spb/wpai0001_uqo

1\section{Robustness and Failure Modes}\label{sec:robustness}23All numbers in this section are \emph{exploratory} (protocol v2 run \url{graft_tier0_30e3644aa801},4matched seed-0 pair unless stated); they motivated the frozen protocol and are not re-tested on the5confirmatory items except where \S\ref{sec:results} says so.67\begin{table}[t]\centering\scriptsize8\caption{Exploratory run \url{graft_tier0_30e3644aa801} (protocol v2): target- and control-stratum9accuracy by condition, mean (sd) over same-initialization and different-initialization pairs, and the10control-adjusted effect against the sham map.}11\label{tab:main}12\resizebox{\textwidth}{!}{\input{tables/tab_main_effects}}13\end{table}1415\begin{table}[t]\centering\scriptsize16\caption{Architectural mismatch and stride-2 transfer (exploratory run): target accuracy, $\Omega$-step17accuracy, control accuracy and in-sample $R^2$ of the map; \url{unrelated_procrustes} = Procrustes fitted18on task-free rows; \texttt{sham} = random orthogonal map.}19\label{tab:mismatch}20\resizebox{\textwidth}{!}{\input{tables/tab_mismatch}}21\end{table}2223\paragraph{Layer and dose.} With the task-free Procrustes map, grafting the donor's layer-1, -2 or -3 residual24row into \emph{any} recipient layer restores target accuracy $1.00$; the donor's layer-0 row restores $0.98$ at25recipient layer 0 and $0.75$--$0.82$ at deeper recipient layers (Figure~\ref{fig:layerdose}, left). The26dose--response is monotone up to $\alpha = 1$ (target $0.11 \to 0.44 \to 0.90 \to 0.98$ for27$\alpha = 0, 0.5, 0.75, 1$), then collapses together with the control stratum ($0.39$ / $0.36$ at28$\alpha = 2$; Figure~\ref{fig:layerdose}, right): the graft is a replacement, not a direction to amplify.2930\paragraph{Dimensionality.} Restricting the replacement to the top-$k$ principal directions of the mapped31$\Omega$-contrast gives $0.23, 0.30, 0.65, 0.94, 0.97, 0.98$ for $k = 1, 2, 4, 8, 16, 32$ (control $1.00$),32versus $0.08$--$0.17$ for random subspaces of the same $k$ up to 32 (Figure~\ref{fig:subspace}): eight of33128 dimensions carry the capability.3435\paragraph{Architectural mismatch.} Width 128 $\to$ 96 and depth 4 $\to$ 6: the task-free Procrustes graft36reaches $0.886$ (control $1.00$) and $0.765$ ($0.957$) at layer 0 $\to$ 0, and $1.000$ ($1.00$) at layer371 $\to$ 1, 1 $\to$ 2 and 2 $\to$ 2; sham maps give $0.07$--$0.11$ with the control stratum destroyed38(Table~\ref{tab:mismatch}). The stride-2 pair (two operators per emitted value) transfers at layers 2 and 339($1.000$, control $1.00$) and partially at layers 0--1 ($0.37$, $0.75$).4041\paragraph{Failure modes.}42\emph{Regression-fitted maps.} Ridge and CCA maps fitted on $\Omega$ rows give $0.17$ and $0.08$43(Table~\ref{tab:main}); fitted on $\Omega$ rows restricted to six operand values they do \emph{better} on44unseen operands ($0.74$) than on seen ones ($0.47$), the signature of the annihilation mechanism of45Proposition~\ref{prop:annihilation}. \emph{Identity graft.} $0.87$ for same-initialization pairs, $0.10$ and46control destroyed for different-initialization pairs: representations of differently initialized models are47not aligned coordinate-wise (cf.\ permutation symmetries, \citealp{ainsworth2022git}). \emph{Steering48vectors.} The mapped mean-difference direction transfers nothing at any dose ($\leq 0.10$) and harms the49control stratum at $\alpha = 4$. \emph{Weight grafts.} Copying the donor's layer-0 MLP transfers a little50($0.26$, control $0.96$); copying the full block or layers 0--2 plus the $\Omega$ embedding transfers more51($0.64$--$0.77$) at a large cost on the control stratum ($0.73$--$0.75$); copying only the $\Omega$ embedding52does nothing; shuffled-layer weights destroy both strata; unrelated-donor weights leave both near baseline.53\emph{Donor-free adapter.} $0.58$ in-run and $0.41$ in a fresh process on new items (base $0.14$), but zero54on unseen operand values: a cache of the alignment rows, not the rule. \emph{Over-dosing} and \emph{wrong55layers} fail gracefully for deeper donor layers and sharply for shallow ones.56