SPB Git

spb/wp31_uqo

Public
3.6 KB · 47 lines latex
1\begin{proof}[Proof of Proposition~\ref{prop:causal}]2By induction on the number of executed actions. Base case: $S^{(0)}_j=e_j+P\,\mathrm{RMSNorm}(h_t)$ with3$h_t=B_\phi(x_{1:t})[t]$, a function of $x_{1:t}$ by causality of $B_\phi$. Inductive step: if $S^{(r)}$ and the4controller features at step $r$ depend on $x_{1:t}$ only, then the action $a_{r}$ does (it is a function of those5features under Assumption~\ref{ass:causal}), the editor's inputs are $S^{(r)}$, the context scalars, and the bank6rows $\{(K_j,V_j)\}_{j\le t}$, each a function of $H_t[1{:}t]$ and hence of $x_{1:t}$; so $S^{(r+1)}$ depends on7$x_{1:t}$ only. The readout and head are deterministic functions of $(S^{(n_t)},S^{(0)},z_t,h_t)$. In the parallel8teacher-forced implementation the per-query mask $j\le t$ enforces the same restriction although all of $H_T$ is9resident in one tensor; the unit test perturbs $x_{t+1:T}$ and verifies that $\ell_{1:t}$ is unchanged.10\end{proof}1112\begin{proof}[Proof of Proposition~\ref{prop:identity}]13If $n_t=0$ then $S^{(n_t)}=S^{(0)}$ and $r(S^{(n_t)},z_t)-r(S^{(0)},z_t)=0$, hence $\Delta_t=sU0=0$ and14$h^{\mathrm{corr}}_t=h_t$. In the implementation two separate branches return the backbone head directly:15one when the requested budget is zero (before any slot is allocated or any bank row is read), and one for every16position whose edit count is zero after routing; both compute exactly the expression $E\,\mathrm{RMSNorm}(h_t)$ on17the same tensor $h_t$ and are therefore bitwise equal to the backbone-only forward on the same device with the same18kernels (tests 02--04 and the cache test). The statement about joint fine-tuning is immediate: $h_t$ is whatever19the current backbone produces.20\end{proof}2122\begin{proof}[Proof of Proposition~\ref{prop:locality}]23The new workspace is $S'=\mathbb{1}[m\in I]\odot C+\mathbb{1}[m\notin I]\odot S$ where24$C_m=\sum_{i} \mathbb{1}[\iota_i=m]\,\tilde S'_{\iota_i}$ sums the (at most two) lane results $\tilde S'$ over the25lane indices $\iota_i$ of the action. For $m\notin I$ the first term is zero and $S'_m=S_m$ by the identity26$0\cdot x + 1\cdot y = y$, which is exact in IEEE arithmetic for finite $y$. For a pair, the two lanes have27distinct indices, so $C_m$ is a single lane result plus exact zeros; both lanes read the same snapshot $\bar S$ and28neither reads the other's output, so permuting the lanes permutes the summands of an exact sum of one nonzero29term and zeros, leaving $C$ unchanged.30\end{proof}3132\begin{proof}[Proof of Proposition~\ref{prop:displacement}]33Each write into slot $j$ adds $\eta_j\delta^c_j$ with $0<\eta_j\le\eta_{\max}$ and $\rms(\delta^c_j)\le c$ by the34clipping rule (if $\rms(\delta_j)\le c$ the factor is $1$ and $\rms(\delta^c_j)=\rms(\delta_j)\le c$; otherwise35$\rms(\delta^c_j)=c\,\rms(\delta_j)/\rms(\delta_j)=c$ up to the $\epsilon$ guard, which can only shrink the step).36Since $\rms(\cdot)=\|\cdot\|_2/\sqrt{w}$ is a norm, the triangle inequality gives37$\rms(S^{(R)}_j-S^{(0)}_j)\le\sum_{\text{writes into }j}\eta_j\rms(\delta^c_j)\le n_j\eta_{\max}c$.38\end{proof}3940\begin{proof}[Proof of Proposition~\ref{prop:regret}]41Let $a^\star=\arg\max_a J(a)$ over $\Act\cup\{\Stop\}$ and $\hat a=\arg\max_a\hat J(a)$. Both $J$ and $\hat J$42assign $0$ to \Stop. For every $a\in\Act$, $|\hat J(a)-J(a)|\le|\hat g-g|+\lambda|\hat c-c|\le\varepsilon+\lambda\delta=:\Delta$,43and $|\hat J(\Stop)-J(\Stop)|=0\le\Delta$. Then44$J(a^\star)-J(\hat a)=\big(J(a^\star)-\hat J(a^\star)\big)+\big(\hat J(a^\star)-\hat J(\hat a)\big)+\big(\hat J(\hat a)-J(\hat a)\big)45\le\Delta+0+\Delta=2\Delta$, the middle term being non-positive by the choice of $\hat a$.46\end{proof}47
Files · f94c71f5c2e9d93426ef4886b309b4e0a6711296
Menu

Theme