SPB Git

spb/wp31_uqo

Public
1.5 KB · 17 lines latex
1\begin{table}[t]\centering\small2\caption{Systems and controls. ``bb'' = backbone, ``$6NP$'' = the usual training-FLOP estimate for $N$ tokens and $P$3parameters; adapter training additionally executes up to 8 editor applications per position. Adapter parameters are4unique parameters outside the backbone (counted by instantiation; the 103M editor includes the residual-plus-entropy5controller features).}6\label{tab:controls}7\begin{tabular}{lrrlll}\toprule8System & backbone & adapter & training exposure & training compute & inference regime\\\midrule9Frozen backbone v2 (budget 0) & 4,754,688 & 182,725 & synthetic train, 5k steps $\times$ 64 & backbone only & no workspace (bitwise bypass)\\10PRISME sparse editor (tiny) & 4,754,688 & 182,725 & same + 3k adapter steps $\times$ 32 & frozen bb fwd + editor & 1--2 slots/action, 0--8 actions\\11Global-recurrence adapter (tiny) & 4,754,688 & 172,608 & same & frozen bb fwd + block & whole latent/action, 0--8 actions\\12Dense 16-slot editor (tiny) & 4,754,688 & 182,725 & same & frozen bb fwd + 16 lanes & 16 slots/action, 0--8 actions\\13PRISME-103M sparse editor & 99,502,848 & 2,762,757 & FineWeb-Edu 98.3M tok + 24.6M adapter tok & $6NP$ + editor & 1--2 slots/action\\14Global-recurrence adapter (103M) & 99,502,848 & 2,623,488 & same & $6NP$ + block & whole latent/action\\15Plain decoder, parameter-matched (102.2M) & 102,157,056 & 0 & FineWeb-Edu 98.3M tok (same recipe) & $6NP$ & no workspace\\16\bottomrule\end{tabular}\end{table}17
Files · main
Menu

Theme