SPB Git

spb/wpai0001_uqo

Public
4.8 KB

# Claim-to-evidence table — WP-AI-0001 (Gate F)

Every claim in the manuscript maps to a run id, a results key and a generator. "Status" = confirmatory (preregistered, new seeds), exploratory (protocol selection), or pilot.

# Claim (paper section) Evidence (run → key) Generator Status
C1 Donor 1.000 vs recipient 0.092 on the target stratum; Ω-step 1.000 vs 0.062; control 1.000 both (§5.1) pilot_tier0_opseq_451ef5087182 → across_seeds, across_seeds_omega_step scripts/run_pilot.py → tab_pilot_gap.tex, fig_gap_tier0.pdf pilot
C2 Hooks bitwise no-op; MLX wrapper bitwise no-op (§5.2) pilot → noop; tests/integration/test_mlx_noop.py pytest pilot / test
C3 Ω executed at the read position: resid patch 1.00 at every layer, attn_out L0 1.00, MLP L0–L2 1.00/0.90/0.83, head 0 of L0 0.62; across-seed r ≥ 0.96 (§5.3) pilot → localization scripts/run_pilot.py → fig_localization_*.pdf pilot
C4 Primary graft: target 0.966 (sd 0.037, min 0.889), control 0.992 (min 0.946); Δ_T^adj +0.875 (sd 0.042, min +0.776), lower bound > 0.25 in 9/9 pairs → H2 supported; H4 not supported (§5.4) graft_tier0_confirmatory_0c2257f6803e → CONFIRMATORY.md, confirmatory.json (primary) scripts/confirmatory_analysis.py, tab_confirmatory.tex confirmatory
C5 Controls: sham 0.091 (control 0.100), norm-matched random 0.091, shuffled item 0.103, shuffled layer 0.186 (control 1.000), unrelated donor 0.076 (control 1.000) (§5.4) confirmatory → conditions.ctl_* tab_confirmatory.tex confirmatory
C6 Subspace k=8 vs random k=8: +0.850 [+0.837, +0.862] (0.927 vs 0.077) (§5.4) confirmatory → secondary.subspace_k8_vs_random, holm confirmatory_analysis.py confirmatory
C7 Adapter graft +0.472 [+0.453, +0.490] (0.544); fresh process 0.344 [0.317, 0.372] vs 0.115 (§5.4) confirmatory → secondary.adapter_vs_base, persistent/fresh_process_eval.json eval_persistent.py confirmatory
C8 Weight graft L0 block vs shuffled: +0.556 [+0.537, +0.577]; retention 0.720 (min 0.310) (§5.4) confirmatory → secondary.weight_L0_block_vs_shuffled idem confirmatory
C9 Rule vs cache: Procrustes seen-fit 0.941 [0.919, 0.960] seen / 0.768 [0.727, 0.808] unseen, ratio 0.816 → H5 supported; adapter 0.702 / 0.000 (§5.4, §6) confirmatory → rule_vs_cache fig_mechanism_tier0.pdf (confirmatory build) confirmatory
C10 Ablation 0.113 → rescue 1.000, sham rescue 0.106; reverse graft 0.972 (§5.4, §6) confirmatory → mechanism idem confirmatory
C11 Width 128→96: 0.901 (L0→0), 1.000 (L1→1); depth 4→6: 0.783, 0.999, 1.000, 1.000; stride-2: 0.386, 0.760, 1.000, 1.000; shams 0.08–0.13 (§5.4) confirmatory → portability tab_mismatch.tex (exploratory build), confirmatory.json confirmatory
C12 Supervised adapter and distillation 1.000 on both strata (§5.4) confirmatory → conditions.baseline_* tab_confirmatory.tex confirmatory
C13 Exploratory: identity graft 0.873 same-init / 0.101 diff-init; ridge-on-Ω-rows 0.17; CCA 0.08; ridge task-free 0.81; Procrustes Ω-rows 0.79/0.70; task-free Procrustes 0.993/0.956 (§7, Table main) graft_tier0_30e3644aa801 → conditions, across_pairs tab_main_effects.tex, fig_pareto_tier0.pdf exploratory
C14 Layer grid 1.00 for donor L1–L3 → any layer, L0→0 0.98, L0→1–3 0.75–0.82; dose 0.44/0.90/0.98/0.92/0.75/0.39 (§7) v2 → layer_grid, dose fig_layer_dose_tier0.pdf exploratory
C15 Subspace k = 1…32: 0.23, 0.30, 0.65, 0.94, 0.97, 0.98; random 0.08–0.17 (§7) v2 → conditions.subspace_* fig_subspace_tier0.pdf exploratory
C16 Steering ≤ 0.10; weight grafts L0 MLP 0.26 (0.96), block 0.64 (0.73), L0–2+embed 0.77 (0.75); Ω embedding only 0.075 (§7) v2 → conditions tab_main_effects.tex exploratory
C17 Annihilation proposition (§3) Appendix A proof — theorem
C18 Tier-1: within-model sufficiency (antonym 0.84–0.88, capital 0.82–1.00, add-three only Llama 0.80, morph none); confirmatory H6 partial for 1.5B→3B and Llama→3B, not supported for 3B→1.5B and 3B→Llama (§5.5) dev tier1_taskvector_e105e3d91386; conf tier1_taskvector_confirmatory_625c54bd186f → TIER1_CONFIRMATORY.md, tier1_confirmatory.json scripts/tier1_analysis.py, tab_tier1_confirmatory_625c54.tex, fig_tier1_transfer_e105e3.pdf confirmatory
C19 Tier-2: 7B→3B antonym +0.53 [+0.34, +0.72] (H6 partial); 3B→7B not supported; 7B→Llama nothing transfers (§5.5) dev tier1_taskvector_eb5d091bf5ed; conf tier1_taskvector_confirmatory_532eb68bd5e2 tab_tier1_confirmatory_532eb6.tex, fig_tier1_transfer_eb5d09.pdf confirmatory
Files · main
Menu

Theme