| 2026-10-29 |
test_incremental_equals_full_prefix_forced: cached decoding ≠ full-prefix forward. |
pytest, atol 1e-4 |
Root cause: forced-action forward let edits resume after STOP; made STOP absorbing (D4). |
| 2026-10-29 |
rsync exclusion experiments also dropped configs/experiments/; baseline launch on M3U96b failed twice (FileNotFoundError). |
experiments/logs/pretrain_enlarged102m_seed1.log (first attempts) |
anchored pattern /experiments. |
| 2026-10-29 |
Stage B bootstrap degeneracy (brief §13.1 confirmed): with U = 0 and lr 1e-3, 700 steps of forced mixed-budget training left val loss identical at every budget (0.4144 / 0.4143 / 0.4143 / 0.4146 / 0.4164 for budgets 0/1/2/4/8); grad-norm 0.01–0.02. Diagnosis: scale mismatch — backbone residual rms 5.64 vs readout difference rms 0.06, so U must grow by ×100 before edits can affect logits. |
experiments/runs/p4_editor_v1_seed01_*/metrics.jsonl (stopped at step ~750) |
D9: fixed non-learned readout_scale = measured backbone residual rms at bootstrap (keeps U = 0 init and exact identity; equivalent to a scale-aware learning rate). Variants with nonzero U init (std 0.02) and lr 3e-3 kept running on M2U64 / M4M64c as evidence. |
| 2026-10-30 |
Editor collapse at lr 3e-3 (w = 128 mixed budgets): after 500 steps every budget gives exactly the budget-0 loss (0.4005) and the trainable gradient norm is 0.00 — the adapter learned to make all edits inert (gate/U → 0) instead of useful. |
M4M64a experiments/logs/p4_diag_mixed_w128_lr3e3.log, run p4_diag_mixed_w128_lr3e3_seed01_* |
"harmless collapse" is a real failure mode of the bootstrap; lr 1e-3 retained. |
| 2026-10-30 |
Global-recurrence baseline run crashed at the final exact-match evaluation (AttributeError: 'GlobalRecurrenceModel' object has no attribute 'W_K'): the cached generator assumed PRISME caches. Training and the step-3000 checkpoint are intact. |
M5M36 experiments/logs/p4_gr_mixed_w64.log |
added generate_uncached fallback (full recomputation) for models without the bank; EM re-run from the checkpoint. |
| 2026-10-30 |
Joint fine-tuning reference (backbone unfrozen, lr 3e-4, answer-span loss): validation loss rose from 0.4005 to 0.472 at every budget after 500 steps — the backbone degraded under the narrower objective and the large learning rate. |
M4M64a experiments/logs/p4_joint_mixed_w64.log |
Not a usable upper reference as run; a low-lr variant is deferred (not required by the pre-registered comparison). |
| 2026-10-30 |
v2 tiny backbone (5.6M, 15k planned steps) overfit the 23k-item train split: validation loss (all tokens) 0.246 at step 6k → 0.282 at step 9k. Run stopped at step 9,300; the step-5,000 checkpoint (val 0.249) is used as the frozen v2 backbone. |
experiments/logs/p4_tiny_backbone_v2.log, run p4_tiny_backbone_v2_seed01_* (state: stopped) |
42 epochs of a small synthetic set is too many; schedule not re-run (the checkpoint is adequate as a frozen comparator). |
| 2026-10-30 |
Killed to free nodes for the 5-seed matrix: the degraded joint-finetune reference (M4M64a) and the v1 dense-writes run on the slow m4mn node (superseded by the v2 matrix p4v2_dense). |
manifests remain in experiments/runs/ on the nodes (state: running → killed) |
— |