STATUS: seed results, denoising runs
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
1 changed file +1 −1
modified
docs/STATUS.md
+1 −1
@@ -6,7 +6,7 @@ | ||
| 6 | 6 | | A — repository, governance, 100-paper smoke, quality audit | **GO** | `docs/gates/GATE_A.md` | |
| 7 | 7 | | B — 500–1 000 validated Claude pairs, spend, human review | **GO** (974 passages, 5 383 validated pairs, 29.68 USD total spend) | `docs/gates/GATE_B.md` | |
| 8 | 8 | | C — leakage-safe splits, reproducible baselines, benchmark + statistical plan | **GO** (splits frozen; B0/B1 run on val; pre-registration v1.0 frozen at `e74b7126` + A1) | `docs/gates/GATE_C.md` | |
| 9 | −| D — M1/M2/M3 training, one-batch overfit, pilot results | in progress — exploratory val: B0 chrF 71.2, B1 68.4, **M1-tiny 32.9** (from scratch, overfits after step 750, degenerate repetitions); M2 best val CE 3.72 vs M1 3.69; M3 full objective worse (val CE 5.9 at step 1000); M3 token-only, B2 T5-small, M1 seed 2 running; **denoising pretraining (D17) started on M3U96a** | `artifacts/metrics/pilot_val_exploratory/`, `artifacts/runs/` | | |
| 9 | +| D — M1/M2/M3 training, one-batch overfit, pilot results | in progress — exploratory val (502 pairs): B0 chrF 71.2 · B1 68.4 · **B2 T5-small 68.8** (W1 to originals 0.112 < 0.170, i.e. closer style distribution but lower lexical fidelity) · **M1-tiny from scratch 32.9** (degenerate). Best val CE over seeds 1–3: M1 3.69/4.09/4.31 · M2 3.72/5.03/3.71 · M3 token-only 3.80/3.74/3.58 · M3 with auxiliary losses ≈ 5.4 → diagnosed (D18): the L_fact normalisation, not the architecture; fixed and re-running. **Denoising pretraining (D17)**: pilot tiny val CE 1.62 @ 9 500 steps (M3U96a); Medium tiny (M3U96b) and Medium small 130 M (M4M64a) running. | `artifacts/metrics/pilot_val_exploratory/`, `artifacts/runs/`, `docs/DECISION_LOG.md` D17–D18 | | |
| 10 | 10 | | E — larger training | not started (depends on D) | — | |
| 11 | 11 | | F — release + paper | scaffolding only (release exporter, CLI, demo, model-card template, paper skeleton compiles: 5 pages of placeholders) | `src/htr/release`, `src/htr/cli.py`, `demo/`, `paper/` | |
| 12 | 12 | |
| 13 | 13 | |