1# DELIVERY REPORT — WP45 / JoF-250 (2026-11-03)23Executor: Claude Code 2.1.317 (claude-fable-5-1) operating autonomously on the author's MacBook Pro, under the mandate in `CLAUDE.md`. All times America/Toronto. Everything below was verified by running the commands listed; nothing is projected.45## 1. Completed features67| Phase | Deliverable | Evidence |8|---|---|---|9| 1 Inventory | 278 files scanned, **276 included**, 2 excluded (`index.csv`; AFA 2021 program mislabelled as article), 0 duplicates, **276/276 Crossref-verified**, frozen manifest `corpus_v1_frozen.json` | `data/manifests/corpus_audit.md`, `jof250 corpus audit` |10| 2 Extraction | PyMuPDF heuristic parser v1.3; 276/276 parsed, mean confidence 0.951; QA vs pdftotext regex (26-doc sample): sections 85% exact (26/26 after adjudication), tables ±1 96%, figures 92%, references ±10% 92%; title vs Crossref ≥ 90: 98.9% | `data/derived/parser_qa.md`, `scripts/02_parser_qa.py` |11| 3 Ontology | 12-part schema v1.0 (strict JSON schema), 276/276 valid annotations (228 first pass, 38 deterministic repairs, 10 uncached retries); deterministic cross-checks; cost 22.1 USD | `src/jof250/rhetoric.py`, `data/annotations/` |12| 4 Profiles | 8 YAML profiles (train split 221 docs) with medians/IQR/bootstrap CIs, move prevalence, contribution placement; 4 figures | `profiles/`, `figures/` |13| 5 Retrieval + engine | 9 642-unit hybrid index (BM25 + MiniLM, provenance); engine modes outline/write/upgrade, conditions A–E, deterministic audits, referee pass, proposal+report+diff contract; 5 review roles; evidence lookup | `src/jof250/{embeddings,retrieval,generation,auditing}.py` |14| 6 Claude Code | 10 slash commands, 7 agents, 1 skill (project + user scope); registration verified in a live session (skill + commands listed; `jof-*` agent types available); `/jof-audit` executed headlessly from a separate sample project | `.claude/`, `experiments/outputs/demo/separate_project_test.md` |15| 7 Experiment | Preregistration frozen (commit 87c73cd) before runs; run 1 discarded after two defects (A-004, archived); **run 2**: 199/199 runs, 33 blind judge sets; preregistered analysis with cluster bootstrap + Holm | `experiments/preregistration.md`, `experiments/analysis/results_heldout_v1.json` |16| 8 Paper | LaTeX WP45 (UQO template), 11 sections + appendices A–H, 64 verified references, all numbers from `numbers.tex` macros; compiled PDF | `paper/main.pdf` |17| 9 Tests | 29 pytest tests (inventory, hashes, duplicates, parsing, schema, segmentation cap, auditing, overlap, CLI, Claude Code files, provenance, budget cap, retrieval, Markdown loader regression) — all pass | `make test` |1819## 2. Commands actually run (chronological, abridged)20`jof250 corpus audit` (×4, fixes in between) · `jof250 corpus parse --force` (×3) · `python -I scripts/02_parser_qa.py` · `python -I scripts/03_make_splits.py` · `jof250 corpus annotate --workers 4` (+ repair/retry pass) · `jof250 profiles build` (×3) · `jof250 index` (×2) · `jof250 write --paper …/wp41_uqo --section introduction --mode upgrade --output experiments/outputs/demo/wp41_intro_upgrade_E.tex` · `jof250 review --paper …/autonomous-research-claude-code --role referee --output experiments/outputs/demo/wp29_referee.md` · `jof250 install-claude-code --scope project|user` · `claude -p "/jof-audit /tmp/sample-paper"` · `python -I scripts/04_build_fixtures.py` · `jof250 benchmark --dry-run` · `jof250 benchmark --config config/evaluation.yaml --workers 8` · `python -I scripts/05_analyze_benchmark.py heldout_v1` · `python -I scripts/07_make_numbers.py` · `make test` · `cd paper && latexmk -pdf main.tex`.2122## 3. Actual measurements23- Corpus: 276 docs (2017: 63, 2018: 65, 2019: 74, 2020: 74); 263 articles, 4 presidential addresses, 8 corrigenda/replications, 1 retracted article; 11 735 pages; median 43 pages, 10 965 body words, 8 tables, 3 figures, 10 numbered equations, 52 references, 101-word abstract.24- Profiles (empirical, n = 173): abstracts state results in 100% and a magnitude in 29%; 90% of introductions open with a motivation move; contribution paragraph median relative position 0.63; roadmap in 65%; median causal-language strength 3/5 (theory papers 1/5); economic significance discussed in 93%; conclusions bounded in 83%.25- Benchmark run 2 (finance held-out, n = 24 paired): H1 not supported (D−B argument logic +0.04 [−0.16, 0.22]); H2 not supported (D−C |Δ| ≤ 0.12); **H3 supported** (E−D rigor +0.96 [0.44, 1.47], Holm p = 0.0085; fidelity +0.46 [0.03, 0.69], p = 0.024); usefulness E−D −0.33 [−0.78, 0.06] n.s.; ablation: referee pass carries the effect (+1.25 rigor, +0.56 fidelity); unsupported claims E−C −1.00 [−1.59, −0.16]; unverifiable citations ≈ 0 in all conditions; overlap with non-source corpus documents max 0.007; judge second-pass Spearman 0.41–0.84; E costs 0.32 USD and 98 s per task vs 0.15 USD and 49 s for D.26- API spend: 93.2 USD total (annotation 22.1, benchmark run 1 ≈ 29 — discarded, run 2 ≈ 42, demos ≈ 0.6) under the 110 USD envelope (A-001, A-005).2728## 4. Uncompleted work and blockers29- **No human evaluation** (no qualified raters available in session): H1 as stated in human-rated terms untested; protocol and blinded outputs prepared.30- **Pilot scale**: 2 held-out finance documents + 1 out-of-domain manuscript; 1–2 repetitions.31- **H5 metric mis-specified in the preregistration** (self-overlap); refined post hoc and both values reported.32- **Run 1 discarded** (A-004): Markdown loader dropped most fixture material; two tasks mis-framed; found by the results-writing agent from judge justifications; fixed, regression-tested, re-run.33- **Cost-matched comparison** not run (E uses two calls).34- Human gold standard for the parser and human inter-rater reliability for the ontology not available; automated cross-checks reported instead.35- `financial_econometrics` profile has only 8 documents (engine falls back to `empirical_all`).36- spbgit: repository `wp45_uqo.git` created and pushed (see git log); SSRN not submitted.3738## 5. Amendments39A-001 budget envelope 60 → 90 USD; A-002 corpus scope = volumes 72–75 (277 → 276 documents); A-003 global Claude Code install on explicit request; A-004/A-004b benchmark re-run after loader/material/task-framing defects; A-005 envelope 90 → 110 USD.40