SPB Git

spb/wp29_uqo

Public
1.6 KB · 35 lines markdown
1# Verification checks (P4)23- Clean re-run: deleted out/results.json, forecasts.csv, exclusions.csv; ran analysis.py twice; results.json byte-identical (cmp) and forecasts.csv identical md5: PASS4- 32 forecast rows: PASS5- 8 origins x 2 h x 2 models unique: PASS6- vintage_date==origin_date: PASS7- train_last_date < origin_date < target first-release date: PASS8- target = train_last + 3h months: PASS9- naive forecast == train_last_value: PASS10- train_last matches vintage file 2024-01-31: PASS11- train_last matches vintage file 2024-04-30: PASS12- train_last matches vintage file 2024-07-31: PASS13- train_last matches vintage file 2024-10-31: PASS14- train_last matches vintage file 2025-01-31: PASS15- train_last matches vintage file 2025-04-30: PASS16- train_last matches vintage file 2025-07-31: PASS17- train_last matches vintage file 2025-12-31: PASS18- actuals match first_release: PASS19- rmse/mae naive h1 recomputed: PASS20- mae<=rmse naive h1: PASS21- rmse/mae model h1 recomputed: PASS22- mae<=rmse model h1: PASS23- rel_impr h1 identity: PASS24- rmse/mae naive h2 recomputed: PASS25- mae<=rmse naive h2: PASS26- rmse/mae model h2 recomputed: PASS27- mae<=rmse model h2: PASS28- rel_impr h2 identity: PASS29- exclusion ledger: 314 - removed == model n_train (159): PASS30- ledger rows n_before-n_after==n_removed: PASS31- n_input_rows match wc: PASS32- n_analysed == rows of last vintage (314): PASS33- revision stat in plausible range [0,2] pp: PASS34- Magnitude vs baseline: model RMSE (1.48/1.40) below naive (2.01/2.27); AR(1) phi≈0.34, intercept≈1.75 stable across origins (implied mean ≈2.6%) — plausible for US GDP: PASS35
Files · 4f59ed568641ceda6f39552d5cc3a441aa812088
Menu

Theme