SPB Git

spb/wp29_uqo

Public
1012 B · 16 lines markdown
1# Verification checks (P4)2| check | outcome |3|---|---|4| Clean re-run of out/analysis.py (deleted results.json, forecasts.csv, exclusions.csv) reproduces byte-identical results.json and forecasts.csv | PASS |5| forecasts.csv has 192 rows, 48 per (model, horizon) | PASS |6| target_date = origin + h months for all rows | PASS |7| last_target_date_used <= origin − 2 months for all rows (GDP rule; incl. estimation sample) | PASS |8| last_predictor_date_used <= origin − 1 month for model rows; empty for naive | PASS |9| actual equals data gdp_yoy of target month | PASS |10| naive forecast equals gdp_yoy(t−2) | PASS |11| RMSE/MAE recomputed from ledger match results.json; rel_improvement identity holds | PASS |12| MAE <= RMSE, all RMSE > 0 | PASS |13| Exclusion ledger: 345 − (7+3+19) = 316 = n_analysed | PASS |14| In-script asserts: 48 origins, no missing actuals, lt<=t−2, lp<=t−1 | PASS |15| Magnitudes: model RMSE (0.74/0.95) below naive (0.81/1.14), same order of magnitude; plausible | PASS |16
Files · main
Menu

Theme