SPB Git

spb/wp29_uqo

Public
1.1 KB · 16 lines markdown
1# Verification checks (P4), 2026-10-302| check | outcome |3|---|---|4| Clean re-run of out/analysis.py (deleted results.json, forecasts.csv, exclusions.csv) regenerates byte-identical results.json and forecasts.csv | PASS |5| forecasts.csv has 192 rows, 48 per (model, horizon) | PASS |6| last_target_date_used <= origin − 2 months for all rows | PASS |7| last_predictor_date_used <= origin − 1 month for model rows; empty for naive | PASS |8| target_date = origin + h for all rows | PASS |9| actual equals data gdp_yoy of target month | PASS |10| MAE <= RMSE for every model/horizon; RMSEs positive | PASS |11| rel_improvement = 1 − rmse_model/rmse_naive | PASS |12| Exclusion ledger: 345 − (12+7+3+25) = 298 = n_analysed (asserted in script) | PASS |13| In-script asserts: plug-in values are the latest available obs (y at t−2, e at t−1) | PASS |14| Magnitudes vs baseline: model RMSE 0.74/0.88 vs naive 0.81/1.14 pp — same order, plausible | PASS |15| Sensitivity (no COVID exclusion) changes ranking of improvement across horizons (h1 0.027, h3 0.319) | NOTED, reported in report |16
Files · main
Menu

Theme