SPB Git

spb/wp29_uqo

Public
1009 B · 15 lines markdown
1# Verification checks (P4)2| check | outcome |3|---|---|4| Clean re-run (deleted results/forecasts/exclusions, re-ran analysis.py): byte-identical results.json and forecasts.csv | PASS |5| forecasts.csv has 144 rows, 36 unique origins | PASS |6| target_date = origin_date + h months for every row | PASS |7| n_evaluated_h1 = n_evaluated_h3 = 35; 36 − 35 = 1 missing target per horizon (2025-10-01) | PASS |8| RMSE ≥ MAE > 0 for all model/horizon pairs | PASS |9| rel_improvement = 1 − rmse_model/rmse_naive (to 1e-12) | PASS |10| first_origin < last_origin | PASS |11| Exclusion ledger: 945 − 1 − 3 = 941 = n_analysed | PASS |12| Naive forecast equals latest non-missing obs ≤ origin (incl. origin 2025-10-01 → 2025-09 value 4.4) | PASS |13| Magnitude: model forecasts within 0.2 pp of naive; model RMSE within 3% of naive RMSE | PASS |14| Information rule: training series truncated with s.loc[:t] at each origin (code inspection); model spec fixed a priori, not tuned on evaluation errors | PASS |15
Files · main
Menu

Theme