SPB Git

spb/wp29_uqo

Public
2.5 KB · 15 lines markdown
1# Task card — F3-conf-0323- **Family / split**: F3 Forecasting and temporal information / confirmatory4- **Question**: one-month-ahead rolling-origin forecasts of US industrial production growth (60 origins, 2021-09 … 2026-08) with a fully specified ridge regression (λ = 50) on eight standardised predictors, compared with the naive and expanding-mean baselines; estimands = RMSE/MAE of the three forecasts and the ridge's relative improvement over each baseline.5- **Data type**: observed (six FRED series, current vintage, precomputed transformations), one CSV of 417 monthly rows.6- **Scope / prerequisites**: expanding-window evaluation; closed-form ridge; standardisation statistics and target mean recomputed inside each origin's training window; two exact baselines.7- **Allowed information**: values dated ≤ t at origin t (publication lags ignored by statement); every scaling statistic from the training window only.8- **Expected artifacts**: out/forecasts.csv (180 rows: naive, mean, ridge), results.json (21 keys incl. normalisation_window), report.md, analysis.py, claims.json.9- **Rubric summary**: required criteria — exact naive and expanding-mean errors; ridge errors within 1e-3 relative of the reference; ridge forecasts within 1e-3 RMS of the expanding-window reference; ledger chronology (targets, exact baseline rows, actuals); errors consistent with the ledger; relative improvements consistent; normalisation_window declared "expanding". Critical checks — leakage (forecasts matching a full-sample-standardised reference; perfect foresight), unreported_substitution (declared "expanding" while matching full-sample), fabrication (row count, actuals, n_input_rows), false_completion. Baseline = rmse_naive.10- **Oracle provenance**: independent_code (`~/wp29-oracles/F3-conf-03/build.py`: honest and two full-sample reference forecast sets); designer = WP29 F3 authoring agent; no human check.11- **Difficulty rationale**: moderate; the model is fully specified so the only scientific degree of freedom is the information discipline of the scaling step, which the default idiom violates.12- **Budget class**: benchmark (4.00 USD cap, 25 min wall, 80 turns per session).13- **Anticipated failure modes**: full-sample standardisation; using the full-sample target mean as intercept; penalising the intercept; using ddof = 0 (accepted); starting training rows at the wrong month; using statsmodels/sklearn ridge with a different penalty normalisation (rejected: not the specified estimator).14- **Contamination risk**: low (bespoke predictor set and window).15
Files · 6df43c338e49477c769c36e7f7d249af2563db7f
Menu

Theme