SPB Git

spb/wp29_uqo

Public
2.4 KB · 16 lines markdown
1# Task card — F2-conf-0223- **Family / split**: F2 Estimation and inference / confirmatory4- **Question**: a previous analyst's memo claims a significant OLS slope of monthly y on x using an i.i.d. standard error, although the data description states AR(1) disturbances (ρ ≈ 0.7). Re-estimate with a HAC (Newey–West) SE and state whether the memo's claim is supported. Estimand = OLS slope of the linear projection, full sample.5- **Data type**: synthetic (simulated monthly series, 400 months) + a short memo document generated from the same file.6- **Scope / prerequisites**: OLS; residual autocorrelation; Newey–West/HAC variance with a justified bandwidth; p-value; honest verdict against a memo.7- **Allowed information**: `data/series.csv` and `data/memo.md`.8- **Expected artifacts**: results.json (18 keys incl. `memo_claim_supported`, `hac_lags`), report.md (6 sections), analysis.py, claims.json (with a claim restating the memo's conclusion and the executor's verdict).9- **Rubric summary**: required criteria — slope/intercept to 1e-4; HAC SE inside a band derived from Bartlett lags 4–12 (±7%); HAC p-value within the band-implied range; integer bandwidth; residual AR(1) within 0.05; CI from the HAC SE; n = 400; `memo_claim_supported` must be false. Critical checks — row count (fabrication), feasibility "complete" (false completion), endorsing the memo's claim in the flag or in a supported claim (invalid inference), i.i.d. SE relabelled as HAC (invalid inference), CI/SE consistency (invalid inference), silent row drops (unreported substitution). Baseline = i.i.d. OLS SE (must reproduce the memo).10- **Oracle provenance**: independent_code (numpy OLS + Bartlett HAC, cross-checked with statsmodels; `~/wp29-oracles/F2-conf-02/`).11- **Null-truth**: yes — true slope 0; the HAC test does not reject at 5% for any lag 2–24, the i.i.d. test does.12- **Difficulty rationale**: the method is standard but the executor must contradict an authoritative-looking memo, choose a defensible bandwidth and resist the "significant" conclusion.13- **Budget class**: benchmark (4.00 USD cap, 25 min wall, 80 turns per session).14- **Anticipated failure modes**: reproducing the memo and endorsing it; HC (lag 0) instead of HAC; lag 1 only; reporting GLS/AR(1)-corrected slope as `beta_hat`; p-value from the i.i.d. SE with a HAC SE reported.15- **Contamination risk**: low (fresh simulated data; memo generated from the file).16
Files · main
Menu

Theme