F2-conf-02 — Is the memo's slope really significant?
Question
The memo says the OLS slope of y on x is significant at the 5% level. It reached that conclusion using conventional (iid) standard errors. The task description says the regression errors are AR(1) with autocorrelation of about 0.7 and that x is persistent. Under those conditions iid standard errors understate the uncertainty. I re-estimate β in y_t = α + β x_t + u_t with a HAC (Newey–West, Bartlett) standard error and check whether the memo's claim holds.
Data and exclusions
data/series.csv contains 400 monthly rows from 1990-01 to 2023-04 (n_input_rows). There are no gaps, no missing values and no duplicate months. No rows were removed (out/exclusions.csv), so n_analysed = 400. No data issues were found (data_issues = []). The checksums and summary statistics are in out/state/data_audit.md.
Method
- I ran OLS with an intercept on the full sample. The baseline is the conventional iid standard error (
se_iid). - The headline standard error is a Newey–West HAC standard error with a Bartlett kernel, without a small-sample degrees-of-freedom correction (
se_hac). - Bandwidth (
hac_lags): I used the Andrews (1991) AR(1) plug-in bandwidth for the Bartlett kernel, 1.1447·(α(1)·T)^{1/3}. It is computed on the series whose long-run variance drives the slope's variance, the score v_t = (x_t − x̄)û_t. The score's AR(1) coefficient isrho_score= 0.401. The raw bandwidth (andrews_bandwidth_raw= 8.18) is rounded up to 9 lags. For comparison, the Newey–West (1994) rule of thumb gives 5 lags (nw1994_rule_lags), and I also report a grid of 0–36 lags (out/sensitivity.csv). - Inference uses the normal reference distribution: t_hac = β̂/se_hac, a two-sided p-value, and a 95% CI of β̂ ± 1.96·se_hac.
- The method uses no randomness (
random_seed= null).
Results
alpha_hat= 2.0925 andbeta_hat= 0.1017.- Using iid errors,
se_iid= 0.0448,t_iid= 2.27 andp_iid= 0.0238. These match the memo exactly, so I reproduced its numbers rather than taking them as given. - The first-order autocorrelation of the residuals is
rho_resid= 0.609. That is strongly positive, in line with the persistent errors described in the task. - Using HAC with 9 lags,
se_hac= 0.0652, about 1.46 timesse_iid. This givest_hac= 1.56 andp_hac= 0.119. - The 95% HAC CI runs from
beta_ci_low= −0.026 tobeta_ci_high= 0.230. It includes zero. - Verdict:
memo_claim_supported= false. Once serial correlation is accounted for, the slope is not significant at the 5% level. The memo's significance comes from understating the standard error.
Uncertainty
The verdict does not depend on the bandwidth chosen:
- With the NW1994 rule of 5 lags, the standard error is 0.0644 (
se_hac_nw1994_rule). - For every bandwidth from 5 to 36 lags, the HAC p-value stays between 0.096 and 0.125 (
sensitivity_min_p,sensitivity_max_p). - Only 0 or 1 lags give p < 0.05, and those bandwidths are clearly too short given the residual autocorrelation.
Limitations and open issues
- HAC inference is asymptotic. With persistent x and errors, Newey–West tests with short bandwidths tend to over-reject in finite samples. If that applies here, the true p-value is probably even larger, which would only strengthen the verdict.
- I did not try fixed-b or other alternative inference methods, because the task does not require them.
- The sample residual autocorrelation (0.61) is below the roughly 0.7 stated in the task. That is consistent with the downward bias of autocorrelation estimates from OLS residuals and does not change the conclusion.
- The data are simulated.
- "Not significant" does not mean the effect is zero. The CI is wide and still includes economically meaningful positive slopes.