F2-conf-02 — Is the memo's slope really significant?
Question
The earlier memo (data/memo.md) regressed monthly y on x by OLS (with intercept, 400 months) and said the slope is significant at 5%, using conventional iid standard errors. The task description says the disturbances follow an AR(1) with autocorrelation of about 0.7 and that x is persistent. Under those conditions iid standard errors are too small. I re-estimated β in y_t = α + β x_t + u_t and tested H0: β = 0 with a Newey–West (Bartlett) HAC standard error.
Data and exclusions
data/series.csv has 400 rows covering 1990-01 to 2023-04 (n_input_rows). There are no gaps, no duplicate months and no missing values, so I removed nothing (out/exclusions.csv), n_analysed = 400 and data_issues is empty. The x and y series have lag-1 autocorrelations of 0.66 and 0.62 (out/state/data_audit.md). The data are synthetic.
Method
- OLS of y on a constant and x. The conventional iid standard error (
se_iid) is the memo's measure and serves as the baseline. rho_residis the lag-1 autocorrelation of the OLS residuals.- HAC standard error: Newey–West with the Bartlett kernel, through statsmodels
cov_type="HAC", including the small-sample correction n/(n−k). - Bandwidth: I used the Andrews (1991) AR(1) plug-in for the Bartlett kernel, fitted to the slope score v_t = (x_t − x̄)·û_t. This targets the persistence that actually drives the slope's variance. The score's lag-1 autocorrelation is 0.401, which gives S = 8.18, so
hac_lags= 8. I also set a floor at the Newey–West rule of thumb, floor(4(T/100)^{2/9}) = 5. Details are underbandwidth_details. - Inference: t = β̂/se_hac, a two-sided normal p-value, and a 95% CI of β̂ ± 1.96·se_hac.
- No randomness is involved (
random_seed= null).
Results
alpha_hat= 2.0925 andbeta_hat= 0.1017.se_iid= 0.0448,t_iid= 2.27 andp_iid= 0.0238. These match the memo to its stated rounding (memo_reproduced), so the memo's arithmetic is correct.rho_resid= 0.609. The residuals are strongly autocorrelated, so the iid assumption fails.se_hac= 0.0653 withhac_lags= 8. That is 1.46 times the iid standard error (se_ratio_hac_over_iid).t_hac= 1.56 andp_hac= 0.119. The 95% CI is [beta_ci_low,beta_ci_high] = [−0.026, 0.230], which includes 0.- Verdict:
memo_claim_supported= false. Once the standard error allows for serial correlation, the slope is not significant at the 5% level.
Uncertainty
The verdict holds for every bandwidth tried, from 4 to 24 lags: hac_sensitivity gives p between 0.114 and 0.123, and any_sensitivity_p_lt_005 = false. The point estimate is positive and of the same size as the memo's. The data are consistent with a modest positive association but do not reject β = 0 at 5%.
Limitations and open issues
- Newey–West tests over-reject in finite samples when persistence is high. This makes the HAC p-value, if anything, too small, which strengthens the "not significant" verdict rather than weakening it. I did not pursue fixed-b or other refinements because the task does not require them.
rho_resid(0.61) is a little below the stated value of about 0.7. This fits the known downward bias of residual autocorrelation estimates and does not change the conclusion.- β is a linear-projection coefficient. It is not a causal effect.