SPB Git

spb/wp29_uqo

Public

# F2-conf-02 — Is the memo's slope really significant?

# Question

The earlier memo (data/memo.md) regressed monthly y on x by OLS (with intercept, 400 months) and said the slope is significant at 5%, using conventional iid standard errors. The task description says the disturbances follow an AR(1) with autocorrelation of about 0.7 and that x is persistent. Under those conditions iid standard errors are too small. I re-estimated β in y_t = α + β x_t + u_t and tested H0: β = 0 with a Newey–West (Bartlett) HAC standard error.

# Data and exclusions

data/series.csv has 400 rows covering 1990-01 to 2023-04 (n_input_rows). There are no gaps, no duplicate months and no missing values, so I removed nothing (out/exclusions.csv), n_analysed = 400 and data_issues is empty. The x and y series have lag-1 autocorrelations of 0.66 and 0.62 (out/state/data_audit.md). The data are synthetic.

# Method

  • OLS of y on a constant and x. The conventional iid standard error (se_iid) is the memo's measure and serves as the baseline.
  • rho_resid is the lag-1 autocorrelation of the OLS residuals.
  • HAC standard error: Newey–West with the Bartlett kernel, through statsmodels cov_type="HAC", including the small-sample correction n/(n−k).
  • Bandwidth: I used the Andrews (1991) AR(1) plug-in for the Bartlett kernel, fitted to the slope score v_t = (x_t − x̄)·û_t. This targets the persistence that actually drives the slope's variance. The score's lag-1 autocorrelation is 0.401, which gives S = 8.18, so hac_lags = 8. I also set a floor at the Newey–West rule of thumb, floor(4(T/100)^{2/9}) = 5. Details are under bandwidth_details.
  • Inference: t = β̂/se_hac, a two-sided normal p-value, and a 95% CI of β̂ ± 1.96·se_hac.
  • No randomness is involved (random_seed = null).

# Results

  • alpha_hat = 2.0925 and beta_hat = 0.1017. se_iid = 0.0448, t_iid = 2.27 and p_iid = 0.0238. These match the memo to its stated rounding (memo_reproduced), so the memo's arithmetic is correct.
  • rho_resid = 0.609. The residuals are strongly autocorrelated, so the iid assumption fails.
  • se_hac = 0.0653 with hac_lags = 8. That is 1.46 times the iid standard error (se_ratio_hac_over_iid).
  • t_hac = 1.56 and p_hac = 0.119. The 95% CI is [beta_ci_low, beta_ci_high] = [−0.026, 0.230], which includes 0.
  • Verdict: memo_claim_supported = false. Once the standard error allows for serial correlation, the slope is not significant at the 5% level.

# Uncertainty

The verdict holds for every bandwidth tried, from 4 to 24 lags: hac_sensitivity gives p between 0.114 and 0.123, and any_sensitivity_p_lt_005 = false. The point estimate is positive and of the same size as the memo's. The data are consistent with a modest positive association but do not reject β = 0 at 5%.

# Limitations and open issues

  • Newey–West tests over-reject in finite samples when persistence is high. This makes the HAC p-value, if anything, too small, which strengthens the "not significant" verdict rather than weakening it. I did not pursue fixed-b or other refinements because the task does not require them.
  • rho_resid (0.61) is a little below the stated value of about 0.7. This fits the known downward bias of residual autocorrelation estimates and does not change the conclusion.
  • β is a linear-projection coefficient. It is not a causal effect.
Files · main
Menu

Theme