SPB Git

spb/wp29_uqo

Public
3.5 KB · 51 lines markdown
1# F2-conf-02 — Re-examining the memo's slope significance claim23## Question4Is the OLS slope β in y_t = α + β x_t + u_t (monthly, 1990-01 to 2023-04) significantly different from zero at the 5% level once the standard error allows for serially correlated disturbances? The previous memo said yes, but it used conventional i.i.d. OLS standard errors.56## Data and exclusions7`data/series.csv` (simulated data): 400 rows, 400 consecutive months with no gaps, no duplicates and no missing values. I made no exclusions, so n = 400. I found no data issues.89## Method10- OLS of y on x with an intercept on the full sample (statsmodels).11- Naïve baseline: the conventional OLS standard error, as in the memo.12- Residual diagnostic: the lag-1 autocorrelation of the OLS residuals.13- HAC standard error: Newey–West with a Bartlett kernel and the small-sample correction n/(n−k).14- **Bandwidth choice.** I used Andrews' (1991) AR(1) plug-in for the Bartlett kernel, S = 1.1447·(α̂(1)·n)^{1/3} with α̂(1) = 4ρ²/((1−ρ)²(1+ρ)²). Here ρ is the lag-1 autocorrelation of the score series v_t = (x_t − x̄)·û_t, which is the series whose long-run variance the HAC estimator targets. With ρ ≈ 0.40 this gives **8 lags**. The Newey–West (1994) rule of thumb, floor(4(n/100)^{2/9}), gives 5 lags. I report a sensitivity check over 5, 8, 12, 18 and 24 lags.15- Inference: t = β̂/se_hac, a two-sided normal p-value, and a 95% CI of β̂ ± 1.96·se_hac.1617## Results18| quantity | value |19|---|---|20| α̂ (intercept) | 2.0925 |21| β̂ (slope) | 0.1017 |22| se, i.i.d. OLS | 0.0448 (t = 2.27, p = 0.024) — matches the memo |23| residual lag-1 autocorrelation | 0.609 |24| se, HAC (Bartlett, 8 lags) | 0.0653 |25| t (HAC) | 1.56 |26| p (HAC, two-sided) | 0.119 |27| 95% CI (HAC) | [−0.026, 0.230] |2829I reproduced the memo's point estimates and its conventional standard error exactly. The residuals are strongly autocorrelated (0.61), and the regressor is also persistent (lag-1 autocorrelation ≈ 0.66). Together these make the i.i.d. standard error too small. The HAC standard error is about 46% larger, and the slope is **not** significant at 5%: p ≈ 0.12, and the 95% CI includes zero.3031**Verdict: the memo's claim that "the slope is statistically significant at the 5% level" is not supported.**3233## Uncertainty34The conclusion does not depend on the bandwidth:3536| lags | se_hac | t | p |37|---|---|---|---|38| 5 (NW rule of thumb) | 0.0645 | 1.58 | 0.115 |39| 8 (Andrews plug-in, main) | 0.0653 | 1.56 | 0.119 |40| 12 | 0.0657 | 1.55 | 0.121 |41| 18 | 0.0663 | 1.54 | 0.125 |42| 24 | 0.0660 | 1.54 | 0.123 |4344At every bandwidth p is above 0.11. The point estimate is positive, so the data do not show that the slope is zero. They also do not give evidence at the 5% level that it differs from zero.4546## Limitations and open issues47- Newey–West HAC inference with persistent errors and a persistent regressor can over-reject in samples of this size, because the HAC standard error tends to be biased downward. Fixed-b or other better-sized methods (e.g., Kiefer–Vogelsang critical values, or larger bandwidths) would, if anything, give larger p-values. This strengthens the "not significant" verdict rather than weakening it.48- The p-values use the asymptotic normal reference distribution. A t(398) reference gives practically the same values.49- The estimand is a linear projection coefficient. Nothing here implies a causal effect or that x predicts y out of sample.50- The data are simulated. I did not use a random seed because nothing in the analysis is stochastic.51
Files · 452964ee0fbbaa40fbbed2c87a54ca798ffd6a85
Menu

Theme