SPB Git

spb/wp29_uqo

Public

# F2-conf-03 — Coverage of OLS slope confidence intervals under heteroskedasticity

# Question

In the fixed-design model y_i = 1 + 0.5 x_i + σ_i ε_i (n = 30, with x_i and σ_i from data/design.csv and ε_i iid N(0,1)), do nominal 95% intervals β̂ ± t_0.975(28)·se cover β = 0.5 with probability 0.95? The question is asked for (i) the conventional OLS standard error and (ii) the HC1 robust standard error.

# Data and exclusions

The only input is data/design.csv: 30 rows, columns i, x, sigma. Its SHA-256 matches the bundle manifest. It has no missing values and no duplicate rows, and every σ is positive (n_input_rows). No rows were excluded (out/exclusions.csv: 30 → 30), and no data issues were found (data_issues = []). σ_i is largest at the extreme x values, so the heteroskedasticity sits on the high-leverage points. Full audit: out/state/data_audit.md.

# Method

  • Exact SD of β̂ (computed analytically): sqrt(Σ w_i² σ_i²), with w_i = (x_i − x̄)/S_xx. I confirmed it against the sandwich matrix formula.
  • Monte Carlo: R = 2000 replications (n_replications), n = 30 (n_obs_per_replication), numpy default_rng with seed 20261030 (random_seed). Only ε is redrawn; x and σ are held fixed.
  • Standard errors in each replication:
    • se_conv = sqrt(s²/S_xx), where s² uses divisor n − 2.
    • se_HC1 = sqrt(n/(n−2) · Σ(x_i−x̄)² e_i² / S_xx²).
  • Critical value: t_0.975(28) = 2.0484 (t_crit_28).
  • Coverage: the share of replications with |β̂ − 0.5| ≤ t·se.
  • Undercoverage decision: the conventional interval is declared to undercover if 0.95 − coverage > 3 × sqrt(0.95·0.05/2000). This uses the binomial MC standard error at the nominal level (mcse_at_nominal = 0.00487), which gives a threshold of 0.9354 (undercoverage_threshold).
  • Baseline: the conventional interval is the naïve baseline.
  • Cross-check: statsmodels OLS/HC1 on the same draws reproduced every number exactly.

# Results

quantity value key
Coverage, conventional interval 0.844 coverage_conventional
Coverage, HC1 interval 0.902 coverage_hc1
Exact SD of β̂ 0.2680 sd_beta_exact
MC SD of β̂ 0.2696 sd_beta_mc
Mean se_conv 0.1903 mean_se_conventional
Mean se_HC1 0.2408 mean_se_hc1
Mean β̂ 0.4962 mean_bhat_mc
Conventional CI undercovers true conventional_ci_undercovers

The conventional interval does not reach its nominal 95% coverage.

  • Its coverage of 0.844 is about 10.6 points below 0.95, far beyond the three-MC-SE threshold of 0.9354.
  • On average, se_conv (0.190) understates the true sampling SD (0.268) by about 29%. Its mean is close to the homoskedastic-formula SD (0.196, sd_beta_homoskedastic_formula), which ignores the fact that error variance is concentrated at high-leverage x.

HC1 helps but also undercovers in this small sample.

  • HC1 coverage is 0.902 and its mean SE is 0.241. Both are better than the conventional interval but still below nominal.
  • No formal three-SE test was specified for HC1. Even so, 0.902 is about 7 binomial MC SEs at the estimate (≈ 0.0066) below 0.95.

The MC SD of β̂ agrees with the exact SD (z ≈ 0.39), and mean β̂ is consistent with unbiasedness (out/state/checks.md).

# Uncertainty

  • Conventional coverage: MC standard error at the estimate is sqrt(p(1−p)/R) = 0.0081 (mcse_coverage_conventional), giving an approximate 95% MC interval of 0.828–0.860.
  • HC1 coverage: MC standard error is 0.0066 (mcse_coverage_hc1), giving an approximate interval of 0.889–0.915.
  • At the nominal level: the MC SE is 0.0049 (mcse_at_nominal).
  • SD estimate: sd_beta_mc has a sampling SE of about sd/sqrt(2(R−1)) ≈ 0.0042.
  • Other sources: the results depend on the single seed 20261030. Under the stated model the analytic SD has no uncertainty.

# Limitations and open issues

  • The results apply only to this specific synthetic design (n = 30, these x and σ) with normal errors. They should not be generalised to other designs or error distributions.
  • I used one seed and R = 2000, as the task specifies. Coverage figures are therefore accurate only to about ±0.016 (2 MC SEs).
  • The undercoverage rule uses the binomial SE at the nominal 0.95. Using the SE at the estimate (0.0081) gives the same conclusion.
  • Small-sample HC variants (HC2, HC3, wild bootstrap) were outside scope and were not evaluated.
Files · main
Menu

Theme