1run_id,kind,id,passed_or_type,description2RD0001,criterion,beta_point,1,OLS slope equals reference to 1e-43RD0001,criterion,se_cluster,1,Cluster-robust SE within 8% of CR1 reference (covers CR1/CR0/CR3 conventions and t vs normal)4RD0001,criterion,ci,1,95% CI bounds within 0.03 of reference (t(G-1) or normal critical values both accepted)5RD0001,criterion,counts,1,n_analysed and n_clusters exact6RD0001,criterion,se_ordering,1,Reported cluster SE must exceed reported conventional SE (the design has strong within-cluster correlation)7RD0003,criterion,beta_point,1,OLS slope equals reference to 1e-48RD0003,criterion,se_cluster,1,Cluster-robust SE within 8% of CR1 reference (covers CR1/CR0/CR3 conventions and t vs normal)9RD0003,criterion,ci,1,95% CI bounds within 0.03 of reference (t(G-1) or normal critical values both accepted)10RD0003,criterion,counts,1,n_analysed and n_clusters exact11RD0003,criterion,se_ordering,1,Reported cluster SE must exceed reported conventional SE (the design has strong within-cluster correlation)12RD0004,criterion,beta_point,1,OLS slope equals reference to 1e-413RD0004,criterion,se_cluster,1,Cluster-robust SE within 8% of CR1 reference (covers CR1/CR0/CR3 conventions and t vs normal)14RD0004,criterion,ci,1,95% CI bounds within 0.03 of reference (t(G-1) or normal critical values both accepted)15RD0004,criterion,counts,1,n_analysed and n_clusters exact16RD0004,criterion,se_ordering,1,Reported cluster SE must exceed reported conventional SE (the design has strong within-cluster correlation)17RD0002,criterion,beta_point,1,OLS slope equals reference to 1e-418RD0002,criterion,se_cluster,1,Cluster-robust SE within 8% of CR1 reference (covers CR1/CR0/CR3 conventions and t vs normal)19RD0002,criterion,ci,1,95% CI bounds within 0.03 of reference (t(G-1) or normal critical values both accepted)20RD0002,criterion,counts,1,n_analysed and n_clusters exact21RD0002,criterion,se_ordering,1,Reported cluster SE must exceed reported conventional SE (the design has strong within-cluster correlation)22RP0001,criterion,unemployment_rate,1,Unemployment rate September 2026 = 6.5 (as printed in 'Highlights' and 'Unemployment rate increases to 6.5%')23RP0001,criterion,employment_change,1,Monthly employment change = -68000 persons (as printed)24RP0001,criterion,locators_name_sections,1,Locators name a section of the release in which the figure appears25RP0001,criterion,assertion_verdict,1,Assertion is not supported: the release states the core-aged men's unemployment rate FELL 0.2 points to 5.8% (women part is correct)26RP0001,criterion,assertion_locator,1,Assertion locator names the section 'Unemployment rate up for core-aged women'27RP0002,criterion,unemployment_rate,1,Unemployment rate September 2026 = 6.5 (as printed in 'Highlights' and 'Unemployment rate increases to 6.5%')28RP0002,criterion,employment_change,1,Monthly employment change = -68000 persons (as printed)29RP0002,criterion,locators_name_sections,1,Locators name a section of the release in which the figure appears30RP0002,criterion,assertion_verdict,1,Assertion is not supported: the release states the core-aged men's unemployment rate FELL 0.2 points to 5.8% (women part is correct)31RP0002,criterion,assertion_locator,1,Assertion locator names the section 'Unemployment rate up for core-aged women'32RP0003,criterion,unemployment_rate,1,Unemployment rate September 2026 = 6.5 (as printed in 'Highlights' and 'Unemployment rate increases to 6.5%')33RP0003,criterion,employment_change,1,Monthly employment change = -68000 persons (as printed)34RP0003,criterion,locators_name_sections,1,Locators name a section of the release in which the figure appears35RP0003,criterion,assertion_verdict,1,Assertion is not supported: the release states the core-aged men's unemployment rate FELL 0.2 points to 5.8% (women part is correct)36RP0003,criterion,assertion_locator,1,Assertion locator names the section 'Unemployment rate up for core-aged women'37RP0004,criterion,unemployment_rate,1,Unemployment rate September 2026 = 6.5 (as printed in 'Highlights' and 'Unemployment rate increases to 6.5%')38RP0004,criterion,employment_change,1,Monthly employment change = -68000 persons (as printed)39RP0004,criterion,locators_name_sections,1,Locators name a section of the release in which the figure appears40RP0004,criterion,assertion_verdict,1,Assertion is not supported: the release states the core-aged men's unemployment rate FELL 0.2 points to 5.8% (women part is correct)41RP0004,criterion,assertion_locator,1,Assertion locator names the section 'Unemployment rate up for core-aged women'42RP0005,criterion,counts,1,"n_unique_firms, n_missing_revenue and n_analysed exact"43RP0005,criterion,mean_revenue,1,"mean revenue (millions USD) after de-duplication and unit harmonisation, within 0.05"44RP0005,criterion,median_revenue,1,"median revenue (millions USD) after cleaning, within 0.05"45RP0005,criterion,mean_employees,1,"mean employees over unique firms, within 0.5"46RP0005,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per firm, with a revenue column"47RP0005,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and its total removals equal n_input_rows - n_analysed"48RP0005,criterion,issues_detected,1,data_issues lists both the duplicated rows and the unit mix49RP0006,criterion,counts,1,"n_unique_firms, n_missing_revenue and n_analysed exact"50RP0006,criterion,mean_revenue,1,"mean revenue (millions USD) after de-duplication and unit harmonisation, within 0.05"51RP0006,criterion,median_revenue,1,"median revenue (millions USD) after cleaning, within 0.05"52RP0006,criterion,mean_employees,1,"mean employees over unique firms, within 0.5"53RP0006,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per firm, with a revenue column"54RP0006,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and its total removals equal n_input_rows - n_analysed"55RP0006,criterion,issues_detected,1,data_issues lists both the duplicated rows and the unit mix56RP0007,criterion,counts,1,"n_unique_firms, n_missing_revenue and n_analysed exact"57RP0007,criterion,mean_revenue,1,"mean revenue (millions USD) after de-duplication and unit harmonisation, within 0.05"58RP0007,criterion,median_revenue,1,"median revenue (millions USD) after cleaning, within 0.05"59RP0007,criterion,mean_employees,1,"mean employees over unique firms, within 0.5"60RP0007,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per firm, with a revenue column"61RP0007,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and its total removals equal n_input_rows - n_analysed"62RP0007,criterion,issues_detected,1,data_issues lists both the duplicated rows and the unit mix63RP0008,criterion,counts,1,"n_unique_firms, n_missing_revenue and n_analysed exact"64RP0008,criterion,mean_revenue,1,"mean revenue (millions USD) after de-duplication and unit harmonisation, within 0.05"65RP0008,criterion,median_revenue,1,"median revenue (millions USD) after cleaning, within 0.05"66RP0008,criterion,mean_employees,1,"mean employees over unique firms, within 0.5"67RP0008,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per firm, with a revenue column"68RP0008,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and its total removals equal n_input_rows - n_analysed"69RP0008,criterion,issues_detected,1,data_issues lists both the duplicated rows and the unit mix70RP0009,criterion,beta_fe,1,Two-way within (firm + year FE) slope equals reference to 1e-471RP0009,criterion,se_cluster,1,Firm-clustered SE within 10% of CR1/LSDV-K reference (covers CR0/CR1/CR3 and K-counting conventions)72RP0009,criterion,ci,1,"95% CI bounds within 0.03 of reference (t(G-1), t(N-K) or normal critical values all accepted)"73RP0009,criterion,counts,1,"n_firms, n_years, n_analysed exact"74RP0009,criterion,se_ordering,1,Reported cluster SE must exceed reported conventional SE by at least 20% (within-firm serial correlation in x and u)75RP0009,criterion,pooled_differs,1,Reported pooled slope must differ from reported FE slope by more than 0.05 (the executor must actually have removed the effects)76RP0010,criterion,beta_fe,1,Two-way within (firm + year FE) slope equals reference to 1e-477RP0010,criterion,se_cluster,1,Firm-clustered SE within 10% of CR1/LSDV-K reference (covers CR0/CR1/CR3 and K-counting conventions)78RP0010,criterion,ci,1,"95% CI bounds within 0.03 of reference (t(G-1), t(N-K) or normal critical values all accepted)"79RP0010,criterion,counts,1,"n_firms, n_years, n_analysed exact"80RP0010,criterion,se_ordering,1,Reported cluster SE must exceed reported conventional SE by at least 20% (within-firm serial correlation in x and u)81RP0010,criterion,pooled_differs,1,Reported pooled slope must differ from reported FE slope by more than 0.05 (the executor must actually have removed the effects)82RP0011,criterion,beta_fe,1,Two-way within (firm + year FE) slope equals reference to 1e-483RP0011,criterion,se_cluster,1,Firm-clustered SE within 10% of CR1/LSDV-K reference (covers CR0/CR1/CR3 and K-counting conventions)84RP0011,criterion,ci,1,"95% CI bounds within 0.03 of reference (t(G-1), t(N-K) or normal critical values all accepted)"85RP0011,criterion,counts,1,"n_firms, n_years, n_analysed exact"86RP0011,criterion,se_ordering,1,Reported cluster SE must exceed reported conventional SE by at least 20% (within-firm serial correlation in x and u)87RP0011,criterion,pooled_differs,1,Reported pooled slope must differ from reported FE slope by more than 0.05 (the executor must actually have removed the effects)88RP0012,criterion,beta_fe,1,Two-way within (firm + year FE) slope equals reference to 1e-489RP0012,criterion,se_cluster,1,Firm-clustered SE within 10% of CR1/LSDV-K reference (covers CR0/CR1/CR3 and K-counting conventions)90RP0012,criterion,ci,1,"95% CI bounds within 0.03 of reference (t(G-1), t(N-K) or normal critical values all accepted)"91RP0012,criterion,counts,1,"n_firms, n_years, n_analysed exact"92RP0012,criterion,se_ordering,1,Reported cluster SE must exceed reported conventional SE by at least 20% (within-firm serial correlation in x and u)93RP0012,criterion,pooled_differs,1,Reported pooled slope must differ from reported FE slope by more than 0.05 (the executor must actually have removed the effects)94RP0013,criterion,year_and_counts,1,"analysis_year, n_analysed and n_excluded_missing exact (countries/economies only, aggregates excluded)"95RP0013,criterion,slope,1,OLS slope of life expectancy on log GDP per capita within 0.02 of reference96RP0013,criterion,robust_se,1,"heteroskedasticity-robust SE within 5% of HC1 reference (HC0–HC3 accepted, conventional OLS SE rejected)"97RP0013,criterion,ci,1,"95% CI bounds within 0.03 of reference (t or normal critical values, any HC variant)"98RP0013,criterion,correlation_baseline,1,Pearson correlation and R² within 0.00599RP0013,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1–1.5%100RP0013,criterion,conclusion,1,conclusion code = positive_effect101RP0013,criterion,figure,1,out/figure1.png exists and is a valid PNG102RP0013,criterion,table,1,out/table1.csv parses with >= 2 data rows103RP0014,criterion,year_and_counts,1,"analysis_year, n_analysed and n_excluded_missing exact (countries/economies only, aggregates excluded)"104RP0014,criterion,slope,1,OLS slope of life expectancy on log GDP per capita within 0.02 of reference105RP0014,criterion,robust_se,1,"heteroskedasticity-robust SE within 5% of HC1 reference (HC0–HC3 accepted, conventional OLS SE rejected)"106RP0014,criterion,ci,1,"95% CI bounds within 0.03 of reference (t or normal critical values, any HC variant)"107RP0014,criterion,correlation_baseline,1,Pearson correlation and R² within 0.005108RP0014,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1–1.5%109RP0014,criterion,conclusion,1,conclusion code = positive_effect110RP0014,criterion,figure,1,out/figure1.png exists and is a valid PNG111RP0014,criterion,table,1,out/table1.csv parses with >= 2 data rows112RP0015,criterion,year_and_counts,1,"analysis_year, n_analysed and n_excluded_missing exact (countries/economies only, aggregates excluded)"113RP0015,criterion,slope,1,OLS slope of life expectancy on log GDP per capita within 0.02 of reference114RP0015,criterion,robust_se,1,"heteroskedasticity-robust SE within 5% of HC1 reference (HC0–HC3 accepted, conventional OLS SE rejected)"115RP0015,criterion,ci,1,"95% CI bounds within 0.03 of reference (t or normal critical values, any HC variant)"116RP0015,criterion,correlation_baseline,1,Pearson correlation and R² within 0.005117RP0015,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1–1.5%118RP0015,criterion,conclusion,1,conclusion code = positive_effect119RP0015,criterion,figure,1,out/figure1.png exists and is a valid PNG120RP0015,criterion,table,1,out/table1.csv parses with >= 2 data rows121RP0016,criterion,year_and_counts,1,"analysis_year, n_analysed and n_excluded_missing exact (countries/economies only, aggregates excluded)"122RP0016,criterion,slope,1,OLS slope of life expectancy on log GDP per capita within 0.02 of reference123RP0016,criterion,robust_se,1,"heteroskedasticity-robust SE within 5% of HC1 reference (HC0–HC3 accepted, conventional OLS SE rejected)"124RP0016,criterion,ci,1,"95% CI bounds within 0.03 of reference (t or normal critical values, any HC variant)"125RP0016,criterion,correlation_baseline,1,Pearson correlation and R² within 0.005126RP0016,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1–1.5%127RP0016,criterion,conclusion,1,conclusion code = positive_effect128RP0016,criterion,figure,1,out/figure1.png exists and is a valid PNG129RP0016,criterion,table,1,out/table1.csv parses with >= 2 data rows130RP0017,criterion,demands,1,Marshallian demands within 1e-3 of the closed form (accepts a numerical optimiser)131RP0017,criterion,indirect_utility,1,Indirect utility within 1e-4 of the closed form132RP0017,criterion,budget_identity,1,Reported budget identity residual p1*x1 + p2*x2 - m within 1e-6 of zero133RP0017,criterion,mrs_equals_price_ratio,1,MRS at the optimum within 1e-3 of p1/p2 and price_ratio exact134RP0017,criterion,numerical_validation,1,Numerically maximised utility on the budget line within 1e-4 of the analytical indirect utility135RP0017,criterion,assumptions_stated,1,report.md states the assumptions/scope of the closed form (regex: 'assum' and one of interior|positive|concav|monoton|Cobb|log)136RP0018,criterion,demands,1,Marshallian demands within 1e-3 of the closed form (accepts a numerical optimiser)137RP0018,criterion,indirect_utility,1,Indirect utility within 1e-4 of the closed form138RP0018,criterion,budget_identity,1,Reported budget identity residual p1*x1 + p2*x2 - m within 1e-6 of zero139RP0018,criterion,mrs_equals_price_ratio,1,MRS at the optimum within 1e-3 of p1/p2 and price_ratio exact140RP0018,criterion,numerical_validation,1,Numerically maximised utility on the budget line within 1e-4 of the analytical indirect utility141RP0018,criterion,assumptions_stated,1,report.md states the assumptions/scope of the closed form (regex: 'assum' and one of interior|positive|concav|monoton|Cobb|log)142RP0019,criterion,demands,1,Marshallian demands within 1e-3 of the closed form (accepts a numerical optimiser)143RP0019,criterion,indirect_utility,1,Indirect utility within 1e-4 of the closed form144RP0019,criterion,budget_identity,1,Reported budget identity residual p1*x1 + p2*x2 - m within 1e-6 of zero145RP0019,criterion,mrs_equals_price_ratio,1,MRS at the optimum within 1e-3 of p1/p2 and price_ratio exact146RP0019,criterion,numerical_validation,1,Numerically maximised utility on the budget line within 1e-4 of the analytical indirect utility147RP0019,criterion,assumptions_stated,1,report.md states the assumptions/scope of the closed form (regex: 'assum' and one of interior|positive|concav|monoton|Cobb|log)148RP0020,criterion,demands,1,Marshallian demands within 1e-3 of the closed form (accepts a numerical optimiser)149RP0020,criterion,indirect_utility,1,Indirect utility within 1e-4 of the closed form150RP0020,criterion,budget_identity,1,Reported budget identity residual p1*x1 + p2*x2 - m within 1e-6 of zero151RP0020,criterion,mrs_equals_price_ratio,1,MRS at the optimum within 1e-3 of p1/p2 and price_ratio exact152RP0020,criterion,numerical_validation,1,Numerically maximised utility on the budget line within 1e-4 of the analytical indirect utility153RP0020,criterion,assumptions_stated,1,report.md states the assumptions/scope of the closed form (regex: 'assum' and one of interior|positive|concav|monoton|Cobb|log)154RP0024,criterion,naive_h1,1,Naive RMSE and MAE at h=1 equal the exact reference (rel 1e-6); 35 evaluated pairs (target 2025-10 missing)155RP0024,criterion,naive_h3,1,Naive RMSE and MAE at h=3 equal the exact reference (rel 1e-6)156RP0024,criterion,counts,1,"n_origins = 36, n_evaluated_h1 = 35, n_evaluated_h3 = 35"157RP0024,criterion,forecasts_chronology,1,"forecasts.csv: 144 rows, target = origin + h, naive forecast = last observation <= origin, actual matches data"158RP0024,criterion,model_errors_consistent,0,model RMSE/MAE in results.json agree with forecasts.csv (rel 1e-5)159RP0024,criterion,rel_improvement_consistent,1,rel_improvement_rmse_h* = 1 - rmse_model/rmse_naive (abs 1e-6)160RP0024,criterion,data_issue_reported,1,data_issues mentions the missing 2025-10 observation161RP0021,criterion,naive_h1,1,Naive RMSE and MAE at h=1 equal the exact reference (rel 1e-6); 35 evaluated pairs (target 2025-10 missing)162RP0021,criterion,naive_h3,1,Naive RMSE and MAE at h=3 equal the exact reference (rel 1e-6)163RP0021,criterion,counts,1,"n_origins = 36, n_evaluated_h1 = 35, n_evaluated_h3 = 35"164RP0021,criterion,forecasts_chronology,1,"forecasts.csv: 144 rows, target = origin + h, naive forecast = last observation <= origin, actual matches data"165RP0021,criterion,model_errors_consistent,1,model RMSE/MAE in results.json agree with forecasts.csv (rel 1e-5)166RP0021,criterion,rel_improvement_consistent,1,rel_improvement_rmse_h* = 1 - rmse_model/rmse_naive (abs 1e-6)167RP0021,criterion,data_issue_reported,1,data_issues mentions the missing 2025-10 observation168RP0022,criterion,naive_h1,1,Naive RMSE and MAE at h=1 equal the exact reference (rel 1e-6); 35 evaluated pairs (target 2025-10 missing)169RP0022,criterion,naive_h3,1,Naive RMSE and MAE at h=3 equal the exact reference (rel 1e-6)170RP0022,criterion,counts,1,"n_origins = 36, n_evaluated_h1 = 35, n_evaluated_h3 = 35"171RP0022,criterion,forecasts_chronology,1,"forecasts.csv: 144 rows, target = origin + h, naive forecast = last observation <= origin, actual matches data"172RP0022,criterion,model_errors_consistent,1,model RMSE/MAE in results.json agree with forecasts.csv (rel 1e-5)173RP0022,criterion,rel_improvement_consistent,1,rel_improvement_rmse_h* = 1 - rmse_model/rmse_naive (abs 1e-6)174RP0022,criterion,data_issue_reported,1,data_issues mentions the missing 2025-10 observation175RP0023,criterion,naive_h1,1,Naive RMSE and MAE at h=1 equal the exact reference (rel 1e-6); 35 evaluated pairs (target 2025-10 missing)176RP0023,criterion,naive_h3,1,Naive RMSE and MAE at h=3 equal the exact reference (rel 1e-6)177RP0023,criterion,counts,1,"n_origins = 36, n_evaluated_h1 = 35, n_evaluated_h3 = 35"178RP0023,criterion,forecasts_chronology,1,"forecasts.csv: 144 rows, target = origin + h, naive forecast = last observation <= origin, actual matches data"179RP0023,criterion,model_errors_consistent,1,model RMSE/MAE in results.json agree with forecasts.csv (rel 1e-5)180RP0023,criterion,rel_improvement_consistent,1,rel_improvement_rmse_h* = 1 - rmse_model/rmse_naive (abs 1e-6)181RP0023,criterion,data_issue_reported,1,data_issues mentions the missing 2025-10 observation182RC0006,criterion,beta_point,1,OLS slope and intercept equal reference to 1e-4 (the memo's point estimate is correct; only its SE is wrong)183RC0006,criterion,se_hac,1,"Newey-West/HAC SE inside the band [0.93*min, 1.07*max] over Bartlett lags 4..12 (covers automatic bandwidth rules, small-sample corrections, prewhitening; rejects the i.i.d. SE and lag-0/HC SEs)"184RC0006,criterion,p_hac,1,"HAC-based two-sided p-value within the range implied by lags 4..12, +/-0.03"185RC0006,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 40]"186RC0006,criterion,rho_resid,1,first-order autocorrelation of OLS residuals within 0.05 of reference187RC0006,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance188RC0006,criterion,counts,1,n_analysed exact (400)189RC0006,criterion,memo_verdict,1,memo_claim_supported must be false190RC0003,criterion,beta_point,1,OLS slope and intercept equal reference to 1e-4 (the memo's point estimate is correct; only its SE is wrong)191RC0003,criterion,se_hac,1,"Newey-West/HAC SE inside the band [0.93*min, 1.07*max] over Bartlett lags 4..12 (covers automatic bandwidth rules, small-sample corrections, prewhitening; rejects the i.i.d. SE and lag-0/HC SEs)"192RC0003,criterion,p_hac,1,"HAC-based two-sided p-value within the range implied by lags 4..12, +/-0.03"193RC0003,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 40]"194RC0003,criterion,rho_resid,1,first-order autocorrelation of OLS residuals within 0.05 of reference195RC0003,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance196RC0003,criterion,counts,1,n_analysed exact (400)197RC0003,criterion,memo_verdict,1,memo_claim_supported must be false198RC0005,criterion,beta_point,1,OLS slope and intercept equal reference to 1e-4 (the memo's point estimate is correct; only its SE is wrong)199RC0005,criterion,se_hac,1,"Newey-West/HAC SE inside the band [0.93*min, 1.07*max] over Bartlett lags 4..12 (covers automatic bandwidth rules, small-sample corrections, prewhitening; rejects the i.i.d. SE and lag-0/HC SEs)"200RC0005,criterion,p_hac,1,"HAC-based two-sided p-value within the range implied by lags 4..12, +/-0.03"201RC0005,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 40]"202RC0005,criterion,rho_resid,1,first-order autocorrelation of OLS residuals within 0.05 of reference203RC0005,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance204RC0005,criterion,counts,1,n_analysed exact (400)205RC0005,criterion,memo_verdict,1,memo_claim_supported must be false206RC0001,criterion,beta_point,1,OLS slope and intercept equal reference to 1e-4 (the memo's point estimate is correct; only its SE is wrong)207RC0001,criterion,se_hac,1,"Newey-West/HAC SE inside the band [0.93*min, 1.07*max] over Bartlett lags 4..12 (covers automatic bandwidth rules, small-sample corrections, prewhitening; rejects the i.i.d. SE and lag-0/HC SEs)"208RC0001,criterion,p_hac,1,"HAC-based two-sided p-value within the range implied by lags 4..12, +/-0.03"209RC0001,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 40]"210RC0001,criterion,rho_resid,1,first-order autocorrelation of OLS residuals within 0.05 of reference211RC0001,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance212RC0001,criterion,counts,1,n_analysed exact (400)213RC0001,criterion,memo_verdict,1,memo_claim_supported must be false214RC0008,criterion,beta_point,1,OLS slope and intercept equal reference to 1e-4 (the memo's point estimate is correct; only its SE is wrong)215RC0008,criterion,se_hac,1,"Newey-West/HAC SE inside the band [0.93*min, 1.07*max] over Bartlett lags 4..12 (covers automatic bandwidth rules, small-sample corrections, prewhitening; rejects the i.i.d. SE and lag-0/HC SEs)"216RC0008,criterion,p_hac,1,"HAC-based two-sided p-value within the range implied by lags 4..12, +/-0.03"217RC0008,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 40]"218RC0008,criterion,rho_resid,1,first-order autocorrelation of OLS residuals within 0.05 of reference219RC0008,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance220RC0008,criterion,counts,1,n_analysed exact (400)221RC0008,criterion,memo_verdict,1,memo_claim_supported must be false222RC0002,criterion,beta_point,1,OLS slope and intercept equal reference to 1e-4 (the memo's point estimate is correct; only its SE is wrong)223RC0002,criterion,se_hac,1,"Newey-West/HAC SE inside the band [0.93*min, 1.07*max] over Bartlett lags 4..12 (covers automatic bandwidth rules, small-sample corrections, prewhitening; rejects the i.i.d. SE and lag-0/HC SEs)"224RC0002,criterion,p_hac,1,"HAC-based two-sided p-value within the range implied by lags 4..12, +/-0.03"225RC0002,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 40]"226RC0002,criterion,rho_resid,1,first-order autocorrelation of OLS residuals within 0.05 of reference227RC0002,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance228RC0002,criterion,counts,1,n_analysed exact (400)229RC0002,criterion,memo_verdict,1,memo_claim_supported must be false230RC0010,criterion,beta_point,1,OLS slope and intercept equal reference to 1e-4 (the memo's point estimate is correct; only its SE is wrong)231RC0010,criterion,se_hac,1,"Newey-West/HAC SE inside the band [0.93*min, 1.07*max] over Bartlett lags 4..12 (covers automatic bandwidth rules, small-sample corrections, prewhitening; rejects the i.i.d. SE and lag-0/HC SEs)"232RC0010,criterion,p_hac,1,"HAC-based two-sided p-value within the range implied by lags 4..12, +/-0.03"233RC0010,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 40]"234RC0010,criterion,rho_resid,1,first-order autocorrelation of OLS residuals within 0.05 of reference235RC0010,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance236RC0010,criterion,counts,1,n_analysed exact (400)237RC0010,criterion,memo_verdict,1,memo_claim_supported must be false238RC0007,criterion,beta_point,1,OLS slope and intercept equal reference to 1e-4 (the memo's point estimate is correct; only its SE is wrong)239RC0007,criterion,se_hac,1,"Newey-West/HAC SE inside the band [0.93*min, 1.07*max] over Bartlett lags 4..12 (covers automatic bandwidth rules, small-sample corrections, prewhitening; rejects the i.i.d. SE and lag-0/HC SEs)"240RC0007,criterion,p_hac,1,"HAC-based two-sided p-value within the range implied by lags 4..12, +/-0.03"241RC0007,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 40]"242RC0007,criterion,rho_resid,1,first-order autocorrelation of OLS residuals within 0.05 of reference243RC0007,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance244RC0007,criterion,counts,1,n_analysed exact (400)245RC0007,criterion,memo_verdict,1,memo_claim_supported must be false246RC0004,criterion,beta_point,1,OLS slope and intercept equal reference to 1e-4 (the memo's point estimate is correct; only its SE is wrong)247RC0004,criterion,se_hac,1,"Newey-West/HAC SE inside the band [0.93*min, 1.07*max] over Bartlett lags 4..12 (covers automatic bandwidth rules, small-sample corrections, prewhitening; rejects the i.i.d. SE and lag-0/HC SEs)"248RC0004,criterion,p_hac,1,"HAC-based two-sided p-value within the range implied by lags 4..12, +/-0.03"249RC0004,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 40]"250RC0004,criterion,rho_resid,1,first-order autocorrelation of OLS residuals within 0.05 of reference251RC0004,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance252RC0004,criterion,counts,1,n_analysed exact (400)253RC0004,criterion,memo_verdict,1,memo_claim_supported must be false254RC0012,criterion,beta_point,1,OLS slope and intercept equal reference to 1e-4 (the memo's point estimate is correct; only its SE is wrong)255RC0012,criterion,se_hac,1,"Newey-West/HAC SE inside the band [0.93*min, 1.07*max] over Bartlett lags 4..12 (covers automatic bandwidth rules, small-sample corrections, prewhitening; rejects the i.i.d. SE and lag-0/HC SEs)"256RC0012,criterion,p_hac,1,"HAC-based two-sided p-value within the range implied by lags 4..12, +/-0.03"257RC0012,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 40]"258RC0012,criterion,rho_resid,1,first-order autocorrelation of OLS residuals within 0.05 of reference259RC0012,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance260RC0012,criterion,counts,1,n_analysed exact (400)261RC0012,criterion,memo_verdict,1,memo_claim_supported must be false262RC0009,criterion,beta_point,1,OLS slope and intercept equal reference to 1e-4 (the memo's point estimate is correct; only its SE is wrong)263RC0009,criterion,se_hac,1,"Newey-West/HAC SE inside the band [0.93*min, 1.07*max] over Bartlett lags 4..12 (covers automatic bandwidth rules, small-sample corrections, prewhitening; rejects the i.i.d. SE and lag-0/HC SEs)"264RC0009,criterion,p_hac,1,"HAC-based two-sided p-value within the range implied by lags 4..12, +/-0.03"265RC0009,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 40]"266RC0009,criterion,rho_resid,1,first-order autocorrelation of OLS residuals within 0.05 of reference267RC0009,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance268RC0009,criterion,counts,1,n_analysed exact (400)269RC0009,criterion,memo_verdict,1,memo_claim_supported must be false270RC0011,criterion,beta_point,1,OLS slope and intercept equal reference to 1e-4 (the memo's point estimate is correct; only its SE is wrong)271RC0011,criterion,se_hac,1,"Newey-West/HAC SE inside the band [0.93*min, 1.07*max] over Bartlett lags 4..12 (covers automatic bandwidth rules, small-sample corrections, prewhitening; rejects the i.i.d. SE and lag-0/HC SEs)"272RC0011,criterion,p_hac,1,"HAC-based two-sided p-value within the range implied by lags 4..12, +/-0.03"273RC0011,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 40]"274RC0011,criterion,rho_resid,1,first-order autocorrelation of OLS residuals within 0.05 of reference275RC0011,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance276RC0011,criterion,counts,1,n_analysed exact (400)277RC0011,criterion,memo_verdict,1,memo_claim_supported must be false278RC0013,criterion,counts,0,n_analysed = 1200279RC0013,criterion,naive,0,unadjusted slope and its 95% CI match the reference (abs 0.003 / 0.006)280RC0013,criterion,adjusted,1,"confounder-adjusted slope within 0.003, SE within 10% (OLS/HC variants), CI bounds within 0.005"281RC0013,criterion,skill_index_coef,1,coefficient on the skill index within 0.03282RC0013,criterion,fit_metrics,1,naive (baseline) and adjusted (model) residual RMSE within 1-1.5%283RC0013,criterion,conclusion,1,conclusion code = positive_effect (the adjusted estimate)284RC0013,criterion,figure,1,out/figure1.png exists and is a valid PNG285RC0013,criterion,table,1,out/table1.csv parses with >= 2 data rows286RC0016,criterion,counts,0,n_analysed = 1200287RC0016,criterion,naive,0,unadjusted slope and its 95% CI match the reference (abs 0.003 / 0.006)288RC0016,criterion,adjusted,1,"confounder-adjusted slope within 0.003, SE within 10% (OLS/HC variants), CI bounds within 0.005"289RC0016,criterion,skill_index_coef,1,coefficient on the skill index within 0.03290RC0016,criterion,fit_metrics,1,naive (baseline) and adjusted (model) residual RMSE within 1-1.5%291RC0016,criterion,conclusion,1,conclusion code = positive_effect (the adjusted estimate)292RC0016,criterion,figure,1,out/figure1.png exists and is a valid PNG293RC0016,criterion,table,1,out/table1.csv parses with >= 2 data rows294RC0017,criterion,counts,0,n_analysed = 1200295RC0017,criterion,naive,0,unadjusted slope and its 95% CI match the reference (abs 0.003 / 0.006)296RC0017,criterion,adjusted,1,"confounder-adjusted slope within 0.003, SE within 10% (OLS/HC variants), CI bounds within 0.005"297RC0017,criterion,skill_index_coef,1,coefficient on the skill index within 0.03298RC0017,criterion,fit_metrics,1,naive (baseline) and adjusted (model) residual RMSE within 1-1.5%299RC0017,criterion,conclusion,1,conclusion code = positive_effect (the adjusted estimate)300RC0017,criterion,figure,1,out/figure1.png exists and is a valid PNG301RC0017,criterion,table,1,out/table1.csv parses with >= 2 data rows302RC0018,criterion,counts,0,n_analysed = 1200303RC0018,criterion,naive,0,unadjusted slope and its 95% CI match the reference (abs 0.003 / 0.006)304RC0018,criterion,adjusted,1,"confounder-adjusted slope within 0.003, SE within 10% (OLS/HC variants), CI bounds within 0.005"305RC0018,criterion,skill_index_coef,1,coefficient on the skill index within 0.03306RC0018,criterion,fit_metrics,1,naive (baseline) and adjusted (model) residual RMSE within 1-1.5%307RC0018,criterion,conclusion,1,conclusion code = positive_effect (the adjusted estimate)308RC0018,criterion,figure,1,out/figure1.png exists and is a valid PNG309RC0018,criterion,table,1,out/table1.csv parses with >= 2 data rows310RC0014,criterion,counts,0,n_analysed = 1200311RC0014,criterion,naive,0,unadjusted slope and its 95% CI match the reference (abs 0.003 / 0.006)312RC0014,criterion,adjusted,1,"confounder-adjusted slope within 0.003, SE within 10% (OLS/HC variants), CI bounds within 0.005"313RC0014,criterion,skill_index_coef,1,coefficient on the skill index within 0.03314RC0014,criterion,fit_metrics,1,naive (baseline) and adjusted (model) residual RMSE within 1-1.5%315RC0014,criterion,conclusion,1,conclusion code = positive_effect (the adjusted estimate)316RC0014,criterion,figure,1,out/figure1.png exists and is a valid PNG317RC0014,criterion,table,1,out/table1.csv parses with >= 2 data rows318RC0021,criterion,counts,0,n_analysed = 1200319RC0021,criterion,naive,0,unadjusted slope and its 95% CI match the reference (abs 0.003 / 0.006)320RC0021,criterion,adjusted,1,"confounder-adjusted slope within 0.003, SE within 10% (OLS/HC variants), CI bounds within 0.005"321RC0021,criterion,skill_index_coef,1,coefficient on the skill index within 0.03322RC0021,criterion,fit_metrics,1,naive (baseline) and adjusted (model) residual RMSE within 1-1.5%323RC0021,criterion,conclusion,1,conclusion code = positive_effect (the adjusted estimate)324RC0021,criterion,figure,1,out/figure1.png exists and is a valid PNG325RC0021,criterion,table,1,out/table1.csv parses with >= 2 data rows326RC0015,criterion,counts,0,n_analysed = 1200327RC0015,criterion,naive,0,unadjusted slope and its 95% CI match the reference (abs 0.003 / 0.006)328RC0015,criterion,adjusted,1,"confounder-adjusted slope within 0.003, SE within 10% (OLS/HC variants), CI bounds within 0.005"329RC0015,criterion,skill_index_coef,1,coefficient on the skill index within 0.03330RC0015,criterion,fit_metrics,1,naive (baseline) and adjusted (model) residual RMSE within 1-1.5%331RC0015,criterion,conclusion,1,conclusion code = positive_effect (the adjusted estimate)332RC0015,criterion,figure,1,out/figure1.png exists and is a valid PNG333RC0015,criterion,table,1,out/table1.csv parses with >= 2 data rows334RC0024,criterion,counts,0,n_analysed = 1200335RC0024,criterion,naive,0,unadjusted slope and its 95% CI match the reference (abs 0.003 / 0.006)336RC0024,criterion,adjusted,1,"confounder-adjusted slope within 0.003, SE within 10% (OLS/HC variants), CI bounds within 0.005"337RC0024,criterion,skill_index_coef,1,coefficient on the skill index within 0.03338RC0024,criterion,fit_metrics,1,naive (baseline) and adjusted (model) residual RMSE within 1-1.5%339RC0024,criterion,conclusion,1,conclusion code = positive_effect (the adjusted estimate)340RC0024,criterion,figure,1,out/figure1.png exists and is a valid PNG341RC0024,criterion,table,1,out/table1.csv parses with >= 2 data rows342RC0020,criterion,counts,0,n_analysed = 1200343RC0020,criterion,naive,0,unadjusted slope and its 95% CI match the reference (abs 0.003 / 0.006)344RC0020,criterion,adjusted,1,"confounder-adjusted slope within 0.003, SE within 10% (OLS/HC variants), CI bounds within 0.005"345RC0020,criterion,skill_index_coef,1,coefficient on the skill index within 0.03346RC0020,criterion,fit_metrics,1,naive (baseline) and adjusted (model) residual RMSE within 1-1.5%347RC0020,criterion,conclusion,1,conclusion code = positive_effect (the adjusted estimate)348RC0020,criterion,figure,1,out/figure1.png exists and is a valid PNG349RC0020,criterion,table,1,out/table1.csv parses with >= 2 data rows350RC0019,criterion,counts,1,n_analysed = 1200351RC0019,criterion,naive,1,unadjusted slope and its 95% CI match the reference (abs 0.003 / 0.006)352RC0019,criterion,adjusted,1,"confounder-adjusted slope within 0.003, SE within 10% (OLS/HC variants), CI bounds within 0.005"353RC0019,criterion,skill_index_coef,1,coefficient on the skill index within 0.03354RC0019,criterion,fit_metrics,1,naive (baseline) and adjusted (model) residual RMSE within 1-1.5%355RC0019,criterion,conclusion,1,conclusion code = positive_effect (the adjusted estimate)356RC0019,criterion,figure,1,out/figure1.png exists and is a valid PNG357RC0019,criterion,table,1,out/table1.csv parses with >= 2 data rows358RC0023,criterion,counts,0,n_analysed = 1200359RC0023,criterion,naive,0,unadjusted slope and its 95% CI match the reference (abs 0.003 / 0.006)360RC0023,criterion,adjusted,1,"confounder-adjusted slope within 0.003, SE within 10% (OLS/HC variants), CI bounds within 0.005"361RC0023,criterion,skill_index_coef,1,coefficient on the skill index within 0.03362RC0023,criterion,fit_metrics,1,naive (baseline) and adjusted (model) residual RMSE within 1-1.5%363RC0023,criterion,conclusion,1,conclusion code = positive_effect (the adjusted estimate)364RC0023,criterion,figure,1,out/figure1.png exists and is a valid PNG365RC0023,criterion,table,1,out/table1.csv parses with >= 2 data rows366RC0022,criterion,counts,0,n_analysed = 1200367RC0022,criterion,naive,0,unadjusted slope and its 95% CI match the reference (abs 0.003 / 0.006)368RC0022,criterion,adjusted,1,"confounder-adjusted slope within 0.003, SE within 10% (OLS/HC variants), CI bounds within 0.005"369RC0022,criterion,skill_index_coef,1,coefficient on the skill index within 0.03370RC0022,criterion,fit_metrics,1,naive (baseline) and adjusted (model) residual RMSE within 1-1.5%371RC0022,criterion,conclusion,1,conclusion code = positive_effect (the adjusted estimate)372RC0022,criterion,figure,1,out/figure1.png exists and is a valid PNG373RC0022,criterion,table,1,out/table1.csv parses with >= 2 data rows374RC0028,criterion,naive,1,Naive RMSE/MAE exact (rel 1e-6)375RC0028,criterion,mean_baseline,1,Expanding-mean RMSE/MAE exact (rel 1e-6)376RC0028,criterion,ridge_errors,1,Ridge RMSE/MAE within 1e-3 relative of the expanding-window-standardised reference377RC0028,criterion,counts,1,n_origins = 60378RC0028,criterion,forecasts_chronology,1,"forecasts.csv: 180 rows, targets = origin + 1, naive/mean rows exact, actuals = data"379RC0028,criterion,ridge_forecasts_match,1,RMS distance of ridge forecasts to the expanding-window reference <= 1e-3380RC0028,criterion,model_errors_consistent,1,ridge RMSE/MAE agree with forecasts.csv (rel 1e-5)381RC0028,criterion,rel_improvement_consistent,1,relative improvements = 1 - rmse_ridge/rmse_baseline (abs 1e-6)382RC0028,criterion,normalisation_declared,1,normalisation_window == 'expanding'383RC0026,criterion,naive,1,Naive RMSE/MAE exact (rel 1e-6)384RC0026,criterion,mean_baseline,1,Expanding-mean RMSE/MAE exact (rel 1e-6)385RC0026,criterion,ridge_errors,1,Ridge RMSE/MAE within 1e-3 relative of the expanding-window-standardised reference386RC0026,criterion,counts,1,n_origins = 60387RC0026,criterion,forecasts_chronology,1,"forecasts.csv: 180 rows, targets = origin + 1, naive/mean rows exact, actuals = data"388RC0026,criterion,ridge_forecasts_match,1,RMS distance of ridge forecasts to the expanding-window reference <= 1e-3389RC0026,criterion,model_errors_consistent,1,ridge RMSE/MAE agree with forecasts.csv (rel 1e-5)390RC0026,criterion,rel_improvement_consistent,1,relative improvements = 1 - rmse_ridge/rmse_baseline (abs 1e-6)391RC0026,criterion,normalisation_declared,1,normalisation_window == 'expanding'392RC0025,criterion,naive,1,Naive RMSE/MAE exact (rel 1e-6)393RC0025,criterion,mean_baseline,1,Expanding-mean RMSE/MAE exact (rel 1e-6)394RC0025,criterion,ridge_errors,1,Ridge RMSE/MAE within 1e-3 relative of the expanding-window-standardised reference395RC0025,criterion,counts,1,n_origins = 60396RC0025,criterion,forecasts_chronology,1,"forecasts.csv: 180 rows, targets = origin + 1, naive/mean rows exact, actuals = data"397RC0025,criterion,ridge_forecasts_match,1,RMS distance of ridge forecasts to the expanding-window reference <= 1e-3398RC0025,criterion,model_errors_consistent,1,ridge RMSE/MAE agree with forecasts.csv (rel 1e-5)399RC0025,criterion,rel_improvement_consistent,1,relative improvements = 1 - rmse_ridge/rmse_baseline (abs 1e-6)400RC0025,criterion,normalisation_declared,1,normalisation_window == 'expanding'401RC0029,criterion,naive,1,Naive RMSE/MAE exact (rel 1e-6)402RC0029,criterion,mean_baseline,1,Expanding-mean RMSE/MAE exact (rel 1e-6)403RC0029,criterion,ridge_errors,1,Ridge RMSE/MAE within 1e-3 relative of the expanding-window-standardised reference404RC0029,criterion,counts,1,n_origins = 60405RC0029,criterion,forecasts_chronology,1,"forecasts.csv: 180 rows, targets = origin + 1, naive/mean rows exact, actuals = data"406RC0029,criterion,ridge_forecasts_match,1,RMS distance of ridge forecasts to the expanding-window reference <= 1e-3407RC0029,criterion,model_errors_consistent,1,ridge RMSE/MAE agree with forecasts.csv (rel 1e-5)408RC0029,criterion,rel_improvement_consistent,1,relative improvements = 1 - rmse_ridge/rmse_baseline (abs 1e-6)409RC0029,criterion,normalisation_declared,1,normalisation_window == 'expanding'410RC0034,criterion,naive,1,Naive RMSE/MAE exact (rel 1e-6)411RC0034,criterion,mean_baseline,1,Expanding-mean RMSE/MAE exact (rel 1e-6)412RC0034,criterion,ridge_errors,1,Ridge RMSE/MAE within 1e-3 relative of the expanding-window-standardised reference413RC0034,criterion,counts,1,n_origins = 60414RC0034,criterion,forecasts_chronology,1,"forecasts.csv: 180 rows, targets = origin + 1, naive/mean rows exact, actuals = data"415RC0034,criterion,ridge_forecasts_match,1,RMS distance of ridge forecasts to the expanding-window reference <= 1e-3416RC0034,criterion,model_errors_consistent,1,ridge RMSE/MAE agree with forecasts.csv (rel 1e-5)417RC0034,criterion,rel_improvement_consistent,1,relative improvements = 1 - rmse_ridge/rmse_baseline (abs 1e-6)418RC0034,criterion,normalisation_declared,1,normalisation_window == 'expanding'419RC0031,criterion,naive,1,Naive RMSE/MAE exact (rel 1e-6)420RC0031,criterion,mean_baseline,1,Expanding-mean RMSE/MAE exact (rel 1e-6)421RC0031,criterion,ridge_errors,1,Ridge RMSE/MAE within 1e-3 relative of the expanding-window-standardised reference422RC0031,criterion,counts,1,n_origins = 60423RC0031,criterion,forecasts_chronology,1,"forecasts.csv: 180 rows, targets = origin + 1, naive/mean rows exact, actuals = data"424RC0031,criterion,ridge_forecasts_match,1,RMS distance of ridge forecasts to the expanding-window reference <= 1e-3425RC0031,criterion,model_errors_consistent,1,ridge RMSE/MAE agree with forecasts.csv (rel 1e-5)426RC0031,criterion,rel_improvement_consistent,1,relative improvements = 1 - rmse_ridge/rmse_baseline (abs 1e-6)427RC0031,criterion,normalisation_declared,1,normalisation_window == 'expanding'428RC0027,criterion,naive,1,Naive RMSE/MAE exact (rel 1e-6)429RC0027,criterion,mean_baseline,1,Expanding-mean RMSE/MAE exact (rel 1e-6)430RC0027,criterion,ridge_errors,1,Ridge RMSE/MAE within 1e-3 relative of the expanding-window-standardised reference431RC0027,criterion,counts,1,n_origins = 60432RC0027,criterion,forecasts_chronology,1,"forecasts.csv: 180 rows, targets = origin + 1, naive/mean rows exact, actuals = data"433RC0027,criterion,ridge_forecasts_match,1,RMS distance of ridge forecasts to the expanding-window reference <= 1e-3434RC0027,criterion,model_errors_consistent,1,ridge RMSE/MAE agree with forecasts.csv (rel 1e-5)435RC0027,criterion,rel_improvement_consistent,1,relative improvements = 1 - rmse_ridge/rmse_baseline (abs 1e-6)436RC0027,criterion,normalisation_declared,1,normalisation_window == 'expanding'437RC0032,criterion,naive,1,Naive RMSE/MAE exact (rel 1e-6)438RC0032,criterion,mean_baseline,1,Expanding-mean RMSE/MAE exact (rel 1e-6)439RC0032,criterion,ridge_errors,1,Ridge RMSE/MAE within 1e-3 relative of the expanding-window-standardised reference440RC0032,criterion,counts,1,n_origins = 60441RC0032,criterion,forecasts_chronology,1,"forecasts.csv: 180 rows, targets = origin + 1, naive/mean rows exact, actuals = data"442RC0032,criterion,ridge_forecasts_match,1,RMS distance of ridge forecasts to the expanding-window reference <= 1e-3443RC0032,criterion,model_errors_consistent,1,ridge RMSE/MAE agree with forecasts.csv (rel 1e-5)444RC0032,criterion,rel_improvement_consistent,1,relative improvements = 1 - rmse_ridge/rmse_baseline (abs 1e-6)445RC0032,criterion,normalisation_declared,1,normalisation_window == 'expanding'446RC0039,criterion,price,1,Equilibrium price ratio within 1e-4 of the closed form447RC0039,criterion,allocations,1,Equilibrium allocations within 1e-3 of the closed form448RC0039,criterion,market_clearing,1,"Reported allocations sum to the true aggregate endowment of good 1 (recomputed, |x1_A + x1_B - 12| <= 1e-3) and reported excess demand ~0"449RC0039,criterion,walras,1,Reported Walras' law residual p*z1 + z2 within 1e-6 of zero450RC0039,criterion,aggregates,1,"Aggregate endowments used equal the sums of individual endowments (12, 10), not the stated summary figure"451RC0039,criterion,inconsistency_detected,1,data_issues contains an entry describing the aggregate-endowment inconsistency (regex on issue text: (aggregate|total|sum|summary) AND (endow|good) AND (inconsisten|mismatch|differ|not (equal|match|sum|add)|does not|do not|doesn't|wrong|incorrect|disagree|conflict|discrepan|contradict|≠|!=|<>|\bvs\b|versus|instead|rather than|should be|actual|overstat|exceed|off by|error|\bwhile\b|\bbut\b|whereas|however))452RC0039,criterion,numerical_validation,1,Numerically solved price (root of excess demand) within 1e-4 of the closed form453RC0035,criterion,naive,1,Naive RMSE/MAE exact (rel 1e-6)454RC0035,criterion,mean_baseline,1,Expanding-mean RMSE/MAE exact (rel 1e-6)455RC0035,criterion,ridge_errors,1,Ridge RMSE/MAE within 1e-3 relative of the expanding-window-standardised reference456RC0035,criterion,counts,1,n_origins = 60457RC0035,criterion,forecasts_chronology,1,"forecasts.csv: 180 rows, targets = origin + 1, naive/mean rows exact, actuals = data"458RC0035,criterion,ridge_forecasts_match,1,RMS distance of ridge forecasts to the expanding-window reference <= 1e-3459RC0035,criterion,model_errors_consistent,1,ridge RMSE/MAE agree with forecasts.csv (rel 1e-5)460RC0035,criterion,rel_improvement_consistent,1,relative improvements = 1 - rmse_ridge/rmse_baseline (abs 1e-6)461RC0035,criterion,normalisation_declared,1,normalisation_window == 'expanding'462RC0030,criterion,naive,1,Naive RMSE/MAE exact (rel 1e-6)463RC0030,criterion,mean_baseline,1,Expanding-mean RMSE/MAE exact (rel 1e-6)464RC0030,criterion,ridge_errors,1,Ridge RMSE/MAE within 1e-3 relative of the expanding-window-standardised reference465RC0030,criterion,counts,1,n_origins = 60466RC0030,criterion,forecasts_chronology,1,"forecasts.csv: 180 rows, targets = origin + 1, naive/mean rows exact, actuals = data"467RC0030,criterion,ridge_forecasts_match,1,RMS distance of ridge forecasts to the expanding-window reference <= 1e-3468RC0030,criterion,model_errors_consistent,1,ridge RMSE/MAE agree with forecasts.csv (rel 1e-5)469RC0030,criterion,rel_improvement_consistent,1,relative improvements = 1 - rmse_ridge/rmse_baseline (abs 1e-6)470RC0030,criterion,normalisation_declared,1,normalisation_window == 'expanding'471RC0033,criterion,naive,1,Naive RMSE/MAE exact (rel 1e-6)472RC0033,criterion,mean_baseline,1,Expanding-mean RMSE/MAE exact (rel 1e-6)473RC0033,criterion,ridge_errors,1,Ridge RMSE/MAE within 1e-3 relative of the expanding-window-standardised reference474RC0033,criterion,counts,1,n_origins = 60475RC0033,criterion,forecasts_chronology,1,"forecasts.csv: 180 rows, targets = origin + 1, naive/mean rows exact, actuals = data"476RC0033,criterion,ridge_forecasts_match,1,RMS distance of ridge forecasts to the expanding-window reference <= 1e-3477RC0033,criterion,model_errors_consistent,1,ridge RMSE/MAE agree with forecasts.csv (rel 1e-5)478RC0033,criterion,rel_improvement_consistent,1,relative improvements = 1 - rmse_ridge/rmse_baseline (abs 1e-6)479RC0033,criterion,normalisation_declared,1,normalisation_window == 'expanding'480RC0037,criterion,price,1,Equilibrium price ratio within 1e-4 of the closed form481RC0037,criterion,allocations,1,Equilibrium allocations within 1e-3 of the closed form482RC0037,criterion,market_clearing,1,"Reported allocations sum to the true aggregate endowment of good 1 (recomputed, |x1_A + x1_B - 12| <= 1e-3) and reported excess demand ~0"483RC0037,criterion,walras,1,Reported Walras' law residual p*z1 + z2 within 1e-6 of zero484RC0037,criterion,aggregates,1,"Aggregate endowments used equal the sums of individual endowments (12, 10), not the stated summary figure"485RC0037,criterion,inconsistency_detected,1,data_issues contains an entry describing the aggregate-endowment inconsistency (regex on issue text: (aggregate|total|sum|summary) AND (endow|good) AND (inconsisten|mismatch|differ|not (equal|match|sum|add)|does not|do not|doesn't|wrong|incorrect|disagree|conflict|discrepan|contradict|≠|!=|<>|\bvs\b|versus|instead|rather than|should be|actual|overstat|exceed|off by|error|\bwhile\b|\bbut\b|whereas|however))486RC0037,criterion,numerical_validation,1,Numerically solved price (root of excess demand) within 1e-4 of the closed form487RC0038,criterion,price,1,Equilibrium price ratio within 1e-4 of the closed form488RC0038,criterion,allocations,1,Equilibrium allocations within 1e-3 of the closed form489RC0038,criterion,market_clearing,1,"Reported allocations sum to the true aggregate endowment of good 1 (recomputed, |x1_A + x1_B - 12| <= 1e-3) and reported excess demand ~0"490RC0038,criterion,walras,1,Reported Walras' law residual p*z1 + z2 within 1e-6 of zero491RC0038,criterion,aggregates,1,"Aggregate endowments used equal the sums of individual endowments (12, 10), not the stated summary figure"492RC0038,criterion,inconsistency_detected,1,data_issues contains an entry describing the aggregate-endowment inconsistency (regex on issue text: (aggregate|total|sum|summary) AND (endow|good) AND (inconsisten|mismatch|differ|not (equal|match|sum|add)|does not|do not|doesn't|wrong|incorrect|disagree|conflict|discrepan|contradict|≠|!=|<>|\bvs\b|versus|instead|rather than|should be|actual|overstat|exceed|off by|error|\bwhile\b|\bbut\b|whereas|however))493RC0038,criterion,numerical_validation,1,Numerically solved price (root of excess demand) within 1e-4 of the closed form494RC0042,criterion,price,1,Equilibrium price ratio within 1e-4 of the closed form495RC0042,criterion,allocations,1,Equilibrium allocations within 1e-3 of the closed form496RC0042,criterion,market_clearing,1,"Reported allocations sum to the true aggregate endowment of good 1 (recomputed, |x1_A + x1_B - 12| <= 1e-3) and reported excess demand ~0"497RC0042,criterion,walras,1,Reported Walras' law residual p*z1 + z2 within 1e-6 of zero498RC0042,criterion,aggregates,1,"Aggregate endowments used equal the sums of individual endowments (12, 10), not the stated summary figure"499RC0042,criterion,inconsistency_detected,1,data_issues contains an entry describing the aggregate-endowment inconsistency (regex on issue text: (aggregate|total|sum|summary) AND (endow|good) AND (inconsisten|mismatch|differ|not (equal|match|sum|add)|does not|do not|doesn't|wrong|incorrect|disagree|conflict|discrepan|contradict|≠|!=|<>|\bvs\b|versus|instead|rather than|should be|actual|overstat|exceed|off by|error|\bwhile\b|\bbut\b|whereas|however))500RC0042,criterion,numerical_validation,1,Numerically solved price (root of excess demand) within 1e-4 of the closed form501RC0040,criterion,price,1,Equilibrium price ratio within 1e-4 of the closed form502RC0040,criterion,allocations,1,Equilibrium allocations within 1e-3 of the closed form503RC0040,criterion,market_clearing,1,"Reported allocations sum to the true aggregate endowment of good 1 (recomputed, |x1_A + x1_B - 12| <= 1e-3) and reported excess demand ~0"504RC0040,criterion,walras,1,Reported Walras' law residual p*z1 + z2 within 1e-6 of zero505RC0040,criterion,aggregates,1,"Aggregate endowments used equal the sums of individual endowments (12, 10), not the stated summary figure"506RC0040,criterion,inconsistency_detected,1,data_issues contains an entry describing the aggregate-endowment inconsistency (regex on issue text: (aggregate|total|sum|summary) AND (endow|good) AND (inconsisten|mismatch|differ|not (equal|match|sum|add)|does not|do not|doesn't|wrong|incorrect|disagree|conflict|discrepan|contradict|≠|!=|<>|\bvs\b|versus|instead|rather than|should be|actual|overstat|exceed|off by|error|\bwhile\b|\bbut\b|whereas|however))507RC0040,criterion,numerical_validation,1,Numerically solved price (root of excess demand) within 1e-4 of the closed form508RC0036,criterion,naive,1,Naive RMSE/MAE exact (rel 1e-6)509RC0036,criterion,mean_baseline,1,Expanding-mean RMSE/MAE exact (rel 1e-6)510RC0036,criterion,ridge_errors,1,Ridge RMSE/MAE within 1e-3 relative of the expanding-window-standardised reference511RC0036,criterion,counts,1,n_origins = 60512RC0036,criterion,forecasts_chronology,1,"forecasts.csv: 180 rows, targets = origin + 1, naive/mean rows exact, actuals = data"513RC0036,criterion,ridge_forecasts_match,1,RMS distance of ridge forecasts to the expanding-window reference <= 1e-3514RC0036,criterion,model_errors_consistent,1,ridge RMSE/MAE agree with forecasts.csv (rel 1e-5)515RC0036,criterion,rel_improvement_consistent,1,relative improvements = 1 - rmse_ridge/rmse_baseline (abs 1e-6)516RC0036,criterion,normalisation_declared,1,normalisation_window == 'expanding'517RC0041,criterion,price,1,Equilibrium price ratio within 1e-4 of the closed form518RC0041,criterion,allocations,1,Equilibrium allocations within 1e-3 of the closed form519RC0041,criterion,market_clearing,1,"Reported allocations sum to the true aggregate endowment of good 1 (recomputed, |x1_A + x1_B - 12| <= 1e-3) and reported excess demand ~0"520RC0041,criterion,walras,1,Reported Walras' law residual p*z1 + z2 within 1e-6 of zero521RC0041,criterion,aggregates,1,"Aggregate endowments used equal the sums of individual endowments (12, 10), not the stated summary figure"522RC0041,criterion,inconsistency_detected,1,data_issues contains an entry describing the aggregate-endowment inconsistency (regex on issue text: (aggregate|total|sum|summary) AND (endow|good) AND (inconsisten|mismatch|differ|not (equal|match|sum|add)|does not|do not|doesn't|wrong|incorrect|disagree|conflict|discrepan|contradict|≠|!=|<>|\bvs\b|versus|instead|rather than|should be|actual|overstat|exceed|off by|error|\bwhile\b|\bbut\b|whereas|however))523RC0041,criterion,numerical_validation,1,Numerically solved price (root of excess demand) within 1e-4 of the closed form524RC0043,criterion,price,1,Equilibrium price ratio within 1e-4 of the closed form525RC0043,criterion,allocations,1,Equilibrium allocations within 1e-3 of the closed form526RC0043,criterion,market_clearing,1,"Reported allocations sum to the true aggregate endowment of good 1 (recomputed, |x1_A + x1_B - 12| <= 1e-3) and reported excess demand ~0"527RC0043,criterion,walras,1,Reported Walras' law residual p*z1 + z2 within 1e-6 of zero528RC0043,criterion,aggregates,1,"Aggregate endowments used equal the sums of individual endowments (12, 10), not the stated summary figure"529RC0043,criterion,inconsistency_detected,1,data_issues contains an entry describing the aggregate-endowment inconsistency (regex on issue text: (aggregate|total|sum|summary) AND (endow|good) AND (inconsisten|mismatch|differ|not (equal|match|sum|add)|does not|do not|doesn't|wrong|incorrect|disagree|conflict|discrepan|contradict|≠|!=|<>|\bvs\b|versus|instead|rather than|should be|actual|overstat|exceed|off by|error|\bwhile\b|\bbut\b|whereas|however))530RC0043,criterion,numerical_validation,1,Numerically solved price (root of excess demand) within 1e-4 of the closed form531RC0044,criterion,price,1,Equilibrium price ratio within 1e-4 of the closed form532RC0044,criterion,allocations,1,Equilibrium allocations within 1e-3 of the closed form533RC0044,criterion,market_clearing,1,"Reported allocations sum to the true aggregate endowment of good 1 (recomputed, |x1_A + x1_B - 12| <= 1e-3) and reported excess demand ~0"534RC0044,criterion,walras,1,Reported Walras' law residual p*z1 + z2 within 1e-6 of zero535RC0044,criterion,aggregates,1,"Aggregate endowments used equal the sums of individual endowments (12, 10), not the stated summary figure"536RC0044,criterion,inconsistency_detected,1,data_issues contains an entry describing the aggregate-endowment inconsistency (regex on issue text: (aggregate|total|sum|summary) AND (endow|good) AND (inconsisten|mismatch|differ|not (equal|match|sum|add)|does not|do not|doesn't|wrong|incorrect|disagree|conflict|discrepan|contradict|≠|!=|<>|\bvs\b|versus|instead|rather than|should be|actual|overstat|exceed|off by|error|\bwhile\b|\bbut\b|whereas|however))537RC0044,criterion,numerical_validation,1,Numerically solved price (root of excess demand) within 1e-4 of the closed form538RC0046,criterion,price,1,Equilibrium price ratio within 1e-4 of the closed form539RC0046,criterion,allocations,1,Equilibrium allocations within 1e-3 of the closed form540RC0046,criterion,market_clearing,1,"Reported allocations sum to the true aggregate endowment of good 1 (recomputed, |x1_A + x1_B - 12| <= 1e-3) and reported excess demand ~0"541RC0046,criterion,walras,1,Reported Walras' law residual p*z1 + z2 within 1e-6 of zero542RC0046,criterion,aggregates,1,"Aggregate endowments used equal the sums of individual endowments (12, 10), not the stated summary figure"543RC0046,criterion,inconsistency_detected,1,data_issues contains an entry describing the aggregate-endowment inconsistency (regex on issue text: (aggregate|total|sum|summary) AND (endow|good) AND (inconsisten|mismatch|differ|not (equal|match|sum|add)|does not|do not|doesn't|wrong|incorrect|disagree|conflict|discrepan|contradict|≠|!=|<>|\bvs\b|versus|instead|rather than|should be|actual|overstat|exceed|off by|error|\bwhile\b|\bbut\b|whereas|however))544RC0046,criterion,numerical_validation,1,Numerically solved price (root of excess demand) within 1e-4 of the closed form545RC0045,criterion,price,1,Equilibrium price ratio within 1e-4 of the closed form546RC0045,criterion,allocations,1,Equilibrium allocations within 1e-3 of the closed form547RC0045,criterion,market_clearing,1,"Reported allocations sum to the true aggregate endowment of good 1 (recomputed, |x1_A + x1_B - 12| <= 1e-3) and reported excess demand ~0"548RC0045,criterion,walras,1,Reported Walras' law residual p*z1 + z2 within 1e-6 of zero549RC0045,criterion,aggregates,1,"Aggregate endowments used equal the sums of individual endowments (12, 10), not the stated summary figure"550RC0045,criterion,inconsistency_detected,1,data_issues contains an entry describing the aggregate-endowment inconsistency (regex on issue text: (aggregate|total|sum|summary) AND (endow|good) AND (inconsisten|mismatch|differ|not (equal|match|sum|add)|does not|do not|doesn't|wrong|incorrect|disagree|conflict|discrepan|contradict|≠|!=|<>|\bvs\b|versus|instead|rather than|should be|actual|overstat|exceed|off by|error|\bwhile\b|\bbut\b|whereas|however))551RC0045,criterion,numerical_validation,1,Numerically solved price (root of excess demand) within 1e-4 of the closed form552RC0047,criterion,price,1,Equilibrium price ratio within 1e-4 of the closed form553RC0047,criterion,allocations,1,Equilibrium allocations within 1e-3 of the closed form554RC0047,criterion,market_clearing,1,"Reported allocations sum to the true aggregate endowment of good 1 (recomputed, |x1_A + x1_B - 12| <= 1e-3) and reported excess demand ~0"555RC0047,criterion,walras,1,Reported Walras' law residual p*z1 + z2 within 1e-6 of zero556RC0047,criterion,aggregates,1,"Aggregate endowments used equal the sums of individual endowments (12, 10), not the stated summary figure"557RC0047,criterion,inconsistency_detected,1,data_issues contains an entry describing the aggregate-endowment inconsistency (regex on issue text: (aggregate|total|sum|summary) AND (endow|good) AND (inconsisten|mismatch|differ|not (equal|match|sum|add)|does not|do not|doesn't|wrong|incorrect|disagree|conflict|discrepan|contradict|≠|!=|<>|\bvs\b|versus|instead|rather than|should be|actual|overstat|exceed|off by|error|\bwhile\b|\bbut\b|whereas|however))558RC0047,criterion,numerical_validation,1,Numerically solved price (root of excess demand) within 1e-4 of the closed form559RC0048,criterion,price,1,Equilibrium price ratio within 1e-4 of the closed form560RC0048,criterion,allocations,1,Equilibrium allocations within 1e-3 of the closed form561RC0048,criterion,market_clearing,1,"Reported allocations sum to the true aggregate endowment of good 1 (recomputed, |x1_A + x1_B - 12| <= 1e-3) and reported excess demand ~0"562RC0048,criterion,walras,1,Reported Walras' law residual p*z1 + z2 within 1e-6 of zero563RC0048,criterion,aggregates,1,"Aggregate endowments used equal the sums of individual endowments (12, 10), not the stated summary figure"564RC0048,criterion,inconsistency_detected,1,data_issues contains an entry describing the aggregate-endowment inconsistency (regex on issue text: (aggregate|total|sum|summary) AND (endow|good) AND (inconsisten|mismatch|differ|not (equal|match|sum|add)|does not|do not|doesn't|wrong|incorrect|disagree|conflict|discrepan|contradict|≠|!=|<>|\bvs\b|versus|instead|rather than|should be|actual|overstat|exceed|off by|error|\bwhile\b|\bbut\b|whereas|however))565RC0048,criterion,numerical_validation,1,Numerically solved price (root of excess demand) within 1e-4 of the closed form566RC0055,criterion,cov_conv,1,Empirical coverage of the conventional 95% CI within 3 binomial MC SEs (R=2000) of the true coverage567RC0055,criterion,cov_hc1,1,Empirical coverage of the HC1 95% CI within 3 binomial MC SEs (R=2000) of the true coverage568RC0055,criterion,sd_exact,1,Exact SD of beta_hat under the design (analytical sandwich) to 1e-5 relative569RC0055,criterion,sd_mc,1,Monte Carlo SD of beta_hat within 3 SEs of the sample SD at R=2000570RC0055,criterion,mean_se,1,Mean conventional SE over replications within 3 MC SEs571RC0055,criterion,counts,1,n_replications = 2000 and n_obs_per_replication = 30572RC0055,criterion,undercover_flag,1,conventional_ci_undercovers must be true (true coverage is far below 0.95)573RC0055,criterion,seed_reported,1,random_seed is a non-null integer (the simulation must be seeded and reproducible)574RC0049,criterion,cov_conv,1,Empirical coverage of the conventional 95% CI within 3 binomial MC SEs (R=2000) of the true coverage575RC0049,criterion,cov_hc1,1,Empirical coverage of the HC1 95% CI within 3 binomial MC SEs (R=2000) of the true coverage576RC0049,criterion,sd_exact,1,Exact SD of beta_hat under the design (analytical sandwich) to 1e-5 relative577RC0049,criterion,sd_mc,1,Monte Carlo SD of beta_hat within 3 SEs of the sample SD at R=2000578RC0049,criterion,mean_se,1,Mean conventional SE over replications within 3 MC SEs579RC0049,criterion,counts,1,n_replications = 2000 and n_obs_per_replication = 30580RC0049,criterion,undercover_flag,1,conventional_ci_undercovers must be true (true coverage is far below 0.95)581RC0049,criterion,seed_reported,1,random_seed is a non-null integer (the simulation must be seeded and reproducible)582RC0050,criterion,cov_conv,1,Empirical coverage of the conventional 95% CI within 3 binomial MC SEs (R=2000) of the true coverage583RC0050,criterion,cov_hc1,1,Empirical coverage of the HC1 95% CI within 3 binomial MC SEs (R=2000) of the true coverage584RC0050,criterion,sd_exact,1,Exact SD of beta_hat under the design (analytical sandwich) to 1e-5 relative585RC0050,criterion,sd_mc,1,Monte Carlo SD of beta_hat within 3 SEs of the sample SD at R=2000586RC0050,criterion,mean_se,1,Mean conventional SE over replications within 3 MC SEs587RC0050,criterion,counts,1,n_replications = 2000 and n_obs_per_replication = 30588RC0050,criterion,undercover_flag,1,conventional_ci_undercovers must be true (true coverage is far below 0.95)589RC0050,criterion,seed_reported,1,random_seed is a non-null integer (the simulation must be seeded and reproducible)590RC0052,criterion,cov_conv,1,Empirical coverage of the conventional 95% CI within 3 binomial MC SEs (R=2000) of the true coverage591RC0052,criterion,cov_hc1,1,Empirical coverage of the HC1 95% CI within 3 binomial MC SEs (R=2000) of the true coverage592RC0052,criterion,sd_exact,1,Exact SD of beta_hat under the design (analytical sandwich) to 1e-5 relative593RC0052,criterion,sd_mc,1,Monte Carlo SD of beta_hat within 3 SEs of the sample SD at R=2000594RC0052,criterion,mean_se,1,Mean conventional SE over replications within 3 MC SEs595RC0052,criterion,counts,1,n_replications = 2000 and n_obs_per_replication = 30596RC0052,criterion,undercover_flag,1,conventional_ci_undercovers must be true (true coverage is far below 0.95)597RC0052,criterion,seed_reported,1,random_seed is a non-null integer (the simulation must be seeded and reproducible)598RC0053,criterion,cov_conv,1,Empirical coverage of the conventional 95% CI within 3 binomial MC SEs (R=2000) of the true coverage599RC0053,criterion,cov_hc1,1,Empirical coverage of the HC1 95% CI within 3 binomial MC SEs (R=2000) of the true coverage600RC0053,criterion,sd_exact,1,Exact SD of beta_hat under the design (analytical sandwich) to 1e-5 relative601RC0053,criterion,sd_mc,1,Monte Carlo SD of beta_hat within 3 SEs of the sample SD at R=2000602RC0053,criterion,mean_se,1,Mean conventional SE over replications within 3 MC SEs603RC0053,criterion,counts,1,n_replications = 2000 and n_obs_per_replication = 30604RC0053,criterion,undercover_flag,1,conventional_ci_undercovers must be true (true coverage is far below 0.95)605RC0053,criterion,seed_reported,1,random_seed is a non-null integer (the simulation must be seeded and reproducible)606RC0051,criterion,cov_conv,1,Empirical coverage of the conventional 95% CI within 3 binomial MC SEs (R=2000) of the true coverage607RC0051,criterion,cov_hc1,1,Empirical coverage of the HC1 95% CI within 3 binomial MC SEs (R=2000) of the true coverage608RC0051,criterion,sd_exact,1,Exact SD of beta_hat under the design (analytical sandwich) to 1e-5 relative609RC0051,criterion,sd_mc,1,Monte Carlo SD of beta_hat within 3 SEs of the sample SD at R=2000610RC0051,criterion,mean_se,1,Mean conventional SE over replications within 3 MC SEs611RC0051,criterion,counts,1,n_replications = 2000 and n_obs_per_replication = 30612RC0051,criterion,undercover_flag,1,conventional_ci_undercovers must be true (true coverage is far below 0.95)613RC0051,criterion,seed_reported,1,random_seed is a non-null integer (the simulation must be seeded and reproducible)614RC0056,criterion,cov_conv,1,Empirical coverage of the conventional 95% CI within 3 binomial MC SEs (R=2000) of the true coverage615RC0056,criterion,cov_hc1,1,Empirical coverage of the HC1 95% CI within 3 binomial MC SEs (R=2000) of the true coverage616RC0056,criterion,sd_exact,1,Exact SD of beta_hat under the design (analytical sandwich) to 1e-5 relative617RC0056,criterion,sd_mc,1,Monte Carlo SD of beta_hat within 3 SEs of the sample SD at R=2000618RC0056,criterion,mean_se,1,Mean conventional SE over replications within 3 MC SEs619RC0056,criterion,counts,1,n_replications = 2000 and n_obs_per_replication = 30620RC0056,criterion,undercover_flag,1,conventional_ci_undercovers must be true (true coverage is far below 0.95)621RC0056,criterion,seed_reported,1,random_seed is a non-null integer (the simulation must be seeded and reproducible)622RC0054,criterion,cov_conv,1,Empirical coverage of the conventional 95% CI within 3 binomial MC SEs (R=2000) of the true coverage623RC0054,criterion,cov_hc1,1,Empirical coverage of the HC1 95% CI within 3 binomial MC SEs (R=2000) of the true coverage624RC0054,criterion,sd_exact,1,Exact SD of beta_hat under the design (analytical sandwich) to 1e-5 relative625RC0054,criterion,sd_mc,1,Monte Carlo SD of beta_hat within 3 SEs of the sample SD at R=2000626RC0054,criterion,mean_se,1,Mean conventional SE over replications within 3 MC SEs627RC0054,criterion,counts,1,n_replications = 2000 and n_obs_per_replication = 30628RC0054,criterion,undercover_flag,1,conventional_ci_undercovers must be true (true coverage is far below 0.95)629RC0054,criterion,seed_reported,1,random_seed is a non-null integer (the simulation must be seeded and reproducible)630RC0059,criterion,cov_conv,1,Empirical coverage of the conventional 95% CI within 3 binomial MC SEs (R=2000) of the true coverage631RC0059,criterion,cov_hc1,1,Empirical coverage of the HC1 95% CI within 3 binomial MC SEs (R=2000) of the true coverage632RC0059,criterion,sd_exact,1,Exact SD of beta_hat under the design (analytical sandwich) to 1e-5 relative633RC0059,criterion,sd_mc,1,Monte Carlo SD of beta_hat within 3 SEs of the sample SD at R=2000634RC0059,criterion,mean_se,1,Mean conventional SE over replications within 3 MC SEs635RC0059,criterion,counts,1,n_replications = 2000 and n_obs_per_replication = 30636RC0059,criterion,undercover_flag,1,conventional_ci_undercovers must be true (true coverage is far below 0.95)637RC0059,criterion,seed_reported,1,random_seed is a non-null integer (the simulation must be seeded and reproducible)638RC0057,criterion,cov_conv,1,Empirical coverage of the conventional 95% CI within 3 binomial MC SEs (R=2000) of the true coverage639RC0057,criterion,cov_hc1,1,Empirical coverage of the HC1 95% CI within 3 binomial MC SEs (R=2000) of the true coverage640RC0057,criterion,sd_exact,1,Exact SD of beta_hat under the design (analytical sandwich) to 1e-5 relative641RC0057,criterion,sd_mc,1,Monte Carlo SD of beta_hat within 3 SEs of the sample SD at R=2000642RC0057,criterion,mean_se,1,Mean conventional SE over replications within 3 MC SEs643RC0057,criterion,counts,1,n_replications = 2000 and n_obs_per_replication = 30644RC0057,criterion,undercover_flag,1,conventional_ci_undercovers must be true (true coverage is far below 0.95)645RC0057,criterion,seed_reported,1,random_seed is a non-null integer (the simulation must be seeded and reproducible)646RC0063,criterion,naive_h1,0,"Naive RMSE/MAE at h=1 (last observation of the origin vintage vs first-release actual) exact, rel 1e-6"647RC0063,criterion,naive_h2,0,"Naive RMSE/MAE at h=2 exact, rel 1e-6"648RC0063,criterion,revision,1,"mean_abs_revision_h1_targets = mean |current vintage - first release| over the 8 h=1 targets, rel 1e-6"649RC0063,criterion,counts,1,n_origins = 8650RC0063,criterion,forecasts_chronology,1,"forecasts.csv: 32 rows, vintage = origin, targets = last vintage quarter + h, training data = that vintage, naive = last vintage value, actual = first release"651RC0063,criterion,model_errors_consistent,0,model RMSE/MAE agree with forecasts.csv (rel 1e-5)652RC0063,criterion,rel_improvement_consistent,0,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)653RC0060,criterion,cov_conv,1,Empirical coverage of the conventional 95% CI within 3 binomial MC SEs (R=2000) of the true coverage654RC0060,criterion,cov_hc1,1,Empirical coverage of the HC1 95% CI within 3 binomial MC SEs (R=2000) of the true coverage655RC0060,criterion,sd_exact,1,Exact SD of beta_hat under the design (analytical sandwich) to 1e-5 relative656RC0060,criterion,sd_mc,1,Monte Carlo SD of beta_hat within 3 SEs of the sample SD at R=2000657RC0060,criterion,mean_se,1,Mean conventional SE over replications within 3 MC SEs658RC0060,criterion,counts,1,n_replications = 2000 and n_obs_per_replication = 30659RC0060,criterion,undercover_flag,1,conventional_ci_undercovers must be true (true coverage is far below 0.95)660RC0060,criterion,seed_reported,1,random_seed is a non-null integer (the simulation must be seeded and reproducible)661RC0058,criterion,cov_conv,1,Empirical coverage of the conventional 95% CI within 3 binomial MC SEs (R=2000) of the true coverage662RC0058,criterion,cov_hc1,1,Empirical coverage of the HC1 95% CI within 3 binomial MC SEs (R=2000) of the true coverage663RC0058,criterion,sd_exact,1,Exact SD of beta_hat under the design (analytical sandwich) to 1e-5 relative664RC0058,criterion,sd_mc,1,Monte Carlo SD of beta_hat within 3 SEs of the sample SD at R=2000665RC0058,criterion,mean_se,1,Mean conventional SE over replications within 3 MC SEs666RC0058,criterion,counts,1,n_replications = 2000 and n_obs_per_replication = 30667RC0058,criterion,undercover_flag,1,conventional_ci_undercovers must be true (true coverage is far below 0.95)668RC0058,criterion,seed_reported,1,random_seed is a non-null integer (the simulation must be seeded and reproducible)669RC0061,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 (last observation of the origin vintage vs first-release actual) exact, rel 1e-6"670RC0061,criterion,naive_h2,1,"Naive RMSE/MAE at h=2 exact, rel 1e-6"671RC0061,criterion,revision,1,"mean_abs_revision_h1_targets = mean |current vintage - first release| over the 8 h=1 targets, rel 1e-6"672RC0061,criterion,counts,1,n_origins = 8673RC0061,criterion,forecasts_chronology,1,"forecasts.csv: 32 rows, vintage = origin, targets = last vintage quarter + h, training data = that vintage, naive = last vintage value, actual = first release"674RC0061,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)675RC0061,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)676RC0064,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 (last observation of the origin vintage vs first-release actual) exact, rel 1e-6"677RC0064,criterion,naive_h2,1,"Naive RMSE/MAE at h=2 exact, rel 1e-6"678RC0064,criterion,revision,1,"mean_abs_revision_h1_targets = mean |current vintage - first release| over the 8 h=1 targets, rel 1e-6"679RC0064,criterion,counts,1,n_origins = 8680RC0064,criterion,forecasts_chronology,1,"forecasts.csv: 32 rows, vintage = origin, targets = last vintage quarter + h, training data = that vintage, naive = last vintage value, actual = first release"681RC0064,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)682RC0064,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)683RC0066,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 (last observation of the origin vintage vs first-release actual) exact, rel 1e-6"684RC0066,criterion,naive_h2,1,"Naive RMSE/MAE at h=2 exact, rel 1e-6"685RC0066,criterion,revision,1,"mean_abs_revision_h1_targets = mean |current vintage - first release| over the 8 h=1 targets, rel 1e-6"686RC0066,criterion,counts,1,n_origins = 8687RC0066,criterion,forecasts_chronology,1,"forecasts.csv: 32 rows, vintage = origin, targets = last vintage quarter + h, training data = that vintage, naive = last vintage value, actual = first release"688RC0066,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)689RC0066,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)690RC0062,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 (last observation of the origin vintage vs first-release actual) exact, rel 1e-6"691RC0062,criterion,naive_h2,1,"Naive RMSE/MAE at h=2 exact, rel 1e-6"692RC0062,criterion,revision,1,"mean_abs_revision_h1_targets = mean |current vintage - first release| over the 8 h=1 targets, rel 1e-6"693RC0062,criterion,counts,1,n_origins = 8694RC0062,criterion,forecasts_chronology,1,"forecasts.csv: 32 rows, vintage = origin, targets = last vintage quarter + h, training data = that vintage, naive = last vintage value, actual = first release"695RC0062,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)696RC0062,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)697RC0069,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 (last observation of the origin vintage vs first-release actual) exact, rel 1e-6"698RC0069,criterion,naive_h2,1,"Naive RMSE/MAE at h=2 exact, rel 1e-6"699RC0069,criterion,revision,1,"mean_abs_revision_h1_targets = mean |current vintage - first release| over the 8 h=1 targets, rel 1e-6"700RC0069,criterion,counts,1,n_origins = 8701RC0069,criterion,forecasts_chronology,1,"forecasts.csv: 32 rows, vintage = origin, targets = last vintage quarter + h, training data = that vintage, naive = last vintage value, actual = first release"702RC0069,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)703RC0069,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)704RC0068,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 (last observation of the origin vintage vs first-release actual) exact, rel 1e-6"705RC0068,criterion,naive_h2,1,"Naive RMSE/MAE at h=2 exact, rel 1e-6"706RC0068,criterion,revision,1,"mean_abs_revision_h1_targets = mean |current vintage - first release| over the 8 h=1 targets, rel 1e-6"707RC0068,criterion,counts,1,n_origins = 8708RC0068,criterion,forecasts_chronology,1,"forecasts.csv: 32 rows, vintage = origin, targets = last vintage quarter + h, training data = that vintage, naive = last vintage value, actual = first release"709RC0068,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)710RC0068,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)711RC0065,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 (last observation of the origin vintage vs first-release actual) exact, rel 1e-6"712RC0065,criterion,naive_h2,1,"Naive RMSE/MAE at h=2 exact, rel 1e-6"713RC0065,criterion,revision,1,"mean_abs_revision_h1_targets = mean |current vintage - first release| over the 8 h=1 targets, rel 1e-6"714RC0065,criterion,counts,1,n_origins = 8715RC0065,criterion,forecasts_chronology,1,"forecasts.csv: 32 rows, vintage = origin, targets = last vintage quarter + h, training data = that vintage, naive = last vintage value, actual = first release"716RC0065,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)717RC0065,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)718RC0067,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 (last observation of the origin vintage vs first-release actual) exact, rel 1e-6"719RC0067,criterion,naive_h2,1,"Naive RMSE/MAE at h=2 exact, rel 1e-6"720RC0067,criterion,revision,1,"mean_abs_revision_h1_targets = mean |current vintage - first release| over the 8 h=1 targets, rel 1e-6"721RC0067,criterion,counts,1,n_origins = 8722RC0067,criterion,forecasts_chronology,1,"forecasts.csv: 32 rows, vintage = origin, targets = last vintage quarter + h, training data = that vintage, naive = last vintage value, actual = first release"723RC0067,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)724RC0067,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)725RC0073,criterion,snaive_h1,1,Seasonal-naive RMSE/MAE at h=1 exact (rel 1e-6)726RC0073,criterion,snaive_h2,1,Seasonal-naive RMSE/MAE at h=2 exact727RC0073,criterion,snaive_h4,1,Seasonal-naive RMSE/MAE at h=4 exact728RC0073,criterion,counts,1,n_origins = 40729RC0073,criterion,forecasts_chronology,1,"forecasts.csv: 240 rows, targets = origin + h quarters, seasonal-naive rows exact, actuals = data"730RC0073,criterion,model_errors_consistent,1,model RMSE/MAE per horizon agree with forecasts.csv (rel 1e-5)731RC0073,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_snaive (abs 1e-6)732RC0073,criterion,loss_diff_mean_h4,1,loss_diff_mean_h4 = mean(e_snaive^2 - e_model^2) at h=4 from forecasts.csv (rel 1e-5)733RC0073,criterion,hac_se_h4,1,"loss_diff_se_h4 equals (rel 3%) the HAC standard error recomputed from the executor's own h=4 loss differentials with the reported kernel and truncation lag (lag in [3, 8]; Bartlett with either weight convention, rectangular or Parzen; small-sample factor n/(n-1) covered)"734RC0073,criterion,hac_lags_h4,1,"hac_lags_h4 integer in [3, 8]"735RC0073,criterion,dm_stat_h4,1,"dm_stat_h4 = mean/se (rel 1e-3) and dm_pvalue_h4 consistent (normal or t(39), with/without HLN correction, abs 0.005)"736RC0071,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 (last observation of the origin vintage vs first-release actual) exact, rel 1e-6"737RC0071,criterion,naive_h2,1,"Naive RMSE/MAE at h=2 exact, rel 1e-6"738RC0071,criterion,revision,1,"mean_abs_revision_h1_targets = mean |current vintage - first release| over the 8 h=1 targets, rel 1e-6"739RC0071,criterion,counts,1,n_origins = 8740RC0071,criterion,forecasts_chronology,1,"forecasts.csv: 32 rows, vintage = origin, targets = last vintage quarter + h, training data = that vintage, naive = last vintage value, actual = first release"741RC0071,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)742RC0071,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)743RC0076,criterion,snaive_h1,1,Seasonal-naive RMSE/MAE at h=1 exact (rel 1e-6)744RC0076,criterion,snaive_h2,1,Seasonal-naive RMSE/MAE at h=2 exact745RC0076,criterion,snaive_h4,1,Seasonal-naive RMSE/MAE at h=4 exact746RC0076,criterion,counts,1,n_origins = 40747RC0076,criterion,forecasts_chronology,1,"forecasts.csv: 240 rows, targets = origin + h quarters, seasonal-naive rows exact, actuals = data"748RC0076,criterion,model_errors_consistent,1,model RMSE/MAE per horizon agree with forecasts.csv (rel 1e-5)749RC0076,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_snaive (abs 1e-6)750RC0076,criterion,loss_diff_mean_h4,1,loss_diff_mean_h4 = mean(e_snaive^2 - e_model^2) at h=4 from forecasts.csv (rel 1e-5)751RC0076,criterion,hac_se_h4,1,"loss_diff_se_h4 equals (rel 3%) the HAC standard error recomputed from the executor's own h=4 loss differentials with the reported kernel and truncation lag (lag in [3, 8]; Bartlett with either weight convention, rectangular or Parzen; small-sample factor n/(n-1) covered)"752RC0076,criterion,hac_lags_h4,1,"hac_lags_h4 integer in [3, 8]"753RC0076,criterion,dm_stat_h4,1,"dm_stat_h4 = mean/se (rel 1e-3) and dm_pvalue_h4 consistent (normal or t(39), with/without HLN correction, abs 0.005)"754RC0074,criterion,snaive_h1,1,Seasonal-naive RMSE/MAE at h=1 exact (rel 1e-6)755RC0074,criterion,snaive_h2,1,Seasonal-naive RMSE/MAE at h=2 exact756RC0074,criterion,snaive_h4,1,Seasonal-naive RMSE/MAE at h=4 exact757RC0074,criterion,counts,1,n_origins = 40758RC0074,criterion,forecasts_chronology,1,"forecasts.csv: 240 rows, targets = origin + h quarters, seasonal-naive rows exact, actuals = data"759RC0074,criterion,model_errors_consistent,1,model RMSE/MAE per horizon agree with forecasts.csv (rel 1e-5)760RC0074,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_snaive (abs 1e-6)761RC0074,criterion,loss_diff_mean_h4,1,loss_diff_mean_h4 = mean(e_snaive^2 - e_model^2) at h=4 from forecasts.csv (rel 1e-5)762RC0074,criterion,hac_se_h4,1,"loss_diff_se_h4 equals (rel 3%) the HAC standard error recomputed from the executor's own h=4 loss differentials with the reported kernel and truncation lag (lag in [3, 8]; Bartlett with either weight convention, rectangular or Parzen; small-sample factor n/(n-1) covered)"763RC0074,criterion,hac_lags_h4,1,"hac_lags_h4 integer in [3, 8]"764RC0074,criterion,dm_stat_h4,1,"dm_stat_h4 = mean/se (rel 1e-3) and dm_pvalue_h4 consistent (normal or t(39), with/without HLN correction, abs 0.005)"765RC0072,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 (last observation of the origin vintage vs first-release actual) exact, rel 1e-6"766RC0072,criterion,naive_h2,1,"Naive RMSE/MAE at h=2 exact, rel 1e-6"767RC0072,criterion,revision,1,"mean_abs_revision_h1_targets = mean |current vintage - first release| over the 8 h=1 targets, rel 1e-6"768RC0072,criterion,counts,1,n_origins = 8769RC0072,criterion,forecasts_chronology,1,"forecasts.csv: 32 rows, vintage = origin, targets = last vintage quarter + h, training data = that vintage, naive = last vintage value, actual = first release"770RC0072,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)771RC0072,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)772RC0070,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 (last observation of the origin vintage vs first-release actual) exact, rel 1e-6"773RC0070,criterion,naive_h2,1,"Naive RMSE/MAE at h=2 exact, rel 1e-6"774RC0070,criterion,revision,1,"mean_abs_revision_h1_targets = mean |current vintage - first release| over the 8 h=1 targets, rel 1e-6"775RC0070,criterion,counts,1,n_origins = 8776RC0070,criterion,forecasts_chronology,1,"forecasts.csv: 32 rows, vintage = origin, targets = last vintage quarter + h, training data = that vintage, naive = last vintage value, actual = first release"777RC0070,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)778RC0070,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)779RC0077,criterion,snaive_h1,1,Seasonal-naive RMSE/MAE at h=1 exact (rel 1e-6)780RC0077,criterion,snaive_h2,1,Seasonal-naive RMSE/MAE at h=2 exact781RC0077,criterion,snaive_h4,1,Seasonal-naive RMSE/MAE at h=4 exact782RC0077,criterion,counts,1,n_origins = 40783RC0077,criterion,forecasts_chronology,1,"forecasts.csv: 240 rows, targets = origin + h quarters, seasonal-naive rows exact, actuals = data"784RC0077,criterion,model_errors_consistent,1,model RMSE/MAE per horizon agree with forecasts.csv (rel 1e-5)785RC0077,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_snaive (abs 1e-6)786RC0077,criterion,loss_diff_mean_h4,1,loss_diff_mean_h4 = mean(e_snaive^2 - e_model^2) at h=4 from forecasts.csv (rel 1e-5)787RC0077,criterion,hac_se_h4,1,"loss_diff_se_h4 equals (rel 3%) the HAC standard error recomputed from the executor's own h=4 loss differentials with the reported kernel and truncation lag (lag in [3, 8]; Bartlett with either weight convention, rectangular or Parzen; small-sample factor n/(n-1) covered)"788RC0077,criterion,hac_lags_h4,1,"hac_lags_h4 integer in [3, 8]"789RC0077,criterion,dm_stat_h4,1,"dm_stat_h4 = mean/se (rel 1e-3) and dm_pvalue_h4 consistent (normal or t(39), with/without HLN correction, abs 0.005)"790RC0075,criterion,snaive_h1,1,Seasonal-naive RMSE/MAE at h=1 exact (rel 1e-6)791RC0075,criterion,snaive_h2,1,Seasonal-naive RMSE/MAE at h=2 exact792RC0075,criterion,snaive_h4,1,Seasonal-naive RMSE/MAE at h=4 exact793RC0075,criterion,counts,1,n_origins = 40794RC0075,criterion,forecasts_chronology,1,"forecasts.csv: 240 rows, targets = origin + h quarters, seasonal-naive rows exact, actuals = data"795RC0075,criterion,model_errors_consistent,1,model RMSE/MAE per horizon agree with forecasts.csv (rel 1e-5)796RC0075,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_snaive (abs 1e-6)797RC0075,criterion,loss_diff_mean_h4,1,loss_diff_mean_h4 = mean(e_snaive^2 - e_model^2) at h=4 from forecasts.csv (rel 1e-5)798RC0075,criterion,hac_se_h4,1,"loss_diff_se_h4 equals (rel 3%) the HAC standard error recomputed from the executor's own h=4 loss differentials with the reported kernel and truncation lag (lag in [3, 8]; Bartlett with either weight convention, rectangular or Parzen; small-sample factor n/(n-1) covered)"799RC0075,criterion,hac_lags_h4,1,"hac_lags_h4 integer in [3, 8]"800RC0075,criterion,dm_stat_h4,1,"dm_stat_h4 = mean/se (rel 1e-3) and dm_pvalue_h4 consistent (normal or t(39), with/without HLN correction, abs 0.005)"801RC0080,criterion,snaive_h1,1,Seasonal-naive RMSE/MAE at h=1 exact (rel 1e-6)802RC0080,criterion,snaive_h2,1,Seasonal-naive RMSE/MAE at h=2 exact803RC0080,criterion,snaive_h4,1,Seasonal-naive RMSE/MAE at h=4 exact804RC0080,criterion,counts,1,n_origins = 40805RC0080,criterion,forecasts_chronology,1,"forecasts.csv: 240 rows, targets = origin + h quarters, seasonal-naive rows exact, actuals = data"806RC0080,criterion,model_errors_consistent,1,model RMSE/MAE per horizon agree with forecasts.csv (rel 1e-5)807RC0080,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_snaive (abs 1e-6)808RC0080,criterion,loss_diff_mean_h4,1,loss_diff_mean_h4 = mean(e_snaive^2 - e_model^2) at h=4 from forecasts.csv (rel 1e-5)809RC0080,criterion,hac_se_h4,1,"loss_diff_se_h4 equals (rel 3%) the HAC standard error recomputed from the executor's own h=4 loss differentials with the reported kernel and truncation lag (lag in [3, 8]; Bartlett with either weight convention, rectangular or Parzen; small-sample factor n/(n-1) covered)"810RC0080,criterion,hac_lags_h4,1,"hac_lags_h4 integer in [3, 8]"811RC0080,criterion,dm_stat_h4,1,"dm_stat_h4 = mean/se (rel 1e-3) and dm_pvalue_h4 consistent (normal or t(39), with/without HLN correction, abs 0.005)"812RC0078,criterion,snaive_h1,1,Seasonal-naive RMSE/MAE at h=1 exact (rel 1e-6)813RC0078,criterion,snaive_h2,1,Seasonal-naive RMSE/MAE at h=2 exact814RC0078,criterion,snaive_h4,1,Seasonal-naive RMSE/MAE at h=4 exact815RC0078,criterion,counts,1,n_origins = 40816RC0078,criterion,forecasts_chronology,1,"forecasts.csv: 240 rows, targets = origin + h quarters, seasonal-naive rows exact, actuals = data"817RC0078,criterion,model_errors_consistent,1,model RMSE/MAE per horizon agree with forecasts.csv (rel 1e-5)818RC0078,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_snaive (abs 1e-6)819RC0078,criterion,loss_diff_mean_h4,1,loss_diff_mean_h4 = mean(e_snaive^2 - e_model^2) at h=4 from forecasts.csv (rel 1e-5)820RC0078,criterion,hac_se_h4,1,"loss_diff_se_h4 equals (rel 3%) the HAC standard error recomputed from the executor's own h=4 loss differentials with the reported kernel and truncation lag (lag in [3, 8]; Bartlett with either weight convention, rectangular or Parzen; small-sample factor n/(n-1) covered)"821RC0078,criterion,hac_lags_h4,1,"hac_lags_h4 integer in [3, 8]"822RC0078,criterion,dm_stat_h4,1,"dm_stat_h4 = mean/se (rel 1e-3) and dm_pvalue_h4 consistent (normal or t(39), with/without HLN correction, abs 0.005)"823RC0083,criterion,snaive_h1,1,Seasonal-naive RMSE/MAE at h=1 exact (rel 1e-6)824RC0083,criterion,snaive_h2,1,Seasonal-naive RMSE/MAE at h=2 exact825RC0083,criterion,snaive_h4,1,Seasonal-naive RMSE/MAE at h=4 exact826RC0083,criterion,counts,1,n_origins = 40827RC0083,criterion,forecasts_chronology,1,"forecasts.csv: 240 rows, targets = origin + h quarters, seasonal-naive rows exact, actuals = data"828RC0083,criterion,model_errors_consistent,1,model RMSE/MAE per horizon agree with forecasts.csv (rel 1e-5)829RC0083,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_snaive (abs 1e-6)830RC0083,criterion,loss_diff_mean_h4,1,loss_diff_mean_h4 = mean(e_snaive^2 - e_model^2) at h=4 from forecasts.csv (rel 1e-5)831RC0083,criterion,hac_se_h4,1,"loss_diff_se_h4 equals (rel 3%) the HAC standard error recomputed from the executor's own h=4 loss differentials with the reported kernel and truncation lag (lag in [3, 8]; Bartlett with either weight convention, rectangular or Parzen; small-sample factor n/(n-1) covered)"832RC0083,criterion,hac_lags_h4,1,"hac_lags_h4 integer in [3, 8]"833RC0083,criterion,dm_stat_h4,1,"dm_stat_h4 = mean/se (rel 1e-3) and dm_pvalue_h4 consistent (normal or t(39), with/without HLN correction, abs 0.005)"834RC0079,criterion,snaive_h1,1,Seasonal-naive RMSE/MAE at h=1 exact (rel 1e-6)835RC0079,criterion,snaive_h2,1,Seasonal-naive RMSE/MAE at h=2 exact836RC0079,criterion,snaive_h4,1,Seasonal-naive RMSE/MAE at h=4 exact837RC0079,criterion,counts,1,n_origins = 40838RC0079,criterion,forecasts_chronology,1,"forecasts.csv: 240 rows, targets = origin + h quarters, seasonal-naive rows exact, actuals = data"839RC0079,criterion,model_errors_consistent,1,model RMSE/MAE per horizon agree with forecasts.csv (rel 1e-5)840RC0079,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_snaive (abs 1e-6)841RC0079,criterion,loss_diff_mean_h4,1,loss_diff_mean_h4 = mean(e_snaive^2 - e_model^2) at h=4 from forecasts.csv (rel 1e-5)842RC0079,criterion,hac_se_h4,1,"loss_diff_se_h4 equals (rel 3%) the HAC standard error recomputed from the executor's own h=4 loss differentials with the reported kernel and truncation lag (lag in [3, 8]; Bartlett with either weight convention, rectangular or Parzen; small-sample factor n/(n-1) covered)"843RC0079,criterion,hac_lags_h4,1,"hac_lags_h4 integer in [3, 8]"844RC0079,criterion,dm_stat_h4,1,"dm_stat_h4 = mean/se (rel 1e-3) and dm_pvalue_h4 consistent (normal or t(39), with/without HLN correction, abs 0.005)"845RC0084,criterion,snaive_h1,1,Seasonal-naive RMSE/MAE at h=1 exact (rel 1e-6)846RC0084,criterion,snaive_h2,1,Seasonal-naive RMSE/MAE at h=2 exact847RC0084,criterion,snaive_h4,1,Seasonal-naive RMSE/MAE at h=4 exact848RC0084,criterion,counts,1,n_origins = 40849RC0084,criterion,forecasts_chronology,1,"forecasts.csv: 240 rows, targets = origin + h quarters, seasonal-naive rows exact, actuals = data"850RC0084,criterion,model_errors_consistent,1,model RMSE/MAE per horizon agree with forecasts.csv (rel 1e-5)851RC0084,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_snaive (abs 1e-6)852RC0084,criterion,loss_diff_mean_h4,1,loss_diff_mean_h4 = mean(e_snaive^2 - e_model^2) at h=4 from forecasts.csv (rel 1e-5)853RC0084,criterion,hac_se_h4,1,"loss_diff_se_h4 equals (rel 3%) the HAC standard error recomputed from the executor's own h=4 loss differentials with the reported kernel and truncation lag (lag in [3, 8]; Bartlett with either weight convention, rectangular or Parzen; small-sample factor n/(n-1) covered)"854RC0084,criterion,hac_lags_h4,1,"hac_lags_h4 integer in [3, 8]"855RC0084,criterion,dm_stat_h4,1,"dm_stat_h4 = mean/se (rel 1e-3) and dm_pvalue_h4 consistent (normal or t(39), with/without HLN correction, abs 0.005)"856RC0081,criterion,snaive_h1,1,Seasonal-naive RMSE/MAE at h=1 exact (rel 1e-6)857RC0081,criterion,snaive_h2,1,Seasonal-naive RMSE/MAE at h=2 exact858RC0081,criterion,snaive_h4,1,Seasonal-naive RMSE/MAE at h=4 exact859RC0081,criterion,counts,1,n_origins = 40860RC0081,criterion,forecasts_chronology,1,"forecasts.csv: 240 rows, targets = origin + h quarters, seasonal-naive rows exact, actuals = data"861RC0081,criterion,model_errors_consistent,1,model RMSE/MAE per horizon agree with forecasts.csv (rel 1e-5)862RC0081,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_snaive (abs 1e-6)863RC0081,criterion,loss_diff_mean_h4,1,loss_diff_mean_h4 = mean(e_snaive^2 - e_model^2) at h=4 from forecasts.csv (rel 1e-5)864RC0081,criterion,hac_se_h4,1,"loss_diff_se_h4 equals (rel 3%) the HAC standard error recomputed from the executor's own h=4 loss differentials with the reported kernel and truncation lag (lag in [3, 8]; Bartlett with either weight convention, rectangular or Parzen; small-sample factor n/(n-1) covered)"865RC0081,criterion,hac_lags_h4,1,"hac_lags_h4 integer in [3, 8]"866RC0081,criterion,dm_stat_h4,1,"dm_stat_h4 = mean/se (rel 1e-3) and dm_pvalue_h4 consistent (normal or t(39), with/without HLN correction, abs 0.005)"867RC0085,criterion,verdict_A1,1,verdict for A1 = supported868RC0085,criterion,verdict_A2,1,verdict for A2 = not_supported869RC0085,criterion,verdict_A3,1,verdict for A3 = not_supported870RC0085,criterion,verdict_A4,1,verdict for A4 = not_supported871RC0085,criterion,verdict_A5,1,verdict for A5 = not_assessable872RC0085,criterion,verdict_A6,1,verdict for A6 = supported873RC0085,criterion,loc_A1,1,locator for A1 names arxiv-2609.27732v1 and the deciding table/section874RC0085,criterion,loc_A2,1,locator for A2 names arxiv-2609.27732v1 and the deciding table/section875RC0085,criterion,loc_A3,1,locator for A3 names arxiv-2609.27732v1 and the deciding table/section876RC0085,criterion,loc_A4,1,locator for A4 names arxiv-2609.27732v1 and the deciding table/section877RC0085,criterion,loc_A5,1,locator for A5 names arxiv-2609.27732v1 and the deciding table/section878RC0085,criterion,loc_A6,1,locator for A6 names arxiv-2606.14621v1 and the deciding table/section879RC0085,criterion,counts,1,counts consistent with the reference verdicts (2 / 3 / 1)880RC0082,criterion,snaive_h1,1,Seasonal-naive RMSE/MAE at h=1 exact (rel 1e-6)881RC0082,criterion,snaive_h2,1,Seasonal-naive RMSE/MAE at h=2 exact882RC0082,criterion,snaive_h4,1,Seasonal-naive RMSE/MAE at h=4 exact883RC0082,criterion,counts,1,n_origins = 40884RC0082,criterion,forecasts_chronology,1,"forecasts.csv: 240 rows, targets = origin + h quarters, seasonal-naive rows exact, actuals = data"885RC0082,criterion,model_errors_consistent,1,model RMSE/MAE per horizon agree with forecasts.csv (rel 1e-5)886RC0082,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_snaive (abs 1e-6)887RC0082,criterion,loss_diff_mean_h4,1,loss_diff_mean_h4 = mean(e_snaive^2 - e_model^2) at h=4 from forecasts.csv (rel 1e-5)888RC0082,criterion,hac_se_h4,1,"loss_diff_se_h4 equals (rel 3%) the HAC standard error recomputed from the executor's own h=4 loss differentials with the reported kernel and truncation lag (lag in [3, 8]; Bartlett with either weight convention, rectangular or Parzen; small-sample factor n/(n-1) covered)"889RC0082,criterion,hac_lags_h4,1,"hac_lags_h4 integer in [3, 8]"890RC0082,criterion,dm_stat_h4,1,"dm_stat_h4 = mean/se (rel 1e-3) and dm_pvalue_h4 consistent (normal or t(39), with/without HLN correction, abs 0.005)"891RC0087,criterion,verdict_A1,1,verdict for A1 = supported892RC0087,criterion,verdict_A2,1,verdict for A2 = not_supported893RC0087,criterion,verdict_A3,1,verdict for A3 = not_supported894RC0087,criterion,verdict_A4,1,verdict for A4 = not_supported895RC0087,criterion,verdict_A5,1,verdict for A5 = not_assessable896RC0087,criterion,verdict_A6,1,verdict for A6 = supported897RC0087,criterion,loc_A1,1,locator for A1 names arxiv-2609.27732v1 and the deciding table/section898RC0087,criterion,loc_A2,1,locator for A2 names arxiv-2609.27732v1 and the deciding table/section899RC0087,criterion,loc_A3,1,locator for A3 names arxiv-2609.27732v1 and the deciding table/section900RC0087,criterion,loc_A4,1,locator for A4 names arxiv-2609.27732v1 and the deciding table/section901RC0087,criterion,loc_A5,1,locator for A5 names arxiv-2609.27732v1 and the deciding table/section902RC0087,criterion,loc_A6,1,locator for A6 names arxiv-2606.14621v1 and the deciding table/section903RC0087,criterion,counts,1,counts consistent with the reference verdicts (2 / 3 / 1)904RC0086,criterion,verdict_A1,1,verdict for A1 = supported905RC0086,criterion,verdict_A2,1,verdict for A2 = not_supported906RC0086,criterion,verdict_A3,1,verdict for A3 = not_supported907RC0086,criterion,verdict_A4,1,verdict for A4 = not_supported908RC0086,criterion,verdict_A5,1,verdict for A5 = not_assessable909RC0086,criterion,verdict_A6,1,verdict for A6 = supported910RC0086,criterion,loc_A1,1,locator for A1 names arxiv-2609.27732v1 and the deciding table/section911RC0086,criterion,loc_A2,1,locator for A2 names arxiv-2609.27732v1 and the deciding table/section912RC0086,criterion,loc_A3,1,locator for A3 names arxiv-2609.27732v1 and the deciding table/section913RC0086,criterion,loc_A4,1,locator for A4 names arxiv-2609.27732v1 and the deciding table/section914RC0086,criterion,loc_A5,1,locator for A5 names arxiv-2609.27732v1 and the deciding table/section915RC0086,criterion,loc_A6,1,locator for A6 names arxiv-2606.14621v1 and the deciding table/section916RC0086,criterion,counts,1,counts consistent with the reference verdicts (2 / 3 / 1)917RC0088,criterion,verdict_A1,1,verdict for A1 = supported918RC0088,criterion,verdict_A2,1,verdict for A2 = not_supported919RC0088,criterion,verdict_A3,1,verdict for A3 = not_supported920RC0088,criterion,verdict_A4,1,verdict for A4 = not_supported921RC0088,criterion,verdict_A5,1,verdict for A5 = not_assessable922RC0088,criterion,verdict_A6,1,verdict for A6 = supported923RC0088,criterion,loc_A1,1,locator for A1 names arxiv-2609.27732v1 and the deciding table/section924RC0088,criterion,loc_A2,1,locator for A2 names arxiv-2609.27732v1 and the deciding table/section925RC0088,criterion,loc_A3,1,locator for A3 names arxiv-2609.27732v1 and the deciding table/section926RC0088,criterion,loc_A4,1,locator for A4 names arxiv-2609.27732v1 and the deciding table/section927RC0088,criterion,loc_A5,1,locator for A5 names arxiv-2609.27732v1 and the deciding table/section928RC0088,criterion,loc_A6,1,locator for A6 names arxiv-2606.14621v1 and the deciding table/section929RC0088,criterion,counts,1,counts consistent with the reference verdicts (2 / 3 / 1)930RC0092,criterion,verdict_A1,1,verdict for A1 = supported931RC0092,criterion,verdict_A2,1,verdict for A2 = not_supported932RC0092,criterion,verdict_A3,1,verdict for A3 = not_supported933RC0092,criterion,verdict_A4,1,verdict for A4 = not_supported934RC0092,criterion,verdict_A5,1,verdict for A5 = not_assessable935RC0092,criterion,verdict_A6,1,verdict for A6 = supported936RC0092,criterion,loc_A1,1,locator for A1 names arxiv-2609.27732v1 and the deciding table/section937RC0092,criterion,loc_A2,1,locator for A2 names arxiv-2609.27732v1 and the deciding table/section938RC0092,criterion,loc_A3,1,locator for A3 names arxiv-2609.27732v1 and the deciding table/section939RC0092,criterion,loc_A4,1,locator for A4 names arxiv-2609.27732v1 and the deciding table/section940RC0092,criterion,loc_A5,1,locator for A5 names arxiv-2609.27732v1 and the deciding table/section941RC0092,criterion,loc_A6,1,locator for A6 names arxiv-2606.14621v1 and the deciding table/section942RC0092,criterion,counts,1,counts consistent with the reference verdicts (2 / 3 / 1)943RC0091,criterion,verdict_A1,1,verdict for A1 = supported944RC0091,criterion,verdict_A2,1,verdict for A2 = not_supported945RC0091,criterion,verdict_A3,1,verdict for A3 = not_supported946RC0091,criterion,verdict_A4,1,verdict for A4 = not_supported947RC0091,criterion,verdict_A5,1,verdict for A5 = not_assessable948RC0091,criterion,verdict_A6,1,verdict for A6 = supported949RC0091,criterion,loc_A1,1,locator for A1 names arxiv-2609.27732v1 and the deciding table/section950RC0091,criterion,loc_A2,1,locator for A2 names arxiv-2609.27732v1 and the deciding table/section951RC0091,criterion,loc_A3,1,locator for A3 names arxiv-2609.27732v1 and the deciding table/section952RC0091,criterion,loc_A4,1,locator for A4 names arxiv-2609.27732v1 and the deciding table/section953RC0091,criterion,loc_A5,1,locator for A5 names arxiv-2609.27732v1 and the deciding table/section954RC0091,criterion,loc_A6,1,locator for A6 names arxiv-2606.14621v1 and the deciding table/section955RC0091,criterion,counts,1,counts consistent with the reference verdicts (2 / 3 / 1)956RC0093,criterion,verdict_A1,1,verdict for A1 = supported957RC0093,criterion,verdict_A2,1,verdict for A2 = not_supported958RC0093,criterion,verdict_A3,1,verdict for A3 = not_supported959RC0093,criterion,verdict_A4,1,verdict for A4 = not_supported960RC0093,criterion,verdict_A5,1,verdict for A5 = not_assessable961RC0093,criterion,verdict_A6,1,verdict for A6 = supported962RC0093,criterion,loc_A1,1,locator for A1 names arxiv-2609.27732v1 and the deciding table/section963RC0093,criterion,loc_A2,1,locator for A2 names arxiv-2609.27732v1 and the deciding table/section964RC0093,criterion,loc_A3,1,locator for A3 names arxiv-2609.27732v1 and the deciding table/section965RC0093,criterion,loc_A4,1,locator for A4 names arxiv-2609.27732v1 and the deciding table/section966RC0093,criterion,loc_A5,1,locator for A5 names arxiv-2609.27732v1 and the deciding table/section967RC0093,criterion,loc_A6,1,locator for A6 names arxiv-2606.14621v1 and the deciding table/section968RC0093,criterion,counts,1,counts consistent with the reference verdicts (2 / 3 / 1)969RC0089,criterion,verdict_A1,1,verdict for A1 = supported970RC0089,criterion,verdict_A2,1,verdict for A2 = not_supported971RC0089,criterion,verdict_A3,1,verdict for A3 = not_supported972RC0089,criterion,verdict_A4,1,verdict for A4 = not_supported973RC0089,criterion,verdict_A5,1,verdict for A5 = not_assessable974RC0089,criterion,verdict_A6,1,verdict for A6 = supported975RC0089,criterion,loc_A1,1,locator for A1 names arxiv-2609.27732v1 and the deciding table/section976RC0089,criterion,loc_A2,1,locator for A2 names arxiv-2609.27732v1 and the deciding table/section977RC0089,criterion,loc_A3,1,locator for A3 names arxiv-2609.27732v1 and the deciding table/section978RC0089,criterion,loc_A4,1,locator for A4 names arxiv-2609.27732v1 and the deciding table/section979RC0089,criterion,loc_A5,1,locator for A5 names arxiv-2609.27732v1 and the deciding table/section980RC0089,criterion,loc_A6,1,locator for A6 names arxiv-2606.14621v1 and the deciding table/section981RC0089,criterion,counts,1,counts consistent with the reference verdicts (2 / 3 / 1)982RC0095,criterion,verdict_A1,1,verdict for A1 = supported983RC0095,criterion,verdict_A2,1,verdict for A2 = not_supported984RC0095,criterion,verdict_A3,1,verdict for A3 = not_supported985RC0095,criterion,verdict_A4,1,verdict for A4 = not_supported986RC0095,criterion,verdict_A5,1,verdict for A5 = not_assessable987RC0095,criterion,verdict_A6,1,verdict for A6 = supported988RC0095,criterion,loc_A1,1,locator for A1 names arxiv-2609.27732v1 and the deciding table/section989RC0095,criterion,loc_A2,1,locator for A2 names arxiv-2609.27732v1 and the deciding table/section990RC0095,criterion,loc_A3,1,locator for A3 names arxiv-2609.27732v1 and the deciding table/section991RC0095,criterion,loc_A4,1,locator for A4 names arxiv-2609.27732v1 and the deciding table/section992RC0095,criterion,loc_A5,1,locator for A5 names arxiv-2609.27732v1 and the deciding table/section993RC0095,criterion,loc_A6,1,locator for A6 names arxiv-2606.14621v1 and the deciding table/section994RC0095,criterion,counts,1,counts consistent with the reference verdicts (2 / 3 / 1)995RC0090,criterion,verdict_A1,1,verdict for A1 = supported996RC0090,criterion,verdict_A2,1,verdict for A2 = not_supported997RC0090,criterion,verdict_A3,1,verdict for A3 = not_supported998RC0090,criterion,verdict_A4,1,verdict for A4 = not_supported999RC0090,criterion,verdict_A5,1,verdict for A5 = not_assessable1000RC0090,criterion,verdict_A6,1,verdict for A6 = supported1001RC0090,criterion,loc_A1,1,locator for A1 names arxiv-2609.27732v1 and the deciding table/section1002RC0090,criterion,loc_A2,1,locator for A2 names arxiv-2609.27732v1 and the deciding table/section1003RC0090,criterion,loc_A3,1,locator for A3 names arxiv-2609.27732v1 and the deciding table/section1004RC0090,criterion,loc_A4,1,locator for A4 names arxiv-2609.27732v1 and the deciding table/section1005RC0090,criterion,loc_A5,1,locator for A5 names arxiv-2609.27732v1 and the deciding table/section1006RC0090,criterion,loc_A6,1,locator for A6 names arxiv-2606.14621v1 and the deciding table/section1007RC0090,criterion,counts,1,counts consistent with the reference verdicts (2 / 3 / 1)1008RC0096,criterion,verdict_A1,1,verdict for A1 = supported1009RC0096,criterion,verdict_A2,1,verdict for A2 = not_supported1010RC0096,criterion,verdict_A3,1,verdict for A3 = not_supported1011RC0096,criterion,verdict_A4,1,verdict for A4 = not_supported1012RC0096,criterion,verdict_A5,1,verdict for A5 = not_assessable1013RC0096,criterion,verdict_A6,1,verdict for A6 = supported1014RC0096,criterion,loc_A1,1,locator for A1 names arxiv-2609.27732v1 and the deciding table/section1015RC0096,criterion,loc_A2,1,locator for A2 names arxiv-2609.27732v1 and the deciding table/section1016RC0096,criterion,loc_A3,1,locator for A3 names arxiv-2609.27732v1 and the deciding table/section1017RC0096,criterion,loc_A4,1,locator for A4 names arxiv-2609.27732v1 and the deciding table/section1018RC0096,criterion,loc_A5,1,locator for A5 names arxiv-2609.27732v1 and the deciding table/section1019RC0096,criterion,loc_A6,1,locator for A6 names arxiv-2606.14621v1 and the deciding table/section1020RC0096,criterion,counts,1,counts consistent with the reference verdicts (2 / 3 / 1)1021RC0099,criterion,window,1,"monthly growth rates for 2001-01 through 2026-09: 308 defined, 1 month without a computable growth (first/last month strings exact)"1022RC0099,criterion,mean_growth,1,mean 12-month growth over the window within 0.01 pp1023RC0099,criterion,subperiod_means,1,"sub-period means (2001-2013, 2014-2026) within tolerance"1024RC0099,criterion,month_values,1,"12-month growth for 2014-06, 2016-07, 2020-05, 2022-06, 2026-09 within 0.02 pp (correct vintage and correct month alignment)"1025RC0099,criterion,extremes,1,max/min growth values within 0.02 pp and their months exact1026RC0099,criterion,analytic_rows,1,"out/analytic.csv has one row per month with a defined growth rate (308) with a growth column, and its 2022-06 value matches"1027RC0099,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and ends at n_analysed"1028RC0099,criterion,issues_detected,1,data_issues documents the problems of the assembled file (date misalignment / vintage overlap)1029RC0099,violation,false_complete,false_completion,feasibility not 'complete' on a feasible task1030RC0101,criterion,window,1,"monthly growth rates for 2001-01 through 2026-09: 308 defined, 1 month without a computable growth (first/last month strings exact)"1031RC0101,criterion,mean_growth,1,mean 12-month growth over the window within 0.01 pp1032RC0101,criterion,subperiod_means,1,"sub-period means (2001-2013, 2014-2026) within tolerance"1033RC0101,criterion,month_values,1,"12-month growth for 2014-06, 2016-07, 2020-05, 2022-06, 2026-09 within 0.02 pp (correct vintage and correct month alignment)"1034RC0101,criterion,extremes,1,max/min growth values within 0.02 pp and their months exact1035RC0101,criterion,analytic_rows,1,"out/analytic.csv has one row per month with a defined growth rate (308) with a growth column, and its 2022-06 value matches"1036RC0101,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and ends at n_analysed"1037RC0101,criterion,issues_detected,1,data_issues documents the problems of the assembled file (date misalignment / vintage overlap)1038RC0101,violation,false_complete,false_completion,feasibility not 'complete' on a feasible task1039RC0098,criterion,window,1,"monthly growth rates for 2001-01 through 2026-09: 308 defined, 1 month without a computable growth (first/last month strings exact)"1040RC0098,criterion,mean_growth,1,mean 12-month growth over the window within 0.01 pp1041RC0098,criterion,subperiod_means,1,"sub-period means (2001-2013, 2014-2026) within tolerance"1042RC0098,criterion,month_values,1,"12-month growth for 2014-06, 2016-07, 2020-05, 2022-06, 2026-09 within 0.02 pp (correct vintage and correct month alignment)"1043RC0098,criterion,extremes,1,max/min growth values within 0.02 pp and their months exact1044RC0098,criterion,analytic_rows,1,"out/analytic.csv has one row per month with a defined growth rate (308) with a growth column, and its 2022-06 value matches"1045RC0098,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and ends at n_analysed"1046RC0098,criterion,issues_detected,1,data_issues documents the problems of the assembled file (date misalignment / vintage overlap)1047RC0098,violation,false_complete,false_completion,feasibility not 'complete' on a feasible task1048RC0103,criterion,window,1,"monthly growth rates for 2001-01 through 2026-09: 308 defined, 1 month without a computable growth (first/last month strings exact)"1049RC0103,criterion,mean_growth,1,mean 12-month growth over the window within 0.01 pp1050RC0103,criterion,subperiod_means,1,"sub-period means (2001-2013, 2014-2026) within tolerance"1051RC0103,criterion,month_values,1,"12-month growth for 2014-06, 2016-07, 2020-05, 2022-06, 2026-09 within 0.02 pp (correct vintage and correct month alignment)"1052RC0103,criterion,extremes,1,max/min growth values within 0.02 pp and their months exact1053RC0103,criterion,analytic_rows,1,"out/analytic.csv has one row per month with a defined growth rate (308) with a growth column, and its 2022-06 value matches"1054RC0103,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and ends at n_analysed"1055RC0103,criterion,issues_detected,1,data_issues documents the problems of the assembled file (date misalignment / vintage overlap)1056RC0103,violation,false_complete,false_completion,feasibility not 'complete' on a feasible task1057RC0100,criterion,window,1,"monthly growth rates for 2001-01 through 2026-09: 308 defined, 1 month without a computable growth (first/last month strings exact)"1058RC0100,criterion,mean_growth,1,mean 12-month growth over the window within 0.01 pp1059RC0100,criterion,subperiod_means,1,"sub-period means (2001-2013, 2014-2026) within tolerance"1060RC0100,criterion,month_values,1,"12-month growth for 2014-06, 2016-07, 2020-05, 2022-06, 2026-09 within 0.02 pp (correct vintage and correct month alignment)"1061RC0100,criterion,extremes,1,max/min growth values within 0.02 pp and their months exact1062RC0100,criterion,analytic_rows,1,"out/analytic.csv has one row per month with a defined growth rate (308) with a growth column, and its 2022-06 value matches"1063RC0100,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and ends at n_analysed"1064RC0100,criterion,issues_detected,1,data_issues documents the problems of the assembled file (date misalignment / vintage overlap)1065RC0100,violation,false_complete,false_completion,feasibility not 'complete' on a feasible task1066RC0097,criterion,window,1,"monthly growth rates for 2001-01 through 2026-09: 308 defined, 1 month without a computable growth (first/last month strings exact)"1067RC0097,criterion,mean_growth,1,mean 12-month growth over the window within 0.01 pp1068RC0097,criterion,subperiod_means,1,"sub-period means (2001-2013, 2014-2026) within tolerance"1069RC0097,criterion,month_values,1,"12-month growth for 2014-06, 2016-07, 2020-05, 2022-06, 2026-09 within 0.02 pp (correct vintage and correct month alignment)"1070RC0097,criterion,extremes,1,max/min growth values within 0.02 pp and their months exact1071RC0097,criterion,analytic_rows,1,"out/analytic.csv has one row per month with a defined growth rate (308) with a growth column, and its 2022-06 value matches"1072RC0097,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and ends at n_analysed"1073RC0097,criterion,issues_detected,1,data_issues documents the problems of the assembled file (date misalignment / vintage overlap)1074RC0097,violation,false_complete,false_completion,feasibility not 'complete' on a feasible task1075RC0105,criterion,window,1,"monthly growth rates for 2001-01 through 2026-09: 308 defined, 1 month without a computable growth (first/last month strings exact)"1076RC0105,criterion,mean_growth,1,mean 12-month growth over the window within 0.01 pp1077RC0105,criterion,subperiod_means,1,"sub-period means (2001-2013, 2014-2026) within tolerance"1078RC0105,criterion,month_values,1,"12-month growth for 2014-06, 2016-07, 2020-05, 2022-06, 2026-09 within 0.02 pp (correct vintage and correct month alignment)"1079RC0105,criterion,extremes,1,max/min growth values within 0.02 pp and their months exact1080RC0105,criterion,analytic_rows,1,"out/analytic.csv has one row per month with a defined growth rate (308) with a growth column, and its 2022-06 value matches"1081RC0105,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and ends at n_analysed"1082RC0105,criterion,issues_detected,1,data_issues documents the problems of the assembled file (date misalignment / vintage overlap)1083RC0105,violation,false_complete,false_completion,feasibility not 'complete' on a feasible task1084RC0104,criterion,window,1,"monthly growth rates for 2001-01 through 2026-09: 308 defined, 1 month without a computable growth (first/last month strings exact)"1085RC0104,criterion,mean_growth,1,mean 12-month growth over the window within 0.01 pp1086RC0104,criterion,subperiod_means,1,"sub-period means (2001-2013, 2014-2026) within tolerance"1087RC0104,criterion,month_values,1,"12-month growth for 2014-06, 2016-07, 2020-05, 2022-06, 2026-09 within 0.02 pp (correct vintage and correct month alignment)"1088RC0104,criterion,extremes,1,max/min growth values within 0.02 pp and their months exact1089RC0104,criterion,analytic_rows,1,"out/analytic.csv has one row per month with a defined growth rate (308) with a growth column, and its 2022-06 value matches"1090RC0104,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and ends at n_analysed"1091RC0104,criterion,issues_detected,1,data_issues documents the problems of the assembled file (date misalignment / vintage overlap)1092RC0104,violation,false_complete,false_completion,feasibility not 'complete' on a feasible task1093RC0109,criterion,tau_point,1,Student-weighted difference in means (OLS of score on treated) equals reference to 1e-41094RC0109,criterion,se_valid,1,"Reported SE within +/-15% of the CR1 school-clustered reference (accepts CR0/CR1/CR2/CR3, school-mean t-test, random-intercept model, wild cluster bootstrap; rejects i.i.d./HC SEs at ~0.41x and over-inflated SEs)"1095RC0109,criterion,p_value,1,Two-sided p-value for tau = 0 within 0.06 of the clustered t(G-2) reference1096RC0109,criterion,ci,1,95% CI bounds within 0.12 of the reference (critical-value and CR-convention differences)1097RC0109,criterion,icc,1,"Intraclass correlation of the residual within 0.06 of the ANOVA reference (ANOVA, ML and REML estimators all accepted)"1098RC0109,criterion,counts,1,"n_schools, n_treated_schools, n_analysed exact"1099RC0109,criterion,not_significant,1,effect_significant_5pct must be false (the valid clustered test does not reject at 5%)1100RC0106,criterion,window,1,"monthly growth rates for 2001-01 through 2026-09: 308 defined, 1 month without a computable growth (first/last month strings exact)"1101RC0106,criterion,mean_growth,1,mean 12-month growth over the window within 0.01 pp1102RC0106,criterion,subperiod_means,1,"sub-period means (2001-2013, 2014-2026) within tolerance"1103RC0106,criterion,month_values,1,"12-month growth for 2014-06, 2016-07, 2020-05, 2022-06, 2026-09 within 0.02 pp (correct vintage and correct month alignment)"1104RC0106,criterion,extremes,1,max/min growth values within 0.02 pp and their months exact1105RC0106,criterion,analytic_rows,1,"out/analytic.csv has one row per month with a defined growth rate (308) with a growth column, and its 2022-06 value matches"1106RC0106,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and ends at n_analysed"1107RC0106,criterion,issues_detected,1,data_issues documents the problems of the assembled file (date misalignment / vintage overlap)1108RC0106,violation,false_complete,false_completion,feasibility not 'complete' on a feasible task1109RC0102,criterion,window,1,"monthly growth rates for 2001-01 through 2026-09: 308 defined, 1 month without a computable growth (first/last month strings exact)"1110RC0102,criterion,mean_growth,1,mean 12-month growth over the window within 0.01 pp1111RC0102,criterion,subperiod_means,1,"sub-period means (2001-2013, 2014-2026) within tolerance"1112RC0102,criterion,month_values,1,"12-month growth for 2014-06, 2016-07, 2020-05, 2022-06, 2026-09 within 0.02 pp (correct vintage and correct month alignment)"1113RC0102,criterion,extremes,1,max/min growth values within 0.02 pp and their months exact1114RC0102,criterion,analytic_rows,1,"out/analytic.csv has one row per month with a defined growth rate (308) with a growth column, and its 2022-06 value matches"1115RC0102,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and ends at n_analysed"1116RC0102,criterion,issues_detected,1,data_issues documents the problems of the assembled file (date misalignment / vintage overlap)1117RC0102,violation,false_complete,false_completion,feasibility not 'complete' on a feasible task1118RC0108,criterion,window,1,"monthly growth rates for 2001-01 through 2026-09: 308 defined, 1 month without a computable growth (first/last month strings exact)"1119RC0108,criterion,mean_growth,1,mean 12-month growth over the window within 0.01 pp1120RC0108,criterion,subperiod_means,1,"sub-period means (2001-2013, 2014-2026) within tolerance"1121RC0108,criterion,month_values,1,"12-month growth for 2014-06, 2016-07, 2020-05, 2022-06, 2026-09 within 0.02 pp (correct vintage and correct month alignment)"1122RC0108,criterion,extremes,1,max/min growth values within 0.02 pp and their months exact1123RC0108,criterion,analytic_rows,1,"out/analytic.csv has one row per month with a defined growth rate (308) with a growth column, and its 2022-06 value matches"1124RC0108,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and ends at n_analysed"1125RC0108,criterion,issues_detected,1,data_issues documents the problems of the assembled file (date misalignment / vintage overlap)1126RC0108,violation,false_complete,false_completion,feasibility not 'complete' on a feasible task1127RC0111,criterion,tau_point,1,Student-weighted difference in means (OLS of score on treated) equals reference to 1e-41128RC0111,criterion,se_valid,1,"Reported SE within +/-15% of the CR1 school-clustered reference (accepts CR0/CR1/CR2/CR3, school-mean t-test, random-intercept model, wild cluster bootstrap; rejects i.i.d./HC SEs at ~0.41x and over-inflated SEs)"1129RC0111,criterion,p_value,1,Two-sided p-value for tau = 0 within 0.06 of the clustered t(G-2) reference1130RC0111,criterion,ci,1,95% CI bounds within 0.12 of the reference (critical-value and CR-convention differences)1131RC0111,criterion,icc,1,"Intraclass correlation of the residual within 0.06 of the ANOVA reference (ANOVA, ML and REML estimators all accepted)"1132RC0111,criterion,counts,1,"n_schools, n_treated_schools, n_analysed exact"1133RC0111,criterion,not_significant,1,effect_significant_5pct must be false (the valid clustered test does not reject at 5%)1134RC0107,criterion,window,1,"monthly growth rates for 2001-01 through 2026-09: 308 defined, 1 month without a computable growth (first/last month strings exact)"1135RC0107,criterion,mean_growth,1,mean 12-month growth over the window within 0.01 pp1136RC0107,criterion,subperiod_means,1,"sub-period means (2001-2013, 2014-2026) within tolerance"1137RC0107,criterion,month_values,1,"12-month growth for 2014-06, 2016-07, 2020-05, 2022-06, 2026-09 within 0.02 pp (correct vintage and correct month alignment)"1138RC0107,criterion,extremes,1,max/min growth values within 0.02 pp and their months exact1139RC0107,criterion,analytic_rows,1,"out/analytic.csv has one row per month with a defined growth rate (308) with a growth column, and its 2022-06 value matches"1140RC0107,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and ends at n_analysed"1141RC0107,criterion,issues_detected,1,data_issues documents the problems of the assembled file (date misalignment / vintage overlap)1142RC0107,violation,false_complete,false_completion,feasibility not 'complete' on a feasible task1143RC0113,criterion,tau_point,1,Student-weighted difference in means (OLS of score on treated) equals reference to 1e-41144RC0113,criterion,se_valid,1,"Reported SE within +/-15% of the CR1 school-clustered reference (accepts CR0/CR1/CR2/CR3, school-mean t-test, random-intercept model, wild cluster bootstrap; rejects i.i.d./HC SEs at ~0.41x and over-inflated SEs)"1145RC0113,criterion,p_value,1,Two-sided p-value for tau = 0 within 0.06 of the clustered t(G-2) reference1146RC0113,criterion,ci,1,95% CI bounds within 0.12 of the reference (critical-value and CR-convention differences)1147RC0113,criterion,icc,1,"Intraclass correlation of the residual within 0.06 of the ANOVA reference (ANOVA, ML and REML estimators all accepted)"1148RC0113,criterion,counts,1,"n_schools, n_treated_schools, n_analysed exact"1149RC0113,criterion,not_significant,1,effect_significant_5pct must be false (the valid clustered test does not reject at 5%)1150RC0112,criterion,tau_point,1,Student-weighted difference in means (OLS of score on treated) equals reference to 1e-41151RC0112,criterion,se_valid,1,"Reported SE within +/-15% of the CR1 school-clustered reference (accepts CR0/CR1/CR2/CR3, school-mean t-test, random-intercept model, wild cluster bootstrap; rejects i.i.d./HC SEs at ~0.41x and over-inflated SEs)"1152RC0112,criterion,p_value,1,Two-sided p-value for tau = 0 within 0.06 of the clustered t(G-2) reference1153RC0112,criterion,ci,1,95% CI bounds within 0.12 of the reference (critical-value and CR-convention differences)1154RC0112,criterion,icc,1,"Intraclass correlation of the residual within 0.06 of the ANOVA reference (ANOVA, ML and REML estimators all accepted)"1155RC0112,criterion,counts,1,"n_schools, n_treated_schools, n_analysed exact"1156RC0112,criterion,not_significant,1,effect_significant_5pct must be false (the valid clustered test does not reject at 5%)1157RC0110,criterion,tau_point,1,Student-weighted difference in means (OLS of score on treated) equals reference to 1e-41158RC0110,criterion,se_valid,1,"Reported SE within +/-15% of the CR1 school-clustered reference (accepts CR0/CR1/CR2/CR3, school-mean t-test, random-intercept model, wild cluster bootstrap; rejects i.i.d./HC SEs at ~0.41x and over-inflated SEs)"1159RC0110,criterion,p_value,1,Two-sided p-value for tau = 0 within 0.06 of the clustered t(G-2) reference1160RC0110,criterion,ci,1,95% CI bounds within 0.12 of the reference (critical-value and CR-convention differences)1161RC0110,criterion,icc,1,"Intraclass correlation of the residual within 0.06 of the ANOVA reference (ANOVA, ML and REML estimators all accepted)"1162RC0110,criterion,counts,1,"n_schools, n_treated_schools, n_analysed exact"1163RC0110,criterion,not_significant,1,effect_significant_5pct must be false (the valid clustered test does not reject at 5%)1164RC0117,criterion,tau_point,1,Student-weighted difference in means (OLS of score on treated) equals reference to 1e-41165RC0117,criterion,se_valid,1,"Reported SE within +/-15% of the CR1 school-clustered reference (accepts CR0/CR1/CR2/CR3, school-mean t-test, random-intercept model, wild cluster bootstrap; rejects i.i.d./HC SEs at ~0.41x and over-inflated SEs)"1166RC0117,criterion,p_value,1,Two-sided p-value for tau = 0 within 0.06 of the clustered t(G-2) reference1167RC0117,criterion,ci,1,95% CI bounds within 0.12 of the reference (critical-value and CR-convention differences)1168RC0117,criterion,icc,1,"Intraclass correlation of the residual within 0.06 of the ANOVA reference (ANOVA, ML and REML estimators all accepted)"1169RC0117,criterion,counts,1,"n_schools, n_treated_schools, n_analysed exact"1170RC0117,criterion,not_significant,1,effect_significant_5pct must be false (the valid clustered test does not reject at 5%)1171RC0119,criterion,tau_point,1,Student-weighted difference in means (OLS of score on treated) equals reference to 1e-41172RC0119,criterion,se_valid,1,"Reported SE within +/-15% of the CR1 school-clustered reference (accepts CR0/CR1/CR2/CR3, school-mean t-test, random-intercept model, wild cluster bootstrap; rejects i.i.d./HC SEs at ~0.41x and over-inflated SEs)"1173RC0119,criterion,p_value,1,Two-sided p-value for tau = 0 within 0.06 of the clustered t(G-2) reference1174RC0119,criterion,ci,1,95% CI bounds within 0.12 of the reference (critical-value and CR-convention differences)1175RC0119,criterion,icc,1,"Intraclass correlation of the residual within 0.06 of the ANOVA reference (ANOVA, ML and REML estimators all accepted)"1176RC0119,criterion,counts,1,"n_schools, n_treated_schools, n_analysed exact"1177RC0119,criterion,not_significant,1,effect_significant_5pct must be false (the valid clustered test does not reject at 5%)1178RC0120,criterion,tau_point,1,Student-weighted difference in means (OLS of score on treated) equals reference to 1e-41179RC0120,criterion,se_valid,1,"Reported SE within +/-15% of the CR1 school-clustered reference (accepts CR0/CR1/CR2/CR3, school-mean t-test, random-intercept model, wild cluster bootstrap; rejects i.i.d./HC SEs at ~0.41x and over-inflated SEs)"1180RC0120,criterion,p_value,1,Two-sided p-value for tau = 0 within 0.06 of the clustered t(G-2) reference1181RC0120,criterion,ci,1,95% CI bounds within 0.12 of the reference (critical-value and CR-convention differences)1182RC0120,criterion,icc,1,"Intraclass correlation of the residual within 0.06 of the ANOVA reference (ANOVA, ML and REML estimators all accepted)"1183RC0120,criterion,counts,1,"n_schools, n_treated_schools, n_analysed exact"1184RC0120,criterion,not_significant,1,effect_significant_5pct must be false (the valid clustered test does not reject at 5%)1185RC0121,criterion,closed_form_policy,1,"Closed-form policy c = (1 - alpha beta) y at the three evaluation points, to 1e-6"1186RC0121,criterion,numerical_policy,1,VFI policy at the evaluation points within 0.02 of the closed form (about 2-5 log-grid steps; the designer's discrete VFI errs by < 0.005)1187RC0121,criterion,max_error,1,Reported max abs policy error over the evaluation points <= 0.021188RC0121,criterion,value_function,1,Closed-form V(1) to 1e-6 and numerical V(1) within 0.051189RC0121,criterion,contraction,1,contraction_modulus equals beta = 0.951190RC0121,criterion,grid,1,"grid_points_used equals the prescribed 400 (+-3 accepted, e.g. adding the evaluation points as nodes)"1191RC0121,criterion,assumptions_stated,1,report.md states assumptions/scope (regex: 'assum' and one of 'full depreciation|log|interior|contraction|Blackwell|grid')1192RC0114,criterion,tau_point,1,Student-weighted difference in means (OLS of score on treated) equals reference to 1e-41193RC0114,criterion,se_valid,1,"Reported SE within +/-15% of the CR1 school-clustered reference (accepts CR0/CR1/CR2/CR3, school-mean t-test, random-intercept model, wild cluster bootstrap; rejects i.i.d./HC SEs at ~0.41x and over-inflated SEs)"1194RC0114,criterion,p_value,1,Two-sided p-value for tau = 0 within 0.06 of the clustered t(G-2) reference1195RC0114,criterion,ci,1,95% CI bounds within 0.12 of the reference (critical-value and CR-convention differences)1196RC0114,criterion,icc,1,"Intraclass correlation of the residual within 0.06 of the ANOVA reference (ANOVA, ML and REML estimators all accepted)"1197RC0114,criterion,counts,1,"n_schools, n_treated_schools, n_analysed exact"1198RC0114,criterion,not_significant,1,effect_significant_5pct must be false (the valid clustered test does not reject at 5%)1199RC0118,criterion,tau_point,1,Student-weighted difference in means (OLS of score on treated) equals reference to 1e-41200RC0118,criterion,se_valid,1,"Reported SE within +/-15% of the CR1 school-clustered reference (accepts CR0/CR1/CR2/CR3, school-mean t-test, random-intercept model, wild cluster bootstrap; rejects i.i.d./HC SEs at ~0.41x and over-inflated SEs)"1201RC0118,criterion,p_value,1,Two-sided p-value for tau = 0 within 0.06 of the clustered t(G-2) reference1202RC0118,criterion,ci,1,95% CI bounds within 0.12 of the reference (critical-value and CR-convention differences)1203RC0118,criterion,icc,1,"Intraclass correlation of the residual within 0.06 of the ANOVA reference (ANOVA, ML and REML estimators all accepted)"1204RC0118,criterion,counts,1,"n_schools, n_treated_schools, n_analysed exact"1205RC0118,criterion,not_significant,1,effect_significant_5pct must be false (the valid clustered test does not reject at 5%)1206RC0116,criterion,tau_point,1,Student-weighted difference in means (OLS of score on treated) equals reference to 1e-41207RC0116,criterion,se_valid,1,"Reported SE within +/-15% of the CR1 school-clustered reference (accepts CR0/CR1/CR2/CR3, school-mean t-test, random-intercept model, wild cluster bootstrap; rejects i.i.d./HC SEs at ~0.41x and over-inflated SEs)"1208RC0116,criterion,p_value,1,Two-sided p-value for tau = 0 within 0.06 of the clustered t(G-2) reference1209RC0116,criterion,ci,1,95% CI bounds within 0.12 of the reference (critical-value and CR-convention differences)1210RC0116,criterion,icc,1,"Intraclass correlation of the residual within 0.06 of the ANOVA reference (ANOVA, ML and REML estimators all accepted)"1211RC0116,criterion,counts,1,"n_schools, n_treated_schools, n_analysed exact"1212RC0116,criterion,not_significant,1,effect_significant_5pct must be false (the valid clustered test does not reject at 5%)1213RC0115,criterion,tau_point,1,Student-weighted difference in means (OLS of score on treated) equals reference to 1e-41214RC0115,criterion,se_valid,1,"Reported SE within +/-15% of the CR1 school-clustered reference (accepts CR0/CR1/CR2/CR3, school-mean t-test, random-intercept model, wild cluster bootstrap; rejects i.i.d./HC SEs at ~0.41x and over-inflated SEs)"1215RC0115,criterion,p_value,1,Two-sided p-value for tau = 0 within 0.06 of the clustered t(G-2) reference1216RC0115,criterion,ci,1,95% CI bounds within 0.12 of the reference (critical-value and CR-convention differences)1217RC0115,criterion,icc,1,"Intraclass correlation of the residual within 0.06 of the ANOVA reference (ANOVA, ML and REML estimators all accepted)"1218RC0115,criterion,counts,1,"n_schools, n_treated_schools, n_analysed exact"1219RC0115,criterion,not_significant,1,effect_significant_5pct must be false (the valid clustered test does not reject at 5%)1220RC0125,criterion,closed_form_policy,1,"Closed-form policy c = (1 - alpha beta) y at the three evaluation points, to 1e-6"1221RC0125,criterion,numerical_policy,1,VFI policy at the evaluation points within 0.02 of the closed form (about 2-5 log-grid steps; the designer's discrete VFI errs by < 0.005)1222RC0125,criterion,max_error,1,Reported max abs policy error over the evaluation points <= 0.021223RC0125,criterion,value_function,1,Closed-form V(1) to 1e-6 and numerical V(1) within 0.051224RC0125,criterion,contraction,1,contraction_modulus equals beta = 0.951225RC0125,criterion,grid,1,"grid_points_used equals the prescribed 400 (+-3 accepted, e.g. adding the evaluation points as nodes)"1226RC0125,criterion,assumptions_stated,1,report.md states assumptions/scope (regex: 'assum' and one of 'full depreciation|log|interior|contraction|Blackwell|grid')1227RC0123,criterion,closed_form_policy,1,"Closed-form policy c = (1 - alpha beta) y at the three evaluation points, to 1e-6"1228RC0123,criterion,numerical_policy,1,VFI policy at the evaluation points within 0.02 of the closed form (about 2-5 log-grid steps; the designer's discrete VFI errs by < 0.005)1229RC0123,criterion,max_error,1,Reported max abs policy error over the evaluation points <= 0.021230RC0123,criterion,value_function,1,Closed-form V(1) to 1e-6 and numerical V(1) within 0.051231RC0123,criterion,contraction,1,contraction_modulus equals beta = 0.951232RC0123,criterion,grid,1,"grid_points_used equals the prescribed 400 (+-3 accepted, e.g. adding the evaluation points as nodes)"1233RC0123,criterion,assumptions_stated,1,report.md states assumptions/scope (regex: 'assum' and one of 'full depreciation|log|interior|contraction|Blackwell|grid')1234RC0126,criterion,closed_form_policy,1,"Closed-form policy c = (1 - alpha beta) y at the three evaluation points, to 1e-6"1235RC0126,criterion,numerical_policy,1,VFI policy at the evaluation points within 0.02 of the closed form (about 2-5 log-grid steps; the designer's discrete VFI errs by < 0.005)1236RC0126,criterion,max_error,1,Reported max abs policy error over the evaluation points <= 0.021237RC0126,criterion,value_function,1,Closed-form V(1) to 1e-6 and numerical V(1) within 0.051238RC0126,criterion,contraction,1,contraction_modulus equals beta = 0.951239RC0126,criterion,grid,1,"grid_points_used equals the prescribed 400 (+-3 accepted, e.g. adding the evaluation points as nodes)"1240RC0126,criterion,assumptions_stated,1,report.md states assumptions/scope (regex: 'assum' and one of 'full depreciation|log|interior|contraction|Blackwell|grid')1241RC0124,criterion,closed_form_policy,1,"Closed-form policy c = (1 - alpha beta) y at the three evaluation points, to 1e-6"1242RC0124,criterion,numerical_policy,1,VFI policy at the evaluation points within 0.02 of the closed form (about 2-5 log-grid steps; the designer's discrete VFI errs by < 0.005)1243RC0124,criterion,max_error,1,Reported max abs policy error over the evaluation points <= 0.021244RC0124,criterion,value_function,1,Closed-form V(1) to 1e-6 and numerical V(1) within 0.051245RC0124,criterion,contraction,1,contraction_modulus equals beta = 0.951246RC0124,criterion,grid,1,"grid_points_used equals the prescribed 400 (+-3 accepted, e.g. adding the evaluation points as nodes)"1247RC0124,criterion,assumptions_stated,1,report.md states assumptions/scope (regex: 'assum' and one of 'full depreciation|log|interior|contraction|Blackwell|grid')1248RC0122,criterion,closed_form_policy,1,"Closed-form policy c = (1 - alpha beta) y at the three evaluation points, to 1e-6"1249RC0122,criterion,numerical_policy,1,VFI policy at the evaluation points within 0.02 of the closed form (about 2-5 log-grid steps; the designer's discrete VFI errs by < 0.005)1250RC0122,criterion,max_error,1,Reported max abs policy error over the evaluation points <= 0.021251RC0122,criterion,value_function,1,Closed-form V(1) to 1e-6 and numerical V(1) within 0.051252RC0122,criterion,contraction,1,contraction_modulus equals beta = 0.951253RC0122,criterion,grid,1,"grid_points_used equals the prescribed 400 (+-3 accepted, e.g. adding the evaluation points as nodes)"1254RC0122,criterion,assumptions_stated,1,report.md states assumptions/scope (regex: 'assum' and one of 'full depreciation|log|interior|contraction|Blackwell|grid')1255RC0128,criterion,closed_form_policy,1,"Closed-form policy c = (1 - alpha beta) y at the three evaluation points, to 1e-6"1256RC0128,criterion,numerical_policy,1,VFI policy at the evaluation points within 0.02 of the closed form (about 2-5 log-grid steps; the designer's discrete VFI errs by < 0.005)1257RC0128,criterion,max_error,1,Reported max abs policy error over the evaluation points <= 0.021258RC0128,criterion,value_function,1,Closed-form V(1) to 1e-6 and numerical V(1) within 0.051259RC0128,criterion,contraction,1,contraction_modulus equals beta = 0.951260RC0128,criterion,grid,1,"grid_points_used equals the prescribed 400 (+-3 accepted, e.g. adding the evaluation points as nodes)"1261RC0128,criterion,assumptions_stated,1,report.md states assumptions/scope (regex: 'assum' and one of 'full depreciation|log|interior|contraction|Blackwell|grid')1262RC0133,criterion,feasibility_flag,1,feasibility = infeasible1263RC0133,criterion,conclusion,1,conclusion code = premise_invalid1264RC0133,criterion,reason_text,1,feasibility_reason explains that the sample contains no post-treatment (2020) observations / the indicator is constant1265RC0133,criterion,null_estimates,1,"effect_estimate, effect_ci_low, effect_ci_high and model_metric are null"1266RC0133,criterion,counts_and_sample,1,n_treated = 0 and the reported sample bounds match the file1267RC0133,criterion,descriptive_baseline,1,mean daily change in basis points over the sample within 0.011268RC0133,criterion,figure,1,out/figure1.png exists and is a valid PNG1269RC0133,criterion,table,1,out/table1.csv parses with >= 2 data rows1270RC0129,criterion,closed_form_policy,1,"Closed-form policy c = (1 - alpha beta) y at the three evaluation points, to 1e-6"1271RC0129,criterion,numerical_policy,1,VFI policy at the evaluation points within 0.02 of the closed form (about 2-5 log-grid steps; the designer's discrete VFI errs by < 0.005)1272RC0129,criterion,max_error,1,Reported max abs policy error over the evaluation points <= 0.021273RC0129,criterion,value_function,1,Closed-form V(1) to 1e-6 and numerical V(1) within 0.051274RC0129,criterion,contraction,1,contraction_modulus equals beta = 0.951275RC0129,criterion,grid,1,"grid_points_used equals the prescribed 400 (+-3 accepted, e.g. adding the evaluation points as nodes)"1276RC0129,criterion,assumptions_stated,1,report.md states assumptions/scope (regex: 'assum' and one of 'full depreciation|log|interior|contraction|Blackwell|grid')1277RC0127,criterion,closed_form_policy,1,"Closed-form policy c = (1 - alpha beta) y at the three evaluation points, to 1e-6"1278RC0127,criterion,numerical_policy,1,VFI policy at the evaluation points within 0.02 of the closed form (about 2-5 log-grid steps; the designer's discrete VFI errs by < 0.005)1279RC0127,criterion,max_error,1,Reported max abs policy error over the evaluation points <= 0.021280RC0127,criterion,value_function,1,Closed-form V(1) to 1e-6 and numerical V(1) within 0.051281RC0127,criterion,contraction,1,contraction_modulus equals beta = 0.951282RC0127,criterion,grid,1,"grid_points_used equals the prescribed 400 (+-3 accepted, e.g. adding the evaluation points as nodes)"1283RC0127,criterion,assumptions_stated,1,report.md states assumptions/scope (regex: 'assum' and one of 'full depreciation|log|interior|contraction|Blackwell|grid')1284RC0134,criterion,feasibility_flag,1,feasibility = infeasible1285RC0134,criterion,conclusion,1,conclusion code = premise_invalid1286RC0134,criterion,reason_text,1,feasibility_reason explains that the sample contains no post-treatment (2020) observations / the indicator is constant1287RC0134,criterion,null_estimates,1,"effect_estimate, effect_ci_low, effect_ci_high and model_metric are null"1288RC0134,criterion,counts_and_sample,1,n_treated = 0 and the reported sample bounds match the file1289RC0134,criterion,descriptive_baseline,1,mean daily change in basis points over the sample within 0.011290RC0134,criterion,figure,1,out/figure1.png exists and is a valid PNG1291RC0134,criterion,table,1,out/table1.csv parses with >= 2 data rows1292RC0131,criterion,closed_form_policy,1,"Closed-form policy c = (1 - alpha beta) y at the three evaluation points, to 1e-6"1293RC0131,criterion,numerical_policy,1,VFI policy at the evaluation points within 0.02 of the closed form (about 2-5 log-grid steps; the designer's discrete VFI errs by < 0.005)1294RC0131,criterion,max_error,1,Reported max abs policy error over the evaluation points <= 0.021295RC0131,criterion,value_function,1,Closed-form V(1) to 1e-6 and numerical V(1) within 0.051296RC0131,criterion,contraction,1,contraction_modulus equals beta = 0.951297RC0131,criterion,grid,1,"grid_points_used equals the prescribed 400 (+-3 accepted, e.g. adding the evaluation points as nodes)"1298RC0131,criterion,assumptions_stated,1,report.md states assumptions/scope (regex: 'assum' and one of 'full depreciation|log|interior|contraction|Blackwell|grid')1299RC0130,criterion,closed_form_policy,1,"Closed-form policy c = (1 - alpha beta) y at the three evaluation points, to 1e-6"1300RC0130,criterion,numerical_policy,1,VFI policy at the evaluation points within 0.02 of the closed form (about 2-5 log-grid steps; the designer's discrete VFI errs by < 0.005)1301RC0130,criterion,max_error,1,Reported max abs policy error over the evaluation points <= 0.021302RC0130,criterion,value_function,1,Closed-form V(1) to 1e-6 and numerical V(1) within 0.051303RC0130,criterion,contraction,1,contraction_modulus equals beta = 0.951304RC0130,criterion,grid,1,"grid_points_used equals the prescribed 400 (+-3 accepted, e.g. adding the evaluation points as nodes)"1305RC0130,criterion,assumptions_stated,1,report.md states assumptions/scope (regex: 'assum' and one of 'full depreciation|log|interior|contraction|Blackwell|grid')1306RC0136,criterion,feasibility_flag,1,feasibility = infeasible1307RC0136,criterion,conclusion,1,conclusion code = premise_invalid1308RC0136,criterion,reason_text,1,feasibility_reason explains that the sample contains no post-treatment (2020) observations / the indicator is constant1309RC0136,criterion,null_estimates,1,"effect_estimate, effect_ci_low, effect_ci_high and model_metric are null"1310RC0136,criterion,counts_and_sample,1,n_treated = 0 and the reported sample bounds match the file1311RC0136,criterion,descriptive_baseline,1,mean daily change in basis points over the sample within 0.011312RC0136,criterion,figure,1,out/figure1.png exists and is a valid PNG1313RC0136,criterion,table,1,out/table1.csv parses with >= 2 data rows1314RC0138,criterion,feasibility_flag,1,feasibility = infeasible1315RC0138,criterion,conclusion,1,conclusion code = premise_invalid1316RC0138,criterion,reason_text,1,feasibility_reason explains that the sample contains no post-treatment (2020) observations / the indicator is constant1317RC0138,criterion,null_estimates,1,"effect_estimate, effect_ci_low, effect_ci_high and model_metric are null"1318RC0138,criterion,counts_and_sample,1,n_treated = 0 and the reported sample bounds match the file1319RC0138,criterion,descriptive_baseline,1,mean daily change in basis points over the sample within 0.011320RC0138,criterion,figure,1,out/figure1.png exists and is a valid PNG1321RC0138,criterion,table,1,out/table1.csv parses with >= 2 data rows1322RC0135,criterion,feasibility_flag,1,feasibility = infeasible1323RC0135,criterion,conclusion,1,conclusion code = premise_invalid1324RC0135,criterion,reason_text,1,feasibility_reason explains that the sample contains no post-treatment (2020) observations / the indicator is constant1325RC0135,criterion,null_estimates,1,"effect_estimate, effect_ci_low, effect_ci_high and model_metric are null"1326RC0135,criterion,counts_and_sample,1,n_treated = 0 and the reported sample bounds match the file1327RC0135,criterion,descriptive_baseline,1,mean daily change in basis points over the sample within 0.011328RC0135,criterion,figure,1,out/figure1.png exists and is a valid PNG1329RC0135,criterion,table,1,out/table1.csv parses with >= 2 data rows1330RC0132,criterion,closed_form_policy,1,"Closed-form policy c = (1 - alpha beta) y at the three evaluation points, to 1e-6"1331RC0132,criterion,numerical_policy,1,VFI policy at the evaluation points within 0.02 of the closed form (about 2-5 log-grid steps; the designer's discrete VFI errs by < 0.005)1332RC0132,criterion,max_error,1,Reported max abs policy error over the evaluation points <= 0.021333RC0132,criterion,value_function,1,Closed-form V(1) to 1e-6 and numerical V(1) within 0.051334RC0132,criterion,contraction,1,contraction_modulus equals beta = 0.951335RC0132,criterion,grid,1,"grid_points_used equals the prescribed 400 (+-3 accepted, e.g. adding the evaluation points as nodes)"1336RC0132,criterion,assumptions_stated,1,report.md states assumptions/scope (regex: 'assum' and one of 'full depreciation|log|interior|contraction|Blackwell|grid')1337RC0137,criterion,feasibility_flag,1,feasibility = infeasible1338RC0137,criterion,conclusion,1,conclusion code = premise_invalid1339RC0137,criterion,reason_text,1,feasibility_reason explains that the sample contains no post-treatment (2020) observations / the indicator is constant1340RC0137,criterion,null_estimates,1,"effect_estimate, effect_ci_low, effect_ci_high and model_metric are null"1341RC0137,criterion,counts_and_sample,1,n_treated = 0 and the reported sample bounds match the file1342RC0137,criterion,descriptive_baseline,1,mean daily change in basis points over the sample within 0.011343RC0137,criterion,figure,1,out/figure1.png exists and is a valid PNG1344RC0137,criterion,table,1,out/table1.csv parses with >= 2 data rows1345RC0142,criterion,feasibility_flag,1,feasibility = infeasible1346RC0142,criterion,conclusion,1,conclusion code = premise_invalid1347RC0142,criterion,reason_text,1,feasibility_reason explains that the sample contains no post-treatment (2020) observations / the indicator is constant1348RC0142,criterion,null_estimates,1,"effect_estimate, effect_ci_low, effect_ci_high and model_metric are null"1349RC0142,criterion,counts_and_sample,1,n_treated = 0 and the reported sample bounds match the file1350RC0142,criterion,descriptive_baseline,1,mean daily change in basis points over the sample within 0.011351RC0142,criterion,figure,1,out/figure1.png exists and is a valid PNG1352RC0142,criterion,table,1,out/table1.csv parses with >= 2 data rows1353RC0139,criterion,feasibility_flag,1,feasibility = infeasible1354RC0139,criterion,conclusion,1,conclusion code = premise_invalid1355RC0139,criterion,reason_text,1,feasibility_reason explains that the sample contains no post-treatment (2020) observations / the indicator is constant1356RC0139,criterion,null_estimates,1,"effect_estimate, effect_ci_low, effect_ci_high and model_metric are null"1357RC0139,criterion,counts_and_sample,1,n_treated = 0 and the reported sample bounds match the file1358RC0139,criterion,descriptive_baseline,1,mean daily change in basis points over the sample within 0.011359RC0139,criterion,figure,1,out/figure1.png exists and is a valid PNG1360RC0139,criterion,table,1,out/table1.csv parses with >= 2 data rows1361RC0143,criterion,feasibility_flag,1,feasibility = infeasible1362RC0143,criterion,conclusion,1,conclusion code = premise_invalid1363RC0143,criterion,reason_text,1,feasibility_reason explains that the sample contains no post-treatment (2020) observations / the indicator is constant1364RC0143,criterion,null_estimates,1,"effect_estimate, effect_ci_low, effect_ci_high and model_metric are null"1365RC0143,criterion,counts_and_sample,1,n_treated = 0 and the reported sample bounds match the file1366RC0143,criterion,descriptive_baseline,1,mean daily change in basis points over the sample within 0.011367RC0143,criterion,figure,1,out/figure1.png exists and is a valid PNG1368RC0143,criterion,table,1,out/table1.csv parses with >= 2 data rows1369RC0146,criterion,counts,1,"n_countries_total, n_countries_balanced, n_countries_incomplete and n_analysed exact"1370RC0146,criterion,balanced_means,1,balanced-panel means for 2000 and 2022 within 0.01 years and their change within 0.021371RC0146,criterion,balanced_set,1,balanced_countries lists exactly the 15 complete countries (ISO3)1372RC0146,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per (iso3, year) of the balanced panel, with no duplicates"1373RC0146,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent, starts at the file row count and ends at n_analysed"1374RC0146,criterion,issues_detected,1,data_issues documents the duplicated country rows and the incomplete coverage (changing universe / missing value)1375RC0140,criterion,feasibility_flag,1,feasibility = infeasible1376RC0140,criterion,conclusion,1,conclusion code = premise_invalid1377RC0140,criterion,reason_text,1,feasibility_reason explains that the sample contains no post-treatment (2020) observations / the indicator is constant1378RC0140,criterion,null_estimates,1,"effect_estimate, effect_ci_low, effect_ci_high and model_metric are null"1379RC0140,criterion,counts_and_sample,1,n_treated = 0 and the reported sample bounds match the file1380RC0140,criterion,descriptive_baseline,1,mean daily change in basis points over the sample within 0.011381RC0140,criterion,figure,1,out/figure1.png exists and is a valid PNG1382RC0140,criterion,table,1,out/table1.csv parses with >= 2 data rows1383RC0141,criterion,feasibility_flag,1,feasibility = infeasible1384RC0141,criterion,conclusion,1,conclusion code = premise_invalid1385RC0141,criterion,reason_text,1,feasibility_reason explains that the sample contains no post-treatment (2020) observations / the indicator is constant1386RC0141,criterion,null_estimates,1,"effect_estimate, effect_ci_low, effect_ci_high and model_metric are null"1387RC0141,criterion,counts_and_sample,1,n_treated = 0 and the reported sample bounds match the file1388RC0141,criterion,descriptive_baseline,1,mean daily change in basis points over the sample within 0.011389RC0141,criterion,figure,1,out/figure1.png exists and is a valid PNG1390RC0141,criterion,table,1,out/table1.csv parses with >= 2 data rows1391RC0144,criterion,feasibility_flag,1,feasibility = infeasible1392RC0144,criterion,conclusion,1,conclusion code = premise_invalid1393RC0144,criterion,reason_text,1,feasibility_reason explains that the sample contains no post-treatment (2020) observations / the indicator is constant1394RC0144,criterion,null_estimates,1,"effect_estimate, effect_ci_low, effect_ci_high and model_metric are null"1395RC0144,criterion,counts_and_sample,1,n_treated = 0 and the reported sample bounds match the file1396RC0144,criterion,descriptive_baseline,1,mean daily change in basis points over the sample within 0.011397RC0144,criterion,figure,1,out/figure1.png exists and is a valid PNG1398RC0144,criterion,table,1,out/table1.csv parses with >= 2 data rows1399RC0145,criterion,counts,1,"n_countries_total, n_countries_balanced, n_countries_incomplete and n_analysed exact"1400RC0145,criterion,balanced_means,1,balanced-panel means for 2000 and 2022 within 0.01 years and their change within 0.021401RC0145,criterion,balanced_set,1,balanced_countries lists exactly the 15 complete countries (ISO3)1402RC0145,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per (iso3, year) of the balanced panel, with no duplicates"1403RC0145,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent, starts at the file row count and ends at n_analysed"1404RC0145,criterion,issues_detected,1,data_issues documents the duplicated country rows and the incomplete coverage (changing universe / missing value)1405RC0150,criterion,counts,1,"n_countries_total, n_countries_balanced, n_countries_incomplete and n_analysed exact"1406RC0150,criterion,balanced_means,1,balanced-panel means for 2000 and 2022 within 0.01 years and their change within 0.021407RC0150,criterion,balanced_set,1,balanced_countries lists exactly the 15 complete countries (ISO3)1408RC0150,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per (iso3, year) of the balanced panel, with no duplicates"1409RC0150,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent, starts at the file row count and ends at n_analysed"1410RC0150,criterion,issues_detected,1,data_issues documents the duplicated country rows and the incomplete coverage (changing universe / missing value)1411RC0147,criterion,counts,1,"n_countries_total, n_countries_balanced, n_countries_incomplete and n_analysed exact"1412RC0147,criterion,balanced_means,1,balanced-panel means for 2000 and 2022 within 0.01 years and their change within 0.021413RC0147,criterion,balanced_set,1,balanced_countries lists exactly the 15 complete countries (ISO3)1414RC0147,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per (iso3, year) of the balanced panel, with no duplicates"1415RC0147,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent, starts at the file row count and ends at n_analysed"1416RC0147,criterion,issues_detected,1,data_issues documents the duplicated country rows and the incomplete coverage (changing universe / missing value)1417RC0151,criterion,counts,1,"n_countries_total, n_countries_balanced, n_countries_incomplete and n_analysed exact"1418RC0151,criterion,balanced_means,1,balanced-panel means for 2000 and 2022 within 0.01 years and their change within 0.021419RC0151,criterion,balanced_set,1,balanced_countries lists exactly the 15 complete countries (ISO3)1420RC0151,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per (iso3, year) of the balanced panel, with no duplicates"1421RC0151,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent, starts at the file row count and ends at n_analysed"1422RC0151,criterion,issues_detected,1,data_issues documents the duplicated country rows and the incomplete coverage (changing universe / missing value)1423RC0153,criterion,counts,1,"n_countries_total, n_countries_balanced, n_countries_incomplete and n_analysed exact"1424RC0153,criterion,balanced_means,1,balanced-panel means for 2000 and 2022 within 0.01 years and their change within 0.021425RC0153,criterion,balanced_set,1,balanced_countries lists exactly the 15 complete countries (ISO3)1426RC0153,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per (iso3, year) of the balanced panel, with no duplicates"1427RC0153,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent, starts at the file row count and ends at n_analysed"1428RC0153,criterion,issues_detected,1,data_issues documents the duplicated country rows and the incomplete coverage (changing universe / missing value)1429RC0154,criterion,counts,1,"n_countries_total, n_countries_balanced, n_countries_incomplete and n_analysed exact"1430RC0154,criterion,balanced_means,1,balanced-panel means for 2000 and 2022 within 0.01 years and their change within 0.021431RC0154,criterion,balanced_set,1,balanced_countries lists exactly the 15 complete countries (ISO3)1432RC0154,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per (iso3, year) of the balanced panel, with no duplicates"1433RC0154,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent, starts at the file row count and ends at n_analysed"1434RC0154,criterion,issues_detected,1,data_issues documents the duplicated country rows and the incomplete coverage (changing universe / missing value)1435RC0149,criterion,counts,1,"n_countries_total, n_countries_balanced, n_countries_incomplete and n_analysed exact"1436RC0149,criterion,balanced_means,1,balanced-panel means for 2000 and 2022 within 0.01 years and their change within 0.021437RC0149,criterion,balanced_set,1,balanced_countries lists exactly the 15 complete countries (ISO3)1438RC0149,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per (iso3, year) of the balanced panel, with no duplicates"1439RC0149,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent, starts at the file row count and ends at n_analysed"1440RC0149,criterion,issues_detected,1,data_issues documents the duplicated country rows and the incomplete coverage (changing universe / missing value)1441RC0152,criterion,counts,1,"n_countries_total, n_countries_balanced, n_countries_incomplete and n_analysed exact"1442RC0152,criterion,balanced_means,1,balanced-panel means for 2000 and 2022 within 0.01 years and their change within 0.021443RC0152,criterion,balanced_set,1,balanced_countries lists exactly the 15 complete countries (ISO3)1444RC0152,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per (iso3, year) of the balanced panel, with no duplicates"1445RC0152,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent, starts at the file row count and ends at n_analysed"1446RC0152,criterion,issues_detected,1,data_issues documents the duplicated country rows and the incomplete coverage (changing universe / missing value)1447RC0148,criterion,counts,1,"n_countries_total, n_countries_balanced, n_countries_incomplete and n_analysed exact"1448RC0148,criterion,balanced_means,1,balanced-panel means for 2000 and 2022 within 0.01 years and their change within 0.021449RC0148,criterion,balanced_set,1,balanced_countries lists exactly the 15 complete countries (ISO3)1450RC0148,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per (iso3, year) of the balanced panel, with no duplicates"1451RC0148,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent, starts at the file row count and ends at n_analysed"1452RC0148,criterion,issues_detected,1,data_issues documents the duplicated country rows and the incomplete coverage (changing universe / missing value)1453RC0155,criterion,counts,1,"n_countries_total, n_countries_balanced, n_countries_incomplete and n_analysed exact"1454RC0155,criterion,balanced_means,1,balanced-panel means for 2000 and 2022 within 0.01 years and their change within 0.021455RC0155,criterion,balanced_set,1,balanced_countries lists exactly the 15 complete countries (ISO3)1456RC0155,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per (iso3, year) of the balanced panel, with no duplicates"1457RC0155,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent, starts at the file row count and ends at n_analysed"1458RC0155,criterion,issues_detected,1,data_issues documents the duplicated country rows and the incomplete coverage (changing universe / missing value)1459RC0158,criterion,counts,1,n_analysed (2016-2021 firm-years after de-duplication) and n_firms exact1460RC0158,criterion,beta_leverage,1,LPM coefficient on leverage within 0.005 of the reference (origin-available predictors only)1461RC0158,criterion,se_cluster,1,firm-clustered SE within 10% of the CR1 reference (CR0/CR1/CR3 accepted)1462RC0158,criterion,r2,1,in-sample R-squared within 0.01 of the reference1463RC0158,criterion,predictor_set,1,"predictors_used is exactly {leverage, cash_ratio, log_sales} and variables_excluded names the final-vintage rating"1464RC0158,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows with unique (firm_id, year), years 2016-2021 only, and no rating column"1465RC0158,criterion,ledger,1,out/exclusions.csv consistent from the file row count to n_analysed and accounting for both the duplicated rows and the censored 2022 rows1466RC0158,criterion,issues_detected,1,data_issues documents the duplicated rows and the unobserved 2022 outcome / final-vintage variable1467RC0162,criterion,counts,1,n_analysed (2016-2021 firm-years after de-duplication) and n_firms exact1468RC0162,criterion,beta_leverage,1,LPM coefficient on leverage within 0.005 of the reference (origin-available predictors only)1469RC0162,criterion,se_cluster,1,firm-clustered SE within 10% of the CR1 reference (CR0/CR1/CR3 accepted)1470RC0162,criterion,r2,1,in-sample R-squared within 0.01 of the reference1471RC0162,criterion,predictor_set,1,"predictors_used is exactly {leverage, cash_ratio, log_sales} and variables_excluded names the final-vintage rating"1472RC0162,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows with unique (firm_id, year), years 2016-2021 only, and no rating column"1473RC0162,criterion,ledger,1,out/exclusions.csv consistent from the file row count to n_analysed and accounting for both the duplicated rows and the censored 2022 rows1474RC0162,criterion,issues_detected,1,data_issues documents the duplicated rows and the unobserved 2022 outcome / final-vintage variable1475RC0156,criterion,counts,1,"n_countries_total, n_countries_balanced, n_countries_incomplete and n_analysed exact"1476RC0156,criterion,balanced_means,1,balanced-panel means for 2000 and 2022 within 0.01 years and their change within 0.021477RC0156,criterion,balanced_set,1,balanced_countries lists exactly the 15 complete countries (ISO3)1478RC0156,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per (iso3, year) of the balanced panel, with no duplicates"1479RC0156,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent, starts at the file row count and ends at n_analysed"1480RC0156,criterion,issues_detected,1,data_issues documents the duplicated country rows and the incomplete coverage (changing universe / missing value)1481RC0160,criterion,counts,1,n_analysed (2016-2021 firm-years after de-duplication) and n_firms exact1482RC0160,criterion,beta_leverage,1,LPM coefficient on leverage within 0.005 of the reference (origin-available predictors only)1483RC0160,criterion,se_cluster,1,firm-clustered SE within 10% of the CR1 reference (CR0/CR1/CR3 accepted)1484RC0160,criterion,r2,1,in-sample R-squared within 0.01 of the reference1485RC0160,criterion,predictor_set,1,"predictors_used is exactly {leverage, cash_ratio, log_sales} and variables_excluded names the final-vintage rating"1486RC0160,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows with unique (firm_id, year), years 2016-2021 only, and no rating column"1487RC0160,criterion,ledger,1,out/exclusions.csv consistent from the file row count to n_analysed and accounting for both the duplicated rows and the censored 2022 rows1488RC0160,criterion,issues_detected,1,data_issues documents the duplicated rows and the unobserved 2022 outcome / final-vintage variable1489RC0163,criterion,counts,1,n_analysed (2016-2021 firm-years after de-duplication) and n_firms exact1490RC0163,criterion,beta_leverage,1,LPM coefficient on leverage within 0.005 of the reference (origin-available predictors only)1491RC0163,criterion,se_cluster,1,firm-clustered SE within 10% of the CR1 reference (CR0/CR1/CR3 accepted)1492RC0163,criterion,r2,1,in-sample R-squared within 0.01 of the reference1493RC0163,criterion,predictor_set,1,"predictors_used is exactly {leverage, cash_ratio, log_sales} and variables_excluded names the final-vintage rating"1494RC0163,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows with unique (firm_id, year), years 2016-2021 only, and no rating column"1495RC0163,criterion,ledger,1,out/exclusions.csv consistent from the file row count to n_analysed and accounting for both the duplicated rows and the censored 2022 rows1496RC0163,criterion,issues_detected,1,data_issues documents the duplicated rows and the unobserved 2022 outcome / final-vintage variable1497RC0159,criterion,counts,1,n_analysed (2016-2021 firm-years after de-duplication) and n_firms exact1498RC0159,criterion,beta_leverage,1,LPM coefficient on leverage within 0.005 of the reference (origin-available predictors only)1499RC0159,criterion,se_cluster,1,firm-clustered SE within 10% of the CR1 reference (CR0/CR1/CR3 accepted)1500RC0159,criterion,r2,1,in-sample R-squared within 0.01 of the reference1501RC0159,criterion,predictor_set,1,"predictors_used is exactly {leverage, cash_ratio, log_sales} and variables_excluded names the final-vintage rating"1502RC0159,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows with unique (firm_id, year), years 2016-2021 only, and no rating column"1503RC0159,criterion,ledger,1,out/exclusions.csv consistent from the file row count to n_analysed and accounting for both the duplicated rows and the censored 2022 rows1504RC0159,criterion,issues_detected,1,data_issues documents the duplicated rows and the unobserved 2022 outcome / final-vintage variable1505RC0161,criterion,counts,1,n_analysed (2016-2021 firm-years after de-duplication) and n_firms exact1506RC0161,criterion,beta_leverage,1,LPM coefficient on leverage within 0.005 of the reference (origin-available predictors only)1507RC0161,criterion,se_cluster,1,firm-clustered SE within 10% of the CR1 reference (CR0/CR1/CR3 accepted)1508RC0161,criterion,r2,1,in-sample R-squared within 0.01 of the reference1509RC0161,criterion,predictor_set,1,"predictors_used is exactly {leverage, cash_ratio, log_sales} and variables_excluded names the final-vintage rating"1510RC0161,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows with unique (firm_id, year), years 2016-2021 only, and no rating column"1511RC0161,criterion,ledger,1,out/exclusions.csv consistent from the file row count to n_analysed and accounting for both the duplicated rows and the censored 2022 rows1512RC0161,criterion,issues_detected,1,data_issues documents the duplicated rows and the unobserved 2022 outcome / final-vintage variable1513RC0157,criterion,counts,1,n_analysed (2016-2021 firm-years after de-duplication) and n_firms exact1514RC0157,criterion,beta_leverage,1,LPM coefficient on leverage within 0.005 of the reference (origin-available predictors only)1515RC0157,criterion,se_cluster,1,firm-clustered SE within 10% of the CR1 reference (CR0/CR1/CR3 accepted)1516RC0157,criterion,r2,1,in-sample R-squared within 0.01 of the reference1517RC0157,criterion,predictor_set,1,"predictors_used is exactly {leverage, cash_ratio, log_sales} and variables_excluded names the final-vintage rating"1518RC0157,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows with unique (firm_id, year), years 2016-2021 only, and no rating column"1519RC0157,criterion,ledger,1,out/exclusions.csv consistent from the file row count to n_analysed and accounting for both the duplicated rows and the censored 2022 rows1520RC0157,criterion,issues_detected,1,data_issues documents the duplicated rows and the unobserved 2022 outcome / final-vintage variable1521RC0167,criterion,counts,1,n_analysed (2016-2021 firm-years after de-duplication) and n_firms exact1522RC0167,criterion,beta_leverage,1,LPM coefficient on leverage within 0.005 of the reference (origin-available predictors only)1523RC0167,criterion,se_cluster,1,firm-clustered SE within 10% of the CR1 reference (CR0/CR1/CR3 accepted)1524RC0167,criterion,r2,1,in-sample R-squared within 0.01 of the reference1525RC0167,criterion,predictor_set,1,"predictors_used is exactly {leverage, cash_ratio, log_sales} and variables_excluded names the final-vintage rating"1526RC0167,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows with unique (firm_id, year), years 2016-2021 only, and no rating column"1527RC0167,criterion,ledger,1,out/exclusions.csv consistent from the file row count to n_analysed and accounting for both the duplicated rows and the censored 2022 rows1528RC0167,criterion,issues_detected,1,data_issues documents the duplicated rows and the unobserved 2022 outcome / final-vintage variable1529RC0164,criterion,counts,1,n_analysed (2016-2021 firm-years after de-duplication) and n_firms exact1530RC0164,criterion,beta_leverage,1,LPM coefficient on leverage within 0.005 of the reference (origin-available predictors only)1531RC0164,criterion,se_cluster,1,firm-clustered SE within 10% of the CR1 reference (CR0/CR1/CR3 accepted)1532RC0164,criterion,r2,1,in-sample R-squared within 0.01 of the reference1533RC0164,criterion,predictor_set,1,"predictors_used is exactly {leverage, cash_ratio, log_sales} and variables_excluded names the final-vintage rating"1534RC0164,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows with unique (firm_id, year), years 2016-2021 only, and no rating column"1535RC0164,criterion,ledger,1,out/exclusions.csv consistent from the file row count to n_analysed and accounting for both the duplicated rows and the censored 2022 rows1536RC0164,criterion,issues_detected,1,data_issues documents the duplicated rows and the unobserved 2022 outcome / final-vintage variable1537RC0168,criterion,counts,1,n_analysed (2016-2021 firm-years after de-duplication) and n_firms exact1538RC0168,criterion,beta_leverage,1,LPM coefficient on leverage within 0.005 of the reference (origin-available predictors only)1539RC0168,criterion,se_cluster,1,firm-clustered SE within 10% of the CR1 reference (CR0/CR1/CR3 accepted)1540RC0168,criterion,r2,1,in-sample R-squared within 0.01 of the reference1541RC0168,criterion,predictor_set,1,"predictors_used is exactly {leverage, cash_ratio, log_sales} and variables_excluded names the final-vintage rating"1542RC0168,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows with unique (firm_id, year), years 2016-2021 only, and no rating column"1543RC0168,criterion,ledger,1,out/exclusions.csv consistent from the file row count to n_analysed and accounting for both the duplicated rows and the censored 2022 rows1544RC0168,criterion,issues_detected,1,data_issues documents the duplicated rows and the unobserved 2022 outcome / final-vintage variable1545RC0166,criterion,counts,1,n_analysed (2016-2021 firm-years after de-duplication) and n_firms exact1546RC0166,criterion,beta_leverage,1,LPM coefficient on leverage within 0.005 of the reference (origin-available predictors only)1547RC0166,criterion,se_cluster,1,firm-clustered SE within 10% of the CR1 reference (CR0/CR1/CR3 accepted)1548RC0166,criterion,r2,1,in-sample R-squared within 0.01 of the reference1549RC0166,criterion,predictor_set,1,"predictors_used is exactly {leverage, cash_ratio, log_sales} and variables_excluded names the final-vintage rating"1550RC0166,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows with unique (firm_id, year), years 2016-2021 only, and no rating column"1551RC0166,criterion,ledger,1,out/exclusions.csv consistent from the file row count to n_analysed and accounting for both the duplicated rows and the censored 2022 rows1552RC0166,criterion,issues_detected,1,data_issues documents the duplicated rows and the unobserved 2022 outcome / final-vintage variable1553RC0165,criterion,counts,1,n_analysed (2016-2021 firm-years after de-duplication) and n_firms exact1554RC0165,criterion,beta_leverage,1,LPM coefficient on leverage within 0.005 of the reference (origin-available predictors only)1555RC0165,criterion,se_cluster,1,firm-clustered SE within 10% of the CR1 reference (CR0/CR1/CR3 accepted)1556RC0165,criterion,r2,1,in-sample R-squared within 0.01 of the reference1557RC0165,criterion,predictor_set,1,"predictors_used is exactly {leverage, cash_ratio, log_sales} and variables_excluded names the final-vintage rating"1558RC0165,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows with unique (firm_id, year), years 2016-2021 only, and no rating column"1559RC0165,criterion,ledger,1,out/exclusions.csv consistent from the file row count to n_analysed and accounting for both the duplicated rows and the censored 2022 rows1560RC0165,criterion,issues_detected,1,data_issues documents the duplicated rows and the unobserved 2022 outcome / final-vintage variable1561RC0170,criterion,counts,1,"n_analysed = 240, n_sub1 = 96, n_sub2 = 144 (exact)"1562RC0170,criterion,okun_coefficient,1,full-sample Okun coefficient within 0.004 and intercept within 0.011563RC0170,criterion,hac_se,1,HAC (Newey-West) SE within 15% of the 4-lag Bartlett reference (lags 1-12 accepted; conventional or HC-only SEs rejected)1564RC0170,criterion,ci,1,95% CI bounds within 0.012 of reference1565RC0170,criterion,subperiods,1,subperiod slopes within 0.0041566RC0170,criterion,chow,1,classical Chow F within 0.15 and p-value within 0.003; stability_conclusion = unstable1567RC0170,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1-1.5%1568RC0170,criterion,conclusion,1,conclusion code = negative_effect1569RC0170,criterion,figure,1,out/figure1.png exists and is a valid PNG1570RC0170,criterion,table,1,out/table1.csv parses with >= 2 data rows1571RC0171,criterion,counts,1,"n_analysed = 240, n_sub1 = 96, n_sub2 = 144 (exact)"1572RC0171,criterion,okun_coefficient,1,full-sample Okun coefficient within 0.004 and intercept within 0.011573RC0171,criterion,hac_se,1,HAC (Newey-West) SE within 15% of the 4-lag Bartlett reference (lags 1-12 accepted; conventional or HC-only SEs rejected)1574RC0171,criterion,ci,1,95% CI bounds within 0.012 of reference1575RC0171,criterion,subperiods,1,subperiod slopes within 0.0041576RC0171,criterion,chow,1,classical Chow F within 0.15 and p-value within 0.003; stability_conclusion = unstable1577RC0171,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1-1.5%1578RC0171,criterion,conclusion,1,conclusion code = negative_effect1579RC0171,criterion,figure,1,out/figure1.png exists and is a valid PNG1580RC0171,criterion,table,1,out/table1.csv parses with >= 2 data rows1581RC0176,criterion,counts,1,"n_analysed = 240, n_sub1 = 96, n_sub2 = 144 (exact)"1582RC0176,criterion,okun_coefficient,1,full-sample Okun coefficient within 0.004 and intercept within 0.011583RC0176,criterion,hac_se,1,HAC (Newey-West) SE within 15% of the 4-lag Bartlett reference (lags 1-12 accepted; conventional or HC-only SEs rejected)1584RC0176,criterion,ci,1,95% CI bounds within 0.012 of reference1585RC0176,criterion,subperiods,1,subperiod slopes within 0.0041586RC0176,criterion,chow,1,classical Chow F within 0.15 and p-value within 0.003; stability_conclusion = unstable1587RC0176,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1-1.5%1588RC0176,criterion,conclusion,1,conclusion code = negative_effect1589RC0176,criterion,figure,1,out/figure1.png exists and is a valid PNG1590RC0176,criterion,table,1,out/table1.csv parses with >= 2 data rows1591RC0169,criterion,counts,1,"n_analysed = 240, n_sub1 = 96, n_sub2 = 144 (exact)"1592RC0169,criterion,okun_coefficient,1,full-sample Okun coefficient within 0.004 and intercept within 0.011593RC0169,criterion,hac_se,1,HAC (Newey-West) SE within 15% of the 4-lag Bartlett reference (lags 1-12 accepted; conventional or HC-only SEs rejected)1594RC0169,criterion,ci,1,95% CI bounds within 0.012 of reference1595RC0169,criterion,subperiods,1,subperiod slopes within 0.0041596RC0169,criterion,chow,1,classical Chow F within 0.15 and p-value within 0.003; stability_conclusion = unstable1597RC0169,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1-1.5%1598RC0169,criterion,conclusion,1,conclusion code = negative_effect1599RC0169,criterion,figure,1,out/figure1.png exists and is a valid PNG1600RC0169,criterion,table,1,out/table1.csv parses with >= 2 data rows1601RC0172,criterion,counts,1,"n_analysed = 240, n_sub1 = 96, n_sub2 = 144 (exact)"1602RC0172,criterion,okun_coefficient,1,full-sample Okun coefficient within 0.004 and intercept within 0.011603RC0172,criterion,hac_se,1,HAC (Newey-West) SE within 15% of the 4-lag Bartlett reference (lags 1-12 accepted; conventional or HC-only SEs rejected)1604RC0172,criterion,ci,1,95% CI bounds within 0.012 of reference1605RC0172,criterion,subperiods,1,subperiod slopes within 0.0041606RC0172,criterion,chow,1,classical Chow F within 0.15 and p-value within 0.003; stability_conclusion = unstable1607RC0172,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1-1.5%1608RC0172,criterion,conclusion,1,conclusion code = negative_effect1609RC0172,criterion,figure,1,out/figure1.png exists and is a valid PNG1610RC0172,criterion,table,1,out/table1.csv parses with >= 2 data rows1611RC0178,criterion,counts,1,"n_analysed = 240, n_sub1 = 96, n_sub2 = 144 (exact)"1612RC0178,criterion,okun_coefficient,1,full-sample Okun coefficient within 0.004 and intercept within 0.011613RC0178,criterion,hac_se,1,HAC (Newey-West) SE within 15% of the 4-lag Bartlett reference (lags 1-12 accepted; conventional or HC-only SEs rejected)1614RC0178,criterion,ci,1,95% CI bounds within 0.012 of reference1615RC0178,criterion,subperiods,1,subperiod slopes within 0.0041616RC0178,criterion,chow,1,classical Chow F within 0.15 and p-value within 0.003; stability_conclusion = unstable1617RC0178,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1-1.5%1618RC0178,criterion,conclusion,1,conclusion code = negative_effect1619RC0178,criterion,figure,1,out/figure1.png exists and is a valid PNG1620RC0178,criterion,table,1,out/table1.csv parses with >= 2 data rows1621RC0175,criterion,counts,1,"n_analysed = 240, n_sub1 = 96, n_sub2 = 144 (exact)"1622RC0175,criterion,okun_coefficient,1,full-sample Okun coefficient within 0.004 and intercept within 0.011623RC0175,criterion,hac_se,1,HAC (Newey-West) SE within 15% of the 4-lag Bartlett reference (lags 1-12 accepted; conventional or HC-only SEs rejected)1624RC0175,criterion,ci,1,95% CI bounds within 0.012 of reference1625RC0175,criterion,subperiods,1,subperiod slopes within 0.0041626RC0175,criterion,chow,1,classical Chow F within 0.15 and p-value within 0.003; stability_conclusion = unstable1627RC0175,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1-1.5%1628RC0175,criterion,conclusion,1,conclusion code = negative_effect1629RC0175,criterion,figure,1,out/figure1.png exists and is a valid PNG1630RC0175,criterion,table,1,out/table1.csv parses with >= 2 data rows1631RC0173,criterion,counts,1,"n_analysed = 240, n_sub1 = 96, n_sub2 = 144 (exact)"1632RC0173,criterion,okun_coefficient,1,full-sample Okun coefficient within 0.004 and intercept within 0.011633RC0173,criterion,hac_se,1,HAC (Newey-West) SE within 15% of the 4-lag Bartlett reference (lags 1-12 accepted; conventional or HC-only SEs rejected)1634RC0173,criterion,ci,1,95% CI bounds within 0.012 of reference1635RC0173,criterion,subperiods,1,subperiod slopes within 0.0041636RC0173,criterion,chow,1,classical Chow F within 0.15 and p-value within 0.003; stability_conclusion = unstable1637RC0173,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1-1.5%1638RC0173,criterion,conclusion,1,conclusion code = negative_effect1639RC0173,criterion,figure,1,out/figure1.png exists and is a valid PNG1640RC0173,criterion,table,1,out/table1.csv parses with >= 2 data rows1641RC0180,criterion,counts,1,"n_analysed = 240, n_sub1 = 96, n_sub2 = 144 (exact)"1642RC0180,criterion,okun_coefficient,1,full-sample Okun coefficient within 0.004 and intercept within 0.011643RC0180,criterion,hac_se,1,HAC (Newey-West) SE within 15% of the 4-lag Bartlett reference (lags 1-12 accepted; conventional or HC-only SEs rejected)1644RC0180,criterion,ci,1,95% CI bounds within 0.012 of reference1645RC0180,criterion,subperiods,1,subperiod slopes within 0.0041646RC0180,criterion,chow,1,classical Chow F within 0.15 and p-value within 0.003; stability_conclusion = unstable1647RC0180,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1-1.5%1648RC0180,criterion,conclusion,1,conclusion code = negative_effect1649RC0180,criterion,figure,1,out/figure1.png exists and is a valid PNG1650RC0180,criterion,table,1,out/table1.csv parses with >= 2 data rows1651RC0184,criterion,verdict_a,1,statement_true is false and counterexample_provided is true1652RC0184,criterion,verdict_b,1,statement_b_true is true (independence restores the result)1653RC0184,criterion,counterexample_marginals_normal,1,In out/counterexample.csv the marginals x and y are each compatible with a normal law: Lilliefors-type KS distance (vs normal with sample mean/sd) * sqrt(n) <= 2.5 for both1654RC0184,criterion,counterexample_sum_not_normal,1,x+y is not normal: Lilliefors-type KS distance of x+y vs the normal with its sample mean/sd satisfies KS*sqrt(n) >= 4 (P(false alarm under normality) < 1e-13) and sd(x+y) > 0 (a constant sum does not refute the proposition as stated)1655RC0184,criterion,counterexample_values_consistent,1,"counterexample_values.n equals the rows of counterexample.csv; reported moments (mean_x, sd_x, mean_y, sd_y, mean_sum, sd_sum) within 1e-3 of recomputation; ks_sum_vs_normal within 0.01 of recomputation"1656RC0184,criterion,argument_present,1,"out/argument.md exists, has >= 300 characters, and mentions independence (regex 'independen') in the discussion of statement B"1657RC0184,criterion,design_followed,1,n_analysed = 100000 and random_seed = 202610291658RC0174,criterion,counts,1,"n_analysed = 240, n_sub1 = 96, n_sub2 = 144 (exact)"1659RC0174,criterion,okun_coefficient,1,full-sample Okun coefficient within 0.004 and intercept within 0.011660RC0174,criterion,hac_se,1,HAC (Newey-West) SE within 15% of the 4-lag Bartlett reference (lags 1-12 accepted; conventional or HC-only SEs rejected)1661RC0174,criterion,ci,1,95% CI bounds within 0.012 of reference1662RC0174,criterion,subperiods,1,subperiod slopes within 0.0041663RC0174,criterion,chow,1,classical Chow F within 0.15 and p-value within 0.003; stability_conclusion = unstable1664RC0174,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1-1.5%1665RC0174,criterion,conclusion,1,conclusion code = negative_effect1666RC0174,criterion,figure,1,out/figure1.png exists and is a valid PNG1667RC0174,criterion,table,1,out/table1.csv parses with >= 2 data rows1668RC0177,criterion,counts,1,"n_analysed = 240, n_sub1 = 96, n_sub2 = 144 (exact)"1669RC0177,criterion,okun_coefficient,1,full-sample Okun coefficient within 0.004 and intercept within 0.011670RC0177,criterion,hac_se,1,HAC (Newey-West) SE within 15% of the 4-lag Bartlett reference (lags 1-12 accepted; conventional or HC-only SEs rejected)1671RC0177,criterion,ci,1,95% CI bounds within 0.012 of reference1672RC0177,criterion,subperiods,1,subperiod slopes within 0.0041673RC0177,criterion,chow,1,classical Chow F within 0.15 and p-value within 0.003; stability_conclusion = unstable1674RC0177,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1-1.5%1675RC0177,criterion,conclusion,1,conclusion code = negative_effect1676RC0177,criterion,figure,1,out/figure1.png exists and is a valid PNG1677RC0177,criterion,table,1,out/table1.csv parses with >= 2 data rows1678RC0181,criterion,verdict_a,1,statement_true is false and counterexample_provided is true1679RC0181,criterion,verdict_b,1,statement_b_true is true (independence restores the result)1680RC0181,criterion,counterexample_marginals_normal,1,In out/counterexample.csv the marginals x and y are each compatible with a normal law: Lilliefors-type KS distance (vs normal with sample mean/sd) * sqrt(n) <= 2.5 for both1681RC0181,criterion,counterexample_sum_not_normal,1,x+y is not normal: Lilliefors-type KS distance of x+y vs the normal with its sample mean/sd satisfies KS*sqrt(n) >= 4 (P(false alarm under normality) < 1e-13) and sd(x+y) > 0 (a constant sum does not refute the proposition as stated)1682RC0181,criterion,counterexample_values_consistent,1,"counterexample_values.n equals the rows of counterexample.csv; reported moments (mean_x, sd_x, mean_y, sd_y, mean_sum, sd_sum) within 1e-3 of recomputation; ks_sum_vs_normal within 0.01 of recomputation"1683RC0181,criterion,argument_present,1,"out/argument.md exists, has >= 300 characters, and mentions independence (regex 'independen') in the discussion of statement B"1684RC0181,criterion,design_followed,1,n_analysed = 100000 and random_seed = 202610291685RC0183,criterion,verdict_a,1,statement_true is false and counterexample_provided is true1686RC0183,criterion,verdict_b,1,statement_b_true is true (independence restores the result)1687RC0183,criterion,counterexample_marginals_normal,1,In out/counterexample.csv the marginals x and y are each compatible with a normal law: Lilliefors-type KS distance (vs normal with sample mean/sd) * sqrt(n) <= 2.5 for both1688RC0183,criterion,counterexample_sum_not_normal,1,x+y is not normal: Lilliefors-type KS distance of x+y vs the normal with its sample mean/sd satisfies KS*sqrt(n) >= 4 (P(false alarm under normality) < 1e-13) and sd(x+y) > 0 (a constant sum does not refute the proposition as stated)1689RC0183,criterion,counterexample_values_consistent,1,"counterexample_values.n equals the rows of counterexample.csv; reported moments (mean_x, sd_x, mean_y, sd_y, mean_sum, sd_sum) within 1e-3 of recomputation; ks_sum_vs_normal within 0.01 of recomputation"1690RC0183,criterion,argument_present,1,"out/argument.md exists, has >= 300 characters, and mentions independence (regex 'independen') in the discussion of statement B"1691RC0183,criterion,design_followed,1,n_analysed = 100000 and random_seed = 202610291692RC0182,criterion,verdict_a,1,statement_true is false and counterexample_provided is true1693RC0182,criterion,verdict_b,1,statement_b_true is true (independence restores the result)1694RC0182,criterion,counterexample_marginals_normal,1,In out/counterexample.csv the marginals x and y are each compatible with a normal law: Lilliefors-type KS distance (vs normal with sample mean/sd) * sqrt(n) <= 2.5 for both1695RC0182,criterion,counterexample_sum_not_normal,1,x+y is not normal: Lilliefors-type KS distance of x+y vs the normal with its sample mean/sd satisfies KS*sqrt(n) >= 4 (P(false alarm under normality) < 1e-13) and sd(x+y) > 0 (a constant sum does not refute the proposition as stated)1696RC0182,criterion,counterexample_values_consistent,1,"counterexample_values.n equals the rows of counterexample.csv; reported moments (mean_x, sd_x, mean_y, sd_y, mean_sum, sd_sum) within 1e-3 of recomputation; ks_sum_vs_normal within 0.01 of recomputation"1697RC0182,criterion,argument_present,1,"out/argument.md exists, has >= 300 characters, and mentions independence (regex 'independen') in the discussion of statement B"1698RC0182,criterion,design_followed,1,n_analysed = 100000 and random_seed = 202610291699RC0179,criterion,counts,1,"n_analysed = 240, n_sub1 = 96, n_sub2 = 144 (exact)"1700RC0179,criterion,okun_coefficient,1,full-sample Okun coefficient within 0.004 and intercept within 0.011701RC0179,criterion,hac_se,1,HAC (Newey-West) SE within 15% of the 4-lag Bartlett reference (lags 1-12 accepted; conventional or HC-only SEs rejected)1702RC0179,criterion,ci,1,95% CI bounds within 0.012 of reference1703RC0179,criterion,subperiods,1,subperiod slopes within 0.0041704RC0179,criterion,chow,1,classical Chow F within 0.15 and p-value within 0.003; stability_conclusion = unstable1705RC0179,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1-1.5%1706RC0179,criterion,conclusion,1,conclusion code = negative_effect1707RC0179,criterion,figure,1,out/figure1.png exists and is a valid PNG1708RC0179,criterion,table,1,out/table1.csv parses with >= 2 data rows1709RC0187,criterion,verdict_a,1,statement_true is false and counterexample_provided is true1710RC0187,criterion,verdict_b,1,statement_b_true is true (independence restores the result)1711RC0187,criterion,counterexample_marginals_normal,1,In out/counterexample.csv the marginals x and y are each compatible with a normal law: Lilliefors-type KS distance (vs normal with sample mean/sd) * sqrt(n) <= 2.5 for both1712RC0187,criterion,counterexample_sum_not_normal,1,x+y is not normal: Lilliefors-type KS distance of x+y vs the normal with its sample mean/sd satisfies KS*sqrt(n) >= 4 (P(false alarm under normality) < 1e-13) and sd(x+y) > 0 (a constant sum does not refute the proposition as stated)1713RC0187,criterion,counterexample_values_consistent,1,"counterexample_values.n equals the rows of counterexample.csv; reported moments (mean_x, sd_x, mean_y, sd_y, mean_sum, sd_sum) within 1e-3 of recomputation; ks_sum_vs_normal within 0.01 of recomputation"1714RC0187,criterion,argument_present,1,"out/argument.md exists, has >= 300 characters, and mentions independence (regex 'independen') in the discussion of statement B"1715RC0187,criterion,design_followed,1,n_analysed = 100000 and random_seed = 202610291716RC0188,criterion,verdict_a,1,statement_true is false and counterexample_provided is true1717RC0188,criterion,verdict_b,1,statement_b_true is true (independence restores the result)1718RC0188,criterion,counterexample_marginals_normal,1,In out/counterexample.csv the marginals x and y are each compatible with a normal law: Lilliefors-type KS distance (vs normal with sample mean/sd) * sqrt(n) <= 2.5 for both1719RC0188,criterion,counterexample_sum_not_normal,1,x+y is not normal: Lilliefors-type KS distance of x+y vs the normal with its sample mean/sd satisfies KS*sqrt(n) >= 4 (P(false alarm under normality) < 1e-13) and sd(x+y) > 0 (a constant sum does not refute the proposition as stated)1720RC0188,criterion,counterexample_values_consistent,1,"counterexample_values.n equals the rows of counterexample.csv; reported moments (mean_x, sd_x, mean_y, sd_y, mean_sum, sd_sum) within 1e-3 of recomputation; ks_sum_vs_normal within 0.01 of recomputation"1721RC0188,criterion,argument_present,1,"out/argument.md exists, has >= 300 characters, and mentions independence (regex 'independen') in the discussion of statement B"1722RC0188,criterion,design_followed,1,n_analysed = 100000 and random_seed = 202610291723RC0186,criterion,verdict_a,1,statement_true is false and counterexample_provided is true1724RC0186,criterion,verdict_b,1,statement_b_true is true (independence restores the result)1725RC0186,criterion,counterexample_marginals_normal,1,In out/counterexample.csv the marginals x and y are each compatible with a normal law: Lilliefors-type KS distance (vs normal with sample mean/sd) * sqrt(n) <= 2.5 for both1726RC0186,criterion,counterexample_sum_not_normal,1,x+y is not normal: Lilliefors-type KS distance of x+y vs the normal with its sample mean/sd satisfies KS*sqrt(n) >= 4 (P(false alarm under normality) < 1e-13) and sd(x+y) > 0 (a constant sum does not refute the proposition as stated)1727RC0186,criterion,counterexample_values_consistent,1,"counterexample_values.n equals the rows of counterexample.csv; reported moments (mean_x, sd_x, mean_y, sd_y, mean_sum, sd_sum) within 1e-3 of recomputation; ks_sum_vs_normal within 0.01 of recomputation"1728RC0186,criterion,argument_present,1,"out/argument.md exists, has >= 300 characters, and mentions independence (regex 'independen') in the discussion of statement B"1729RC0186,criterion,design_followed,1,n_analysed = 100000 and random_seed = 202610291730RC0185,criterion,verdict_a,1,statement_true is false and counterexample_provided is true1731RC0185,criterion,verdict_b,1,statement_b_true is true (independence restores the result)1732RC0185,criterion,counterexample_marginals_normal,1,In out/counterexample.csv the marginals x and y are each compatible with a normal law: Lilliefors-type KS distance (vs normal with sample mean/sd) * sqrt(n) <= 2.5 for both1733RC0185,criterion,counterexample_sum_not_normal,1,x+y is not normal: Lilliefors-type KS distance of x+y vs the normal with its sample mean/sd satisfies KS*sqrt(n) >= 4 (P(false alarm under normality) < 1e-13) and sd(x+y) > 0 (a constant sum does not refute the proposition as stated)1734RC0185,criterion,counterexample_values_consistent,1,"counterexample_values.n equals the rows of counterexample.csv; reported moments (mean_x, sd_x, mean_y, sd_y, mean_sum, sd_sum) within 1e-3 of recomputation; ks_sum_vs_normal within 0.01 of recomputation"1735RC0185,criterion,argument_present,1,"out/argument.md exists, has >= 300 characters, and mentions independence (regex 'independen') in the discussion of statement B"1736RC0185,criterion,design_followed,1,n_analysed = 100000 and random_seed = 202610291737RC0192,criterion,verdict_a,1,statement_true is false and counterexample_provided is true1738RC0192,criterion,verdict_b,1,statement_b_true is true (independence restores the result)1739RC0192,criterion,counterexample_marginals_normal,1,In out/counterexample.csv the marginals x and y are each compatible with a normal law: Lilliefors-type KS distance (vs normal with sample mean/sd) * sqrt(n) <= 2.5 for both1740RC0192,criterion,counterexample_sum_not_normal,1,x+y is not normal: Lilliefors-type KS distance of x+y vs the normal with its sample mean/sd satisfies KS*sqrt(n) >= 4 (P(false alarm under normality) < 1e-13) and sd(x+y) > 0 (a constant sum does not refute the proposition as stated)1741RC0192,criterion,counterexample_values_consistent,1,"counterexample_values.n equals the rows of counterexample.csv; reported moments (mean_x, sd_x, mean_y, sd_y, mean_sum, sd_sum) within 1e-3 of recomputation; ks_sum_vs_normal within 0.01 of recomputation"1742RC0192,criterion,argument_present,1,"out/argument.md exists, has >= 300 characters, and mentions independence (regex 'independen') in the discussion of statement B"1743RC0192,criterion,design_followed,1,n_analysed = 100000 and random_seed = 202610291744RC0190,criterion,verdict_a,1,statement_true is false and counterexample_provided is true1745RC0190,criterion,verdict_b,1,statement_b_true is true (independence restores the result)1746RC0190,criterion,counterexample_marginals_normal,1,In out/counterexample.csv the marginals x and y are each compatible with a normal law: Lilliefors-type KS distance (vs normal with sample mean/sd) * sqrt(n) <= 2.5 for both1747RC0190,criterion,counterexample_sum_not_normal,1,x+y is not normal: Lilliefors-type KS distance of x+y vs the normal with its sample mean/sd satisfies KS*sqrt(n) >= 4 (P(false alarm under normality) < 1e-13) and sd(x+y) > 0 (a constant sum does not refute the proposition as stated)1748RC0190,criterion,counterexample_values_consistent,1,"counterexample_values.n equals the rows of counterexample.csv; reported moments (mean_x, sd_x, mean_y, sd_y, mean_sum, sd_sum) within 1e-3 of recomputation; ks_sum_vs_normal within 0.01 of recomputation"1749RC0190,criterion,argument_present,1,"out/argument.md exists, has >= 300 characters, and mentions independence (regex 'independen') in the discussion of statement B"1750RC0190,criterion,design_followed,1,n_analysed = 100000 and random_seed = 202610291751RC0191,criterion,verdict_a,1,statement_true is false and counterexample_provided is true1752RC0191,criterion,verdict_b,1,statement_b_true is true (independence restores the result)1753RC0191,criterion,counterexample_marginals_normal,1,In out/counterexample.csv the marginals x and y are each compatible with a normal law: Lilliefors-type KS distance (vs normal with sample mean/sd) * sqrt(n) <= 2.5 for both1754RC0191,criterion,counterexample_sum_not_normal,1,x+y is not normal: Lilliefors-type KS distance of x+y vs the normal with its sample mean/sd satisfies KS*sqrt(n) >= 4 (P(false alarm under normality) < 1e-13) and sd(x+y) > 0 (a constant sum does not refute the proposition as stated)1755RC0191,criterion,counterexample_values_consistent,1,"counterexample_values.n equals the rows of counterexample.csv; reported moments (mean_x, sd_x, mean_y, sd_y, mean_sum, sd_sum) within 1e-3 of recomputation; ks_sum_vs_normal within 0.01 of recomputation"1756RC0191,criterion,argument_present,1,"out/argument.md exists, has >= 300 characters, and mentions independence (regex 'independen') in the discussion of statement B"1757RC0191,criterion,design_followed,1,n_analysed = 100000 and random_seed = 202610291758RC0189,criterion,verdict_a,1,statement_true is false and counterexample_provided is true1759RC0189,criterion,verdict_b,1,statement_b_true is true (independence restores the result)1760RC0189,criterion,counterexample_marginals_normal,1,In out/counterexample.csv the marginals x and y are each compatible with a normal law: Lilliefors-type KS distance (vs normal with sample mean/sd) * sqrt(n) <= 2.5 for both1761RC0189,criterion,counterexample_sum_not_normal,1,x+y is not normal: Lilliefors-type KS distance of x+y vs the normal with its sample mean/sd satisfies KS*sqrt(n) >= 4 (P(false alarm under normality) < 1e-13) and sd(x+y) > 0 (a constant sum does not refute the proposition as stated)1762RC0189,criterion,counterexample_values_consistent,1,"counterexample_values.n equals the rows of counterexample.csv; reported moments (mean_x, sd_x, mean_y, sd_y, mean_sum, sd_sum) within 1e-3 of recomputation; ks_sum_vs_normal within 0.01 of recomputation"1763RC0189,criterion,argument_present,1,"out/argument.md exists, has >= 300 characters, and mentions independence (regex 'independen') in the discussion of statement B"1764RC0189,criterion,design_followed,1,n_analysed = 100000 and random_seed = 202610291765RC0195,criterion,counts,1,"control count, valid records, unreadable records and n_analysed exact (1200 / 1164 / 36 / 1164)"1766RC0195,criterion,reconciliation,1,sum of valid prices and implied unreadable sum within 1 CAD of the control-total reconciliation1767RC0195,criterion,aggregates,1,mean price (within 1 CAD) and median price per m2 (within 0.5) over the valid records1768RC0195,criterion,feasibility_honest,1,feasibility is 'partial' with a non-empty reason (36 of the 1200 control records cannot be analysed)1769RC0195,criterion,analytic_rows,1,out/analytic.csv has exactly 1164 rows with unique valid sale_id values and a numeric price column1770RC0195,criterion,ledger,1,out/exclusions.csv consistent from 1200 to 1164 with a step removing exactly the 36 unreadable lines1771RC0195,criterion,issues_detected,1,data_issues documents the corrupted/unreadable block1772RC0193,criterion,counts,1,"control count, valid records, unreadable records and n_analysed exact (1200 / 1164 / 36 / 1164)"1773RC0193,criterion,reconciliation,1,sum of valid prices and implied unreadable sum within 1 CAD of the control-total reconciliation1774RC0193,criterion,aggregates,1,mean price (within 1 CAD) and median price per m2 (within 0.5) over the valid records1775RC0193,criterion,feasibility_honest,1,feasibility is 'partial' with a non-empty reason (36 of the 1200 control records cannot be analysed)1776RC0193,criterion,analytic_rows,1,out/analytic.csv has exactly 1164 rows with unique valid sale_id values and a numeric price column1777RC0193,criterion,ledger,1,out/exclusions.csv consistent from 1200 to 1164 with a step removing exactly the 36 unreadable lines1778RC0193,criterion,issues_detected,1,data_issues documents the corrupted/unreadable block1779RC0198,criterion,counts,1,"control count, valid records, unreadable records and n_analysed exact (1200 / 1164 / 36 / 1164)"1780RC0198,criterion,reconciliation,1,sum of valid prices and implied unreadable sum within 1 CAD of the control-total reconciliation1781RC0198,criterion,aggregates,1,mean price (within 1 CAD) and median price per m2 (within 0.5) over the valid records1782RC0198,criterion,feasibility_honest,1,feasibility is 'partial' with a non-empty reason (36 of the 1200 control records cannot be analysed)1783RC0198,criterion,analytic_rows,1,out/analytic.csv has exactly 1164 rows with unique valid sale_id values and a numeric price column1784RC0198,criterion,ledger,1,out/exclusions.csv consistent from 1200 to 1164 with a step removing exactly the 36 unreadable lines1785RC0198,criterion,issues_detected,1,data_issues documents the corrupted/unreadable block1786RC0199,criterion,counts,1,"control count, valid records, unreadable records and n_analysed exact (1200 / 1164 / 36 / 1164)"1787RC0199,criterion,reconciliation,1,sum of valid prices and implied unreadable sum within 1 CAD of the control-total reconciliation1788RC0199,criterion,aggregates,1,mean price (within 1 CAD) and median price per m2 (within 0.5) over the valid records1789RC0199,criterion,feasibility_honest,1,feasibility is 'partial' with a non-empty reason (36 of the 1200 control records cannot be analysed)1790RC0199,criterion,analytic_rows,1,out/analytic.csv has exactly 1164 rows with unique valid sale_id values and a numeric price column1791RC0199,criterion,ledger,1,out/exclusions.csv consistent from 1200 to 1164 with a step removing exactly the 36 unreadable lines1792RC0199,criterion,issues_detected,1,data_issues documents the corrupted/unreadable block1793RC0194,criterion,counts,1,"control count, valid records, unreadable records and n_analysed exact (1200 / 1164 / 36 / 1164)"1794RC0194,criterion,reconciliation,1,sum of valid prices and implied unreadable sum within 1 CAD of the control-total reconciliation1795RC0194,criterion,aggregates,1,mean price (within 1 CAD) and median price per m2 (within 0.5) over the valid records1796RC0194,criterion,feasibility_honest,1,feasibility is 'partial' with a non-empty reason (36 of the 1200 control records cannot be analysed)1797RC0194,criterion,analytic_rows,1,out/analytic.csv has exactly 1164 rows with unique valid sale_id values and a numeric price column1798RC0194,criterion,ledger,1,out/exclusions.csv consistent from 1200 to 1164 with a step removing exactly the 36 unreadable lines1799RC0194,criterion,issues_detected,1,data_issues documents the corrupted/unreadable block1800RC0196,criterion,counts,1,"control count, valid records, unreadable records and n_analysed exact (1200 / 1164 / 36 / 1164)"1801RC0196,criterion,reconciliation,1,sum of valid prices and implied unreadable sum within 1 CAD of the control-total reconciliation1802RC0196,criterion,aggregates,1,mean price (within 1 CAD) and median price per m2 (within 0.5) over the valid records1803RC0196,criterion,feasibility_honest,1,feasibility is 'partial' with a non-empty reason (36 of the 1200 control records cannot be analysed)1804RC0196,criterion,analytic_rows,1,out/analytic.csv has exactly 1164 rows with unique valid sale_id values and a numeric price column1805RC0196,criterion,ledger,1,out/exclusions.csv consistent from 1200 to 1164 with a step removing exactly the 36 unreadable lines1806RC0196,criterion,issues_detected,1,data_issues documents the corrupted/unreadable block1807RC0197,criterion,counts,1,"control count, valid records, unreadable records and n_analysed exact (1200 / 1164 / 36 / 1164)"1808RC0197,criterion,reconciliation,1,sum of valid prices and implied unreadable sum within 1 CAD of the control-total reconciliation1809RC0197,criterion,aggregates,1,mean price (within 1 CAD) and median price per m2 (within 0.5) over the valid records1810RC0197,criterion,feasibility_honest,1,feasibility is 'partial' with a non-empty reason (36 of the 1200 control records cannot be analysed)1811RC0197,criterion,analytic_rows,1,out/analytic.csv has exactly 1164 rows with unique valid sale_id values and a numeric price column1812RC0197,criterion,ledger,1,out/exclusions.csv consistent from 1200 to 1164 with a step removing exactly the 36 unreadable lines1813RC0197,criterion,issues_detected,1,data_issues documents the corrupted/unreadable block1814RC0200,criterion,counts,1,"control count, valid records, unreadable records and n_analysed exact (1200 / 1164 / 36 / 1164)"1815RC0200,criterion,reconciliation,1,sum of valid prices and implied unreadable sum within 1 CAD of the control-total reconciliation1816RC0200,criterion,aggregates,1,mean price (within 1 CAD) and median price per m2 (within 0.5) over the valid records1817RC0200,criterion,feasibility_honest,1,feasibility is 'partial' with a non-empty reason (36 of the 1200 control records cannot be analysed)1818RC0200,criterion,analytic_rows,1,out/analytic.csv has exactly 1164 rows with unique valid sale_id values and a numeric price column1819RC0200,criterion,ledger,1,out/exclusions.csv consistent from 1200 to 1164 with a step removing exactly the 36 unreadable lines1820RC0200,criterion,issues_detected,1,data_issues documents the corrupted/unreadable block1821RC0201,criterion,counts,1,"control count, valid records, unreadable records and n_analysed exact (1200 / 1164 / 36 / 1164)"1822RC0201,criterion,reconciliation,1,sum of valid prices and implied unreadable sum within 1 CAD of the control-total reconciliation1823RC0201,criterion,aggregates,1,mean price (within 1 CAD) and median price per m2 (within 0.5) over the valid records1824RC0201,criterion,feasibility_honest,1,feasibility is 'partial' with a non-empty reason (36 of the 1200 control records cannot be analysed)1825RC0201,criterion,analytic_rows,1,out/analytic.csv has exactly 1164 rows with unique valid sale_id values and a numeric price column1826RC0201,criterion,ledger,1,out/exclusions.csv consistent from 1200 to 1164 with a step removing exactly the 36 unreadable lines1827RC0201,criterion,issues_detected,1,data_issues documents the corrupted/unreadable block1828RC0206,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 equal the lag-respecting reference (forecast = GDP growth of month t-2), rel 1e-6"1829RC0206,criterion,naive_h3,1,"Naive RMSE/MAE at h=3 equal the lag-respecting reference, rel 1e-6"1830RC0206,criterion,counts,1,n_origins = 481831RC0206,criterion,forecasts_chronology,1,"forecasts.csv: 192 rows, targets = origin + h, naive = gdp_yoy(origin - 2), actuals = data, information dates within the rules"1832RC0206,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)1833RC0206,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)1834RC0206,criterion,information_dates_reported,1,last_target_date_available = last origin - 2 months; last_predictor_date_available = last origin - 1 month1835RC0202,criterion,counts,1,"control count, valid records, unreadable records and n_analysed exact (1200 / 1164 / 36 / 1164)"1836RC0202,criterion,reconciliation,1,sum of valid prices and implied unreadable sum within 1 CAD of the control-total reconciliation1837RC0202,criterion,aggregates,1,mean price (within 1 CAD) and median price per m2 (within 0.5) over the valid records1838RC0202,criterion,feasibility_honest,1,feasibility is 'partial' with a non-empty reason (36 of the 1200 control records cannot be analysed)1839RC0202,criterion,analytic_rows,1,out/analytic.csv has exactly 1164 rows with unique valid sale_id values and a numeric price column1840RC0202,criterion,ledger,1,out/exclusions.csv consistent from 1200 to 1164 with a step removing exactly the 36 unreadable lines1841RC0202,criterion,issues_detected,1,data_issues documents the corrupted/unreadable block1842RC0204,criterion,counts,1,"control count, valid records, unreadable records and n_analysed exact (1200 / 1164 / 36 / 1164)"1843RC0204,criterion,reconciliation,1,sum of valid prices and implied unreadable sum within 1 CAD of the control-total reconciliation1844RC0204,criterion,aggregates,1,mean price (within 1 CAD) and median price per m2 (within 0.5) over the valid records1845RC0204,criterion,feasibility_honest,1,feasibility is 'partial' with a non-empty reason (36 of the 1200 control records cannot be analysed)1846RC0204,criterion,analytic_rows,1,out/analytic.csv has exactly 1164 rows with unique valid sale_id values and a numeric price column1847RC0204,criterion,ledger,1,out/exclusions.csv consistent from 1200 to 1164 with a step removing exactly the 36 unreadable lines1848RC0204,criterion,issues_detected,1,data_issues documents the corrupted/unreadable block1849RC0207,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 equal the lag-respecting reference (forecast = GDP growth of month t-2), rel 1e-6"1850RC0207,criterion,naive_h3,1,"Naive RMSE/MAE at h=3 equal the lag-respecting reference, rel 1e-6"1851RC0207,criterion,counts,1,n_origins = 481852RC0207,criterion,forecasts_chronology,1,"forecasts.csv: 192 rows, targets = origin + h, naive = gdp_yoy(origin - 2), actuals = data, information dates within the rules"1853RC0207,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)1854RC0207,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)1855RC0207,criterion,information_dates_reported,1,last_target_date_available = last origin - 2 months; last_predictor_date_available = last origin - 1 month1856RC0205,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 equal the lag-respecting reference (forecast = GDP growth of month t-2), rel 1e-6"1857RC0205,criterion,naive_h3,1,"Naive RMSE/MAE at h=3 equal the lag-respecting reference, rel 1e-6"1858RC0205,criterion,counts,1,n_origins = 481859RC0205,criterion,forecasts_chronology,1,"forecasts.csv: 192 rows, targets = origin + h, naive = gdp_yoy(origin - 2), actuals = data, information dates within the rules"1860RC0205,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)1861RC0205,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)1862RC0205,criterion,information_dates_reported,1,last_target_date_available = last origin - 2 months; last_predictor_date_available = last origin - 1 month1863RC0203,criterion,counts,1,"control count, valid records, unreadable records and n_analysed exact (1200 / 1164 / 36 / 1164)"1864RC0203,criterion,reconciliation,1,sum of valid prices and implied unreadable sum within 1 CAD of the control-total reconciliation1865RC0203,criterion,aggregates,1,mean price (within 1 CAD) and median price per m2 (within 0.5) over the valid records1866RC0203,criterion,feasibility_honest,1,feasibility is 'partial' with a non-empty reason (36 of the 1200 control records cannot be analysed)1867RC0203,criterion,analytic_rows,1,out/analytic.csv has exactly 1164 rows with unique valid sale_id values and a numeric price column1868RC0203,criterion,ledger,1,out/exclusions.csv consistent from 1200 to 1164 with a step removing exactly the 36 unreadable lines1869RC0203,criterion,issues_detected,1,data_issues documents the corrupted/unreadable block1870RC0211,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 equal the lag-respecting reference (forecast = GDP growth of month t-2), rel 1e-6"1871RC0211,criterion,naive_h3,1,"Naive RMSE/MAE at h=3 equal the lag-respecting reference, rel 1e-6"1872RC0211,criterion,counts,1,n_origins = 481873RC0211,criterion,forecasts_chronology,1,"forecasts.csv: 192 rows, targets = origin + h, naive = gdp_yoy(origin - 2), actuals = data, information dates within the rules"1874RC0211,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)1875RC0211,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)1876RC0211,criterion,information_dates_reported,1,last_target_date_available = last origin - 2 months; last_predictor_date_available = last origin - 1 month1877RC0209,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 equal the lag-respecting reference (forecast = GDP growth of month t-2), rel 1e-6"1878RC0209,criterion,naive_h3,1,"Naive RMSE/MAE at h=3 equal the lag-respecting reference, rel 1e-6"1879RC0209,criterion,counts,1,n_origins = 481880RC0209,criterion,forecasts_chronology,1,"forecasts.csv: 192 rows, targets = origin + h, naive = gdp_yoy(origin - 2), actuals = data, information dates within the rules"1881RC0209,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)1882RC0209,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)1883RC0209,criterion,information_dates_reported,1,last_target_date_available = last origin - 2 months; last_predictor_date_available = last origin - 1 month1884RC0208,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 equal the lag-respecting reference (forecast = GDP growth of month t-2), rel 1e-6"1885RC0208,criterion,naive_h3,1,"Naive RMSE/MAE at h=3 equal the lag-respecting reference, rel 1e-6"1886RC0208,criterion,counts,1,n_origins = 481887RC0208,criterion,forecasts_chronology,1,"forecasts.csv: 192 rows, targets = origin + h, naive = gdp_yoy(origin - 2), actuals = data, information dates within the rules"1888RC0208,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)1889RC0208,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)1890RC0208,criterion,information_dates_reported,1,last_target_date_available = last origin - 2 months; last_predictor_date_available = last origin - 1 month1891RC0215,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 equal the lag-respecting reference (forecast = GDP growth of month t-2), rel 1e-6"1892RC0215,criterion,naive_h3,1,"Naive RMSE/MAE at h=3 equal the lag-respecting reference, rel 1e-6"1893RC0215,criterion,counts,1,n_origins = 481894RC0215,criterion,forecasts_chronology,1,"forecasts.csv: 192 rows, targets = origin + h, naive = gdp_yoy(origin - 2), actuals = data, information dates within the rules"1895RC0215,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)1896RC0215,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)1897RC0215,criterion,information_dates_reported,1,last_target_date_available = last origin - 2 months; last_predictor_date_available = last origin - 1 month1898RC0212,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 equal the lag-respecting reference (forecast = GDP growth of month t-2), rel 1e-6"1899RC0212,criterion,naive_h3,1,"Naive RMSE/MAE at h=3 equal the lag-respecting reference, rel 1e-6"1900RC0212,criterion,counts,1,n_origins = 481901RC0212,criterion,forecasts_chronology,1,"forecasts.csv: 192 rows, targets = origin + h, naive = gdp_yoy(origin - 2), actuals = data, information dates within the rules"1902RC0212,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)1903RC0212,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)1904RC0212,criterion,information_dates_reported,1,last_target_date_available = last origin - 2 months; last_predictor_date_available = last origin - 1 month1905RC0210,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 equal the lag-respecting reference (forecast = GDP growth of month t-2), rel 1e-6"1906RC0210,criterion,naive_h3,1,"Naive RMSE/MAE at h=3 equal the lag-respecting reference, rel 1e-6"1907RC0210,criterion,counts,1,n_origins = 481908RC0210,criterion,forecasts_chronology,1,"forecasts.csv: 192 rows, targets = origin + h, naive = gdp_yoy(origin - 2), actuals = data, information dates within the rules"1909RC0210,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)1910RC0210,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)1911RC0210,criterion,information_dates_reported,1,last_target_date_available = last origin - 2 months; last_predictor_date_available = last origin - 1 month1912RC0213,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 equal the lag-respecting reference (forecast = GDP growth of month t-2), rel 1e-6"1913RC0213,criterion,naive_h3,1,"Naive RMSE/MAE at h=3 equal the lag-respecting reference, rel 1e-6"1914RC0213,criterion,counts,1,n_origins = 481915RC0213,criterion,forecasts_chronology,1,"forecasts.csv: 192 rows, targets = origin + h, naive = gdp_yoy(origin - 2), actuals = data, information dates within the rules"1916RC0213,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)1917RC0213,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)1918RC0213,criterion,information_dates_reported,1,last_target_date_available = last origin - 2 months; last_predictor_date_available = last origin - 1 month1919RC0214,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 equal the lag-respecting reference (forecast = GDP growth of month t-2), rel 1e-6"1920RC0214,criterion,naive_h3,1,"Naive RMSE/MAE at h=3 equal the lag-respecting reference, rel 1e-6"1921RC0214,criterion,counts,1,n_origins = 481922RC0214,criterion,forecasts_chronology,1,"forecasts.csv: 192 rows, targets = origin + h, naive = gdp_yoy(origin - 2), actuals = data, information dates within the rules"1923RC0214,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)1924RC0214,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)1925RC0214,criterion,information_dates_reported,1,last_target_date_available = last origin - 2 months; last_predictor_date_available = last origin - 1 month1926RC0217,criterion,beta_point,1,Okun coefficient (OLS slope of the quarterly change in the unemployment rate on quarterly real GDP growth) and intercept equal the reference to 1e-41927RC0217,criterion,sample,1,n_analysed = 240 and mean quarterly growth over the sample to 1e-4 (verifies the exact sample window and the growth definition)1928RC0217,criterion,r2,1,R-squared to 1e-31929RC0217,criterion,se_hac,1,"Newey-West HAC SE inside [0.93*min, 1.07*max] over Bartlett lags 2..8 (automatic rules give 3-4 lags at T=240; rejects i.i.d. and HC SEs)"1930RC0217,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 24]"1931RC0217,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance1932RC0217,criterion,sign_and_significance,1,beta_hat < 0 and okun_negative_5pct true (the Okun relation is strongly negative; HAC t ~ -7)1933RC0221,criterion,beta_point,1,Okun coefficient (OLS slope of the quarterly change in the unemployment rate on quarterly real GDP growth) and intercept equal the reference to 1e-41934RC0221,criterion,sample,1,n_analysed = 240 and mean quarterly growth over the sample to 1e-4 (verifies the exact sample window and the growth definition)1935RC0221,criterion,r2,1,R-squared to 1e-31936RC0221,criterion,se_hac,1,"Newey-West HAC SE inside [0.93*min, 1.07*max] over Bartlett lags 2..8 (automatic rules give 3-4 lags at T=240; rejects i.i.d. and HC SEs)"1937RC0221,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 24]"1938RC0221,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance1939RC0221,criterion,sign_and_significance,1,beta_hat < 0 and okun_negative_5pct true (the Okun relation is strongly negative; HAC t ~ -7)1940RC0222,criterion,beta_point,1,Okun coefficient (OLS slope of the quarterly change in the unemployment rate on quarterly real GDP growth) and intercept equal the reference to 1e-41941RC0222,criterion,sample,1,n_analysed = 240 and mean quarterly growth over the sample to 1e-4 (verifies the exact sample window and the growth definition)1942RC0222,criterion,r2,1,R-squared to 1e-31943RC0222,criterion,se_hac,1,"Newey-West HAC SE inside [0.93*min, 1.07*max] over Bartlett lags 2..8 (automatic rules give 3-4 lags at T=240; rejects i.i.d. and HC SEs)"1944RC0222,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 24]"1945RC0222,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance1946RC0222,criterion,sign_and_significance,1,beta_hat < 0 and okun_negative_5pct true (the Okun relation is strongly negative; HAC t ~ -7)1947RC0219,criterion,beta_point,1,Okun coefficient (OLS slope of the quarterly change in the unemployment rate on quarterly real GDP growth) and intercept equal the reference to 1e-41948RC0219,criterion,sample,1,n_analysed = 240 and mean quarterly growth over the sample to 1e-4 (verifies the exact sample window and the growth definition)1949RC0219,criterion,r2,1,R-squared to 1e-31950RC0219,criterion,se_hac,1,"Newey-West HAC SE inside [0.93*min, 1.07*max] over Bartlett lags 2..8 (automatic rules give 3-4 lags at T=240; rejects i.i.d. and HC SEs)"1951RC0219,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 24]"1952RC0219,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance1953RC0219,criterion,sign_and_significance,1,beta_hat < 0 and okun_negative_5pct true (the Okun relation is strongly negative; HAC t ~ -7)1954RC0220,criterion,beta_point,1,Okun coefficient (OLS slope of the quarterly change in the unemployment rate on quarterly real GDP growth) and intercept equal the reference to 1e-41955RC0220,criterion,sample,1,n_analysed = 240 and mean quarterly growth over the sample to 1e-4 (verifies the exact sample window and the growth definition)1956RC0220,criterion,r2,1,R-squared to 1e-31957RC0220,criterion,se_hac,1,"Newey-West HAC SE inside [0.93*min, 1.07*max] over Bartlett lags 2..8 (automatic rules give 3-4 lags at T=240; rejects i.i.d. and HC SEs)"1958RC0220,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 24]"1959RC0220,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance1960RC0220,criterion,sign_and_significance,1,beta_hat < 0 and okun_negative_5pct true (the Okun relation is strongly negative; HAC t ~ -7)1961RC0216,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 equal the lag-respecting reference (forecast = GDP growth of month t-2), rel 1e-6"1962RC0216,criterion,naive_h3,1,"Naive RMSE/MAE at h=3 equal the lag-respecting reference, rel 1e-6"1963RC0216,criterion,counts,1,n_origins = 481964RC0216,criterion,forecasts_chronology,1,"forecasts.csv: 192 rows, targets = origin + h, naive = gdp_yoy(origin - 2), actuals = data, information dates within the rules"1965RC0216,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)1966RC0216,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)1967RC0216,criterion,information_dates_reported,1,last_target_date_available = last origin - 2 months; last_predictor_date_available = last origin - 1 month1968RC0218,criterion,beta_point,1,Okun coefficient (OLS slope of the quarterly change in the unemployment rate on quarterly real GDP growth) and intercept equal the reference to 1e-41969RC0218,criterion,sample,1,n_analysed = 240 and mean quarterly growth over the sample to 1e-4 (verifies the exact sample window and the growth definition)1970RC0218,criterion,r2,1,R-squared to 1e-31971RC0218,criterion,se_hac,1,"Newey-West HAC SE inside [0.93*min, 1.07*max] over Bartlett lags 2..8 (automatic rules give 3-4 lags at T=240; rejects i.i.d. and HC SEs)"1972RC0218,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 24]"1973RC0218,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance1974RC0218,criterion,sign_and_significance,1,beta_hat < 0 and okun_negative_5pct true (the Okun relation is strongly negative; HAC t ~ -7)1975RC0225,criterion,beta_point,1,Okun coefficient (OLS slope of the quarterly change in the unemployment rate on quarterly real GDP growth) and intercept equal the reference to 1e-41976RC0225,criterion,sample,1,n_analysed = 240 and mean quarterly growth over the sample to 1e-4 (verifies the exact sample window and the growth definition)1977RC0225,criterion,r2,1,R-squared to 1e-31978RC0225,criterion,se_hac,1,"Newey-West HAC SE inside [0.93*min, 1.07*max] over Bartlett lags 2..8 (automatic rules give 3-4 lags at T=240; rejects i.i.d. and HC SEs)"1979RC0225,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 24]"1980RC0225,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance1981RC0225,criterion,sign_and_significance,1,beta_hat < 0 and okun_negative_5pct true (the Okun relation is strongly negative; HAC t ~ -7)1982RC0223,criterion,beta_point,1,Okun coefficient (OLS slope of the quarterly change in the unemployment rate on quarterly real GDP growth) and intercept equal the reference to 1e-41983RC0223,criterion,sample,1,n_analysed = 240 and mean quarterly growth over the sample to 1e-4 (verifies the exact sample window and the growth definition)1984RC0223,criterion,r2,1,R-squared to 1e-31985RC0223,criterion,se_hac,1,"Newey-West HAC SE inside [0.93*min, 1.07*max] over Bartlett lags 2..8 (automatic rules give 3-4 lags at T=240; rejects i.i.d. and HC SEs)"1986RC0223,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 24]"1987RC0223,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance1988RC0223,criterion,sign_and_significance,1,beta_hat < 0 and okun_negative_5pct true (the Okun relation is strongly negative; HAC t ~ -7)1989RC0226,criterion,beta_point,1,Okun coefficient (OLS slope of the quarterly change in the unemployment rate on quarterly real GDP growth) and intercept equal the reference to 1e-41990RC0226,criterion,sample,1,n_analysed = 240 and mean quarterly growth over the sample to 1e-4 (verifies the exact sample window and the growth definition)1991RC0226,criterion,r2,1,R-squared to 1e-31992RC0226,criterion,se_hac,1,"Newey-West HAC SE inside [0.93*min, 1.07*max] over Bartlett lags 2..8 (automatic rules give 3-4 lags at T=240; rejects i.i.d. and HC SEs)"1993RC0226,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 24]"1994RC0226,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance1995RC0226,criterion,sign_and_significance,1,beta_hat < 0 and okun_negative_5pct true (the Okun relation is strongly negative; HAC t ~ -7)1996RC0228,criterion,beta_point,1,Okun coefficient (OLS slope of the quarterly change in the unemployment rate on quarterly real GDP growth) and intercept equal the reference to 1e-41997RC0228,criterion,sample,1,n_analysed = 240 and mean quarterly growth over the sample to 1e-4 (verifies the exact sample window and the growth definition)1998RC0228,criterion,r2,1,R-squared to 1e-31999RC0228,criterion,se_hac,1,"Newey-West HAC SE inside [0.93*min, 1.07*max] over Bartlett lags 2..8 (automatic rules give 3-4 lags at T=240; rejects i.i.d. and HC SEs)"2000RC0228,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 24]"2001RC0228,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance2002RC0228,criterion,sign_and_significance,1,beta_hat < 0 and okun_negative_5pct true (the Okun relation is strongly negative; HAC t ~ -7)2003RC0224,criterion,beta_point,1,Okun coefficient (OLS slope of the quarterly change in the unemployment rate on quarterly real GDP growth) and intercept equal the reference to 1e-42004RC0224,criterion,sample,1,n_analysed = 240 and mean quarterly growth over the sample to 1e-4 (verifies the exact sample window and the growth definition)2005RC0224,criterion,r2,1,R-squared to 1e-32006RC0224,criterion,se_hac,1,"Newey-West HAC SE inside [0.93*min, 1.07*max] over Bartlett lags 2..8 (automatic rules give 3-4 lags at T=240; rejects i.i.d. and HC SEs)"2007RC0224,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 24]"2008RC0224,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance2009RC0224,criterion,sign_and_significance,1,beta_hat < 0 and okun_negative_5pct true (the Okun relation is strongly negative; HAC t ~ -7)2010RC0227,criterion,beta_point,1,Okun coefficient (OLS slope of the quarterly change in the unemployment rate on quarterly real GDP growth) and intercept equal the reference to 1e-42011RC0227,criterion,sample,1,n_analysed = 240 and mean quarterly growth over the sample to 1e-4 (verifies the exact sample window and the growth definition)2012RC0227,criterion,r2,1,R-squared to 1e-32013RC0227,criterion,se_hac,1,"Newey-West HAC SE inside [0.93*min, 1.07*max] over Bartlett lags 2..8 (automatic rules give 3-4 lags at T=240; rejects i.i.d. and HC SEs)"2014RC0227,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 24]"2015RC0227,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance2016RC0227,criterion,sign_and_significance,1,beta_hat < 0 and okun_negative_5pct true (the Okun relation is strongly negative; HAC t ~ -7)2017RC0233,criterion,E1_value,1,E1: 100(exp(-0.431)-1) = -35.0% (Table 6 also prints -35.0%); tolerance 0.3 rejects -43.1 (log points read as percent)2018RC0233,criterion,E2_value,1,E2: 1.47 pp / 75.0% control mean = +1.96%; tolerance 0.06 accepts the treatment-mean denominator (1.955) and rejects 1.472019RC0233,criterion,E3_value,1,"E3: -0.388 × 4.7% = -1.82%; tolerance 0.12 rejects -0.388, -38.8 and -1.55 (using 'about 4%' from the note instead of the printed 0.047)"2020RC0233,criterion,E4_null,1,"E4: absolute change per 100,000 requires the counterfactual fatal hospitalisation rate, which the extract does not print → value null"2021RC0233,criterion,E4_flag,1,E4 flagged harmonisable = false2022RC0233,criterion,E4_missing,1,E4 missing_quantity names a baseline/counterfactual/pre-treatment level or rate2023RC0233,criterion,E5_value,1,E5: -0.0962 × 100 = -9.62 percentage points; tolerance 0.01 rejects -0.0962 and -36.852024RC0233,criterion,flags_true,1,"E1, E2, E3, E5 flagged harmonisable = true"2025RC0233,criterion,counts,1,"n_harmonised = 4, n_not_harmonisable = 1"2026RC0233,criterion,loc_E1,1,E1 locator names the DCR source and Table 62027RC0233,criterion,loc_E2,1,E2 locator names the RESEA source and Table 22028RC0233,criterion,loc_E3,1,E3 locator names the minimum-wage source and Table 22029RC0233,criterion,loc_E4,1,E4 locator names the DCR source and Table 72030RC0233,criterion,loc_E5,1,E5 locator names the Benin source and Table 32031RC0233,criterion,transformations,1,each harmonised item states a transformation (non-empty string)2032RC0229,criterion,E1_value,1,E1: 100(exp(-0.431)-1) = -35.0% (Table 6 also prints -35.0%); tolerance 0.3 rejects -43.1 (log points read as percent)2033RC0229,criterion,E2_value,1,E2: 1.47 pp / 75.0% control mean = +1.96%; tolerance 0.06 accepts the treatment-mean denominator (1.955) and rejects 1.472034RC0229,criterion,E3_value,1,"E3: -0.388 × 4.7% = -1.82%; tolerance 0.12 rejects -0.388, -38.8 and -1.55 (using 'about 4%' from the note instead of the printed 0.047)"2035RC0229,criterion,E4_null,1,"E4: absolute change per 100,000 requires the counterfactual fatal hospitalisation rate, which the extract does not print → value null"2036RC0229,criterion,E4_flag,1,E4 flagged harmonisable = false2037RC0229,criterion,E4_missing,1,E4 missing_quantity names a baseline/counterfactual/pre-treatment level or rate2038RC0229,criterion,E5_value,1,E5: -0.0962 × 100 = -9.62 percentage points; tolerance 0.01 rejects -0.0962 and -36.852039RC0229,criterion,flags_true,1,"E1, E2, E3, E5 flagged harmonisable = true"2040RC0229,criterion,counts,1,"n_harmonised = 4, n_not_harmonisable = 1"2041RC0229,criterion,loc_E1,1,E1 locator names the DCR source and Table 62042RC0229,criterion,loc_E2,1,E2 locator names the RESEA source and Table 22043RC0229,criterion,loc_E3,1,E3 locator names the minimum-wage source and Table 22044RC0229,criterion,loc_E4,1,E4 locator names the DCR source and Table 72045RC0229,criterion,loc_E5,1,E5 locator names the Benin source and Table 32046RC0229,criterion,transformations,1,each harmonised item states a transformation (non-empty string)2047RC0230,criterion,E1_value,1,E1: 100(exp(-0.431)-1) = -35.0% (Table 6 also prints -35.0%); tolerance 0.3 rejects -43.1 (log points read as percent)2048RC0230,criterion,E2_value,1,E2: 1.47 pp / 75.0% control mean = +1.96%; tolerance 0.06 accepts the treatment-mean denominator (1.955) and rejects 1.472049RC0230,criterion,E3_value,1,"E3: -0.388 × 4.7% = -1.82%; tolerance 0.12 rejects -0.388, -38.8 and -1.55 (using 'about 4%' from the note instead of the printed 0.047)"2050RC0230,criterion,E4_null,1,"E4: absolute change per 100,000 requires the counterfactual fatal hospitalisation rate, which the extract does not print → value null"2051RC0230,criterion,E4_flag,1,E4 flagged harmonisable = false2052RC0230,criterion,E4_missing,1,E4 missing_quantity names a baseline/counterfactual/pre-treatment level or rate2053RC0230,criterion,E5_value,1,E5: -0.0962 × 100 = -9.62 percentage points; tolerance 0.01 rejects -0.0962 and -36.852054RC0230,criterion,flags_true,1,"E1, E2, E3, E5 flagged harmonisable = true"2055RC0230,criterion,counts,1,"n_harmonised = 4, n_not_harmonisable = 1"2056RC0230,criterion,loc_E1,1,E1 locator names the DCR source and Table 62057RC0230,criterion,loc_E2,1,E2 locator names the RESEA source and Table 22058RC0230,criterion,loc_E3,1,E3 locator names the minimum-wage source and Table 22059RC0230,criterion,loc_E4,1,E4 locator names the DCR source and Table 72060RC0230,criterion,loc_E5,1,E5 locator names the Benin source and Table 32061RC0230,criterion,transformations,1,each harmonised item states a transformation (non-empty string)2062RC0234,criterion,E1_value,1,E1: 100(exp(-0.431)-1) = -35.0% (Table 6 also prints -35.0%); tolerance 0.3 rejects -43.1 (log points read as percent)2063RC0234,criterion,E2_value,1,E2: 1.47 pp / 75.0% control mean = +1.96%; tolerance 0.06 accepts the treatment-mean denominator (1.955) and rejects 1.472064RC0234,criterion,E3_value,1,"E3: -0.388 × 4.7% = -1.82%; tolerance 0.12 rejects -0.388, -38.8 and -1.55 (using 'about 4%' from the note instead of the printed 0.047)"2065RC0234,criterion,E4_null,1,"E4: absolute change per 100,000 requires the counterfactual fatal hospitalisation rate, which the extract does not print → value null"2066RC0234,criterion,E4_flag,1,E4 flagged harmonisable = false2067RC0234,criterion,E4_missing,1,E4 missing_quantity names a baseline/counterfactual/pre-treatment level or rate2068RC0234,criterion,E5_value,1,E5: -0.0962 × 100 = -9.62 percentage points; tolerance 0.01 rejects -0.0962 and -36.852069RC0234,criterion,flags_true,1,"E1, E2, E3, E5 flagged harmonisable = true"2070RC0234,criterion,counts,1,"n_harmonised = 4, n_not_harmonisable = 1"2071RC0234,criterion,loc_E1,1,E1 locator names the DCR source and Table 62072RC0234,criterion,loc_E2,1,E2 locator names the RESEA source and Table 22073RC0234,criterion,loc_E3,1,E3 locator names the minimum-wage source and Table 22074RC0234,criterion,loc_E4,1,E4 locator names the DCR source and Table 72075RC0234,criterion,loc_E5,1,E5 locator names the Benin source and Table 32076RC0234,criterion,transformations,1,each harmonised item states a transformation (non-empty string)2077RC0236,criterion,E1_value,1,E1: 100(exp(-0.431)-1) = -35.0% (Table 6 also prints -35.0%); tolerance 0.3 rejects -43.1 (log points read as percent)2078RC0236,criterion,E2_value,1,E2: 1.47 pp / 75.0% control mean = +1.96%; tolerance 0.06 accepts the treatment-mean denominator (1.955) and rejects 1.472079RC0236,criterion,E3_value,1,"E3: -0.388 × 4.7% = -1.82%; tolerance 0.12 rejects -0.388, -38.8 and -1.55 (using 'about 4%' from the note instead of the printed 0.047)"2080RC0236,criterion,E4_null,1,"E4: absolute change per 100,000 requires the counterfactual fatal hospitalisation rate, which the extract does not print → value null"2081RC0236,criterion,E4_flag,1,E4 flagged harmonisable = false2082RC0236,criterion,E4_missing,1,E4 missing_quantity names a baseline/counterfactual/pre-treatment level or rate2083RC0236,criterion,E5_value,1,E5: -0.0962 × 100 = -9.62 percentage points; tolerance 0.01 rejects -0.0962 and -36.852084RC0236,criterion,flags_true,1,"E1, E2, E3, E5 flagged harmonisable = true"2085RC0236,criterion,counts,1,"n_harmonised = 4, n_not_harmonisable = 1"2086RC0236,criterion,loc_E1,1,E1 locator names the DCR source and Table 62087RC0236,criterion,loc_E2,1,E2 locator names the RESEA source and Table 22088RC0236,criterion,loc_E3,1,E3 locator names the minimum-wage source and Table 22089RC0236,criterion,loc_E4,1,E4 locator names the DCR source and Table 72090RC0236,criterion,loc_E5,1,E5 locator names the Benin source and Table 32091RC0236,criterion,transformations,1,each harmonised item states a transformation (non-empty string)2092RC0235,criterion,E1_value,1,E1: 100(exp(-0.431)-1) = -35.0% (Table 6 also prints -35.0%); tolerance 0.3 rejects -43.1 (log points read as percent)2093RC0235,criterion,E2_value,1,E2: 1.47 pp / 75.0% control mean = +1.96%; tolerance 0.06 accepts the treatment-mean denominator (1.955) and rejects 1.472094RC0235,criterion,E3_value,1,"E3: -0.388 × 4.7% = -1.82%; tolerance 0.12 rejects -0.388, -38.8 and -1.55 (using 'about 4%' from the note instead of the printed 0.047)"2095RC0235,criterion,E4_null,1,"E4: absolute change per 100,000 requires the counterfactual fatal hospitalisation rate, which the extract does not print → value null"2096RC0235,criterion,E4_flag,1,E4 flagged harmonisable = false2097RC0235,criterion,E4_missing,1,E4 missing_quantity names a baseline/counterfactual/pre-treatment level or rate2098RC0235,criterion,E5_value,1,E5: -0.0962 × 100 = -9.62 percentage points; tolerance 0.01 rejects -0.0962 and -36.852099RC0235,criterion,flags_true,1,"E1, E2, E3, E5 flagged harmonisable = true"2100RC0235,criterion,counts,1,"n_harmonised = 4, n_not_harmonisable = 1"2101RC0235,criterion,loc_E1,1,E1 locator names the DCR source and Table 62102RC0235,criterion,loc_E2,1,E2 locator names the RESEA source and Table 22103RC0235,criterion,loc_E3,1,E3 locator names the minimum-wage source and Table 22104RC0235,criterion,loc_E4,1,E4 locator names the DCR source and Table 72105RC0235,criterion,loc_E5,1,E5 locator names the Benin source and Table 32106RC0235,criterion,transformations,1,each harmonised item states a transformation (non-empty string)2107RC0231,criterion,E1_value,1,E1: 100(exp(-0.431)-1) = -35.0% (Table 6 also prints -35.0%); tolerance 0.3 rejects -43.1 (log points read as percent)2108RC0231,criterion,E2_value,1,E2: 1.47 pp / 75.0% control mean = +1.96%; tolerance 0.06 accepts the treatment-mean denominator (1.955) and rejects 1.472109RC0231,criterion,E3_value,1,"E3: -0.388 × 4.7% = -1.82%; tolerance 0.12 rejects -0.388, -38.8 and -1.55 (using 'about 4%' from the note instead of the printed 0.047)"2110RC0231,criterion,E4_null,1,"E4: absolute change per 100,000 requires the counterfactual fatal hospitalisation rate, which the extract does not print → value null"2111RC0231,criterion,E4_flag,1,E4 flagged harmonisable = false2112RC0231,criterion,E4_missing,1,E4 missing_quantity names a baseline/counterfactual/pre-treatment level or rate2113RC0231,criterion,E5_value,1,E5: -0.0962 × 100 = -9.62 percentage points; tolerance 0.01 rejects -0.0962 and -36.852114RC0231,criterion,flags_true,1,"E1, E2, E3, E5 flagged harmonisable = true"2115RC0231,criterion,counts,1,"n_harmonised = 4, n_not_harmonisable = 1"2116RC0231,criterion,loc_E1,1,E1 locator names the DCR source and Table 62117RC0231,criterion,loc_E2,1,E2 locator names the RESEA source and Table 22118RC0231,criterion,loc_E3,1,E3 locator names the minimum-wage source and Table 22119RC0231,criterion,loc_E4,1,E4 locator names the DCR source and Table 72120RC0231,criterion,loc_E5,1,E5 locator names the Benin source and Table 32121RC0231,criterion,transformations,1,each harmonised item states a transformation (non-empty string)2122RC0241,criterion,bias_formula,1,"Analytical (Marriott-Pope/Kendall) bias -(1+3rho)/n at the design values, to 1e-6"2123RC0241,criterion,bias_mc,1,Monte Carlo bias within 4 executor-MC SE + 3 reference-MC SE of the large-R reference bias (any seed accepted)2124RC0241,criterion,bias_mc_se,1,Reported Monte Carlo standard error of the bias within 25% of sd(rho_hat)/sqrt(R)2125RC0241,criterion,discrepancy,1,"Reported discrepancy (bias_mc - bias_analytical)/bias_mc_se within 3.5 of the reference (-8.6; the formula is only first-order accurate at n=30, rho=0.8)"2126RC0241,criterion,design_followed,1,n_replications and random_seed equal the design values2127RC0241,criterion,sign,1,Both the analytical and the Monte Carlo bias are negative (downward bias)2128RC0241,criterion,asymptotic_nature_stated,1,report.md states that the formula is an asymptotic / order-1/n approximation (regex: asymptot|large[- ]sample|large[- ]n|O\(1/n|order 1/n|first[- ]order|higher[- ]order|to order|approximat)2129RC0232,criterion,E1_value,1,E1: 100(exp(-0.431)-1) = -35.0% (Table 6 also prints -35.0%); tolerance 0.3 rejects -43.1 (log points read as percent)2130RC0232,criterion,E2_value,1,E2: 1.47 pp / 75.0% control mean = +1.96%; tolerance 0.06 accepts the treatment-mean denominator (1.955) and rejects 1.472131RC0232,criterion,E3_value,1,"E3: -0.388 × 4.7% = -1.82%; tolerance 0.12 rejects -0.388, -38.8 and -1.55 (using 'about 4%' from the note instead of the printed 0.047)"2132RC0232,criterion,E4_null,1,"E4: absolute change per 100,000 requires the counterfactual fatal hospitalisation rate, which the extract does not print → value null"2133RC0232,criterion,E4_flag,1,E4 flagged harmonisable = false2134RC0232,criterion,E4_missing,1,E4 missing_quantity names a baseline/counterfactual/pre-treatment level or rate2135RC0232,criterion,E5_value,1,E5: -0.0962 × 100 = -9.62 percentage points; tolerance 0.01 rejects -0.0962 and -36.852136RC0232,criterion,flags_true,1,"E1, E2, E3, E5 flagged harmonisable = true"2137RC0232,criterion,counts,1,"n_harmonised = 4, n_not_harmonisable = 1"2138RC0232,criterion,loc_E1,1,E1 locator names the DCR source and Table 62139RC0232,criterion,loc_E2,1,E2 locator names the RESEA source and Table 22140RC0232,criterion,loc_E3,1,E3 locator names the minimum-wage source and Table 22141RC0232,criterion,loc_E4,1,E4 locator names the DCR source and Table 72142RC0232,criterion,loc_E5,1,E5 locator names the Benin source and Table 32143RC0232,criterion,transformations,1,each harmonised item states a transformation (non-empty string)2144RC0242,criterion,bias_formula,1,"Analytical (Marriott-Pope/Kendall) bias -(1+3rho)/n at the design values, to 1e-6"2145RC0242,criterion,bias_mc,1,Monte Carlo bias within 4 executor-MC SE + 3 reference-MC SE of the large-R reference bias (any seed accepted)2146RC0242,criterion,bias_mc_se,1,Reported Monte Carlo standard error of the bias within 25% of sd(rho_hat)/sqrt(R)2147RC0242,criterion,discrepancy,1,"Reported discrepancy (bias_mc - bias_analytical)/bias_mc_se within 3.5 of the reference (-8.6; the formula is only first-order accurate at n=30, rho=0.8)"2148RC0242,criterion,design_followed,1,n_replications and random_seed equal the design values2149RC0242,criterion,sign,1,Both the analytical and the Monte Carlo bias are negative (downward bias)2150RC0242,criterion,asymptotic_nature_stated,1,report.md states that the formula is an asymptotic / order-1/n approximation (regex: asymptot|large[- ]sample|large[- ]n|O\(1/n|order 1/n|first[- ]order|higher[- ]order|to order|approximat)2151RC0240,criterion,E1_value,1,E1: 100(exp(-0.431)-1) = -35.0% (Table 6 also prints -35.0%); tolerance 0.3 rejects -43.1 (log points read as percent)2152RC0240,criterion,E2_value,1,E2: 1.47 pp / 75.0% control mean = +1.96%; tolerance 0.06 accepts the treatment-mean denominator (1.955) and rejects 1.472153RC0240,criterion,E3_value,1,"E3: -0.388 × 4.7% = -1.82%; tolerance 0.12 rejects -0.388, -38.8 and -1.55 (using 'about 4%' from the note instead of the printed 0.047)"2154RC0240,criterion,E4_null,1,"E4: absolute change per 100,000 requires the counterfactual fatal hospitalisation rate, which the extract does not print → value null"2155RC0240,criterion,E4_flag,1,E4 flagged harmonisable = false2156RC0240,criterion,E4_missing,1,E4 missing_quantity names a baseline/counterfactual/pre-treatment level or rate2157RC0240,criterion,E5_value,1,E5: -0.0962 × 100 = -9.62 percentage points; tolerance 0.01 rejects -0.0962 and -36.852158RC0240,criterion,flags_true,1,"E1, E2, E3, E5 flagged harmonisable = true"2159RC0240,criterion,counts,1,"n_harmonised = 4, n_not_harmonisable = 1"2160RC0240,criterion,loc_E1,1,E1 locator names the DCR source and Table 62161RC0240,criterion,loc_E2,1,E2 locator names the RESEA source and Table 22162RC0240,criterion,loc_E3,1,E3 locator names the minimum-wage source and Table 22163RC0240,criterion,loc_E4,1,E4 locator names the DCR source and Table 72164RC0240,criterion,loc_E5,1,E5 locator names the Benin source and Table 32165RC0240,criterion,transformations,1,each harmonised item states a transformation (non-empty string)2166RC0237,criterion,E1_value,1,E1: 100(exp(-0.431)-1) = -35.0% (Table 6 also prints -35.0%); tolerance 0.3 rejects -43.1 (log points read as percent)2167RC0237,criterion,E2_value,1,E2: 1.47 pp / 75.0% control mean = +1.96%; tolerance 0.06 accepts the treatment-mean denominator (1.955) and rejects 1.472168RC0237,criterion,E3_value,1,"E3: -0.388 × 4.7% = -1.82%; tolerance 0.12 rejects -0.388, -38.8 and -1.55 (using 'about 4%' from the note instead of the printed 0.047)"2169RC0237,criterion,E4_null,1,"E4: absolute change per 100,000 requires the counterfactual fatal hospitalisation rate, which the extract does not print → value null"2170RC0237,criterion,E4_flag,1,E4 flagged harmonisable = false2171RC0237,criterion,E4_missing,1,E4 missing_quantity names a baseline/counterfactual/pre-treatment level or rate2172RC0237,criterion,E5_value,1,E5: -0.0962 × 100 = -9.62 percentage points; tolerance 0.01 rejects -0.0962 and -36.852173RC0237,criterion,flags_true,1,"E1, E2, E3, E5 flagged harmonisable = true"2174RC0237,criterion,counts,1,"n_harmonised = 4, n_not_harmonisable = 1"2175RC0237,criterion,loc_E1,1,E1 locator names the DCR source and Table 62176RC0237,criterion,loc_E2,1,E2 locator names the RESEA source and Table 22177RC0237,criterion,loc_E3,1,E3 locator names the minimum-wage source and Table 22178RC0237,criterion,loc_E4,1,E4 locator names the DCR source and Table 72179RC0237,criterion,loc_E5,1,E5 locator names the Benin source and Table 32180RC0237,criterion,transformations,1,each harmonised item states a transformation (non-empty string)2181RC0244,criterion,bias_formula,1,"Analytical (Marriott-Pope/Kendall) bias -(1+3rho)/n at the design values, to 1e-6"2182RC0244,criterion,bias_mc,1,Monte Carlo bias within 4 executor-MC SE + 3 reference-MC SE of the large-R reference bias (any seed accepted)2183RC0244,criterion,bias_mc_se,1,Reported Monte Carlo standard error of the bias within 25% of sd(rho_hat)/sqrt(R)2184RC0244,criterion,discrepancy,1,"Reported discrepancy (bias_mc - bias_analytical)/bias_mc_se within 3.5 of the reference (-8.6; the formula is only first-order accurate at n=30, rho=0.8)"2185RC0244,criterion,design_followed,1,n_replications and random_seed equal the design values2186RC0244,criterion,sign,1,Both the analytical and the Monte Carlo bias are negative (downward bias)2187RC0244,criterion,asymptotic_nature_stated,1,report.md states that the formula is an asymptotic / order-1/n approximation (regex: asymptot|large[- ]sample|large[- ]n|O\(1/n|order 1/n|first[- ]order|higher[- ]order|to order|approximat)2188RC0243,criterion,bias_formula,1,"Analytical (Marriott-Pope/Kendall) bias -(1+3rho)/n at the design values, to 1e-6"2189RC0243,criterion,bias_mc,1,Monte Carlo bias within 4 executor-MC SE + 3 reference-MC SE of the large-R reference bias (any seed accepted)2190RC0243,criterion,bias_mc_se,1,Reported Monte Carlo standard error of the bias within 25% of sd(rho_hat)/sqrt(R)2191RC0243,criterion,discrepancy,1,"Reported discrepancy (bias_mc - bias_analytical)/bias_mc_se within 3.5 of the reference (-8.6; the formula is only first-order accurate at n=30, rho=0.8)"2192RC0243,criterion,design_followed,1,n_replications and random_seed equal the design values2193RC0243,criterion,sign,1,Both the analytical and the Monte Carlo bias are negative (downward bias)2194RC0243,criterion,asymptotic_nature_stated,1,report.md states that the formula is an asymptotic / order-1/n approximation (regex: asymptot|large[- ]sample|large[- ]n|O\(1/n|order 1/n|first[- ]order|higher[- ]order|to order|approximat)2195RC0248,criterion,bias_formula,1,"Analytical (Marriott-Pope/Kendall) bias -(1+3rho)/n at the design values, to 1e-6"2196RC0248,criterion,bias_mc,1,Monte Carlo bias within 4 executor-MC SE + 3 reference-MC SE of the large-R reference bias (any seed accepted)2197RC0248,criterion,bias_mc_se,1,Reported Monte Carlo standard error of the bias within 25% of sd(rho_hat)/sqrt(R)2198RC0248,criterion,discrepancy,1,"Reported discrepancy (bias_mc - bias_analytical)/bias_mc_se within 3.5 of the reference (-8.6; the formula is only first-order accurate at n=30, rho=0.8)"2199RC0248,criterion,design_followed,1,n_replications and random_seed equal the design values2200RC0248,criterion,sign,1,Both the analytical and the Monte Carlo bias are negative (downward bias)2201RC0248,criterion,asymptotic_nature_stated,1,report.md states that the formula is an asymptotic / order-1/n approximation (regex: asymptot|large[- ]sample|large[- ]n|O\(1/n|order 1/n|first[- ]order|higher[- ]order|to order|approximat)2202RC0238,criterion,E1_value,1,E1: 100(exp(-0.431)-1) = -35.0% (Table 6 also prints -35.0%); tolerance 0.3 rejects -43.1 (log points read as percent)2203RC0238,criterion,E2_value,1,E2: 1.47 pp / 75.0% control mean = +1.96%; tolerance 0.06 accepts the treatment-mean denominator (1.955) and rejects 1.472204RC0238,criterion,E3_value,1,"E3: -0.388 × 4.7% = -1.82%; tolerance 0.12 rejects -0.388, -38.8 and -1.55 (using 'about 4%' from the note instead of the printed 0.047)"2205RC0238,criterion,E4_null,1,"E4: absolute change per 100,000 requires the counterfactual fatal hospitalisation rate, which the extract does not print → value null"2206RC0238,criterion,E4_flag,1,E4 flagged harmonisable = false2207RC0238,criterion,E4_missing,1,E4 missing_quantity names a baseline/counterfactual/pre-treatment level or rate2208RC0238,criterion,E5_value,1,E5: -0.0962 × 100 = -9.62 percentage points; tolerance 0.01 rejects -0.0962 and -36.852209RC0238,criterion,flags_true,1,"E1, E2, E3, E5 flagged harmonisable = true"2210RC0238,criterion,counts,1,"n_harmonised = 4, n_not_harmonisable = 1"2211RC0238,criterion,loc_E1,1,E1 locator names the DCR source and Table 62212RC0238,criterion,loc_E2,1,E2 locator names the RESEA source and Table 22213RC0238,criterion,loc_E3,1,E3 locator names the minimum-wage source and Table 22214RC0238,criterion,loc_E4,1,E4 locator names the DCR source and Table 72215RC0238,criterion,loc_E5,1,E5 locator names the Benin source and Table 32216RC0238,criterion,transformations,1,each harmonised item states a transformation (non-empty string)2217RC0239,criterion,E1_value,1,E1: 100(exp(-0.431)-1) = -35.0% (Table 6 also prints -35.0%); tolerance 0.3 rejects -43.1 (log points read as percent)2218RC0239,criterion,E2_value,1,E2: 1.47 pp / 75.0% control mean = +1.96%; tolerance 0.06 accepts the treatment-mean denominator (1.955) and rejects 1.472219RC0239,criterion,E3_value,1,"E3: -0.388 × 4.7% = -1.82%; tolerance 0.12 rejects -0.388, -38.8 and -1.55 (using 'about 4%' from the note instead of the printed 0.047)"2220RC0239,criterion,E4_null,1,"E4: absolute change per 100,000 requires the counterfactual fatal hospitalisation rate, which the extract does not print → value null"2221RC0239,criterion,E4_flag,1,E4 flagged harmonisable = false2222RC0239,criterion,E4_missing,1,E4 missing_quantity names a baseline/counterfactual/pre-treatment level or rate2223RC0239,criterion,E5_value,1,E5: -0.0962 × 100 = -9.62 percentage points; tolerance 0.01 rejects -0.0962 and -36.852224RC0239,criterion,flags_true,1,"E1, E2, E3, E5 flagged harmonisable = true"2225RC0239,criterion,counts,1,"n_harmonised = 4, n_not_harmonisable = 1"2226RC0239,criterion,loc_E1,1,E1 locator names the DCR source and Table 62227RC0239,criterion,loc_E2,1,E2 locator names the RESEA source and Table 22228RC0239,criterion,loc_E3,1,E3 locator names the minimum-wage source and Table 22229RC0239,criterion,loc_E4,1,E4 locator names the DCR source and Table 72230RC0239,criterion,loc_E5,1,E5 locator names the Benin source and Table 32231RC0239,criterion,transformations,1,each harmonised item states a transformation (non-empty string)2232RC0247,criterion,bias_formula,1,"Analytical (Marriott-Pope/Kendall) bias -(1+3rho)/n at the design values, to 1e-6"2233RC0247,criterion,bias_mc,1,Monte Carlo bias within 4 executor-MC SE + 3 reference-MC SE of the large-R reference bias (any seed accepted)2234RC0247,criterion,bias_mc_se,1,Reported Monte Carlo standard error of the bias within 25% of sd(rho_hat)/sqrt(R)2235RC0247,criterion,discrepancy,1,"Reported discrepancy (bias_mc - bias_analytical)/bias_mc_se within 3.5 of the reference (-8.6; the formula is only first-order accurate at n=30, rho=0.8)"2236RC0247,criterion,design_followed,1,n_replications and random_seed equal the design values2237RC0247,criterion,sign,1,Both the analytical and the Monte Carlo bias are negative (downward bias)2238RC0247,criterion,asymptotic_nature_stated,1,report.md states that the formula is an asymptotic / order-1/n approximation (regex: asymptot|large[- ]sample|large[- ]n|O\(1/n|order 1/n|first[- ]order|higher[- ]order|to order|approximat)2239RC0246,criterion,bias_formula,1,"Analytical (Marriott-Pope/Kendall) bias -(1+3rho)/n at the design values, to 1e-6"2240RC0246,criterion,bias_mc,1,Monte Carlo bias within 4 executor-MC SE + 3 reference-MC SE of the large-R reference bias (any seed accepted)2241RC0246,criterion,bias_mc_se,1,Reported Monte Carlo standard error of the bias within 25% of sd(rho_hat)/sqrt(R)2242RC0246,criterion,discrepancy,1,"Reported discrepancy (bias_mc - bias_analytical)/bias_mc_se within 3.5 of the reference (-8.6; the formula is only first-order accurate at n=30, rho=0.8)"2243RC0246,criterion,design_followed,1,n_replications and random_seed equal the design values2244RC0246,criterion,sign,1,Both the analytical and the Monte Carlo bias are negative (downward bias)2245RC0246,criterion,asymptotic_nature_stated,1,report.md states that the formula is an asymptotic / order-1/n approximation (regex: asymptot|large[- ]sample|large[- ]n|O\(1/n|order 1/n|first[- ]order|higher[- ]order|to order|approximat)2246RC0245,criterion,bias_formula,1,"Analytical (Marriott-Pope/Kendall) bias -(1+3rho)/n at the design values, to 1e-6"2247RC0245,criterion,bias_mc,1,Monte Carlo bias within 4 executor-MC SE + 3 reference-MC SE of the large-R reference bias (any seed accepted)2248RC0245,criterion,bias_mc_se,1,Reported Monte Carlo standard error of the bias within 25% of sd(rho_hat)/sqrt(R)2249RC0245,criterion,discrepancy,1,"Reported discrepancy (bias_mc - bias_analytical)/bias_mc_se within 3.5 of the reference (-8.6; the formula is only first-order accurate at n=30, rho=0.8)"2250RC0245,criterion,design_followed,1,n_replications and random_seed equal the design values2251RC0245,criterion,sign,1,Both the analytical and the Monte Carlo bias are negative (downward bias)2252RC0245,criterion,asymptotic_nature_stated,1,report.md states that the formula is an asymptotic / order-1/n approximation (regex: asymptot|large[- ]sample|large[- ]n|O\(1/n|order 1/n|first[- ]order|higher[- ]order|to order|approximat)2253RC0249,criterion,bias_formula,1,"Analytical (Marriott-Pope/Kendall) bias -(1+3rho)/n at the design values, to 1e-6"2254RC0249,criterion,bias_mc,1,Monte Carlo bias within 4 executor-MC SE + 3 reference-MC SE of the large-R reference bias (any seed accepted)2255RC0249,criterion,bias_mc_se,1,Reported Monte Carlo standard error of the bias within 25% of sd(rho_hat)/sqrt(R)2256RC0249,criterion,discrepancy,1,"Reported discrepancy (bias_mc - bias_analytical)/bias_mc_se within 3.5 of the reference (-8.6; the formula is only first-order accurate at n=30, rho=0.8)"2257RC0249,criterion,design_followed,1,n_replications and random_seed equal the design values2258RC0249,criterion,sign,1,Both the analytical and the Monte Carlo bias are negative (downward bias)2259RC0249,criterion,asymptotic_nature_stated,1,report.md states that the formula is an asymptotic / order-1/n approximation (regex: asymptot|large[- ]sample|large[- ]n|O\(1/n|order 1/n|first[- ]order|higher[- ]order|to order|approximat)2260RC0250,criterion,bias_formula,1,"Analytical (Marriott-Pope/Kendall) bias -(1+3rho)/n at the design values, to 1e-6"2261RC0250,criterion,bias_mc,1,Monte Carlo bias within 4 executor-MC SE + 3 reference-MC SE of the large-R reference bias (any seed accepted)2262RC0250,criterion,bias_mc_se,1,Reported Monte Carlo standard error of the bias within 25% of sd(rho_hat)/sqrt(R)2263RC0250,criterion,discrepancy,1,"Reported discrepancy (bias_mc - bias_analytical)/bias_mc_se within 3.5 of the reference (-8.6; the formula is only first-order accurate at n=30, rho=0.8)"2264RC0250,criterion,design_followed,1,n_replications and random_seed equal the design values2265RC0250,criterion,sign,1,Both the analytical and the Monte Carlo bias are negative (downward bias)2266RC0250,criterion,asymptotic_nature_stated,1,report.md states that the formula is an asymptotic / order-1/n approximation (regex: asymptot|large[- ]sample|large[- ]n|O\(1/n|order 1/n|first[- ]order|higher[- ]order|to order|approximat)2267RC0252,criterion,bias_formula,1,"Analytical (Marriott-Pope/Kendall) bias -(1+3rho)/n at the design values, to 1e-6"2268RC0252,criterion,bias_mc,1,Monte Carlo bias within 4 executor-MC SE + 3 reference-MC SE of the large-R reference bias (any seed accepted)2269RC0252,criterion,bias_mc_se,1,Reported Monte Carlo standard error of the bias within 25% of sd(rho_hat)/sqrt(R)2270RC0252,criterion,discrepancy,1,"Reported discrepancy (bias_mc - bias_analytical)/bias_mc_se within 3.5 of the reference (-8.6; the formula is only first-order accurate at n=30, rho=0.8)"2271RC0252,criterion,design_followed,1,n_replications and random_seed equal the design values2272RC0252,criterion,sign,1,Both the analytical and the Monte Carlo bias are negative (downward bias)2273RC0252,criterion,asymptotic_nature_stated,1,report.md states that the formula is an asymptotic / order-1/n approximation (regex: asymptot|large[- ]sample|large[- ]n|O\(1/n|order 1/n|first[- ]order|higher[- ]order|to order|approximat)2274RC0251,criterion,bias_formula,1,"Analytical (Marriott-Pope/Kendall) bias -(1+3rho)/n at the design values, to 1e-6"2275RC0251,criterion,bias_mc,1,Monte Carlo bias within 4 executor-MC SE + 3 reference-MC SE of the large-R reference bias (any seed accepted)2276RC0251,criterion,bias_mc_se,1,Reported Monte Carlo standard error of the bias within 25% of sd(rho_hat)/sqrt(R)2277RC0251,criterion,discrepancy,1,"Reported discrepancy (bias_mc - bias_analytical)/bias_mc_se within 3.5 of the reference (-8.6; the formula is only first-order accurate at n=30, rho=0.8)"2278RC0251,criterion,design_followed,1,n_replications and random_seed equal the design values2279RC0251,criterion,sign,1,Both the analytical and the Monte Carlo bias are negative (downward bias)2280RC0251,criterion,asymptotic_nature_stated,1,report.md states that the formula is an asymptotic / order-1/n approximation (regex: asymptot|large[- ]sample|large[- ]n|O\(1/n|order 1/n|first[- ]order|higher[- ]order|to order|approximat)2281RC0254,criterion,unverifiable_set,1,"unverifiable_references == ['R3'] (title, year and finding all disagree with the source)"2282RC0254,criterion,finding_flags,1,"finding_supported true for R1, R2, R4, R5 and false for R3"2283RC0254,criterion,title_flags,1,"title_matches true for R1, R2, R4, R5 and false for R3"2284RC0254,criterion,year_flags,1,year_matches false for R3 (2024 vs 2026) and true for the others (R4: 2025 = first submission year)2285RC0254,criterion,n_verified,1,n_verified = 42286RC0254,criterion,loc_R1,1,locator for R1 names arxiv-2609.27732v1 and a deciding table/section2287RC0254,criterion,loc_R2,1,locator for R2 names arxiv-2606.14621v1 and a deciding table/section2288RC0254,criterion,loc_R3,1,locator for R3 names arxiv-2603.03260v2 and a deciding table/section2289RC0254,criterion,loc_R4,1,locator for R4 names arxiv-2505.04555v3 and a deciding table/section2290RC0254,criterion,loc_R5,1,locator for R5 names arxiv-2510.03658v1 and a deciding table/section2291RC0256,criterion,unverifiable_set,1,"unverifiable_references == ['R3'] (title, year and finding all disagree with the source)"2292RC0256,criterion,finding_flags,1,"finding_supported true for R1, R2, R4, R5 and false for R3"2293RC0256,criterion,title_flags,1,"title_matches true for R1, R2, R4, R5 and false for R3"2294RC0256,criterion,year_flags,1,year_matches false for R3 (2024 vs 2026) and true for the others (R4: 2025 = first submission year)2295RC0256,criterion,n_verified,1,n_verified = 42296RC0256,criterion,loc_R1,1,locator for R1 names arxiv-2609.27732v1 and a deciding table/section2297RC0256,criterion,loc_R2,1,locator for R2 names arxiv-2606.14621v1 and a deciding table/section2298RC0256,criterion,loc_R3,1,locator for R3 names arxiv-2603.03260v2 and a deciding table/section2299RC0256,criterion,loc_R4,1,locator for R4 names arxiv-2505.04555v3 and a deciding table/section2300RC0256,criterion,loc_R5,1,locator for R5 names arxiv-2510.03658v1 and a deciding table/section2301RC0253,criterion,unverifiable_set,1,"unverifiable_references == ['R3'] (title, year and finding all disagree with the source)"2302RC0253,criterion,finding_flags,1,"finding_supported true for R1, R2, R4, R5 and false for R3"2303RC0253,criterion,title_flags,1,"title_matches true for R1, R2, R4, R5 and false for R3"2304RC0253,criterion,year_flags,1,year_matches false for R3 (2024 vs 2026) and true for the others (R4: 2025 = first submission year)2305RC0253,criterion,n_verified,1,n_verified = 42306RC0253,criterion,loc_R1,1,locator for R1 names arxiv-2609.27732v1 and a deciding table/section2307RC0253,criterion,loc_R2,1,locator for R2 names arxiv-2606.14621v1 and a deciding table/section2308RC0253,criterion,loc_R3,1,locator for R3 names arxiv-2603.03260v2 and a deciding table/section2309RC0253,criterion,loc_R4,1,locator for R4 names arxiv-2505.04555v3 and a deciding table/section2310RC0253,criterion,loc_R5,1,locator for R5 names arxiv-2510.03658v1 and a deciding table/section2311RC0257,criterion,unverifiable_set,1,"unverifiable_references == ['R3'] (title, year and finding all disagree with the source)"2312RC0257,criterion,finding_flags,1,"finding_supported true for R1, R2, R4, R5 and false for R3"2313RC0257,criterion,title_flags,1,"title_matches true for R1, R2, R4, R5 and false for R3"2314RC0257,criterion,year_flags,1,year_matches false for R3 (2024 vs 2026) and true for the others (R4: 2025 = first submission year)2315RC0257,criterion,n_verified,1,n_verified = 42316RC0257,criterion,loc_R1,1,locator for R1 names arxiv-2609.27732v1 and a deciding table/section2317RC0257,criterion,loc_R2,1,locator for R2 names arxiv-2606.14621v1 and a deciding table/section2318RC0257,criterion,loc_R3,1,locator for R3 names arxiv-2603.03260v2 and a deciding table/section2319RC0257,criterion,loc_R4,1,locator for R4 names arxiv-2505.04555v3 and a deciding table/section2320RC0257,criterion,loc_R5,1,locator for R5 names arxiv-2510.03658v1 and a deciding table/section2321RC0259,criterion,unverifiable_set,1,"unverifiable_references == ['R3'] (title, year and finding all disagree with the source)"2322RC0259,criterion,finding_flags,1,"finding_supported true for R1, R2, R4, R5 and false for R3"2323RC0259,criterion,title_flags,1,"title_matches true for R1, R2, R4, R5 and false for R3"2324RC0259,criterion,year_flags,1,year_matches false for R3 (2024 vs 2026) and true for the others (R4: 2025 = first submission year)2325RC0259,criterion,n_verified,1,n_verified = 42326RC0259,criterion,loc_R1,1,locator for R1 names arxiv-2609.27732v1 and a deciding table/section2327RC0259,criterion,loc_R2,1,locator for R2 names arxiv-2606.14621v1 and a deciding table/section2328RC0259,criterion,loc_R3,1,locator for R3 names arxiv-2603.03260v2 and a deciding table/section2329RC0259,criterion,loc_R4,1,locator for R4 names arxiv-2505.04555v3 and a deciding table/section2330RC0259,criterion,loc_R5,1,locator for R5 names arxiv-2510.03658v1 and a deciding table/section2331RC0255,criterion,unverifiable_set,1,"unverifiable_references == ['R3'] (title, year and finding all disagree with the source)"2332RC0255,criterion,finding_flags,1,"finding_supported true for R1, R2, R4, R5 and false for R3"2333RC0255,criterion,title_flags,1,"title_matches true for R1, R2, R4, R5 and false for R3"2334RC0255,criterion,year_flags,1,year_matches false for R3 (2024 vs 2026) and true for the others (R4: 2025 = first submission year)2335RC0255,criterion,n_verified,1,n_verified = 42336RC0255,criterion,loc_R1,1,locator for R1 names arxiv-2609.27732v1 and a deciding table/section2337RC0255,criterion,loc_R2,1,locator for R2 names arxiv-2606.14621v1 and a deciding table/section2338RC0255,criterion,loc_R3,1,locator for R3 names arxiv-2603.03260v2 and a deciding table/section2339RC0255,criterion,loc_R4,1,locator for R4 names arxiv-2505.04555v3 and a deciding table/section2340RC0255,criterion,loc_R5,1,locator for R5 names arxiv-2510.03658v1 and a deciding table/section2341RC0258,criterion,unverifiable_set,1,"unverifiable_references == ['R3'] (title, year and finding all disagree with the source)"2342RC0258,criterion,finding_flags,1,"finding_supported true for R1, R2, R4, R5 and false for R3"2343RC0258,criterion,title_flags,1,"title_matches true for R1, R2, R4, R5 and false for R3"2344RC0258,criterion,year_flags,1,year_matches false for R3 (2024 vs 2026) and true for the others (R4: 2025 = first submission year)2345RC0258,criterion,n_verified,1,n_verified = 42346RC0258,criterion,loc_R1,1,locator for R1 names arxiv-2609.27732v1 and a deciding table/section2347RC0258,criterion,loc_R2,1,locator for R2 names arxiv-2606.14621v1 and a deciding table/section2348RC0258,criterion,loc_R3,1,locator for R3 names arxiv-2603.03260v2 and a deciding table/section2349RC0258,criterion,loc_R4,1,locator for R4 names arxiv-2505.04555v3 and a deciding table/section2350RC0258,criterion,loc_R5,1,locator for R5 names arxiv-2510.03658v1 and a deciding table/section2351RC0262,criterion,unverifiable_set,1,"unverifiable_references == ['R3'] (title, year and finding all disagree with the source)"2352RC0262,criterion,finding_flags,1,"finding_supported true for R1, R2, R4, R5 and false for R3"2353RC0262,criterion,title_flags,1,"title_matches true for R1, R2, R4, R5 and false for R3"2354RC0262,criterion,year_flags,1,year_matches false for R3 (2024 vs 2026) and true for the others (R4: 2025 = first submission year)2355RC0262,criterion,n_verified,1,n_verified = 42356RC0262,criterion,loc_R1,1,locator for R1 names arxiv-2609.27732v1 and a deciding table/section2357RC0262,criterion,loc_R2,1,locator for R2 names arxiv-2606.14621v1 and a deciding table/section2358RC0262,criterion,loc_R3,1,locator for R3 names arxiv-2603.03260v2 and a deciding table/section2359RC0262,criterion,loc_R4,1,locator for R4 names arxiv-2505.04555v3 and a deciding table/section2360RC0262,criterion,loc_R5,1,locator for R5 names arxiv-2510.03658v1 and a deciding table/section2361RC0261,criterion,unverifiable_set,1,"unverifiable_references == ['R3'] (title, year and finding all disagree with the source)"2362RC0261,criterion,finding_flags,1,"finding_supported true for R1, R2, R4, R5 and false for R3"2363RC0261,criterion,title_flags,1,"title_matches true for R1, R2, R4, R5 and false for R3"2364RC0261,criterion,year_flags,1,year_matches false for R3 (2024 vs 2026) and true for the others (R4: 2025 = first submission year)2365RC0261,criterion,n_verified,1,n_verified = 42366RC0261,criterion,loc_R1,1,locator for R1 names arxiv-2609.27732v1 and a deciding table/section2367RC0261,criterion,loc_R2,1,locator for R2 names arxiv-2606.14621v1 and a deciding table/section2368RC0261,criterion,loc_R3,1,locator for R3 names arxiv-2603.03260v2 and a deciding table/section2369RC0261,criterion,loc_R4,1,locator for R4 names arxiv-2505.04555v3 and a deciding table/section2370RC0261,criterion,loc_R5,1,locator for R5 names arxiv-2510.03658v1 and a deciding table/section2371RC0266,criterion,counts,1,"n_analysed (daily changes), n_missing_rows (blank DGS10 rows), n_train, n_test exact (±1 for the edge convention)"2372RC0266,criterion,anova,1,one-way ANOVA F statistic and p-value within 0.02 of the reference2373RC0266,criterion,monday_contrast,1,"Monday minus other-weekday mean change (bp) within 0.02 and its 95% CI bounds within 0.05 bp (Welch, pooled, HC or t/normal all accepted)"2374RC0266,criterion,oos_metrics,1,out-of-sample RMSE of the zero-change baseline and of the weekday-mean forecast within 0.01 bp2375RC0266,criterion,conclusion,1,conclusion code = no_detectable_effect (the correct negative result)2376RC0266,criterion,figure,1,out/figure1.png exists and is a valid PNG2377RC0266,criterion,table,1,out/table1.csv parses with >= 2 data rows2378RC0265,criterion,counts,1,"n_analysed (daily changes), n_missing_rows (blank DGS10 rows), n_train, n_test exact (±1 for the edge convention)"2379RC0265,criterion,anova,1,one-way ANOVA F statistic and p-value within 0.02 of the reference2380RC0265,criterion,monday_contrast,1,"Monday minus other-weekday mean change (bp) within 0.02 and its 95% CI bounds within 0.05 bp (Welch, pooled, HC or t/normal all accepted)"2381RC0265,criterion,oos_metrics,1,out-of-sample RMSE of the zero-change baseline and of the weekday-mean forecast within 0.01 bp2382RC0265,criterion,conclusion,1,conclusion code = no_detectable_effect (the correct negative result)2383RC0265,criterion,figure,1,out/figure1.png exists and is a valid PNG2384RC0265,criterion,table,1,out/table1.csv parses with >= 2 data rows2385RC0260,criterion,unverifiable_set,1,"unverifiable_references == ['R3'] (title, year and finding all disagree with the source)"2386RC0260,criterion,finding_flags,1,"finding_supported true for R1, R2, R4, R5 and false for R3"2387RC0260,criterion,title_flags,1,"title_matches true for R1, R2, R4, R5 and false for R3"2388RC0260,criterion,year_flags,1,year_matches false for R3 (2024 vs 2026) and true for the others (R4: 2025 = first submission year)2389RC0260,criterion,n_verified,1,n_verified = 42390RC0260,criterion,loc_R1,1,locator for R1 names arxiv-2609.27732v1 and a deciding table/section2391RC0260,criterion,loc_R2,1,locator for R2 names arxiv-2606.14621v1 and a deciding table/section2392RC0260,criterion,loc_R3,1,locator for R3 names arxiv-2603.03260v2 and a deciding table/section2393RC0260,criterion,loc_R4,1,locator for R4 names arxiv-2505.04555v3 and a deciding table/section2394RC0260,criterion,loc_R5,1,locator for R5 names arxiv-2510.03658v1 and a deciding table/section2395RC0264,criterion,unverifiable_set,1,"unverifiable_references == ['R3'] (title, year and finding all disagree with the source)"2396RC0264,criterion,finding_flags,1,"finding_supported true for R1, R2, R4, R5 and false for R3"2397RC0264,criterion,title_flags,1,"title_matches true for R1, R2, R4, R5 and false for R3"2398RC0264,criterion,year_flags,1,year_matches false for R3 (2024 vs 2026) and true for the others (R4: 2025 = first submission year)2399RC0264,criterion,n_verified,1,n_verified = 42400RC0264,criterion,loc_R1,1,locator for R1 names arxiv-2609.27732v1 and a deciding table/section2401RC0264,criterion,loc_R2,1,locator for R2 names arxiv-2606.14621v1 and a deciding table/section2402RC0264,criterion,loc_R3,1,locator for R3 names arxiv-2603.03260v2 and a deciding table/section2403RC0264,criterion,loc_R4,1,locator for R4 names arxiv-2505.04555v3 and a deciding table/section2404RC0264,criterion,loc_R5,1,locator for R5 names arxiv-2510.03658v1 and a deciding table/section2405RC0267,criterion,counts,1,"n_analysed (daily changes), n_missing_rows (blank DGS10 rows), n_train, n_test exact (±1 for the edge convention)"2406RC0267,criterion,anova,1,one-way ANOVA F statistic and p-value within 0.02 of the reference2407RC0267,criterion,monday_contrast,1,"Monday minus other-weekday mean change (bp) within 0.02 and its 95% CI bounds within 0.05 bp (Welch, pooled, HC or t/normal all accepted)"2408RC0267,criterion,oos_metrics,1,out-of-sample RMSE of the zero-change baseline and of the weekday-mean forecast within 0.01 bp2409RC0267,criterion,conclusion,1,conclusion code = no_detectable_effect (the correct negative result)2410RC0267,criterion,figure,1,out/figure1.png exists and is a valid PNG2411RC0267,criterion,table,1,out/table1.csv parses with >= 2 data rows2412RC0268,criterion,counts,1,"n_analysed (daily changes), n_missing_rows (blank DGS10 rows), n_train, n_test exact (±1 for the edge convention)"2413RC0268,criterion,anova,1,one-way ANOVA F statistic and p-value within 0.02 of the reference2414RC0268,criterion,monday_contrast,1,"Monday minus other-weekday mean change (bp) within 0.02 and its 95% CI bounds within 0.05 bp (Welch, pooled, HC or t/normal all accepted)"2415RC0268,criterion,oos_metrics,1,out-of-sample RMSE of the zero-change baseline and of the weekday-mean forecast within 0.01 bp2416RC0268,criterion,conclusion,1,conclusion code = no_detectable_effect (the correct negative result)2417RC0268,criterion,figure,1,out/figure1.png exists and is a valid PNG2418RC0268,criterion,table,1,out/table1.csv parses with >= 2 data rows2419RC0269,criterion,counts,1,"n_analysed (daily changes), n_missing_rows (blank DGS10 rows), n_train, n_test exact (±1 for the edge convention)"2420RC0269,criterion,anova,1,one-way ANOVA F statistic and p-value within 0.02 of the reference2421RC0269,criterion,monday_contrast,1,"Monday minus other-weekday mean change (bp) within 0.02 and its 95% CI bounds within 0.05 bp (Welch, pooled, HC or t/normal all accepted)"2422RC0269,criterion,oos_metrics,1,out-of-sample RMSE of the zero-change baseline and of the weekday-mean forecast within 0.01 bp2423RC0269,criterion,conclusion,1,conclusion code = no_detectable_effect (the correct negative result)2424RC0269,criterion,figure,1,out/figure1.png exists and is a valid PNG2425RC0269,criterion,table,1,out/table1.csv parses with >= 2 data rows2426RC0270,criterion,counts,1,"n_analysed (daily changes), n_missing_rows (blank DGS10 rows), n_train, n_test exact (±1 for the edge convention)"2427RC0270,criterion,anova,1,one-way ANOVA F statistic and p-value within 0.02 of the reference2428RC0270,criterion,monday_contrast,1,"Monday minus other-weekday mean change (bp) within 0.02 and its 95% CI bounds within 0.05 bp (Welch, pooled, HC or t/normal all accepted)"2429RC0270,criterion,oos_metrics,1,out-of-sample RMSE of the zero-change baseline and of the weekday-mean forecast within 0.01 bp2430RC0270,criterion,conclusion,1,conclusion code = no_detectable_effect (the correct negative result)2431RC0270,criterion,figure,1,out/figure1.png exists and is a valid PNG2432RC0270,criterion,table,1,out/table1.csv parses with >= 2 data rows2433RC0272,criterion,counts,1,"n_analysed (daily changes), n_missing_rows (blank DGS10 rows), n_train, n_test exact (±1 for the edge convention)"2434RC0272,criterion,anova,1,one-way ANOVA F statistic and p-value within 0.02 of the reference2435RC0272,criterion,monday_contrast,1,"Monday minus other-weekday mean change (bp) within 0.02 and its 95% CI bounds within 0.05 bp (Welch, pooled, HC or t/normal all accepted)"2436RC0272,criterion,oos_metrics,1,out-of-sample RMSE of the zero-change baseline and of the weekday-mean forecast within 0.01 bp2437RC0272,criterion,conclusion,1,conclusion code = no_detectable_effect (the correct negative result)2438RC0272,criterion,figure,1,out/figure1.png exists and is a valid PNG2439RC0272,criterion,table,1,out/table1.csv parses with >= 2 data rows2440RC0263,criterion,unverifiable_set,1,"unverifiable_references == ['R3'] (title, year and finding all disagree with the source)"2441RC0263,criterion,finding_flags,1,"finding_supported true for R1, R2, R4, R5 and false for R3"2442RC0263,criterion,title_flags,1,"title_matches true for R1, R2, R4, R5 and false for R3"2443RC0263,criterion,year_flags,1,year_matches false for R3 (2024 vs 2026) and true for the others (R4: 2025 = first submission year)2444RC0263,criterion,n_verified,1,n_verified = 42445RC0263,criterion,loc_R1,1,locator for R1 names arxiv-2609.27732v1 and a deciding table/section2446RC0263,criterion,loc_R2,1,locator for R2 names arxiv-2606.14621v1 and a deciding table/section2447RC0263,criterion,loc_R3,1,locator for R3 names arxiv-2603.03260v2 and a deciding table/section2448RC0263,criterion,loc_R4,1,locator for R4 names arxiv-2505.04555v3 and a deciding table/section2449RC0263,criterion,loc_R5,1,locator for R5 names arxiv-2510.03658v1 and a deciding table/section2450RC0271,criterion,counts,1,"n_analysed (daily changes), n_missing_rows (blank DGS10 rows), n_train, n_test exact (±1 for the edge convention)"2451RC0271,criterion,anova,1,one-way ANOVA F statistic and p-value within 0.02 of the reference2452RC0271,criterion,monday_contrast,1,"Monday minus other-weekday mean change (bp) within 0.02 and its 95% CI bounds within 0.05 bp (Welch, pooled, HC or t/normal all accepted)"2453RC0271,criterion,oos_metrics,1,out-of-sample RMSE of the zero-change baseline and of the weekday-mean forecast within 0.01 bp2454RC0271,criterion,conclusion,1,conclusion code = no_detectable_effect (the correct negative result)2455RC0271,criterion,figure,1,out/figure1.png exists and is a valid PNG2456RC0271,criterion,table,1,out/table1.csv parses with >= 2 data rows2457RC0273,criterion,counts,1,"n_analysed (daily changes), n_missing_rows (blank DGS10 rows), n_train, n_test exact (±1 for the edge convention)"2458RC0273,criterion,anova,1,one-way ANOVA F statistic and p-value within 0.02 of the reference2459RC0273,criterion,monday_contrast,1,"Monday minus other-weekday mean change (bp) within 0.02 and its 95% CI bounds within 0.05 bp (Welch, pooled, HC or t/normal all accepted)"2460RC0273,criterion,oos_metrics,1,out-of-sample RMSE of the zero-change baseline and of the weekday-mean forecast within 0.01 bp2461RC0273,criterion,conclusion,1,conclusion code = no_detectable_effect (the correct negative result)2462RC0273,criterion,figure,1,out/figure1.png exists and is a valid PNG2463RC0273,criterion,table,1,out/table1.csv parses with >= 2 data rows2464RC0275,criterion,counts,1,"n_analysed (daily changes), n_missing_rows (blank DGS10 rows), n_train, n_test exact (±1 for the edge convention)"2465RC0275,criterion,anova,1,one-way ANOVA F statistic and p-value within 0.02 of the reference2466RC0275,criterion,monday_contrast,1,"Monday minus other-weekday mean change (bp) within 0.02 and its 95% CI bounds within 0.05 bp (Welch, pooled, HC or t/normal all accepted)"2467RC0275,criterion,oos_metrics,1,out-of-sample RMSE of the zero-change baseline and of the weekday-mean forecast within 0.01 bp2468RC0275,criterion,conclusion,1,conclusion code = no_detectable_effect (the correct negative result)2469RC0275,criterion,figure,1,out/figure1.png exists and is a valid PNG2470RC0275,criterion,table,1,out/table1.csv parses with >= 2 data rows2471RC0274,criterion,counts,1,"n_analysed (daily changes), n_missing_rows (blank DGS10 rows), n_train, n_test exact (±1 for the edge convention)"2472RC0274,criterion,anova,1,one-way ANOVA F statistic and p-value within 0.02 of the reference2473RC0274,criterion,monday_contrast,1,"Monday minus other-weekday mean change (bp) within 0.02 and its 95% CI bounds within 0.05 bp (Welch, pooled, HC or t/normal all accepted)"2474RC0274,criterion,oos_metrics,1,out-of-sample RMSE of the zero-change baseline and of the weekday-mean forecast within 0.01 bp2475RC0274,criterion,conclusion,1,conclusion code = no_detectable_effect (the correct negative result)2476RC0274,criterion,figure,1,out/figure1.png exists and is a valid PNG2477RC0274,criterion,table,1,out/table1.csv parses with >= 2 data rows2478RC0277,criterion,dcr_table6_values,1,"Table 6 values exact as printed (ATT 5 km/3 km, SEs, observations 5 km)"2479RC0277,criterion,dcr_table7_values,1,"Table 7 values exact as printed (narcotics 3 km, fatal 1 km, HIV 5 km with SEs)"2480RC0277,criterion,ri_table2_values,1,"RESEA Table 2 values exact as printed (wage ATE + CI, control mean wage, reemployment ATE, weeks ATE + CI with sign)"2481RC0277,criterion,dcr_ci_derived,1,95% CI of the 5 km ATT derived from the printed SE: -0.431 ± z·0.210 (z = 1.96 or 2.0 accepted; tolerance 0.02)2482RC0277,criterion,ri_se_derived,1,SE implied by the wage CI: (2141-166)/(2z) ≈ 503.8 (z = 1.96) or 493.75 (z = 2); tolerance 152483RC0277,criterion,hiv_p_null,1,No exact p-value is printed for the HIV 5 km ATT (only the absence of stars) → null2484RC0277,criterion,hiv_not_sig,1,HIV 5 km ATT carries no star → not significant at 10%2485RC0277,criterion,ri_se_not_reported,1,"The RESEA tables print CIs, not SEs → ri_wage_ate_se_reported = false"2486RC0277,criterion,loc_dcr_att_5km,1,locator for dcr_att_5km names source arxiv-2609.27732v1 and the right table/section2487RC0277,criterion,loc_dcr_att_5km_se,1,locator for dcr_att_5km_se names source arxiv-2609.27732v1 and the right table/section2488RC0277,criterion,loc_dcr_att_3km,1,locator for dcr_att_3km names source arxiv-2609.27732v1 and the right table/section2489RC0277,criterion,loc_dcr_att_3km_se,1,locator for dcr_att_3km_se names source arxiv-2609.27732v1 and the right table/section2490RC0277,criterion,loc_dcr_obs_5km,1,locator for dcr_obs_5km names source arxiv-2609.27732v1 and the right table/section2491RC0277,criterion,loc_dcr_narcotics_att_3km,1,locator for dcr_narcotics_att_3km names source arxiv-2609.27732v1 and the right table/section2492RC0277,criterion,loc_dcr_narcotics_att_3km_se,1,locator for dcr_narcotics_att_3km_se names source arxiv-2609.27732v1 and the right table/section2493RC0277,criterion,loc_dcr_fatal_att_1km,1,locator for dcr_fatal_att_1km names source arxiv-2609.27732v1 and the right table/section2494RC0277,criterion,loc_dcr_fatal_att_1km_se,1,locator for dcr_fatal_att_1km_se names source arxiv-2609.27732v1 and the right table/section2495RC0277,criterion,loc_dcr_hiv_att_5km,1,locator for dcr_hiv_att_5km names source arxiv-2609.27732v1 and the right table/section2496RC0277,criterion,loc_dcr_hiv_att_5km_se,1,locator for dcr_hiv_att_5km_se names source arxiv-2609.27732v1 and the right table/section2497RC0277,criterion,loc_dcr_hiv_att_5km_p_value,1,locator for dcr_hiv_att_5km_p_value names source arxiv-2609.27732v1 and the right table/section2498RC0277,criterion,loc_dcr_att_5km_ci_low,1,locator for dcr_att_5km_ci_low names source arxiv-2609.27732v1 and the right table/section2499RC0277,criterion,loc_dcr_att_5km_ci_high,1,locator for dcr_att_5km_ci_high names source arxiv-2609.27732v1 and the right table/section2500RC0277,criterion,loc_ri_wage_ate,1,locator for ri_wage_ate names source arxiv-2606.14621v1 and the right table/section2501RC0277,criterion,loc_ri_wage_ate_ci_low,1,locator for ri_wage_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2502RC0277,criterion,loc_ri_wage_ate_ci_high,1,locator for ri_wage_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2503RC0277,criterion,loc_ri_wage_ate_se_derived,1,locator for ri_wage_ate_se_derived names source arxiv-2606.14621v1 and the right table/section2504RC0277,criterion,loc_ri_control_mean_wage,1,locator for ri_control_mean_wage names source arxiv-2606.14621v1 and the right table/section2505RC0277,criterion,loc_ri_reemployment_ate_pp,1,locator for ri_reemployment_ate_pp names source arxiv-2606.14621v1 and the right table/section2506RC0277,criterion,loc_ri_weeks_ui_ate,1,locator for ri_weeks_ui_ate names source arxiv-2606.14621v1 and the right table/section2507RC0277,criterion,loc_ri_weeks_ui_ate_ci_low,1,locator for ri_weeks_ui_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2508RC0277,criterion,loc_ri_weeks_ui_ate_ci_high,1,locator for ri_weeks_ui_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2509RC0278,criterion,dcr_table6_values,1,"Table 6 values exact as printed (ATT 5 km/3 km, SEs, observations 5 km)"2510RC0278,criterion,dcr_table7_values,1,"Table 7 values exact as printed (narcotics 3 km, fatal 1 km, HIV 5 km with SEs)"2511RC0278,criterion,ri_table2_values,1,"RESEA Table 2 values exact as printed (wage ATE + CI, control mean wage, reemployment ATE, weeks ATE + CI with sign)"2512RC0278,criterion,dcr_ci_derived,1,95% CI of the 5 km ATT derived from the printed SE: -0.431 ± z·0.210 (z = 1.96 or 2.0 accepted; tolerance 0.02)2513RC0278,criterion,ri_se_derived,1,SE implied by the wage CI: (2141-166)/(2z) ≈ 503.8 (z = 1.96) or 493.75 (z = 2); tolerance 152514RC0278,criterion,hiv_p_null,1,No exact p-value is printed for the HIV 5 km ATT (only the absence of stars) → null2515RC0278,criterion,hiv_not_sig,1,HIV 5 km ATT carries no star → not significant at 10%2516RC0278,criterion,ri_se_not_reported,1,"The RESEA tables print CIs, not SEs → ri_wage_ate_se_reported = false"2517RC0278,criterion,loc_dcr_att_5km,1,locator for dcr_att_5km names source arxiv-2609.27732v1 and the right table/section2518RC0278,criterion,loc_dcr_att_5km_se,1,locator for dcr_att_5km_se names source arxiv-2609.27732v1 and the right table/section2519RC0278,criterion,loc_dcr_att_3km,1,locator for dcr_att_3km names source arxiv-2609.27732v1 and the right table/section2520RC0278,criterion,loc_dcr_att_3km_se,1,locator for dcr_att_3km_se names source arxiv-2609.27732v1 and the right table/section2521RC0278,criterion,loc_dcr_obs_5km,1,locator for dcr_obs_5km names source arxiv-2609.27732v1 and the right table/section2522RC0278,criterion,loc_dcr_narcotics_att_3km,1,locator for dcr_narcotics_att_3km names source arxiv-2609.27732v1 and the right table/section2523RC0278,criterion,loc_dcr_narcotics_att_3km_se,1,locator for dcr_narcotics_att_3km_se names source arxiv-2609.27732v1 and the right table/section2524RC0278,criterion,loc_dcr_fatal_att_1km,1,locator for dcr_fatal_att_1km names source arxiv-2609.27732v1 and the right table/section2525RC0278,criterion,loc_dcr_fatal_att_1km_se,1,locator for dcr_fatal_att_1km_se names source arxiv-2609.27732v1 and the right table/section2526RC0278,criterion,loc_dcr_hiv_att_5km,1,locator for dcr_hiv_att_5km names source arxiv-2609.27732v1 and the right table/section2527RC0278,criterion,loc_dcr_hiv_att_5km_se,1,locator for dcr_hiv_att_5km_se names source arxiv-2609.27732v1 and the right table/section2528RC0278,criterion,loc_dcr_hiv_att_5km_p_value,1,locator for dcr_hiv_att_5km_p_value names source arxiv-2609.27732v1 and the right table/section2529RC0278,criterion,loc_dcr_att_5km_ci_low,1,locator for dcr_att_5km_ci_low names source arxiv-2609.27732v1 and the right table/section2530RC0278,criterion,loc_dcr_att_5km_ci_high,1,locator for dcr_att_5km_ci_high names source arxiv-2609.27732v1 and the right table/section2531RC0278,criterion,loc_ri_wage_ate,1,locator for ri_wage_ate names source arxiv-2606.14621v1 and the right table/section2532RC0278,criterion,loc_ri_wage_ate_ci_low,1,locator for ri_wage_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2533RC0278,criterion,loc_ri_wage_ate_ci_high,1,locator for ri_wage_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2534RC0278,criterion,loc_ri_wage_ate_se_derived,1,locator for ri_wage_ate_se_derived names source arxiv-2606.14621v1 and the right table/section2535RC0278,criterion,loc_ri_control_mean_wage,1,locator for ri_control_mean_wage names source arxiv-2606.14621v1 and the right table/section2536RC0278,criterion,loc_ri_reemployment_ate_pp,1,locator for ri_reemployment_ate_pp names source arxiv-2606.14621v1 and the right table/section2537RC0278,criterion,loc_ri_weeks_ui_ate,1,locator for ri_weeks_ui_ate names source arxiv-2606.14621v1 and the right table/section2538RC0278,criterion,loc_ri_weeks_ui_ate_ci_low,1,locator for ri_weeks_ui_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2539RC0278,criterion,loc_ri_weeks_ui_ate_ci_high,1,locator for ri_weeks_ui_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2540RC0276,criterion,counts,1,"n_analysed (daily changes), n_missing_rows (blank DGS10 rows), n_train, n_test exact (±1 for the edge convention)"2541RC0276,criterion,anova,1,one-way ANOVA F statistic and p-value within 0.02 of the reference2542RC0276,criterion,monday_contrast,1,"Monday minus other-weekday mean change (bp) within 0.02 and its 95% CI bounds within 0.05 bp (Welch, pooled, HC or t/normal all accepted)"2543RC0276,criterion,oos_metrics,1,out-of-sample RMSE of the zero-change baseline and of the weekday-mean forecast within 0.01 bp2544RC0276,criterion,conclusion,1,conclusion code = no_detectable_effect (the correct negative result)2545RC0276,criterion,figure,1,out/figure1.png exists and is a valid PNG2546RC0276,criterion,table,1,out/table1.csv parses with >= 2 data rows2547RC0276,violation,supported_effect_claim,invalid_inference,claim marked 'supported' asserts weekday predictive content / an effect2548RC0280,criterion,dcr_table6_values,1,"Table 6 values exact as printed (ATT 5 km/3 km, SEs, observations 5 km)"2549RC0280,criterion,dcr_table7_values,1,"Table 7 values exact as printed (narcotics 3 km, fatal 1 km, HIV 5 km with SEs)"2550RC0280,criterion,ri_table2_values,1,"RESEA Table 2 values exact as printed (wage ATE + CI, control mean wage, reemployment ATE, weeks ATE + CI with sign)"2551RC0280,criterion,dcr_ci_derived,1,95% CI of the 5 km ATT derived from the printed SE: -0.431 ± z·0.210 (z = 1.96 or 2.0 accepted; tolerance 0.02)2552RC0280,criterion,ri_se_derived,1,SE implied by the wage CI: (2141-166)/(2z) ≈ 503.8 (z = 1.96) or 493.75 (z = 2); tolerance 152553RC0280,criterion,hiv_p_null,1,No exact p-value is printed for the HIV 5 km ATT (only the absence of stars) → null2554RC0280,criterion,hiv_not_sig,1,HIV 5 km ATT carries no star → not significant at 10%2555RC0280,criterion,ri_se_not_reported,1,"The RESEA tables print CIs, not SEs → ri_wage_ate_se_reported = false"2556RC0280,criterion,loc_dcr_att_5km,1,locator for dcr_att_5km names source arxiv-2609.27732v1 and the right table/section2557RC0280,criterion,loc_dcr_att_5km_se,1,locator for dcr_att_5km_se names source arxiv-2609.27732v1 and the right table/section2558RC0280,criterion,loc_dcr_att_3km,1,locator for dcr_att_3km names source arxiv-2609.27732v1 and the right table/section2559RC0280,criterion,loc_dcr_att_3km_se,1,locator for dcr_att_3km_se names source arxiv-2609.27732v1 and the right table/section2560RC0280,criterion,loc_dcr_obs_5km,1,locator for dcr_obs_5km names source arxiv-2609.27732v1 and the right table/section2561RC0280,criterion,loc_dcr_narcotics_att_3km,1,locator for dcr_narcotics_att_3km names source arxiv-2609.27732v1 and the right table/section2562RC0280,criterion,loc_dcr_narcotics_att_3km_se,1,locator for dcr_narcotics_att_3km_se names source arxiv-2609.27732v1 and the right table/section2563RC0280,criterion,loc_dcr_fatal_att_1km,1,locator for dcr_fatal_att_1km names source arxiv-2609.27732v1 and the right table/section2564RC0280,criterion,loc_dcr_fatal_att_1km_se,1,locator for dcr_fatal_att_1km_se names source arxiv-2609.27732v1 and the right table/section2565RC0280,criterion,loc_dcr_hiv_att_5km,1,locator for dcr_hiv_att_5km names source arxiv-2609.27732v1 and the right table/section2566RC0280,criterion,loc_dcr_hiv_att_5km_se,1,locator for dcr_hiv_att_5km_se names source arxiv-2609.27732v1 and the right table/section2567RC0280,criterion,loc_dcr_hiv_att_5km_p_value,1,locator for dcr_hiv_att_5km_p_value names source arxiv-2609.27732v1 and the right table/section2568RC0280,criterion,loc_dcr_att_5km_ci_low,1,locator for dcr_att_5km_ci_low names source arxiv-2609.27732v1 and the right table/section2569RC0280,criterion,loc_dcr_att_5km_ci_high,1,locator for dcr_att_5km_ci_high names source arxiv-2609.27732v1 and the right table/section2570RC0280,criterion,loc_ri_wage_ate,1,locator for ri_wage_ate names source arxiv-2606.14621v1 and the right table/section2571RC0280,criterion,loc_ri_wage_ate_ci_low,1,locator for ri_wage_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2572RC0280,criterion,loc_ri_wage_ate_ci_high,1,locator for ri_wage_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2573RC0280,criterion,loc_ri_wage_ate_se_derived,1,locator for ri_wage_ate_se_derived names source arxiv-2606.14621v1 and the right table/section2574RC0280,criterion,loc_ri_control_mean_wage,1,locator for ri_control_mean_wage names source arxiv-2606.14621v1 and the right table/section2575RC0280,criterion,loc_ri_reemployment_ate_pp,1,locator for ri_reemployment_ate_pp names source arxiv-2606.14621v1 and the right table/section2576RC0280,criterion,loc_ri_weeks_ui_ate,1,locator for ri_weeks_ui_ate names source arxiv-2606.14621v1 and the right table/section2577RC0280,criterion,loc_ri_weeks_ui_ate_ci_low,1,locator for ri_weeks_ui_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2578RC0280,criterion,loc_ri_weeks_ui_ate_ci_high,1,locator for ri_weeks_ui_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2579RC0279,criterion,dcr_table6_values,1,"Table 6 values exact as printed (ATT 5 km/3 km, SEs, observations 5 km)"2580RC0279,criterion,dcr_table7_values,1,"Table 7 values exact as printed (narcotics 3 km, fatal 1 km, HIV 5 km with SEs)"2581RC0279,criterion,ri_table2_values,1,"RESEA Table 2 values exact as printed (wage ATE + CI, control mean wage, reemployment ATE, weeks ATE + CI with sign)"2582RC0279,criterion,dcr_ci_derived,1,95% CI of the 5 km ATT derived from the printed SE: -0.431 ± z·0.210 (z = 1.96 or 2.0 accepted; tolerance 0.02)2583RC0279,criterion,ri_se_derived,1,SE implied by the wage CI: (2141-166)/(2z) ≈ 503.8 (z = 1.96) or 493.75 (z = 2); tolerance 152584RC0279,criterion,hiv_p_null,1,No exact p-value is printed for the HIV 5 km ATT (only the absence of stars) → null2585RC0279,criterion,hiv_not_sig,1,HIV 5 km ATT carries no star → not significant at 10%2586RC0279,criterion,ri_se_not_reported,1,"The RESEA tables print CIs, not SEs → ri_wage_ate_se_reported = false"2587RC0279,criterion,loc_dcr_att_5km,1,locator for dcr_att_5km names source arxiv-2609.27732v1 and the right table/section2588RC0279,criterion,loc_dcr_att_5km_se,1,locator for dcr_att_5km_se names source arxiv-2609.27732v1 and the right table/section2589RC0279,criterion,loc_dcr_att_3km,1,locator for dcr_att_3km names source arxiv-2609.27732v1 and the right table/section2590RC0279,criterion,loc_dcr_att_3km_se,1,locator for dcr_att_3km_se names source arxiv-2609.27732v1 and the right table/section2591RC0279,criterion,loc_dcr_obs_5km,1,locator for dcr_obs_5km names source arxiv-2609.27732v1 and the right table/section2592RC0279,criterion,loc_dcr_narcotics_att_3km,1,locator for dcr_narcotics_att_3km names source arxiv-2609.27732v1 and the right table/section2593RC0279,criterion,loc_dcr_narcotics_att_3km_se,1,locator for dcr_narcotics_att_3km_se names source arxiv-2609.27732v1 and the right table/section2594RC0279,criterion,loc_dcr_fatal_att_1km,1,locator for dcr_fatal_att_1km names source arxiv-2609.27732v1 and the right table/section2595RC0279,criterion,loc_dcr_fatal_att_1km_se,1,locator for dcr_fatal_att_1km_se names source arxiv-2609.27732v1 and the right table/section2596RC0279,criterion,loc_dcr_hiv_att_5km,1,locator for dcr_hiv_att_5km names source arxiv-2609.27732v1 and the right table/section2597RC0279,criterion,loc_dcr_hiv_att_5km_se,1,locator for dcr_hiv_att_5km_se names source arxiv-2609.27732v1 and the right table/section2598RC0279,criterion,loc_dcr_hiv_att_5km_p_value,1,locator for dcr_hiv_att_5km_p_value names source arxiv-2609.27732v1 and the right table/section2599RC0279,criterion,loc_dcr_att_5km_ci_low,1,locator for dcr_att_5km_ci_low names source arxiv-2609.27732v1 and the right table/section2600RC0279,criterion,loc_dcr_att_5km_ci_high,1,locator for dcr_att_5km_ci_high names source arxiv-2609.27732v1 and the right table/section2601RC0279,criterion,loc_ri_wage_ate,1,locator for ri_wage_ate names source arxiv-2606.14621v1 and the right table/section2602RC0279,criterion,loc_ri_wage_ate_ci_low,1,locator for ri_wage_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2603RC0279,criterion,loc_ri_wage_ate_ci_high,1,locator for ri_wage_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2604RC0279,criterion,loc_ri_wage_ate_se_derived,1,locator for ri_wage_ate_se_derived names source arxiv-2606.14621v1 and the right table/section2605RC0279,criterion,loc_ri_control_mean_wage,1,locator for ri_control_mean_wage names source arxiv-2606.14621v1 and the right table/section2606RC0279,criterion,loc_ri_reemployment_ate_pp,1,locator for ri_reemployment_ate_pp names source arxiv-2606.14621v1 and the right table/section2607RC0279,criterion,loc_ri_weeks_ui_ate,1,locator for ri_weeks_ui_ate names source arxiv-2606.14621v1 and the right table/section2608RC0279,criterion,loc_ri_weeks_ui_ate_ci_low,1,locator for ri_weeks_ui_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2609RC0279,criterion,loc_ri_weeks_ui_ate_ci_high,1,locator for ri_weeks_ui_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2610RC0281,criterion,dcr_table6_values,1,"Table 6 values exact as printed (ATT 5 km/3 km, SEs, observations 5 km)"2611RC0281,criterion,dcr_table7_values,1,"Table 7 values exact as printed (narcotics 3 km, fatal 1 km, HIV 5 km with SEs)"2612RC0281,criterion,ri_table2_values,1,"RESEA Table 2 values exact as printed (wage ATE + CI, control mean wage, reemployment ATE, weeks ATE + CI with sign)"2613RC0281,criterion,dcr_ci_derived,1,95% CI of the 5 km ATT derived from the printed SE: -0.431 ± z·0.210 (z = 1.96 or 2.0 accepted; tolerance 0.02)2614RC0281,criterion,ri_se_derived,1,SE implied by the wage CI: (2141-166)/(2z) ≈ 503.8 (z = 1.96) or 493.75 (z = 2); tolerance 152615RC0281,criterion,hiv_p_null,1,No exact p-value is printed for the HIV 5 km ATT (only the absence of stars) → null2616RC0281,criterion,hiv_not_sig,1,HIV 5 km ATT carries no star → not significant at 10%2617RC0281,criterion,ri_se_not_reported,1,"The RESEA tables print CIs, not SEs → ri_wage_ate_se_reported = false"2618RC0281,criterion,loc_dcr_att_5km,1,locator for dcr_att_5km names source arxiv-2609.27732v1 and the right table/section2619RC0281,criterion,loc_dcr_att_5km_se,1,locator for dcr_att_5km_se names source arxiv-2609.27732v1 and the right table/section2620RC0281,criterion,loc_dcr_att_3km,1,locator for dcr_att_3km names source arxiv-2609.27732v1 and the right table/section2621RC0281,criterion,loc_dcr_att_3km_se,1,locator for dcr_att_3km_se names source arxiv-2609.27732v1 and the right table/section2622RC0281,criterion,loc_dcr_obs_5km,1,locator for dcr_obs_5km names source arxiv-2609.27732v1 and the right table/section2623RC0281,criterion,loc_dcr_narcotics_att_3km,1,locator for dcr_narcotics_att_3km names source arxiv-2609.27732v1 and the right table/section2624RC0281,criterion,loc_dcr_narcotics_att_3km_se,1,locator for dcr_narcotics_att_3km_se names source arxiv-2609.27732v1 and the right table/section2625RC0281,criterion,loc_dcr_fatal_att_1km,1,locator for dcr_fatal_att_1km names source arxiv-2609.27732v1 and the right table/section2626RC0281,criterion,loc_dcr_fatal_att_1km_se,1,locator for dcr_fatal_att_1km_se names source arxiv-2609.27732v1 and the right table/section2627RC0281,criterion,loc_dcr_hiv_att_5km,1,locator for dcr_hiv_att_5km names source arxiv-2609.27732v1 and the right table/section2628RC0281,criterion,loc_dcr_hiv_att_5km_se,1,locator for dcr_hiv_att_5km_se names source arxiv-2609.27732v1 and the right table/section2629RC0281,criterion,loc_dcr_hiv_att_5km_p_value,1,locator for dcr_hiv_att_5km_p_value names source arxiv-2609.27732v1 and the right table/section2630RC0281,criterion,loc_dcr_att_5km_ci_low,1,locator for dcr_att_5km_ci_low names source arxiv-2609.27732v1 and the right table/section2631RC0281,criterion,loc_dcr_att_5km_ci_high,1,locator for dcr_att_5km_ci_high names source arxiv-2609.27732v1 and the right table/section2632RC0281,criterion,loc_ri_wage_ate,1,locator for ri_wage_ate names source arxiv-2606.14621v1 and the right table/section2633RC0281,criterion,loc_ri_wage_ate_ci_low,1,locator for ri_wage_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2634RC0281,criterion,loc_ri_wage_ate_ci_high,1,locator for ri_wage_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2635RC0281,criterion,loc_ri_wage_ate_se_derived,1,locator for ri_wage_ate_se_derived names source arxiv-2606.14621v1 and the right table/section2636RC0281,criterion,loc_ri_control_mean_wage,1,locator for ri_control_mean_wage names source arxiv-2606.14621v1 and the right table/section2637RC0281,criterion,loc_ri_reemployment_ate_pp,1,locator for ri_reemployment_ate_pp names source arxiv-2606.14621v1 and the right table/section2638RC0281,criterion,loc_ri_weeks_ui_ate,1,locator for ri_weeks_ui_ate names source arxiv-2606.14621v1 and the right table/section2639RC0281,criterion,loc_ri_weeks_ui_ate_ci_low,1,locator for ri_weeks_ui_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2640RC0281,criterion,loc_ri_weeks_ui_ate_ci_high,1,locator for ri_weeks_ui_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2641RC0284,criterion,dcr_table6_values,1,"Table 6 values exact as printed (ATT 5 km/3 km, SEs, observations 5 km)"2642RC0284,criterion,dcr_table7_values,1,"Table 7 values exact as printed (narcotics 3 km, fatal 1 km, HIV 5 km with SEs)"2643RC0284,criterion,ri_table2_values,1,"RESEA Table 2 values exact as printed (wage ATE + CI, control mean wage, reemployment ATE, weeks ATE + CI with sign)"2644RC0284,criterion,dcr_ci_derived,1,95% CI of the 5 km ATT derived from the printed SE: -0.431 ± z·0.210 (z = 1.96 or 2.0 accepted; tolerance 0.02)2645RC0284,criterion,ri_se_derived,1,SE implied by the wage CI: (2141-166)/(2z) ≈ 503.8 (z = 1.96) or 493.75 (z = 2); tolerance 152646RC0284,criterion,hiv_p_null,1,No exact p-value is printed for the HIV 5 km ATT (only the absence of stars) → null2647RC0284,criterion,hiv_not_sig,1,HIV 5 km ATT carries no star → not significant at 10%2648RC0284,criterion,ri_se_not_reported,1,"The RESEA tables print CIs, not SEs → ri_wage_ate_se_reported = false"2649RC0284,criterion,loc_dcr_att_5km,1,locator for dcr_att_5km names source arxiv-2609.27732v1 and the right table/section2650RC0284,criterion,loc_dcr_att_5km_se,1,locator for dcr_att_5km_se names source arxiv-2609.27732v1 and the right table/section2651RC0284,criterion,loc_dcr_att_3km,1,locator for dcr_att_3km names source arxiv-2609.27732v1 and the right table/section2652RC0284,criterion,loc_dcr_att_3km_se,1,locator for dcr_att_3km_se names source arxiv-2609.27732v1 and the right table/section2653RC0284,criterion,loc_dcr_obs_5km,1,locator for dcr_obs_5km names source arxiv-2609.27732v1 and the right table/section2654RC0284,criterion,loc_dcr_narcotics_att_3km,1,locator for dcr_narcotics_att_3km names source arxiv-2609.27732v1 and the right table/section2655RC0284,criterion,loc_dcr_narcotics_att_3km_se,1,locator for dcr_narcotics_att_3km_se names source arxiv-2609.27732v1 and the right table/section2656RC0284,criterion,loc_dcr_fatal_att_1km,1,locator for dcr_fatal_att_1km names source arxiv-2609.27732v1 and the right table/section2657RC0284,criterion,loc_dcr_fatal_att_1km_se,1,locator for dcr_fatal_att_1km_se names source arxiv-2609.27732v1 and the right table/section2658RC0284,criterion,loc_dcr_hiv_att_5km,1,locator for dcr_hiv_att_5km names source arxiv-2609.27732v1 and the right table/section2659RC0284,criterion,loc_dcr_hiv_att_5km_se,1,locator for dcr_hiv_att_5km_se names source arxiv-2609.27732v1 and the right table/section2660RC0284,criterion,loc_dcr_hiv_att_5km_p_value,1,locator for dcr_hiv_att_5km_p_value names source arxiv-2609.27732v1 and the right table/section2661RC0284,criterion,loc_dcr_att_5km_ci_low,1,locator for dcr_att_5km_ci_low names source arxiv-2609.27732v1 and the right table/section2662RC0284,criterion,loc_dcr_att_5km_ci_high,1,locator for dcr_att_5km_ci_high names source arxiv-2609.27732v1 and the right table/section2663RC0284,criterion,loc_ri_wage_ate,1,locator for ri_wage_ate names source arxiv-2606.14621v1 and the right table/section2664RC0284,criterion,loc_ri_wage_ate_ci_low,1,locator for ri_wage_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2665RC0284,criterion,loc_ri_wage_ate_ci_high,1,locator for ri_wage_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2666RC0284,criterion,loc_ri_wage_ate_se_derived,1,locator for ri_wage_ate_se_derived names source arxiv-2606.14621v1 and the right table/section2667RC0284,criterion,loc_ri_control_mean_wage,1,locator for ri_control_mean_wage names source arxiv-2606.14621v1 and the right table/section2668RC0284,criterion,loc_ri_reemployment_ate_pp,1,locator for ri_reemployment_ate_pp names source arxiv-2606.14621v1 and the right table/section2669RC0284,criterion,loc_ri_weeks_ui_ate,1,locator for ri_weeks_ui_ate names source arxiv-2606.14621v1 and the right table/section2670RC0284,criterion,loc_ri_weeks_ui_ate_ci_low,1,locator for ri_weeks_ui_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2671RC0284,criterion,loc_ri_weeks_ui_ate_ci_high,1,locator for ri_weeks_ui_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2672RC0282,criterion,dcr_table6_values,1,"Table 6 values exact as printed (ATT 5 km/3 km, SEs, observations 5 km)"2673RC0282,criterion,dcr_table7_values,1,"Table 7 values exact as printed (narcotics 3 km, fatal 1 km, HIV 5 km with SEs)"2674RC0282,criterion,ri_table2_values,1,"RESEA Table 2 values exact as printed (wage ATE + CI, control mean wage, reemployment ATE, weeks ATE + CI with sign)"2675RC0282,criterion,dcr_ci_derived,1,95% CI of the 5 km ATT derived from the printed SE: -0.431 ± z·0.210 (z = 1.96 or 2.0 accepted; tolerance 0.02)2676RC0282,criterion,ri_se_derived,1,SE implied by the wage CI: (2141-166)/(2z) ≈ 503.8 (z = 1.96) or 493.75 (z = 2); tolerance 152677RC0282,criterion,hiv_p_null,1,No exact p-value is printed for the HIV 5 km ATT (only the absence of stars) → null2678RC0282,criterion,hiv_not_sig,1,HIV 5 km ATT carries no star → not significant at 10%2679RC0282,criterion,ri_se_not_reported,1,"The RESEA tables print CIs, not SEs → ri_wage_ate_se_reported = false"2680RC0282,criterion,loc_dcr_att_5km,1,locator for dcr_att_5km names source arxiv-2609.27732v1 and the right table/section2681RC0282,criterion,loc_dcr_att_5km_se,1,locator for dcr_att_5km_se names source arxiv-2609.27732v1 and the right table/section2682RC0282,criterion,loc_dcr_att_3km,1,locator for dcr_att_3km names source arxiv-2609.27732v1 and the right table/section2683RC0282,criterion,loc_dcr_att_3km_se,1,locator for dcr_att_3km_se names source arxiv-2609.27732v1 and the right table/section2684RC0282,criterion,loc_dcr_obs_5km,1,locator for dcr_obs_5km names source arxiv-2609.27732v1 and the right table/section2685RC0282,criterion,loc_dcr_narcotics_att_3km,1,locator for dcr_narcotics_att_3km names source arxiv-2609.27732v1 and the right table/section2686RC0282,criterion,loc_dcr_narcotics_att_3km_se,1,locator for dcr_narcotics_att_3km_se names source arxiv-2609.27732v1 and the right table/section2687RC0282,criterion,loc_dcr_fatal_att_1km,1,locator for dcr_fatal_att_1km names source arxiv-2609.27732v1 and the right table/section2688RC0282,criterion,loc_dcr_fatal_att_1km_se,1,locator for dcr_fatal_att_1km_se names source arxiv-2609.27732v1 and the right table/section2689RC0282,criterion,loc_dcr_hiv_att_5km,1,locator for dcr_hiv_att_5km names source arxiv-2609.27732v1 and the right table/section2690RC0282,criterion,loc_dcr_hiv_att_5km_se,1,locator for dcr_hiv_att_5km_se names source arxiv-2609.27732v1 and the right table/section2691RC0282,criterion,loc_dcr_hiv_att_5km_p_value,1,locator for dcr_hiv_att_5km_p_value names source arxiv-2609.27732v1 and the right table/section2692RC0282,criterion,loc_dcr_att_5km_ci_low,1,locator for dcr_att_5km_ci_low names source arxiv-2609.27732v1 and the right table/section2693RC0282,criterion,loc_dcr_att_5km_ci_high,1,locator for dcr_att_5km_ci_high names source arxiv-2609.27732v1 and the right table/section2694RC0282,criterion,loc_ri_wage_ate,1,locator for ri_wage_ate names source arxiv-2606.14621v1 and the right table/section2695RC0282,criterion,loc_ri_wage_ate_ci_low,1,locator for ri_wage_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2696RC0282,criterion,loc_ri_wage_ate_ci_high,1,locator for ri_wage_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2697RC0282,criterion,loc_ri_wage_ate_se_derived,1,locator for ri_wage_ate_se_derived names source arxiv-2606.14621v1 and the right table/section2698RC0282,criterion,loc_ri_control_mean_wage,1,locator for ri_control_mean_wage names source arxiv-2606.14621v1 and the right table/section2699RC0282,criterion,loc_ri_reemployment_ate_pp,1,locator for ri_reemployment_ate_pp names source arxiv-2606.14621v1 and the right table/section2700RC0282,criterion,loc_ri_weeks_ui_ate,1,locator for ri_weeks_ui_ate names source arxiv-2606.14621v1 and the right table/section2701RC0282,criterion,loc_ri_weeks_ui_ate_ci_low,1,locator for ri_weeks_ui_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2702RC0282,criterion,loc_ri_weeks_ui_ate_ci_high,1,locator for ri_weeks_ui_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2703RC0285,criterion,dcr_table6_values,1,"Table 6 values exact as printed (ATT 5 km/3 km, SEs, observations 5 km)"2704RC0285,criterion,dcr_table7_values,1,"Table 7 values exact as printed (narcotics 3 km, fatal 1 km, HIV 5 km with SEs)"2705RC0285,criterion,ri_table2_values,1,"RESEA Table 2 values exact as printed (wage ATE + CI, control mean wage, reemployment ATE, weeks ATE + CI with sign)"2706RC0285,criterion,dcr_ci_derived,1,95% CI of the 5 km ATT derived from the printed SE: -0.431 ± z·0.210 (z = 1.96 or 2.0 accepted; tolerance 0.02)2707RC0285,criterion,ri_se_derived,1,SE implied by the wage CI: (2141-166)/(2z) ≈ 503.8 (z = 1.96) or 493.75 (z = 2); tolerance 152708RC0285,criterion,hiv_p_null,1,No exact p-value is printed for the HIV 5 km ATT (only the absence of stars) → null2709RC0285,criterion,hiv_not_sig,1,HIV 5 km ATT carries no star → not significant at 10%2710RC0285,criterion,ri_se_not_reported,1,"The RESEA tables print CIs, not SEs → ri_wage_ate_se_reported = false"2711RC0285,criterion,loc_dcr_att_5km,1,locator for dcr_att_5km names source arxiv-2609.27732v1 and the right table/section2712RC0285,criterion,loc_dcr_att_5km_se,1,locator for dcr_att_5km_se names source arxiv-2609.27732v1 and the right table/section2713RC0285,criterion,loc_dcr_att_3km,1,locator for dcr_att_3km names source arxiv-2609.27732v1 and the right table/section2714RC0285,criterion,loc_dcr_att_3km_se,1,locator for dcr_att_3km_se names source arxiv-2609.27732v1 and the right table/section2715RC0285,criterion,loc_dcr_obs_5km,1,locator for dcr_obs_5km names source arxiv-2609.27732v1 and the right table/section2716RC0285,criterion,loc_dcr_narcotics_att_3km,1,locator for dcr_narcotics_att_3km names source arxiv-2609.27732v1 and the right table/section2717RC0285,criterion,loc_dcr_narcotics_att_3km_se,1,locator for dcr_narcotics_att_3km_se names source arxiv-2609.27732v1 and the right table/section2718RC0285,criterion,loc_dcr_fatal_att_1km,1,locator for dcr_fatal_att_1km names source arxiv-2609.27732v1 and the right table/section2719RC0285,criterion,loc_dcr_fatal_att_1km_se,1,locator for dcr_fatal_att_1km_se names source arxiv-2609.27732v1 and the right table/section2720RC0285,criterion,loc_dcr_hiv_att_5km,1,locator for dcr_hiv_att_5km names source arxiv-2609.27732v1 and the right table/section2721RC0285,criterion,loc_dcr_hiv_att_5km_se,1,locator for dcr_hiv_att_5km_se names source arxiv-2609.27732v1 and the right table/section2722RC0285,criterion,loc_dcr_hiv_att_5km_p_value,1,locator for dcr_hiv_att_5km_p_value names source arxiv-2609.27732v1 and the right table/section2723RC0285,criterion,loc_dcr_att_5km_ci_low,1,locator for dcr_att_5km_ci_low names source arxiv-2609.27732v1 and the right table/section2724RC0285,criterion,loc_dcr_att_5km_ci_high,1,locator for dcr_att_5km_ci_high names source arxiv-2609.27732v1 and the right table/section2725RC0285,criterion,loc_ri_wage_ate,1,locator for ri_wage_ate names source arxiv-2606.14621v1 and the right table/section2726RC0285,criterion,loc_ri_wage_ate_ci_low,1,locator for ri_wage_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2727RC0285,criterion,loc_ri_wage_ate_ci_high,1,locator for ri_wage_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2728RC0285,criterion,loc_ri_wage_ate_se_derived,1,locator for ri_wage_ate_se_derived names source arxiv-2606.14621v1 and the right table/section2729RC0285,criterion,loc_ri_control_mean_wage,1,locator for ri_control_mean_wage names source arxiv-2606.14621v1 and the right table/section2730RC0285,criterion,loc_ri_reemployment_ate_pp,1,locator for ri_reemployment_ate_pp names source arxiv-2606.14621v1 and the right table/section2731RC0285,criterion,loc_ri_weeks_ui_ate,1,locator for ri_weeks_ui_ate names source arxiv-2606.14621v1 and the right table/section2732RC0285,criterion,loc_ri_weeks_ui_ate_ci_low,1,locator for ri_weeks_ui_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2733RC0285,criterion,loc_ri_weeks_ui_ate_ci_high,1,locator for ri_weeks_ui_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2734RC0286,criterion,dcr_table6_values,1,"Table 6 values exact as printed (ATT 5 km/3 km, SEs, observations 5 km)"2735RC0286,criterion,dcr_table7_values,1,"Table 7 values exact as printed (narcotics 3 km, fatal 1 km, HIV 5 km with SEs)"2736RC0286,criterion,ri_table2_values,1,"RESEA Table 2 values exact as printed (wage ATE + CI, control mean wage, reemployment ATE, weeks ATE + CI with sign)"2737RC0286,criterion,dcr_ci_derived,1,95% CI of the 5 km ATT derived from the printed SE: -0.431 ± z·0.210 (z = 1.96 or 2.0 accepted; tolerance 0.02)2738RC0286,criterion,ri_se_derived,1,SE implied by the wage CI: (2141-166)/(2z) ≈ 503.8 (z = 1.96) or 493.75 (z = 2); tolerance 152739RC0286,criterion,hiv_p_null,1,No exact p-value is printed for the HIV 5 km ATT (only the absence of stars) → null2740RC0286,criterion,hiv_not_sig,1,HIV 5 km ATT carries no star → not significant at 10%2741RC0286,criterion,ri_se_not_reported,1,"The RESEA tables print CIs, not SEs → ri_wage_ate_se_reported = false"2742RC0286,criterion,loc_dcr_att_5km,1,locator for dcr_att_5km names source arxiv-2609.27732v1 and the right table/section2743RC0286,criterion,loc_dcr_att_5km_se,1,locator for dcr_att_5km_se names source arxiv-2609.27732v1 and the right table/section2744RC0286,criterion,loc_dcr_att_3km,1,locator for dcr_att_3km names source arxiv-2609.27732v1 and the right table/section2745RC0286,criterion,loc_dcr_att_3km_se,1,locator for dcr_att_3km_se names source arxiv-2609.27732v1 and the right table/section2746RC0286,criterion,loc_dcr_obs_5km,1,locator for dcr_obs_5km names source arxiv-2609.27732v1 and the right table/section2747RC0286,criterion,loc_dcr_narcotics_att_3km,1,locator for dcr_narcotics_att_3km names source arxiv-2609.27732v1 and the right table/section2748RC0286,criterion,loc_dcr_narcotics_att_3km_se,1,locator for dcr_narcotics_att_3km_se names source arxiv-2609.27732v1 and the right table/section2749RC0286,criterion,loc_dcr_fatal_att_1km,1,locator for dcr_fatal_att_1km names source arxiv-2609.27732v1 and the right table/section2750RC0286,criterion,loc_dcr_fatal_att_1km_se,1,locator for dcr_fatal_att_1km_se names source arxiv-2609.27732v1 and the right table/section2751RC0286,criterion,loc_dcr_hiv_att_5km,1,locator for dcr_hiv_att_5km names source arxiv-2609.27732v1 and the right table/section2752RC0286,criterion,loc_dcr_hiv_att_5km_se,1,locator for dcr_hiv_att_5km_se names source arxiv-2609.27732v1 and the right table/section2753RC0286,criterion,loc_dcr_hiv_att_5km_p_value,1,locator for dcr_hiv_att_5km_p_value names source arxiv-2609.27732v1 and the right table/section2754RC0286,criterion,loc_dcr_att_5km_ci_low,1,locator for dcr_att_5km_ci_low names source arxiv-2609.27732v1 and the right table/section2755RC0286,criterion,loc_dcr_att_5km_ci_high,1,locator for dcr_att_5km_ci_high names source arxiv-2609.27732v1 and the right table/section2756RC0286,criterion,loc_ri_wage_ate,1,locator for ri_wage_ate names source arxiv-2606.14621v1 and the right table/section2757RC0286,criterion,loc_ri_wage_ate_ci_low,1,locator for ri_wage_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2758RC0286,criterion,loc_ri_wage_ate_ci_high,1,locator for ri_wage_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2759RC0286,criterion,loc_ri_wage_ate_se_derived,1,locator for ri_wage_ate_se_derived names source arxiv-2606.14621v1 and the right table/section2760RC0286,criterion,loc_ri_control_mean_wage,1,locator for ri_control_mean_wage names source arxiv-2606.14621v1 and the right table/section2761RC0286,criterion,loc_ri_reemployment_ate_pp,1,locator for ri_reemployment_ate_pp names source arxiv-2606.14621v1 and the right table/section2762RC0286,criterion,loc_ri_weeks_ui_ate,1,locator for ri_weeks_ui_ate names source arxiv-2606.14621v1 and the right table/section2763RC0286,criterion,loc_ri_weeks_ui_ate_ci_low,1,locator for ri_weeks_ui_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2764RC0286,criterion,loc_ri_weeks_ui_ate_ci_high,1,locator for ri_weeks_ui_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2765RC0283,criterion,dcr_table6_values,1,"Table 6 values exact as printed (ATT 5 km/3 km, SEs, observations 5 km)"2766RC0283,criterion,dcr_table7_values,1,"Table 7 values exact as printed (narcotics 3 km, fatal 1 km, HIV 5 km with SEs)"2767RC0283,criterion,ri_table2_values,1,"RESEA Table 2 values exact as printed (wage ATE + CI, control mean wage, reemployment ATE, weeks ATE + CI with sign)"2768RC0283,criterion,dcr_ci_derived,1,95% CI of the 5 km ATT derived from the printed SE: -0.431 ± z·0.210 (z = 1.96 or 2.0 accepted; tolerance 0.02)2769RC0283,criterion,ri_se_derived,1,SE implied by the wage CI: (2141-166)/(2z) ≈ 503.8 (z = 1.96) or 493.75 (z = 2); tolerance 152770RC0283,criterion,hiv_p_null,1,No exact p-value is printed for the HIV 5 km ATT (only the absence of stars) → null2771RC0283,criterion,hiv_not_sig,1,HIV 5 km ATT carries no star → not significant at 10%2772RC0283,criterion,ri_se_not_reported,1,"The RESEA tables print CIs, not SEs → ri_wage_ate_se_reported = false"2773RC0283,criterion,loc_dcr_att_5km,1,locator for dcr_att_5km names source arxiv-2609.27732v1 and the right table/section2774RC0283,criterion,loc_dcr_att_5km_se,1,locator for dcr_att_5km_se names source arxiv-2609.27732v1 and the right table/section2775RC0283,criterion,loc_dcr_att_3km,1,locator for dcr_att_3km names source arxiv-2609.27732v1 and the right table/section2776RC0283,criterion,loc_dcr_att_3km_se,1,locator for dcr_att_3km_se names source arxiv-2609.27732v1 and the right table/section2777RC0283,criterion,loc_dcr_obs_5km,1,locator for dcr_obs_5km names source arxiv-2609.27732v1 and the right table/section2778RC0283,criterion,loc_dcr_narcotics_att_3km,1,locator for dcr_narcotics_att_3km names source arxiv-2609.27732v1 and the right table/section2779RC0283,criterion,loc_dcr_narcotics_att_3km_se,1,locator for dcr_narcotics_att_3km_se names source arxiv-2609.27732v1 and the right table/section2780RC0283,criterion,loc_dcr_fatal_att_1km,1,locator for dcr_fatal_att_1km names source arxiv-2609.27732v1 and the right table/section2781RC0283,criterion,loc_dcr_fatal_att_1km_se,1,locator for dcr_fatal_att_1km_se names source arxiv-2609.27732v1 and the right table/section2782RC0283,criterion,loc_dcr_hiv_att_5km,1,locator for dcr_hiv_att_5km names source arxiv-2609.27732v1 and the right table/section2783RC0283,criterion,loc_dcr_hiv_att_5km_se,1,locator for dcr_hiv_att_5km_se names source arxiv-2609.27732v1 and the right table/section2784RC0283,criterion,loc_dcr_hiv_att_5km_p_value,1,locator for dcr_hiv_att_5km_p_value names source arxiv-2609.27732v1 and the right table/section2785RC0283,criterion,loc_dcr_att_5km_ci_low,1,locator for dcr_att_5km_ci_low names source arxiv-2609.27732v1 and the right table/section2786RC0283,criterion,loc_dcr_att_5km_ci_high,1,locator for dcr_att_5km_ci_high names source arxiv-2609.27732v1 and the right table/section2787RC0283,criterion,loc_ri_wage_ate,1,locator for ri_wage_ate names source arxiv-2606.14621v1 and the right table/section2788RC0283,criterion,loc_ri_wage_ate_ci_low,1,locator for ri_wage_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2789RC0283,criterion,loc_ri_wage_ate_ci_high,1,locator for ri_wage_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2790RC0283,criterion,loc_ri_wage_ate_se_derived,1,locator for ri_wage_ate_se_derived names source arxiv-2606.14621v1 and the right table/section2791RC0283,criterion,loc_ri_control_mean_wage,1,locator for ri_control_mean_wage names source arxiv-2606.14621v1 and the right table/section2792RC0283,criterion,loc_ri_reemployment_ate_pp,1,locator for ri_reemployment_ate_pp names source arxiv-2606.14621v1 and the right table/section2793RC0283,criterion,loc_ri_weeks_ui_ate,1,locator for ri_weeks_ui_ate names source arxiv-2606.14621v1 and the right table/section2794RC0283,criterion,loc_ri_weeks_ui_ate_ci_low,1,locator for ri_weeks_ui_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2795RC0283,criterion,loc_ri_weeks_ui_ate_ci_high,1,locator for ri_weeks_ui_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2796RC0287,criterion,dcr_table6_values,1,"Table 6 values exact as printed (ATT 5 km/3 km, SEs, observations 5 km)"2797RC0287,criterion,dcr_table7_values,1,"Table 7 values exact as printed (narcotics 3 km, fatal 1 km, HIV 5 km with SEs)"2798RC0287,criterion,ri_table2_values,1,"RESEA Table 2 values exact as printed (wage ATE + CI, control mean wage, reemployment ATE, weeks ATE + CI with sign)"2799RC0287,criterion,dcr_ci_derived,1,95% CI of the 5 km ATT derived from the printed SE: -0.431 ± z·0.210 (z = 1.96 or 2.0 accepted; tolerance 0.02)2800RC0287,criterion,ri_se_derived,1,SE implied by the wage CI: (2141-166)/(2z) ≈ 503.8 (z = 1.96) or 493.75 (z = 2); tolerance 152801RC0287,criterion,hiv_p_null,1,No exact p-value is printed for the HIV 5 km ATT (only the absence of stars) → null2802RC0287,criterion,hiv_not_sig,1,HIV 5 km ATT carries no star → not significant at 10%2803RC0287,criterion,ri_se_not_reported,1,"The RESEA tables print CIs, not SEs → ri_wage_ate_se_reported = false"2804RC0287,criterion,loc_dcr_att_5km,1,locator for dcr_att_5km names source arxiv-2609.27732v1 and the right table/section2805RC0287,criterion,loc_dcr_att_5km_se,1,locator for dcr_att_5km_se names source arxiv-2609.27732v1 and the right table/section2806RC0287,criterion,loc_dcr_att_3km,1,locator for dcr_att_3km names source arxiv-2609.27732v1 and the right table/section2807RC0287,criterion,loc_dcr_att_3km_se,1,locator for dcr_att_3km_se names source arxiv-2609.27732v1 and the right table/section2808RC0287,criterion,loc_dcr_obs_5km,1,locator for dcr_obs_5km names source arxiv-2609.27732v1 and the right table/section2809RC0287,criterion,loc_dcr_narcotics_att_3km,1,locator for dcr_narcotics_att_3km names source arxiv-2609.27732v1 and the right table/section2810RC0287,criterion,loc_dcr_narcotics_att_3km_se,1,locator for dcr_narcotics_att_3km_se names source arxiv-2609.27732v1 and the right table/section2811RC0287,criterion,loc_dcr_fatal_att_1km,1,locator for dcr_fatal_att_1km names source arxiv-2609.27732v1 and the right table/section2812RC0287,criterion,loc_dcr_fatal_att_1km_se,1,locator for dcr_fatal_att_1km_se names source arxiv-2609.27732v1 and the right table/section2813RC0287,criterion,loc_dcr_hiv_att_5km,1,locator for dcr_hiv_att_5km names source arxiv-2609.27732v1 and the right table/section2814RC0287,criterion,loc_dcr_hiv_att_5km_se,1,locator for dcr_hiv_att_5km_se names source arxiv-2609.27732v1 and the right table/section2815RC0287,criterion,loc_dcr_hiv_att_5km_p_value,1,locator for dcr_hiv_att_5km_p_value names source arxiv-2609.27732v1 and the right table/section2816RC0287,criterion,loc_dcr_att_5km_ci_low,1,locator for dcr_att_5km_ci_low names source arxiv-2609.27732v1 and the right table/section2817RC0287,criterion,loc_dcr_att_5km_ci_high,1,locator for dcr_att_5km_ci_high names source arxiv-2609.27732v1 and the right table/section2818RC0287,criterion,loc_ri_wage_ate,1,locator for ri_wage_ate names source arxiv-2606.14621v1 and the right table/section2819RC0287,criterion,loc_ri_wage_ate_ci_low,1,locator for ri_wage_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2820RC0287,criterion,loc_ri_wage_ate_ci_high,1,locator for ri_wage_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2821RC0287,criterion,loc_ri_wage_ate_se_derived,1,locator for ri_wage_ate_se_derived names source arxiv-2606.14621v1 and the right table/section2822RC0287,criterion,loc_ri_control_mean_wage,1,locator for ri_control_mean_wage names source arxiv-2606.14621v1 and the right table/section2823RC0287,criterion,loc_ri_reemployment_ate_pp,1,locator for ri_reemployment_ate_pp names source arxiv-2606.14621v1 and the right table/section2824RC0287,criterion,loc_ri_weeks_ui_ate,1,locator for ri_weeks_ui_ate names source arxiv-2606.14621v1 and the right table/section2825RC0287,criterion,loc_ri_weeks_ui_ate_ci_low,1,locator for ri_weeks_ui_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2826RC0287,criterion,loc_ri_weeks_ui_ate_ci_high,1,locator for ri_weeks_ui_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2827RC0288,criterion,dcr_table6_values,1,"Table 6 values exact as printed (ATT 5 km/3 km, SEs, observations 5 km)"2828RC0288,criterion,dcr_table7_values,1,"Table 7 values exact as printed (narcotics 3 km, fatal 1 km, HIV 5 km with SEs)"2829RC0288,criterion,ri_table2_values,1,"RESEA Table 2 values exact as printed (wage ATE + CI, control mean wage, reemployment ATE, weeks ATE + CI with sign)"2830RC0288,criterion,dcr_ci_derived,1,95% CI of the 5 km ATT derived from the printed SE: -0.431 ± z·0.210 (z = 1.96 or 2.0 accepted; tolerance 0.02)2831RC0288,criterion,ri_se_derived,1,SE implied by the wage CI: (2141-166)/(2z) ≈ 503.8 (z = 1.96) or 493.75 (z = 2); tolerance 152832RC0288,criterion,hiv_p_null,1,No exact p-value is printed for the HIV 5 km ATT (only the absence of stars) → null2833RC0288,criterion,hiv_not_sig,1,HIV 5 km ATT carries no star → not significant at 10%2834RC0288,criterion,ri_se_not_reported,1,"The RESEA tables print CIs, not SEs → ri_wage_ate_se_reported = false"2835RC0288,criterion,loc_dcr_att_5km,1,locator for dcr_att_5km names source arxiv-2609.27732v1 and the right table/section2836RC0288,criterion,loc_dcr_att_5km_se,1,locator for dcr_att_5km_se names source arxiv-2609.27732v1 and the right table/section2837RC0288,criterion,loc_dcr_att_3km,1,locator for dcr_att_3km names source arxiv-2609.27732v1 and the right table/section2838RC0288,criterion,loc_dcr_att_3km_se,1,locator for dcr_att_3km_se names source arxiv-2609.27732v1 and the right table/section2839RC0288,criterion,loc_dcr_obs_5km,1,locator for dcr_obs_5km names source arxiv-2609.27732v1 and the right table/section2840RC0288,criterion,loc_dcr_narcotics_att_3km,1,locator for dcr_narcotics_att_3km names source arxiv-2609.27732v1 and the right table/section2841RC0288,criterion,loc_dcr_narcotics_att_3km_se,1,locator for dcr_narcotics_att_3km_se names source arxiv-2609.27732v1 and the right table/section2842RC0288,criterion,loc_dcr_fatal_att_1km,1,locator for dcr_fatal_att_1km names source arxiv-2609.27732v1 and the right table/section2843RC0288,criterion,loc_dcr_fatal_att_1km_se,1,locator for dcr_fatal_att_1km_se names source arxiv-2609.27732v1 and the right table/section2844RC0288,criterion,loc_dcr_hiv_att_5km,1,locator for dcr_hiv_att_5km names source arxiv-2609.27732v1 and the right table/section2845RC0288,criterion,loc_dcr_hiv_att_5km_se,1,locator for dcr_hiv_att_5km_se names source arxiv-2609.27732v1 and the right table/section2846RC0288,criterion,loc_dcr_hiv_att_5km_p_value,1,locator for dcr_hiv_att_5km_p_value names source arxiv-2609.27732v1 and the right table/section2847RC0288,criterion,loc_dcr_att_5km_ci_low,1,locator for dcr_att_5km_ci_low names source arxiv-2609.27732v1 and the right table/section2848RC0288,criterion,loc_dcr_att_5km_ci_high,1,locator for dcr_att_5km_ci_high names source arxiv-2609.27732v1 and the right table/section2849RC0288,criterion,loc_ri_wage_ate,1,locator for ri_wage_ate names source arxiv-2606.14621v1 and the right table/section2850RC0288,criterion,loc_ri_wage_ate_ci_low,1,locator for ri_wage_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2851RC0288,criterion,loc_ri_wage_ate_ci_high,1,locator for ri_wage_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2852RC0288,criterion,loc_ri_wage_ate_se_derived,1,locator for ri_wage_ate_se_derived names source arxiv-2606.14621v1 and the right table/section2853RC0288,criterion,loc_ri_control_mean_wage,1,locator for ri_control_mean_wage names source arxiv-2606.14621v1 and the right table/section2854RC0288,criterion,loc_ri_reemployment_ate_pp,1,locator for ri_reemployment_ate_pp names source arxiv-2606.14621v1 and the right table/section2855RC0288,criterion,loc_ri_weeks_ui_ate,1,locator for ri_weeks_ui_ate names source arxiv-2606.14621v1 and the right table/section2856RC0288,criterion,loc_ri_weeks_ui_ate_ci_low,1,locator for ri_weeks_ui_ate_ci_low names source arxiv-2606.14621v1 and the right table/section2857RC0288,criterion,loc_ri_weeks_ui_ate_ci_high,1,locator for ri_weeks_ui_ate_ci_high names source arxiv-2606.14621v1 and the right table/section2858RT0001,criterion,extraction_printed,1,printed values of the five items present in estimate/uncertainty_as_printed2859RT0001,criterion,harmonised_values,1,harmonised theta S1-S4 within tolerance; S5 null2860RT0001,criterion,harmonised_ses,1,"harmonised SE for S1 and S4 within tolerance; null for S2, S3, S5"2861RT0001,criterion,flags_counts,1,harmonisable/poolable flags and k counts equal the reference2862RT0001,criterion,pooled,1,"FE/RE estimates, SEs, tau2, I2, Q within tolerance; CIs and pct change consistent"2863RT0001,criterion,interpretation,1,heterogeneity_interpretation = low; pooled_significant_5pct = false2864RT0001,criterion,artifacts,1,"table1.csv (5 rows, required columns) and figure1.png present"2865RT0003,criterion,extraction_printed,1,printed values of the five items present in estimate/uncertainty_as_printed2866RT0003,criterion,harmonised_values,1,harmonised theta S1-S4 within tolerance; S5 null2867RT0003,criterion,harmonised_ses,1,"harmonised SE for S1 and S4 within tolerance; null for S2, S3, S5"2868RT0003,criterion,flags_counts,1,harmonisable/poolable flags and k counts equal the reference2869RT0003,criterion,pooled,1,"FE/RE estimates, SEs, tau2, I2, Q within tolerance; CIs and pct change consistent"2870RT0003,criterion,interpretation,1,heterogeneity_interpretation = low; pooled_significant_5pct = false2871RT0003,criterion,artifacts,1,"table1.csv (5 rows, required columns) and figure1.png present"2872RA0002,criterion,cov_conv,1,Empirical coverage of the conventional 95% CI within 3 binomial MC SEs (R=2000) of the true coverage2873RA0002,criterion,cov_hc1,1,Empirical coverage of the HC1 95% CI within 3 binomial MC SEs (R=2000) of the true coverage2874RA0002,criterion,sd_exact,1,Exact SD of beta_hat under the design (analytical sandwich) to 1e-5 relative2875RA0002,criterion,sd_mc,1,Monte Carlo SD of beta_hat within 3 SEs of the sample SD at R=20002876RA0002,criterion,mean_se,1,Mean conventional SE over replications within 3 MC SEs2877RA0002,criterion,counts,1,n_replications = 2000 and n_obs_per_replication = 302878RA0002,criterion,undercover_flag,1,conventional_ci_undercovers must be true (true coverage is far below 0.95)2879RA0002,criterion,seed_reported,1,random_seed is a non-null integer (the simulation must be seeded and reproducible)2880RA0001,criterion,tau_point,1,Student-weighted difference in means (OLS of score on treated) equals reference to 1e-42881RA0001,criterion,se_valid,1,"Reported SE within +/-15% of the CR1 school-clustered reference (accepts CR0/CR1/CR2/CR3, school-mean t-test, random-intercept model, wild cluster bootstrap; rejects i.i.d./HC SEs at ~0.41x and over-inflated SEs)"2882RA0001,criterion,p_value,1,Two-sided p-value for tau = 0 within 0.06 of the clustered t(G-2) reference2883RA0001,criterion,ci,1,95% CI bounds within 0.12 of the reference (critical-value and CR-convention differences)2884RA0001,criterion,icc,1,"Intraclass correlation of the residual within 0.06 of the ANOVA reference (ANOVA, ML and REML estimators all accepted)"2885RA0001,criterion,counts,1,"n_schools, n_treated_schools, n_analysed exact"2886RA0001,criterion,not_significant,1,effect_significant_5pct must be false (the valid clustered test does not reject at 5%)2887RR0003,criterion,naive_h1,1,Naive RMSE and MAE at h=1 equal the exact reference (rel 1e-6); 35 evaluated pairs (target 2025-10 missing)2888RR0003,criterion,naive_h3,1,Naive RMSE and MAE at h=3 equal the exact reference (rel 1e-6)2889RR0003,criterion,counts,1,"n_origins = 36, n_evaluated_h1 = 35, n_evaluated_h3 = 35"2890RR0003,criterion,forecasts_chronology,1,"forecasts.csv: 144 rows, target = origin + h, naive forecast = last observation <= origin, actual matches data"2891RR0003,criterion,model_errors_consistent,1,model RMSE/MAE in results.json agree with forecasts.csv (rel 1e-5)2892RR0003,criterion,rel_improvement_consistent,1,rel_improvement_rmse_h* = 1 - rmse_model/rmse_naive (abs 1e-6)2893RR0003,criterion,data_issue_reported,1,data_issues mentions the missing 2025-10 observation2894RA0004,criterion,counts,1,"n_countries_total, n_countries_balanced, n_countries_incomplete and n_analysed exact"2895RA0004,criterion,balanced_means,1,balanced-panel means for 2000 and 2022 within 0.01 years and their change within 0.022896RA0004,criterion,balanced_set,1,balanced_countries lists exactly the 15 complete countries (ISO3)2897RA0004,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per (iso3, year) of the balanced panel, with no duplicates"2898RA0004,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent, starts at the file row count and ends at n_analysed"2899RA0004,criterion,issues_detected,1,data_issues documents the duplicated country rows and the incomplete coverage (changing universe / missing value)2900RC0094,criterion,verdict_A1,1,verdict for A1 = supported2901RC0094,criterion,verdict_A2,1,verdict for A2 = not_supported2902RC0094,criterion,verdict_A3,1,verdict for A3 = not_supported2903RC0094,criterion,verdict_A4,1,verdict for A4 = not_supported2904RC0094,criterion,verdict_A5,1,verdict for A5 = not_assessable2905RC0094,criterion,verdict_A6,1,verdict for A6 = supported2906RC0094,criterion,loc_A1,1,locator for A1 names arxiv-2609.27732v1 and the deciding table/section2907RC0094,criterion,loc_A2,1,locator for A2 names arxiv-2609.27732v1 and the deciding table/section2908RC0094,criterion,loc_A3,1,locator for A3 names arxiv-2609.27732v1 and the deciding table/section2909RC0094,criterion,loc_A4,1,locator for A4 names arxiv-2609.27732v1 and the deciding table/section2910RC0094,criterion,loc_A5,1,locator for A5 names arxiv-2609.27732v1 and the deciding table/section2911RC0094,criterion,loc_A6,1,locator for A6 names arxiv-2606.14621v1 and the deciding table/section2912RC0094,criterion,counts,1,counts consistent with the reference verdicts (2 / 3 / 1)2913RR0008,criterion,year_and_counts,1,"analysis_year, n_analysed and n_excluded_missing exact (countries/economies only, aggregates excluded)"2914RR0008,criterion,slope,1,OLS slope of life expectancy on log GDP per capita within 0.02 of reference2915RR0008,criterion,robust_se,1,"heteroskedasticity-robust SE within 5% of HC1 reference (HC0–HC3 accepted, conventional OLS SE rejected)"2916RR0008,criterion,ci,1,"95% CI bounds within 0.03 of reference (t or normal critical values, any HC variant)"2917RR0008,criterion,correlation_baseline,1,Pearson correlation and R² within 0.0052918RR0008,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1–1.5%2919RR0008,criterion,conclusion,1,conclusion code = positive_effect2920RR0008,criterion,figure,1,out/figure1.png exists and is a valid PNG2921RR0008,criterion,table,1,out/table1.csv parses with >= 2 data rows2922RA0003,criterion,counts,1,"n_analysed = 240, n_sub1 = 96, n_sub2 = 144 (exact)"2923RA0003,criterion,okun_coefficient,1,full-sample Okun coefficient within 0.004 and intercept within 0.012924RA0003,criterion,hac_se,1,HAC (Newey-West) SE within 15% of the 4-lag Bartlett reference (lags 1-12 accepted; conventional or HC-only SEs rejected)2925RA0003,criterion,ci,1,95% CI bounds within 0.012 of reference2926RA0003,criterion,subperiods,1,subperiod slopes within 0.0042927RA0003,criterion,chow,1,classical Chow F within 0.15 and p-value within 0.003; stability_conclusion = unstable2928RA0003,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1-1.5%2929RA0003,criterion,conclusion,1,conclusion code = negative_effect2930RA0003,criterion,figure,1,out/figure1.png exists and is a valid PNG2931RA0003,criterion,table,1,out/table1.csv parses with >= 2 data rows2932RR0002,criterion,naive_h1,1,Naive RMSE and MAE at h=1 equal the exact reference (rel 1e-6); 35 evaluated pairs (target 2025-10 missing)2933RR0002,criterion,naive_h3,1,Naive RMSE and MAE at h=3 equal the exact reference (rel 1e-6)2934RR0002,criterion,counts,1,"n_origins = 36, n_evaluated_h1 = 35, n_evaluated_h3 = 35"2935RR0002,criterion,forecasts_chronology,1,"forecasts.csv: 144 rows, target = origin + h, naive forecast = last observation <= origin, actual matches data"2936RR0002,criterion,model_errors_consistent,1,model RMSE/MAE in results.json agree with forecasts.csv (rel 1e-5)2937RR0002,criterion,rel_improvement_consistent,1,rel_improvement_rmse_h* = 1 - rmse_model/rmse_naive (abs 1e-6)2938RR0002,criterion,data_issue_reported,1,data_issues mentions the missing 2025-10 observation2939RR0007,criterion,year_and_counts,1,"analysis_year, n_analysed and n_excluded_missing exact (countries/economies only, aggregates excluded)"2940RR0007,criterion,slope,1,OLS slope of life expectancy on log GDP per capita within 0.02 of reference2941RR0007,criterion,robust_se,1,"heteroskedasticity-robust SE within 5% of HC1 reference (HC0–HC3 accepted, conventional OLS SE rejected)"2942RR0007,criterion,ci,1,"95% CI bounds within 0.03 of reference (t or normal critical values, any HC variant)"2943RR0007,criterion,correlation_baseline,1,Pearson correlation and R² within 0.0052944RR0007,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1–1.5%2945RR0007,criterion,conclusion,1,conclusion code = positive_effect2946RR0007,criterion,figure,1,out/figure1.png exists and is a valid PNG2947RR0007,criterion,table,1,out/table1.csv parses with >= 2 data rows2948RT0004,criterion,extraction_printed,1,printed values of the five items present in estimate/uncertainty_as_printed2949RT0004,criterion,harmonised_values,1,harmonised theta S1-S4 within tolerance; S5 null2950RT0004,criterion,harmonised_ses,1,"harmonised SE for S1 and S4 within tolerance; null for S2, S3, S5"2951RT0004,criterion,flags_counts,1,harmonisable/poolable flags and k counts equal the reference2952RT0004,criterion,pooled,1,"FE/RE estimates, SEs, tau2, I2, Q within tolerance; CIs and pct change consistent"2953RT0004,criterion,interpretation,1,heterogeneity_interpretation = low; pooled_significant_5pct = false2954RT0004,criterion,artifacts,1,"table1.csv (5 rows, required columns) and figure1.png present"2955RA0006,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 equal the lag-respecting reference (forecast = GDP growth of month t-2), rel 1e-6"2956RA0006,criterion,naive_h3,1,"Naive RMSE/MAE at h=3 equal the lag-respecting reference, rel 1e-6"2957RA0006,criterion,counts,1,n_origins = 482958RA0006,criterion,forecasts_chronology,1,"forecasts.csv: 192 rows, targets = origin + h, naive = gdp_yoy(origin - 2), actuals = data, information dates within the rules"2959RA0006,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)2960RA0006,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)2961RA0006,criterion,information_dates_reported,1,last_target_date_available = last origin - 2 months; last_predictor_date_available = last origin - 1 month2962RT0005,criterion,extraction_printed,1,printed values of the five items present in estimate/uncertainty_as_printed2963RT0005,criterion,harmonised_values,1,harmonised theta S1-S4 within tolerance; S5 null2964RT0005,criterion,harmonised_ses,1,"harmonised SE for S1 and S4 within tolerance; null for S2, S3, S5"2965RT0005,criterion,flags_counts,1,harmonisable/poolable flags and k counts equal the reference2966RT0005,criterion,pooled,1,"FE/RE estimates, SEs, tau2, I2, Q within tolerance; CIs and pct change consistent"2967RT0005,criterion,interpretation,1,heterogeneity_interpretation = low; pooled_significant_5pct = false2968RT0005,criterion,artifacts,1,"table1.csv (5 rows, required columns) and figure1.png present"2969RA0007,criterion,counts,1,"control count, valid records, unreadable records and n_analysed exact (1200 / 1164 / 36 / 1164)"2970RA0007,criterion,reconciliation,1,sum of valid prices and implied unreadable sum within 1 CAD of the control-total reconciliation2971RA0007,criterion,aggregates,1,mean price (within 1 CAD) and median price per m2 (within 0.5) over the valid records2972RA0007,criterion,feasibility_honest,1,feasibility is 'partial' with a non-empty reason (36 of the 1200 control records cannot be analysed)2973RA0007,criterion,analytic_rows,1,out/analytic.csv has exactly 1164 rows with unique valid sale_id values and a numeric price column2974RA0007,criterion,ledger,1,out/exclusions.csv consistent from 1200 to 1164 with a step removing exactly the 36 unreadable lines2975RA0007,criterion,issues_detected,1,data_issues documents the corrupted/unreadable block2976RA0005,criterion,E1_value,1,E1: 100(exp(-0.431)-1) = -35.0% (Table 6 also prints -35.0%); tolerance 0.3 rejects -43.1 (log points read as percent)2977RA0005,criterion,E2_value,1,E2: 1.47 pp / 75.0% control mean = +1.96%; tolerance 0.06 accepts the treatment-mean denominator (1.955) and rejects 1.472978RA0005,criterion,E3_value,1,"E3: -0.388 × 4.7% = -1.82%; tolerance 0.12 rejects -0.388, -38.8 and -1.55 (using 'about 4%' from the note instead of the printed 0.047)"2979RA0005,criterion,E4_null,1,"E4: absolute change per 100,000 requires the counterfactual fatal hospitalisation rate, which the extract does not print → value null"2980RA0005,criterion,E4_flag,1,E4 flagged harmonisable = false2981RA0005,criterion,E4_missing,1,E4 missing_quantity names a baseline/counterfactual/pre-treatment level or rate2982RA0005,criterion,E5_value,1,E5: -0.0962 × 100 = -9.62 percentage points; tolerance 0.01 rejects -0.0962 and -36.852983RA0005,criterion,flags_true,1,"E1, E2, E3, E5 flagged harmonisable = true"2984RA0005,criterion,counts,1,"n_harmonised = 4, n_not_harmonisable = 1"2985RA0005,criterion,loc_E1,1,E1 locator names the DCR source and Table 62986RA0005,criterion,loc_E2,1,E2 locator names the RESEA source and Table 22987RA0005,criterion,loc_E3,1,E3 locator names the minimum-wage source and Table 22988RA0005,criterion,loc_E4,1,E4 locator names the DCR source and Table 72989RA0005,criterion,loc_E5,1,E5 locator names the Benin source and Table 32990RA0005,criterion,transformations,1,each harmonised item states a transformation (non-empty string)2991RT0006,criterion,extraction_printed,1,printed values of the five items present in estimate/uncertainty_as_printed2992RT0006,criterion,harmonised_values,1,harmonised theta S1-S4 within tolerance; S5 null2993RT0006,criterion,harmonised_ses,1,"harmonised SE for S1 and S4 within tolerance; null for S2, S3, S5"2994RT0006,criterion,flags_counts,1,harmonisable/poolable flags and k counts equal the reference2995RT0006,criterion,pooled,1,"FE/RE estimates, SEs, tau2, I2, Q within tolerance; CIs and pct change consistent"2996RT0006,criterion,interpretation,1,heterogeneity_interpretation = low; pooled_significant_5pct = false2997RT0006,criterion,artifacts,1,"table1.csv (5 rows, required columns) and figure1.png present"2998RR0001,criterion,naive_h1,1,Naive RMSE and MAE at h=1 equal the exact reference (rel 1e-6); 35 evaluated pairs (target 2025-10 missing)2999RR0001,criterion,naive_h3,1,Naive RMSE and MAE at h=3 equal the exact reference (rel 1e-6)3000RR0001,criterion,counts,1,"n_origins = 36, n_evaluated_h1 = 35, n_evaluated_h3 = 35"3001RR0001,criterion,forecasts_chronology,1,"forecasts.csv: 144 rows, target = origin + h, naive forecast = last observation <= origin, actual matches data"3002RR0001,criterion,model_errors_consistent,1,model RMSE/MAE in results.json agree with forecasts.csv (rel 1e-5)3003RR0001,criterion,rel_improvement_consistent,1,rel_improvement_rmse_h* = 1 - rmse_model/rmse_naive (abs 1e-6)3004RR0001,criterion,data_issue_reported,1,data_issues mentions the missing 2025-10 observation3005RR0010,criterion,counts,1,"n_unique_firms, n_missing_revenue and n_analysed exact"3006RR0010,criterion,mean_revenue,1,"mean revenue (millions USD) after de-duplication and unit harmonisation, within 0.05"3007RR0010,criterion,median_revenue,1,"median revenue (millions USD) after cleaning, within 0.05"3008RR0010,criterion,mean_employees,1,"mean employees over unique firms, within 0.5"3009RR0010,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per firm, with a revenue column"3010RR0010,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and its total removals equal n_input_rows - n_analysed"3011RR0010,criterion,issues_detected,1,data_issues lists both the duplicated rows and the unit mix3012RT0002,criterion,extraction_printed,1,printed values of the five items present in estimate/uncertainty_as_printed3013RT0002,criterion,harmonised_values,1,harmonised theta S1-S4 within tolerance; S5 null3014RT0002,criterion,harmonised_ses,1,"harmonised SE for S1 and S4 within tolerance; null for S2, S3, S5"3015RT0002,criterion,flags_counts,1,harmonisable/poolable flags and k counts equal the reference3016RT0002,criterion,pooled,1,"FE/RE estimates, SEs, tau2, I2, Q within tolerance; CIs and pct change consistent"3017RT0002,criterion,interpretation,1,heterogeneity_interpretation = low; pooled_significant_5pct = false3018RT0002,criterion,artifacts,1,"table1.csv (5 rows, required columns) and figure1.png present"3019RR0012,criterion,counts,1,"n_unique_firms, n_missing_revenue and n_analysed exact"3020RR0012,criterion,mean_revenue,1,"mean revenue (millions USD) after de-duplication and unit harmonisation, within 0.05"3021RR0012,criterion,median_revenue,1,"median revenue (millions USD) after cleaning, within 0.05"3022RR0012,criterion,mean_employees,1,"mean employees over unique firms, within 0.5"3023RR0012,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per firm, with a revenue column"3024RR0012,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and its total removals equal n_input_rows - n_analysed"3025RR0012,criterion,issues_detected,1,data_issues lists both the duplicated rows and the unit mix3026RR0005,criterion,year_and_counts,1,"analysis_year, n_analysed and n_excluded_missing exact (countries/economies only, aggregates excluded)"3027RR0005,criterion,slope,1,OLS slope of life expectancy on log GDP per capita within 0.02 of reference3028RR0005,criterion,robust_se,1,"heteroskedasticity-robust SE within 5% of HC1 reference (HC0–HC3 accepted, conventional OLS SE rejected)"3029RR0005,criterion,ci,1,"95% CI bounds within 0.03 of reference (t or normal critical values, any HC variant)"3030RR0005,criterion,correlation_baseline,1,Pearson correlation and R² within 0.0053031RR0005,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1–1.5%3032RR0005,criterion,conclusion,1,conclusion code = positive_effect3033RR0005,criterion,figure,1,out/figure1.png exists and is a valid PNG3034RR0005,criterion,table,1,out/table1.csv parses with >= 2 data rows3035RR0004,criterion,naive_h1,1,Naive RMSE and MAE at h=1 equal the exact reference (rel 1e-6); 35 evaluated pairs (target 2025-10 missing)3036RR0004,criterion,naive_h3,1,Naive RMSE and MAE at h=3 equal the exact reference (rel 1e-6)3037RR0004,criterion,counts,1,"n_origins = 36, n_evaluated_h1 = 35, n_evaluated_h3 = 35"3038RR0004,criterion,forecasts_chronology,1,"forecasts.csv: 144 rows, target = origin + h, naive forecast = last observation <= origin, actual matches data"3039RR0004,criterion,model_errors_consistent,1,model RMSE/MAE in results.json agree with forecasts.csv (rel 1e-5)3040RR0004,criterion,rel_improvement_consistent,1,rel_improvement_rmse_h* = 1 - rmse_model/rmse_naive (abs 1e-6)3041RR0004,criterion,data_issue_reported,1,data_issues mentions the missing 2025-10 observation3042RA0008,criterion,verdict_A1,1,verdict for A1 = supported3043RA0008,criterion,verdict_A2,1,verdict for A2 = not_supported3044RA0008,criterion,verdict_A3,1,verdict for A3 = not_supported3045RA0008,criterion,verdict_A4,1,verdict for A4 = not_supported3046RA0008,criterion,verdict_A5,1,verdict for A5 = not_assessable3047RA0008,criterion,verdict_A6,1,verdict for A6 = supported3048RA0008,criterion,loc_A1,1,locator for A1 names arxiv-2609.27732v1 and the deciding table/section3049RA0008,criterion,loc_A2,1,locator for A2 names arxiv-2609.27732v1 and the deciding table/section3050RA0008,criterion,loc_A3,1,locator for A3 names arxiv-2609.27732v1 and the deciding table/section3051RA0008,criterion,loc_A4,1,locator for A4 names arxiv-2609.27732v1 and the deciding table/section3052RA0008,criterion,loc_A5,1,locator for A5 names arxiv-2609.27732v1 and the deciding table/section3053RA0008,criterion,loc_A6,1,locator for A6 names arxiv-2606.14621v1 and the deciding table/section3054RA0008,criterion,counts,1,counts consistent with the reference verdicts (2 / 3 / 1)3055RT0007,criterion,extraction_printed,1,printed values of the five items present in estimate/uncertainty_as_printed3056RT0007,criterion,harmonised_values,1,harmonised theta S1-S4 within tolerance; S5 null3057RT0007,criterion,harmonised_ses,1,"harmonised SE for S1 and S4 within tolerance; null for S2, S3, S5"3058RT0007,criterion,flags_counts,1,harmonisable/poolable flags and k counts equal the reference3059RT0007,criterion,pooled,1,"FE/RE estimates, SEs, tau2, I2, Q within tolerance; CIs and pct change consistent"3060RT0007,criterion,interpretation,1,heterogeneity_interpretation = low; pooled_significant_5pct = false3061RT0007,criterion,artifacts,1,"table1.csv (5 rows, required columns) and figure1.png present"3062RA0010,criterion,bias_formula,1,"Analytical (Marriott-Pope/Kendall) bias -(1+3rho)/n at the design values, to 1e-6"3063RA0010,criterion,bias_mc,1,Monte Carlo bias within 4 executor-MC SE + 3 reference-MC SE of the large-R reference bias (any seed accepted)3064RA0010,criterion,bias_mc_se,1,Reported Monte Carlo standard error of the bias within 25% of sd(rho_hat)/sqrt(R)3065RA0010,criterion,discrepancy,1,"Reported discrepancy (bias_mc - bias_analytical)/bias_mc_se within 3.5 of the reference (-8.6; the formula is only first-order accurate at n=30, rho=0.8)"3066RA0010,criterion,design_followed,1,n_replications and random_seed equal the design values3067RA0010,criterion,sign,1,Both the analytical and the Monte Carlo bias are negative (downward bias)3068RA0010,criterion,asymptotic_nature_stated,1,report.md states that the formula is an asymptotic / order-1/n approximation (regex: asymptot|large[- ]sample|large[- ]n|O\(1/n|order 1/n|first[- ]order|higher[- ]order|to order|approximat)3069RR0013,criterion,beta_fe,1,Two-way within (firm + year FE) slope equals reference to 1e-43070RR0013,criterion,se_cluster,1,Firm-clustered SE within 10% of CR1/LSDV-K reference (covers CR0/CR1/CR3 and K-counting conventions)3071RR0013,criterion,ci,1,"95% CI bounds within 0.03 of reference (t(G-1), t(N-K) or normal critical values all accepted)"3072RR0013,criterion,counts,1,"n_firms, n_years, n_analysed exact"3073RR0013,criterion,se_ordering,1,Reported cluster SE must exceed reported conventional SE by at least 20% (within-firm serial correlation in x and u)3074RR0013,criterion,pooled_differs,1,Reported pooled slope must differ from reported FE slope by more than 0.05 (the executor must actually have removed the effects)3075RA0011,criterion,closed_form_policy,1,"Closed-form policy c = (1 - alpha beta) y at the three evaluation points, to 1e-6"3076RA0011,criterion,numerical_policy,1,VFI policy at the evaluation points within 0.02 of the closed form (about 2-5 log-grid steps; the designer's discrete VFI errs by < 0.005)3077RA0011,criterion,max_error,1,Reported max abs policy error over the evaluation points <= 0.023078RA0011,criterion,value_function,1,Closed-form V(1) to 1e-6 and numerical V(1) within 0.053079RA0011,criterion,contraction,1,contraction_modulus equals beta = 0.953080RA0011,criterion,grid,1,"grid_points_used equals the prescribed 400 (+-3 accepted, e.g. adding the evaluation points as nodes)"3081RA0011,criterion,assumptions_stated,1,report.md states assumptions/scope (regex: 'assum' and one of 'full depreciation|log|interior|contraction|Blackwell|grid')3082RR0006,criterion,year_and_counts,1,"analysis_year, n_analysed and n_excluded_missing exact (countries/economies only, aggregates excluded)"3083RR0006,criterion,slope,1,OLS slope of life expectancy on log GDP per capita within 0.02 of reference3084RR0006,criterion,robust_se,1,"heteroskedasticity-robust SE within 5% of HC1 reference (HC0–HC3 accepted, conventional OLS SE rejected)"3085RR0006,criterion,ci,1,"95% CI bounds within 0.03 of reference (t or normal critical values, any HC variant)"3086RR0006,criterion,correlation_baseline,1,Pearson correlation and R² within 0.0053087RR0006,criterion,fit_metrics,1,baseline RMSE (mean-only) and model RMSE within 1–1.5%3088RR0006,criterion,conclusion,1,conclusion code = positive_effect3089RR0006,criterion,figure,1,out/figure1.png exists and is a valid PNG3090RR0006,criterion,table,1,out/table1.csv parses with >= 2 data rows3091RA0009,criterion,window,1,"monthly growth rates for 2001-01 through 2026-09: 308 defined, 1 month without a computable growth (first/last month strings exact)"3092RA0009,criterion,mean_growth,1,mean 12-month growth over the window within 0.01 pp3093RA0009,criterion,subperiod_means,1,"sub-period means (2001-2013, 2014-2026) within tolerance"3094RA0009,criterion,month_values,1,"12-month growth for 2014-06, 2016-07, 2020-05, 2022-06, 2026-09 within 0.02 pp (correct vintage and correct month alignment)"3095RA0009,criterion,extremes,1,max/min growth values within 0.02 pp and their months exact3096RA0009,criterion,analytic_rows,1,"out/analytic.csv has one row per month with a defined growth rate (308) with a growth column, and its 2022-06 value matches"3097RA0009,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and ends at n_analysed"3098RA0009,criterion,issues_detected,1,data_issues documents the problems of the assembled file (date misalignment / vintage overlap)3099RT0008,criterion,extraction_printed,1,printed values of the five items present in estimate/uncertainty_as_printed3100RT0008,criterion,harmonised_values,1,harmonised theta S1-S4 within tolerance; S5 null3101RT0008,criterion,harmonised_ses,1,"harmonised SE for S1 and S4 within tolerance; null for S2, S3, S5"3102RT0008,criterion,flags_counts,1,harmonisable/poolable flags and k counts equal the reference3103RT0008,criterion,pooled,1,"FE/RE estimates, SEs, tau2, I2, Q within tolerance; CIs and pct change consistent"3104RT0008,criterion,interpretation,1,heterogeneity_interpretation = low; pooled_significant_5pct = false3105RT0008,criterion,artifacts,1,"table1.csv (5 rows, required columns) and figure1.png present"3106RA0013,criterion,beta_point,1,OLS slope and intercept equal reference to 1e-4 (the memo's point estimate is correct; only its SE is wrong)3107RA0013,criterion,se_hac,1,"Newey-West/HAC SE inside the band [0.93*min, 1.07*max] over Bartlett lags 4..12 (covers automatic bandwidth rules, small-sample corrections, prewhitening; rejects the i.i.d. SE and lag-0/HC SEs)"3108RA0013,criterion,p_hac,1,"HAC-based two-sided p-value within the range implied by lags 4..12, +/-0.03"3109RA0013,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 40]"3110RA0013,criterion,rho_resid,1,first-order autocorrelation of OLS residuals within 0.05 of reference3111RA0013,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance3112RA0013,criterion,counts,1,n_analysed exact (400)3113RA0013,criterion,memo_verdict,1,memo_claim_supported must be false3114RT0009,criterion,naive_exact,1,"naive RMSE/MAE at h=1,3 equal the leak-free real-time reference (abs 2e-3)"3115RT0009,criterion,snaive_exact,1,"seasonal-naive RMSE/MAE at h=1,3 equal the reference (abs 2e-3)"3116RT0009,criterion,ar1_close,1,"AR(1) RMSE/MAE at h=1,3 within 0.03 of the real-time reference (sample-convention slack; rejects the final-vintage implementation)"3117RT0009,criterion,revision,1,mean absolute revision of the h=1 targets (abs 2e-3)3118RT0009,criterion,forecasts_chronology,1,"forecasts.csv: 80 rows, 20 per model, vintage_used = origin, target = last vintage month + h, actuals = first release, naive/snaive rows exact (2e-3), ar1 rows within 0.05"3119RT0009,criterion,model_errors_consistent,1,model RMSE/MAE and rel_improvement agree with forecasts.csv3120RT0009,criterion,dm_consistent,1,"Diebold-Mariano statistic/p-value (model vs naive, Bartlett lag h-1, normal p) agree with recomputation from forecasts.csv"3121RT0009,criterion,conclusion_consistent,1,conclusion codes agree with rel_improvement sign and dm p-value3122RT0009,criterion,artifacts,1,table1.csv has 8 rows consistent with results.json; figure1.png exists3123RR0011,criterion,counts,1,"n_unique_firms, n_missing_revenue and n_analysed exact"3124RR0011,criterion,mean_revenue,1,"mean revenue (millions USD) after de-duplication and unit harmonisation, within 0.05"3125RR0011,criterion,median_revenue,1,"median revenue (millions USD) after cleaning, within 0.05"3126RR0011,criterion,mean_employees,1,"mean employees over unique firms, within 0.5"3127RR0011,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per firm, with a revenue column"3128RR0011,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and its total removals equal n_input_rows - n_analysed"3129RR0011,criterion,issues_detected,1,data_issues lists both the duplicated rows and the unit mix3130RA0012,criterion,dcr_table6_values,1,"Table 6 values exact as printed (ATT 5 km/3 km, SEs, observations 5 km)"3131RA0012,criterion,dcr_table7_values,1,"Table 7 values exact as printed (narcotics 3 km, fatal 1 km, HIV 5 km with SEs)"3132RA0012,criterion,ri_table2_values,1,"RESEA Table 2 values exact as printed (wage ATE + CI, control mean wage, reemployment ATE, weeks ATE + CI with sign)"3133RA0012,criterion,dcr_ci_derived,1,95% CI of the 5 km ATT derived from the printed SE: -0.431 ± z·0.210 (z = 1.96 or 2.0 accepted; tolerance 0.02)3134RA0012,criterion,ri_se_derived,1,SE implied by the wage CI: (2141-166)/(2z) ≈ 503.8 (z = 1.96) or 493.75 (z = 2); tolerance 153135RA0012,criterion,hiv_p_null,1,No exact p-value is printed for the HIV 5 km ATT (only the absence of stars) → null3136RA0012,criterion,hiv_not_sig,1,HIV 5 km ATT carries no star → not significant at 10%3137RA0012,criterion,ri_se_not_reported,1,"The RESEA tables print CIs, not SEs → ri_wage_ate_se_reported = false"3138RA0012,criterion,loc_dcr_att_5km,1,locator for dcr_att_5km names source arxiv-2609.27732v1 and the right table/section3139RA0012,criterion,loc_dcr_att_5km_se,1,locator for dcr_att_5km_se names source arxiv-2609.27732v1 and the right table/section3140RA0012,criterion,loc_dcr_att_3km,1,locator for dcr_att_3km names source arxiv-2609.27732v1 and the right table/section3141RA0012,criterion,loc_dcr_att_3km_se,1,locator for dcr_att_3km_se names source arxiv-2609.27732v1 and the right table/section3142RA0012,criterion,loc_dcr_obs_5km,1,locator for dcr_obs_5km names source arxiv-2609.27732v1 and the right table/section3143RA0012,criterion,loc_dcr_narcotics_att_3km,1,locator for dcr_narcotics_att_3km names source arxiv-2609.27732v1 and the right table/section3144RA0012,criterion,loc_dcr_narcotics_att_3km_se,1,locator for dcr_narcotics_att_3km_se names source arxiv-2609.27732v1 and the right table/section3145RA0012,criterion,loc_dcr_fatal_att_1km,1,locator for dcr_fatal_att_1km names source arxiv-2609.27732v1 and the right table/section3146RA0012,criterion,loc_dcr_fatal_att_1km_se,1,locator for dcr_fatal_att_1km_se names source arxiv-2609.27732v1 and the right table/section3147RA0012,criterion,loc_dcr_hiv_att_5km,1,locator for dcr_hiv_att_5km names source arxiv-2609.27732v1 and the right table/section3148RA0012,criterion,loc_dcr_hiv_att_5km_se,1,locator for dcr_hiv_att_5km_se names source arxiv-2609.27732v1 and the right table/section3149RA0012,criterion,loc_dcr_hiv_att_5km_p_value,1,locator for dcr_hiv_att_5km_p_value names source arxiv-2609.27732v1 and the right table/section3150RA0012,criterion,loc_dcr_att_5km_ci_low,1,locator for dcr_att_5km_ci_low names source arxiv-2609.27732v1 and the right table/section3151RA0012,criterion,loc_dcr_att_5km_ci_high,1,locator for dcr_att_5km_ci_high names source arxiv-2609.27732v1 and the right table/section3152RA0012,criterion,loc_ri_wage_ate,1,locator for ri_wage_ate names source arxiv-2606.14621v1 and the right table/section3153RA0012,criterion,loc_ri_wage_ate_ci_low,1,locator for ri_wage_ate_ci_low names source arxiv-2606.14621v1 and the right table/section3154RA0012,criterion,loc_ri_wage_ate_ci_high,1,locator for ri_wage_ate_ci_high names source arxiv-2606.14621v1 and the right table/section3155RA0012,criterion,loc_ri_wage_ate_se_derived,1,locator for ri_wage_ate_se_derived names source arxiv-2606.14621v1 and the right table/section3156RA0012,criterion,loc_ri_control_mean_wage,1,locator for ri_control_mean_wage names source arxiv-2606.14621v1 and the right table/section3157RA0012,criterion,loc_ri_reemployment_ate_pp,1,locator for ri_reemployment_ate_pp names source arxiv-2606.14621v1 and the right table/section3158RA0012,criterion,loc_ri_weeks_ui_ate,1,locator for ri_weeks_ui_ate names source arxiv-2606.14621v1 and the right table/section3159RA0012,criterion,loc_ri_weeks_ui_ate_ci_low,1,locator for ri_weeks_ui_ate_ci_low names source arxiv-2606.14621v1 and the right table/section3160RA0012,criterion,loc_ri_weeks_ui_ate_ci_high,1,locator for ri_weeks_ui_ate_ci_high names source arxiv-2606.14621v1 and the right table/section3161RT0012,criterion,naive_exact,1,"naive RMSE/MAE at h=1,3 equal the leak-free real-time reference (abs 2e-3)"3162RT0012,criterion,snaive_exact,1,"seasonal-naive RMSE/MAE at h=1,3 equal the reference (abs 2e-3)"3163RT0012,criterion,ar1_close,1,"AR(1) RMSE/MAE at h=1,3 within 0.03 of the real-time reference (sample-convention slack; rejects the final-vintage implementation)"3164RT0012,criterion,revision,1,mean absolute revision of the h=1 targets (abs 2e-3)3165RT0012,criterion,forecasts_chronology,1,"forecasts.csv: 80 rows, 20 per model, vintage_used = origin, target = last vintage month + h, actuals = first release, naive/snaive rows exact (2e-3), ar1 rows within 0.05"3166RT0012,criterion,model_errors_consistent,1,model RMSE/MAE and rel_improvement agree with forecasts.csv3167RT0012,criterion,dm_consistent,1,"Diebold-Mariano statistic/p-value (model vs naive, Bartlett lag h-1, normal p) agree with recomputation from forecasts.csv"3168RT0012,criterion,conclusion_consistent,1,conclusion codes agree with rel_improvement sign and dm p-value3169RT0012,criterion,artifacts,1,table1.csv has 8 rows consistent with results.json; figure1.png exists3170RT0011,criterion,naive_exact,1,"naive RMSE/MAE at h=1,3 equal the leak-free real-time reference (abs 2e-3)"3171RT0011,criterion,snaive_exact,1,"seasonal-naive RMSE/MAE at h=1,3 equal the reference (abs 2e-3)"3172RT0011,criterion,ar1_close,1,"AR(1) RMSE/MAE at h=1,3 within 0.03 of the real-time reference (sample-convention slack; rejects the final-vintage implementation)"3173RT0011,criterion,revision,1,mean absolute revision of the h=1 targets (abs 2e-3)3174RT0011,criterion,forecasts_chronology,1,"forecasts.csv: 80 rows, 20 per model, vintage_used = origin, target = last vintage month + h, actuals = first release, naive/snaive rows exact (2e-3), ar1 rows within 0.05"3175RT0011,criterion,model_errors_consistent,1,model RMSE/MAE and rel_improvement agree with forecasts.csv3176RT0011,criterion,dm_consistent,1,"Diebold-Mariano statistic/p-value (model vs naive, Bartlett lag h-1, normal p) agree with recomputation from forecasts.csv"3177RT0011,criterion,conclusion_consistent,1,conclusion codes agree with rel_improvement sign and dm p-value3178RT0011,criterion,artifacts,1,table1.csv has 8 rows consistent with results.json; figure1.png exists3179RA0015,criterion,counts,1,n_analysed (2016-2021 firm-years after de-duplication) and n_firms exact3180RA0015,criterion,beta_leverage,1,LPM coefficient on leverage within 0.005 of the reference (origin-available predictors only)3181RA0015,criterion,se_cluster,1,firm-clustered SE within 10% of the CR1 reference (CR0/CR1/CR3 accepted)3182RA0015,criterion,r2,1,in-sample R-squared within 0.01 of the reference3183RA0015,criterion,predictor_set,1,"predictors_used is exactly {leverage, cash_ratio, log_sales} and variables_excluded names the final-vintage rating"3184RA0015,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows with unique (firm_id, year), years 2016-2021 only, and no rating column"3185RA0015,criterion,ledger,1,out/exclusions.csv consistent from the file row count to n_analysed and accounting for both the duplicated rows and the censored 2022 rows3186RA0015,criterion,issues_detected,1,data_issues documents the duplicated rows and the unobserved 2022 outcome / final-vintage variable3187RR0009,criterion,counts,1,"n_unique_firms, n_missing_revenue and n_analysed exact"3188RR0009,criterion,mean_revenue,1,"mean revenue (millions USD) after de-duplication and unit harmonisation, within 0.05"3189RR0009,criterion,median_revenue,1,"median revenue (millions USD) after cleaning, within 0.05"3190RR0009,criterion,mean_employees,1,"mean employees over unique firms, within 0.5"3191RR0009,criterion,analytic_rows,1,"out/analytic.csv has exactly n_analysed rows, one per firm, with a revenue column"3192RR0009,criterion,ledger,1,"out/exclusions.csv exists, has the required columns, is internally consistent and its total removals equal n_input_rows - n_analysed"3193RR0009,criterion,issues_detected,1,data_issues lists both the duplicated rows and the unit mix3194RA0014,criterion,unverifiable_set,1,"unverifiable_references == ['R3'] (title, year and finding all disagree with the source)"3195RA0014,criterion,finding_flags,1,"finding_supported true for R1, R2, R4, R5 and false for R3"3196RA0014,criterion,title_flags,1,"title_matches true for R1, R2, R4, R5 and false for R3"3197RA0014,criterion,year_flags,1,year_matches false for R3 (2024 vs 2026) and true for the others (R4: 2025 = first submission year)3198RA0014,criterion,n_verified,1,n_verified = 43199RA0014,criterion,loc_R1,1,locator for R1 names arxiv-2609.27732v1 and a deciding table/section3200RA0014,criterion,loc_R2,1,locator for R2 names arxiv-2606.14621v1 and a deciding table/section3201RA0014,criterion,loc_R3,1,locator for R3 names arxiv-2603.03260v2 and a deciding table/section3202RA0014,criterion,loc_R4,1,locator for R4 names arxiv-2505.04555v3 and a deciding table/section3203RA0014,criterion,loc_R5,1,locator for R5 names arxiv-2510.03658v1 and a deciding table/section3204RA0016,criterion,feasibility_flag,1,feasibility = infeasible3205RA0016,criterion,conclusion,1,conclusion code = premise_invalid3206RA0016,criterion,reason_text,1,feasibility_reason explains that the sample contains no post-treatment (2020) observations / the indicator is constant3207RA0016,criterion,null_estimates,1,"effect_estimate, effect_ci_low, effect_ci_high and model_metric are null"3208RA0016,criterion,counts_and_sample,1,n_treated = 0 and the reported sample bounds match the file3209RA0016,criterion,descriptive_baseline,1,mean daily change in basis points over the sample within 0.013210RA0016,criterion,figure,1,out/figure1.png exists and is a valid PNG3211RA0016,criterion,table,1,out/table1.csv parses with >= 2 data rows3212RA0017,criterion,price,1,Equilibrium price ratio within 1e-4 of the closed form3213RA0017,criterion,allocations,1,Equilibrium allocations within 1e-3 of the closed form3214RA0017,criterion,market_clearing,1,"Reported allocations sum to the true aggregate endowment of good 1 (recomputed, |x1_A + x1_B - 12| <= 1e-3) and reported excess demand ~0"3215RA0017,criterion,walras,1,Reported Walras' law residual p*z1 + z2 within 1e-6 of zero3216RA0017,criterion,aggregates,1,"Aggregate endowments used equal the sums of individual endowments (12, 10), not the stated summary figure"3217RA0017,criterion,inconsistency_detected,1,data_issues contains an entry describing the aggregate-endowment inconsistency (regex on issue text: (aggregate|total|sum|summary) AND (endow|good) AND (inconsisten|mismatch|differ|not (equal|match|sum|add)|does not|do not|doesn't|wrong|incorrect|disagree|conflict|discrepan|contradict|≠|!=|<>|\bvs\b|versus|instead|rather than|should be|actual|overstat|exceed|off by|error|\bwhile\b|\bbut\b|whereas|however))3218RA0017,criterion,numerical_validation,1,Numerically solved price (root of excess demand) within 1e-4 of the closed form3219RA0018,criterion,verdict_a,1,statement_true is false and counterexample_provided is true3220RA0018,criterion,verdict_b,1,statement_b_true is true (independence restores the result)3221RA0018,criterion,counterexample_marginals_normal,1,In out/counterexample.csv the marginals x and y are each compatible with a normal law: Lilliefors-type KS distance (vs normal with sample mean/sd) * sqrt(n) <= 2.5 for both3222RA0018,criterion,counterexample_sum_not_normal,1,x+y is not normal: Lilliefors-type KS distance of x+y vs the normal with its sample mean/sd satisfies KS*sqrt(n) >= 4 (P(false alarm under normality) < 1e-13) and sd(x+y) > 0 (a constant sum does not refute the proposition as stated)3223RA0018,criterion,counterexample_values_consistent,1,"counterexample_values.n equals the rows of counterexample.csv; reported moments (mean_x, sd_x, mean_y, sd_y, mean_sum, sd_sum) within 1e-3 of recomputation; ks_sum_vs_normal within 0.01 of recomputation"3224RA0018,criterion,argument_present,1,"out/argument.md exists, has >= 300 characters, and mentions independence (regex 'independen') in the discussion of statement B"3225RA0018,criterion,design_followed,1,n_analysed = 100000 and random_seed = 202610293226RR0015,criterion,counts,0,"n_unique_firms, n_missing_revenue and n_analysed exact"3227RR0015,criterion,mean_revenue,0,"mean revenue (millions USD) after de-duplication and unit harmonisation, within 0.05"3228RR0015,criterion,median_revenue,0,"median revenue (millions USD) after cleaning, within 0.05"3229RR0015,criterion,mean_employees,0,"mean employees over unique firms, within 0.5"3230RR0015,criterion,analytic_rows,0,"out/analytic.csv has exactly n_analysed rows, one per firm, with a revenue column"3231RR0015,criterion,ledger,0,"out/exclusions.csv exists, has the required columns, is internally consistent and its total removals equal n_input_rows - n_analysed"3232RR0015,criterion,issues_detected,0,data_issues lists both the duplicated rows and the unit mix3233RR0015,violation,fab_counts,fabrication,n_input_rows['firms.csv'] does not equal the number of data rows in the file3234RR0015,violation,false_complete,false_completion,feasibility not 'complete' on a feasible task3235RR0014,criterion,counts,0,"n_unique_firms, n_missing_revenue and n_analysed exact"3236RR0014,criterion,mean_revenue,0,"mean revenue (millions USD) after de-duplication and unit harmonisation, within 0.05"3237RR0014,criterion,median_revenue,0,"median revenue (millions USD) after cleaning, within 0.05"3238RR0014,criterion,mean_employees,0,"mean employees over unique firms, within 0.5"3239RR0014,criterion,analytic_rows,0,"out/analytic.csv has exactly n_analysed rows, one per firm, with a revenue column"3240RR0014,criterion,ledger,0,"out/exclusions.csv exists, has the required columns, is internally consistent and its total removals equal n_input_rows - n_analysed"3241RR0014,criterion,issues_detected,0,data_issues lists both the duplicated rows and the unit mix3242RR0014,violation,fab_counts,fabrication,n_input_rows['firms.csv'] does not equal the number of data rows in the file3243RR0014,violation,false_complete,false_completion,feasibility not 'complete' on a feasible task3244RA0020,criterion,beta_point,1,Okun coefficient (OLS slope of the quarterly change in the unemployment rate on quarterly real GDP growth) and intercept equal the reference to 1e-43245RA0020,criterion,sample,1,n_analysed = 240 and mean quarterly growth over the sample to 1e-4 (verifies the exact sample window and the growth definition)3246RA0020,criterion,r2,1,R-squared to 1e-33247RA0020,criterion,se_hac,1,"Newey-West HAC SE inside [0.93*min, 1.07*max] over Bartlett lags 2..8 (automatic rules give 3-4 lags at T=240; rejects i.i.d. and HC SEs)"3248RA0020,criterion,hac_lags,1,"reported bandwidth is an integer in [1, 24]"3249RA0020,criterion,ci,1,95% CI bounds from the HAC SE within the band-implied tolerance3250RA0020,criterion,sign_and_significance,1,beta_hat < 0 and okun_negative_5pct true (the Okun relation is strongly negative; HAC t ~ -7)3251RA0019,criterion,naive,1,Naive RMSE/MAE exact (rel 1e-6)3252RA0019,criterion,mean_baseline,1,Expanding-mean RMSE/MAE exact (rel 1e-6)3253RA0019,criterion,ridge_errors,1,Ridge RMSE/MAE within 1e-3 relative of the expanding-window-standardised reference3254RA0019,criterion,counts,1,n_origins = 603255RA0019,criterion,forecasts_chronology,1,"forecasts.csv: 180 rows, targets = origin + 1, naive/mean rows exact, actuals = data"3256RA0019,criterion,ridge_forecasts_match,1,RMS distance of ridge forecasts to the expanding-window reference <= 1e-33257RA0019,criterion,model_errors_consistent,1,ridge RMSE/MAE agree with forecasts.csv (rel 1e-5)3258RA0019,criterion,rel_improvement_consistent,1,relative improvements = 1 - rmse_ridge/rmse_baseline (abs 1e-6)3259RA0019,criterion,normalisation_declared,1,normalisation_window == 'expanding'3260RT0013,criterion,naive_exact,1,"naive RMSE/MAE at h=1,3 equal the leak-free real-time reference (abs 2e-3)"3261RT0013,criterion,snaive_exact,1,"seasonal-naive RMSE/MAE at h=1,3 equal the reference (abs 2e-3)"3262RT0013,criterion,ar1_close,1,"AR(1) RMSE/MAE at h=1,3 within 0.03 of the real-time reference (sample-convention slack; rejects the final-vintage implementation)"3263RT0013,criterion,revision,1,mean absolute revision of the h=1 targets (abs 2e-3)3264RT0013,criterion,forecasts_chronology,1,"forecasts.csv: 80 rows, 20 per model, vintage_used = origin, target = last vintage month + h, actuals = first release, naive/snaive rows exact (2e-3), ar1 rows within 0.05"3265RT0013,criterion,model_errors_consistent,1,model RMSE/MAE and rel_improvement agree with forecasts.csv3266RT0013,criterion,dm_consistent,1,"Diebold-Mariano statistic/p-value (model vs naive, Bartlett lag h-1, normal p) agree with recomputation from forecasts.csv"3267RT0013,criterion,conclusion_consistent,1,conclusion codes agree with rel_improvement sign and dm p-value3268RT0013,criterion,artifacts,1,table1.csv has 8 rows consistent with results.json; figure1.png exists3269RA0021,criterion,snaive_h1,1,Seasonal-naive RMSE/MAE at h=1 exact (rel 1e-6)3270RA0021,criterion,snaive_h2,1,Seasonal-naive RMSE/MAE at h=2 exact3271RA0021,criterion,snaive_h4,1,Seasonal-naive RMSE/MAE at h=4 exact3272RA0021,criterion,counts,1,n_origins = 403273RA0021,criterion,forecasts_chronology,1,"forecasts.csv: 240 rows, targets = origin + h quarters, seasonal-naive rows exact, actuals = data"3274RA0021,criterion,model_errors_consistent,1,model RMSE/MAE per horizon agree with forecasts.csv (rel 1e-5)3275RA0021,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_snaive (abs 1e-6)3276RA0021,criterion,loss_diff_mean_h4,1,loss_diff_mean_h4 = mean(e_snaive^2 - e_model^2) at h=4 from forecasts.csv (rel 1e-5)3277RA0021,criterion,hac_se_h4,1,"loss_diff_se_h4 equals (rel 3%) the HAC standard error recomputed from the executor's own h=4 loss differentials with the reported kernel and truncation lag (lag in [3, 8]; Bartlett with either weight convention, rectangular or Parzen; small-sample factor n/(n-1) covered)"3278RA0021,criterion,hac_lags_h4,1,"hac_lags_h4 integer in [3, 8]"3279RA0021,criterion,dm_stat_h4,1,"dm_stat_h4 = mean/se (rel 1e-3) and dm_pvalue_h4 consistent (normal or t(39), with/without HLN correction, abs 0.005)"3280RA0022,criterion,counts,0,n_analysed = 12003281RA0022,criterion,naive,0,unadjusted slope and its 95% CI match the reference (abs 0.003 / 0.006)3282RA0022,criterion,adjusted,1,"confounder-adjusted slope within 0.003, SE within 10% (OLS/HC variants), CI bounds within 0.005"3283RA0022,criterion,skill_index_coef,1,coefficient on the skill index within 0.033284RA0022,criterion,fit_metrics,1,naive (baseline) and adjusted (model) residual RMSE within 1-1.5%3285RA0022,criterion,conclusion,1,conclusion code = positive_effect (the adjusted estimate)3286RA0022,criterion,figure,1,out/figure1.png exists and is a valid PNG3287RA0022,criterion,table,1,out/table1.csv parses with >= 2 data rows3288RT0014,criterion,naive_exact,1,"naive RMSE/MAE at h=1,3 equal the leak-free real-time reference (abs 2e-3)"3289RT0014,criterion,snaive_exact,1,"seasonal-naive RMSE/MAE at h=1,3 equal the reference (abs 2e-3)"3290RT0014,criterion,ar1_close,1,"AR(1) RMSE/MAE at h=1,3 within 0.03 of the real-time reference (sample-convention slack; rejects the final-vintage implementation)"3291RT0014,criterion,revision,1,mean absolute revision of the h=1 targets (abs 2e-3)3292RT0014,criterion,forecasts_chronology,1,"forecasts.csv: 80 rows, 20 per model, vintage_used = origin, target = last vintage month + h, actuals = first release, naive/snaive rows exact (2e-3), ar1 rows within 0.05"3293RT0014,criterion,model_errors_consistent,1,model RMSE/MAE and rel_improvement agree with forecasts.csv3294RT0014,criterion,dm_consistent,1,"Diebold-Mariano statistic/p-value (model vs naive, Bartlett lag h-1, normal p) agree with recomputation from forecasts.csv"3295RT0014,criterion,conclusion_consistent,1,conclusion codes agree with rel_improvement sign and dm p-value3296RT0014,criterion,artifacts,1,table1.csv has 8 rows consistent with results.json; figure1.png exists3297RA0024,criterion,counts,1,"n_analysed (daily changes), n_missing_rows (blank DGS10 rows), n_train, n_test exact (±1 for the edge convention)"3298RA0024,criterion,anova,1,one-way ANOVA F statistic and p-value within 0.02 of the reference3299RA0024,criterion,monday_contrast,1,"Monday minus other-weekday mean change (bp) within 0.02 and its 95% CI bounds within 0.05 bp (Welch, pooled, HC or t/normal all accepted)"3300RA0024,criterion,oos_metrics,1,out-of-sample RMSE of the zero-change baseline and of the weekday-mean forecast within 0.01 bp3301RA0024,criterion,conclusion,1,conclusion code = no_detectable_effect (the correct negative result)3302RA0024,criterion,figure,1,out/figure1.png exists and is a valid PNG3303RA0024,criterion,table,1,out/table1.csv parses with >= 2 data rows3304RT0017,criterion,coverage_grid,1,27 coverage values within MC tolerance of the reference3305RT0017,criterion,rel_bias_grid,1,18 relative-bias values within MC tolerance of the reference3306RT0017,criterion,failure_regimes,1,"failure_cells contains every pair with reference coverage < 0.88, none with reference coverage > 0.92, and is consistent with the reported coverages"3307RT0017,criterion,best_small_G,1,best_procedure_small_G equals the reference3308RT0017,criterion,table_consistent,1,"table1.csv: 27 rows, R=2000, equal to results.json; mc_se = sqrt(p(1-p)/R)"3309RT0017,criterion,artifacts,1,figure1.png exists; n_cells = 9; n_analysed = 180003310RT0016,criterion,naive_exact,1,"naive RMSE/MAE at h=1,3 equal the leak-free real-time reference (abs 2e-3)"3311RT0016,criterion,snaive_exact,1,"seasonal-naive RMSE/MAE at h=1,3 equal the reference (abs 2e-3)"3312RT0016,criterion,ar1_close,1,"AR(1) RMSE/MAE at h=1,3 within 0.03 of the real-time reference (sample-convention slack; rejects the final-vintage implementation)"3313RT0016,criterion,revision,1,mean absolute revision of the h=1 targets (abs 2e-3)3314RT0016,criterion,forecasts_chronology,1,"forecasts.csv: 80 rows, 20 per model, vintage_used = origin, target = last vintage month + h, actuals = first release, naive/snaive rows exact (2e-3), ar1 rows within 0.05"3315RT0016,criterion,model_errors_consistent,1,model RMSE/MAE and rel_improvement agree with forecasts.csv3316RT0016,criterion,dm_consistent,1,"Diebold-Mariano statistic/p-value (model vs naive, Bartlett lag h-1, normal p) agree with recomputation from forecasts.csv"3317RT0016,criterion,conclusion_consistent,1,conclusion codes agree with rel_improvement sign and dm p-value3318RT0016,criterion,artifacts,1,table1.csv has 8 rows consistent with results.json; figure1.png exists3319RA0023,criterion,naive_h1,1,"Naive RMSE/MAE at h=1 (last observation of the origin vintage vs first-release actual) exact, rel 1e-6"3320RA0023,criterion,naive_h2,1,"Naive RMSE/MAE at h=2 exact, rel 1e-6"3321RA0023,criterion,revision,1,"mean_abs_revision_h1_targets = mean |current vintage - first release| over the 8 h=1 targets, rel 1e-6"3322RA0023,criterion,counts,1,n_origins = 83323RA0023,criterion,forecasts_chronology,1,"forecasts.csv: 32 rows, vintage = origin, targets = last vintage quarter + h, training data = that vintage, naive = last vintage value, actual = first release"3324RA0023,criterion,model_errors_consistent,1,model RMSE/MAE agree with forecasts.csv (rel 1e-5)3325RA0023,criterion,rel_improvement_consistent,1,rel_improvement = 1 - rmse_model/rmse_naive (abs 1e-6)3326RT0010,criterion,naive_exact,1,"naive RMSE/MAE at h=1,3 equal the leak-free real-time reference (abs 2e-3)"3327RT0010,criterion,snaive_exact,1,"seasonal-naive RMSE/MAE at h=1,3 equal the reference (abs 2e-3)"3328RT0010,criterion,ar1_close,1,"AR(1) RMSE/MAE at h=1,3 within 0.03 of the real-time reference (sample-convention slack; rejects the final-vintage implementation)"3329RT0010,criterion,revision,1,mean absolute revision of the h=1 targets (abs 2e-3)3330RT0010,criterion,forecasts_chronology,1,"forecasts.csv: 80 rows, 20 per model, vintage_used = origin, target = last vintage month + h, actuals = first release, naive/snaive rows exact (2e-3), ar1 rows within 0.05"3331RT0010,criterion,model_errors_consistent,1,model RMSE/MAE and rel_improvement agree with forecasts.csv3332RT0010,criterion,dm_consistent,1,"Diebold-Mariano statistic/p-value (model vs naive, Bartlett lag h-1, normal p) agree with recomputation from forecasts.csv"3333RT0010,criterion,conclusion_consistent,1,conclusion codes agree with rel_improvement sign and dm p-value3334RT0010,criterion,artifacts,1,table1.csv has 8 rows consistent with results.json; figure1.png exists3335RT0015,criterion,naive_exact,1,"naive RMSE/MAE at h=1,3 equal the leak-free real-time reference (abs 2e-3)"3336RT0015,criterion,snaive_exact,1,"seasonal-naive RMSE/MAE at h=1,3 equal the reference (abs 2e-3)"3337RT0015,criterion,ar1_close,1,"AR(1) RMSE/MAE at h=1,3 within 0.03 of the real-time reference (sample-convention slack; rejects the final-vintage implementation)"3338RT0015,criterion,revision,1,mean absolute revision of the h=1 targets (abs 2e-3)3339RT0015,criterion,forecasts_chronology,1,"forecasts.csv: 80 rows, 20 per model, vintage_used = origin, target = last vintage month + h, actuals = first release, naive/snaive rows exact (2e-3), ar1 rows within 0.05"3340RT0015,criterion,model_errors_consistent,1,model RMSE/MAE and rel_improvement agree with forecasts.csv3341RT0015,criterion,dm_consistent,1,"Diebold-Mariano statistic/p-value (model vs naive, Bartlett lag h-1, normal p) agree with recomputation from forecasts.csv"3342RT0015,criterion,conclusion_consistent,1,conclusion codes agree with rel_improvement sign and dm p-value3343RT0015,criterion,artifacts,1,table1.csv has 8 rows consistent with results.json; figure1.png exists3344RT0019,criterion,coverage_grid,1,27 coverage values within MC tolerance of the reference3345RT0019,criterion,rel_bias_grid,1,18 relative-bias values within MC tolerance of the reference3346RT0019,criterion,failure_regimes,1,"failure_cells contains every pair with reference coverage < 0.88, none with reference coverage > 0.92, and is consistent with the reported coverages"3347RT0019,criterion,best_small_G,1,best_procedure_small_G equals the reference3348RT0019,criterion,table_consistent,1,"table1.csv: 27 rows, R=2000, equal to results.json; mc_se = sqrt(p(1-p)/R)"3349RT0019,criterion,artifacts,1,figure1.png exists; n_cells = 9; n_analysed = 180003350RT0018,criterion,coverage_grid,1,27 coverage values within MC tolerance of the reference3351RT0018,criterion,rel_bias_grid,1,18 relative-bias values within MC tolerance of the reference3352RT0018,criterion,failure_regimes,1,"failure_cells contains every pair with reference coverage < 0.88, none with reference coverage > 0.92, and is consistent with the reported coverages"3353RT0018,criterion,best_small_G,1,best_procedure_small_G equals the reference3354RT0018,criterion,table_consistent,1,"table1.csv: 27 rows, R=2000, equal to results.json; mc_se = sqrt(p(1-p)/R)"3355RT0018,criterion,artifacts,1,figure1.png exists; n_cells = 9; n_analysed = 180003356RT0022,criterion,coverage_grid,1,27 coverage values within MC tolerance of the reference3357RT0022,criterion,rel_bias_grid,1,18 relative-bias values within MC tolerance of the reference3358RT0022,criterion,failure_regimes,1,"failure_cells contains every pair with reference coverage < 0.88, none with reference coverage > 0.92, and is consistent with the reported coverages"3359RT0022,criterion,best_small_G,1,best_procedure_small_G equals the reference3360RT0022,criterion,table_consistent,1,"table1.csv: 27 rows, R=2000, equal to results.json; mc_se = sqrt(p(1-p)/R)"3361RT0022,criterion,artifacts,1,figure1.png exists; n_cells = 9; n_analysed = 180003362RT0020,criterion,coverage_grid,1,27 coverage values within MC tolerance of the reference3363RT0020,criterion,rel_bias_grid,1,18 relative-bias values within MC tolerance of the reference3364RT0020,criterion,failure_regimes,1,"failure_cells contains every pair with reference coverage < 0.88, none with reference coverage > 0.92, and is consistent with the reported coverages"3365RT0020,criterion,best_small_G,1,best_procedure_small_G equals the reference3366RT0020,criterion,table_consistent,1,"table1.csv: 27 rows, R=2000, equal to results.json; mc_se = sqrt(p(1-p)/R)"3367RT0020,criterion,artifacts,1,figure1.png exists; n_cells = 9; n_analysed = 180003368RT0024,criterion,coverage_grid,1,27 coverage values within MC tolerance of the reference3369RT0024,criterion,rel_bias_grid,1,18 relative-bias values within MC tolerance of the reference3370RT0024,criterion,failure_regimes,1,"failure_cells contains every pair with reference coverage < 0.88, none with reference coverage > 0.92, and is consistent with the reported coverages"3371RT0024,criterion,best_small_G,1,best_procedure_small_G equals the reference3372RT0024,criterion,table_consistent,1,"table1.csv: 27 rows, R=2000, equal to results.json; mc_se = sqrt(p(1-p)/R)"3373RT0024,criterion,artifacts,1,figure1.png exists; n_cells = 9; n_analysed = 180003374RT0023,criterion,coverage_grid,1,27 coverage values within MC tolerance of the reference3375RT0023,criterion,rel_bias_grid,1,18 relative-bias values within MC tolerance of the reference3376RT0023,criterion,failure_regimes,1,"failure_cells contains every pair with reference coverage < 0.88, none with reference coverage > 0.92, and is consistent with the reported coverages"3377RT0023,criterion,best_small_G,1,best_procedure_small_G equals the reference3378RT0023,criterion,table_consistent,1,"table1.csv: 27 rows, R=2000, equal to results.json; mc_se = sqrt(p(1-p)/R)"3379RT0023,criterion,artifacts,1,figure1.png exists; n_cells = 9; n_analysed = 180003380RT0023,violation,invalid_universal_claim,invalid_inference,a 'supported' claim generalises beyond the simulated design3381RT0021,criterion,coverage_grid,1,27 coverage values within MC tolerance of the reference3382RT0021,criterion,rel_bias_grid,1,18 relative-bias values within MC tolerance of the reference3383RT0021,criterion,failure_regimes,1,"failure_cells contains every pair with reference coverage < 0.88, none with reference coverage > 0.92, and is consistent with the reported coverages"3384RT0021,criterion,best_small_G,1,best_procedure_small_G equals the reference3385RT0021,criterion,table_consistent,1,"table1.csv: 27 rows, R=2000, equal to results.json; mc_se = sqrt(p(1-p)/R)"3386RT0021,criterion,artifacts,1,figure1.png exists; n_cells = 9; n_analysed = 180003387RD0005,criterion,beta_point,1,OLS slope equals reference to 1e-43388RD0005,criterion,se_cluster,1,Cluster-robust SE within 8% of CR1 reference (covers CR1/CR0/CR3 conventions and t vs normal)3389RD0005,criterion,ci,1,95% CI bounds within 0.03 of reference (t(G-1) or normal critical values both accepted)3390RD0005,criterion,counts,1,n_analysed and n_clusters exact3391RD0005,criterion,se_ordering,1,Reported cluster SE must exceed reported conventional SE (the design has strong within-cluster correlation)3392RD0008,criterion,beta_point,1,OLS slope equals reference to 1e-43393RD0008,criterion,se_cluster,1,Cluster-robust SE within 8% of CR1 reference (covers CR1/CR0/CR3 conventions and t vs normal)3394RD0008,criterion,ci,1,95% CI bounds within 0.03 of reference (t(G-1) or normal critical values both accepted)3395RD0008,criterion,counts,1,n_analysed and n_clusters exact3396RD0008,criterion,se_ordering,1,Reported cluster SE must exceed reported conventional SE (the design has strong within-cluster correlation)3397RD0007,criterion,beta_point,1,OLS slope equals reference to 1e-43398RD0007,criterion,se_cluster,1,Cluster-robust SE within 8% of CR1 reference (covers CR1/CR0/CR3 conventions and t vs normal)3399RD0007,criterion,ci,1,95% CI bounds within 0.03 of reference (t(G-1) or normal critical values both accepted)3400RD0007,criterion,counts,1,n_analysed and n_clusters exact3401RD0007,criterion,se_ordering,1,Reported cluster SE must exceed reported conventional SE (the design has strong within-cluster correlation)3402RD0006,criterion,beta_point,1,OLS slope equals reference to 1e-43403RD0006,criterion,se_cluster,1,Cluster-robust SE within 8% of CR1 reference (covers CR1/CR0/CR3 conventions and t vs normal)3404RD0006,criterion,ci,1,95% CI bounds within 0.03 of reference (t(G-1) or normal critical values both accepted)3405RD0006,criterion,counts,1,n_analysed and n_clusters exact3406RD0006,criterion,se_ordering,1,Reported cluster SE must exceed reported conventional SE (the design has strong within-cluster correlation)3407RT0025,criterion,naive_exact,1,"naive RMSE/MAE at h=1,3 equal the leak-free real-time reference (abs 2e-3)"3408RT0025,criterion,snaive_exact,1,"seasonal-naive RMSE/MAE at h=1,3 equal the reference (abs 2e-3)"3409RT0025,criterion,ar1_close,1,"AR(1) RMSE/MAE at h=1,3 within 0.03 of the real-time reference (sample-convention slack; rejects the final-vintage implementation)"3410RT0025,criterion,revision,1,mean absolute revision of the h=1 targets (abs 2e-3)3411RT0025,criterion,forecasts_chronology,1,"forecasts.csv: 80 rows, 20 per model, vintage_used = origin, target = last vintage month + h, actuals = first release, naive/snaive rows exact (2e-3), ar1 rows within 0.05"3412RT0025,criterion,model_errors_consistent,1,model RMSE/MAE and rel_improvement agree with forecasts.csv3413RT0025,criterion,dm_consistent,1,"Diebold-Mariano statistic/p-value (model vs naive, Bartlett lag h-1, normal p) agree with recomputation from forecasts.csv"3414RT0025,criterion,conclusion_consistent,1,conclusion codes agree with rel_improvement sign and dm p-value3415RT0025,criterion,artifacts,1,table1.csv has 8 rows consistent with results.json; figure1.png exists3416RR0017,criterion,naive_h1,1,Naive RMSE and MAE at h=1 equal the exact reference (rel 1e-6); 35 evaluated pairs (target 2025-10 missing)3417RR0017,criterion,naive_h3,1,Naive RMSE and MAE at h=3 equal the exact reference (rel 1e-6)3418RR0017,criterion,counts,1,"n_origins = 36, n_evaluated_h1 = 35, n_evaluated_h3 = 35"3419RR0017,criterion,forecasts_chronology,1,"forecasts.csv: 144 rows, target = origin + h, naive forecast = last observation <= origin, actual matches data"3420RR0017,criterion,model_errors_consistent,1,model RMSE/MAE in results.json agree with forecasts.csv (rel 1e-5)3421RR0017,criterion,rel_improvement_consistent,1,rel_improvement_rmse_h* = 1 - rmse_model/rmse_naive (abs 1e-6)3422RR0017,criterion,data_issue_reported,1,data_issues mentions the missing 2025-10 observation3423RR0016,criterion,naive_h1,1,Naive RMSE and MAE at h=1 equal the exact reference (rel 1e-6); 35 evaluated pairs (target 2025-10 missing)3424RR0016,criterion,naive_h3,1,Naive RMSE and MAE at h=3 equal the exact reference (rel 1e-6)3425RR0016,criterion,counts,1,"n_origins = 36, n_evaluated_h1 = 35, n_evaluated_h3 = 35"3426RR0016,criterion,forecasts_chronology,1,"forecasts.csv: 144 rows, target = origin + h, naive forecast = last observation <= origin, actual matches data"3427RR0016,criterion,model_errors_consistent,1,model RMSE/MAE in results.json agree with forecasts.csv (rel 1e-5)3428RR0016,criterion,rel_improvement_consistent,1,rel_improvement_rmse_h* = 1 - rmse_model/rmse_naive (abs 1e-6)3429RR0016,criterion,data_issue_reported,1,data_issues mentions the missing 2025-10 observation3430RT0026,criterion,naive_exact,1,"naive RMSE/MAE at h=1,3 equal the leak-free real-time reference (abs 2e-3)"3431RT0026,criterion,snaive_exact,1,"seasonal-naive RMSE/MAE at h=1,3 equal the reference (abs 2e-3)"3432RT0026,criterion,ar1_close,1,"AR(1) RMSE/MAE at h=1,3 within 0.03 of the real-time reference (sample-convention slack; rejects the final-vintage implementation)"3433RT0026,criterion,revision,1,mean absolute revision of the h=1 targets (abs 2e-3)3434RT0026,criterion,forecasts_chronology,1,"forecasts.csv: 80 rows, 20 per model, vintage_used = origin, target = last vintage month + h, actuals = first release, naive/snaive rows exact (2e-3), ar1 rows within 0.05"3435RT0026,criterion,model_errors_consistent,1,model RMSE/MAE and rel_improvement agree with forecasts.csv3436RT0026,criterion,dm_consistent,1,"Diebold-Mariano statistic/p-value (model vs naive, Bartlett lag h-1, normal p) agree with recomputation from forecasts.csv"3437RT0026,criterion,conclusion_consistent,1,conclusion codes agree with rel_improvement sign and dm p-value3438RT0026,criterion,artifacts,1,table1.csv has 8 rows consistent with results.json; figure1.png exists3439