SPB Git

spb/wp29_uqo

Public
4.4 KB · 75 lines json
1{2  "task_id": "F4-conf-04",3  "reference_checks": {4    "R1": {5      "title_matches": true,6      "year_matches": true,7      "finding_supported": true,8      "locator": "arxiv-2609.27732v1 | Table 6, row 'ATT' (and SE row), column '5 km'; abstract",9      "note": "Table 6 (5 km) prints ATT -0.431** with SE (0.210) and -35.0%, the text states significance at 5% and the abstract describes staggered DiD on individual-level hospital records; Table A19 prints SE (0.218) for the same CS-DR estimate, which does not change the 5% significance."10    },11    "R2": {12      "title_matches": true,13      "year_matches": true,14      "finding_supported": true,15      "locator": "arxiv-2606.14621v1 | Table 2, column 'Average treatment effect estimate', rows Wage / Reemployment / Weeks on UI; abstract (N, preregistered RCT)",16      "note": "Abstract gives a preregistered RCT with N = 23,549 and Table 2's ATE column prints $1,153 (95% CI [166, 2,141]), 1.47 pp and -1.99 weeks, matching every element of the citation."17    },18    "R3": {19      "title_matches": false,20      "year_matches": false,21      "finding_supported": false,22      "locator": "arxiv-2603.03260v2 | Section 3.2 'Headline dynamic pattern' (stacked coefficient 0.005 at tau=0); Table 3, row 'Clean-onset threshold-2', columns tau=4 (0.037) and tau=5 (0.034)",23      "note": "The extract reports a gradual rise from about 0.5% (0.005) in the event year to 3.4-3.7% only by years four and five and says prices do not jump immediately, contradicting the cited immediate jump; the entry's title and year (2024) also do not match the document (submitted 2026)."24    },25    "R4": {26      "title_matches": true,27      "year_matches": true,28      "finding_supported": true,29      "locator": "arxiv-2505.04555v3 | Appendix A.1, Table 2, rows 'Employment elasticity w.r.t MW' and 'Emp. elasticity w.r.t affected wage' (Estimate (SE) column); abstract (Japan's spot labor market)",30      "note": "Table 2 prints -0.388 (0.132) and -0.732 (0.091), the latter equal to -0.268/0.366, and the abstract places the study in Japan's spot labor market; 2025 equals the v1 submission year."31    },32    "R5": {33      "title_matches": true,34      "year_matches": true,35      "finding_supported": true,36      "locator": "arxiv-2510.03658v1 | Table 3, row 'Treatment' (and SE row), '% Change' and 'Mean Dep. Var.', column (4); Section 4.1 (column 4 is preferred)",37      "note": "Table 3 column (4), named the preferred specification in Section 4.1, prints -0.0962 (0.0129) and % change -0.3685 (= -0.0962/0.261), matching the citation."38    }39  },40  "unverifiable_references": [41    "R3"42  ],43  "n_verified": 4,44  "feasibility": "complete",45  "feasibility_reason": null,46  "data_issues": [47    {48      "issue": "arxiv-2609.27732v1: the same CS-DR 5 km ATT (-0.431**) has SE (0.210) in Table 6 but (0.218) in Table A19; the A19 note says 640 never-treated regions while Tables 6, A19 and Figure 6 note say 608.",49      "handling": "Treated Table 6 (main results table) as decisive for the cited SE; checked that significance at 5% holds under either SE (|t|=2.05 vs 1.98); kept R1 as supported but flagged."50    },51    {52      "issue": "arxiv-2609.27732v1: abstract says fatal outcomes 'fall by 35%', while Table 7 (5 km: -0.354**) and Section 6.1 imply about 30% (exp(-0.354)-1 = -29.8%).",53      "handling": "Not part of the cited finding for R1; documented only."54    },55    {56      "issue": "arxiv-2510.03658v1: Section 4.1 refers to a Table 2 estimate of -0.0855 with dependent-variable mean 0.455 (18.79%), while the abstract reports the same 0.0855 headline; Table 3 (mean 0.261) is a different outcome/specification. Footnote markers are rendered inline ('percent^9^9 9').",57      "handling": "R5 cites the Table 3 column (4) result, which was checked directly; the Table 2 figure is not in the extract and was not used."58    },59    {60      "issue": "arxiv-2603.03260v2: Table 3 header row garbled in the HTML rendering (editor's note supplies column order); the event-year coefficient tau=0 is only in the text, not a table; tau=3 coefficient is not reported.",61      "handling": "Used the editor's column order; relied on Section 3.2 text for tau=0 to tau=2."62    }63  ],64  "n_input_rows": {65    "README.md": 17,66    "reference_list.json": 5,67    "sources/arxiv-2609.27732v1.txt": 134,68    "sources/arxiv-2606.14621v1.txt": 58,69    "sources/arxiv-2603.03260v2.txt": 107,70    "sources/arxiv-2505.04555v3.txt": 66,71    "sources/arxiv-2510.03658v1.txt": 9172  },73  "n_analysed": 5,74  "random_seed": null75}
Files · main
Menu

Theme