SPB Git

spb/wp29_uqo

Public
3.6 KB · 66 lines json
1{2  "task_id": "F4-conf-02",3  "verdicts": {4    "A1": "supported",5    "A2": "not_supported",6    "A3": "not_supported",7    "A4": "not_supported",8    "A5": "not_assessable",9    "A6": "supported"10  },11  "locators": {12    "A1": "arxiv-2609.27732v1 | Table 6 | row \"ATT\" | column \"5 km\"",13    "A2": "arxiv-2609.27732v1 | Table 7 | row \"HIV\" | column \"1 km\"",14    "A3": "arxiv-2609.27732v1 | Table 6 | row \"% change\" | column \"3 km\"",15    "A4": "arxiv-2609.27732v1 | Table 7 | row \"Hepatitis\" | column \"5 km\"",16    "A5": "not reported in arxiv-2609.27732v1",17    "A6": "arxiv-2606.14621v1 | Table 2 | row \"Weeks on UI\" | column \"Average treatment effect estimate\""18  },19  "reasons": {20    "A1": "Table 6 prints ATT -0.431** (SE 0.210) at 5 km (** = p<0.05) and a % change of -35.0%, matching 100*(exp(-0.431)-1) = -35.0%.",21    "A2": "Table 7 prints the 1 km HIV ATT as +0.063 (SE (0.801)), positive and insignificant, so the sign claimed (-0.063, a fall) is contradicted.",22    "A3": "An ATT of -0.283 log points implies 100*(exp(-0.283)-1) = -24.6% (Table 6 prints -24.7%), not 28.3%; the assertion equates log points with percent.",23    "A4": "With ATT -0.406 and SE 0.250 (no star), the 95% CI is [-0.896, 0.084] (±1.96 SE), which includes zero; the claimed [-0.66, -0.16] is only ±1 SE ((-0.656, -0.156)).",24    "A5": "The extract reports ATTs only by buffer, outcome category and estimator; no estimate by sex (men vs women) appears anywhere, so the comparison can be neither confirmed nor refuted.",25    "A6": "Table 2 prints the ATE -1.99 weeks (95% CI [-2.24, -1.75]) with control mean 17.3 weeks, and 1.99/17.3 = 11.5%, as also stated in the Section 3 text."26  },27  "n_supported": 2,28  "n_not_supported": 3,29  "n_not_assessable": 1,30  "feasibility": "complete",31  "feasibility_reason": null,32  "data_issues": [33    {34      "issue": "arxiv-2609.27732v1: Table A19 prints the CS-DR 5 km ATT -0.431** with SE (0.218), whereas Table 6 prints the same estimate with SE (0.210).",35      "handling": "A1 assessed against Table 6 (the cited main table); with SE 0.218 the estimate remains significant at 5% (|t|=1.98), so the verdict is unchanged."36    },37    {38      "issue": "arxiv-2609.27732v1: Table A19 note states 640 never-treated comparison regions while its 'Control regions' row and Tables 6-7 state 608.",39      "handling": "Recorded; does not bear on any assertion."40    },41    {42      "issue": "arxiv-2609.27732v1: abstract says fatal hospitalisations fall by 35%, but Table 7 (5 km, -0.354) implies -29.8% and Section 6.1 says 'approximately 30%'.",43      "handling": "Recorded as an internal inconsistency; no assertion concerns this number."44    },45    {46      "issue": "arxiv-2609.27732v1: results text calls HIV estimates 'close to zero', although 3 km and 5 km point estimates are -0.239 and -0.340 (insignificant).",47      "handling": "Recorded; A2 judged on the printed 1 km coefficient (+0.063)."48    },49    {50      "issue": "arxiv-2609.27732v1: extract ends mid-sentence in the Table A19 note (truncated).",51      "handling": "No assertion depends on the missing text."52    },53    {54      "issue": "arxiv-2606.14621v1: Section 3 text reports the weeks-on-UI CIs as positive magnitudes ([1.75, 2.24], [1.55, 1.99]) while Table 2 prints signed values; text contains rendering defect 'p ¡ 0.001' (for p < 0.001).",55      "handling": "Treated as sign convention for a 'reduction' and a character-encoding defect; A6 judged on Table 2 values."56    }57  ],58  "n_input_rows": {59    "assertions.json": 6,60    "README.md": 14,61    "arxiv-2609.27732v1.txt": 134,62    "arxiv-2606.14621v1.txt": 5863  },64  "n_analysed": 6,65  "random_seed": null66}
Files · main
Menu

Theme