SPB Git

spb/wp29_uqo

Public
3.5 KB · 62 lines json
1{2  "task_id": "F4-conf-02",3  "verdicts": {4    "A1": "supported",5    "A2": "not_supported",6    "A3": "not_supported",7    "A4": "not_supported",8    "A5": "not_assessable",9    "A6": "supported"10  },11  "locators": {12    "A1": "arxiv-2609.27732v1 | Table 6 | row \"ATT\" / \"% change\" | column \"5 km\"",13    "A2": "arxiv-2609.27732v1 | Table 7 | row \"HIV\" | column \"1 km\"",14    "A3": "arxiv-2609.27732v1 | Table 6 | row \"% change\" | column \"3 km\"",15    "A4": "arxiv-2609.27732v1 | Table 7 | row \"Hepatitis\" | column \"5 km\"",16    "A5": "not reported in arxiv-2609.27732v1",17    "A6": "arxiv-2606.14621v1 | Table 2 | row \"Weeks on UI\" | column \"Average treatment effect estimate\""18  },19  "reasons": {20    "A1": "Table 6 prints ATT -0.431** (0.210) and -35.0% at 5 km, with ** denoting p<0.05, matching every element (100*(exp(-0.431)-1) = -35.0%).",21    "A2": "Table 7 prints the 1 km HIV ATT as +0.063 (SE 0.801), positive and insignificant, so the sign and the claimed fall in HIV hospitalisations are contradicted.",22    "A3": "Table 6 converts the 3 km ATT of -0.283 to -24.7% (100*(exp(-0.283)-1) = -24.6%), not 28.3%; the assertion equates log points with percent (and omits that the estimate is insignificant, SE 0.279).",23    "A4": "With ATT -0.406 and SE 0.250 the 95% CI is [-0.90, 0.08] (±1.96·SE), which includes zero (the asserted [-0.66, -0.16] is ±1·SE) and the estimate carries no significance star.",24    "A5": "The extract reports ATTs only by buffer, outcome category and estimator (Tables 6, 7, A19) and contains no estimate by sex, so the men-vs-women comparison can be neither confirmed nor refuted.",25    "A6": "Table 2 prints the ATE as -1.99 weeks (95% CI [-2.24, -1.75]) against a control mean of 17.3 weeks, and 1.99/17.3 = 11.5%, matching the 11.5% stated in the Section 3 text."26  },27  "n_supported": 2,28  "n_not_supported": 3,29  "n_not_assessable": 1,30  "feasibility": "complete",31  "feasibility_reason": null,32  "data_issues": [33    {34      "issue": "Table A19 reports the CS-DR 5 km ATT -0.431** with SE (0.218), while Table 6 reports the same estimate with SE (0.210).",35      "handling": "A1 cites the main Table 6 and asserts SE 0.210; judged against Table 6. Significance at 5% holds under either SE (|t|=2.05 or 1.98 vs 1.96); noted as an internal inconsistency."36    },37    {38      "issue": "Table A19 note states 640 never-treated comparison regions, while Tables 6/7, A19 body and Figure 6 note state 608.",39      "handling": "Not decisive for any assertion; recorded only."40    },41    {42      "issue": "Abstract says fatal hospitalisations 'fall by 35%', whereas Table 7 (-0.354 at 5 km) implies -29.8% and Section 6.1 says 'approximately 30%'.",43      "handling": "Not decisive for any assertion; recorded only."44    },45    {46      "issue": "Results text says HIV estimates are 'close to zero', though the 5 km HIV ATT is -0.340 (insignificant).",47      "handling": "A2 judged on the Table 7 number (1 km = +0.063), not the prose."48    },49    {50      "issue": "RESEA text writes the weeks-on-UI CI as positive magnitudes '[1.75 weeks, 2.24 weeks]' for the reduction, while Table 2 gives [-2.24, -1.75]; also a rendering defect 'p ¡ 0.001' in Section 3.",51      "handling": "Sign-convention difference only; A6 judged against Table 2 values, which are consistent with the text."52    }53  ],54  "n_input_rows": {55    "assertions.json": 6,56    "README.md": 14,57    "sources/arxiv-2609.27732v1.txt": 134,58    "sources/arxiv-2606.14621v1.txt": 5859  },60  "n_analysed": 6,61  "random_seed": null62}
Files · main
Menu

Theme