SPB Git

spb/wp29_uqo

Public
1.6 KB · 30 lines markdown
1# Verification checks (P4)23Reproducibility: out/ deliverables deleted, analysis.py run twice from workspace root; results.json, table1.csv and stdout byte-identical (cmp) -> PASS. (Note: an early comparison using /tmp was contaminated by another process writing to /tmp; redone inside out/state/scratch.)45| check | outcome | detail |6|---|---|---|7| FE recomputed independently | PASS | -0.188143 vs -0.188143 |8| Q recomputed | PASS | 0.323686 |9| tau2=0 since Q<df -> RE==FE | PASS | Q=0.3237<1 |10| I2 rule | PASS | I2=0.0 |11| SEs positive | PASS | 0.1063,0.1063 |12| CIs contain estimates | PASS | [-0.3964,0.0201] |13| CI width = 2*1.96*SE | PASS |  |14| significance flag consistent | PASS | False |15| pct change | PASS | -17.150% |16| counts | PASS | 5,4,2 |17| poolable implies SE non-null; not harmonisable implies null theta | PASS |  |18| reason_if_not present iff not poolable | PASS |  |19| S1 SE vs CI | PASS | 0.1378 vs 0.14 |20| S1 p consistent with b/SE | PASS | 0.0865 vs 0.086 |21| S4 approx SE reproduces p | PASS |  |22| S3 printed % vs ratio of means | PASS | -0.2981 vs -0.2979 (rounding) |23| S4 printed % vs ratio of means | PASS | 0.1125 vs 0.111 (small discrepancy, reported) |24| FE within range of pooled inputs | PASS | -0.240..-0.118 |25| magnitude vs baseline unweighted mean of pooled | PASS | -0.1881 vs -0.1788 |26| exclusion ledger chain | PASS | 5->5->4->2 |27| table1 has 5 rows and 12 cols | PASS |  |2829No failed checks. Two small source-internal discrepancies (S3, S4 printed % vs ratio of printed means) are recorded as data_issues; sensitivity keys show negligible effect on FE (sensitivity_s4_ratio_of_means, sensitivity_s1_se_from_ci).30
Files · main
Menu

Theme