SPB Git

spb/wp35_uqo

Public
5.0 KB · 62 lines markdown
1# WP35 — Limitations (written after Phases 4–5, before the paper)23Each item names the deliverable it qualifies. "EMPIRICAL" refers to Seshat/EA/V-Dem estimates; "SIMULATED" to the4agent-based results; neither is causal.56## A. Data (EMPIRICAL)71. **Crisis-selected outcome.** CrisisDB covers 150 of 626 polities; H2-A tests severity conditional on a recorded crisis.82. **Undated facts.** 93.7% of Polaris social-complexity facts have no date; "pre-crisis" capacity is mostly whole-polity9   capacity. A dated-only test was not estimable.103. **Presence codes.** Seshat K items record whether an institution existed, not its reach, quality or cost.114. **Scale-only D.** No usable indicators of division of labour or dispersion in Polaris; occupational complexity is coded12   for 75 polities only and was excluded.135. **Collinearity.** corr(D, K) = 0.84; P keeps 17% of the joint variance and is a residual; measurement error in either14   index leaks into P.156. **Coder circularity.** Polaris codes and CrisisDB codes are produced by the same project from overlapping16   historiography; a polity known to have collapsed may be coded as less administratively capable.177. **Polity boundaries.** Seshat polities are periodization decisions; "polity end" (Y2) is not an instability event.188. **Modern K and democracy.** The six V-Dem capacity items correlate 0.75 with electoral democracy; the capacity19   interpretation competes with regime type. Expert coders rate periods knowing later events.209. **Modern D.** Maddison population starts in 1820 for most countries; land area only from 1886; no dispersion measure.2110. **Ethnographic Atlas.** Cross-section with focal years −2000 to 1965; no outcome; EA031 is a coarse ordinal measure;22    midpoints of open categories are bounds.2311. **Crosswalks.** 39 V-Dem countries (mostly historical or micro-states) lack Maddison population and drop out.2425## B. Design and inference (EMPIRICAL)2612. **No identification.** Associations only (research/identification.md). The modern negative control shows P associated27    with past events as strongly as with future events, so P marks chronically unstable countries rather than forecasting28    onsets; the Oster-adjusted coefficient crosses zero and the Cinelli–Hazlett robustness value is 0.07.2913. **Power.** Seshat binary Y1b is underpowered (MDE ≈ 0.6 SD); only the fractional severity outcome has adequate power.3014. **Few clusters.** 42 regions / 10 macro-regions; cluster-robust inference with few clusters is anti-conservative;31    alternative clusterings are reported.3215. **Baselines decide the verdict.** By the pre-registered rule, P must beat every baseline out of sample in ≥ 80% of33    folds: it fails against the D-only baseline in Seshat (leave-one-region-out) and against the K-only baseline in the34    modern panel (both schemes). The mismatch index therefore adds no predictive content beyond its own components.3516. **Placebo.** A Seshat placebo index (scale minus production infrastructure) performs about as well as P; the modern36    placebo (scale minus polyarchy) is weaker than P but still significant.3717. **Nonlinearity.** The modern hinge/spline improvement is 0.001 nats per observation and meets the 80% rule by one fold;38    it is reported as marginal, not as a threshold.3918. **Equinox-2020 replication** was pre-registered but not executed (time); it is listed as a blocked task in the final audit.4041## C. Theory (PROPOSITION / CONJECTURE)4219. Theorems 1–5 concern an idealized communication system; nothing in them is tested on historical data. C1–C3 are43    conjectures; C1 (proxy monotonicity) is undermined by the collinearity and placebo results above.4420. Capacity is exogenous in the model; historically it is built in response to demand.4546## D. Simulations (SIMULATED)4721. Institutions are imposed, not emergent; results describe the cost structure of imposed regimes.4822. Message and bit accounting is stylized (one-bit acknowledgements, fixed admin overhead per task); absolute numbers are49    not comparable to any historical quantity. Only within-simulation comparisons are meaningful.5023. Decoding success does not depend on the plan drawn, so distribution shocks affect cost but not success by51    construction; this is a modelling choice, not a finding.5224. Hierarchy saturation depends on the administrative-capacity ratio, a free parameter swept from 0.25 to 4; the53    "phase" boundary near ratio 1 follows from Theorem 5 and is confirmed, not discovered.5425. Shannon codes (not Huffman) are used so that the measured stale-code penalty is comparable to Theorem 3; with weakly55    concentrated plan distributions a Shannon code can be longer than raw coding (one cell), and a learning cost of 20056    bits per agent is repaid only with a large, concentrated plan space and a long horizon.5758## E. Process5926. Executed autonomously by a language-model agent in one session; the PI has not yet reviewed the code or the text.6027. Reference verification relied on Crossref metadata; chapter contents of Johnson (1982) and the published tables of61    Sng (2014) were not read.62
Files · 39ef4252c6e9baf1f0a3a4809ca1ab5579d2895d
Menu

Theme