1# WP35 — Measurement report (Phase 3)23All numbers come from `results/empirical/measurement_diagnostics.json`, `measurement_diagnostics_modern.json`,4`measurement_irt_item_parameters.csv`, `power_h2a_*.csv`, produced by `python -m wp35.measurement.build_indices`5(2026-11-01). **No outcome variable was read by that module.** Definitions follow `research/preregistration.md` §3.67## 1. Seshat (polity level)89### 1.1 Coordination demand D10Four logged scale variables (polity population, territory, largest-settlement population; settlement hierarchy levels11unlogged). First principal component of their pairwise-complete correlation matrix explains **82.1%** of variance with12near-equal loadings (log pop 0.26, log territory 0.24, log capital 0.26, settlement hierarchy 0.24). Score = loading-13weighted mean of available standardized variables, requiring ≥ 2 of 4; **442 polities** have `D_pc1`; 299 have14population alone (`log_pop`). Range bounds (`value_from`/`value_to`) propagate to `D_pc1_lo/hi`: the median half-width15is 0.017 SD, the 90th percentile 0.093 SD, so range uncertainty in the scale variables is small relative to16between-polity variation (the larger uncertainty is *which* polities have any estimate at all).1718### 1.2 Coordination capacity K19Four blocks of presence indicators, each the share coded present among coded items (≥ 50% coded required):20administration (5 items incl. rank-scaled administrative levels), standardized rules and money (10), communication21infrastructure (7), record-keeping (9). `K_mean` = mean of blocks with ≥ 3 blocks: **344 polities**. Inter-block22correlations 0.75–0.79; first PC of the blocks explains 82.4% (loadings 0.25 each), and `K_pc1` correlates 0.999 with23`K_mean`. Cronbach α of the four blocks by macro-region ranges 0.83 (Europe) to 0.97 (South Asia); mean off-diagonal24block correlation by era 0.67 (1001–1500) to 0.81 (pre-1000 BCE) — the four capacity blocks hang together25in every region and era.26Latent alternative: 2PL IRT (MAP, log-normal prior on discrimination, EM converged in 135 iterations) on the 30 binary27items (disputed 0.5 → missing; administrative levels excluded) gives `K_irt` for **579 polities** (≥ 3 items). It28correlates **0.96** with `K_mean`. Item difficulties order sensibly (tokens, non-written records, roads, couriers easy;29paper currency, general postal service, examination system, merit promotion hard; `article` is nearly universal and30uninformative). Five record-keeping items (written record, script, lists/tables, calendar, practical literature) hit the31discrimination ceiling (8): they are coded almost jointly in Seshat, i.e. locally dependent; the latent score is32therefore dominated by the "writing cluster", which is why we keep the transparent block mean as primary. Posterior SD of33`K_irt`: median 0.34, 90th percentile 0.61 (on a unit-variance scale) — individual-polity capacity scores carry34substantial uncertainty; this is carried into the econometrics through the IRT variant and the bound runs.35Cross-region invariance: refitting the IRT separately on the Old World (n = 532) and on the Americas + Southeast36Asia/Oceania (n = 94) gives item difficulties correlated **0.88** across the two fits (mean absolute difference 1.1637logits, inflated by boundary estimates on the small New-World sample). Comparability is acceptable for the ordering38of items but the New-World sample is too small for a strict invariance test; leave-region-out results (H5) are the39operational safeguard.40Leave-one-block-out: dropping any block leaves `K` correlated ≥ 0.98 with the full index and `P` correlated ≥ 0.9541with `P_main`.4243### 1.3 Coordination pressure P and the collinearity problem44`P_main = z(D_pc1) − z(K_mean)` is defined for **317 polities** and, in pre-crisis form, for **127 of the 166 CrisisDB45records**. As anticipated from Turchin et al. (2018) and Shin et al. (2020), scale and capacity are strongly46collinear: corr(`D_pc1`, `K_mean`) = **0.84** (0.80 with `K_irt`). Consequently `P_main` retains only **16.6%** of the47variance of z(D)+z(K); it correlates 0.39 with D and −0.18 with K, and −0.04 with the Turchin-style single complexity48axis (`complexity_pc1`, first PC of 57 social-complexity indicators, 49.7% of variance). The mismatch index is thus49nearly orthogonal to overall complexity, which is exactly what makes the H2 test informative *if* P carries signal, and50what makes it fragile: P is a residual, so measurement error in either D or K leaks into it. The pre-registered51baselines (D-only, K-only, complexity-PC1-only) address this directly.5253### 1.4 A-priori power (pre-registration §5.8; random outcomes, actual P distribution, n = 127)54| Outcome | β (per SD of P, logit) | power |55|---|---|---|56| Y1b binary (base rate 0.77) | 0.4 / 0.5 / 0.6 / 0.8 | 0.47 / 0.63 / 0.79 / 0.95 |57| Y1 fractional (14 items, base 0.29) | 0.10 / 0.15 / 0.20 | 0.49 / 0.81 / 0.96 |58**Decision (pre-registered rule):** the binary severe-outcome test Y1b is *underpowered a priori* (MDE ≈ 0.6 > 0.5);59the fractional severity Y1 is adequately powered for effects of ≈ 0.15 log-odds per SD. Y1 remains the primary60Seshat H2 outcome; Y1b is reported as secondary.6162## 2. Modern panel63`K_modern` = mean of six standardized V-Dem items (≥ 4 coded): rigorous/impartial administration, meritocratic64appointment, transparent laws, fiscal capacity source, territorial control, EMB capacity; PC1 explains 60.5% with65loadings 0.13–0.19. `D_modern` = log Maddison population (1820+); `P_modern` defined for **15,697 country-years**.66corr(D, K) = 0.06 (no collinearity problem in the modern panel). **Caveat fixed before analysis:** corr(`K_modern`,67`v2x_polyarchy`) = **0.75** — the V-Dem capacity items are strongly associated with electoral democracy even though no68democracy index enters K; all modern specifications therefore control for polyarchy as pre-registered, and the K-only69baseline is reported.7071## 3. Ethnographic Atlas72`log_community_size` from EA031 category midpoints (611 societies), `log_population` from continuous EA202 (953),73`jurisdictional_hierarchy_beyond` = EA033 − 1 (0–4 levels; 1,155). No outcome; used for H1 only, with Glottolog74family (173 families) and region controls.7576## 4. What the measurement model cannot do77- Seshat K items are presence codes: they measure *existence*, not reach or quality, of institutions.78- Most facts are undated, so "pre-crisis" K is mostly whole-polity K (see pre-registration §3.6).79- No direct indicator of division of labour or dispersion in Polaris; D is scale only.80- IRT local dependence among writing items; invariance only coarsely checked.81