SPB Git

spb/wp35_uqo

Public
6.5 KB

# WP35 — Measurement report (Phase 3)

All numbers come from results/empirical/measurement_diagnostics.json, measurement_diagnostics_modern.json, measurement_irt_item_parameters.csv, power_h2a_*.csv, produced by python -m wp35.measurement.build_indices (2026-11-01). No outcome variable was read by that module. Definitions follow research/preregistration.md §3.

# 1. Seshat (polity level)

# 1.1 Coordination demand D

Four logged scale variables (polity population, territory, largest-settlement population; settlement hierarchy levels unlogged). First principal component of their pairwise-complete correlation matrix explains 82.1% of variance with near-equal loadings (log pop 0.26, log territory 0.24, log capital 0.26, settlement hierarchy 0.24). Score = loading- weighted mean of available standardized variables, requiring ≥ 2 of 4; 442 polities have D_pc1; 299 have population alone (log_pop). Range bounds (value_from/value_to) propagate to D_pc1_lo/hi: the median half-width is 0.017 SD, the 90th percentile 0.093 SD, so range uncertainty in the scale variables is small relative to between-polity variation (the larger uncertainty is which polities have any estimate at all).

# 1.2 Coordination capacity K

Four blocks of presence indicators, each the share coded present among coded items (≥ 50% coded required): administration (5 items incl. rank-scaled administrative levels), standardized rules and money (10), communication infrastructure (7), record-keeping (9). K_mean = mean of blocks with ≥ 3 blocks: 344 polities. Inter-block correlations 0.75–0.79; first PC of the blocks explains 82.4% (loadings 0.25 each), and K_pc1 correlates 0.999 with K_mean. Cronbach α of the four blocks by macro-region ranges 0.83 (Europe) to 0.97 (South Asia); mean off-diagonal block correlation by era 0.67 (1001–1500) to 0.81 (pre-1000 BCE) — the four capacity blocks hang together in every region and era. Latent alternative: 2PL IRT (MAP, log-normal prior on discrimination, EM converged in 135 iterations) on the 30 binary items (disputed 0.5 → missing; administrative levels excluded) gives K_irt for 579 polities (≥ 3 items). It correlates 0.96 with K_mean. Item difficulties order sensibly (tokens, non-written records, roads, couriers easy; paper currency, general postal service, examination system, merit promotion hard; article is nearly universal and uninformative). Five record-keeping items (written record, script, lists/tables, calendar, practical literature) hit the discrimination ceiling (8): they are coded almost jointly in Seshat, i.e. locally dependent; the latent score is therefore dominated by the "writing cluster", which is why we keep the transparent block mean as primary. Posterior SD of K_irt: median 0.34, 90th percentile 0.61 (on a unit-variance scale) — individual-polity capacity scores carry substantial uncertainty; this is carried into the econometrics through the IRT variant and the bound runs. Cross-region invariance: refitting the IRT separately on the Old World (n = 532) and on the Americas + Southeast Asia/Oceania (n = 94) gives item difficulties correlated 0.88 across the two fits (mean absolute difference 1.16 logits, inflated by boundary estimates on the small New-World sample). Comparability is acceptable for the ordering of items but the New-World sample is too small for a strict invariance test; leave-region-out results (H5) are the operational safeguard. Leave-one-block-out: dropping any block leaves K correlated ≥ 0.98 with the full index and P correlated ≥ 0.95 with P_main.

# 1.3 Coordination pressure P and the collinearity problem

P_main = z(D_pc1) − z(K_mean) is defined for 317 polities and, in pre-crisis form, for 127 of the 166 CrisisDB records. As anticipated from Turchin et al. (2018) and Shin et al. (2020), scale and capacity are strongly collinear: corr(D_pc1, K_mean) = 0.84 (0.80 with K_irt). Consequently P_main retains only 16.6% of the variance of z(D)+z(K); it correlates 0.39 with D and −0.18 with K, and −0.04 with the Turchin-style single complexity axis (complexity_pc1, first PC of 57 social-complexity indicators, 49.7% of variance). The mismatch index is thus nearly orthogonal to overall complexity, which is exactly what makes the H2 test informative if P carries signal, and what makes it fragile: P is a residual, so measurement error in either D or K leaks into it. The pre-registered baselines (D-only, K-only, complexity-PC1-only) address this directly.

# 1.4 A-priori power (pre-registration §5.8; random outcomes, actual P distribution, n = 127)

Outcome β (per SD of P, logit) power
Y1b binary (base rate 0.77) 0.4 / 0.5 / 0.6 / 0.8 0.47 / 0.63 / 0.79 / 0.95
Y1 fractional (14 items, base 0.29) 0.10 / 0.15 / 0.20 0.49 / 0.81 / 0.96
Decision (pre-registered rule): the binary severe-outcome test Y1b is underpowered a priori (MDE ≈ 0.6 > 0.5);
the fractional severity Y1 is adequately powered for effects of ≈ 0.15 log-odds per SD. Y1 remains the primary
Seshat H2 outcome; Y1b is reported as secondary.

# 2. Modern panel

K_modern = mean of six standardized V-Dem items (≥ 4 coded): rigorous/impartial administration, meritocratic appointment, transparent laws, fiscal capacity source, territorial control, EMB capacity; PC1 explains 60.5% with loadings 0.13–0.19. D_modern = log Maddison population (1820+); P_modern defined for 15,697 country-years. corr(D, K) = 0.06 (no collinearity problem in the modern panel). Caveat fixed before analysis: corr(K_modern, v2x_polyarchy) = 0.75 — the V-Dem capacity items are strongly associated with electoral democracy even though no democracy index enters K; all modern specifications therefore control for polyarchy as pre-registered, and the K-only baseline is reported.

# 3. Ethnographic Atlas

log_community_size from EA031 category midpoints (611 societies), log_population from continuous EA202 (953), jurisdictional_hierarchy_beyond = EA033 − 1 (0–4 levels; 1,155). No outcome; used for H1 only, with Glottolog family (173 families) and region controls.

# 4. What the measurement model cannot do

  • Seshat K items are presence codes: they measure existence, not reach or quality, of institutions.
  • Most facts are undated, so "pre-crisis" K is mostly whole-polity K (see pre-registration §3.6).
  • No direct indicator of division of labour or dispersion in Polaris; D is scale only.
  • IRT local dependence among writing items; invariance only coarsely checked.
Files · 39ef4252c6e9baf1f0a3a4809ca1ab5579d2895d
Menu

Theme