FINAL_DELIVERY — UQO Working Paper No. 28
Title. Beyond One-Step Distributed Maximum Likelihood: Local Bias Cancellation, Global Synchronization, and the Price of Inexact Curvature.
Author. Simon-Pierre Boucher (UQO). Provenance and AI-use disclosure follows the abstract (the prior note's "GPT-6.1" designation was removed at the author's request; no funding line).
Identifier. WP28 (free in the series; collision note in SOURCE_PROVENANCE.md). Manuscript. paper/main.pdf (page count in scripts/validate_pdf.sh output; 53 pages at the last build).
Strongest proved results
- Theorem 1: under A1 (uniform stochastic expansion), A2(r) (bias expansion of order r), A3 (local Newton regularity), fixed p, m → ∞: K = o(N^{1−1/(2^{q+1}r)}) ⇒ √N(θ^{(q)}_r − θ̂_N) → 0 and √N(θ^{(q)}_r − θ₀) ⇒ N(0, Σ_ψ). The centered remainder of order (m√K)⁻¹ is carried explicitly.
- Theorem 2: exact exponential identities (moments, biases, Var J₂, Newton map and basin), boundary limit −θ₀(β_r c^r)^{2^q} (q ≥ 1) / β_rθ₀c^r (q = 0) when K/N^{α(r,q)} → c, divergence beyond: the exponent is sharp for the construction.
- Theorem 3: inexact Newton bound O_p(‖e‖² + δ_N‖e‖ + ‖δ_g‖); stale averaged local Hessians ⇒ α = 1 − 1/(2(r+q)) (needs A4); single-machine Hessian ⇒ α = 1 − 1/(2r+q) (recovers CEASE (t+1)/(t+2), JLY 2/3, Zhu–Li–Wang 3/4); b-bit relative quantization needs b ≥ (½ − r(1−α))log₂N + ω(1).
- Proposition 4 (unequal sizes, misspecification), Proposition 5 (cost model, conditional), Corollary 1 (inference).
- Algebraic core machine-checked: 27 Lean 4/Mathlib theorems (
theory/lean/).
New vs. known
Known: generalized jackknife (Quenouille; Schucany–Gray–Owen; Dhaene–Jochmans), distributed one-step estimator (Huang–Huo), debias-then-average (ZDW SAVGM; Gu–Chen; Wu–Zhu–Wang; Yin), rounds frontiers (JLY; CEASE), local-Hessian one step (Zhu–Li–Wang). New: joint (r,q) frontier, its sharpness in an exact model, inexact-curvature frontier with bit counts. Not checked: texts behind paywalls listed in literature/PRIORITY_AND_GAP.md §5.
Simulations actually run
- 39 exponential cells (2000 reps; 500 at N = 2^22), 136 logistic/Poisson/robustness cells on 18 cluster nodes (1000/500 reps), 32 failure-affected cells rerun with valid-worker-only variants (500 reps for the ten N = 2^20 cells), boundary study (60 cells), ablations (8 + 6 cells), unequal sizes (10 cells); all completed; seeds = 20261028 + hash(cell); manifests in experiments/EXPERIMENT_MANIFEST.csv; standard errors in results/processed/*.csv.
- Benchmarks: 51 runs (17 designs × 3) of the real TCP protocol on MacLustr, coordinator M4M64a (Mac Studio M4 Max), up to 16 distinct hosts, K ∈ {16, 64, 128}, p ∈ {8, 64}; results/raw/benchmarks.jsonl; summary in paper §10.
Main caveats
Fixed p and i.i.d. only; sufficient exponents, sharp only for the construction in the exponential model; boundary regime reached only at very large N (finite-m prediction provided); finite-sample floor (m√N)⁻¹ after bias cancellation; higher-order patterns fail at m ≲ 16p in logistic regression (failures reported, valid-worker-only variants provided); benchmarks specific to one LAN; no lower bounds, energy or cost claims; adaptive order open.
Paths
- PDF:
paper/main.pdf; LaTeX:paper/main.tex+sections/,appendices/,tables/(generated),figures/; bibliographypaper/references.bib(40 entries, verified inliterature/PRIOR_ART_MATRIX.csv). - Theory:
theory/ASSUMPTIONS.md,theory/THEOREM_AUDIT.md,theory/symbolic_checks.py,theory/lean/. - Code:
src/pamle/; teststests/; experimentsexperiments/; resultsresults/{raw,processed,tables,figures}. - Audits:
literature/,FINAL_REVIEW.md,LIMITATIONS_AND_CLAIMS.md,PHASE_STATUS.md,research_log.md. - Series summary files:
WP28_Research_Summary.md(this file + README),WP28_Theorem_Audit.md= theory/THEOREM_AUDIT.md,WP28_Prior_Art_and_Novelty.md= literature/PRIORITY_AND_GAP.md,WP28_Experiment_Results.csv= results/processed/summary.csv,WP28_Final_Review.md= FINAL_REVIEW.md (symlinks in the repository root). - Git: local repository with full history; remote
gitsrv:srv/git/wp28_uqo.git(spbgit).
Reproduction
python3 -m pip install -r requirements.txt && pytest -q && python3 theory/symbolic_checks.py
bash scripts/check_lean.sh # optional, needs elan
bash scripts/reproduce_all.sh # laptop parts (hours)
python3 experiments/scatter_cluster.py --configs ... --launch ; python3 experiments/run_benchmarks.py ... # cluster
bash scripts/compile_paper.sh && bash scripts/validate_pdf.shSuggested next step
A worst-case necessity construction over a class of regular likelihoods (Volgushev et al. style) for Theorem 2(vi), and a second-order expansion of the one-step gap that makes the (m√N)⁻¹ floor explicit; then a second network (high latency) for the cost model.