SPB Git

spb/localvm-research Public License

Running LLMs larger than memory on a consumer Mac — falsification-driven research: margin-gated deferred refinement, out-of-core verification on Apple Silicon. TR-01 published.

Python 63.2% JavaScript 23.5% CSS 11.8% Shell 0.9% Makefile 0.5%

History of experiments/candidate_01/hypothesis.md · clear filter

  1. expG@8B: favorable scaling; candidate_01 first run: bytes pass, metric insight
    …
    8B: esc@99% falls to 22.6% at 4-bit. Candidate: 154-231 MB/token logical
(9-14x under checkpoint); verify-all at hardware ceiling (q8 self-
agreement 1.56%/token prefill/decode flips); margin-mode seq-fidelity
fails as registered -> quality-level metrics now mandatory.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
    Simon-Pierre Boucher committed 5 h ago (Aug 12, 2026) · 1 file changed +15 −4
  2. candidate_01: margin-gated deferred-refinement runtime + benchmark + hypothesis
    …
    q4 resident base generates with margin recording; low-margin tokens
deferred; windowed q8 sweeps verify (margin mode) or verify-all
(QSpec-style exact); rollback via KV trim. Baselines: pure q4/q8.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
    Simon-Pierre Boucher committed 6 h ago (Aug 12, 2026) · 1 file changed +66