spb/localvm-research

Public License

Running LLMs larger than memory on a consumer Mac — falsification-driven research: margin-gated deferred refinement, out-of-core verification on Apple Silicon. TR-01 published.

34commits 1branches 0releases

113.5 MBsize

maindefault branch

21 days agolast push

Python 63.2% JavaScript 23.5% CSS 11.8% Shell 0.9% Makefile 0.5%

Wed, Aug 12, 2026 1

candidate_01 scale: StreamingVerifier (per-layer materialize->compute->re-lazify) + 32B benchmark

…

q4-32B resident (17.5 GB) + q8-32B (34.8 GB) layer-streamed from SSD per
sweep; peak residency = base + a few layers; SSD sees one sequential
checkpoint pass per sweep. Judge: independent 8B bf16.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

Simon-Pierre Boucher committed 1 mo ago · 1 file +174