spb/localvm-research Public License
Running LLMs larger than memory on a consumer Mac — falsification-driven research: margin-gated deferred refinement, out-of-core verification on Apple Silicon. TR-01 published.
Python 63.2%
JavaScript 23.5%
CSS 11.8%
Shell 0.9%
Makefile 0.5%
1
Fetching 14 files: 0%| | 0/14 [00:00<?, ?it/s]
Fetching 14 files: 100%|██████████| 14/14 [00:00<00:00, 5206.62it/s]2
Fetching 17 files: 0%| | 0/17 [00:00<?, ?it/s]
Fetching 17 files: 100%|██████████| 17/17 [00:00<00:00, 6735.61it/s]3loading q4 resident …4q8 checkpoint (streamed): 34.8 GB5baseline: pure q4 …6 1/12 (96 tok, 24.1 tok/s)7 2/12 (96 tok, 26.6 tok/s)8 3/12 (96 tok, 26.5 tok/s)9 4/12 (96 tok, 26.7 tok/s)10 5/12 (96 tok, 26.6 tok/s)11 6/12 (96 tok, 26.7 tok/s)12 7/12 (96 tok, 26.6 tok/s)13 8/12 (96 tok, 26.5 tok/s)14 9/12 (96 tok, 26.5 tok/s)15 10/12 (96 tok, 26.6 tok/s)16 11/12 (96 tok, 26.5 tok/s)17 12/12 (96 tok, 26.3 tok/s)18runtime: mode=verify-all tau=2.0 W=64 …19 1/12 (96 tok, 4 sweeps, 3 rollbacks, last sweep io 3.0s)20 2/12 (96 tok, 10 sweeps, 9 rollbacks, last sweep io 2.9s)21 3/12 (96 tok, 7 sweeps, 6 rollbacks, last sweep io 2.9s)22 4/12 (96 tok, 4 sweeps, 3 rollbacks, last sweep io 3.0s)23 5/12 (74 tok, 10 sweeps, 10 rollbacks, last sweep io 3.0s)24 6/12 (96 tok, 15 sweeps, 15 rollbacks, last sweep io 2.8s)25 7/12 (96 tok, 12 sweeps, 12 rollbacks, last sweep io 2.9s)26 8/12 (85 tok, 11 sweeps, 11 rollbacks, last sweep io 3.0s)27 9/12 (96 tok, 6 sweeps, 5 rollbacks, last sweep io 3.0s)28 10/12 (95 tok, 11 sweeps, 11 rollbacks, last sweep io 3.0s)29 11/12 (93 tok, 13 sweeps, 13 rollbacks, last sweep io 3.0s)30 12/12 (96 tok, 10 sweeps, 9 rollbacks, last sweep io 2.8s)31 tok/s=1.59 sweepLat=3.0s GB/token(logical)=3.5332freeing 32B models; loading 8B bf16 judge …33
Fetching 12 files: 0%| | 0/12 [00:00<?, ?it/s]
Fetching 12 files: 100%|██████████| 12/12 [00:00<00:00, 5958.52it/s]34 pure_q4: -0.750635 verify-all_tau2.0: -0.51443637wrote /Users/simon-pierreboucher/Desktop/localvm-research/results/candidate_01_scale32b/20260812T061115Z/results.json38