spb/localvm-research Public License
Running LLMs larger than memory on a consumer Mac — falsification-driven research: margin-gated deferred refinement, out-of-core verification on Apple Silicon. TR-01 published.
Python 63.2%
JavaScript 23.5%
CSS 11.8%
Shell 0.9%
Makefile 0.5%
1
Fetching 14 files: 0%| | 0/14 [00:00<?, ?it/s]
Fetching 14 files: 100%|██████████| 14/14 [00:00<00:00, 6875.91it/s]2
Fetching 17 files: 0%| | 0/17 [00:00<?, ?it/s]
Fetching 17 files: 100%|██████████| 17/17 [00:00<00:00, 7145.32it/s]3loading q4 resident …4q8 checkpoint (streamed): 34.8 GB5baseline: pure q4 …6 1/12 (96 tok, 24.1 tok/s)7 2/12 (96 tok, 26.7 tok/s)8 3/12 (96 tok, 26.5 tok/s)9 4/12 (96 tok, 26.6 tok/s)10 5/12 (96 tok, 26.6 tok/s)11 6/12 (96 tok, 26.6 tok/s)12 7/12 (96 tok, 26.7 tok/s)13 8/12 (96 tok, 26.8 tok/s)14 9/12 (96 tok, 26.7 tok/s)15 10/12 (96 tok, 26.5 tok/s)16 11/12 (96 tok, 26.5 tok/s)17 12/12 (96 tok, 26.5 tok/s)18runtime: mode=margin tau=2.0 W=32 …19 1/12 (96 tok, 5 sweeps, 3 rollbacks, last sweep io 2.9s)20 2/12 (96 tok, 11 sweeps, 9 rollbacks, last sweep io 2.8s)21 3/12 (96 tok, 4 sweeps, 1 rollbacks, last sweep io 2.9s)22 4/12 (96 tok, 7 sweeps, 5 rollbacks, last sweep io 2.8s)23 5/12 (96 tok, 15 sweeps, 15 rollbacks, last sweep io 3.0s)24 6/12 (96 tok, 16 sweeps, 15 rollbacks, last sweep io 2.8s)25 7/12 (96 tok, 16 sweeps, 15 rollbacks, last sweep io 2.9s)26 8/12 (96 tok, 20 sweeps, 19 rollbacks, last sweep io 2.8s)27 9/12 (96 tok, 4 sweeps, 2 rollbacks, last sweep io 3.0s)28 10/12 (96 tok, 11 sweeps, 10 rollbacks, last sweep io 3.0s)29 11/12 (96 tok, 10 sweeps, 8 rollbacks, last sweep io 2.9s)30 12/12 (96 tok, 11 sweeps, 10 rollbacks, last sweep io 2.9s)31 tok/s=1.62 sweepLat=3.0s GB/token(logical)=3.9332runtime: mode=verify-all tau=2.0 W=32 …33 1/12 (96 tok, 5 sweeps, 3 rollbacks, last sweep io 3.0s)34 2/12 (96 tok, 11 sweeps, 9 rollbacks, last sweep io 2.8s)35 3/12 (96 tok, 4 sweeps, 1 rollbacks, last sweep io 2.8s)36 4/12 (96 tok, 5 sweeps, 3 rollbacks, last sweep io 3.0s)37 5/12 (96 tok, 15 sweeps, 15 rollbacks, last sweep io 3.0s)38 6/12 (96 tok, 15 sweeps, 15 rollbacks, last sweep io 2.8s)39 7/12 (96 tok, 16 sweeps, 15 rollbacks, last sweep io 2.9s)40 8/12 (96 tok, 14 sweeps, 13 rollbacks, last sweep io 2.9s)41 9/12 (96 tok, 7 sweeps, 5 rollbacks, last sweep io 3.0s)42 10/12 (96 tok, 11 sweeps, 10 rollbacks, last sweep io 3.0s)43 11/12 (96 tok, 10 sweeps, 8 rollbacks, last sweep io 2.9s)44 12/12 (96 tok, 10 sweeps, 9 rollbacks, last sweep io 2.8s)45 tok/s=1.69 sweepLat=3.0s GB/token(logical)=3.7246freeing 32B models; loading 8B bf16 judge …47
Fetching 12 files: 0%| | 0/12 [00:00<?, ?it/s]
Fetching 12 files: 100%|██████████| 12/12 [00:00<00:00, 3096.00it/s]48 pure_q4: -0.750649 margin_tau2.0: -0.546050 verify-all_tau2.0: -0.46675152wrote /Users/simon-pierreboucher/Desktop/localvm-research/results/candidate_01_scale32b/20260812T055506Z/results.json53