resident q4: 0.97 GB · streamed q8: 1.83 GB
baseline: pure q8 greedy …
baseline: pure q4 greedy …
runtime: mode=margin tau=1.0 W=32 …
  fidelity=0.5482 tok/s=110.3 defer=0.37 rollback=0.064 MB/token(logical)=150
runtime: mode=margin tau=2.0 W=32 …
  fidelity=0.6611 tok/s=78.1 defer=1.00 rollback=0.103 MB/token(logical)=211
runtime: mode=verify-all tau=2.0 W=32 …
  fidelity=0.8864 tok/s=68.7 defer=1.09 rollback=0.121 MB/token(logical)=237
judging outputs with bf16 reference …

Fetching 9 files:   0%|          | 0/9 [00:00<?, ?it/s]
Fetching 9 files: 100%|██████████| 9/9 [00:00<00:00, 2338.83it/s]
             pure_q4: mean logprob (bf16 judge) = -0.3872
             pure_q8: mean logprob (bf16 judge) = -0.1328
       margin_tau1.0: mean logprob (bf16 judge) = -0.2671
       margin_tau2.0: mean logprob (bf16 judge) = -0.1761
   verify-all_tau2.0: mean logprob (bf16 judge) = -0.1297

wrote /Users/simon-pierreboucher/Desktop/localvm-research/results/candidate_01/20260812T052415Z/results.json
baselines: {
 "pure_q4": {
  "tokens_per_s": 294.29358902494874,
  "fidelity_vs_q8_mean": 0.486328125
 },
 "pure_q8": {
  "tokens_per_s": 204.40615588770143,
  "fidelity_vs_q8_mean": 1.0
 }
}