SPB Git

spb/localvm-research Public License

Running LLMs larger than memory on a consumer Mac — falsification-driven research: margin-gated deferred refinement, out-of-core verification on Apple Silicon. TR-01 published.

Python 63.2% JavaScript 23.5% CSS 11.8% Shell 0.9% Makefile 0.5%

History of experiments/micro/expG_decision_stability/benchmark.py · clear filter

  1. expG: decision-stability benchmark + hypothesis + cross-domain eval prompts
    Gate-Zero measurement: reference greedy trajectories (Qwen3-1.7B bf16),
    teacher-forced 2/3/4/8-bit MLX variants, joint margin×agreement matrix,
    AUROC, escalation curves. Kill: AUROC<0.65 or >50% escalation at 99%.
    
    Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
    Simon-Pierre Boucher committed 6 h ago (Aug 12, 2026) · 1 file changed +205 −11
  2. Bootstrap: charter-compliant skeleton, header enforcement, hardware manifest, experiment scaffolds
    - Repository layout per CLAUDE.md §3
    - tools/check_headers.py enforcing §0.1 (58 files pass)
    - tools/new_experiment.py scaffolding with seven-field hypothesis block (§10)
    - benchmarks/hardware_manifest.py: macOS-native fingerprint (M5 Max / 48GB verified)
    - Eight micro-experiment scaffolds (§9, exp A–H)
    
    Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
    Simon-Pierre Boucher committed 7 h ago (Aug 12, 2026) · 1 file changed +33