SPB Git

spb/modelmap Public License

Internal cartography of local LLMs on Apple Silicon — registered, gated, negative-first. Public atlas at modelmap.io.

Python 66.3% JavaScript 24.5% CSS 8.1% Shell 0.7%

History of benchmarks/promptsets/word_order_B.jsonl · clear filter

  1. expA run #2: first positive maps (agreement, arith_valid) + real noise floor
    - v2 promptsets: structure-borne, token-balanced (overlap certificates);
      capture_pooled returns mean+last-token reps in one pass
    - Strict twin gate falsified again (word_order twin acc 0.96 — subword
      statistics); gate retired, differential (real-twin) is the map
    - agreement: 25/28 signal layers (max dSel +0.379); arith_valid: real
      0.86/0.90 vs twin 0.56, strongest last-token; word_order null-dominated
    - First real noise floor: top-5 replication ~0.54 off ceiling; dataset
      shift > seed SD on only 3-8/28 layers (registered 1/3 not met)
    - atlas probes/v2 published (Level 1, per-property verdicts); site charts
      generalized to any probes entry; home leads with agreement map
    
    Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
    Simon-Pierre Boucher committed 4 h ago (Aug 12, 2026) · 1 file changed +240