SPB Git

spb/modelmap Public License

Internal cartography of local LLMs on Apple Silicon — registered, gated, negative-first. Public atlas at modelmap.io.

🔗 https://modelmap.io
interpretabilityllmapple-siliconmlxreproducibility
Python 66.3% JavaScript 24.5% CSS 8.1% Shell 0.7%

History of experiments/micro/expA_probe_reliability/hypothesis.md · clear filter

  1. expA run #2: first positive maps (agreement, arith_valid) + real noise floor
    …
    - v2 promptsets: structure-borne, token-balanced (overlap certificates);
  capture_pooled returns mean+last-token reps in one pass
- Strict twin gate falsified again (word_order twin acc 0.96 — subword
  statistics); gate retired, differential (real-twin) is the map
- agreement: 25/28 signal layers (max dSel +0.379); arith_valid: real
  0.86/0.90 vs twin 0.56, strongest last-token; word_order null-dominated
- First real noise floor: top-5 replication ~0.54 off ceiling; dataset
  shift > seed SD on only 3-8/28 layers (registered 1/3 not met)
- atlas probes/v2 published (Level 1, per-property verdicts); site charts
  generalized to any probes entry; home leads with agreement map

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
    Simon-Pierre Boucher committed 5 h ago (Aug 12, 2026) · 1 file changed +46
  2. Phase 5 substrate + expH run #1: first measured result
    …
    - mapcard v0 schema + publish gate (G23), stats core (bootstrap/FDR/
  replication), probe harness with built-in shuffled-label controls
  (unit test caught a fancy-indexing shuffle bug pre-science)
- expH hypothesis registered before run; run #1 on M5 Max 48GB:
  (A) mmap 3.2-10.8x zarr on random-batch reads (confirmed >=2x bar);
  (B) MLX capture nearly free (1.02x), torch-MPS retain 1.22x (confirmed)
- expA hypothesis registered (dataset-variance > seed-variance)

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
    Simon-Pierre Boucher committed 6 h ago (Aug 12, 2026) · 1 file changed +34 −9
  3. Bootstrap modelmap: charter-compliant skeleton, tooling, and modelmap.io platform
    …
    - Repo skeleton per charter §3 with mandatory author headers everywhere
- tools/check_headers.py (gates commits), new_experiment.py, new_map.py
- benchmarks: hardware_manifest.py (sysctl-based) + harness skeleton
- experiments/micro A-H scaffolded with empty seven-field blocks
- site/: modelmap.io platform (Express, light theme, English), coherent
  with localvm-research/web — Home, Research, Experiments, Atlas (with
  confidence Levels 0-3), Results, Code, About; attribution footer

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
    Simon-Pierre Boucher committed 7 h ago (Aug 12, 2026) · 1 file changed +23