spb/forge

Wed, Aug 5, 20261 commit

1. Add .forge — Apple-native, git-style weight format with zero-copy loading

   ···

   A .forge is a model repository: tiny JSON manifests (one commit per save,
   with parent links) over content-addressed shards. Tensors are 16KB-page-
   aligned inside shards padded to page multiples, so loading is mmap +
   newBuffer(bytesNoCopy) — on unified memory the file-cache pages ARE the
   GPU memory. Saves are deltas: only tensors whose FNV-1a hash changed since
   the parent manifest are written. Shards cap at 95MB (GitHub-pushable).
   Store f32 (zero-copy alias at load) or f16/bf16 (half size).
   
   - src/core/fmodel.{h,cpp}: save() + Snapshot zero-copy reader
   - Tensor::from_buffer: views over externally-owned MTLBuffers
   - forge export CLI; generate/eval accept .forge repos directly
   - trainer commits weights natively to <out>/model.forge at each checkpoint
     (forge_save/forge_dtype config keys); .bin keeps optimizer state for resume
   - tools/fmodel.py: inspect, log (history), to-safetensors (pure numpy)
   
   Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

   simon-pierre boucher3 mo ago 1 file +129
   8b73bf1