SPB Git
spboucher.ai

spb/forge

Public MIT

Forge — LLM training from scratch in pure C++20 + Metal on Apple Silicon.

llmtrainingcppmetalapple-silicon
History
NameLast commitUpdated
..
gpt-100m.json Forge: LLM training from scratch in C++20 + Metal on Apple Silicon
gpt-10m-1epoch.json Forge: LLM training from scratch in C++20 + Metal on Apple Silicon
gpt-10m.json Forge: LLM training from scratch in C++20 + Metal on Apple Silicon
gpt-200m-cluster.json 200M cluster run: one epoch at micro-batch 8
gpt-200m.json Forge: LLM training from scratch in C++20 + Metal on Apple Silicon
gpt-25m.json Forge: LLM training from scratch in C++20 + Metal on Apple Silicon
gpt-50m-deep.json Add configurable training modes: Muon optimizer and WSD schedule
gpt-50m-moe.json Add QAT, MoE, and architecture-variant knobs — all config-selected
gpt-50m-muon.json Add configurable training modes: Muon optimizer and WSD schedule
gpt-50m-ternary.json Add QAT, MoE, and architecture-variant knobs — all config-selected
gpt-50m.json Add configurable training modes: Muon optimizer and WSD schedule
gpt-smoke.json Forge: LLM training from scratch in C++20 + Metal on Apple Silicon

Clone forge

Anonymous clone and fetch. Pushing requires the owner's personal access token.

ZIP tar.gz snapshot of 6d77a0144ff4fc9cb5f2a0f9e5ac30cc2cbfce7e
Files · 6d77a0144ff4fc9cb5f2a0f9e5ac30cc2cbfce7e
Menu

Theme
↑↓ navigate ↵ open esc close / or ⌘K anywhere