SPB Git
spboucher.ai

spb/forge

Public MIT

Forge — LLM training from scratch in pure C++20 + Metal on Apple Silicon.

llmtrainingcppmetalapple-silicon
History
NameLast commitUpdated
..
attention.h Add architecture-variant waves 1+2: train Mistral/Qwen/Gemma/OLMo-class models...
config.h Add wave 3: DeepSeek-V3-style MoE routing, all config-selected
embedding.h Forge: LLM training from scratch in C++20 + Metal on Apple Silicon
linear.cpp Add QAT, MoE, and architecture-variant knobs — all config-selected
linear.h Add QAT, MoE, and architecture-variant knobs — all config-selected
mlp.h Add wave 3: DeepSeek-V3-style MoE routing, all config-selected
module.h Forge: LLM training from scratch in C++20 + Metal on Apple Silicon
transformer.h Add wave 3: DeepSeek-V3-style MoE routing, all config-selected

Clone forge

Anonymous clone and fetch. Pushing requires the owner's personal access token.

ZIP tar.gz snapshot of main
Files · main
Menu

Theme
↑↓ navigate ↵ open esc close / or ⌘K anywhere