SPB Git forge

spb/forge

Public MIT

Forge — LLM training from scratch in pure C++20 + Metal on Apple Silicon.

11commits 1branches 0releases
185.3 MBsize
maindefault branch
1 mo agolast push
C++ 61.2% C 23% Python 7.6% TeX 7.2% CMake 1.1%
NameLast commitUpdated
…
adamw.metal Forge: LLM training from scratch in C++20 + Metal on Apple Silicon 1 mo ago
attention.metal Add architecture-variant waves 1+2: train... 1 mo ago
cross_entropy.metal Forge: LLM training from scratch in C++20 + Metal on Apple Silicon 1 mo ago
elementwise.metal Add wave 3: DeepSeek-V3-style MoE routing, all config-selected 1 mo ago
embedding.metal Forge: LLM training from scratch in C++20 + Metal on Apple Silicon 1 mo ago
flash_attention_mma.metal Add architecture-variant waves 1+2: train... 1 mo ago
flash_attention.metal Add architecture-variant waves 1+2: train... 1 mo ago
layernorm.metal Forge: LLM training from scratch in C++20 + Metal on Apple Silicon 1 mo ago
matmul_mpp.metal Forge: LLM training from scratch in C++20 + Metal on Apple Silicon 1 mo ago
matmul_simd.metal Forge: LLM training from scratch in C++20 + Metal on Apple Silicon 1 mo ago
matmul.metal Forge: LLM training from scratch in C++20 + Metal on Apple Silicon 1 mo ago
moe.metal Add wave 3: DeepSeek-V3-style MoE routing, all config-selected 1 mo ago
precision_probe.metal Forge: LLM training from scratch in C++20 + Metal on Apple Silicon 1 mo ago
quant.metal Add QAT, MoE, and architecture-variant knobs — all config-selected 1 mo ago
softmax.metal Forge: LLM training from scratch in C++20 + Metal on Apple Silicon 1 mo ago