spboucher.ai ↗

spb/forge

Public MIT

Forge — LLM training from scratch in pure C++20 + Metal on Apple Silicon.

llm training cpp metal apple-silicon

11commits 1branches 0releases

185.3 MBsize

maindefault branch

1 mo agolast push

C++ 61.2% C 23% Python 7.6% TeX 7.2% CMake 1.1%

Name	Last commit	Updated
…
attention.h	Add architecture-variant waves 1+2: train...	1 mo ago
config.h	Add wave 3: DeepSeek-V3-style MoE routing, all config-selected	1 mo ago
embedding.h	Forge: LLM training from scratch in C++20 + Metal on Apple Silicon	1 mo ago
linear.cpp	Add QAT, MoE, and architecture-variant knobs — all config-selected	1 mo ago
linear.h	Add QAT, MoE, and architecture-variant knobs — all config-selected	1 mo ago
mlp.h	Add wave 3: DeepSeek-V3-style MoE routing, all config-selected	1 mo ago
module.h	Forge: LLM training from scratch in C++20 + Metal on Apple Silicon	1 mo ago
transformer.h	Add wave 3: DeepSeek-V3-style MoE routing, all config-selected	1 mo ago