SPB Git

Repository Public

MODELS_BY_DEVICE.md 13.3 KB 52 lines markdown

1<!--2Local Chat3File: Documentation/MODELS_BY_DEVICE.md4Author: Simon-Pierre Boucher5Contact: contact@spboucher.ai6Generated file — do not edit. Regenerate with Scripts/models-by-device.py7-->8# MLX models by Apple device910Generated on 2026-11-20 from the live [mlx-community](https://huggingface.co/mlx-community) listing on Hugging Face: 477 repositories read (most downloaded per task), 370 with an architecture MLX Swift LM 3.33.0 can load, 332 of those with a size estimate.1112The app shows the same list live (Models → By device), for every device class, and refreshes it daily.1314**How a model is proposed** — its architecture is implemented by MLX Swift; estimated memory = weights (parameters × nominal bits per weight ÷ 8) + KV cache for a 4,096-token context + 350 MB; it must stay under 70 % of the memory a model may use on the device (65 % of RAM on a Mac under 32 GB, 75 % from 32 GB, 55 % on iPhone and iPad). Figures are estimates; nothing here was run on a physical iPhone or iPad.1516## Best picks1718The largest well-downloaded models (≥ 500 downloads) that fit comfortably, one quantization per model.1920| Device | Memory for a model | Chat | Vision | Chat models that fit |21|---|---|---|---|---|22| **iPhone · 6 GB**<br><sub>iPhone 14 Pro, iPhone 15</sub> | 3.3 GB | [`gemma-2-2b-it-4bit`](https://huggingface.co/mlx-community/gemma-2-2b-it-4bit) · ≈ 2.3 GB<br>[`MiniCPM5-2B-mlx-4Bit`](https://huggingface.co/mlx-community/MiniCPM5-2B-mlx-4Bit) · ≈ 2.2 GB<br>[`Qwen3.5-2B-OptiQ-4bit`](https://huggingface.co/mlx-community/Qwen3.5-2B-OptiQ-4bit) · ≈ 1.7 GB<br>[`LFM3-1.7B-OptiQ-4bit`](https://huggingface.co/mlx-community/LFM3-1.7B-OptiQ-4bit) · ≈ 1.6 GB | [`SmolVLM-Instruct-4bit`](https://huggingface.co/mlx-community/SmolVLM-Instruct-4bit) · ≈ 2.0 GB<br>[`Qwen3.5-2B-4bit`](https://huggingface.co/mlx-community/Qwen3.5-2B-4bit) · ≈ 2.0 GB | 50 |23| **iPhone · 8 GB**<br><sub>iPhone 15 Pro, iPhone 16, iPhone 17</sub> | 4.4 GB | [`granite-4.1-3b-4bit`](https://huggingface.co/mlx-community/granite-4.1-3b-4bit) · ≈ 2.8 GB<br>[`Llama-3.2-3B-Instruct-4bit`](https://huggingface.co/mlx-community/Llama-3.2-3B-Instruct-4bit) · ≈ 2.7 GB<br>[`granite-4.0-h-micro-4bit`](https://huggingface.co/mlx-community/granite-4.0-h-micro-4bit) · ≈ 2.7 GB<br>[`OpenCodeInterpreter-SC2-3B-4bit`](https://huggingface.co/mlx-community/OpenCodeInterpreter-SC2-3B-4bit) · ≈ 2.7 GB | [`SmolVLM-Instruct-4bit`](https://huggingface.co/mlx-community/SmolVLM-Instruct-4bit) · ≈ 2.0 GB<br>[`Qwen3.5-2B-6bit`](https://huggingface.co/mlx-community/Qwen3.5-2B-6bit) · ≈ 2.5 GB | 56 |24| **iPhone · 12 GB**<br><sub>iPhone 17 Pro, iPhone 17 Pro Max, iPhone Air</sub> | 6.6 GB | [`gemma-3n-E2B-it-lm-4bit`](https://huggingface.co/mlx-community/gemma-3n-E2B-it-lm-4bit) · ≈ 3.6 GB<br>[`Qwen3.5-4B-OptiQ-4bit`](https://huggingface.co/mlx-community/Qwen3.5-4B-OptiQ-4bit) · ≈ 3.4 GB<br>[`Qwen3.5-4B-3D-Coder-OptiQ-4bit`](https://huggingface.co/mlx-community/Qwen3.5-4B-3D-Coder-OptiQ-4bit) · ≈ 3.4 GB<br>[`Qwen3-4B-Instruct-2507-4bit`](https://huggingface.co/mlx-community/Qwen3-4B-Instruct-2507-4bit) · ≈ 3.3 GB | [`gemma-4-e2b-it-4bit`](https://huggingface.co/mlx-community/gemma-4-e2b-it-4bit) · ≈ 4.1 GB<br>[`gemma-3-4b-it-qat-4bit`](https://huggingface.co/mlx-community/gemma-3-4b-it-qat-4bit) · ≈ 4.0 GB | 77 |25| **iPad · 8 GB**<br><sub>iPad Air (M2, M3), iPad mini (A17 Pro), iPad Pro M4 256 / 512 GB</sub> | 4.4 GB | [`granite-4.1-3b-4bit`](https://huggingface.co/mlx-community/granite-4.1-3b-4bit) · ≈ 2.8 GB<br>[`Llama-3.2-3B-Instruct-4bit`](https://huggingface.co/mlx-community/Llama-3.2-3B-Instruct-4bit) · ≈ 2.7 GB<br>[`granite-4.0-h-micro-4bit`](https://huggingface.co/mlx-community/granite-4.0-h-micro-4bit) · ≈ 2.7 GB<br>[`OpenCodeInterpreter-SC2-3B-4bit`](https://huggingface.co/mlx-community/OpenCodeInterpreter-SC2-3B-4bit) · ≈ 2.7 GB | [`SmolVLM-Instruct-4bit`](https://huggingface.co/mlx-community/SmolVLM-Instruct-4bit) · ≈ 2.0 GB<br>[`Qwen3.5-2B-6bit`](https://huggingface.co/mlx-community/Qwen3.5-2B-6bit) · ≈ 2.5 GB | 56 |26| **iPad · 12 GB**<br><sub>iPad Pro M5 256 / 512 GB</sub> | 6.6 GB | [`gemma-3n-E2B-it-lm-4bit`](https://huggingface.co/mlx-community/gemma-3n-E2B-it-lm-4bit) · ≈ 3.6 GB<br>[`Qwen3.5-4B-OptiQ-4bit`](https://huggingface.co/mlx-community/Qwen3.5-4B-OptiQ-4bit) · ≈ 3.4 GB<br>[`Qwen3.5-4B-3D-Coder-OptiQ-4bit`](https://huggingface.co/mlx-community/Qwen3.5-4B-3D-Coder-OptiQ-4bit) · ≈ 3.4 GB<br>[`Qwen3-4B-Instruct-2507-4bit`](https://huggingface.co/mlx-community/Qwen3-4B-Instruct-2507-4bit) · ≈ 3.3 GB | [`gemma-4-e2b-it-4bit`](https://huggingface.co/mlx-community/gemma-4-e2b-it-4bit) · ≈ 4.1 GB<br>[`gemma-3-4b-it-qat-4bit`](https://huggingface.co/mlx-community/gemma-3-4b-it-qat-4bit) · ≈ 4.0 GB | 77 |27| **iPad · 16 GB**<br><sub>iPad Pro M4 / M5 1 TB and 2 TB</sub> | 8.8 GB | [`Qwen2.5-Coder-7B-Instruct-4bit`](https://huggingface.co/mlx-community/Qwen2.5-Coder-7B-Instruct-4bit) · ≈ 5.9 GB<br>[`Qwen2.5-7B-Instruct-4bit`](https://huggingface.co/mlx-community/Qwen2.5-7B-Instruct-4bit) · ≈ 5.9 GB<br>[`Qwen2.5-7B-Instruct-Uncensored-4bit`](https://huggingface.co/mlx-community/Qwen2.5-7B-Instruct-Uncensored-4bit) · ≈ 5.9 GB<br>[`Qwen2.5-Coder-7B-4bit`](https://huggingface.co/mlx-community/Qwen2.5-Coder-7B-4bit) · ≈ 5.9 GB | [`Ternary-Bonsai-2-9B-2bit`](https://huggingface.co/mlx-community/Ternary-Bonsai-2-9B-2bit) · ≈ 5.1 GB<br>[`NVIDIA-Nemotron-3.5-Bolt-E4B-OptiQ-4bit`](https://huggingface.co/mlx-community/NVIDIA-Nemotron-3.5-Bolt-E4B-OptiQ-4bit) · ≈ 5.8 GB | 82 |28| **Mac · 8 GB**<br><sub>MacBook Air M1 – M3 base</sub> | 5.2 GB | [`gemma-3n-E2B-it-lm-4bit`](https://huggingface.co/mlx-community/gemma-3n-E2B-it-lm-4bit) · ≈ 3.6 GB<br>[`Qwen3.5-4B-OptiQ-4bit`](https://huggingface.co/mlx-community/Qwen3.5-4B-OptiQ-4bit) · ≈ 3.4 GB<br>[`Qwen3.5-4B-3D-Coder-OptiQ-4bit`](https://huggingface.co/mlx-community/Qwen3.5-4B-3D-Coder-OptiQ-4bit) · ≈ 3.4 GB<br>[`Qwen3-4B-Instruct-2507-4bit`](https://huggingface.co/mlx-community/Qwen3-4B-Instruct-2507-4bit) · ≈ 3.3 GB | [`Qwen3-VL-4B-Instruct-4bit`](https://huggingface.co/mlx-community/Qwen3-VL-4B-Instruct-4bit) · ≈ 3.6 GB<br>[`Qwen2.5-VL-3B-Instruct-4bit`](https://huggingface.co/mlx-community/Qwen2.5-VL-3B-Instruct-4bit) · ≈ 3.1 GB | 57 |29| **Mac · 16 GB**<br><sub>MacBook Air, Mac mini, MacBook Pro base</sub> | 10.4 GB | [`gemma-2-9b-it-4bit`](https://huggingface.co/mlx-community/gemma-2-9b-it-4bit) · ≈ 7.1 GB<br>[`Qwen3.5-9B-OptiQ-4bit`](https://huggingface.co/mlx-community/Qwen3.5-9B-OptiQ-4bit) · ≈ 6.9 GB<br>[`MiMo-V2.6-Distill-Qwen-9B-OptiQ-4bit`](https://huggingface.co/mlx-community/MiMo-V2.6-Distill-Qwen-9B-OptiQ-4bit) · ≈ 6.9 GB<br>[`Ornith-1.5-9B-OptiQ-4bit`](https://huggingface.co/mlx-community/Ornith-1.5-9B-OptiQ-4bit) · ≈ 6.9 GB | [`Ternary-Bonsai-2-9B-2bit`](https://huggingface.co/mlx-community/Ternary-Bonsai-2-9B-2bit) · ≈ 5.1 GB<br>[`Qwen3.5-9B-4bit`](https://huggingface.co/mlx-community/Qwen3.5-9B-4bit) · ≈ 7.2 GB | 91 |30| **Mac · 24 GB**<br><sub>MacBook Air / Pro, Mac mini</sub> | 15.6 GB | [`gemma-4-26B-A4B-it-OptiQ-4bit-REAP-14B`](https://huggingface.co/mlx-community/gemma-4-26B-A4B-it-OptiQ-4bit-REAP-14B) · ≈ 10.9 GB<br>[`gemma-4-12b-coder-fable5-composer2.5-4bit`](https://huggingface.co/mlx-community/gemma-4-12b-coder-fable5-composer2.5-4bit) · ≈ 9.1 GB<br>[`gemma-4-12B-it-qat-OptiQ-4bit`](https://huggingface.co/mlx-community/gemma-4-12B-it-qat-OptiQ-4bit) · ≈ 9.1 GB<br>[`gemma-4-12B-it-OptiQ-4bit`](https://huggingface.co/mlx-community/gemma-4-12B-it-OptiQ-4bit) · ≈ 9.1 GB | [`gemma-3-12b-it-qat-4bit`](https://huggingface.co/mlx-community/gemma-3-12b-it-qat-4bit) · ≈ 9.1 GB<br>[`gemma-4-12B-it-4bit`](https://huggingface.co/mlx-community/gemma-4-12B-it-4bit) · ≈ 9.1 GB | 105 |31| **Mac · 32 GB**<br><sub>MacBook Pro, Mac Studio</sub> | 24.0 GB | [`Qwen3-Coder-30B-A3B-Instruct-3bit`](https://huggingface.co/mlx-community/Qwen3-Coder-30B-A3B-Instruct-3bit) · ≈ 16.2 GB<br>[`Mistral-Small-3.2-24B-Instruct-2506-4bit`](https://huggingface.co/mlx-community/Mistral-Small-3.2-24B-Instruct-2506-4bit) · ≈ 16.1 GB<br>[`Devstral-Small-2-24B-Instruct-2512-OptiQ-4bit`](https://huggingface.co/mlx-community/Devstral-Small-2-24B-Instruct-2512-OptiQ-4bit) · ≈ 16.1 GB<br>[`gpt-oss-20b-OptiQ-4bit`](https://huggingface.co/mlx-community/gpt-oss-20b-OptiQ-4bit) · ≈ 14.7 GB | [`Devstral-Small-2-24B-Instruct-2512-4bit`](https://huggingface.co/mlx-community/Devstral-Small-2-24B-Instruct-2512-4bit) · ≈ 16.4 GB<br>[`mistralai_Devstral-Small-2-24B-Instruct-2512-MLX-4Bit`](https://huggingface.co/mlx-community/mistralai_Devstral-Small-2-24B-Instruct-2512-MLX-4Bit) · ≈ 16.4 GB | 130 |32| **Mac · 48 GB**<br><sub>MacBook Pro M4 / M5 Pro and Max</sub> | 36.0 GB | [`KAT-Coder-V2.5-Dev-OptiQ-4bit`](https://huggingface.co/mlx-community/KAT-Coder-V2.5-Dev-OptiQ-4bit) · ≈ 21.9 GB<br>[`Qwen3.6-35B-A3B-OptiQ-4bit`](https://huggingface.co/mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit) · ≈ 21.9 GB<br>[`DeepSeek-R1-Distill-Qwen-32B-4bit`](https://huggingface.co/mlx-community/DeepSeek-R1-Distill-Qwen-32B-4bit) · ≈ 20.9 GB<br>[`Qwen2.5-Coder-32B-Instruct-4bit`](https://huggingface.co/mlx-community/Qwen2.5-Coder-32B-Instruct-4bit) · ≈ 20.9 GB | [`Qwen3.6-35B-A3B-4bit`](https://huggingface.co/mlx-community/Qwen3.6-35B-A3B-4bit) · ≈ 22.2 GB<br>[`Qwen3.5-35B-A3B-4bit`](https://huggingface.co/mlx-community/Qwen3.5-35B-A3B-4bit) · ≈ 22.2 GB | 135 |33| **Mac · 64 GB**<br><sub>MacBook Pro Max, Mac Studio</sub> | 48.0 GB | [`Llama-3.3-70B-Instruct-3bit`](https://huggingface.co/mlx-community/Llama-3.3-70B-Instruct-3bit) · ≈ 32.5 GB<br>[`KAT-Coder-V2.5-Dev-OptiQ-4bit`](https://huggingface.co/mlx-community/KAT-Coder-V2.5-Dev-OptiQ-4bit) · ≈ 21.9 GB<br>[`Qwen3.6-35B-A3B-OptiQ-4bit`](https://huggingface.co/mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit) · ≈ 21.9 GB<br>[`DeepSeek-R1-Distill-Qwen-32B-4bit`](https://huggingface.co/mlx-community/DeepSeek-R1-Distill-Qwen-32B-4bit) · ≈ 20.9 GB | [`Qwen3.6-35B-A3B-4bit`](https://huggingface.co/mlx-community/Qwen3.6-35B-A3B-4bit) · ≈ 22.2 GB<br>[`Qwen3.5-35B-A3B-4bit`](https://huggingface.co/mlx-community/Qwen3.5-35B-A3B-4bit) · ≈ 22.2 GB | 147 |34| **Mac · 96 GB**<br><sub>Mac Studio M3 Ultra</sub> | 72.0 GB | [`Mistral-Small-4-119B-2603-OptiQ-2bit`](https://huggingface.co/mlx-community/Mistral-Small-4-119B-2603-OptiQ-2bit) · ≈ 38.4 GB<br>[`Qwen3-Coder-Next-4bit`](https://huggingface.co/mlx-community/Qwen3-Coder-Next-4bit) · ≈ 45.5 GB<br>[`Qwen3-Next-80B-A3B-Instruct-4bit`](https://huggingface.co/mlx-community/Qwen3-Next-80B-A3B-Instruct-4bit) · ≈ 45.5 GB<br>[`Kimi-Dev-72B-4bit-DWQ`](https://huggingface.co/mlx-community/Kimi-Dev-72B-4bit-DWQ) · ≈ 41.9 GB | [`Qwen2.5-VL-72B-Instruct-4bit`](https://huggingface.co/mlx-community/Qwen2.5-VL-72B-Instruct-4bit) · ≈ 42.2 GB<br>[`Qwen3.6-35B-A3B-4bit`](https://huggingface.co/mlx-community/Qwen3.6-35B-A3B-4bit) · ≈ 22.2 GB | 150 |35| **Mac · 128 GB**<br><sub>MacBook Pro M4 / M5 Max, Mac Studio</sub> | 96.0 GB | [`Mistral-Small-4-119B-2603-OptiQ-2bit`](https://huggingface.co/mlx-community/Mistral-Small-4-119B-2603-OptiQ-2bit) · ≈ 38.4 GB<br>[`Qwen3-Coder-Next-4bit`](https://huggingface.co/mlx-community/Qwen3-Coder-Next-4bit) · ≈ 45.5 GB<br>[`Qwen3-Next-80B-A3B-Instruct-4bit`](https://huggingface.co/mlx-community/Qwen3-Next-80B-A3B-Instruct-4bit) · ≈ 45.5 GB<br>[`Kimi-Dev-72B-4bit-DWQ`](https://huggingface.co/mlx-community/Kimi-Dev-72B-4bit-DWQ) · ≈ 41.9 GB | [`Qwen2.5-VL-72B-Instruct-4bit`](https://huggingface.co/mlx-community/Qwen2.5-VL-72B-Instruct-4bit) · ≈ 42.2 GB<br>[`Qwen3.6-35B-A3B-4bit`](https://huggingface.co/mlx-community/Qwen3.6-35B-A3B-4bit) · ≈ 22.2 GB | 152 |36| **Mac · 192 GB**<br><sub>Mac Studio M2 Ultra</sub> | 144.0 GB | [`Mistral-Small-4-119B-2603-OptiQ-2bit`](https://huggingface.co/mlx-community/Mistral-Small-4-119B-2603-OptiQ-2bit) · ≈ 38.4 GB<br>[`Qwen3-Coder-Next-4bit`](https://huggingface.co/mlx-community/Qwen3-Coder-Next-4bit) · ≈ 45.5 GB<br>[`Qwen3-Next-80B-A3B-Instruct-4bit`](https://huggingface.co/mlx-community/Qwen3-Next-80B-A3B-Instruct-4bit) · ≈ 45.5 GB<br>[`Kimi-Dev-72B-4bit-DWQ`](https://huggingface.co/mlx-community/Kimi-Dev-72B-4bit-DWQ) · ≈ 41.9 GB | [`Mistral-Medium-3.5-128B-4bit`](https://huggingface.co/mlx-community/Mistral-Medium-3.5-128B-4bit) · ≈ 70.7 GB<br>[`Qwen3.5-122B-A10B-4bit`](https://huggingface.co/mlx-community/Qwen3.5-122B-A10B-4bit) · ≈ 68.0 GB | 156 |3738## Embedding models (Knowledge Studio)3940Small enough for every device class above.4142| Model | Architecture | Downloads |43|---|---|---|44| [`Qwen3-Embedding-0.6B-8bit`](https://huggingface.co/mlx-community/Qwen3-Embedding-0.6B-8bit) | qwen3 | 6,494 |45| [`Qwen3-Embedding-4B-4bit-DWQ`](https://huggingface.co/mlx-community/Qwen3-Embedding-4B-4bit-DWQ) | qwen3 | 4,988 |46| [`embeddinggemma-2-bf16`](https://huggingface.co/mlx-community/embeddinggemma-2-bf16) | embedding_gemma2 | 4,442 |47| [`embeddinggemma-2-8bit`](https://huggingface.co/mlx-community/embeddinggemma-2-8bit) | embedding_gemma2 | 3,230 |48| [`all-MiniLM-L6-v2-4bit`](https://huggingface.co/mlx-community/all-MiniLM-L6-v2-4bit) | bert | 3,218 |49| [`bge-m3-mlx-fp16`](https://huggingface.co/mlx-community/bge-m3-mlx-fp16) | xlm-roberta | 3,068 |50| [`Qwen3-Embedding-8B-4bit-DWQ`](https://huggingface.co/mlx-community/Qwen3-Embedding-8B-4bit-DWQ) | qwen3 | 2,573 |51| [`bge-m3-mlx-8bit`](https://huggingface.co/mlx-community/bge-m3-mlx-8bit) | xlm-roberta | 1,760 |52
Files main
Menu

Theme