The best LLMs for a 16 GB Mac.

22 of 73 open models run well in 16 GB. The GPU can use about 12 GB of it by default. Speed depends on the chip: from 68 GB/s on the M1 to 200 GB/s on the M1 Pro.

Smartest that runs wellMiniCPM5 2B8-bit · 2.7 GB · 11–59 tok/sBiggest that runs wellPhi-4 Reasoning Vision 15B4-bit · 8.4 GB · 4–19 tok/s

Macs with 16 GB

8 chips from M1 to M6 come with 16 GB. Open one for its own list and speeds.

Runs well 33

Fits with room for context, at 10 or more tokens a second on the M1 Pro.

ModelVersionMemoryM1M1 Pro
MiniCPM5 2B2.52B · Intelligence 12.58-bit2.7 GB11–2033–59
Qwen3.5 9B9B · Intelligence 11.26-bit7.3 GB3–612–22
Granite 4.2 8B8B · Intelligence 11.18-bit8.5 GB4–611–19
Granite 4.2 3B3B · Intelligence 9.18-bit3.2 GB10–1728–50
Gemma 4 E4B8B · Intelligence 8.98-bit8.5 GB12–2219–33
Ministral 3 8B8.9B · Intelligence 5.56-bit7.2 GB3–613–22
Nemotron 3 Nano 4B3.97B · Intelligence 4.88-bit4.2 GB10–1721–38
Phi-4 Reasoning Vision 15B15B4-bit8.4 GB4–611–19
Phi-4 (14B)14B4-bit7.9 GB4–711–20
Gemma 4 12B Unified12B4-bit6.7 GB3–613–24
Qwen3 8B8.2B8-bit8.7 GB4–610–18
Llama 3.1 8B Instruct8B8-bit8.5 GB4–611–19
Gemma 4 E2B5.1B8-bit5.4 GB13–2338–67
Qwen3.5 4B4B8-bit4.3 GB13–2421–37
Phi-4 mini instruct3.8B8-bit4 GB10–1823–40
Llama 3.2 3B Instruct3.21B8-bit3.4 GB12–2126–47
SmolLM3 3B3B8-bit3.2 GB10–1728–50
LFM2.5 2.6B2.69B8-bit2.9 GB11–1931–55
Qwen3.5 2B2B8-bit2.1 GB15–2643–76
Llama 3.2 1B Instruct1.23B8-bit1.3 GB24–4269–123
Qwen3.5 0.8B0.8B8-bit0.9 GB34–60100–178
Qwen3 0.6B0.6B8-bit0.6 GB51–91150–267
Qwen3.8 27B27B · Intelligence 33.72-bit lower quality8.4 GB4–611–19
Muse Glimmer 30B29.6B · Intelligence 17.52-bit lower quality9.3 GB3–610–17
Nemotron 3.5 Lightning 30B A3B30B · 3B active · Intelligence 12.92-bit lower quality9.4 GB34–60100–178
Granite 4.2 30B30B · Intelligence 12.72-bit lower quality9.4 GB3–610–17
gpt-oss-20b21B · 3.6B active · Intelligence 93-bit lower quality9.2 GB19–3456–100
Nemotron 3 Nano 30B A3B30B · 3.5B active · Intelligence 8.92-bit lower quality9.4 GB28–4982–145
Qwen3 Coder 30B A3B Instruct30.5B · 3.3B active2-bit lower quality9.5 GB31–5490–160
GLM-4.7 Flash30B · 3B active2-bit lower quality9.4 GB34–60100–178
Qwen3.6 27B27B2-bit lower quality8.4 GB4–611–19
Gemma 4 26B A4B25.2B · 3.8B active2-bit lower quality7.9 GB26–4575–133
LFM2.5 24B A2B24B · 2B active3-bit lower quality10.5 GB34–60100–178

Runs, but slowly 4

Fits, but under 10 tokens a second: fine for batch work, slow for chat.

ModelVersionMemoryM1M1 Pro
Gemma 4 31B30.7B · Intelligence 14.72-bit lower quality9.6 GB3–69–17
Devstral Small 2 (24B)24B3-bit lower quality10.5 GB3–59–15
Magistral Small 1.2 (2509)24B3-bit lower quality10.5 GB3–59–15
Mistral Small 3.2 (24B)24B3-bit lower quality10.5 GB3–59–15

Only just fits 1

Needs almost all memory: raise the GPU memory limit and keep the context short.

ModelVersionMemoryM1M1 Pro
Qwen3.6 35B A3B35B · 3B active · Intelligence 18.22-bit lower quality10.9 GB34–60100–178

Too big 35

Needs more memory than 16 GB, even at 2 bits.

Questions

What is the best LLM for a Mac with 16 GB?
Of the models with a published Intelligence Index, MiniCPM5 2B scores highest among those that run well in 16 GB (8-bit). The biggest that runs well is Phi-4 Reasoning Vision 15B.
Is 16 GB enough for local AI on a Mac?
22 of the 73 open models here run well in it at 4 bits or better. macOS lets the GPU use about 12 GB of it by default; the model and its context have to fit in that.
Can a 16 GB Mac run gpt-oss-20b?
Yes, 3-bit, at about 19–34 tokens a second on an M1 and 56–100 on an M1 Pro.

Other sizes: 8 GB · 16 GB · 18 GB · 24 GB · 32 GB · 36 GB · 48 GB · 64 GB · 96 GB · 128 GB · 192 GB · 256 GB · 512 GB

Run them with MLX Harness (free, open source) or Apple’s mlx-lm in Terminal: step by step.

How it’s worked out

Memory: the model’s parameters at 8, 6, 4, 3 or 2 bits per weight plus MLX’s group scales (half a bit per weight), or its native format, with room for the context on top. By default macOS lets the GPU use about 75% of unified memory. Speed: memory bandwidth divided by the bytes read per token is the ceiling for one conversation; in llama.cpp’s public Apple Silicon benchmarks real runs reach about 45% to 80% of it, which is the range shown. These are estimates, not measurements: measure your own Mac on MLX Bench. Model figures from each official model card, chip figures from Apple’s Tech Specs. Checked 2026-10-19. Same data as mlx.app/compare.

Best local LLMs for a 16 GB Mac (M1 to M6): what runs, how fast