Memory guide · 16GB VRAM

What can you run on 16GB VRAM?

3 of the 16 open models we track fit in 16GB VRAM without spilling into system RAM, the biggest being GPT-OSS 20B. Speed depends on your card's memory bandwidth, so we show a range for 300–900 GB/s cards. Prices & stock checked 2026-10-23. Prices change daily and some retailers block our checker, so always confirm on the store page.

Models that fit in 16GB VRAM

ModelQuantMemory neededEst. speed, 300–900 GB/s card
Qwen3.5 9Bdense · 9B active · chat, small agentsQ8_0~12 GB~25–72 tok/s
Gemma 4 12Bdense · 12B active · chat, visionQ4_K_M~9 GB~33–93 tok/s
GPT-OSS 20BMoE · 3.6B active · reasoning, toolsMXFP4 (native)~13 GB~98–198 tok/s

We don't track any 16GB cards, so speed is shown for a typical 300–900 GB/s NVIDIA card (slower cards at the low end, faster ones at the high end). Fit assumes ~93% of VRAM is usable. How we estimate

Just out of reach: Gemma 4 26B-A4B (~18 GB at 4-bit), Qwen3.8 27B (~19 GB at 4-bit), GLM-4.7-Flash 30B-A3B (~21 GB at 4-bit).

Want more than 16GB?

We don't track any 16GB cards yet. These are the cheapest tracked rigs with more memory.

FAQ

What's the biggest model I can run on 16GB VRAM?

Of the models we track, GPT-OSS 20B is the largest that fits fully in 16GB VRAM (MXFP4 (native), about 13 GB including runtime and ~8K context).

Can I run Llama 3.3 70B on 16GB VRAM?

Not fully in memory. At 4-bit it needs about 46 GB including runtime and ~8K context.

How are fit and speed estimated?

Memory needed = weights + 1.5 GB + 5% of weights. Decode speed ≈ 1 ÷ (active weights in GB ÷ (efficiency × memory bandwidth) + a small fixed per-token overhead), with efficiency and overhead fitted per platform to 43 public llama.cpp/MLX benchmarks (median error about 5%). They're estimates, not benchmarks.

Other memory sizes

Best hardware for…

Restock & price-drop alerts

One short email a week: what got cheaper, what's back in stock, and which new open models your machine can run. Unsubscribe anytime.