Google DeepMind · 12B total / 12B active · dense

Best hardware to run Gemma 4 12B locally

Gemma 4 12B needs about 9 GB at Q4_K_M. 17 of the 17 priced rigs we track can hold it. Here's the cheapest, the best value and the fastest. Prices & stock checked 2026-10-23. Prices change daily and some retailers block our checker, so always confirm on the store page.

Our picks

Mac miniAvailable

Mac mini M5 Pro

15-core CPU / 16-core GPU, 24GB

$1,699at Apple Store

Cheapest that fits. Lowest price we've seen on any tracked rig that holds Gemma 4 12B at 4-bit (9 of 17 GB usable).

Fits~36 tok/sQ4_K_M

Suggested quant: Q8_0 (~21 tok/s)

Check price
Mac StudioAvailable

Mac Studio M5 Max

18-core CPU / 40-core GPU, 48GB

$3,099at Apple Store

Best value. Lowest price per token/sec among complete systems where it fits comfortably: about $45 per tok/s at 4-bit.

Fits~70 tok/sQ4_K_M

Suggested quant: Q8_0 (~41 tok/s)

Check price
RTX 5090In stock

NVIDIA GeForce RTX 5090 Founders Edition

32GB card

$8,500at Newegg

Fastest. Most memory bandwidth of the rigs that fit it (1,792 GB/s), so the quickest decode: ~170 tok/s at 4-bit.

Fits~170 tok/sQ4_K_M

Suggested quant: Q8_0 (~104 tok/s)

GPU price is card only: you still need a host PC.

Check price

Which quant to use

Use Q4_K_M on most rigs: it needs ~9 GB. Q8_0 (~15 GB) is a bit more accurate and fits comfortably on 17 of these rigs, e.g. the Mac mini M5 Pro.

Every rig that fits it

MachinePrice4-bit fit & speedSuggested quant$ per tok/s
Mac mini M5 ProMac mini$1,699
Fits~36 tok/s
Q8_0$47
GMKtec EVO-X2Strix Halo$2,200
Fits~28 tok/s
Q8_0$78
Mac Studio M5 MaxMac Studio$2,499
Fits~53 tok/s
Q8_0$47
Mac Studio M5 MaxMac Studio$3,099
Fits~70 tok/s
Q8_0$45
Framework Desktop DIYStrix Halo$3,449
Fits~28 tok/s
Q8_0$123
GMKtec EVO-X2Strix Halo$3,500
Fits~28 tok/s
Q8_0$125
Minisforum MS-S1 MaxStrix Halo$3,919
Fits~28 tok/s
Q8_0$140
Beelink GTR9 ProStrix Halo$4,349
Fits~28 tok/s
Q8_0$155
Gigabyte GeForce RTX 4090 Windforce V2RTX 4090 (card only, needs a host PC)$4,899
Fits~103 tok/s
Q8_0$47
Mac Studio M5 UltraMac Studio$5,499
Fits~111 tok/s
Q8_0$50
Lenovo ThinkStation PGXDGX Spark / GB10$5,859
Fits~29 tok/s
Q8_0$203
ASUS Ascent GX10DGX Spark / GB10$5,999
Fits~29 tok/s
Q8_0$208
NVIDIA DGX SparkDGX Spark / GB10$6,950
Fits~29 tok/s
Q8_0$241
HP ZGX Nano G1nDGX Spark / GB10$7,699
Fits~29 tok/s
Q8_0$266
Gigabyte AI TOP ATOMDGX Spark / GB10$8,499
Fits~29 tok/s
Q8_0$294
NVIDIA GeForce RTX 5090 Founders EditionRTX 5090 (card only, needs a host PC)$8,500
Fits~170 tok/s
Q8_0$50
PNY NVIDIA RTX PRO 6000 BlackwellRTX PRO 6000 (card only, needs a host PC)$17,899
Fits~170 tok/s
Q8_0$105

Sorted by lowest price. Speeds are estimated single-user decode at ~8K context. Full fit table, including rigs that don't fit: Gemma 4 12B memory requirements. How we estimate

FAQ

How much memory does Gemma 4 12B need?

About 9 GB at Q4_K_M and 15 GB at Q8_0, including runtime overhead and ~8K tokens of context for one user. Longer context needs more.

What's the cheapest hardware to run Gemma 4 12B locally?

Of the rigs we track, the Mac mini M5 Pro at $1,699, estimated ~36 tok/s at 4-bit. Prices checked 2026-10-23.

Which quant should I use for Gemma 4 12B?

Q4_K_M is the default: about 9 GB. Q8_0 needs about 15 GB; use it only if you have the room and still get usable speed.

How fast does Gemma 4 12B run?

It has 12B active parameters per token, so speed is set by memory bandwidth: from ~28 tok/s on the slowest rig that fits to ~170 tok/s on the NVIDIA GeForce RTX 5090 Founders Edition. Estimates, not benchmarks.

Related guides

Restock & price-drop alerts

One short email a week: what got cheaper, what's back in stock, and which new open models your machine can run. Unsubscribe anytime.