Strix HaloAvailable
GMKtec EVO-X2
Ryzen AI Max+ 395, 64GB / 1TB
$2,200at GMKtec store
Tight fit~4 tok/sQ4_K_M
Check price at GMKtecMeta · 70B parameters · dense
What hardware runs Llama 3.3 70B?
It needs about 46 GB at Q4_K_M and 80 GB at Q8_0, with 70B parameters active per token. The cheapest rig we track that fits it at Q4_K_M is the GMKtec EVO-X2 at $2,200.
13 rigs that fit it
Strix HaloAvailable
GMKtec EVO-X2
Ryzen AI Max+ 395, 128GB / 1TB
$3,500at GMKtec store
Fits~4 tok/sQ4_K_M
Check price at GMKtec
Strix HaloAvailable
Minisforum MS-S1 Max
Ryzen AI Max+ 395, 128GB / 2TB
$3,879at Minisforum store
Fits~4 tok/sQ4_K_M
Check price at Minisforum
Strix HaloPre-order
Beelink GTR9 Pro
Ryzen AI Max+ 395, 128GB / 2TB
$4,349at Beelink store
Fits~4 tok/sQ4_K_M
Check price at Beelink
Strix HaloOut of stock
Framework Desktop DIY
Ryzen AI Max+ 395, 128GB
$4,839at Framework store
Fits~4 tok/sQ4_K_M
Check price at Framework
DGX SparkOut of stock
Gigabyte AI TOP ATOM
4TB
$5,300at B&H Photo
Fits~4 tok/sQ4_K_M
Check price at B&H
Mac StudioAvailable
Mac Studio M5 Ultra
30-core CPU / 64-core GPU, 96GB
$5,499at Apple Store
Fits~17 tok/sQ4_K_M
Check price at Apple
DGX SparkOut of stock
Lenovo ThinkStation PGX
1TB
$5,859at B&H Photo
Fits~4 tok/sQ4_K_M
Check price at B&H
DGX SparkAvailable
NVIDIA DGX Spark
Founders Edition, 4TB
$6,950at NVIDIA Marketplace
Fits~4 tok/sQ4_K_M
Check price at NVIDIA
RTX PRO 6000In stock
PNY NVIDIA RTX PRO 6000 Blackwell
96GB card
$17,899at B&H Photo
Fits~25 tok/sQ4_K_M
Check price at B&HMac StudioStock unknown
Mac Studio M5 Ultra
256GB
Price unknown
Fits~17 tok/sQ4_K_M
Check price at AppleEvery rig, side by side
| Machine | Price | Q4_K_M | Q8_0 |
|---|---|---|---|
| Mac mini M5 Pro15-core CPU / 16-core GPU, 24GB | $1,699 | Won't fitneeds ~46 GB | Won't fitneeds ~80 GB |
| GMKtec EVO-X2Ryzen AI Max+ 395, 64GB / 1TB | $2,200 | Tight fit~4 tok/s46 of 48 GB | Won't fitneeds ~80 GB |
| Mac Studio M5 Max18-core CPU / 32-core GPU, 36GB | $2,499 | Won't fitneeds ~46 GB | Won't fitneeds ~80 GB |
| Mac Studio M5 Max18-core CPU / 40-core GPU, 48GB | $3,099 | Won't fitneeds ~46 GB | Won't fitneeds ~80 GB |
| GMKtec EVO-X2Ryzen AI Max+ 395, 128GB / 1TB | $3,500 | Fits~4 tok/s46 of 96 GB | Fits~2 tok/s80 of 96 GB |
| Minisforum MS-S1 MaxRyzen AI Max+ 395, 128GB / 2TB | $3,879 | Fits~4 tok/s46 of 96 GB | Fits~2 tok/s80 of 96 GB |
| Beelink GTR9 ProRyzen AI Max+ 395, 128GB / 2TB | $4,349 | Fits~4 tok/s46 of 96 GB | Fits~2 tok/s80 of 96 GB |
| Gigabyte GeForce RTX 4090 Windforce V224GB card | $4,499 | Won't fitneeds ~46 GB | Won't fitneeds ~80 GB |
| Framework Desktop DIYRyzen AI Max+ 395, 128GB | $4,839 | Fits~4 tok/s46 of 96 GB | Fits~2 tok/s80 of 96 GB |
| Gigabyte AI TOP ATOM4TB | $5,300 | Fits~4 tok/s46 of 109 GB | Fits~2 tok/s80 of 109 GB |
| Mac Studio M5 Ultra30-core CPU / 64-core GPU, 96GB | $5,499 | Fits~17 tok/s46 of 72 GB | Won't fitneeds ~80 GB |
| Lenovo ThinkStation PGX1TB | $5,859 | Fits~4 tok/s46 of 109 GB | Fits~2 tok/s80 of 109 GB |
| ASUS Ascent GX101TB | $5,999 | Fits~4 tok/s46 of 109 GB | Fits~2 tok/s80 of 109 GB |
| NVIDIA DGX SparkFounders Edition, 4TB | $6,950 | Fits~4 tok/s46 of 109 GB | Fits~2 tok/s80 of 109 GB |
| HP ZGX Nano G1n4TB | $7,699 | Fits~4 tok/s46 of 109 GB | Fits~2 tok/s80 of 109 GB |
| NVIDIA GeForce RTX 5090 Founders Edition32GB card | $8,500 | Won't fitneeds ~46 GB | Won't fitneeds ~80 GB |
| PNY NVIDIA RTX PRO 6000 Blackwell96GB card | $17,899 | Fits~25 tok/s46 of 89 GB | Fits~14 tok/s80 of 89 GB |
| Mac Studio M5 Ultra256GB | — | Fits~17 tok/s46 of 192 GB | Fits~10 tok/s80 of 192 GB |
Sorted by lowest price. Estimates only. Method