How much memory do open models need?
Pick a model to see every rig that runs it, with estimated speed and current prices.
| Model | Total / active params | ~Memory at 4-bit | ~Memory at 8-bit | Rigs that fit (4-bit) |
|---|---|---|---|---|
| Qwen3.5 9BAlibaba Qwen | 9B / 9B | 7 GB | 12 GB | 18 of 18 |
| Gemma 4 12BGoogle DeepMind | 12B / 12B | 9 GB | 15 GB | 18 of 18 |
| GPT-OSS 20BOpenAI | 21B / 3.6B | 13 GB | 25 GB | 18 of 18 |
| Gemma 4 26B-A4BGoogle DeepMind | 25.2B / 3.8B | 18 GB | 30 GB | 17 of 18 |
| Qwen3.8 27BAlibaba Qwen | 27B / 27B | 19 GB | 32 GB | 17 of 18 |
| GLM-4.7-Flash 30B-A3BZhipu (Z.ai) | 30B / 3B | 21 GB | 35 GB | 17 of 18 |
| Gemma 4 31BGoogle DeepMind | 31B / 31B | 21 GB | 36 GB | 17 of 18 |
| Qwen3.6 35B-A3BAlibaba Qwen | 35B / 3B | 24 GB | 41 GB | 16 of 18 |
| Llama 3.3 70BMeta | 70B / 70B | 46 GB | 80 GB | 13 of 18 |
| Qwen3-Next 80B-A3BAlibaba Qwen | 80B / 3B | 52 GB | 91 GB | 12 of 18 |
| Llama 4 Scout 109B-A17BMeta | 109B / 17B | 71 GB | 123 GB | 12 of 18 |
| GPT-OSS 120BOpenAI | 117B / 5.1B | 67 GB | 132 GB | 12 of 18 |
| Nemotron 3 Super 120B-A12BNVIDIA | 120B / 12B | 78 GB | 135 GB | 11 of 18 |
| Qwen3.5 122B-A10BAlibaba Qwen | 122B / 10B | 79 GB | 138 GB | 11 of 18 |
| Qwen3 235B-A22BAlibaba Qwen | 235B / 22B | 151 GB | 264 GB | 1 of 18 |
| Muse Spark Open 816B-A42BMeta | 816B / 42B | 521 GB | 912 GB | 0 of 18 |