Best local AI models for 64GB VRAM
Ranked by what actually fits at 32K context, computed from real file bytes.
A 64GB card gives you about 59.52 GiB to work with after driver overhead. 2050 indexed models fit at 32K context — the largest being DeepSeek-V2.5 at 236B parameters in IQ1_M.
From the file· fit from summed bytesFrom the file· KV per layer
alltext generation 1761vision + language 185speech recognition 39speech synthesis 21embeddings 26video generation 16image generation 2
Fits in 64GB at 32K context
largest quantization that fits, per model
| Model | Modality | Best quant | Params○ | Total◐ | Headroom◐ |
|---|---|---|---|---|---|
| Qwen3-Coder-30B-A3B-InstructMoE | text generation | Q8_0 | 30.5B | 34.05 GiB | 25.47 GiB |
| Qwen3.6-27B | text generation | BF16 | 27.8B | 53.77 GiB | 5.75 GiB |
| Qwen3.6-35B-A3BMoE | vision + language | Q8_0 | 36.0B | 38.50 GiB | 21.02 GiB |
| Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP | vision + language | Q8_0 | 27.8B | 58.77 GiB | 0.75 GiB |
| Qwen3.8-27B | text generation | BF16 | 27.8B | 58.51 GiB | 1.01 GiB |
| Qwen3.5-9B | vision + language | BF16 | 9.7B | 18.98 GiB | 40.54 GiB |
| gemma-4-26B-A4B-itMoE | vision + language | BF16 | 26.5B | 50.98 GiB | 8.54 GiB |
| gemma-4-12B-it | vision + language | BF16 | 12.0B | 25.51 GiB | 34.01 GiB |
| nemotron-3.5-asr-streaming-0.6b | speech recognition | F32 | 638M | 3.22 GiB | 56.30 GiB |
| Qwen3.5-4B | vision + language | BF16 | 4.7B | 9.88 GiB | 49.64 GiB |
| gemma-4-12B-it-qat-q4_0-unquantized | text generation | Q4_0 | 12.0B | 9.81 GiB | 49.71 GiB |
| Qwythos-9B-Claude-Mythos-5-1M | vision + language | BF16 | 9.4B | 35.67 GiB | 23.85 GiB |
| gemma-4-E4B-it | text generation | BF16 | 8.0B | 15.50 GiB | 44.02 GiB |
| Qwen3-30B-A3B-Thinking-2507MoE | text generation | Q8_0 | 30.5B | 34.05 GiB | 25.47 GiB |
| gemma-4-31B-it | vision + language | Q8_0 | 31.3B | 37.93 GiB | 21.59 GiB |
| Muse-Glimmer-30B | vision + language | BF16 | 29.8B | 53.28 GiB | 6.24 GiB |
| Qwen3-4B | text generation | BF16 | 4.0B | 12.81 GiB | 46.71 GiB |
| Qwen3-8B | text generation | BF16 | 8.2B | 20.60 GiB | 38.92 GiB |
| gemma-4-26B-A4B-it-qat-q4_0-unquantizedMoE | vision + language | Q4_0 | 26.5B | 15.78 GiB | 43.74 GiB |
| Qwen3.5-122B-A10BMoE | vision + language | UD-IQ4_XS | 125B | 59.25 GiB | 0.27 GiB |
| Laguna-XS-2.1MoE | text generation | Q8_0 | 33.4B | 35.32 GiB | 24.20 GiB |
| Qwen3.5-0.8B | vision + language | BF16 | 873M | 2.60 GiB | 56.92 GiB |
| Llama-3.2-1B-Instruct | text generation | F16 | 1.2B | 4.11 GiB | 55.41 GiB |
| Qwen-AgentWorld-35B-A3BMoE | text generation | Q8_0 | 34.7B | 35.80 GiB | 23.72 GiB |
| gemma-4-E2B-it | vision + language | BF16 | 5.1B | 9.71 GiB | 49.81 GiB |
| gemma-4-31B-it-qat-q4_0-unquantized | vision + language | Q4_0 | 32.7B | 23.49 GiB | 36.03 GiB |
| gpt-oss-20bMoE | text generation | F16 | 21.5B | 14.40 GiB | 45.12 GiB |
| KAT-Coder-V2.5-DevMoE | text generation | Q8_0 | 34.7B | 35.81 GiB | 23.71 GiB |
| gemma-4-E4B-it-qat-q4_0-unquantized | vision + language | Q4_0 | 7.9B | 6.12 GiB | 53.40 GiB |
| Qwen3-VL-30B-A3B-InstructMoE | vision + language | Q8_0 | 31.1B | 34.05 GiB | 25.47 GiB |
| Qwen3-30B-A3BMoE | text generation | Q8_0 | 30.5B | 34.05 GiB | 25.47 GiB |
| Qwopus3.6-35B-A3B-v1MoE | vision + language | Q8_0 | 36.0B | 36.64 GiB | 22.88 GiB |
| llama-3-youko-8b | text generation | Q8_0 | 8.0B | 12.79 GiB | 46.73 GiB |
| Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-NEO-IMATRIX-MAX-MTP | vision + language | Q8_0 | 9.7B | 21.60 GiB | 37.92 GiB |
| Laguna-S-2.1MoE | text generation | UD-IQ4_NL | 118B | 57.18 GiB | 2.34 GiB |
| parakeet-tdt-0.6b-v3 | speech recognition | F32 | 627M | 3.18 GiB | 56.34 GiB |
| Qwen3.5-35B-A3BMoE | vision + language | Q8_0 | 36.0B | 36.65 GiB | 22.87 GiB |
| Llama-3.1-8B-Instruct | text generation | F32 | 8.0B | 34.76 GiB | 24.76 GiB |
| ced-base | text generation | F32 | 86M | 1.16 GiB | 58.36 GiB |
| Ace-Step1.5 | speech synthesis | Q8_0 | 160M | 46.10 GiB | 13.42 GiB |
| Qwen2.5-7B-Instruct | text generation | F16 | 7.6B | 16.80 GiB | 42.72 GiB |
| Qwen3-TTS-12Hz-0.6B-Base | speech synthesis | F32 | 915M | 29.72 GiB | 29.80 GiB |
| Qwythos-9B-v2 | vision + language | BF16 | 9.7B | 35.67 GiB | 23.85 GiB |
| UI-TARS-1.5-7B | text generation | F16 | 8.3B | 16.80 GiB | 42.72 GiB |
| gemma-3-1b-it | text generation | F16 | 1000M | 2.81 GiB | 56.71 GiB |
| gemma-4-E2B-it-qat-q4_0-unquantized | text generation | BF16 | 5.1B | 9.83 GiB | 49.69 GiB |
| Qwen3-1.7B | text generation | BF16 | 2.0B | 8.08 GiB | 51.44 GiB |
| GLM-4.7-FlashMoE | text generation | BF16 | 31.2B | 58.26 GiB | 1.26 GiB |
| whisper-medium | speech recognition | F32 | 764M | 3.69 GiB | 55.83 GiB |
| embeddinggemma-300m | text generation | F32 | 303M | 2.05 GiB | 57.47 GiB |
| Llama-3.2-3B-Instruct | text generation | F16 | 3.2B | 10.30 GiB | 49.22 GiB |
| Qwen3-0.6B | text generation | BF16 | 752M | 5.68 GiB | 53.84 GiB |
| Qwen3-14B | text generation | BF16 | 14.8B | 33.37 GiB | 26.15 GiB |
| Ornith-1.0-35BMoE | text generation | Q8_0 | 34.7B | 35.81 GiB | 23.71 GiB |
| ThinkingCap-Qwen3.6-27B | vision + language | F16 | 27.4B | 53.77 GiB | 5.75 GiB |
| Qwopus3.6-27B-Coder | vision + language | Q8_0 | 27.8B | 29.92 GiB | 29.60 GiB |
| Voxtral-Mini-4B-Realtime-2602 | speech recognition | F16 | 4.4B | 12.33 GiB | 47.19 GiB |
| Wan2.1-T2V-1.3B | text generation | Q8_0 | 1.4B | 12.18 GiB | 47.34 GiB |
| Qwen3-Coder-NextMoE | text generation | UD-Q5_K_M | 79.7B | 58.96 GiB | 0.56 GiB |
| LFM2.5-1.2B-Instruct | text generation | BF16 | 1.2B | 3.37 GiB | 56.15 GiB |
This page models a generic 64GB accelerator, so it answers what fits rather than how fast it runs. For tokens per second you need a specific card — pick one from hardware, where bandwidth is known.