Radeon RX 6750 GRE
Radeon RX 6750 GRE has 10 GB of VRAM at 320 GB/s — about 9.30 GiB usable after driver and compositor overhead. 1527 of 2118 indexed models fit at 16K context with q8_0 KV.
What fits at 16K context
| Model | Best quant | Params | Weights● | KV● | Total in memory◐ | Headroom◐ | tok/s◐ |
|---|---|---|---|---|---|---|---|
| L3-8B-Sunfall-v0.5-Stheno-v3.2 | Q6_K_L | 8.0B | 7.30 GiB | 1.06 GiB | 9.30 GiB | 0.00 GiB | 24±26.5% |
| Qwen3-48B-A4B-Savant-Commander-Distill-12X-Closed-Open-Heretic-UncensoredMoE | I1-IQ1_M | 33.6B | 7.19 GiB | 1.20 GiB | 9.30 GiB | 0.00 GiB | 41±37% |
| granite-20b-code-instruct-8k | IQ3_S | 20.1B | 8.32 GiB | 0.00 GiB | 9.30 GiB | 0.00 GiB | 24±26.5% |
| granite-20b-code-base-8k | I1-IQ3_S | 20.1B | 8.32 GiB | 0.00 GiB | 9.30 GiB | 0.00 GiB | 24±26.5% |
| Le-Chaton-Slim-23BMoE | I1-Q2_K_S | 23.3B | 7.52 GiB | 0.86 GiB | 9.30 GiB | 0.00 GiB | 41±37% |
| Qwen3-VL-30B-A3B-InstructMoE | UD-TQ1_0 | 31.1B | 7.60 GiB | 0.80 GiB | 9.29 GiB | 0.01 GiB | 63±37% |
| Ministral-3-8B-Instruct-2512-BF16 | Q6_K_L | 8.9B | 7.22 GiB | 1.13 GiB | 9.29 GiB | 0.01 GiB | 24±26.5% |
| GLM-4.7-Flash-REAP-23B-A3B-absolute-heresyMoE | I1-Q2_K | 23.0B | 7.94 GiB | 0.44 GiB | 9.29 GiB | 0.01 GiB | 69±37% |
| EuroLLM-22B-Instruct-2512 | IQ2_XS | 22.6B | 6.53 GiB | 1.79 GiB | 9.28 GiB | 0.02 GiB | 24±26.5% |
| Qwen3-VL-30B-A3B-ThinkingMoE | UD-TQ1_0 | 31.1B | 7.59 GiB | 0.80 GiB | 9.28 GiB | 0.02 GiB | 63±37% |
| Qwen3-30B-A3B-Thinking-2507MoE | UD-TQ1_0 | 30.5B | 7.59 GiB | 0.80 GiB | 9.28 GiB | 0.02 GiB | 63±37% |
| medgemma-27b-it | UD-IQ2_XXS | 28.8B | 7.31 GiB | 0.99 GiB | 9.28 GiB | 0.02 GiB | 24±26.5% |
| gemma-3-27b-it | UD-IQ2_XXS | 27.4B | 7.31 GiB | 0.99 GiB | 9.28 GiB | 0.02 GiB | 24±26.5% |
| medgemma-27b-text-it | UD-IQ2_XXS | 27.0B | 7.31 GiB | 0.99 GiB | 9.28 GiB | 0.02 GiB | 24±26.5% |
| Llama-3.2-11B-Vision-Instruct | Q4_K_S | 10.7B | 7.01 GiB | 1.33 GiB | 9.28 GiB | 0.02 GiB | 24±26.5% |
| Falcon3-7B-Instruct | Q8_0 | 7.5B | 7.38 GiB | 0.93 GiB | 9.28 GiB | 0.02 GiB | 24±26.5% |
| Qwen3-30B-A3BMoE | IQ2_XXS | 30.5B | 7.59 GiB | 0.80 GiB | 9.28 GiB | 0.02 GiB | 63±37% |
| Pantheon-Proto-RP-1.8-30B-A3BMoE | IQ2_XXS | 30.5B | 7.59 GiB | 0.80 GiB | 9.28 GiB | 0.02 GiB | 63±37% |
| granite-3.1-2b-instruct | Q8_0 | 2.5B | 7.70 GiB | 0.66 GiB | 9.27 GiB | 0.03 GiB | 24±26.5% |
| codegeex4-all-9b | IQ1_M | 9.4B | 3.00 GiB | 5.31 GiB | 9.26 GiB | 0.04 GiB | 24±26.5% |
| ERNIE-21B-A3B-Thinking-Gemini-3-Pro-High-Reasoning-V2 | I1-IQ3_XXS | 21.8B | 7.88 GiB | 0.46 GiB | 9.26 GiB | 0.04 GiB | 24±26.5% |
| ERNIE-21B-A3B-Claude-4.5-High-OPUS-Thinking | I1-IQ3_XXS | 21.8B | 7.88 GiB | 0.46 GiB | 9.26 GiB | 0.04 GiB | 24±26.5% |
| ERNIE-4.5-21B-A3B-Thinking | I1-IQ3_XXS | 21.8B | 7.88 GiB | 0.46 GiB | 9.26 GiB | 0.04 GiB | 24±26.5% |
| glm-4-9b-chat | IQ1_M | 9.4B | 3.00 GiB | 5.31 GiB | 9.26 GiB | 0.04 GiB | 24±26.5% |
| LFM2-8B-A1BMoE | Q8_0 | 8.3B | 8.26 GiB | 0.10 GiB | 9.25 GiB | 0.05 GiB | 68±37% |
| gemma-2-9b | Q5_1 | 9.2B | 6.52 GiB | 1.79 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| gemma-2-9b-it | Q5_1 | 9.2B | 6.52 GiB | 1.79 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| GLM-4.6V-Flash | Q6_K_L | 10.3B | 7.98 GiB | 0.33 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| GLM-Z1-9B-0414 | Q6_K_L | 9.4B | 7.98 GiB | 0.33 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| GLM-4-9B-0414 | Q6_K_L | 9.4B | 7.98 GiB | 0.33 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| FrickFritz-4B | F16 | 4.7B | 8.07 GiB | 0.27 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| Newton-bot-3-VLM-mini-4B | F16 | 4.7B | 8.07 GiB | 0.27 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| qwen3.5-4b-agentic-coder-v4 | F16 | 4.7B | 8.07 GiB | 0.27 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| Myth-4B | F16 | 4.3B | 8.07 GiB | 0.27 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| Qwen3.5-4B-Uncensored | F16 | 4.7B | 8.07 GiB | 0.27 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| JOSIE-2-4B-Preview | F16 | 4.7B | 8.07 GiB | 0.27 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| Qwen3.5-4B | BF16 | 4.7B | 8.07 GiB | 0.27 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| Surogate-3.5-4B | F16 | 5.3B | 8.07 GiB | 0.27 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| Qwopus3.5-4B-v3 | BF16 | 4.7B | 8.07 GiB | 0.27 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| Ministral-3-14B-Instruct-2512-BF16-abliterated | IQ4_XS | 13.9B | 6.96 GiB | 1.33 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| Ministral-3-14B-abliterated | IQ4_XS | 13.9B | 6.96 GiB | 1.33 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| Ministral-3-14B-Reasoning-2512-Uncensored | IQ4_XS | 13.9B | 6.96 GiB | 1.33 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| gemma-3-12b-it | Q4_0 | 12.2B | 7.52 GiB | 0.78 GiB | 9.25 GiB | 0.05 GiB | 24±26.5% |
| Forsaken-Void-12B | I1-Q4_K_M | 12.2B | 6.96 GiB | 1.33 GiB | 9.24 GiB | 0.06 GiB | 24±26.5% |
| Silver-Siren-ST-12B | I1-Q4_K_M | 12.2B | 6.96 GiB | 1.33 GiB | 9.24 GiB | 0.06 GiB | 24±26.5% |
| Tess-3-Mistral-Nemo-12B | I1-Q4_K_M | 12.2B | 6.96 GiB | 1.33 GiB | 9.24 GiB | 0.06 GiB | 24±26.5% |
| KrakenSakura-Maelstrom-12B-v1 | Q4_K_M | 12.2B | 6.96 GiB | 1.33 GiB | 9.24 GiB | 0.06 GiB | 24±26.5% |
| MN-12B-Runeweaver-RP-RU | I1-Q4_K_M | 12.2B | 6.96 GiB | 1.33 GiB | 9.24 GiB | 0.06 GiB | 24±26.5% |
| Impish_Bloodmoon_12B | I1-Q4_K_M | 12.2B | 6.96 GiB | 1.33 GiB | 9.24 GiB | 0.06 GiB | 24±26.5% |
| Wayfarer-2-12B | I1-Q4_K_M | 12.2B | 6.96 GiB | 1.33 GiB | 9.24 GiB | 0.06 GiB | 24±26.5% |
| Wayfarer-12B | I1-Q4_K_M | 12.2B | 6.96 GiB | 1.33 GiB | 9.24 GiB | 0.06 GiB | 24±26.5% |
| Muse-12B | I1-Q4_K_M | 12.2B | 6.96 GiB | 1.33 GiB | 9.24 GiB | 0.06 GiB | 24±26.5% |
| Vikhr-Nemo-12B-Instruct-R-21-09-24 | Q4_K_M | 12.2B | 6.96 GiB | 1.33 GiB | 9.24 GiB | 0.06 GiB | 24±26.5% |
| Mistral-Nemo-Base-2407 | Q4_K_M | 12.2B | 6.96 GiB | 1.33 GiB | 9.24 GiB | 0.06 GiB | 24±26.5% |
| writing-roleplay-20k-context-nemo-12b-v1.0 | Q4_K_M | 12.2B | 6.96 GiB | 1.33 GiB | 9.24 GiB | 0.06 GiB | 24±26.5% |
| Dans-PersonalityEngine-V1.3.0-12b | I1-Q4_K_M | 12.2B | 6.96 GiB | 1.33 GiB | 9.24 GiB | 0.06 GiB | 24±26.5% |
| mini-magnum-12b-v1.1 | Q4_K_M | 12.2B | 6.96 GiB | 1.33 GiB | 9.24 GiB | 0.06 GiB | 24±26.5% |
| Lumimaid-v0.2-12B | Q4_K_M | 12.2B | 6.96 GiB | 1.33 GiB | 9.24 GiB | 0.06 GiB | 24±26.5% |
| MN-Violet-Lotus-12B | I1-Q4_K_M | 12.2B | 6.96 GiB | 1.33 GiB | 9.24 GiB | 0.06 GiB | 24±26.5% |
| Rocinante-X-12B-v1-Heretic-Uncensored | I1-Q4_K_M | 12.2B | 6.96 GiB | 1.33 GiB | 9.24 GiB | 0.06 GiB | 24±26.5% |
Speed is modeled, not measured: decode is memory-bandwidth bound, so tokens per second is bytes read per token against achievable bandwidth. Mixture-of-experts models carry a wider band because only the routed experts are read each step, and few have been measured publicly.
Measured on this card
| Workload◍ | Median | Middle 50% | Runs |
|---|---|---|---|
| Image generation | 2.78 it/s | 2.77–2.92 | 5 |
Aggregated from community-submitted runs, so the spread is wide by nature — it covers different models, resolutions, step counts and settings, not one controlled configuration. Read the middle 50% rather than the median alone. These figures are reproduced with attribution from vladmandic-sd-data-benchmark, which publishes no licence — so we display and link rather than redistribute them.
Questions people ask
- What AI models can a Radeon RX 6750 GRE run?
- 1527 of 2118 indexed open-weight models fit a Radeon RX 6750 GRE at 16,384 context with q8_0 KV cache, the largest being L3-8B-Sunfall-v0.5-Stheno-v3.2 at Q6_K_L. That covers text, vision-language, image, video and speech models.
- How much usable memory does a Radeon RX 6750 GRE actually have?
- Its nameplate is 10 GB, but about 9.30 GiB is available to a model once driver and compositor overhead is accounted for.
- Is a Radeon RX 6750 GRE fast for local AI?
- Its memory bandwidth is 320 GB/s, and that figure — not teraflops — is what governs token generation speed. Capacity decides what you can run; bandwidth decides how fast it runs.