Apple · apple

Apple M3 Max

Apple M3 Max has 96 GB of unified memory at 307 GB/s — about 66.96 GiB usable after driver and compositor overhead. 2071 of 2118 indexed models fit at 16K context with q4_0 KV. Note only 72 GB of its 96 GB is allocatable to the GPU.

Spec sheet· bandwidth, theoreticalFrom the file· fit from summed bytesPredicted· speed
Memory
96 GB
LPDDR5-6400
Bandwidth
307 GB/s
384-bit bus
Tensor FP16
—
dense
TDP
—
Context4K8K16K32K64K128K
KV cachef16q8_0q4_0quantizing the KV cache is a ~2× lever on the dominant term at long context
text 1781vision language 186image 2audio asr 39audio tts 21video 16embedding 26

What fits at 16K context

largest quantization that fits, per model · 2071 of 2118 indexed
ModelBest quantParamsWeights●KV●Total in memory◐Headroom◐tok/s◐
Meta-Llama-3-70B-InstructQ8_070.6B69.83 GiB1.41 GiB71.92 GiB0.08 GiB4±8.3%
GLM-4.5VMoEI1-Q5_K_S108B70.53 GiB0.81 GiB71.91 GiB0.09 GiB15±37%
calme-2.4-llama3-70bQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
calme-2.2-llama3-70bQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
L3.3-Electra-R1-70bQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
L3.3-70B-Magnum-v4-SEQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
Hermes-4-70BQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
Llama-3.3_70_b_uncensored_continuedQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
grok-oss-Revenant-70BQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
Llama-3.1-70BQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
Llama-3.3-70B-InstructQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
Llama-3.1-Nemotron-70B-Instruct-HFQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
Llama-3.3-70B-Instruct-abliteratedQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
Hermes-4-70B-hereticQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
Anubis-70B-v1.2Q8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
L3.3-70B-Euryale-v2.3Q8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
Rombos-LLM-70b-Llama-3.3Q8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
llama-3-firefunction-v2Q8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
DeepSeek-R1-Distill-Llama-70B-hereticQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
DeepSeek-R1-Distill-Llama-70BQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
DeepSeek-R1-Distill-Llama-70B-abliteratedQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
Legion-V2.1-LLaMa-70BQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
Tess-R1-Limerick-Llama-3.1-70BQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
Assistant_Pepe_70BQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
SEMIKONG-70BQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
functionary-medium-v3.2KV unresolvedQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
Llama-3.1-WhiteRabbitNeo-2-70BQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
Athene-70BQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
Infinity-Instruct-7M-Gen-Llama3_1-70BQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
Hermes-3-Llama-3.1-70BQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
L3.3-70B-Magnum-DiamondQ8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
Meta-Llama-3-70B-Instruct-abliterated-v3.5Q8_070.6B69.83 GiB1.41 GiB71.91 GiB0.09 GiB4±8.3%
MiniMax-M2.7-BF16-ultra-uncensored-hereticMoEI1-IQ2_M229B69.70 GiB1.09 GiB71.32 GiB0.68 GiB18±37%
MiniMax-M2.1MoEI1-IQ2_M229B69.70 GiB1.09 GiB71.32 GiB0.68 GiB18±37%
MiniMax-M2.5MoEI1-IQ2_M229B69.70 GiB1.09 GiB71.32 GiB0.68 GiB18±37%
OYM-Qimi-122B-A10B-K2.6MoEI1-Q4_K_M125B70.64 GiB0.11 GiB71.32 GiB0.68 GiB21±37%
Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliteratedMoEQ4_K_M123B70.63 GiB0.11 GiB71.32 GiB0.68 GiB21±37%
GLM-4.6-REAP-268B-A32BMoEUD-IQ1_S269B69.09 GiB1.62 GiB71.30 GiB0.70 GiB14±37%
Step-3.7-FlashUD-IQ3_XXS201B68.54 GiB1.98 GiB71.09 GiB0.91 GiB4±8.3%
MiniMax-M2.1-REAP-139B-A10BMoEI1-IQ4_XS139B69.15 GiB1.09 GiB70.77 GiB1.23 GiB16±37%
m51Lab-MiniMax-M2.7-REAP-139B-A10BMoEI1-IQ4_XS139B69.15 GiB1.09 GiB70.77 GiB1.23 GiB16±37%
Behemoth-X-123B-v2Q4_K_L123B68.47 GiB1.55 GiB70.72 GiB1.28 GiB4±8.3%
Llama-4-Scout-17B-16E-InstructMoEKV unresolvedQ5_K_S109B69.16 GiB0.84 GiB70.58 GiB1.42 GiB15±37%
MiniMax-M2MoEUD-IQ2_XXS229B68.92 GiB1.09 GiB70.54 GiB1.46 GiB18±37%
Mistral-Large-Instruct-2411Q4_K_M123B68.19 GiB1.55 GiB70.44 GiB1.56 GiB4±8.3%
c4ai-command-r-plus-08-2024Q5_K_M104B68.57 GiB1.13 GiB70.42 GiB1.58 GiB4±8.3%
Step-3.5-Flash-REAP-121B-A11BI1-Q4_K_M121B67.82 GiB1.98 GiB70.37 GiB1.63 GiB4±8.3%
Qwen3.5-122B-A10BMoEQ4_K_S125B69.66 GiB0.11 GiB70.35 GiB1.65 GiB21±37%
GLM-4.5-Air-DerestrictedMoEQ4_K_L110B68.88 GiB0.81 GiB70.27 GiB1.73 GiB15±37%
Mistral-Medium-3.5-128BQ4_K_S128B68.01 GiB1.55 GiB70.26 GiB1.74 GiB4±8.3%
Ornith-1.0-35B-AEON-Ultimate-Uncensored-BF16MoEQ8_035.1B69.57 GiB0.09 GiB70.22 GiB1.78 GiB21±37%
GLM-4.5-AirMoEQ4_K_M110B68.45 GiB0.81 GiB69.84 GiB2.16 GiB15±37%
Qwen3.5-122B-A10B-hereticMoEI1-Q4_K_M123B69.11 GiB0.11 GiB69.80 GiB2.20 GiB21±37%
Laguna-S-2.1MoEQ4_1118B68.96 GiB0.25 GiB69.78 GiB2.22 GiB19±37%
dots.llm1.instMoEQ3_K_S143B64.78 GiB4.36 GiB69.72 GiB2.28 GiB13±37%
MiMo-V2-FlashMoEKV unresolvedIQ2_XXS310B68.47 GiB0.53 GiB69.60 GiB2.40 GiB20±37%
HunyuanImage-2.1Q6_K17.5B68.97 GiB0.00 GiB69.57 GiB2.43 GiB4±8.3%
Mistral-Small-4-119B-2603MoEUD-Q4_K_M119B68.70 GiB0.10 GiB69.38 GiB2.62 GiB21±37%
GLM-4.7-REAP-218B-A32BMoEUD-IQ2_XXS218B67.13 GiB1.62 GiB69.34 GiB2.66 GiB13±37%
Mixtral-8x22B-Instruct-v0.1MoEQ3_K_L141B67.60 GiB0.98 GiB69.20 GiB2.80 GiB7±37%
●From the file◐Predictedwhat these mean

Speed is modeled, not measured: decode is memory-bandwidth bound, so tokens per second is bytes read per token against achievable bandwidth. Mixture-of-experts models carry a wider band because only the routed experts are read each step, and few have been measured publicly.

Questions people ask

What AI models can a Apple M3 Max run?
2071 of 2118 indexed open-weight models fit a Apple M3 Max at 16,384 context with q4_0 KV cache, the largest being Meta-Llama-3-70B-Instruct at Q8_0. That covers text, vision-language, image, video and speech models.
How much usable memory does a Apple M3 Max actually have?
Its nameplate is 96 GB, but about 66.96 GiB is available to a model once driver and compositor overhead is accounted for, and only 72 GB of the pool can be allocated to the GPU at all.
Is a Apple M3 Max fast for local AI?
Its memory bandwidth is 307 GB/s, and that figure — not teraflops — is what governs token generation speed. Capacity decides what you can run; bandwidth decides how fast it runs.