MiniMaxAI · text · mixture of experts

MiniMax-M2

MiniMaxAI/MiniMax-M2

MiniMax-M2 at Q4_K_M is exactly 138,342,383,904 bytes (128.84 GiB / 138.34 GB) — an effective 4.839 bits per weight, not the nominal 4. Its KV cache at 32K is 7.75 GiB.

From the file· summed from 4 file(s)From the file· KV per layer
Parameters
229B
total, not active
Architecture
minimax-m2
62 layers
Context
196,608
native (config.json)
License
mit

Shipped quantizations

exact bytes, summed from published files
QuantSizeExact bytesEffective bpwTensorsPublisher
IQ1_S43.78 GiB47,009,105,1201.644bartowski
IQ1_M45.65 GiB49,018,340,5761.715bartowski
IQ2_XXS2 shards50.97 GiB54,726,362,5281.914bartowski
UD-TQ1_052.50 GiB56,369,923,2641.972unsloth
IQ2_XS2 shards58.81 GiB63,143,151,0082.209bartowski
IQ2_S2 shards59.00 GiB63,351,847,3602.216bartowski
UD-IQ1_S2 shards59.58 GiB63,976,293,7602.238unsloth
UD-IQ1_M2 shards64.01 GiB68,731,897,2162.404unsloth
IQ2_M2 shards67.05 GiB71,995,128,2242.518bartowski
UD-IQ2_XXS2 shards68.92 GiB74,000,401,7922.588unsloth
UD-IQ2_M2 shards72.72 GiB78,077,265,2802.731unsloth
Q2_K2 shards74.34 GiB79,821,736,3842.792bartowski
Q2_K_L3 shards74.90 GiB80,421,928,4802.813bartowski
Q2_K2 shards77.58 GiB83,302,681,9842.914unsloth
Q2_K_L2 shards77.72 GiB83,446,728,0642.919unsloth
IQ3_XXS3 shards83.91 GiB90,098,792,9923.152bartowski
UD-IQ3_XXS2 shards87.18 GiB93,608,314,2403.274unsloth
IQ3_XS3 shards87.32 GiB93,764,189,7603.280bartowski
Q3_K_S2 shards91.91 GiB98,690,597,2483.452unsloth
Q3_K_S3 shards92.31 GiB99,115,712,0323.467bartowski
IQ3_M3 shards96.82 GiB103,954,578,9763.636bartowski
Q3_K_M3 shards96.82 GiB103,955,365,4083.636bartowski
Q3_K_L3 shards100.78 GiB108,207,111,6803.785bartowski
Q3_K_M3 shards101.77 GiB109,272,482,2723.822unsloth
IQ4_XS3 shards113.53 GiB121,899,124,2244.264unsloth
IQ4_XS4 shards113.78 GiB122,166,375,0404.273bartowski
IQ4_NL3 shards120.14 GiB128,999,622,1444.512unsloth
IQ4_NL4 shards120.37 GiB129,243,415,2004.521bartowski
Q4_03 shards120.61 GiB129,503,725,0564.530unsloth
Q4_K_S3 shards121.10 GiB130,033,780,2244.549unsloth
Q4_04 shards122.32 GiB131,337,683,6164.594bartowski
Q4_K_S4 shards124.56 GiB133,750,456,9924.679bartowski
Q4_K_M4 shards128.84 GiB138,342,383,9044.839lmstudio-community
Q4_K_M3 shards128.84 GiB138,342,385,1204.839unsloth
Q4_K_M4 shards129.07 GiB138,586,178,2084.848bartowski
Q4_13 shards133.39 GiB143,226,840,5765.010unsloth
Q4_14 shards133.47 GiB143,312,167,5845.013bartowski
Q5_K_S4 shards146.66 GiB157,478,438,4965.509unsloth
Q5_K_S4 shards146.73 GiB157,551,575,7125.511bartowski
Q5_K_M4 shards151.16 GiB162,303,936,1285.677unsloth

KV cache by context

computed per layer
ContextKV cache (f16)Flat formulaOverstated byFull / windowed / recurrent
4,0960.97 GiB0.97 GiB62 / 0 / 0
8,1921.94 GiB1.94 GiB62 / 0 / 0
16,3843.88 GiB3.88 GiB62 / 0 / 0
32,7687.75 GiB7.75 GiB62 / 0 / 0
65,53615.50 GiB15.50 GiB62 / 0 / 0
131,07231.00 GiB31.00 GiB62 / 0 / 0

Compare with

same modality, comparable size

Will it run on your card?

full quant x context sweep

Why other calculators give a different number

A parameters × bits ÷ 8 estimate puts Q4_K_M at roughly 119.81 GiB. The real file is 128.84 GiB, because a quantization is a mixture and some tensors are always kept at higher precision.

Architecture

from config.json
Layers
62
Attention heads
48
KV heads
8
Head dim
128
Hidden size
3072
Vocab
200,064
Sliding window
none
SWA period
MLA
no
Experts
256
Experts per token
8
use_sliding_window

Questions people ask

How much VRAM does MiniMax-M2 need?
Q4_K_M is exactly 138,342,383,904 bytes (128.84 GiB) in weights. Add the KV cache, which depends on your context length, plus roughly half a gigabyte of runtime overhead.
How large is MiniMax-M2's KV cache?
7.75 GiB at 32K context with an f16 cache, computed per layer. Quantizing the cache to q8_0 roughly halves it, which is often the difference between a context length fitting and not.
Is MiniMax-M2 a mixture-of-experts model?
Yes — 256 experts, 8 routed per token. Every expert must be resident, but only the routed ones are read per token, which is why its memory requirement and its speed behave very differently.
Which quantization of MiniMax-M2 should I use?
Q4_K_M is the usual default. Pick the largest quantization that fits your card at the context you actually need — the table above gives exact sizes for every one published.