Model comparison

Laguna-M.1 vs GLM-5.2

These two publish different quantization sets; the table below has the exact sizes. At long context the gap widens: GLM-5.2's KV cache at 32K is 3.2× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

Laguna-M.1GLM-5.2
Parameters226B753B
Architecturelagunaglm-dsa
Layers7078
Native context262,1441,048,576
Mixture of expertsyes, 256 expertsyes, 256 experts
Quantizations published220
Smallest quantization223.63 GiB169.33 GiB
Q4_K_M
Licenceapache-2.0mit

KV cache by context

the term that decides long-context viability
ContextLaguna-M.1GLM-5.2Ratio
4,0961.09 GiB0.34 GiB3.19×
8,1922.19 GiB0.69 GiB3.19×
16,3844.38 GiB1.37 GiB3.19×
32,7688.75 GiB2.74 GiB3.19×
65,53617.50 GiB5.48 GiB3.19×
131,07235.00 GiB10.97 GiB3.19×