Model comparison

GLM-4-9B-0414-abliterated vs Qwen3-30B-A3B-Thinking-2507

These two publish different quantization sets; the table below has the exact sizes.

From the file· summed bytes, KV per layer

Side by side

GLM-4-9B-0414-abliteratedQwen3-30B-A3B-Thinking-2507
Parameters9.4B30.5B
Architectureglm4qwen3moe
Layers48
Native context262,144
Mixture of expertsnoyes, 128 experts
Quantizations published151
Smallest quantization7.70 GiB7.05 GiB
Q4_K_M17.28 GiB
Licencemitapache-2.0

KV cache by context

the term that decides long-context viability
ContextGLM-4-9B-0414-abliteratedQwen3-30B-A3B-Thinking-2507Ratio
4,0960.38 GiB
8,1920.75 GiB
16,3841.50 GiB
32,7683.00 GiB
65,5366.00 GiB
131,07212.00 GiB