Model comparison

Huihui-GLM-4.7-Flash-abliterated-57B vs Qwen3-30B-A3B-Thinking-2507

At Q4_K_M, Qwen3-30B-A3B-Thinking-2507 is the smaller download — 18,556,685,824 bytes against 33,687,658,720. At long context the gap widens: Qwen3-30B-A3B-Thinking-2507's KV cache at 32K is 1.4× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

Huihui-GLM-4.7-Flash-abliterated-57BQwen3-30B-A3B-Thinking-2507
Parameters57.3B30.5B
Architecturedeepseek2qwen3moe
Layers6348
Native context202,752262,144
Mixture of expertsyes, 64 expertsyes, 128 experts
Quantizations published3651
Smallest quantization10.79 GiB7.05 GiB
Q4_K_M31.37 GiB17.28 GiB
Licenceapache-2.0

KV cache by context

the term that decides long-context viability
ContextHuihui-GLM-4.7-Flash-abliterated-57BQwen3-30B-A3B-Thinking-2507Ratio
4,0960.52 GiB0.38 GiB1.39×
8,1921.05 GiB0.75 GiB1.39×
16,3842.09 GiB1.50 GiB1.39×
32,7684.18 GiB3.00 GiB1.39×
65,5368.37 GiB6.00 GiB1.39×
131,07216.73 GiB12.00 GiB1.39×