Model comparison

Wizard-Vicuna-30B-Uncensored vs Qwen3.6-27B

At Q4_K_M, Qwen3.6-27B is the smaller download — 16,547,397,888 bytes against 19,621,139,904. At long context the gap widens: Qwen3.6-27B's KV cache at 32K is 24.4× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

Wizard-Vicuna-30B-UncensoredQwen3.6-27B
Parameters32.5B27.8B
Architecturellamaqwen35
Layers6064
Native context2,048262,144
Mixture of expertsnono
Quantizations published3340
Smallest quantization6.63 GiB8.74 GiB
Q4_K_M18.27 GiB15.41 GiB
Licenceotherapache-2.0

KV cache by context

the term that decides long-context viability
ContextWizard-Vicuna-30B-UncensoredQwen3.6-27BRatio
4,0966.09 GiB0.25 GiB24.36×
8,19212.19 GiB0.50 GiB24.37×
16,38424.38 GiB1.00 GiB24.37×
32,76848.75 GiB2.00 GiB24.37×
65,53697.50 GiB4.00 GiB24.37×
131,072195.00 GiB8.00 GiB24.37×