Model comparison

SmolLM2-1.7B-Instruct-Uncensored vs Qwen3-1.7B

At Q4_K_M, Qwen3-1.7B is the smaller download — 1,107,409,472 bytes against 1,112,233,344. At long context the gap widens: Qwen3-1.7B's KV cache at 32K is 1.7× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

SmolLM2-1.7B-Instruct-UncensoredQwen3-1.7B
Parameters1.8B2.0B
Architecturellamaqwen3
Layers2428
Native context8,19240,960
Mixture of expertsnono
Quantizations published1248
Smallest quantization0.66 GiB0.50 GiB
Q4_K_M1.04 GiB1.03 GiB
Licenceapache-2.0

KV cache by context

the term that decides long-context viability
ContextSmolLM2-1.7B-Instruct-UncensoredQwen3-1.7BRatio
4,0960.75 GiB0.44 GiB1.71×
8,1921.50 GiB0.88 GiB1.71×
16,3843.00 GiB1.75 GiB1.71×
32,7686.00 GiB3.50 GiB1.71×
65,53612.00 GiB7.00 GiB1.71×
131,07224.00 GiB14.00 GiB1.71×