Model comparison

DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored vs Qwen3-4B

At Q4_K_M, DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored is the smaller download — 1,116,739,904 bytes against 2,497,280,256. At long context the gap widens: DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored's KV cache at 32K is 5.1× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

DeepSeek-R1-Distill-Qwen-1.5B-Fully-UncensoredQwen3-4B
Parameters1.8B4.0B
Architectureqwen2qwen3
Layers2836
Native context131,07240,960
Mixture of expertsnono
Quantizations published1229
Smallest quantization0.70 GiB1.01 GiB
Q4_K_M1.04 GiB2.33 GiB
Licencemit

KV cache by context

the term that decides long-context viability
ContextDeepSeek-R1-Distill-Qwen-1.5B-Fully-UncensoredQwen3-4BRatio
4,0960.11 GiB0.56 GiB5.14×
8,1920.22 GiB1.13 GiB5.14×
16,3840.44 GiB2.25 GiB5.14×
32,7680.88 GiB4.50 GiB5.14×
65,5361.75 GiB9.00 GiB5.14×
131,0723.50 GiB18.00 GiB5.14×