Model comparison

Qwen3-15B-A2B-Base vs Qwen3.6-27B

At Q4_K_M, Qwen3-15B-A2B-Base is the smaller download — 9,496,453,792 bytes against 16,547,397,888. At long context the gap widens: Qwen3-15B-A2B-Base's KV cache at 32K is 1.3× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

Qwen3-15B-A2B-BaseQwen3.6-27B
Parameters15.6B27.8B
Architectureqwen3moeqwen35
Layers2464
Native context4,096262,144
Mixture of expertsyes, 128 expertsno
Quantizations published1140
Smallest quantization5.41 GiB8.74 GiB
Q4_K_M8.84 GiB15.41 GiB
Licenceapache-2.0apache-2.0

KV cache by context

the term that decides long-context viability
ContextQwen3-15B-A2B-BaseQwen3.6-27BRatio
4,0960.19 GiB0.25 GiB1.33×
8,1920.38 GiB0.50 GiB1.33×
16,3840.75 GiB1.00 GiB1.33×
32,7681.50 GiB2.00 GiB1.33×
65,5363.00 GiB4.00 GiB1.33×
131,0726.00 GiB8.00 GiB1.33×