Model comparison

Qwen3.6-27B-Omnimerge-v4-MTP-GGUF vs gemma-4-12B-it-qat-q4_0-unquantized

These two publish different quantization sets; the table below has the exact sizes.

From the file· summed bytes, KV per layer

Side by side

Qwen3.6-27B-Omnimerge-v4-MTP-GGUFgemma-4-12B-it-qat-q4_0-unquantized
Parameters27.3B12.0B
Architectureqwen35gemma4
Layers48
Native context262,144
Mixture of expertsnono
Quantizations published12
Smallest quantization10.64 GiB6.50 GiB
Q4_K_M
Licenceotherapache-2.0

KV cache by context

the term that decides long-context viability
ContextQwen3.6-27B-Omnimerge-v4-MTP-GGUFgemma-4-12B-it-qat-q4_0-unquantizedRatio
4,0960.72 GiB
8,1920.97 GiB
16,3841.47 GiB
32,7682.47 GiB
65,5364.47 GiB
131,0728.47 GiB