Model comparison

gemma-4-19b-a4b-it-REAP-heretic vs Qwen3.8-27B

At Q4_K_M, gemma-4-19b-a4b-it-REAP-heretic is the smaller download — 10,069,118,784 bytes against 16,810,714,336. At long context the gap widens: gemma-4-19b-a4b-it-REAP-heretic's KV cache at 32K is 1.3× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

gemma-4-19b-a4b-it-REAP-hereticQwen3.8-27B
Parameters19.0B27.8B
Architecturegemma4qwen35
Layers3064
Native context262,144262,144
Mixture of expertsyes, 90 expertsno
Quantizations published2722
Smallest quantization5.70 GiB8.39 GiB
Q4_K_M9.38 GiB15.66 GiB
Licencegemmaapache-2.0

KV cache by context

the term that decides long-context viability
Contextgemma-4-19b-a4b-it-REAP-hereticQwen3.8-27BRatio
4,0960.45 GiB0.25 GiB1.80×
8,1920.61 GiB0.50 GiB1.21×
16,3840.92 GiB1.00 GiB1.09×
32,7681.54 GiB2.00 GiB1.30×
65,5362.79 GiB4.00 GiB1.43×
131,0725.29 GiB8.00 GiB1.51×