Model comparison

Gemma-4-31B-Isometry-Fabled-Persona vs llama-3-youko-8b

These two publish different quantization sets; the table below has the exact sizes. At long context the gap widens: llama-3-youko-8b's KV cache at 32K is 1.5× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

Gemma-4-31B-Isometry-Fabled-Personallama-3-youko-8b
Parameters31.3B8.0B
Architecturegemma4llama
Layers6032
Native context262,1448,192
Mixture of expertsnono
Quantizations published342
Smallest quantization6.67 GiB5.34 GiB
Q4_K_M17.40 GiB
Licenceapache-2.0llama3

KV cache by context

the term that decides long-context viability
ContextGemma-4-31B-Isometry-Fabled-Personallama-3-youko-8bRatio
4,0961.80 GiB0.50 GiB3.59×
8,1922.42 GiB1.00 GiB2.42×
16,3843.67 GiB2.00 GiB1.84×
32,7686.17 GiB4.00 GiB1.54×
65,53611.17 GiB8.00 GiB1.40×
131,07221.17 GiB16.00 GiB1.32×