Model comparison

Llama-3-Stheno-Maid-Blackroot-Grand-HORROR-16B vs Qwen3-Coder-30B-A3B-Instruct

At Q4_K_M, Llama-3-Stheno-Maid-Blackroot-Grand-HORROR-16B is the smaller download — 10,014,868,608 bytes against 18,556,689,568.

From the file· summed bytes, KV per layer

Side by side

Llama-3-Stheno-Maid-Blackroot-Grand-HORROR-16BQwen3-Coder-30B-A3B-Instruct
Parameters16.5B30.5B
Architecturellamaqwen3moe
Layers48
Native context262,144
Mixture of expertsnoyes, 128 experts
Quantizations published1046
Smallest quantization5.88 GiB7.46 GiB
Q4_K_M9.33 GiB17.28 GiB
Licenceapache-2.0apache-2.0

KV cache by context

the term that decides long-context viability
ContextLlama-3-Stheno-Maid-Blackroot-Grand-HORROR-16BQwen3-Coder-30B-A3B-InstructRatio
4,0960.38 GiB
8,1920.75 GiB
16,3841.50 GiB
32,7683.00 GiB
65,5366.00 GiB
131,07212.00 GiB