Model comparison

Janus-Pro-7B vs Krea-2-Turbo

At Q4_K_M, Janus-Pro-7B is the smaller download — 4,223,359,936 bytes against 7,216,993,376.

From the file· summed bytes, KV per layer

Side by side

Janus-Pro-7BKrea-2-Turbo
Parameters7.4B12.8B
Architecturellamaqwen_image
Layers30
Native context16,384
Mixture of expertsnono
Quantizations published3633
Smallest quantization1.61 GiB2.78 GiB
Q4_K_M3.93 GiB6.72 GiB
Licencemitother

KV cache by context

the term that decides long-context viability
ContextJanus-Pro-7BKrea-2-TurboRatio
4,0961.88 GiB
8,1923.75 GiB
16,3847.50 GiB
32,76815.00 GiB
65,53630.00 GiB
131,07260.00 GiB