Model comparison

MiMo-VL-7B-RL vs Qwythos-9B-v2

At Q4_K_M, MiMo-VL-7B-RL is the smaller download — 4,684,339,136 bytes against 6,047,707,680. At long context the gap widens: Qwythos-9B-v2's KV cache at 32K is 4.5× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

MiMo-VL-7B-RLQwythos-9B-v2
Parameters8.3B9.7B
Architectureqwen2vlqwen35
Layers3632
Native context128,0001,048,576
Mixture of expertsnono
Quantizations published6443
Smallest quantization1.86 GiB3.64 GiB
Q4_K_M4.36 GiB5.63 GiB
Licencemitapache-2.0

KV cache by context

the term that decides long-context viability
ContextMiMo-VL-7B-RLQwythos-9B-v2Ratio
4,0960.56 GiB0.13 GiB4.50×
8,1921.13 GiB0.25 GiB4.50×
16,3842.25 GiB0.50 GiB4.50×
32,7684.50 GiB1.00 GiB4.50×
65,5369.00 GiB2.00 GiB4.50×
131,07218.00 GiB4.00 GiB4.50×