Model comparison

MiniCPM-V-4.6 vs Unlimited-OCR

At Q4_K_M, MiniCPM-V-4.6 is the smaller download — 529,101,504 bytes against 1,950,321,792.

From the file· summed bytes, KV per layer

Side by side

MiniCPM-V-4.6Unlimited-OCR
Parameters1.3B3.3B
Architectureqwen35deepseek2-ocr
Layers2412
Native context262,14432,768
Mixture of expertsnoyes, 64 experts
Quantizations published1521
Smallest quantization0.47 GiB1.15 GiB
Q4_K_M0.49 GiB1.82 GiB
Licenceapache-2.0mit

KV cache by context

the term that decides long-context viability
ContextMiniCPM-V-4.6Unlimited-OCRRatio
4,0960.05 GiB
8,1920.09 GiB
16,3840.19 GiB
32,7680.38 GiB
65,5360.75 GiB
131,0721.50 GiB