Model comparison

deepseek-coder-5.7bmqa-base vs HyperCLOVAX-SEED-Text-Instruct-1.5B

At Q4_K_M, HyperCLOVAX-SEED-Text-Instruct-1.5B is the smaller download — 1,133,974,368 bytes against 3,430,867,168.

From the file· summed bytes, KV per layer

Side by side

deepseek-coder-5.7bmqa-baseHyperCLOVAX-SEED-Text-Instruct-1.5B
Parameters5.7B1.6B
Architecturellamallama
Layers32
Native context16,384
Mixture of expertsnono
Quantizations published141
Smallest quantization2.00 GiB1.06 GiB
Q4_K_M3.20 GiB1.06 GiB
Licenceotherother

KV cache by context

the term that decides long-context viability
Contextdeepseek-coder-5.7bmqa-baseHyperCLOVAX-SEED-Text-Instruct-1.5BRatio
4,0960.06 GiB
8,1920.13 GiB
16,3840.25 GiB
32,7680.50 GiB
65,5361.00 GiB
131,0722.00 GiB