Model comparison

Qwen3.5-9B-DFlash vs KaLM-embedding-multilingual-mini-instruct-v2.5

These two publish different quantization sets; the table below has the exact sizes. At long context the gap widens: Qwen3.5-9B-DFlash's KV cache at 32K is 1.8× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

Qwen3.5-9B-DFlashKaLM-embedding-multilingual-mini-instruct-v2.5
Parameters1.3B494M
Architecturedflashqwen2
Layers624
Native context262,144131,072
Mixture of expertsnono
Quantizations published111
Smallest quantization0.45 GiB0.49 GiB
Q4_K_M0.71 GiB
Licenceapache-2.0

KV cache by context

the term that decides long-context viability
ContextQwen3.5-9B-DFlashKaLM-embedding-multilingual-mini-instruct-v2.5Ratio
4,0960.09 GiB0.05 GiB2.00×
8,1920.12 GiB0.09 GiB1.27×
16,3840.15 GiB0.19 GiB1.25×
32,7680.21 GiB0.38 GiB1.76×
65,5360.34 GiB0.75 GiB2.22×
131,0720.59 GiB1.50 GiB2.55×