Model comparison

canary-1b-v2 vs whisper-medium

At Q4_K_M, whisper-medium is the smaller download — 504,102,848 bytes against 735,476,448.

From the file· summed bytes, KV per layer

Side by side

canary-1b-v2whisper-medium
Parameters980M764M
Architecturecanarywhisper
Layers24
Native context
Mixture of expertsnono
Quantizations published1219
Smallest quantization0.37 GiB0.25 GiB
Q4_K_M0.68 GiB0.47 GiB
Licencecc-by-4.0apache-2.0

KV cache by context

the term that decides long-context viability
Contextcanary-1b-v2whisper-mediumRatio
4,096
8,192
16,384
32,768
65,536
131,072