Quantization format

Q5_0

Q5_0 has a nominal rate of bits per weight. We have no measured files carrying this label yet.

From the file· 506 files measured
Nominal bpw
from the block layout
Measured average
6.111
506 files
Range
1.558–31.893
varies by architecture
File sizes
0.02 GiB+
up to 151.16 GiB

Real files

one per model, most downloaded first
ModelSizeEffective bpwvs nominal
FLUX.2-klein-9B6.25 GiB5.910
cohere-transcribe-03-20261.62 GiB6.733
LTX-2.314.24 GiB13.297
Qwen3-8B5.33 GiB5.588
Qwen3-4B2.63 GiB5.616
parakeet-tdt-0.6b-v30.44 GiB6.000
whisper-medium0.50 GiB5.647
Wan2.2-I2V-A14B9.61 GiB5.775
Wan2.1-T2V-1.3B0.97 GiB5.861
Qwen2.5-32B-Instruct21.08 GiB5.528
Qwen2.5-Coder-7B-Instruct4.95 GiB5.583
Qwen3-14B9.56 GiB5.560
Qwen2.5-7B-Instruct4.95 GiB5.583
Jan-v3-4B-base-instruct2.88 GiB5.606
Qwen2.5-1.5B-Instruct1.17 GiB6.525
whisper-large-v31.01 GiB5.604
Qwen3-30B-A3B19.63 GiB5.524
LTX-212.72 GiB5.791
Qwen2.5-Coder-32B-Instruct42.17 GiB11.055
whisper-large-v3-turbo0.53 GiB5.677
Qwen2.5-Coder-14B-Instruct19.12 GiB11.121
granite-4.1-3b2.21 GiB5.590
Qwen2.5-3B-Instruct2.22 GiB6.179
Qwen2.5-0.5B-Instruct0.46 GiB7.942
Qwen3-32B21.08 GiB5.527
From the filewhat these mean

Other quantizations