Quantization format

BF16

Files labelled BF16 average 15.545 effective bits per weight across 945 real quantizations — not the nominal 16. That is -3% more than the label implies, because a quantization is a mixture: some tensors are always kept at higher precision.

From the file· 945 files measured
Nominal bpw
16
from the block layout
Measured average
15.545
945 files
Range
1.033–32.883
varies by architecture
File sizes
0.05 GiB+
up to 1912.15 GiB

Note

Unquantized bfloat16; wider exponent, fewer mantissa bits than F16.

Real files

one per model, most downloaded first
ModelSizeEffective bpwvs nominal
Qwen3.6-27B50.11 GiB15.495+-3%
embeddinggemma-300m0.57 GiB16.177+1%
Qwen3.6-35B-A3B64.61 GiB15.438+-4%
Qwen3.5-9B16.69 GiB14.852+-7%
gemma-4-26B-A4B-it47.04 GiB15.222+-5%
gemma-4-12B-it22.20 GiB15.941+-0%
Qwen3.5-4B7.85 GiB14.463+-10%
Qwythos-9B-Claude-Mythos-5-1M17.14 GiB15.649+-2%
gemma-4-E4B-it14.02 GiB15.060+-6%
Qwen3-Coder-30B-A3B-Instruct56.90 GiB16.008+0%
gemma-4-31B-it57.20 GiB15.710+-2%
Qwen3-VL-30B-A3B-Instruct56.90 GiB15.731+-2%
FLUX.2-klein-9B16.91 GiB16.000+0%
cohere-transcribe-03-20263.82 GiB15.898+-1%
Qwen-AgentWorld-35B-A3B64.61 GiB16.013+0%
LTX-2.339.15 GiB
Llama-3.2-1B-Instruct2.31 GiB16.052+0%
gemma-4-E2B-it8.67 GiB14.540+-9%
Qwen3-8B15.26 GiB16.006+0%
Qwen3.5-0.8B1.41 GiB13.892+-13%
Qwen3-4B7.50 GiB16.013+0%
GLM-5.21404.42 GiB16.014+0%
Llama-3.1-8B-Instruct14.97 GiB16.008+0%
Ornith-1.0-35B64.61 GiB16.013+0%
Llama-3.2-3B-Instruct5.99 GiB16.020+0%
From the filewhat these mean

Other quantizations