Quantization format

F16

Files labelled F16 average 15.704 effective bits per weight across 1161 real quantizations — not the nominal 16. That is -2% more than the label implies, because a quantization is a mixture: some tensors are always kept at higher precision.

From the file· 1161 files measured
Nominal bpw
16
from the block layout
Measured average
15.704
1161 files
Range
1.028–32.396
varies by architecture
File sizes
0.04 GiB+
up to 1250.09 GiB

Note

Unquantized half precision.

What files with this label actually contain

tensor types across 39 parsed files
F32
15920
F16
13018
BF16
866
MXFP4
72

If F16 were a uniform precision, this chart would have one bar. The F32 entries are normalization and bias tensors, which are never quantized; the higher K-quant entries are attention and output tensors deliberately promoted to protect quality.

Real files

one per model, most downloaded first
ModelSizeEffective bpwvs nominal
nemotron-3.5-asr-streaming-0.6b1.20 GiB16.130+1%
parakeet-unified-en-0.6b1.15 GiB16.032+0%
FLUX.2-klein-9B16.91 GiB16.000+0%
cohere-transcribe-03-20263.82 GiB15.903+-1%
LTX-2.339.15 GiB
Llama-3.2-1B-Instruct2.31 GiB16.052+0%
gpt-oss-20b12.85 GiB5.129+-68%
Qwopus3.6-35B-A3B-v166.19 GiB15.814+-1%
Qwen3-VL-8B-Instruct-abliterated-v115.26 GiB14.954+-7%
UI-TARS-1.5-7B14.19 GiB14.701+-8%
parakeet-tdt-0.6b-v31.17 GiB16.022+0%
Llama-3.2-3B-Instruct5.99 GiB16.020+0%
ThinkingCap-Qwen3.6-27B50.90 GiB15.984+-0%
whisper-medium1.44 GiB16.149+1%
Wan2.1-T2V-1.3B2.65 GiB16.016+0%
Bielik-11B-v3.0-Instruct20.80 GiB16.001+0%
Voxtral-Mini-4B-Realtime-26028.27 GiB16.036+0%
LFM2.5-1.2B-Instruct2.18 GiB16.018+0%
Qwen2.5-32B-Instruct61.04 GiB16.002+0%
gemma-3-1b-it1.87 GiB16.054+0%
Qwen2.5-Coder-7B-Instruct14.19 GiB16.007+0%
Qwen3-VL-4B-Instruct7.50 GiB14.514+-9%
Qwen2.5-7B-Instruct14.19 GiB16.007+0%
Qwen3-VL-2B-Instruct3.21 GiB12.963+-19%
Qwen2.5-1.5B-Instruct2.88 GiB16.032+0%
From the filewhat these mean

Other quantizations