Quantization format

I1_Q3_K_L

I1_Q3_K_L has a nominal rate of bits per weight. We have no measured files carrying this label yet.

From the file· 1034 files measured
Nominal bpw
from the block layout
Measured average
4.321
1034 files
Range
1.151–9.199
varies by architecture
File sizes
0.10 GiB+
up to 148.65 GiB

Real files

one per model, most downloaded first

Other quantizations