Quantization format
I1_IQ3_M
I1_IQ3_M has a nominal rate of — bits per weight. We have no measured files carrying this label yet.
From the file· 1034 files measured
Nominal bpw
—
from the block layout
Measured average
3.796
1034 files
Range
2.094–8.066
varies by architecture
File sizes
0.09 GiB+
up to 160.39 GiB
Real files
one per model, most downloaded first
●From the filewhat these mean