Quantization format

UD_Q2_K

UD_Q2_K has a nominal rate of bits per weight. We have no measured files carrying this label yet.

From the file· 5 files measured
Nominal bpw
from the block layout
Measured average
6.751
5 files
Range
3.951–9.479
varies by architecture
File sizes
3.69 GiB+
up to 10.15 GiB

Real files

one per model, most downloaded first
ModelSizeEffective bpwvs nominal
LTX-2.38.67 GiB8.095
ERNIE-Image-Turbo3.71 GiB3.962
ERNIE-Image3.69 GiB3.951
From the filewhat these mean

Other quantizations