Quantization publisher

litigerking

litigerking publishes 7 quantizations across 1 models in our index, averaging 6.917 effective bits per weight. Their files differ in size from other publishers' builds of the same nominal quantization on 9 of the pairs we can compare — the same label does not mean the same file.

From the file· summed file bytes
Repositories
1
Quantizations
7
Models covered
1
Avg effective bpw
6.917
across their files

Same model, same quant label, different bytes

largest disagreements first
ModelQuantlitigerkingvsTheirsDifference
Hy-MT2-30B-A3BQ5_K_M19.91 GiBmradermacher19.91 GiB-0.0%
Hy-MT2-30B-A3BQ6_K23.01 GiBmradermacher23.01 GiB-0.0%
Hy-MT2-30B-A3BQ8_029.79 GiBmradermacher29.79 GiB-0.0%
Hy-MT2-30B-A3BQ3_K_M13.45 GiBmradermacher13.45 GiB-0.0%
Hy-MT2-30B-A3BQ2_K10.30 GiBmradermacher10.30 GiB-0.0%
Hy-MT2-30B-A3BQ4_K_M16.98 GiBmradermacher16.98 GiB-0.0%
Hy-MT2-30B-A3BQ4_K_M16.98 GiBGrahLnn16.98 GiB0.0%
Hy-MT2-30B-A3BQ3_K_M13.45 GiBGrahLnn13.45 GiB0.0%
Hy-MT2-30B-A3BQ2_K10.30 GiBGrahLnn10.30 GiB0.0%

A quantization label describes a target, not a recipe. Publishers make different choices about which tensors to keep at higher precision, and some apply an importance matrix while others don't — so two files both honestly labelled the same thing can differ measurably in size and in quality.

Models they publish

ModelQuantizationsSmallest
Hy-MT2-30B-A3B710.30 GiB