Quantization publisher

Szeweq

Szeweq publishes 1 quantizations across 1 models in our index, averaging 8.516 effective bits per weight. Their files differ in size from other publishers' builds of the same nominal quantization on 3 of the pairs we can compare — the same label does not mean the same file.

From the file· summed file bytes
Repositories
1
Quantizations
1
Models covered
1
Avg effective bpw
8.516
across their files

Same model, same quant label, different bytes

largest disagreements first
ModelQuantSzeweqvsTheirsDifference
G9v3-3BQ8_02.96 GiBbartowski2.96 GiB-0.0%
G9v3-3BQ8_02.96 GiBWhiskyAKM2.96 GiB-0.0%
G9v3-3BQ8_02.96 GiBWhiskyAKM2.96 GiB-0.0%

A quantization label describes a target, not a recipe. Publishers make different choices about which tensors to keep at higher precision, and some apply an importance matrix while others don't — so two files both honestly labelled the same thing can differ measurably in size and in quality.

Models they publish

ModelQuantizationsSmallest
G9v3-3B12.96 GiB