Quantization publisher
baoqtrinh
baoqtrinh publishes 2 quantizations across 1 models in our index, averaging 10.178 effective bits per weight.
From the file· summed file bytes
Repositories
1
Quantizations
2
Models covered
1
Avg effective bpw
10.178
across their files
Models they publish
| Model | Quantizations | Smallest |
|---|---|---|
| meta-llama-3.1-8b-bnb-4bit | 2 | 4.58 GiB |