aya-23-8B · bartowski

aya-23-8B Q3_K_L

This file is exactly 4,527,975,552 bytes — 4.22 GiB / 4.53 GB at an effective 4.512 bits per weight. The nominal rate for Q3_K_L is lower; mixed-precision tensors make the real figure higher, always.

From the file· 1 file(s), summed

Get it

4.22 GiB · 1 file

llama.cpp

llama-cli -hf bartowski/aya-23-8B-GGUF:Q3_K_L

Downloads and runs in one step, resolving the quantization by name.

Hugging Face CLI

hf download bartowski/aya-23-8B-GGUF aya-23-8B-Q3_K_L.gguf

Direct download

aya-23-8B-Q3_K_L.gguf

Straight from the Hugging Face CDN — we host nothing and earn nothing from this. Verify what you received against the exact byte count above; a size mismatch is the usual cause of a file that will not load.

Repository →

Size

4.22 GiB

4.53 GB

Effective bpw

4.512

from real bytes ÷ params

Tensors

—

Header

—

GGUF metadata