DavidAU · text

Grand-Horror-25B-Godzillas-Wicked-Sister

DavidAU/Grand-Horror-25B-Godzillas-Wicked-Sister

Grand-Horror-25B-Godzillas-Wicked-Sister at Q4_K_M is exactly 15,109,002,592 bytes (14.07 GiB / 15.11 GB) — an effective 4.827 bits per weight, not the nominal 4.

From the file· summed from 1 file(s)
Parameters
25.0B
Architecture
llama
Context
native (config.json)
License
apache-2.0

Shipped quantizations

exact bytes, summed from published files
QuantSizeExact bytesEffective bpwTensorsPublisher
Q2_K8.79 GiB9,438,582,1123.015DavidAU
Q3_K_S10.22 GiB10,976,982,3683.507DavidAU
Q3_K_M11.35 GiB12,186,318,1763.893DavidAU
Q3_K_L12.33 GiB13,236,991,3284.229DavidAU
IQ4_XS12.72 GiB13,658,330,4644.363DavidAU
Q4_K_S13.35 GiB14,330,631,5204.578DavidAU
Q4_K_M14.07 GiB15,109,002,5924.827DavidAU
Q5_K_S16.11 GiB17,297,708,3845.526DavidAU
Q5_K_M16.53 GiB17,748,923,7445.670DavidAU
Q6_K19.14 GiB20,553,839,9686.566DavidAU
Q8_024.79 GiB26,618,721,6328.503DavidAU

Compare with

same modality, comparable size

Will it run on your card?

full quant x context sweep

Why other calculators give a different number

A parameters × bits ÷ 8 estimate puts Q4_K_M at roughly 13.12 GiB. The real file is 14.07 GiB, because a quantization is a mixture and some tensors are always kept at higher precision.

Architecture

Architecture unavailable — this repository is gated and no ungated mirror was found. Exact file sizes above are still authoritative; only the KV math needs the config.

Questions people ask

How much VRAM does Grand-Horror-25B-Godzillas-Wicked-Sister need?
Q4_K_M is exactly 15,109,002,592 bytes (14.07 GiB) in weights. Add the KV cache, which depends on your context length, plus roughly half a gigabyte of runtime overhead.
Which quantization of Grand-Horror-25B-Godzillas-Wicked-Sister should I use?
Q4_K_M is the usual default. Pick the largest quantization that fits your card at the context you actually need — the table above gives exact sizes for every one published.