GenueAI · text

Tessera-4.1

GenueAI/Tessera-4.1

Tessera-4.1 at Q4_K_M is exactly 8,988,110,688 bytes (8.37 GiB / 8.99 GB) — an effective 4.868 bits per weight, not the nominal 4. Its KV cache at 32K is 6.00 GiB.

From the file· summed from 1 file(s)From the file· KV per layer
Parameters
14.8B
Architecture
qwen2
48 layers
Context
32,768
native (config.json)
License

Shipped quantizations

exact bytes, summed from published files
QuantSizeExact bytesEffective bpwTensorsPublisher
I1-IQ1_S3.36 GiB3,607,994,4641.954mradermacher
I1-IQ1_M3.61 GiB3,872,309,3442.097mradermacher
I1-IQ2_XXS4.02 GiB4,312,834,1442.336mradermacher
I1-IQ2_XS4.38 GiB4,704,575,5842.548mradermacher
I1-IQ2_S4.66 GiB5,003,726,9442.710mradermacher
I1-IQ2_M4.99 GiB5,356,146,7842.901mradermacher
I1-Q2_K_S5.03 GiB5,397,188,7042.923mradermacher
Q2_K5.37 GiB5,770,497,8883.126mradermacher
I1-Q2_K5.37 GiB5,770,498,1443.126mradermacher
I1-IQ3_XXS5.54 GiB5,946,708,0643.221mradermacher
I1-IQ3_XS5.94 GiB6,383,362,1443.458mradermacher
Q3_K_S6.20 GiB6,659,596,1283.607mradermacher
I1-Q3_K_S6.20 GiB6,659,596,3843.607mradermacher
I1-IQ3_S6.23 GiB6,693,019,7443.625mradermacher
I1-IQ3_M6.44 GiB6,916,538,4643.746mradermacher
Q3_K_M6.84 GiB7,339,204,4483.975mradermacher
I1-Q3_K_M6.84 GiB7,339,204,7043.975mradermacher
Q3_K_L7.38 GiB7,924,768,6084.292mradermacher
I1-Q3_K_L7.38 GiB7,924,768,8644.292mradermacher
I1-IQ4_XS7.56 GiB8,119,840,8644.398mradermacher
IQ4_XS7.62 GiB8,186,195,8084.434mradermacher
I1-Q4_07.96 GiB8,544,268,3844.628mradermacher
I1-IQ4_NL7.96 GiB8,549,183,5844.631mradermacher
Q4_K_S7.98 GiB8,573,431,6484.644mradermacher
I1-Q4_K_S7.98 GiB8,573,431,9044.644mradermacher
Q4_K_M8.37 GiB8,988,110,6884.868mradermacher
I1-Q4_K_M8.37 GiB8,988,110,9444.868mradermacher
I1-Q4_18.75 GiB9,392,140,3845.087mradermacher
Q5_K_S9.56 GiB10,266,554,2085.561mradermacher
I1-Q5_K_S9.56 GiB10,266,554,4645.561mradermacher
Q5_K_M9.79 GiB10,508,873,5685.692mradermacher
I1-Q5_K_M9.79 GiB10,508,873,8245.692mradermacher
Q6_K11.29 GiB12,124,684,1286.567mradermacher
I1-Q6_K11.29 GiB12,124,684,3846.567mradermacher
Q8_014.62 GiB15,701,598,0488.505mradermacher

KV cache by context

computed per layer
ContextKV cache (f16)Flat formulaOverstated byFull / windowed / recurrent
4,0960.75 GiB0.75 GiB48 / 0 / 0
8,1921.50 GiB1.50 GiB48 / 0 / 0
16,3843.00 GiB3.00 GiB48 / 0 / 0
32,7686.00 GiB6.00 GiB48 / 0 / 0
65,53612.00 GiB12.00 GiB48 / 0 / 0
131,07224.00 GiB24.00 GiB48 / 0 / 0

Compare with

same modality, comparable size

Will it run on your card?

full quant x context sweep

Why other calculators give a different number

A parameters × bits ÷ 8 estimate puts Q4_K_M at roughly 7.74 GiB. The real file is 8.37 GiB, because a quantization is a mixture and some tensors are always kept at higher precision.

Architecture

from config.json
Layers
48
Attention heads
40
KV heads
8
Head dim
128
Hidden size
5120
Vocab
152,064
Sliding window
none
SWA period
MLA
no
Experts
Experts per token
use_sliding_window
false

Questions people ask

How much VRAM does Tessera-4.1 need?
Q4_K_M is exactly 8,988,110,688 bytes (8.37 GiB) in weights. Add the KV cache, which depends on your context length, plus roughly half a gigabyte of runtime overhead.
How large is Tessera-4.1's KV cache?
6.00 GiB at 32K context with an f16 cache, computed per layer. Quantizing the cache to q8_0 roughly halves it, which is often the difference between a context length fitting and not.
Which quantization of Tessera-4.1 should I use?
Q4_K_M is the usual default. Pick the largest quantization that fits your card at the context you actually need — the table above gives exact sizes for every one published.