Is Llama-2-7B-32K-Instruct or HyperCLOVAX-SEED-Text-Instruct-1.5B smaller?

HyperCLOVAX-SEED-Text-Instruct-1.5B is smaller at Q4_K_M: 1.06 GiB against 3.80 GiB.

Which uses less memory at long context?

We cannot resolve the KV layout for one of these models, so we do not publish a comparison.

Model comparison

At Q4_K_M, HyperCLOVAX-SEED-Text-Instruct-1.5B is the smaller download — 1,133,974,368 bytes against 4,081,004,288.

From the file· summed bytes, KV per layer

	Llama-2-7B-32K-Instruct	HyperCLOVAX-SEED-Text-Instruct-1.5B
Parameters	6.7B	1.6B
Architecture	llama	llama
Layers	32	—
Native context	32,768	—
Mixture of experts	no	no
Quantizations published	36	1
Smallest quantization	1.42 GiB	1.06 GiB
Q4_K_M	3.80 GiB	1.06 GiB
Licence	llama2	other

the term that decides long-context viability

Context	Llama-2-7B-32K-Instruct	HyperCLOVAX-SEED-Text-Instruct-1.5B	Ratio
4,096	2.00 GiB	—	—
8,192	4.00 GiB	—	—
16,384	8.00 GiB	—	—
32,768	16.00 GiB	—	—
65,536	32.00 GiB	—	—
131,072	64.00 GiB	—	—