RUC-NLPIR · text

OmniAtlas-Qwen3-30B-A3B

RUC-NLPIR/OmniAtlas-Qwen3-30B-A3B

OmniAtlas-Qwen3-30B-A3B at I1-IQ1_S is exactly 6,416,780,992 bytes (5.98 GiB / 6.42 GB) — an effective 1.618 bits per weight, not the nominal 1.

From the file· summed from 1 file(s)From the file· KV per layer
Parameters
31.7B
Architecture
qwen3vlmoe
null layers
Context
native (config.json)
License
apache-2.0

Shipped quantizations

exact bytes, summed from published files
QuantSizeExact bytesEffective bpwTensorsPublisher
I1-IQ1_S5.98 GiB6,416,780,9921.618mradermacher
I1-IQ1_M6.59 GiB7,078,563,5201.785mradermacher
I1-IQ2_XXS7.62 GiB8,181,534,4002.063mradermacher
I1-IQ2_XS8.45 GiB9,076,494,0162.289mradermacher
I1-IQ2_S8.65 GiB9,287,429,8242.342mradermacher
I1-IQ2_M9.47 GiB10,169,806,5282.565mradermacher
I1-Q2_K_S9.80 GiB10,519,670,4642.653mradermacher
I1-Q2_K10.49 GiB11,258,916,5442.840mradermacher
I1-IQ3_XXS11.04 GiB11,849,625,2802.989mradermacher
I1-IQ3_XS11.73 GiB12,598,775,4883.178mradermacher
I1-Q3_K_S12.38 GiB13,292,801,7283.353mradermacher
I1-IQ3_S12.39 GiB13,299,486,4003.354mradermacher
I1-IQ3_M12.59 GiB13,513,395,9043.408mradermacher
I1-Q3_K_M13.70 GiB14,712,180,4163.711mradermacher
I1-Q3_K_L14.81 GiB15,901,003,4564.010mradermacher
I1-IQ4_XS15.24 GiB16,368,709,3124.128mradermacher
I1-Q4_016.19 GiB17,380,355,7764.384mradermacher
I1-Q4_K_S16.26 GiB17,456,377,5364.403mradermacher
I1-Q4_K_M17.28 GiB18,557,054,6564.680mradermacher
I1-Q4_117.87 GiB19,192,884,9284.841mradermacher
I1-Q5_K_S19.63 GiB21,080,911,5525.317mradermacher
I1-Q5_K_M20.23 GiB21,725,982,4005.480mradermacher
I1-Q6_K23.37 GiB25,092,968,1286.329mradermacher

Compare with

same modality, comparable size

Will it run on your card?

full quant x context sweep

Why other calculators give a different number

A parameters × bits ÷ 8 estimate puts I1-IQ1_S at roughly 16.62 GiB. The real file is 5.98 GiB, because a quantization is a mixture and some tensors are always kept at higher precision.

Architecture

from config.json
Layers
Attention heads
KV heads
Head dim
Hidden size
Vocab
Sliding window
none
SWA period
MLA
no
Experts
Experts per token
use_sliding_window

Questions people ask

How much VRAM does OmniAtlas-Qwen3-30B-A3B need?
I1-IQ1_S is exactly 6,416,780,992 bytes (5.98 GiB) in weights. Add the KV cache, which depends on your context length, plus roughly half a gigabyte of runtime overhead.
Which quantization of OmniAtlas-Qwen3-30B-A3B should I use?
Q4_K_M is the usual default. Pick the largest quantization that fits your card at the context you actually need — the table above gives exact sizes for every one published.