Hardware

Ranked by memory bandwidth, which is what actually governs token generation speed — not teraflops, and not core count.

AcceleratorMemoryBandwidthTensor FP16TDPModels fit
Instinct MI325X256 GB6000130710001865
Instinct MI300X192 GB530013077501858
Instinct MI250X128 GB32773835601840
Instinct MI21064 GB16381813001791
Instinct MI10032 GB12291853001667
Instinct MI50 32GB32 GB10243001667
Instinct MI6032 GB10243001667
Radeon VII16 GB10243001187
Radeon RX 7900 XTX24 GB9603551561
Radeon Pro W7900 Dual Slot48 GB8642951752
Radeon Pro W790048 GB8642951752
Radeon Pro W780048 GB8642811752
Radeon RX 7900 XT20 GB8003151435
Radeon RX 9070 XT16 GB6403041187
Radeon RX 907016 GB6402201187
Radeon AI Pro R970032 GB6403001667
Radeon AI Pro R9700S32 GB6403001667
Radeon AI Pro R960032 GB6401501667
Radeon AI Pro R9600D32 GB6401501667
Radeon RX 7800 XT16 GB6242631187
Radeon RX 770016 GB6242631187
Radeon RX 7900 GRE16 GB5762601187
Radeon Pro W770016 GB5761901187
Radeon Pro W780032 GB5762601667
Radeon RX 6950 XT16 GB5763351187
Radeon RX 680016 GB5122501187
Radeon Pro W680032 GB5122501667
Radeon RX 6800 XT16 GB5123001187
Radeon RX 6900 XT16 GB5123001187
Radeon RX 7700 XT12 GB432245966
Radeon RX 6750 XT12 GB432250966
Radeon RX 9070 GRE12 GB432220966
Radeon RX 6750 GRE12 GB384230966
Radeon RX 6700 XT12 GB384230966
Radeon RX 9060 XT16 GB3201601187
Radeon RX 9060 XT8 GB320150618
Radeon RX 6750 GRE10 GB320170905
Radeon RX 670010 GB320175905
Radeon Pro W76008 GB288130618
Radeon RX 7600 XT16 GB2881901187
Radeon Pro W75008 GB28870618
Radeon RX 7650 GRE8 GB288170618
Radeon RX 90608 GB288132618
Radeon RX 76008 GB288165618
Radeon RX 6650 XT8 GB280180618
AMD Ryzen AI Max 390 (Radeon 8050S)unified32 GB24 usable2561201635
Radeon RX 6600 XT8 GB256160618
AMD Ryzen AI Max 385 (Radeon 8050S)unified32 GB24 usable2561201635
AMD Ryzen AI Max 385 (Radeon 8050S)unified64 GB48 usable2561201774
AMD Ryzen AI Max 390 (Radeon 8050S)unified64 GB48 usable2561201774
AMD Ryzen AI Max+ 395 (Radeon 8060S)unified128 GB96 usable2561201815
AMD Ryzen AI Max+ 395 (Radeon 8060S)unified32 GB24 usable2561201635
AMD Ryzen AI Max+ 395 (Radeon 8060S)unified64 GB48 usable2561201774
Radeon RX 66008 GB224132618
Radeon Pro W66008 GB224130618
Radeon RX 74008 GB17355618
Radeon RX 6500 XT8 GB144113618
Radeon RX 6500 XT4 GB144107241
Radeon RX 64004 GB12853241
Radeon Pro W64004 GB12850241
Spec sheetPredictedwhat these mean