some GPUs use HBM. Most use GDDR. AMD and Nvidia still extract huge bandwidth from GDDR via high bus speeds + wide buses (like the 1.79 TB/s on the 5090)
Indeed! I implied "AI GPUs" since that’s where HBM is commonly used (despite AMD pioneering it on some consumer cards). And yeah, thousand-bit wide busses get close in performance.
some GPUs use HBM. Most use GDDR. AMD and Nvidia still extract huge bandwidth from GDDR via high bus speeds + wide buses (like the 1.79 TB/s on the 5090)