> so 30 12gb gpus - a 3090 will cost around $1800 3090 has 24Gb, thus 15 GPUs X ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		coolspot on May 3, 2022 \| parent \| context \| favorite \| on: OPT: Open Pre-trained Transformer Language Models > so 30 12gb gpus - a 3090 will cost around $1800 3090 has 24Gb, thus 15 GPUs X $1800 = $27,000 in GPUs

etaioinshrdlu on May 3, 2022 [–]

Can 3090 GPUs share their memory with one another to fit such a large model? Or is the enterprise grade hardware required?

coolspot on May 3, 2022 | [–]

Yes, two 3090s ($1.7k each) can be connected via NVlink with common 48Gb of memory pool.

Two RTX A6000 ($4.5k each) can form 96Gb memory pool.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact