I don't think it is the cheapest, but the tiny box is an option: https://tinygra... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		tuxpenguine on Aug 9, 2023 \| parent \| context \| favorite \| on: Ask HN: Cheapest hardware to run Llama 2 70B I don't think it is the cheapest, but the tiny box is an option: https://tinygrad.org/

Tepix on Aug 10, 2023 [–]

Tiny box is for running it at fp16, most other comments here talk about running it with 4bit quantization

Consider applying for YC's Summer 2026 batch! Applications are open till May 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact