Won’t prompt processing need the full model though, and be quite slow on a Mac? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		manmal 10 months ago \| parent \| context \| favorite \| on: The Llama 4 herd Won’t prompt processing need the full model though, and be quite slow on a Mac?

terhechte 10 months ago [–]

Yes, that's what I tried to express. Large prompts will probably be slow. I tried a 120k prompt once and it took 10min to process. But you still get a ton of world knowledge and fast response times, and smaller prompts will process fast.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact