Most LLM providers have batch mode. Not sure why you are calling them out. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		dist-epoch 7 months ago \| parent \| context \| favorite \| on: Batch Mode in the Gemini API: Process More for Les... Most LLM providers have batch mode. Not sure why you are calling them out.

okdood64 7 months ago [–]

I'll take it further. Regular cloud compute have batch workload capabilities at cheaper rates, as well since forever.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact