Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

That’s not what prompt caching is.

Also, most ChatGPT users have their “personalization” prefix in the system prompt (which contains things like date/time), which would break caching of the actual user-query.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: