Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Writing an LLM Eval with Vercel's AI SDK and Vitest (xata.io)
1 point by gulcin_xata 9 months ago | hide | past | favorite | 1 comment


Recently we launched Xata Agent, an open-source AI agent which helps diagnose issues and suggest optimizations for PostgreSQL databases.

To make sure that Xata Agent still works well after modifying a prompt or switching LLM models we decided to test it with an Eval. In this blog, we'll explain how we used Vercel's AI SDK and Vitest to build an Eval in TypeScript.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: