Oh I wad hoping this would go back another step in the 5 whys and why use an LLM conversationally at all.

By the time you got a nice well established context with the right info... just give it to the user.

I like the idea of hallucination-free systems where the LLM merely classifies things at most.

Question -> classifier -> check with user action to take -> act using no AI