Azure already has this, there's a literal checkbox that forces it to only answer questions it can cite from your internal documents.
The reality is chat is a terrible interface in the long run. Horrible discoverability, completely non-obvious edges, turns what you might think is an equally accessible tool into the worst case of "you're holding it wrong you've ever seen just judging by what people in these comments are complaining about.
But chat was/is brilliant at making this stuff accessible. I've gone back and learned of incredible things I could have been doing years ago if I had paid more attention to ML, but it wasn't until chat gave us this perfect interface to start from that I suddenly got the spark.
As chat models get more powerful, chat will be the least interesting thing you can do with them. If the model is intelligent enough to convert minimal instructions into complex workflows, why do I need to chat with it? To take it to its logical extreme, why not have one button that just does the right thing?
The more realistic version of that will be industry specific interfaces that focus on the 5 buttons you need to get your job done, along with the X decades of procedure that can guide the LLM to exactly what needs to be done.
The reality is chat is a terrible interface in the long run. Horrible discoverability, completely non-obvious edges, turns what you might think is an equally accessible tool into the worst case of "you're holding it wrong you've ever seen just judging by what people in these comments are complaining about.
But chat was/is brilliant at making this stuff accessible. I've gone back and learned of incredible things I could have been doing years ago if I had paid more attention to ML, but it wasn't until chat gave us this perfect interface to start from that I suddenly got the spark.
As chat models get more powerful, chat will be the least interesting thing you can do with them. If the model is intelligent enough to convert minimal instructions into complex workflows, why do I need to chat with it? To take it to its logical extreme, why not have one button that just does the right thing?
The more realistic version of that will be industry specific interfaces that focus on the 5 buttons you need to get your job done, along with the X decades of procedure that can guide the LLM to exactly what needs to be done.