The harness that connects to a chatbot, API or voice interaction is the place to route requests to different systems. If you remember the early days of ChatGPT it explicitly said it was routing image generation to Dall-E after embellishing your request itself first.
Determining which tool to use should be a lightweight operation but I’m not expert enough to understand exactly how much lighter than a full LLM call just to recognize it needs a different tool or model.
For sure, I just know it’s tempting given the power of large transformers to throw things at an existing model.
For instance, OCR is something that can be done locally with no access to a GPU but people (including me) still often use cloud hosted multi-modal large language models for it.
Then the Lord said to Joshua, “Do not be afraid; do not be discouraged. Take the whole army with you, and go up and attack Ai. For I have delivered into your hands the king of Ai, his people, his city and his land.
In a way if people can’t yet use spreadsheets correctly (but they think they do) then it’s impossible to move them away.
Also the OP has much about the programmatic components, but Excel is also an interface. The front end of an unofficial corporate app. And people know (they think) how to use it.
I just listened to a demo of an insurance industry SaaS that isn’t yet public. Goal to move many things out of spreadsheets. Had AI agents built in and all sorts of bells and whistles. But the screens were chaos. I immediately thought it was just too “complicated” to switch a person off the busy/messy system they know - Excel.
My cynical mind think link you but also comes to the opposite conclusion.
Everyone will be writing apps.
Almost every app will be as janky as possible and people will just take the jank as the normal thing and get used to it and working around it, just like they did when every company started using electron and fake mobile apps that are wrapped buggy webpages.
With fast updates that changes every feature across updates, breaking everything and people accepting as the norm.
It's already happening:
- you can see Show HN post making it to the front page full vibecoded with as much jank as possible and the all the comments praising it and not questionning all the jank.
- I've seen it in some popular open source projects when after updates existing feature started to break constantly. The whole thing is ai coded up to the handling of bug reports and feature request and have Claude as co-commiter. I've looked in the internet to see the perception no one is complaining about it
- same at work, managers accepting slop AI solutions that are wrong at so many levels simply because it's fast and complain about the symptoms months down the line without questionning the AI part.
I got one too many chunks of this nonsense and told Claude to knock it off, forever. It acknowledged and wrote out some instructions to its memory about it.
And what a breath of fresh air. Its responses are maybe 20% longer but I read them at least twice as fast. Should have done it a long time ago.
I feel like mine is mocking me. I added an instruction in Claude.md that says "under no circumstances use the phrase found the smoking gun, say I found the problem instead"
What does it do? It says "found the smoking gun! Ooops I wasn't meant to say that - I found the problem!"
It's pretty wild how "reasoning" models now generate like 10 thousand hidden chain of thought tokens in response to a "increase opacity of the logo by 20%" prompt before writing the actual message and yet they still manage to do this.
Why are you using an LLM for "increase opacity of the logo by 20%"? That sounds like the type of straightforward operation a dedicated tool exists for.
Not the person you're asking, but I did that by explaining to Fable my problem with Opus's gobbledygook and having it write a Claude skill for producing clear explanations in its reports to me. I also had it add notes about the need for clearer writing to CLAUDE.md and other project documentation. Opus's subsequent reports to me have been much clearer.
What the American government funds with tax dollars should be chosen by the American people, via Congress. Choosing not to fund speech isn’t the same as prohibiting it.
That said, “chosen by the American people” needs to be broad enough that we’re not singling out individual universities and individual countries based on the power of their political lobbies.
Determining which tool to use should be a lightweight operation but I’m not expert enough to understand exactly how much lighter than a full LLM call just to recognize it needs a different tool or model.
reply