> why would you want to let a LLM have any agentic interface to the real world though

The various arms race type dilemmas that actors face will create that outcome.

If you're a nation state not doing that, you'll lose to a nation state that does.

If you're a company not doing that, you'll lose to a company that does.