Funnily you've mentioned, I explored this route and found one 'normal' web hosting that provides an SVN repo. But in my case, I need a Git hosting to collaborate with friends on private stuff (I don't like an idea of my code being fed into an LLM by GitHub) and a VPN for travels, so VPS is a requirement, unfortunately.
Find a Hoster which offers you a shell login where the Hoster manages close to all services you need, including backups, security updates and so on.
That should massively simplify your setup.