I prefer the lower overhead of having things hosted elsewhere, but keep regular backups and have a well detailed business continuity plan for each vendor that could go hostile, belly up, or otherwise no longer viable.

You take advantage of off-the-shelf options at the same time that you prepare for the worst.