I have this problem, but it really only becomes an issue when a few days becomes a few weeks. Do that a few times and the battery will lose capacity too.
Weeks, sure. 2 weeks is probably on the lower end of acceptable though. My car is often left for 2 weeks and is completely fine, but most of the time it's weekly.