You would end up with the "religious week" and the "standard week" moving relative to one another over the years, in a classic case of trying to fix messy details and thereby adding more details (as in https://xkcd.com/927/).