> A lot of things like retirement funds are built with the assumption of infinite growth

Not really, just a stable ratio of workers/retirees is enough for this system to work. But what we're seeing is a rapid shift in that ratio, with both less workers and more retirees.