If you got a mortgage at 14.5% you can refinance it when rates get lower, and people did.

The 2nd group can't "refinance" all the extra principal they owe.