In general, the people who have 2nd vacation homes buy single family houses or condominium apartments. They don't rent, because that doesn't get them ownership of anything. The 2nd home is generally a more speculative investment than anything else.

So no, they're not really pushing up the costs of rental apartments, because they're not in that market segment at all.