I am not a game theorist, but take Centipede game for instance. If you know the exact number of rounds in advance, the optimal strategy is markedly different than if you don't know it. And I think there are many weird behaviors like that in iterated games, where optimal solution for infinite time horizon is not the same (or doesn't even exist) as the limit of optimal solutions for finite horizons approaching infinity.