You can but eventually the voltage gets so high that the resistance of the air isn't enough to prevent a short via a discharge. And in a vacuum, the resistance is even less. One would have to keep the capacitor in a super resistant gas or fluid to prevent a short.
So the equation shows that as d goes up, C goes down.
But as d goes up the breakdown voltage also increases so my question is why can’t we force more voltage on there.