> while you are physically in the EU

This is the only part that really matters here, AFAIK. Practically, there's no good way to enforce this limitation.

The residency thing is seared into my mind from people using EU "citizen" instead of EU "resident" when talking about the GDPR.