The Constitution binds the government, it's not something applied to citizens. The government cannot infringe on speech period. Doesn't matter if they want to infringe on it for citizens, non citizens or someone living in a territory the government controls