This isn't just true for middle-eastern types. My girlfriend is Native American, and often has guys trying to hit on her in Spanish (especially true in Spain), even after telling them repeatedly that she doesn't speak Spanish.