I never took that phrase to be reserved for sexual situations - in fact my mom used to use it with me all the time over toys, ice cream, etc. "Come ON, PLEEEASE?!" "No means no..."

I think it's a phrase that is often applied in sexual situations, but not intended to be exclusive to them.