Well it's wrong if people have that expectation and it's not the reality.

It's also problematic in a world wherein people have to work together, which is why most jobs don't allow one to 'work when one chooses' although that is obviously the case in some scenarios.