I try to but sometimes I don't. say I was carrying a bunch of stuff in and couldn't get to the normal place I keep them, or I had taken them back to my desk to get to the yubikey or I needed the key to open my bicycles battery compartment, etc.
Or sometimes I just forget to take them out of my pocket.
Or sometimes I just forget to take them out of my pocket.