Heck, sometimes it can be fun to get a little lost. "Oh, _that's_ where $FOO is!", as you accidentally go by it. Or "That looks like a cool $BAR, I'll have to come back and check it out"
This is definitely part of the fun. I sometimes take new routes to places I’ve visited before without particularly checking beforehand if road XYZ actually connects to the intended destination (it’s enough if it leads to it’s general direction) - once in a while you end up in a cul-de-sac, but mostly you end up with your described situation