I think more precisely, the traditional definition of an orbit (stable or not) is that it's influenced by gravity. You could be in a situation where the influence of gravity was negligible (say, far beyond any galaxy) but it wouldn't be considered an orbit at that point.

I guess certain multi-body situations like Lagrange points might make it debatable about which "direction" you're falling though.