Not only that, but a bicycle is something that feels like part of your own body when you're using it. If you think too hard about the positions of everything you'll probably ride worse. A computer on the other hand is something that requires careful thought to get the most out of it.
The real bicycle for the mind is pencil and paper.
That's a good analogy. Pencil (or pen) and paper go at human speed, like a bicycle, and have no artificial constraints (glyphs available for writing, for example).
I still use notebooks for some things. You can draw in a notebook (and yes, I know you can draw on a computer, but in many ways it is more involved). The link between thought and recording is much tighter than on a computer.
It would be interesting to look at how our tools shape and limit our thinking.
The real bicycle for the mind is pencil and paper.