Yes. Without constant money and electricity flowing into it, you wouldn't even need to unplug it, it would stop on its own.

Again, that problem solves itself when he realizes he can’t make more money with this and no one wants to keep giving him money to try.

Unless he gets to the point where the materials are mined by robots, the chips and solar panels are made in automated factories and the servers/solar farms are maintained by robots. Then he doesn't need other people's money.