> Much harder to pull local privilege escalation exploits.

That's not certain. sshd is way bigger than sudo, so chances of it having an exploitable bug seem higher.