This is an excellent explanation of the flaws inherent in the rationalist philosophy. I’m not deeply involved in the community but it seems like there’s very little appreciation of the limits of first principles based reasoning. To put it simply, there are ideas and phenomena that are strictly inaccessible to pure logical deduction. This also infects their thoughts about AI doom. There’s very little mention of how the AI will collect data or marshall physical resources. Instead it just reads physics textbooks then infers an infallible plan to amass infinite power. It’s worth noting that the AGI god’s abilities seem to align pretty well with Yudkowsky’s conception of why he is a superior person.