These people are not scientists. LessWrong is a cult.

Rationalism is more interested in making its ideas sound correct than it is in having correct ideas. They are very convincing but they have no accreditation.

Don't trust these LessWrong people, or waste your time with their "thought experiments".

You've summarized the hazard of AI: it can seem reasonable without reasoning.

Heyyy... Maybe lesswrong already know this!