Jefferson, Adams and Washington all warned about the dangers of central banks. Jefferson went so far as to lament prohibitions on it missing from the constitution.
Slave owners who died before they got to read Adam Smith and who had no concept of a "Free Market" are not expert economists. Think about how much insanity the world has seen since their days. We have developed institutions to mitigate that insanity.
If a nuclear war ever sets us back technologically 300 years, then I'll start to take the founding fathers ideas seriously again.
But yeah, that's "Joe Rogan" material :p