Models are trained on human data and they make exactly the same mistakes - and a lot of mistakes humans don't usually make.

Also they are extremely bad at high-level design.