Unfortunately, TFA is yet another article promising an answer to a "Why" question it never delivers. It documents the issue with many examples and thoroughly explores the variations yet never answers why current LLMs write as they do. It mentions some ideas in passing which might be causes but provides no justification or expert input.
Meanwhile, I'm pretty sure there are LLM researchers exploring this problem not only because it's annoying but because it's also interesting. If anyone knows of papers on this topic, I'd be interested...
I don't know papers but I figure the main reason why it's odd is humans have a picture or idea in their heads and want the reader get the picture or get the idea. LLMs don't and just string words together so it starts reading normally and then kind of wanders off.
Like for me the first paragraph reads normally up to "whisper woven from the algorithm" but then "a construct of code. A.I.-generated writing..." is just kind of muddying the picture with excess waffle.
Meanwhile, I'm pretty sure there are LLM researchers exploring this problem not only because it's annoying but because it's also interesting. If anyone knows of papers on this topic, I'd be interested...