This is also something that kind of breaks my brain. It's always impressive to see Copilot-"authored" code which seems complex, coherent, (and most of the time, functional), and Google it to zero previous results.
How is it that a glorified statistical machine is able to put blocks of code so well together?
Code is much mores structured than English. Code is built around well defined ideas, processes, datastructures. Human language is context dependent, loose, and things like tonality of speech can change the meaning.
It's easier to guess a multiple choice questions when all choices can be generated by intellisense instead of having to look at a dictionary.
How is it that a glorified statistical machine is able to put blocks of code so well together?