1- The mania only started post Nov 22. And the huge investments since then didn't meant substantial progress since GPT-4 launch in March 22.
2- We are running out of high quality tokens in 2024. (per Epoch AI)
GPT-4 launch was barely 1 year ago. Give the investments a few years to pay off.
I've heard multiple reports that training runs costing ~$1 billion are in the the works at the major labs, and that the results will come in the next year or so. Let's see what that brings.
As for the tokens, they will find more quality tokens. It's like oil or other raw resources. There are more sources out there if you keep searching.
1- The mania only started post Nov 22. And the huge investments since then didn't meant substantial progress since GPT-4 launch in March 22. 2- We are running out of high quality tokens in 2024. (per Epoch AI)