> using enough training data and compute gives you the results we see.
I think this is key. We don't have a good intuition for the truly staggering amount of data and compute that goes into this.
An example that we have come to terms with is weather forecasting: weather models have distinctly super-human capabilities when it comes to forecasting the weather. This is due to the amount of compute and data they have available, neither of which a human mind can come close to matching.
I think this is key. We don't have a good intuition for the truly staggering amount of data and compute that goes into this.
An example that we have come to terms with is weather forecasting: weather models have distinctly super-human capabilities when it comes to forecasting the weather. This is due to the amount of compute and data they have available, neither of which a human mind can come close to matching.
We have gotten used to this.