I agree there is emergent behavior and this is impressive (I'm similarly impressed how well GPT4 can generate SQL statements).
That said, even playing Othello is still an example of next-token prediction via pattern recognition. Yah, it might be quasi-building a model of sorts, but that's of course just what non-linear predictors do.
Don't get me wrong -- we are also very powerful pattern recognizers.
That said, even playing Othello is still an example of next-token prediction via pattern recognition. Yah, it might be quasi-building a model of sorts, but that's of course just what non-linear predictors do.
Don't get me wrong -- we are also very powerful pattern recognizers.