First, you're moving the goalposts. Second, it's not actually true that any existing frontier AI can write a chess bot program that can beat a 1600 player ... not unless the program is derived from Stockfish or some other leading engine that has been in development for decades.
> The system is built and delivered as it is because that's how the providers make the most money. If they cared to have it perform well in chess games, you'd see a different shape and behavior.
These comments indicate a complete failure to understand the technology.
Using juliac without --trim=safe took over 1 minute to compile a hello world program, and took the same for a second compilation with no source change. Without --trim you can't use dynamic types, which rules out even println without explicitly giving it a Core.stdout argument. I'll come back in a year or so to see if it's become usable.
> OpenAI, meanwhile, says its experience with Navier-Stokes could open the door to solving puzzles with more practical relevance. “We are now able to spend millions of dollars on a problem that we really care about and that really matters: developing new materials, finding cures to diseases,” Bubeck said. “All of those things that we have been talking about for a long time—now they seem to be at our fingertips.”
Eh? There's no connection at all between the Navier-Stokes work and those things.
He may be hinting that solving these complex mathematical problems will boost OpenAI clients' confidence and encourage them to spend millions of dollars on solving other complex problems.
I would think it would have the exact opposite effect.
Why would anyone use OpenAI models for anything commercially valuable, or where secrecy is important, when it appears that if OpenAI "becomes aware" that you are doing so they may try to compete with you?
Not only did OpenAI, by their own admission, rush to re-solve Navier-Stokes once they heard the rumor that it has been solved (the rumor being that it was Anthropic that had done it), but they are leaving the door open ("we cannot rule out that") as to whether the model they used to do it had been trained on the anonymized date from the researchers who's approach they ended up copying.
Terrance Tao has recently said as much for mathematics - that there appears to be a trend (not just this Navier-Stokes incident) of the AI companies going after math problems wherever there is an "rumor" of progress, and that he thinks this may sadly result in breakthrough mathematics being conducted in secret to avoid this.
The rush to steal another researcher's thunder is bad enough, but it also appears that one of OpenAI's employees acted in a very thuggish manner to try to threaten the professor who had been working on this not to publish and to co-operate with their telling of the story.
>but they are leaving the door open ("we cannot rule out that") as to whether the model they used to do it had been trained on the anonymized date from the researchers who's approach they ended up copying.
This is just lawyer speak. Maybe there was a small reward from a possible thumbs up on any of the chat sessions. Open AI have no way of knowing if that happened or not and the chances that, if this did happen, that it had anything to do with their solution of Navier Stokes is extremely unlikely.
>to try to threaten the professor who had been working on this not to publish and to co-operate with their telling of the story.
There was never a threat to not publish their own work with whatever credit to whoever. This was about the offer to be a lead author on the paper that Open AI authored, an invitation that was not extended to Levant.
Yes they know the timelines, which they've explained. No they don't know exactly what they train on. Even I don't, and my little experiments are nowhere near OpenAI scale. This is par the course for ML. Plus it would kind of defeat the purpose of de-anonimization if they could.
reply