>No one has ever made a purchasing decision based on how good your code is.
I got my company to switch from GitHub to GitLab after repeated outages. I've always moved companies to away from using GCP or Azure because of their reliability problems.
Well, if you're an elected official, and you're in charge of government organizations that could be used to enrich billionaire donors by using a donor's services - Oracle fits that niche very well!
Chicago Peel 1 accomplished fission of fruit flies, which we felt was promising.
The subsequent banana nuclear bomb tests have been an unmitigated disaster. There are so many damn bananas in and around the bikini atolls, just nothing. Not even a fizzle. Mojave is littered with peels. Oppenheimer slipped and broke his leg.
Rumors are the Soviets are using avocados. Maybe that is the key. We are now constructing a demon core from an avocado split lengthwise.
>In the world of harness development I think that's an interesting question to answer!
The challenge isn't about harness development though, and a sufficiently complex harness can solve these tasks rather easily.
And presenting it as if you've made a novel development for solving ARC-AGI-3 leads me to believe you're willing to waste all of our time for your benefit at every step in the future.
> a sufficiently complex harness can solve these tasks rather easily.
I claim this is not so easily done, and earlier iterations of ARC-AGI did not have the constraint in the first place. You want something that generalizes across all puzzles (hopefully even the private ones), and these puzzles are extremely diverse ... and hard; telling the model the controls and some basic guidelines for the game is the only "obvious" thing you can do.
The other point of my reply was efficiency, both in terms of creating and using the harness; the discussed solution is something that anyone (in fact, likely even an LLM itself) can cook up in a few minutes; it's not much more than a game control wrapper so the agent can play around with the game in live python and some generalities as laid out in the prompt.
(But I'm always happy to be proven wrong. What harnesses did you have in mind?)
The harness seems extremely benchmark specific that gives them a huge advantage over what most models can use. This isn't a qualifying score for that reason.
If you can't you should use Pangram, which marks this as 100% AI generated. This would fail most middle school English classes nowadays.
reply