OpenAI o3 beats FrontierMath — because OpenAI funded the test and had access to the questions
OpenAI o3 beats FrontierMath — because OpenAI funded the test and had access to the questions
OpenAI released its o3 model in December, bragging about the model’s unparalleled ability to do math and science problems. The model’s success on the FrontierMath benchmark — 87.5%, beating t…
You're viewing a single thread.
Tamay Besiroglu from Epoch AI says they were “restricted from disclosing the partnership” until the o3 launch. Their contract “specifically prevented us from disclosing information about the funding source and the fact that OpenAI has data access to much but not all of the dataset.”
If you had no problems with that contract, then I don't trust your ethical judgment as a scientist.
absolutely; there’s no reason to hide the funding source and OpenAI’s access unless you’re grifting. I feel bad for the mathematicians working on FrontierMath who didn’t know though. imagine wasting valuable time on something like this then finding out it was all just a marketing stunt devised by grifters.