OpenAI’s math solutions aren’t meeting the field’s standards yet

When OpenAI released hundreds of claimed solutions to some of the world’s hardest math problems this week, the frontier lab said that it had consulted an advisory group of elite mathematicians to avoid the controversy that came with the last time one of its models solved a long-standing problem in the field. But OpenAI fell short of those standards, particularly where the mathematicians emphasized the need for human understanding of a mathematical result. That’s especially concerning after a new paper highlighted gaps between the natural language and formally expressed solution to a million-dollar problem ostensibly solved by OpenAI’s models. The Advisory Group on Mathematics and Artificial Intelligence (AGMAI), hosted by the Institute for Advanced Study, is made up of nine prominent researchers at institutions around the world.