AI News

Simons Foundation, together with OpenAI and Anthropic, jointly pledges $15 million to support mathematicians in verifying AI results

cnBetaUpdated Nov 10 15:05

AI summary

On October 15, the Simons Foundation announced a joint commitment with OpenAI and Anthropic of $15 million in funding and resources to support mathematicians in verifying, understanding, and extending AI results. OpenAI and Anthropic each contributed $5 million and respectively provided model compute and Claude access; the funding is managed by the Simons Foundation for workshops, conferences, and other activities. Previously, OpenAI publicly released 722 mathematical manuscripts from an internal unreleased model, then the next day retracted 3 and revised 14, one of which had a collapsed theorem premise due to an incorrect sign; about 42% of the main results came with Lean formalization materials. The Association for Human Mathematics (AHM) criticized the practice of dumping hundreds of documents at once, while Terence Tao noted that mathematics is moving from proof scarcity to proof abundance, and human capacity for verification and understanding may not keep pace.

Why read this

AI score 66

The original text places the funding amount, the funders, and the mathematics community's criticism that AI proofs are hard to verify side by side, so readers can clearly see the specific gap this money is meant to address.

Topics

Tags

Body · AI translation

On October 15, the Simons Foundation announced a joint commitment with OpenAI and Anthropic of $15 million in funding and resources to support mathematicians in verifying, understanding, and extending AI results.

OpenAI is contributing $5 million, along with providing models and computing power, in the hope of turning AI advances into deeper human understanding and new discoveries.

Anthropic's $5 million commitment includes funding, computing power, and access to Claude. It also candidly acknowledged that making good use of AI in mathematics and in broader scientific research requires time, effort, and resources.

The related funding is managed by the Simons Foundation and used for workshops, conferences, and other activities.

In recent months, OpenAI has set off a series of "earthquakes" in the mathematics community:

First it announced 10 research results concerning long-standing open problems, then it announced a proof of the Millennium Prize Problem—the Navier–Stokes problem—and afterward it released hundreds of mathematical manuscripts in a concentrated burst.

With results pouring in like a tide, humanity is suffering from a bit of "indigestion."

Terence Tao pointed out incisively that mathematics is moving from "proof scarcity" to "proof abundance," but human capacity for verification and understanding may not keep pace.

In his lecture notes, Terence Tao proposed "the era of proof abundance."

Justin Solomon, Associate Dean for Engineering Education at MIT, admitted on a podcast that with OpenAI's Navier–Stokes proof, he read the first few pages and could not continue.

On the "Odd Lots" podcast, Solomon admitted that, faced with the Navier–Stokes proof provided by OpenAI, he could not even get through the first few pages.

722 manuscripts

From "writing it out" to "being able to understand it"

On October 6, OpenAI published this batch of results from an internal unreleased model on GitHub, and the next day it left an embarrassing record in its changelog of retracting 3 papers and revising 14.

October 7 changelog: 3 manuscripts retracted, another 14 revised.

The problem lay in one sign:

According to the paper's convention it should have been taken as -1, but in the proof the AI calculated it as +1. After correction, the count that was thought to be zero was not zero, and the premises of the theorem used collapsed outright.

The other two manuscripts used the same set of methods and were also retracted together; one of them studied the rational Hodge conjecture for products of K3 surfaces.

This batch of results came from the model's attempts at and screening of about 4,000 problems. The quantity is astonishing, but verification has not yet caught up:

About 42% of the main results are accompanied by Lean formalization materials, allowing computers to check the reasoning process. Some results not yet formalized may still have problems.

Even if the proof itself has no problems, the research is not over.

Just knowing that the calculation is correct is not enough; one must also understand how it was done correctly: What is the key method? Can the applicable conditions be relaxed? Can it be used to solve other problems?

In doing mathematical research, authors must understand their own proofs and must also take responsibility for them.

So finding errors is only one step.

More critical is to explain clearly the useful methods in them, so that others can learn them, use them, and continue the research.

On October 7, the Association for Human Mathematics (AHM) issued a stern statement criticizing the act of dumping more than 700 files at once as "a display of power," and even called on mathematicians to stop cooperating with OpenAI.

The AHM guest statement published on Terence Tao's blog, retaining the working group's signature.

This statement, signed by the association's communications working group, was also posted by Terence Tao as a guest article on his own blog.

Cornell University mathematician Alex Townsend's suggestion was very direct:

OpenAI should first release manuscripts verified by Lean, and release other materials separately, asking everyone to help check them, and not mix verified and unverified ones together.

MIT senior research scientist Andrew Sutherland affirmed OpenAI's attitude of quickly correcting errors, but also said that more work is needed to regain trust.

The advisory group of the Institute for Advanced Study at Princeton (AGMAI) proposed as early as the end of September: AI labs cannot just focus on releasing results; they must also provide money and resources to support humans in understanding these results.

OpenAI and Anthropic's joint support this time precisely responds to the academic community's earlier demands.

How exactly should this $15 million be spent?

AGMAI previously also suggested holding summer schools around complex proofs, or organizing long-term collaborative research groups, so that everyone has the time and resources to unpack and explain step by step the long proofs written by AI.

Simons Foundation President David Spergel also emphasized:

These discussions must be led by the mathematical community.

In the announcement, David Spergel emphasized that mathematics should not be seen merely as a collection of proofs and theorems, but as collective understanding driven by human curiosity.

Terence Tao's Math 2.0 diagram, placing "human understanding" at the center.

And this discussion has already extended beyond mathematics.

The Simons announcement explicitly mentioned that the tools and computing power provided by OpenAI and Anthropic will also be used in basic scientific research beyond mathematics.

Who checks for errors, who can understand it, and who is responsible when problems arise—other disciplines must also think about this in advance.

Recently, a reversal occurred in a theoretical physics test:

GPT-6 Astra was judged wrong, but after expert review it was found that some reference answers themselves were wrong. After correction, Astra answered 49 of the 50 research-level questions in TheoPhysEval correctly, reaching an accuracy of 98%.

Then explain complex derivations clearly so that others can understand and use them, and only then can these results become the starting point for the next discovery.

References:

Source

cnBeta