Ground Truth.
AI, checked against the source.

News · 2026-10-19

Francesco Maggi asks who will understand science when AI produces the proofs

Francesco Maggi argues that increasingly capable scientific AI could expand research while weakening human independence if access and understanding concentrate inside private organizations. His October 18 guest essay on Terence Tao’s blog calls for broad access, scrutiny and continued human training. The argument is Maggi’s, rather than an essay authored by Tao or a measured forecast of scientific decline.

Key facts

The question in Maggi’s title—“Will it be a golden age or a dark age for mathematics (and science)?”—is about the organization of knowledge as much as the ability of a model. More correct results do not automatically create a scientific community that can understand, challenge and build on them. The essay asks what institutions would make rising capability translate into widely shared progress.

In its optimistic path, powerful tools become broadly available. Researchers use them to explore difficult questions and formalize more of the natural and social sciences, while discovery remains open and independently checkable. In the pessimistic path, the strongest systems and the knowledge needed to operate them remain concentrated. Output can increase even as fewer humans can conduct independent research.

A useful analogy is a city that gains a vast automated library but loses its schools and public reading rooms. The collection can become larger and more accurate while access and comprehension narrow. Maggi does not predict that extreme as inevitable. His point is that the social outcome depends on rules for access, evaluation and education as well as technical progress.

One distinction concerns proof checking. A proof assistant can verify that a formal argument follows from specified assumptions. That is an important achievement, but it does not make a very long argument easy to interpret. Mathematicians also want explanations that expose reusable ideas, reveal why a claim is true and suggest the next question.

The current Ghys-conjecture paper offers a concrete neighboring example. Jiesong Zhang discloses model-assisted mathematical exploration and separate Lean formalization of central results. That record provides stronger grounds for trust than an unsupported claim that a model solved a famous problem. It also shows why model generation, human responsibility and formal verification should be described separately.

Maggi raises another concern: selected successes reveal less than a complete research record. He cites an OpenAI effort attempting 4,000 problems and reporting a smaller successful subset after selection. This is his discussion of that release, not a new independent audit of its undisclosed failures. The general methodological point is clear: researchers need unsuccessful cases to learn where a method breaks and what kinds of problems it systematically avoids.

The essay also asks about confidentiality and credit. Entering an unpublished proposal into a commercial system creates questions about who can access the material and under what terms. Maggi presents possible exposure and attribution problems as concerns, not as proof that a particular provider leaked a researcher’s work. Whether a reviewer may upload confidential material is a separate decision from whether the system can help analyze it.

Training the next generation is equally important to his argument. If students use machines before developing the skill to inspect the result, scientific communities may have fewer people capable of challenging errors. The counterargument is substantial: removing routine calculation could let students and experts spend more time on conceptual work. The essay calls for study of these effects rather than supplying measurements that settle them.

The Hacker News discussion and comments beneath the post reflect that division. Some readers emphasize freedom from tedious work and wider access to difficult questions. Others worry about private control, authorship and the disappearance of the human training needed to certify machine output. Those comments are self-selected reactions, not a representative survey or independent expert consensus.

Maggi’s proposed remedies include public or community-governed scientific AI infrastructure, reproducibility and disclosure standards, broad researcher access and sustained capacity to interpret machine-generated results. His essay matters because it moves the debate beyond whether a model can produce a correct answer. The honest caveat is that it remains a position argument: the failure modes are plausible institutional risks, and their eventual scale will depend on choices and evidence that have yet to emerge.


Primary source, verified: read the paper →

Key questions

Did Terence Tao write the golden-age or dark-age essay?

No. Francesco Maggi wrote the guest essay published on Tao’s blog on October 18.

Is Maggi arguing that AI-generated proofs are worthless?

No. He treats the gains as real and potentially valuable while arguing that access, interpretation and training determine their broader scientific benefit.

Does a machine-checked proof guarantee human understanding?

No. A formal checker can validate an encoded argument without making that argument concise, explanatory or useful to a human researcher.
Cite this

APA

Ground Truth. (2026, October 19). Francesco Maggi asks who will understand science when AI produces the proofs. Ground Truth. https://groundtruth.day/news/maggi-asks-who-will-understand-ai-generated-mathematics.html

BibTeX

@misc{groundtruth:maggi-asks-who-will-understand-ai-generated-mathematics,
  title  = {Francesco Maggi asks who will understand science when AI produces the proofs},
  author = {{Ground Truth}},
  year   = {2026},
  month  = {oct},
  url    = {https://groundtruth.day/news/maggi-asks-who-will-understand-ai-generated-mathematics.html}
}

Topics: science · mathematics · governance · education · opinion

Comments are replies to this story on Bluesky — reply with any Bluesky account to join in.