←新闻详情

Rohan Paul更新于 10月25日 20:59

Google DeepMind 等机构论文:最佳 AI 智能体解出 50 道未公开研究级物理题中的 49 道

New paper from Google Deep Mind, and many top Universities finds the best AI agent tested solved 49 of 50 unpublished research-level theoretical physics problem

AI 导读

Google DeepMind 与多所顶尖高校的新论文显示,测试中表现最好的 AI 智能体解出了 50 道未公开研究级理论物理题中的 49 道,每题约相当于领域专家一天的工作量,单题成本低于 3 美元。这些题目由专家从自身研究中提供,智能体独立作答,分联网与不联网两组,仅按最终数值答案评分。GPT-6-Astra 在 Codex 中联网解出 49 道,它与 Opus 5.5 在 Claude Code 中不联网各解出 46 道,去掉联网后准确率变化很小,作者据此认为模型可能已记住大量物理文献。

推荐理由

AI 评分 74

论文用专家未公开的50道研究级物理题测试智能体,并给出单题成本与联网与否的对比。

主题

标签

正文

New paper from Google Deep Mind, and many top Universities finds the best AI agent tested solved 49 of 50 unpublished research-level theoretical physics problems, each roughly a day's work for a world expert.

at under $3 each.

Benchmarks for AI in physics often use textbook or contest problems, or block the tools real researchers use. So it was unclear how agents handle the calculations that fill daily research.

Experts contributed 50 unpublished problems from their own research, each about a day's work for a specialist. Agents worked alone, with and without web search, and were graded only on final numerical answers.

GPT-6-Astra in Codex solved 49 of 50 with web search, and both it and Opus 5.5 in Claude Code solved 46 of 50 without it. Accuracy barely changed without search, which suggests the models have memorized much of the physics literature.

来源

Rohan Paul