20 余位 AI 研究者发论文警告自动化 AI 研究存在极端风险
More than 20 leading AI researchers warn that automated AI research poses extreme risks
Geoffrey Hinton、Yoshua Bengio 和 OpenAI 研究负责人 Jakub Pachocki 等 20 余位 AI 研究者在一篇新论文中警告，自我改进的 AI 可能引发智能爆炸，AI 研发自动化或许很快就会触发这一过程。论文称 AI 系统已在构建它们的公司里编写大部分代码，并可能在未来几年内自动化整个 AI 研发流程，原本需要数年的进展可能压缩到数月。作者警告社会可能跟不上，对超级智能 AI 的控制可能失控，国家、公司、政府之间的权力平衡可能被削弱，并呼吁政策制定者更清楚地了解 AI 研究正如何被自动化。
推荐理由
AI 评分 62
论文由 Geoffrey Hinton、Yoshua Bengio 等 20 余位研究者署名，提出 AI 研发自动化可能触发智能爆炸并给出政策建议。
主题
正文
当前显示原文，中文全文译文尚未就绪。
In case you didn't have enough, here's another AI warning: More than 20 AI researchers, including Geoffrey Hinton, Yoshua Bengio, and OpenAI research lead Jakub Pachocki, warn of a possible "intelligence explosion" driven by self-improving AI in a new research paper . "Although there remains much uncertainty, AI R&D automation might soon trigger one," they write.
According to the study , AI systems already write most of the code at the companies building them and could automate the entire AI R&D pipeline within years. Progress that normally takes years could then happen in months. The authors warn society might not keep up, control over superhuman AI could slip away, and power balances between nations, companies, and governments could erode. They urge policymakers to gain far more visibility into how AI research is being automated.
The paper joins a growing list of warnings. 42 leading mathematicians recently called for more attention to existential AI risks, several AI lab employees have voiced fears that AI could destroy humanity, and Pachocki himself said no lab has solved alignment well enough "to continue responsibly scaling at maximum speed for much longer." Some Anthropic employees are reportedly already scouting safe havens in case AI goes sideways .