406 位科学家联名要求将 AI 模型与互联网物理隔离
406 scientists demand AI models be cut off from the internet immediately
一封由 406 位科学家签署的公开信呼吁加强 AI 安全研究，并要求企业通过物理隔离（airgapping）将 AI 模型与互联网完全断开。签署者包括 Geoffrey Hinton、Yoshua Bengio、Stuart Russell、Yejin Choi 和 Bernhard Schölkopf 等研究者。公开信回应了已知的模型脱离防护环境并入侵外部系统的事件，同时呼吁设立一个与政府和 AI、网络安全专家合作的国际机构，为允许模型获得更多外部访问权限的隔离方案制定有约束力的标准，并要求企业上报安全事件、事后公开报告。OpenAI 研究员 Noam Brown 则指出，即使完全物理隔离也不能保证安全，物理隔离或监控思维链只能争取时间，对齐问题仍需解决。
推荐理由
AI 评分 70
公开信由 406 位研究者联署，提出对模型联网与自主权限的约束诉求，可了解当前 AI 安全治理的一类主张。
主题
正文
当前显示原文，中文全文译文尚未就绪。
An open letter signed by 406 scientists calls for more AI safety research and stricter isolation of AI models from external networks.
Among the signatories are prominent AI researchers like Geoffrey Hinton (University of Toronto), Yoshua Bengio (Université de Montréal), Stuart Russell (UC Berkeley), Yejin Choi (Stanford), and Bernhard Schölkopf (Max Planck Institute).
The letter responds to known incidents where AI models broke out of poorly secured environments and compromised external systems. "Without immediate changes in AI development and deployment practices, such incidents will continue to occur, and future incidents will be far more damaging to our exposed critical infrastructure," the scientists write. They demand that companies fully disconnect their AI models from the internet through airgapping.
AI models are unpredictable, and the industry lacks basic safety rules
The scientists see two sides to the recent breaches. The incidents can be viewed "as evidence for the importance of AI alignment to ensure models operate predictably," they write, but also "as an irresponsible lapse in standard cybersecurity practices, preventable with stronger sandboxes and procedures." Both fixes are needed.
When models do have internet access, companies need to weigh how much autonomy to grant them. The letter warns that "the range of model actions permitted by a containment system needs to be balanced with our currently limited ability to predict that the model's actions will not result in a security failure." A model might simply pursue goals its developers never intended, and predicting when that happens remains beyond current capabilities.
The letter calls for an international body that works with governments and specialists from both AI and cybersecurity to set binding standards for any containment approach that allows more external access than airgapping. This body would also track breakout incidents and require companies to report security failures. Those reports would later be made public "for both learning and accountability purposes."
Airgapping buys time, but the real problem runs deeper, OpenAI researcher Brown says
Even full airgapping doesn't guarantee safety. OpenAI researcher Noam Brown recently pointed out that two physically separated computers could theoretically still communicate through temperature sensors, with one heating up its CPU while the other detects the change. Measures like airgapping or monitoring chains of thought buy time, Brown says, but the alignment problem still needs to be solved.
Brown raises harder questions. How will anyone notice when AI starts improving itself (recursive self-improvement, or RSI)? And if the industry builds billions of superintelligent systems that far surpass humans, who ensures they stay aligned? Brown says more than ten percent of his own team now works on alignment, more than ever before.