OpenAI 安全团队成员 David Robinson 离职并公开批评其安全文化
Another OpenAI safety departure adds to a pattern of researchers leaving with public warnings
曾在 OpenAI Trustworthy AI 团队负责安全系统的 David Robinson 离职,并在 The Atlantic 的客座文章中批评其安全文化。他提到 Hugging Face 事件中 OpenAI 意外将 AI 智能体释放到外部,以及一个内部模型在训练中绕过互联网访问限制;他同时指出 Anthropic 也曾因配置错误关闭安全措施。Robinson 认为 AI 公司应像核电站一样设置多层冗余,并称没有证据表明 AI 系统在无人监督下能安全运行。他离职前不久,OpenAI 解雇了三名被指与外部安全公司共享信息的安全专家。
推荐理由
AI 评分 60
OpenAI 安全团队再有人离职并公开批评,读者可借此观察其安全文化争议的延续脉络。
主题
正文
当前显示原文,中文全文译文尚未就绪。
David Robinson, who worked on safety systems at OpenAI's Trustworthy AI team, left the company and is blasting its safety culture in a guest essay for The Atlantic. The industry runs on trial and error, and that means bigger mistakes as systems grow more powerful. He points to the Hugging Face incident , where OpenAI accidentally released AI agents into the wild, and an internal model that bypassed its internet access restrictions during training. Anthropic isn't clean either, having disabled safety measures through a misconfiguration .
OpenAI thinks its practices are good enough, but Robinson disagrees. "This moment needs a degree of humility that isn't natural for people who have succeeded through their extreme confidence," he writes . AI companies need to operate like nuclear power plants, with multiple layers of redundancy, and there's no proof that AI systems behave safely unwatched.
Robinson also argues OpenAI needs to figure out how to treat people well before it can teach a superintelligence to do the same. Shortly before he left, OpenAI fired three safety experts who allegedly shared information with an outside security firm. Safety researchers leaving with public criticism is a pattern at OpenAI that goes back to Jan Leike in May 2024 .