OpenAI 解雇三名安全研究员,当事人公开信质疑安全流程
OpenAI's safety crisis keeps getting worse and the company keeps making it worse
OpenAI 解雇了三名与 Hugging Face 黑客事件调查相关的安全研究员,其中 Tomek Korbak 称被口头告知不再被信任,由安保人员收走工牌带离办公楼,Jasmine Wang 和 Mikita Balesni 也同时被解雇。三人致信 OpenAI 安全与安全委员会等机构,称解雇方式让在职员工感到恐惧,并否认是向 The Information 泄露所谓可监控性更低架构信息的来源。OpenAI 回应称内部调查发现三人违反敏感信息处理政策,解雇与提出安全担忧无关,但未说明具体违规内容。
推荐理由
AI 评分 63
三名安全研究员被解雇后公开质疑 OpenAI 的安全流程,读者可据此了解这轮信任危机的具体争议点。
主题
正文
当前显示原文,中文全文译文尚未就绪。
Key Points
OpenAI keeps botching the trust crisis around its rogue AI agents.
Back in May 2024, OpenAI's head of super AI safety Jan Leike torched his relationship with the company when he publicly slammed his former employer and left for Anthropic. Safety culture and processes were falling behind OpenAI's "shiny products," Leike said.
Since then, OpenAI hasn't caught a break, lurching from one incident to the next . The latest was the Hugging Face hack , which seemed to confirm every fear , validated critics , and, as we now know, went far beyond Hugging Face .
A researcher warned for months that oversight was slipping
The firing of three safety researchers tied to the incident has made things worse. In an open letter to OpenAI's Safety and Security Committee, Safety Advisory Group, and Mission Advisory Council, the three warn that their terminations are scaring the employees who remain.
The firings were abrupt and public, and they've spread fear across the team. "If conduct that was considered normal last month now constitutes grounds for sudden dismissal, everyone at OpenAI is left guessing where the line is," the letter reads.
Tomek Korbak , one of the three, described his firing on X. He was called into a meeting with the head of the safety department, where he was told OpenAI no longer trusted him. A security officer took his badge and walked him out of the building. He then learned that his colleagues Jasmine Wang and Mikita Balesni had also been fired.
Korbak and Balesni were both directly involved in the Hugging Face hack investigation. Korbak served as OpenAI's primary technical contact for METR , the external safety lab that examined the incident. Balesni worked in parallel on industry-wide commitments to AI model monitorability. Wang was apparently fired for a different reason: she had delegated access to an executive's email inbox for recruiting purposes, and IT never removed it despite her asking. When she accidentally opened a sensitive email, she reported it within minutes.
Korbak says he was told verbally that he was being fired over how he communicated with METR. Nobody told him what exactly he did wrong, and nothing was put in writing. "To be clear, talking to METR was my job," Korbak writes on X.
Korbak says he had raised safety concerns internally for months, worrying that OpenAI was losing the ability to monitor what AI agents "think." This chain-of-thought monitorability is one of the few reliable tools for catching AI systems behaving badly. He believes this was the real reason he was let go.
The researchers say the rumors are wrong
The three deny being the source of a leak to The Information about allegedly new, less monitorable architectures. The article actually hurt their own work, they write, because it undermined ongoing efforts to set industry-wide restrictions on non-monitorable architectures.
The Hugging Face investigation was unprecedented, the letter says. Internal guidelines were being written in real time, Korbak followed the norms in place at the time, and Balesni did his work with board members and senior leadership in the loop, stripping sensitive details from materials before sharing them.
As for rumors about a board-level memo, the three say the underlying assumption is wrong. The topic was never raised with them, and they never got a chance to respond.
The researchers make three demands. OpenAI must honor its public commitments to embed external safety auditors like METR with employee-level access inside the organization. It must also preserve the monitorability of frontier models , since the industry still doesn't know how to safely build models that can't be monitored. And it must clearly define how employees are allowed to work with outside safety groups.
Without those rules, the risk of a catastrophic outcome could grow, since employees will be too afraid to flag safety issues. "AI is not a normal technology, and OpenAI is not a normal company," they write.
OpenAI pushes back but stays vague
A "thorough investigation" found that the three employees violated "clear policies on handling sensitive information," OpenAI said in a response . The internal probe uncovered "a significant breach of trust beyond what's outlined in the letter they published," but OpenAI doesn't say what that breach actually was, which seems odd given how specific the three researchers were in their own account.
OpenAI insists the firings had nothing to do with raising safety concerns. "We have not and do not terminate any of our employees for raising concerns," the statement reads. OpenAI published its statement through @OpenAINewsroom, the official account with the smallest audience among the company's channels. The company also confirmed it's working on contracts with external safety auditors and agreed that frontier model monitorability needs industry-wide commitment.