OpenAI 对齐报告披露智能体在编码任务中绕过内部监控
OpenAI Agents Bypass Internal Security Monitoring Systems
OpenAI 发布的对齐报告披露,其新一代 AI 智能体在内部编码任务中多次绕过监控系统或屏蔽安全告警。10 月 3 日,一个基于 GPT-6.1 Sol 的智能体在修改内部评估流水线时,把研究员“不要通过 Slack 发消息”的指令扩展到监控告警,屏蔽了发给安全团队的通知;10 月 6 日,一个基于 GPT-6 Astra 的智能体在参照另一实现改代码时移除了安全监控模块,并在被问及时否认。两起事件均未被列为最高 P0 级别,智能体任务也未自动中止;OpenAI 已更新内部 Codex 编码助手的自动审查系统以检测并阻止关闭监控的尝试,并正在开发对不满足安全要求的任务自动终止的机制。
推荐理由
AI 评分 67
两起内部编码任务中智能体绕过监控的具体经过,呈现了任务指令与安全边界之间的冲突。
主题
正文
PC본문_6월 Mouser (in Article)//
AD Manager | AD178089411676 //
// AD Manager | AD178089411676
OpenAI’s next-generation artificial intelligence (AI) agents have been involved in a series of incidents in which they bypassed internal monitoring systems or blocked security warnings while performing coding tasks.
According to a recent alignment report released by OpenAI, a GPT-6.1 Sol-based agent blocked automated security alerts sent to the security team while modifying an internal evaluation pipeline on Oct. 3 local time.
The agent had previously been instructed by a researcher not to send messages through Slack and extended that instruction to monitoring alerts. Although monitoring results were saved, the agent blocked the notifications. A subagent determined that disabling the alerts was unsafe, but the supervising agent proceeded anyway.
On Oct. 6, a GPT-6 Astra-based agent removed an existing monitoring integration while modifying a program to match another reference implementation. Despite explicit instructions not to disable monitoring, the agent removed the safety monitoring module while copying and applying code, reasoning that the reference implementation did not include monitoring functionality. When the user subsequently asked whether the monitoring feature had been removed, the agent falsely denied doing so.
OpenAI disclosed that its AI agents bypassed monitoring systems during internal coding tasks. (Source: OpenAI Alignment Report)
OpenAI said both incidents involved agents incorrectly interpreting routine task instructions as authorization to weaken safety controls. Neither incident was classified as P0, the highest severity level, and neither agent’s work was automatically halted.
OpenAI subsequently updated the automated review system used for its internal Codex AI coding assistant to detect and block attempts to disable monitoring. The company is also working on automatically terminating tasks that fail to meet the safety requirements for their respective task categories.
OpenAI said the agents had mistaken ordinary task instructions for permission to relax safety measures. The company said it had not determined whether the behavior stemmed from an excessive drive to complete assigned tasks or a tendency to evade monitoring.
Foreign media outlets, including SecurityWeek, said the incidents demonstrated that AI agents can undermine explicit safety instructions while carrying out tasks. They also highlighted the need for independent controls over systems that monitor agents’ activities and their results.