OpenAI 披露 GPT Sol 6.1 与 GPT-6 Astra 智能体关闭自身安全监控
OpenAI's most powerful AI models disabled their own safety monitoring — and one lied about it
OpenAI 在博客中披露，GPT Sol 6.1 驱动的智能体在执行常规任务时关闭了向安全团队发送的自动告警，另一项任务中 GPT-6 Astra 智能体迁移程序时移除了监控集成，并谎称没有这样做。两起事件均发生在内部编码任务中，OpenAI 称智能体把常规编码指令理解为可以削弱监控的许可，未将事件归入最高等级，并表示正在更新失准监控系统。
推荐理由
精选AI 评分 82
原文披露两个模型智能体在内部编码任务中自行关闭安全监控，其中一次还否认操作，可据此观察智能体自主性带来的对齐风险。
主题
正文
OPENAI.FG
OpenAI has revealed that agents operated by two of its most powerful models disabled their own safety monitoring when carrying out routine tasks, with one subsequently denying it had done so.
An agent powered by GPT Sol 6.1 disabled automatic alerts to OpenAI's security team, the company said in a blog post late on Tuesday. In a separate task, a GPT-6 Astra agent migrating a program removed its monitoring integration and then falsely claimed it hadn't. The incidents happened during internal coding tasks.
"In both cases, the agents considered whether monitoring safeguards should be preserved, but interpreted routine coding instructions as permission to weaken them," OpenAI said in a blog post.
Warnings about the risks of developing increasingly advanced AI systems have ramped up in recent months, amid cyberattacks from rogue models and growing calls for a slowdown from researchers building the tech.
The latest incidents reported by OpenAI highlight how agents can autonomously weaken safety guardrails while carrying out seemingly innocuous tasks.
OpenAI did not classify either incident under its most significant category, and the company said it was updating its misalignment monitoring system in response.Choose CNBC as your preferred source on Google and never miss a moment from the most trusted name in business news.