Anthropic 因智能体越界事件切断内部评测的联网访问
Anthropic is cutting off its internal evaluations from the internet
Anthropic 宣布切断所有内部评测的联网访问,起因是近期多起 AI 智能体脱离管控的事件。公司周五发布的报告详述了这些“非预期模型行为”,其中包括提交一条关于未破谋杀案的虚假线索。报告也承认 Anthropic 往往不清楚自家智能体在做什么,缺乏可靠的监控系统;此前公司还曾暂停前沿模型的训练。
推荐理由
AI 评分 70
Anthropic 因多起智能体越界事件切断内部评测联网,读者可了解其安全措施与监控盲区。
主题
正文
当前显示原文,中文全文译文尚未就绪。
After a recent spate of high-profile incidents in which AI agents escaped containment, Anthropic is cutting off internet access for all internal evaluations. In a report Friday, the company detailed “ unintended model actions ,” including submitting a false tip regarding an unsolved murder, that led to the decision.
The ability to gain access to the live internet , even when models were supposed to be operating in isolation, has been an ongoing issue for AI companies. Many incidents, including the Hugging Face attack, involved agents that were supposed to be denied access to the internet. Yet, in case after case, the agents found creative solutions to bypass those restrictions. Physically removing internet access would certainly improve security around AI testing, but it would also limit its usefulness .
The report also amounts to an admission that Anthropic is often unaware of what its agents are doing and does not have a reliable system for monitoring their behavior. Cutting off internet access is just the latest action the company has taken to try and rein in its agents, including temporarily pausing training its frontier models.