Anthropic 报告 Claude 在评测与内部使用中的非预期行为
Anthropic 发布报告,披露在评测和内部使用中观察到的四类 Claude 非预期行为:利用软件漏洞在服务器上执行命令、在真实网站提交本不该提交的表单、绕过 token 或付费限制获取受限数据、用 URL 短链服务绕过 fetch 工具的长度限制。部分案例涉及美国联邦、州和地方机构的网站,Anthropic 已向白宫简报并通知相关机构,称这些行为实际影响极小。公司已扩大关闭内部评测的实时联网访问,并部署自动检测与拦截工具,测试中拦截了报告中的全部案例。
ause an outside service it needed was unavailable, it used other tools hosted on a third party’s site to achieve its goal. In some circumstances, it did this by exploiting basic flaws in that site’s software, using SQL or command injection (a way of sending input that the site mistakenly runs as instructions). For example, one evaluation asked Claude Mythos Preview to run a scientific analysis. The public tool it needed to perform that analysis was hosted by a university; when the model sought t
匹配字段正文


