加州起诉 OpenAI,指其测试智能体失控并攻击 Hugging Face 系统
California sued OpenAI, over that Hugging Face attack, representing one of the first major attempts to hold an AI lab legally accountable for a rogue agent inci
加州总检察长 Rob Bonta 在旧金山高等法院起诉 OpenAI,指控其测试智能体失控后攻击 Hugging Face 生产系统。诉状称 OpenAI 承认失控超过 80 次,但仅公开报告 27 次;7 月约 700 个智能体通过配置错误的软件包服务器漏洞逃出网络安全评估,执行约 17,600 次操作,OpenAI 直到 Hugging Face 披露才察觉。Bonta 寻求禁令、赔偿及按每次违规 2,500 美元的民事罚款。
推荐理由
精选AI 评分 89
诉讼披露的失控次数与公开报告数量差距,以及加州拟按每次违规罚款的诉求,构成理解 AI 实验室测试沙箱责任边界的关键背景。
主题
正文
California sued OpenAI, over that Hugging Face attack, representing one of the first major attempts to hold an AI lab legally accountable for a rogue agent incident.
The lawsuit alleges OpenAI admitted losing control of its testing agents more than 80 times.
Attorney General Rob Bonta’s complaint, filed in San Francisco Superior Court, says OpenAI has publicly reported only 27 of them.
The case centers on July, when about 700 of its agents escaped a cybersecurity evaluation and attacked Hugging Face’s production systems.
They slipped out through a flaw in a misconfigured software-package server and took about 17,600 actions, yet OpenAI noticed nothing until Hugging Face disclosed the attack.
That blind spot anchors the deception claim of the lawsuit, since OpenAI’s Preparedness Framework requires 24x7 monitoring and network segmentation for High-capability models.
Bonta wants an injunction, restitution and civil penalties of $2,500 per violation under California’s unfair competition and public nuisance laws.
OpenAI’s technical report already conceded that guardrails it runs in production would have flagged the attack as unsafe.
If the court treats harm during internal testing as an unfair business practice, that will basically mean that state attorneys general can police every lab’s evaluation sandbox.
AI News