OpenAI 安全人员谈模型能力突跳带来的安全挑战
A quote from @joedaroo
OpenAI 负责 Agent Security 的 @joedaroo 表示,模型在“cyber”“swarming”“message boards”等相关能力上的跃升之快令人意外,安全姿态需要时间建立,不只是加固系统,还要融入公司文化、让人员随之改变。他因此呼吁各组织自问:面对 AI 能力的突然跃升,自己的人员、系统和流程是否具备韧性,是否有正确的应急响应、沟通机制和待命人员。
推荐理由
AI 评分 58
OpenAI 安全人员复盘模型能力突跳带来的安全压力,提醒各组织检查自身应对突发能力跃升的韧性。
主题
正文
当前显示原文,中文全文译文尚未就绪。
28th September 2026
To say that we were surprised at the jump and suddenness of the capabilities of our models when it came to “cyber” or “swarming” or “message boards” or anything else related to the incidents is an understatement. Security posture takes time to develop. It’s not just about hardening the systems at play; you have to ingrain it in the culture of the company. The literal people themselves in your organization have to change and evolve with it. These jumps in capabilities were so fast and so sudden that they created an extremely difficult problem. [...]
So today my hope is that everyone around the world can look at their own organization and say: how can I deal with a surprise or a sudden jump in AI capability? Are my people, my systems, or my processes resilient to surprises? Do my teams know what to do when something goes wrong? Do I have the right incident response? The right comms and messaging? Do I have the right people ready to go when capabilities jump?
— @joedaroo , Agent Security at OpenAI, identity confirmed by The Information's Rocket Drew
This is a quotation collected by Simon Willison, posted on 28th September 2026 .