AI 热点

OpenAI 首次向四家独立机构开放内部 AI 系统进行现场审计

The Decoder更新于 11月19日 02:19

OpenAI opens its AI systems to four independent on-site auditors for the first time

AI 导读

OpenAI 首次允许 Apollo Research、METR、Transluce 和 Goodfire 在其办公室直接审计内部 AI 系统,调查安全风险与模型行为。各机构可按任务接触未发布模型、源代码、训练数据及监控系统,并与开发者进行保密交流。独立安全委员会将监督流程并接收未删减报告,审计机构可独立发布结果,但 OpenAI 可隐去机密材料或推迟报告以先行修复风险。

推荐理由

AI 评分 73

四家外部机构将接触未发布模型、源码与训练数据,这套现场审计安排呈现了前沿模型安全审查的具体边界与治理流程。

主题

标签

正文

OpenAI is giving four outside audit organizations direct access to its internal AI systems to investigate safety risks and model behavior on-site. The company says it's working with Apollo Research, METR, Transluce, and Goodfire, as OpenAI announced. The program builds on an earlier on-site review of its monitoring systems and fulfills commitments from the "White House Accord on Super Intelligence."

Depending on their assignment, the organizations get access at OpenAI's offices to unreleased models, source code, training data, and monitoring systems. They can also speak confidentially with developers. Apollo Research is examining whether models secretly work against their developers' intentions. METR is reviewing AI misbehavior in the largest reinforcement learning training run, a method where models learn through rewards. Goodfire is analyzing internal model processes, and Transluce is evaluating post-training safety checks. OpenAI and Transluce are also planning an eight-week follow-up review for early 2027.

An independent safety board oversees the entire process, receives unredacted reports, and mediates disputes. The auditors publish their findings independently, but OpenAI can redact confidential material and delay reports to fix risks first. The company expects some friction early on but is already considering more reviews, including ones focused on company culture and internal processes.

来源

The Decoder