OpenAI invites METR and Redwood Research to conduct an embedded evaluation of its internal monitoring system
OpenAI said that this summer it invited METR and Redwood Research to conduct a three-week embedded evaluation of its internal monitoring system, and granted them deep access to its infrastructure. The evaluation helped strengthen safeguards as OpenAI scales the system, and will also shape future research collaboration with METR and other third-party evaluators. METR said that two employees from METR and Redwood Research were on-site at OpenAI's offices for three weeks, evaluating the system OpenAI uses to monitor whether internal agents exhibit misaligned behavior; a brief write-up has been made public.
Why read this
AI score 51
OpenAI publicly disclosed for the first time the internal monitoring process for third-party embedded evaluations, offering insight into how external organizations can access its infrastructure and participate in alignment reviews.
Topics
View original postTwo employees from METR and Redwood Research worked on premises at OpenAI for three weeks this summer in an embedded assessment pilot. This team evaluated the systems OpenAI was using to monitor for misalignment from internal agents. A brief write-up of their work is now public.
View original
Two employees from METR and Redwood Research worked on premises at OpenAI for three weeks this summer in an embedded assessment pilot. This team evaluated the systems OpenAI was using to monitor for misalignment from internal agents. A brief write-up of their work is now public.
Body
This summer, we invited METR and Redwood Research to pilot an embedded evaluation of our internal monitoring system, providing deep access to our infrastructure over three weeks.
Their findings helped strengthen safeguards as we expanded the system and will help shape future research collaborations with METR and other third party evaluators.