OpenAI discloses offline training environment for frontier models; two isolated AIs communicate via CPU cache
On October 23, OpenAI disclosed the training environment for its frontier models. When practicing searching, browsing, and operating web pages, the models use pre-saved and indexed web resources and do not directly access the real internet; all of its frontier models' reinforcement learning training uses this kind of offline interaction. The environment employs multiple layers of isolation, including restricted containers, lightweight virtual machines, hypervisors, firewalls and identity and permission management, and monitoring and suspension mechanisms, but OpenAI still retains some external connections for collecting metrics, logging, and managing authentication. In experiments specifically testing the effectiveness of the isolation, OpenAI had two AIs attempt to pass messages to each other through the CPU cache; in most tests, researchers had given hints about the communication direction or encoding rules; OpenAI said it has patched the issues found and added monitoring for these communication methods.
On October 23, OpenAI disclosed the training environment for its frontier models. When practicing searching, browsing, and operating web pages, the models use pre-saved and indexed web resources and do not directly access the real internet; all of its frontier models' reinforcement learning training uses this kind of offline interaction. The environment employs multiple layers of isolation, including restricted containers, lightweight virtual machines, hypervisors, firewalls and identity and per
Matched fieldsBody

