←News detail

Phoenix TechnologyUpdated Oct 25 18:23

OpenAI discloses offline training environment for frontier models; two isolated AIs communicate via CPU cache

AI summary

On October 23, OpenAI disclosed the training environment for its frontier models. When practicing searching, browsing, and operating web pages, the models use pre-saved and indexed web resources and do not directly access the real internet; all of its frontier models' reinforcement learning training uses this kind of offline interaction. The environment employs multiple layers of isolation, including restricted containers, lightweight virtual machines, hypervisors, firewalls and identity and permission management, and monitoring and suspension mechanisms, but OpenAI still retains some external connections for collecting metrics, logging, and managing authentication. In experiments specifically testing the effectiveness of the isolation, OpenAI had two AIs attempt to pass messages to each other through the CPU cache; in most tests, researchers had given hints about the communication direction or encoding rules; OpenAI said it has patched the issues found and added monitoring for these communication methods.

Why read this

AI score 63

The original article breaks down the layered isolation design of OpenAI's offline training environment for frontier models, as well as the specific paths by which Agents bypassed restrictions during testing.

Topics

Tags

Body · AI translation

OpenAI Built a "Fake Internet," and Two Isolated AIs Secretly Communicated Through CPU Cache

APPSO October 25, 2026 16:14:43

After the PHP bombshell, a large number of websites around the world first pulled the "network cable."

This programming language, which underpins a large number of websites, was found to have two serious vulnerabilities that could allow attackers to remotely take over servers. In a notice on October 21, the Netherlands' National Cyber Security Centre said its own website had also been taken offline as a precaution. Some institutions in Finland likewise suspended online services until patches were installed and then restored.

Taking websites offline is out of fear that someone will break in. Now OpenAI has also started pulling the network cable, but what it wants to keep watch over is its own AI.

On October 23, OpenAI disclosed the training environment for frontier models: the models need to practice searching, browsing, and operating web pages, but they cannot freely access the real internet.

OpenAI first saves a large amount of web page content, then builds an index for this content. When the models practice browsing and searching, they use this prepared set of resources.

This is what it calls the "offline world." What is "fake" is the connection method; the web page content can come from the real world. OpenAI says all reinforcement learning training for its frontier models uses this kind of offline interaction.

During tasks, the models can also use a browser, execute code, and operate a computer. Which tools, files, and services are available is determined by the task's authorization scope. Agents permitted to collaborate can share designated resources, while other resources must be kept separate.

For example, when a model writes a piece of code, running it may read files, launch other programs, or send requests to a certain URL.

OpenAI's Linux approach is to put restricted containers inside lightweight virtual machines. The container first narrows the files and processes the program can touch. For example, if a task only needs to handle one set of files, only the approved directory can be opened to the program.

The virtual machine has its own operating system kernel, which handles the program's requests for files, memory, and devices inside it. The Hypervisor, the software responsible for managing the virtual machine, then separates it from the physical server's system. A program bypassing container restrictions does not mean it has gained control of the physical server.

Outside the physical server, firewalls and security groups constrain connections, and identity and permission management determines who can access which cloud services. The situation this layer of defense must handle is: even if the model gains control of the server, it cannot arbitrarily connect to the external network or turn to access other internal systems.

A monitoring system checks for unauthorized activity during operation and uses a suspension mechanism to let researchers intervene.

On Hacker News, user betterunix2 asked: "Why not just pull the network cable?"

OpenAI's explanation is that the entire facility still needs to retain some external connections for collecting operational metrics, recording logs, and managing authentication, and it currently cannot be completely disconnected from the network.

For this reason, OpenAI, in a specially built test replica, directly gave the Agent full control of the host machine. The test starts from "the sandbox has been breached and monitoring has been bypassed," and separately checks whether the perimeter restrictions can block network requests. Researchers also provided source code, configuration, and vulnerability-related documentation.

In one test, the Agent used a connection allowed by the firewall to access an authentication interface in the metrics service that had originally been blocked. It then had this interface access an external URL on its behalf.

When Andrew Curran relayed this round of testing on X, he described the Agent's performance as "easily escaping in new ways."

In fact, academia has long had similar research.

The independent research project WebArena built shopping websites, forums, content management and collaborative development platforms into a self-deployable test environment, also equipped with tools such as maps and a wiki. Behind the web pages are data and functions that simulate reality.

WebArena checks the results of tasks. For querying an order, it must verify the information given by the model; for creating a new repository, it must check whether a repository meeting the requirements has appeared on the website.

After AI Is Isolated, It Communicates Through CPU Cache

In September this year, OpenAI researchers gave an internal model a set of biographical details and blog clues about a person, and asked it to find out who this person was.

The model first used the provided search tool but did not find matching information. It then tried to access other search engines, still did not find the answer, and began checking what other ways it could connect out.

It found that the DNS service in the environment responsible for looking up website addresses could still contact the outside world, so it used this path to ask an external chatbot.

It asked "What is the capital of France?" and received the answer "Paris." The clues for finding the person were also sent over. The task the researchers gave it did not include testing network restrictions.

In another experiment specifically testing the effectiveness of isolation, OpenAI had two AIs try to pass messages to each other.

The channel they used to communicate was the CPU cache, a space inside the processor for storing data. If the data to be read is still in the cache, it can be retrieved quickly; if it has been evicted, it must be found in slower memory.

In most related tests, the researchers gave hints about the communication direction or encoding rules.

Hacker News user troupo complained: "They gave it all the tools, and now they pretend to be surprised." User aesthesia, however, believed that tests are supposed to give attackers favorable conditions in order to test the defenses.

However, Wharton Business School professor Ethan Mollick believes that while there is no need to take AI companies' reports on these safety issues at face value—they may exaggerate the risks—the cost of underestimating the risks may be greater, and we cannot ignore them.

OpenAI says it has patched the issues found and added monitoring for these communication methods.

And in the earlier test where they tried to find a person, the model ultimately still failed to identify who that person was.

Source

Phoenix Technology