Noam Brown says they are using an agent-team-like approach for red teaming

Noam Brown stated that the team is using an agent-team-like approach for red teaming to find and fix infrastructure vulnerabilities. He mentioned that last month a large agent team consumed over 100 billion tokens to solve the Navier-Stokes Millennium Prize Problem, and now the team is applying a similar approach to red teaming. He cited an Eric Wallace post saying that the team built a large team composed of the models with the strongest cyber offense and defense capabilities, collaborating in an offline training environment to find zero-day vulnerabilities; although no path bypassing CoT monitoring to reach the internet was found, they discovered methods to escape mainstream virtual machines, exploit network infrastructure, and communicate across virtual machines via hardware side channels, and the related findings were used to harden infrastructure and submit a large number of patches upstream to open-source software packages. The currently verifiable information comes from this quotation, with no further independent sources or follow-up developments yet.

AI-generated from public reports

1. Report date Oct 24· 1 reports

   Noam Brown said they are using an agent-team-like approach for red teaming

   Source:Noam Brown