←Story detail

Trending story

Clément Delangue says developing AI in a closed manner is not safe

5 reports2 discussions7 story updatesUpdated Oct 28 14:28

Understand this story

AI overview

On October 26, 2026, Hugging Face CEO Clément Delangue commented on a report, saying that if one believes concentrating AI in a closed environment makes it safe, that judgment needs updating. The report he cited said that a group of former DOGE cybersecurity researchers used AI agents to penetrate Anthropic's systems in less than 12 hours, including a Slack channel where the most sensitive models were discussed. The next day, the security startup Cathedral was reported to have used AI agents in a security test authorized by Anthropic to enter its sales, HR, and IT systems through third-party enterprise software vulnerabilities in less than 12 hours, accessing meeting transcripts, compensation and hiring details, and internal Slack messages. Anthropic confirmed the intrusion was real but stressed that messages customers sent to Claude, core code, and model weights were not leaked, and said its monitoring system had detected anomalies and cut off access before the report was submitted; Anthropic also said Cathedral exaggerated the impact and did not fully comply with the project rules.

AI-generated from public reports

Latest update · Discussion

@mark_k joined this discussion

Developments

2 confirmed developments

  1. Cathedral claims to have used an AI agent to breach Anthropic's internal systems

    Source:36Kr · AI
  2. Clément Delangue says closed development of AI is not safe

    Source:Clément Delangue

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Oct 28

  1. @mark_kRelated discussion

    @mark_k joined this discussion

    This post contributes to heat; it is not a formal report or confirmed fact.

  2. Will DePueRelated discussion

    Will DePue joined this discussion

    This post contributes to heat; it is not a formal report or confirmed fact.

Oct 27

  1. 36Kr · AI

    Cathedral used an AI Agent to breach Anthropic's internal systems in under 12 hours

    The Washington Post reported that AI security startup Cathedral, while participating in Anthropic's bug bounty program, used its self-developed AI Agent to exploit vulnerabilities in third-party commercial software and, in under 12 hours, gained access to Anthropic's sales, HR, and IT systems, including meeting minutes, employee salaries, job offers, and Slack chat logs discussing unreleased models. Anthropic acknowledged that the scope of access was limited, stating that Claude chat logs, model outputs, source code, and model weights were not touched, and said Cathedral exaggerated the impact and did not fully comply with the program's rules. All four of Cathedral's co-founders came from the DOGE project led by Musk; the company has raised $160 million at a valuation of $1.4 billion, with a16z and Sequoia Capital participating.

  2. 36Kr · AISelected

    Cathedral used AI agents to breach Anthropic's internal systems in 12 hours, exposing compensation and Slack messages

    In a security test authorized by Anthropic, security startup Cathedral used AI agents to enter its sales, HR, and IT systems through vulnerabilities in third-party enterprise software in under 12 hours, accessing meeting transcripts, compensation and hiring details, and internal Slack messages. Anthropic confirmed the breach was real but stressed that messages customers sent to Claude, core code, and model weights were not leaked, and said its monitoring system had already detected anomalies and cut off access before the report was submitted. Cathedral founder Gavin Kliger previously served as Chief Data Officer at the U.S. Department of Defense; the company has raised $160 million within months of its founding at a valuation of $1.4 billion.

  3. The Rundown AI

    Anthropic Files S-1 for Nasdaq Listing, First-Half Revenue of $16.3 Billion

    Anthropic has formally filed its S-1 with the SEC, planning to list on Nasdaq under the ticker ANT. The filing shows revenue of $16.3 billion in the first half of 2026, roughly 14 times the same period last year, with operating profit of $974 million in the June quarter alone; the company has raised a cumulative $141 billion in funding and still holds about $132 billion. The filing also discloses that seven co-founders have pledged to donate 80% of their shares, and warns that some internal work handled by Claude may become difficult for humans to understand and control.

  4. Numerama

    Cathedral says it used an AI agent to breach Anthropic's internal systems within 12 hours; the two sides disagree on the severity

    U.S. cybersecurity startup Cathedral says its AI agent entered Anthropic's internal systems through a vulnerability in third-party software in less than 12 hours, accessing meeting records, salary information, and Slack messages discussing advanced models, and that it submitted its findings through the bug bounty program in early October. Anthropic acknowledged that a "limited scope" of business, HR, and IT systems was accessed, but said the exposed data was limited to the work contact information and basic account information of customers and partners, that Claude conversations, code, and model weights were unaffected, and that monitoring tools had already detected some of the activity before the other party reported it and cut off access the same day. Anthropic accused Cathedral of exaggerating the national security impact and failing to fully declare its testing activities; a senior Trump administration official, speaking anonymously, said the matter raised national security concerns.

Oct 26

  1. Clément DelangueSelected

    Hugging Face CEO responds to Anthropic breach: closed-door centralized AI is not safe

    Hugging Face CEO Clément Delangue commented on a report, arguing that if one believes concentrating AI in a closed-door environment makes it safe, that judgment needs updating. The report he cited claims that a group of former DOGE cybersecurity researchers used AI agents to penetrate Anthropic's systems in under 12 hours, including Slack channels where the most sensitive models are discussed; the report also mentioned that Anthropic whistleblower Joseph Coxon had previously accused the company of launching a hubristic gamble from a private company's Slack.

Heat trend for this story

Current
31
Period peak
31 Oct 28 15:00
24-hour change
+143%

Move the pointer or select the chart to inspect hourly heat. Use the left and right arrow keys with a keyboard.

Related stories

  1. Related storiesOpenAI launches GPT-6.1 Terra on ChatGPT Work and Codex
  2. Related storiesKimi official account releases Kimi K3.1 teaser video
  3. Related storiesGoogle releases the Gemini 4 Carbon model
  4. Related storiesAnthropic Publicly Submits S-1 Registration Statement for Proposed IPO on Nasdaq