←Story detail

Trending story

Meta releases technical details of the Prometheus supercluster

1 reports1 story updatesUpdated Oct 20 02:49

Understand this story

AI overview

Meta's engineering team has published technical details of the Prometheus supercluster. Located in New Albany, Ohio, the cluster currently consists of hundreds of thousands of GPUs and operates as a single machine, with plans to scale to approximately 1 million GPUs. Meta confirmed that the first phase has already used the cluster to train the Muse family of foundation models (including Muse Wonder), with Muse Wonder achieving pretraining goodput of over 85% and reinforcement learning goodput of over 90%. Meta also disclosed two platforms: Catalina, based on NVIDIA GB200 NVL72, and Clemente, based on GB300 NVL72, as well as the upcoming Vera Rubin NVL72 platform.

AI-generated from public reports

Latest development · Report

Meta Details Prometheus Supercomputer: Has Trained Muse Models, Plans to Scale to About 1 Million GPUs

Developments

1 confirmed developments

  1. Meta releases technical details of Prometheus supercluster

    Source:Unite.AI

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Oct 20

  1. Unite.AI

    Meta Details Prometheus Supercomputer: Has Trained Muse Models, Plans to Scale to About 1 Million GPUs

    Meta's engineering team has published technical details of the Prometheus supercomputer, confirming that the first phase has trained the Muse family of foundation models (including Muse Wonder) and that it plans to scale the system to about 1 million GPUs. The cluster is located in New Albany, Ohio, currently consists of hundreds of thousands of GPUs, and runs as a single machine; Muse Wonder achieved pretraining goodput above 85% and reinforcement learning above 90%. Meta also disclosed two platforms—Catalina based on NVIDIA GB200 NVL72 and Clemente based on GB300 NVL72—as well as the upcoming Vera Rubin NVL72 platform.

Related stories

  1. Related storiesMeta updates its commercial terms, removing language that could have allowed scraping of news website content
  2. Related storiesMeta releases open-weight model Muse Spark Open
  3. Related storiesAmazon launches the TorchNeuron open-source toolkit
  4. Related storiesNvidia releases Nemotron 3.5 Super VL and Bolt models