Meta releases technical details of Prometheus supercluster
Meta's engineering team has published technical details of the Prometheus supercluster. Located in New Albany, Ohio, the cluster currently consists of hundreds of thousands of GPUs and operates as a single machine, with plans to scale to approximately 1 million GPUs. Meta confirmed that the first phase has already used the cluster to train the Muse family of foundation models (including Muse Wonder), with Muse Wonder achieving pretraining goodput of over 85% and reinforcement learning goodput of over 90%. Meta also disclosed two platforms: Catalina, based on NVIDIA GB200 NVL72, and Clemente, based on GB300 NVL72, as well as the upcoming Vera Rubin NVL72 platform.
Matched fieldsTitle
View story:Meta releases technical details of the Prometheus supercluster