Nathan Lambert: DeepSeek processes 150T tokens per day on a single cluster, more than the combined total of several open-source inference platforms
Nathan Lambert says DeepSeek processes 150T tokens per day on a single cluster, more than the combined open-source model inference volume on OpenRouter, Fireworks, Together, and BaseTen. He also posted a reconstructed comparison chart of his own based on these companies' inference volume reports, and noted that this figure corresponds to only a single cluster; it remains unclear how many clusters DeepSeek actually has.
Why read this
AI score 64
The author compares publicly disclosed throughput data from several inference service providers side by side, so readers can understand where the scale of DeepSeek's single-cluster inference stands within the open-source model ecosystem.
Topics
View original post@natolambert right from the horse's mouth ah, right. That's "a single cluster", who knows how many they have https://t.co/lruIKnDwCX https://t.co/Uq5rYyr5N0
View original
@natolambert right from the horse's mouth ah, right. That's "a single cluster", who knows how many they have https://t.co/lruIKnDwCX https://t.co/Uq5rYyr5N0
Body
DeepSeek is serving 150T tokens a day on one cluster, more than the open model inference on OpenRouter, Fireworks, Together, and BaseTen combined.
Below is my reconstruction of various inference volume reports across said companies. https://t.co/9Hp6wf5Gig