马斯克：算力上线瓶颈不止缺电

前$GOOGL员工谈为何数据中心容量和电力才是真正的瓶颈，而非GPU生产本身，以及部分新兴云厂商有多不可靠（$AMZN、$GOOGL、$MSFT、$NVDA）： 1. 据这位专家称，开源模型缩小与前沿模型差距的速度快于预期，从今年第二季度开始，客户在多智能体架构中越来越多地用开源替代方案取代Anthropic和OpenAI的模型。这一转变始于工具调用和MCP等简单任务，但已向上延伸至底层编排。 2. 这位专家认为，目前最大的制约因素是容量，某些公司的流量增长了5倍，而GPU的可用性——尤其是在延迟要求最严格的美国——根本跟不上。在亚洲或澳大利亚等海外地区获取容量在技术上可行，但会增加延迟，而大多数客户不会接受。 3. 超大规模云厂商提供可靠性，但价格昂贵，要求签订三年或更长的多年承诺，且最新硬件的可用性有限，客户已经在追逐B300。AI原生公司往往因超大规模云厂商的定价和合同僵化而倾向于新兴云厂商，但新兴云厂商自身也有可靠性问题，GPU会意外掉线，需要工程资源全天候管理集群稳定性。 4. 第三梯队由较小的独立运营商组成，他们投资了GPU机架，看到出租容量并在一两年内收回成本的机会，其余部分则是纯利润。这位专家称这些运营商在实践中基本不可用，他们所做的不过是找地、装机架、接电和设置冷却，背后没有真正的云管理、维护或运营专业知识。 5. 这位专家预计，未来一两年内GPU的整体可用性将显著提升，$NVDA将继续扩大生产。真正的瓶颈不是GPU本身，而是美国的数据中心容量和电力。在供应侧，这位专家还看到$SPCX等参与者开始向市场出租闲置容量，预计会有更多参与者跟进。 6. 这位专家指出，美国的云厂商通常要求预付20%至30%的款项，其余部分在合同期内按月或按季度支付，并在期末就流量损失等可靠性事件协商返还款项。亚太地区的供应商运营方式不同，完全不需要预付款。 发现于@AlphaSenseInc

查看原文

Former $GOOGL employee on why data center capacity and electricity are the real bottlenecks, not GPU production itself, and how unreliable some of the neoclouds are ($AMZN, $GOOGL, $MSFT, $NVDA): 1. According to the expert, open-source models are closing the gap with frontier models faster than expected, with customers increasingly replacing Anthropic and OpenAI models in multi-agent architectures with open-source alternatives starting from Q2 of this year. The shift started with simple tasks like tool calling and MCP, but has moved up the stack to low-level orchestration. 2. The expert identifies capacity as the biggest constraint at the moment, with certain companies' traffic growing 5x while GPU availability, particularly in the U.S. where latency requirements are tightest, simply cannot keep up. Sourcing capacity overseas in Asia or Australia is technically possible but adds latency that most customers will not accept. 3. Hyperscalers offer reliability but are expensive, require multi-year commitments of three or more years, and have limited availability of the latest hardware, with customers already chasing B300s. AI-native companies tend to gravitate toward neoclouds due to hyperscaler pricing and contract rigidity, but neoclouds come with their own reliability issues, with GPUs dropping off unexpectedly and requiring engineering resources to manage fleet stability around the clock. 4. The third tier consists of smaller independent operators who have invested in GPU racks, seeing the opportunity to lease out capacity and recoup costs within a year or two, with the remainder being pure profit. The expert describes these as essentially unusable in practice, with operators who do nothing more than find land, install racks, connect electricity, and set up cooling, with no real cloud management, maintenance, or operational expertise behind them. 5. The expert expects overall GPU availability to increase meaningfully over the next year or two, with $NVDA continuing to ramp production. The real bottleneck is not GPUs themselves but data center capacity and electricity in the U.S. On the supply side, the expert also sees players $SPCX beginning to lease out spare capacity to the market, with more likely to follow. 6. The expert notes that U.S.-based neoclouds typically require 20-30% prepayment upfront, with the remainder paid monthly or quarterly over the contract term, and rebates negotiated at the end for any reliability incidents like traffic loss. APAC-based providers operate differently, with no prepayment required at all. found on @AlphaSenseInc