←新闻详情

TechSpot更新于 10月25日 20:47

亚马逊囤积英伟达 GB300 服务器却无电可用,暴露 AI 基建的电力瓶颈

"Dark GPUs" at Amazon show the limits of the AI buildout: chips are easy to buy, power is not

AI 导读

据 Business Insider 看到的内部邮件,亚马逊每月接收价值数十亿美元的英伟达服务器机架,仅 8 月 AWS 就预计接收约 50 亿美元的 GB300 机架,此后每月再增约 30 亿美元,但部分美国 AWS 站点电力不足,这些硬件只能暂存于中转仓库。这种被称为 dark GPUs 的现象正给数据中心带来财务压力,亚马逊第二季度自由现金流自 2023 年以来首次转负,今年资本支出预计约 2200 亿美元。

正文

Dark AI Clouds: Like any other hyperscaler willing to sacrifice everything to turn AI into a game-changing opportunity, Amazon is pulling some bold stunts with both its finances and its hardware. A new report says the company is buying more GPUs than it has the power to run.

Amazon is allegedly taking in billions of dollars' worth of Nvidia racks every month, even though some sites aren't ready for them and there is no electricity to feed the AI accelerators just yet. According to internal emails seen by Business Insider, Amazon is willing to tie up billions in cash upfront as long as it can secure new hardware capacity early.

The messages describe Amazon's Early Rack Receipt process, through which AWS expected to take around $5 billion worth of Nvidia GB300 server racks in August alone, with roughly $3 billion more expected every month for the foreseeable future. Amazon is getting servers "built for the age of AI reasoning" before the final deployment phase.

Some US-based AWS facilities don't have enough power to install and turn the servers on, which means the costly hardware is being stored in "intermediary" warehouses until the final data center site is completed. In the emails, one Amazon team lamented that there was no clear forecast for actually installing all the GPUs the company was acquiring each month.

Amazon's lack of energy capacity is part of a growing phenomenon known as "dark GPUs." Data center and cloud giants are piling up all the hardware they can, but much of it is essentially gathering dust on shelves while the rest of the IT industry is left with the scraps.

The dark GPU issue is also adding financial pressure to data center ventures. Amazon's trailing free cash flow turned negative in the second quarter for the first time since 2023, and the company expects it to stay that way for a while, with capital expenditures set to reach around $220 billion this year.

Amazon is spending more than any other hyperscaler to build new AI capabilities and data center capacity, and is changing its usual business practices to do it. Before the AI craze, AWS only took ownership of racks once they were finished and delivered to a data center. Now, the company Jeff Bezos founded is willing to spend billions upfront to secure more AI racks earlier in the supply chain.

An Amazon spokesperson defended the approach, calling the practice of storing finished racks in a warehouse "best business practice." The company expects significant financial returns from this massive AI infrastructure build-up eventually, because AI is a once-in-a-lifetime opportunity no IT company can afford to miss. AWS has been through something similar before, Amazon CEO Andy Jassy said.

来源

TechSpot