←新闻详情

Rohan Paul更新于 10月21日 22:46

微软将自研 Maia 芯片作为产品主要推理系统,2027 年起部署 Maia 300

Satya Nadella officially announced that Microsoft will make its in-house Maia chips the primary inference system for its products, scaling to multiple gigawatts

AI 导读

Satya Nadella 宣布微软将把自研 Maia 芯片扩展至多吉瓦部署,成为自家产品与服务的主要推理系统,并发布第三代加速器 Maia 300。微软称 Maia 300 每瓦 token 数比领先的 GPU 系统高 40%,一个整机架在 167kW 内集成 96 个加速器、27.6TB HBM,token 吞吐量最高可达 Maia 200 机架的 7 倍。Maia 200 已在 Teams 和 Copilot 中承担生产流量,每瓦 token 数最高为领先 GPU 基础设施的 1.7 倍;Maia 300 采用多 chiplet 设计,每颗芯片配 8 组 HBM4、峰值带宽 18.0 TB/s、TDP 950W,并支持增强的 MXFP4 以压缩 KV cache。据报微软正与 TSMC 洽谈 2027 年交付超过 30 万颗 Maia 300,该数字仍在谈判中。

推荐理由

AI 评分 75

微软把自研 Maia 芯片定为自家产品的主要推理系统,读者可据此观察大厂算力自给的路径与约束。

主题

标签

引用

Satya Nadella

@satyanadella

Today we are announcing our biggest bet yet on our own silicon. Starting next calendar year, we will scale our Maia family to multi-gigawatt deployments, making it the primary inference system for our own product and services. And we’re introducing Maia 300, which delivers 40% more tokens per watt compared to leading GPU-based systems. We are already…

展开完整原文

Today we are announcing our biggest bet yet on our own silicon. Starting next calendar year, we will scale our Maia family to multi-gigawatt deployments, making it the primary inference system for our own product and services. And we’re introducing Maia 300, which delivers 40% more tokens per watt compared to leading GPU-based systems. We are already deploying Maia 200 across the US, Europe, and Australia, delivering up to 1.7x more tokens per watt across experiences in Teams and Copilot. Our goal is to build on the full-stack efficiency gains we’ve already seen, while continuing to bring the latest innovations from across the ecosystem into our fleet.

查看原帖

正文

当前显示原文,中文全文译文尚未就绪。

Satya Nadella officially announced that Microsoft will make its in-house Maia chips the primary inference system for its products, scaling to multiple gigawatts.

This will make it less reliant on NVIDIA hardware, and Maia 300 is meant to replace AMD chips too, not only Nvidia. The key claim is 40% more tokens per megawatt than leading GPU-based systems

A full rack packs 96 accelerators into 167kW with 27.6TB of HBM, and Microsoft claims it delivers up to 7x the token throughput of a Maia 200 rack.

The shift will start in 2027 with Maia 300, a third-generation accelerator built for long-context reasoning, low-latency chat and multi-step agent tasks.

Its predecessor, Maia 200, already serves production traffic including Microsoft Copilot and Microsoft claims Maia 200 produces up to 1.7x more tokens per watt than leading GPU infrastructure.

Maia 300 goes after the cost of moving data, which Microsoft says now limits large inference systems more than raw arithmetic does.

Maia 300 uses a “multi-chiplet” design, A traditional chip is one large slab of silicon that does everything: the math (compute), managing the memory (memory controller) and talking to other chips (I/O). Maia 300 instead splits those jobs into several smaller pieces of silicon, called chiplets, packaged together so they act as one chip. That leaves more room on the compute chiplets for the parts that actually run the AI math, and each chiplet can be made with whatever manufacturing process suits its job best.

Each chip pairs 8 HBM4 stacks delivering 18.0 TB/s of peak bandwidth with a 950W TDP, and uses on-die SRAM as a scratchpad to relieve that memory.

Support for low-precision formats such as an enhanced MXFP4 shrinks the KV cache, the stored attention state that grows with every token, so longer contexts fit within the same power budget.

Supply is the harder constraint, since Microsoft has reportedly been negotiating with TSMC for more than 300,000 Maia 300 units for 2027 delivery, a figure still under negotiation rather than a signed purchase order.

来源

Rohan Paul