SemiAnalysis 实测 Rubin NVL72:AgentX 基准下每美元性能达 GB300 的 67 倍
SemiAnalysis 发布首份 Rubin NVL72 智能体推理实测结果,基于其 AgentX 基准,在 170 TPS 下每 TCO 总吞吐量约为 GB300 Dynamo TRTLLM 的 67 倍。在多数服务商实际部署的 60-100 TPS 区间,Rubin 每 TCO 吞吐量为 GB300 的 1.4 至 3 倍;按 3 年租赁成本计算,80 TPS 时可多产出 62% token。该测试使用 2300W TDP、每计算托盘 1.5TB CPU LPDDR5X 的量产 SKU,结果基于预发布软件,后续还将补充 vLLM 与 SGLang 的 Rubin 数据。
, Rohit Nagraj, and the Mainland China TensorRTLLM Team for helping on doing next gen Rubin software bring up and helping verify our agentic benchmark results. Star the InferenceX GitHub repository if you find the open-source benchmark and data useful!. InferenceX is the only inference benchmark in the world to have TPUv7, NVIDIA, & AMD and soon SambaNova & Trainium. Due to how realistic AgentX scenario is to real world agentic inference workloads, AMD has committed to collaborating on MI455X UA
匹配字段正文




