Aaron Levie：AI 智能体时代算力需求将暴涨
The compute needed for the stage of AI we’re about to enter is going to be insane.
Box CEO Aaron Levie 称，AI 下一阶段所需算力将“疯狂”增长，个人智能体、企业防御智能体群、代码安全审查智能体、处理企业数据的智能体以及 7×24 小时后台智能体都会推高需求。推理量将按数量级持续增长，智能体除 token 外还需要计算机、网络和文件系统等基础设施，而这一建设才刚起步。
查看原帖.@auchenberg calculated that Muse needs 65,000 CPUs and 75PB of DRAM to serve 100 million users. That's $2.8B in infra for one app. It made me think. Facebook alone has over 3 billion users. That's nearly 300x scale for one platform. And they have more platforms with similar numbers. Just do the math. There aren't enough CPUs in the world to run all of…
展开完整原文
.@auchenberg calculated that Muse needs 65,000 CPUs and 75PB of DRAM to serve 100 million users. That's $2.8B in infra for one app. It made me think. Facebook alone has over 3 billion users. That's nearly 300x scale for one platform. And they have more platforms with similar numbers. Just do the math. There aren't enough CPUs in the world to run all of this. A worrisome constraint we're heading toward.
正文
当前显示原文，中文全文译文尚未就绪。
The compute needed for the stage of AI we’re about to enter is going to be insane.
Personal agents, agent swarms defending enterprises, agents that review all of our code for security issues, agents that process nearly all enterprise data in workflows, background agents working on tasks 24/7, and on and on.
This will take a mix of inference volume that is going to keep growing by orders of magnitude, as well as infrastructure that agents need alongside the tokens. They need computers, networking, file systems, and so on.
We’re only in the early stages of what this buildout is going to look like.