←新闻详情

Rohan Paul更新于 10月21日 22:46

智能体集群把新增 token 推向廉价模型

Agent swarms send most new token volume to cheaper models, so agent token counts will outrun frontier-model revenue.

AI 导读

智能体集群将大部分新增 token 流量导向更便宜的模型,使智能体 token 消耗量增速超过前沿模型的收入增长。集群中父智能体负责规划,子智能体处理搜索文件、运行测试等易校验的窄任务,开发者可将其路由到通过验证的最便宜模型。这种 token 爆炸也意味着 AI 软件的包月与按席位定价将转向按量计费,因为 24x7 运行的智能体集群打破了人类提示速度对用量的限制。

引用

a16z

@a16z

Your next users are machines Agents burn nearly 5x the tokens people do, up 14x in six months https://t.co/0nqxqLemSt

查看原帖

正文

当前显示原文,中文全文译文尚未就绪。

Agent swarms send most new token volume to cheaper models, so agent token counts will outrun frontier-model revenue.

In a swarm, a parent agent plans while child agents handle narrow jobs like searching files or running tests. Narrow jobs are usually easy to check, so developers can route them to the cheapest model that passes.

And this massive token-explosion is also the major reason, flat-rate and per-seat pricing for AI software will give way to metering, because it relied on human prompting speed to cap usage. A person sends only so many prompts a day, so vendors could charge per user and still predict inference bills. But that equation will not hold with agent swarms working 24x7.

来源

Rohan Paul