RouterPlus：小团队也能拿到批量推理价格
Inference pricing has a size penalty. The best per-token rates go to whoever can commit the most volume.
RouterPlus 把多个团队的需求合并成与供应商的一笔大单，各团队按自身流量份额享受该批量单价，让非批量买家也能拿到批量定价。该服务还会用你的真实用量测试模型，挑出够用且成本最低的那个，避免所有任务都付费调用顶级模型。作者认为这种模式最适合热门开源模型，因为多个团队本就需要相同权重跑在同类硬件上。
查看原帖Getting your inference right shouldn't be hard. @useRouterPlus (YC F26) is live: the right model and provider for your workload, at the best price. check out : https://t.co/HDYLVRYMEC https://t.co/8WbdbK2z6i
正文
当前显示原文，中文全文译文尚未就绪。
Inference pricing has a size penalty. The best per-token rates go to whoever can commit the most volume.
RouterPlus groups demand from many teams into one large deal with a provider, and each team pays that rate on its share of the traffic.
Large buyers have done this with cloud commits for years. Applied to tokens, I’d guess it works best for popular open models, where many teams already want the same weights served on the same kind of hardware.
For a small team, this is a route to bulk pricing that doesn’t require being a bulk buyer. They also test models on your real usage and pick the one that's good enough at the lowest cost. Many teams pay for a top model on every task when a cheaper one could do most of the work.