OpenRouter 对话 Mercor：用 evals 决定模型取舍
When your inference bill starts climbing, choosing the right model becomes a question of accuracy, cost, and latency.
AI 导读
OpenRouter 在 New Defaults 节目中，由 cclark 对话 Mercor 的 OsvaldNitski，讨论推理成本上升时如何在准确率、成本与延迟之间选模型，以及 evals 如何帮助团队判断何时优化、切换模型或自研模型。
正文
When your inference bill starts climbing, choosing the right model becomes a question of accuracy, cost, and latency.
In our latest New Defaults, OpenRouter’s @cclark sat down with @OsvaldNitski from @mercor to discuss how evals help teams decide when to optimize, switch models, or train their own.