OpenRouter talks with Mercor about how to choose models through evaluation
AI summary
On OpenRouter's New Defaults program, @cclark and Mercor's @OsvaldNitski discussed how, as inference costs rise, teams can use evaluations to weigh accuracy, cost, and latency, and decide when to optimize, switch models, or train their own models. The main post only includes a link to the full episode.
Body
Watch the full episode of New Defaults: https://t.co/V9IDdPOBeD