NVIDIA 发布 NeMo Switchyard,为 AI 智能体提供跨模型路由
NVIDIA 发布 NeMo Switchyard,为 AI 智能体提供跨模型路由能力,可在专用模型与前沿模型之间按任务分配请求,以平衡性能、成本与效率。该工具提供免调优的 LLM 分类器、阶段路由器和升级路由器,也支持基于工作负载数据训练的预填充路由器,并可通过 OpenAI、Anthropic 和 Responses API 接入。LangChain 在 145 个多轮智能体任务上测试升级路由器,在 Nemotron 3.5 Lightning 与 Claude Opus 4.8 之间路由,仅 7% 调用发往前沿模型,成本降低 74%,准确率约有 6 个百分点的折让。
Technical Blog sessionStorage.removeItem('facets.search.text'); sessionStorage.removeItem('facets.search.text-copy'); sessionStorage.removeItem('facets.search.filters'); Learn how NVIDIA NeMo Switchyard routes agent workloads across specialized and frontier models to balance performance, cost, and efficiency. AI-Generated Summary Powered by NVIDIA Nemotron. AI-generated content may summarize information incompletely. Verify important information. Learn more Building an AI agent does not end with
匹配字段正文





