←搜索结果

按匹配度 · 共 358 条结果 清除搜索

星期三

  1. The Rundown AI

    ChatGPT 共同创作者 Diogo Almeida 的 TypeSafe 推出 Jev

    前 OpenAI 研究员 Diogo Almeida 的 TypeSafe 结束隐身状态,推出 Jev,一种在软件内部回答预设问题并附带置信度分数的 AI 系统,官方称其零幻觉。Jev 定价为每 10 亿输入 token 42 美元、输出免费,TypeSafe 估算比 Claude Fable 5.1 低 238 倍,响应时间 70 至 500 毫秒,比当前 LLM 快 40 至 200 倍。它只在预先设定的选项之间选择,可用于应用内的快速判断,如分类请求、给记录打分或筛查其他 AI 输出是否越狱。

    r rapid building and deployment 300+ native integrations, no LLM lock-in Global governance and advanced analytics Discover your path to enterprise-wide AI adoption . Image source: arXiv The Rundown: 30+ Chinese AI researchers, including those from ByteDance, Tsinghua, and Shanghai AI Lab, published “The Last AI Built by Humans,” a roadmap detailing five levels of recursive self-improvement, ending with AI that builds its successors. The details: Level 1 has the AI carrying out upgrades humans de

    匹配字段正文

  2. Hugging Face

    IBM 研究:用 Pass^k 衡量智能体一致性,一致性差距可减半

    IBM 研究团队在 Hugging Face 博客发布 ALTK-Evolve 的一致性分析工作,指出标准评测只报 Mean@k 会掩盖智能体重复执行同一任务时的波动,提出用 Pass^k(k 次运行全部成功的任务比例)衡量一致性,两者之差即一致性差距。在 AppWorld test_normal 的 168 个任务上,GPT-4.1 驱动的 ReAct 智能体 Mean@5 为 77.4%、Pass^5 仅 53.0%;加入由单条轨迹生成的一致性准则后,Pass^5 升至 69.0%、Mean@5 升至 81.0%,差距从 24.4pp 收窄到 12.0pp。检测环节只需对已记录轨迹的每个决策步骤做一次离线重采样(默认 k=5),无需 ground truth 或重跑任务,相关代码已开源在 ALTK-Evolve 仓库。

    t Try the ALTK-Evolve — the open-source repo now includes the Consistency Analyzer and consistency-guideline generation used in these experiments — or read the technical report on arXiv for the complete methodology. If accuracy numbers you can't reproduce on your own tasks sound familiar, we'd like to hear about it — concrete examples of flip-prone behavior in your own agents are exactly the kind of feedback that shapes what we build next. Open an issue or a discussion . Appendix: Understanding

    匹配字段正文

星期五

  1. Cognition 模型 / Devin 博客精选

    Cognition 发布编码模型 SWE-2,FrontierCode 1.1 Main 得分 50.0%

    Cognition 发布编码模型 SWE-2,在 FrontierCode 1.1 Main 上得分 50.0%,比 Fable 5.1 低不到 1 分而成本便宜 64%。SWE-2 基于 2.8T 参数的 Kimi K33 后训练,首次把 RL 扩展到数万亿参数规模,并用单次 RL 训练覆盖全部推理档位。该模型即日起在 Devin Desktop 和 CLI 上线,随后在 Devin Web 和 Fusion 推出。

    Cao, and S. Alberti, "SWE-1.7: Frontier Intelligence at a Fraction of the Cost," July 2026. cognition.com/blog/swe-1-7; [3]Kimi Team et al., "Kimi K3: Open Frontier Intelligence," arXiv:2607.24653, July 2026. arxiv.org/abs/2607.24653; [4]W. Kool, H. van Hoof, and M. Welling, "Buy 4 REINFORCE Samples, Get a Baseline for Free!," Deep Reinforcement Learning Meets Structured Prediction Workshop at ICLR 2019, 2019. openreview.net/pdf?id=r1lgTGL5DE; [5]E. Greensmith, P. L. Bartlett, and J. Baxter, "Va

    匹配字段正文

星期四

  1. Hugging Face

    HF Jobs 上的 Async GRPO 与 LoRA:一个 bucket、一个代理,无需 NCCL

    Hugging Face 博客介绍在 HF Jobs 上用 AsyncGRPOTrainer 实现仅适配器同步的异步 GRPO 训练:训练器每几步把 LoRA 适配器存到挂载的 Storage Bucket,再通过 vLLM 的 /v1/load_lora_adapter 端点按版本名加载,无需 NCCL 传张量。方案使用 vLLM v0.27.1、max_staleness=4 对应 --max-loras 6,并在 sail/Sanity-Test-R1D-1.5B 数据集上以 Qwen2.5-Math-1.5B、LoRA rank 1 验证。

    ackio dashboard for every run in this post. Penghui Qi, Zichen Liu, Xiangxin Zhou, Tianyu Pang, Chao Du, Wee Sun Lee, Min Lin, Defeating the Training-Inference Mismatch via FP16 , arXiv:2510.26788, 2025. Source of the Sanity dataset sail/Sanity-Test-R1D-1.5B and of the LoRA recipe, sail-sg/Precision-RL , oat/scripts/lora/bf16 grpo tis lora.sh . Models mentioned in this article 1 deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B Datasets mentioned in this article 1 sail/Sanity-Test-R1D-1.5B Spaces mentio

    匹配字段正文

  2. Redwood Research:Blog

    Redwood Research 提出 NLS depth:衡量模型不可言说串行推理的代理指标

    Redwood Research 提出 NLS depth(Natural-Language-rooted node-Separated depth),用于量化模型在不经过自然语言瓶颈的情况下能执行的串行认知量,是对 GDM 论文中“不透明串行深度”概念的具体化。该指标要求瓶颈节点由预训练先验初始化并输出自然语言(含代码、JSON、图像 patch),且不扩展输出空间,可在训练前仅凭架构与训练配方判定。作者认为 NLS depth 可与可监控性、无 CoT 能力追踪互补,但对其对后训练选择不敏感。

    Scatter plot of NLS depth versus number of layers for open-source models

    b/website/7624816413e9b4d2e3ba620c5a5e091b98b190a5.pdf; Brown-Cohen, J., Lindner, D., & Shah, R. (2026). Quantifying the Necessity of Chain of Thought through Opaque Serial Depth. arXiv:2603.09786. https://arxiv.org/abs/2603.09786; Deng, Y., Choi, Y., & Shieber, S. (2024). From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Step. arXiv:2405.14838. https://arxiv.org/abs/2405.14838; Drori, J., Marks, L., Woodworth, B., Cloud, A., & Turner, A. M. (2025). Output Supervision Can Ob

    匹配字段正文

  3. Cognition 模型 / Devin 博客精选

    Cognition 用 Devin 智能体集群完成 RSA-260 分解

    Cognition 研究团队用 Devin 智能体集群完成 260 位数字 RSA-260 的分解,刷新公开求解的 RSA Factoring Challenge 纪录,此前纪录 RSA-250 于 2020 年 2 月创下。团队称 Devin 构建了性能最高的 GPU 格筛器,使分解成本比此前公开最优水平低 10 倍,本次分解约耗 4,900 GPU-days(约 13.5 GPU-years),按市场价约 40 万美元。作者估算,超大规模厂商或前沿 AI 实验室分解 RSA-1024 的成本约为每个 3000 万美元,而 RSA-2048 的难度约为 RSA-1024 的十亿倍,基本不受此工作影响。

    , and P. Zimmermann, "Comparing the Difficulty of Factorization and Discrete Logarithm: A 240-Digit Experiment," Advances in Cryptology — CRYPTO 2020, LNCS 12171, pp. 62–91, 2020. arxiv.org/abs/2006.06197; [2]The CADO-NFS Development Team, "CADO-NFS, An Implementation of the Number Field Sieve Algorithm," software project, accessed September 9, 2026. cado-nfs.gitlabpages.inria.fr; [3]N. David and P. Zimmermann, "A New Ranking Function for Polynomial Selection in the Number Field Sieve," 75 Years

    匹配字段正文

星期三

  1. Dwarkesh Patel Podcast & Blog

    预训练进步主要来自数据而非模型改进

    Dwarkesh Patel 博客发布一项研究,把 2019 至 2025 年的预训练进步拆分为数据与模型两部分。在 1e19 FLOPs 算力预算下,数据改进带来 12.0x 的算力效率提升,模型改进为 3.7x,前者约为后者的 3.24x。研究还发现两者收益基本相互独立,88% 的 OLMES 评测分数方差可由模型与数据的加性效应解释。

    worse than OpenWebText. This is not surprising since the Pile’s main improvement was data corpus diversity over filtering. It has a curated 22-source mixture including PubMed and arXiv papers, GitHub code, legal opinions, patents, and parliamentary proceedings. The amount of cross-domain transfer to OLMES (which is English web-prose MCQ) might be minimal for many of these tokens, thus resulting in lower compute efficiency. We note that by virtue of its larger size, we expect that the Pile shoul

    匹配字段正文

星期五

  1. Anthropic Research精选

    Anthropic 用 Claude 智能体 11 天完成费马大定理形式化证明

    Anthropic 分享了费马大定理的首个完整计算机可验证证明,Claude 在 11 天内基本自主地用 Lean 语言完成,写出 1300 万行 Lean 代码并证明 29500 个中间定理。该证明基于 Prove2Me 平台和 Claude Code 多智能体框架,消耗约 60 亿输出 token,最终由 Lean 检查,仅使用 Lean 的三个标准公理。Anthropic 认为自动形式化可减轻数学界审稿负担,并已扩大对外部研究者的订阅与算力支持。

    und in Propositions as Types by Philip Wadler. Chen, S., Marwaha, K., Lu, X., Yuen, H., & Peng, T. (2026). Prove2Me: An open collaborative platform for scaling math formalization. arXiv. https://doi.org/10.48550/arXiv.2608.28433 Automating Math , Adam Marblestone, in Asterisk Magazine. Footnotes During his undergrad, Peng’s research advisor wanted to include results from Peng’s thesis in a Nature article. He asked Peng whether he was sure the proof was correct. Peng’s honest answer was: “I'm 99%

    匹配字段正文

星期三

  1. LG AI Research 官方博客

    LG AI Research 提出 VLM 与智能体 AI 驱动的自主视觉检测框架

    LG AI Research 提出一套零人工视觉检测框架:用 MC Dropout 分解不确定性,仅采集模型知识缺失(Epistemic)样本,准确率达 93.13%,比随机采样的 88.29% 提升 4.84 个百分点。被选样本由 VLM 自动标注,经 Real-IAD 基础训练、领域微调和 GRPO 强化学习三阶段,输出缺陷坐标与自然语言原因解释。框架还基于视觉特征嵌入空间的相似度分析识别噪声标签,防止确认偏差。

    e model work, not the data work”: Data Cascades in High-Stakes AI." ACM CHI. [4] Wu, Q., et al. (2023). "AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation." arXiv preprint arXiv:2308.08155. [5] Kim, J., et al. (2024). "VLM-PL: Advanced Pseudo Labeling Approach for Class Incremental Object Detection via Vision-Language Model." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). [6] Gal, Y., & Ghahramani, Z. (2016). "Dropout as a bayesian approx

    匹配字段正文

星期五

  1. LMSYS Blog精选

    LMSYS 公开 infer-forge:围绕 SGLang 的 Harness、Loop 与 Graph 工程方法

    LMSYS 发布 infer-forge 方法论文,介绍围绕 SGLang 的推理工程系统,由 MonoRepo、Harness、Task Loop 和 Task Graph 四层结构组成,用于让跨仓库的推理优化工作可复现、可验证。该系统为内部工程系统,并非 SGLang 或 LMSYS 官方组件,目前不开源,文章公开的是构建方法论,供团队交给 AI 编码工具并结合自身系统上下文搭建适配实现。文中给出使用记录:一位工程师 4 月至 7 月的在飞任务峰值从 2 个升至 9 个,DeepSeek-V4-Pro 服务项目中 38 个可独立验证的任务节点被组织成任务图。

    The inference deployment space stacks five layers of static configuration. Model shows Ling, Qwen, DeepSeek, Kimi, GLM, and MiniMax. Serving Scenario runs Modality (text, image, video) into Traffic Shape (input and output length, media count, resolution, QPS, concurrency, cache reuse) into SLO (TTFT, TPOT, throughput, E2E latency). Serving Topology separates Deployment Architecture—Colocated PD, PD Disaggregation, and EPD Disaggregation, each listing the node roles it is built from — Prefill and Decode together, then Prefill and Decode as separate roles, then Encoder alongside them — from Parallelism—TP, PP, DP, and EP—because the two are chosen independently. Versioned Runtime Profiles is a stack of tabbed cards labelled Service A rev. 12, Service B rev. 7, and Service C rev. 21, plus a fourth paler card behind them all, blank and showing only its top edge, whose narrow tab carries an ellipsis for the profiles not drawn, the front card holding an Engine Configuration and a Container I

    ploration, LMSYS Org, July 2, 2026; Lilian Weng — Harness Engineering for Self-Improvement, Lil'Log, July 4, 2026; Boye Niu et al. — Flow: Modularized Agentic Workflow Automation, arXiv:2501.07834, 2025; Andy Xu and Yu-Wing Tai — Meta-Agent: From Task Descriptions to Verified Multi-Agent Systems, arXiv:2605.25233, 2026; Ao Li et al. — GraphFlow: A Graph-Based Workflow Management for Efficient LLM-Agent Serving, arXiv:2605.22566, 2026; Sydney Runkle and Harrison Chase — 3 Years of Graph Engineeri

    匹配字段正文

星期四

  1. LG AI Research 官方博客

    LG AI Research 的 ReSQL:通过检索增强错误推理实现自我改进的 Text-to-SQL 框架(ACL 2026)

    LG AI Research 提出 ReSQL,一个通过检索增强错误推理实现自我改进的 Text-to-SQL 框架,相关论文被 ACL 2026 Findings 收录。在 SPIDER 和 BIRD 基准的第二轮精炼后,该框架将歧义列引用错误减少 36.5%、多语句 SQL 错误减少 39.4%、ORDER BY 先于 UNION 的错误减少 73.1%,并完全消除了 GROUP BY 子句中的聚合函数错误。

    "Teaching large language models to self-debug." International Conference on Learning Representations. Vol. 2024. 2024. [6]. Wang, Xuezhi, et al. "Self-consistency improves chain of thought reasoning in language models." arXiv preprint arXiv:2203.11171 (2022). [7] Hu, Edward J., et al. "Lora: Low-rank adaptation of large language models." Iclr 1.2 (2022): 3. [8] Liu, Yang, et al. "G-eval: Nlg evaluation using gpt-4 with better human alignment, 2023." arXiv preprint arXiv:2303.16634 12 (2023): 1.

    匹配字段正文

星期三

  1. Qwen Blog精选

    Qwen 开源 Qwen3.8-Flash-Next:125B 参数 MoE,激活 6B,训练成本约为 Qwen3.7-Plus 的 1/9

    Qwen 团队开源多模态 MoE 模型 Qwen3.8-Flash-Next,主模型 125B 参数、额外 51B N-gram 嵌入参数、每 token 激活 6B,训练成本约为 Qwen3.7-Plus 的 1/9,原生支持 262,144 tokens 上下文并可通过 YaRN 扩展至 1,000,000 tokens。该模型是 Qwen4 架构的早期预览,在注意力、残差、嵌入和优化四方面升级,采用 GDN + QSA 混合注意力、Gated Residual、N-gram Embedding 与 Muon 优化器,权重已在 Hugging Face 和 ModelScope 开放。生产版本以 qwen3.8-flash 名称在 QwenCloud 提供服务,默认 1M 上下文并内置官方工具,定价为每百万输入 tokens 0.15 美元、每百万输出 tokens 0.47 美元。

    86.9 73.9 Visual math problem solving MathVision Without CI 90.6 With CI 95.7 Without CI 90.0 With CI 94.6 Without CI 90.3 With CI 88.7 Without CI 65.5 Scientific chart analysis CharXiv (RQ) Without CI 84.6 With CI 90.6 Without CI 83.7 With CI 90.2 Without CI 85.8 With CI 85.9 Without CI 66.0 1. ClawEval-MM: scores are reported as "pass@3 / average score". Pass@3 measures the percentage passed in at least one of three trials, and the average score is the mean score across the three trials. 2. Re

    匹配字段正文

星期五

  1. Hugging Face

    Hugging Face Inference Endpoints、Jobs 与 Buckets 如何支撑 Papers with Code 搜索

    Hugging Face 用 Jobs、Buckets 和 Inference Endpoints 为 Papers with Code 搭建搜索:离线用 Qwen/Qwen3-Embedding-0.6B(固定 revision、256 维 L2 归一化向量)批量生成论文向量,在线仅把查询嵌入放在请求路径上,端点冷启动或异常时立即回退全文检索。5000 篇论文试点中,L4 GPU 上以 1024 维约每秒编码 75 篇,同一批次可确定性降到 512 和 256 维复用。

    text retrieval remains excellent for exact terminology, identifiers, and rare names. We also preserve deterministic identity behavior on top of the fused ranking: exact titles and arXiv IDs stay at the top; the method taxonomy recognizes navigational searches such as “the original BERT paper”; incomplete titles and bounded spelling mistakes use conservative trigram candidates; and ambiguous fuzzy matches abstain rather than forcing a bad result. Note: hybrid search isn't always the best option,

    匹配字段正文

星期四

  1. Liquid AI 模型与工程博客

    Liquid AI 发布 LFM2.5-DSpark 草稿模型,推理最高提速 3.2 倍

    Liquid AI 为 LFM2.5-1.2B-Instruct、LFM2.5-2.6B 和 LFM2.5-8B-A1B 发布 DSpark 投机解码草稿模型,GPU 上吞吐最高提升 3.18 倍,端侧最高 2.87 倍,且不改变输出质量。草稿模型约 300M 参数,采用 5 层、block size 9 的简化注意力结构,已在 Hugging Face 提供 Safetensors 与 GGUF 权重,并开源集成到 llama.cpp 和 SGLang。在 BFCL 多工具函数调用场景中,LFM2.5-2.6B 的延迟平均降低 57%;LFM2.5-8B-A1B 受 llama.cpp Metal 后端 MoE 实现影响,端侧仅提升 18%。

    ccuracy for footprint as your deployment demands References [1] Cheng et al. (2026). DSpark: Confidence-Scheduled Speculative Decoding with Semi-Autoregressive Generation. https://arxiv.org/abs/2607.05147 [2] Li et al. (2025). EAGLE-3: Scaling up Inference Acceleration of Large Language Models via Training-Time Test. https://openreview.net/forum?id=4exx1hUffq [3] Chen et al. (2026). DFlash: Block Diffusion for Flash Speculative Decoding. https://arxiv.org/abs/2602.06036 [4] Patil et al. (2025).

    匹配字段正文

  2. 蚂蚁百灵:Developer Blog精选

    蚂蚁百灵开源 Ling-3.0-tiny-base 与 Ling-3.0-flash-base

    蚂蚁百灵正式开源 Ling-3.0-tiny-base 与 Ling-3.0-flash-base 两个 Base Model,并同步开放预训练、中期训练和 WSM 合并三个阶段的权重,共 6 个 checkpoints。Ling-3.0-tiny-base 总参数 7.9B、激活参数 1.3B,Ling-3.0-flash-base 总参数 124B、激活参数 5.1B,可用于持续预训练、监督微调、偏好优化、强化学习后训练与蒸馏。官方说明 Base Model 未完成指令对齐,不建议未经后训练直接部署为面向终端用户的聊天服务。

    能进入真实世界的重要前提。 我们相信,基模开源,才是真正的开源。 开放后训练模型,是把已经形成的能力交给社区;开放 Base Model,是让社区能够从底座出发,继续训练并塑造面向真实场景的智能。 通过开放 Tiny 与 Flash 的 Base Model,以及模型训练过程中的关键 checkpoints,我们希望更多研究者和开发者能够从预训练底座出发,用自己的数据、任务和反馈,让模型在真实世界中继续生长。 🤖 ModelScope Ling-3.0-flash 🤗 Hugging Face 🤖 ModelScope 注:1、WSM 技术论文:WSM: Decay-Free Learning Rate Schedule via Checkpoint Merging for LLM Pre-training(https://arxiv.org/abs/2507.17634) 模型发布技术分享上一篇Ling-3.0-flash-Fin:面向真实金融工作流的开放模型下一篇从跑起来到训起来:Ling-3.0-tiny × ASystem AReno,打通单机 Agentic RL 闭环$/$

    匹配字段正文

星期一

  1. Preferred Networks:AI 研究与产品

    Preferred Networks 发布 Matlantis-PFP v9:支持元素增至 96 种,MLIP Arena 排名并列第一

    Preferred Networks 发布 Matlantis 核心机器学习原子间势(MLIP)技术 PFP v9.0.0,在 v8.0.0 的 r2SCAN 模式基础上新增镧系和锕系元素,支持元素总数从 70 增至 96(氢至锔)。在 MLIP Arena 公开基准上,PFP v9 的 PBE 模式总排名与 MACE-MPA 并列第一,并在五个任务中的三个排名第一,任意两两对比中均无法被其他模型超越。

    . 13, 2991 (2022). https://www.nature.com/articles/s41467-022-30687-9 [2] Y. Chiang et al., NeurIPS 38 (2025). https://papers.nips.cc/paper files/paper/2025/hash/bfa45223cc236855dbaa5c468c809896-Abstract-Datasets and Benchmarks Track.html (https://huggingface.co/spaces/atomind/mlip-arena) [3] C. Shinagawa et al., “Matlantis-PFP v8: Universal Machine Learning Interatomic Potential with Better Experimental Agreements via r2SCAN Functional”, arXiv:2603.11063 (2026). https://arxiv.org/abs/2603.11063

    匹配字段正文

星期五

  1. METR Notes

    METR 研究:AI 是否带来了发现加速

    METR 发布分析,用公开发现数据检验 AI 是否带来加速:网络安全漏洞发现明显加速,数学成果有一定加速但更难客观衡量,算法优化领域尚未出现显著加速。结论仅基于公开发现,AI 实验室内部未披露的成果可能未被计入。cURL 漏洞从 2025 年的 9 个增至 2026-06-24 的 36 个,其中 15 个标注 AI;Firefox CVE 从 2025 年的 210 个增至 2026-08-04 的 342 个;OpenSSL 从 2025 年全年的 6 个增至 2026-08-05 的 39 个。数学方面,Smale 问题清单中的 Jacobian 猜想由 Alpöge 与 Claude Fable 在 2026 年给出反例,Green 清单的 Problem 44 和 Problem 100 的 sofic 部分也已被解决。nanoGPT、CIFAR-10、Gurobi、MIPLIB、Stockfish、矩阵乘法指数等优化类指标均未显示明显加速。

    me growth trend as CVE issuance or level off at current rates. We’ll have to wait and see how publicly available Frontier AI Cyber models continue to progress over the next year.” arXiv submissions: dramatic acceleration Mathematics submissions to arXiv have dramatically accelerated, with big variations by subfield. Combinatorics (math.CO) rose from 377 submissions in January 2026 to 743 in July, roughly doubling over those months (the 2025 monthly average was 368); This metric clearly cannot be

    匹配字段正文

星期四

  1. Hugging Face精选

    复现 ICML 2,200 篇论文后,我们学到了什么

    Hugging Face 与 alphaXiv 组织社区借助编码智能体复现了 2,226 篇 ICML 2026 论文,并公开实验日志、代码和产物。受检论文中,51% 至少有一项主张获独立验证,23% 至少有一项被证伪或存在争议;结果也显示,智能体会误判尺度效应或单位问题,可靠审查仍需人类引导。

    The logbook that caught it also failed to reproduce the paper's headline +4pp result under the authors' own code and data. The authors have already uploaded a clarified version to arXiv. An evaluation diluted by padding. In "Do Transformers Need Three Projections?", a participant discovered that 66% of evaluated label positions were EOS padding tokens that train to near-zero loss, deflating perplexity roughly threefold. The abstract's "3.1% quality cost for 50% cache reduction" becomes roughly 9

    匹配字段正文

星期二

  1. NVIDIA Developer · Generative AI精选

    NVIDIA 发布 NeMo Switchyard,为 AI 智能体提供跨模型路由

    NVIDIA 发布 NeMo Switchyard,为 AI 智能体提供跨模型路由能力,可在专用模型与前沿模型之间按任务分配请求,以平衡性能、成本与效率。该工具提供免调优的 LLM 分类器、阶段路由器和升级路由器,也支持基于工作负载数据训练的预填充路由器,并可通过 OpenAI、Anthropic 和 Responses API 接入。LangChain 在 145 个多轮智能体任务上测试升级路由器,在 Nemotron 3.5 Lightning 与 Claude Opus 4.8 之间路由,仅 7% 调用发往前沿模型,成本降低 74%,准确率约有 6 个百分点的折让。

    equired quality level at the right cost. Figure 5. Accuracy versus total test-set cost for a learned prefill router on personal assistant-type tasks (Pinchbench + ClawdQA) https://arxiv.org/abs/2603.20895 Improving agent efficiency with NeMo Switchyard NVIDIA is working with partners across the agent, model, and enterprise application ecosystem to bring NeMo Switchyard model routing into existing developer workflows without a separate setup. These collaborations include: LangChain benchmarked Ne

    匹配字段正文

  2. Sarvam AI Blog

    Sarvam AI 与 AI4Bharat 发布 Indic DiarBench:覆盖 22 种印度语言的多说话人 ASR 与说话人分离基准

    Sarvam AI 联合 AI4Bharat 推出 Indic DiarBench,这是首个覆盖全部 22 种印度法定语言、联合标注 ASR 与说话人分离的开源基准数据集,包含 108 小时自然对话语音。数据集涵盖 2-9 名说话人、近场与远场会议及 YouTube 真实场景,并提供人工校验的转写文本与说话人时间戳,支持 DER 等指标对说话人归属 ASR 进行联合评测。

    Indic DiarBench: A Joint Diarization-ASR Benchmark Dataset for Indian Languages

    the words right, but whether it can correctly attribute those words to the people who said them. Try it Indic DiarBench dataset is fully open on Hugging Face: audio, annotations and evaluation protocol: huggingface.co/datasets/sarvamai/indic-diarbench; Indic DiarBench will be presented at Interspeech 2026. Read the paper on arXiv: arxiv.org/abs/2607.23808 Curious what else we're building? Explore our APIs and start creating. Curious what else we're building? Explore our APIs and start creating.

    匹配字段正文