←搜索结果

按匹配度 · 共 1346 条结果 清除搜索

星期二

  1. NVIDIA Developer · Generative AI精选

    NVIDIA 发布 NeMo Switchyard,为 AI 智能体提供跨模型路由

    NVIDIA 发布 NeMo Switchyard,为 AI 智能体提供跨模型路由能力,可在专用模型与前沿模型之间按任务分配请求,以平衡性能、成本与效率。该工具提供免调优的 LLM 分类器、阶段路由器和升级路由器,也支持基于工作负载数据训练的预填充路由器,并可通过 OpenAI、Anthropic 和 Responses API 接入。LangChain 在 145 个多轮智能体任务上测试升级路由器,在 Nemotron 3.5 Lightning 与 Claude Opus 4.8 之间路由,仅 7% 调用发往前沿模型,成本降低 74%,准确率约有 6 个百分点的折让。

    controllable agents better suited for real AI workflows. Consider a system of models performing a computer-use task measured by the Terminal-Bench Hard benchmark (Figure 1). While DeepSeek V4 has the highest overall accuracy in this example, it isn’t the best model for every task group. For instance, Kimi K2.6 is better suited to the ML and RL task groups, while Qwen3.5 397B A17B is preferable for math and science. The remaining six task groups should use DeepSeek V4. This approach can also be a

    匹配字段正文

星期一

  1. Interconnects

    Interconnects 作者发布后训练教材《Reinforcement Learning from Human Feedback》

    Interconnects 作者 Nathan Lambert 的后训练教材《Reinforcement Learning from Human Feedback: Aligning and Post-training LLMs》由 Manning 出版,已在 Manning 和 Amazon US 发货,Amazon UK 10 月上市。全书约 25% 篇幅讲 RL,覆盖从策略梯度定理到 PPO、GRPO、GSPO、CISPO 等算法,并包含拒绝采样、结果奖励模型、角色训练等主题,还临时加入了 on-policy distillation 一节。

    tion the early knowledge distillation literature of 2015 to 2-3 key insights that got us to the multi-teacher on-policy distillation (MOPD) of models like Xiaomi MiMo-V2-Flash and DeepSeek V4. The second half of this book goes into a tour of over-optimization, regularization, evaluation, and character training, which is all about the many ways post-training can go wrong and what you need to stay on top of. This is what differentiates the book most from those that are just a list of code exercise

    匹配字段正文

星期四

  1. Hugging Face

    Baseten 接入 Hugging Face Inference Providers

    Hugging Face Inference Providers 现已支持 Baseten,用户可通过网页、huggingface_hub >= 1.26.1、JavaScript SDK 及多种 Agent Harness 调用其托管模型。请求可使用供应商 API key 直连并由供应商计费,也可经 Hugging Face 路由且不加价;PRO 用户每月获 $2 推理额度,登录的免费用户享有少量免费配额。

    en is available through the Hugging Face SDKs - huggingface hub ( = 1.26.1) for Python and @huggingface/inference for JavaScript. The following examples show how to use the latest DeepSeek V4 Flash through Baseten. Use a Hugging Face token to authenticate - the request will be routed to Baseten automatically. From your favorite Agent Harness Hugging Face Inference Providers are integrated in most Agent Harnesses - including Pi, OpenCode, Hermes Agents, OpenClaw, and more. This means you can plug

    匹配字段正文

星期一

  1. Recode China AI

    禁止中国开放权重模型对美国弊大于利

    作者主张,禁止中国开放权重模型会切断美国 AI 生态的低成本创新来源,却难以阻止已公开权重的全球传播。文章认为,廉价模型有助于降低应用层推理成本、支持企业自主托管数据并促进价格竞争,而既往技术限制也未必实现预期目标。

    Tony Peng's avatar

    cutives cited model cost as the primary obstacle to generative AI adoption. Chinese labs have shipped some of the most aggressively priced, yet competitive open models. The latest DeepSeek-V4-Flash costs just 1/105 of Anthropic’s Fable 5 on one task, according to Artificial Analysis. Even at that ratio, DeepSeek’s CEO said in a investor meeting that the company still runs a 60% profit margin and can recoup a model’s cost within 10 months. A growing trend today is developers now route models by c

    匹配字段正文

  2. Interconnects

    Interconnects 推出 Artifacts Hub 与 Adoption Dashboard

    Interconnects 发布 Artifacts Hub 和 Adoption Dashboard 两个免费数据项目,前者覆盖过去两年发布的 792 个模型,结合 Hugging Face、Open Router 推理 token 与 Artificial Analysis 智能指数展示模型趋势;后者按地理和组织追踪下载量与衍生模型数量,突出中美差距。两个项目与 AI 验证初创公司 Project VAIL 合作构建。

    ghts the US-China gap and growing players in the open ecosystem. To date, our primary efforts on Interconnects have been release recaps for popular models like Kimi K3 , GLM 5.2 , DeepSeek R1 , etc. and monthly round-ups of the open models that matter, Artifacts Log . We’re expanding on these, building on the tools and internal data we’ve collected for other projects like The ATOM Project (and report ). This allows us to capture our ecosystem view of open models, develop methods for understandin

    匹配字段正文

  3. OpenHands 官方博客

    2026 年工程团队最佳 AI 编程工具盘点

    OpenHands 官方博客发布 2026 年工程团队最佳 AI 编程工具盘点,按自主性、部署模式、模型灵活性、界面、定价与治理等维度评估,涵盖终端智能体、IDE 工具和专有平台。文章引用 Faros AI 2026 工程报告,基于 22,000 名开发者、4,000 多个团队的遥测数据,发现团队从低 AI 采用率升至高度采用时,每位开发者完成 epic 数增长 66.2%。

    runs as a minimal CLI with tree-structured sessions that allow branching and navigation without losing context; Broad provider support via BYOK: Pi connects to Anthropic, OpenAI, DeepSeek, Gemini, Groq, xAI, OpenRouter, and Kimi through your own API key or existing subscription; Small core: Pi keeps its built-in orchestration and tool surface minimal, which can make it more straightforward to inspect and modify than larger agent frameworks; No governance layer: Pi has no plan mode, sub-agents,

    匹配字段正文

星期六

  1. NVIDIA Developer · Generative AI

    NVIDIA 详解面向快速交互式长上下文推理的 AI 模型注意力协同设计

    NVIDIA 技术博客分析 dense attention 在 GPU 上的性能规律:增大 group size(G)可提升 decode 吞吐,head dimension 取 128 或 256 更契合 GPU tile 与 128 字节内存传输;prefill 延迟随 ISL 平方增长,decode 延迟随 KV cache 序列长度线性增长。文章给出四条协同设计准则,并指出张量并行不应超过 KV head 数(KH),TensorRT-LLM 以 Wide EP 和 Helix Parallelism 应对。

    idelines: a co-design checklist that helps model developers raise inference throughput and interactivity on NVIDIA GPUs. Stay tuned for a post covering sparse attention. Figure 1. DeepSeek-R1 prefill time breakdown at 4K, 32K, and 128K context lengths, where the attention share rises from 18% to 85% Every analysis is grounded in two sources: analytical formulas from GEMM-shape arithmetic, and measured data from prefill and decode kernels with FP8 for both attention compute and the KV cache. Pref

    匹配字段正文

星期三

  1. The Next Platform

    AMD 公布 Venice CPU 与 MI400 系列 GPU 路线图,瞄准智能体 AI 与机架级系统

    AMD 在 Advancing AI 2026 活动上公布服务器 CPU 与 Instinct GPU 路线图。Venice Epyc 9006 采用 Zen 6 与 Zen 6c 核心,最高 256 核 512 线程,顶配型号相较 Turin 每插槽性能提升 1.8 倍,并支持 PCI-Express 6.0。MI455X 基于 CDNA 5 架构,配备 432 GB HBM4 与 23.3 TB/sec 带宽,FP8 算力 20 petaflops;Helios 机架将搭载 72 颗 MI455X 与 18 颗 Venice HF CPU,AMD 称其每美元 token 数比 Vera-Rubin NVL72 机架最多高 30%。

    55X GPU accelerator and made some vaguer claims about performance at the rack level compared to Vera-Rubin racks coming later this year. Here is the inference throughput using the DeepSeek V4 Flash model: As with other GPUs and XPUs, the increase in capacity across all fronts in the MI455X device yields higher token throughput, and particularly at the higher interactivity levels where users need more tokens processed. Here is how AMD reckons the cost per token on DeepSeek V4 Flash on the two dif

    匹配字段正文

  2. LMSYS Blog

    LMSYS 在 Miles 中实现 Blackwell 原生 MXFP8 与 NVFP4 强化学习配方

    LMSYS 在 Miles 中实现了两种 Blackwell 原生强化学习配方:端到端 MXFP8,以及面向 MoE 专家的逐 token NVFP4,覆盖 checkpoint 转换、Megatron 训练、SGLang rollout 与在线权重更新。在 8x B200 上对 Qwen3-30B-A3B 的配方消融中,BF16 与五种低精度配置的原始 reward 曲线高度重合,MXFP8 和 NVFP4 均缩短了 rollout 时间。NVFP4 采用在线逐 token 激活缩放,并支持高精度或反量化 backward 模式,相关改动已提交至 TransformerEngine、FlashInfer、SGLang 等上游仓库。

    NVFP4 two-level scaling with FP32 tensor scale and E4M3 block scales

    oduce avoidable train-inference mismatch Why Blackwell-Native Recipes? Previous low-precision approaches were not designed around MXFP8 or NVFP4. The existing Miles path follows a DeepSeek-V3-style block-scaled FP8 recipe: weights use 128x128 block scaling, activations use 1x128 tile scaling, and scales are computed online for each tile or block. This is a strong Hopper-era recipe, but on Blackwell its FP32 scales are still applied in software around the Tensor Core path rather than through nati

    匹配字段正文

星期日

  1. Berkeley AI Research (BAIR) Blog

    BAIR 提出 ABBEL:用信念状态监督让 LLM 高效完成长程交互

    伯克利 AI 研究(BAIR)提出 ABBEL 框架,将 LLM 的摘要内容隔离并监督为自然语言的信念状态(belief states),以替代完整交互历史作为智能体的工作上下文。在协作编程环境 CollabBench 中,基于通用重建式信念评分的 ABBEL 将性能差距缩小约 50%,训练步数减少 50%;在 Combination Lock 任务中,结合领域知识的信念评分使 ABBEL 接近甚至超过完整上下文模型。

    ABBEL overview

    s the number of tokens till 50% compute spend is on attention gets much larger than 25K. Interleaving linear attention alternatives with full attention as is done with gpt-oss and DeepSeekv4, results in massive flops reductions for the attention computation. For example with DeepSeekv4-Pro (1.6T A49B) it requires nearly 450 thousand tokens to reach the 50% tradeoff point. Grandcode uses Qwen-3.5-397B-A17B a model which hits 50% FLOPs for attention at 150 thousand tokens. ↩ This setting is techni

    匹配字段正文

星期六

  1. Recode China AI

    Kimi K3 引发硅谷焦虑,月之暗面冲刺 $50B 估值上市前融资

    Recode China AI 汇总了 7 月 19–25 日的 408 条中国 AI 新闻,重点包括 Kimi K3 引发的中美技术与政策争议,以及月之暗面按 $50B 投前估值推进融资和香港上市。周报还提及 GLM 5.2 协助 Hugging Face 应对 OpenAI 模型发起的网络攻击、宇树科技的人形机器人出货与降价,以及千问、混元、Ling 和 Dola Seed Audio 等模型进展。

    Tony Peng's avatar

    mbership, an enterprise tier bundling its Allegretto plan benefits with corporate billing and support. (@Kimi Moonshot) A UK/US study found Kimi K3 significantly lags American models in offensive cyber “hacking power”—a data point that cuts against the panic narrative above (SCMP); Recode China AI published a full translation of DeepSeek founder Liang Wenfeng’s four-hour investor meeting—his AGI roadmap, the US-China compute gap, Huawei chips, and why DeepSeek stays open source (Recode China AI)

    匹配字段正文

星期五

  1. One Useful Thing

    Ethan Mollick 谈该用哪些 AI 做事:ChatGPT 与 Claude 智能体实测指南

    Ethan Mollick 发布一份用 AI 做事的选型指南,认为如今用 AI 已从聊天转向能自主规划并调用工具的智能体系统。他实测 ChatGPT 的 Work/Codex 与 Claude 的 Cowork/Code 两种模式,指出两者都能连邮箱、跑长任务,但权限设置决定智能体能否直接发邮件或改文件,默认应先要求人工确认以降低 prompt injection 风险。他还提到高风险问题应选 Claude 的 Opus、Fable 或 GPT-5.6 Sol 的高思考档位,Google 目前缺少前沿模型和类似 Codex 的产品,但 Gemini Notebook 适合多来源研究、Gemini Omni 可直接编辑视频。

    models and is okay for working with office documents but lags badly in terms of its agentic abilities. And for the technically inclined, Chinese open weights models like Kimi K3, DeepSeek, and Qwen are surprisingly capable, but do require expertise to use as agents. And then there is Google. Google, which led on benchmarks not that long ago, has fallen behind where it now counts: it has no leading frontier model and it has nothing close to Codex and Code. That is why I don’t suggest Gemini as y

    匹配字段正文

星期三

  1. antirez 原创博客

    antirez:AI 编程时代,软件分发方式也将改变

    antirez 认为,AI 编程不仅改变了开发方式,也让软件使用方式发生变化:用户可让 AI 智能体直接修改代码,因此“稳定分支+不稳定分支”的传统分发模式可能不再适用,代码仓库更应成为解决问题的模板。他以 Redis 有序集合内存优化 PR 和 DwarfStar 为例,指出 95% 就绪的分支对部分用户比最终成品更有价值,并提到 GPT 5.6 Sol 借助 DwarfStar 现有代码,约两小时自动完成 Laguna S.1 模型实现。

    be an integral part of the project. For instance, yesterday the Laguna S.1 model was released. It looks interesting on paper, however: will it really be good enough? Will the new DeepSeek v4 Flash checkpoints make it not really relevant for DwarfStar? It is too early to say. However, to collectively form an idea, publishing a branch with this model implementation is a good middle ground: people will try it, will refine it with their coding agents, and the community can collectively form an idea

    匹配字段正文

  2. The Next Platform

    Gartner:GenAI 硬件投资远超模型与平台收入

    Gartner 数据显示,GenAI 模型收入 2023 年为 14 亿美元、2024 年为 57 亿美元(增长 320.4%),2026 年预计 28.3 亿美元,增速已明显放缓,远低于 OpenAI 约 250 亿美元、Anthropic 5 月 470 亿美元的 ARR。AI 平台市场已大于模型市场本身,而垂直领域专用模型收入增速约为通用基础模型的两倍。未来两年数据中心与硬件投资规模达数万亿美元。

    Timothy Prickett Morgan 发布于 2026年7月21日 星期二 // 21:32 UTC 最近几周,关于来自中国的开放权重 AI 模型——例如阿里巴巴 Qwen、DeepSeek R1、V3 和 V4,以及 Moonshot Kimi K3——在能力上正逐步逼近来自美国的闭源模型(如 OpenAI GPT、Anthropic Claude 和 Google Gemini)的讨论甚嚣尘上。 这场始于去年 1 月 DeepSeek R1 模型的讨论是有道理的,因为如果美洲和欧洲大陆的公司决定他们想要开放权重——在现阶段他们通常无法获得开源模型,因为模型制造成本太高——那么他们就会考虑中国模型,而不是成本高得多的闭源权重模型。这反过来会压低美国 AI 模型制造商所能产生的收入,而这或许不足以覆盖 OpenAI、Anthropic、Google 等公司正在承担的巨额 AI 硬件租赁成本以及如今的购置成本——他们正按照自己的愿景创造生成式 AI 的未来,而我们其他人将不得不应对这一未来。NEXTPLATFORM 广告 未来两年,账面上有数万亿美元的数据中心和硬件投资,以支撑

    匹配字段正文

星期一

  1. Interconnects

    Kimi K3 与开源权重的升级:Nathan Lambert 谈中美模型差距与开源策略

    Moonshot AI 于 7 月 16 日发布旗舰模型 Kimi K3,这是一个 2.8T 参数的 MoE 模型,权重将于 7 月 27 日开放。作者 Nathan Lambert 认为 K3 是迄今最强的开源模型,在 Vals AI 指数上排名第 2、Artificial Analysis 智能指数第 3、Frontend Code Arena 第 1,开源与闭源、美国与中国模型之间的性能差距已从争议中的 6-9 个月缩短到约 3-5 个月。文章还讨论了开源权重模型对前沿实验室资本开支的减速作用、中国实验室的资本效率,以及美国可能限制中国开源模型的监管动向。

    to something shorter, say 3-5 months. From the release materials, it is clear that K3 is a true frontier model. It will be the closest open models have been to the frontier since DeepSeek R1 . DeepSeek R1 was a different story. This was a Chinese lab being extremely quick to pivot to reasoning models and release one faster than many American companies. Kimi K3 an example of a Chinese lab executing on scaling the known areas: data, algorithms, architecture, tools, environments, etc. Kimi K3 come

    匹配字段正文

  2. Unsloth精选

    Unsloth 推出 AMD 版本,可在 AMD GPU 上训练和运行 LLM

    Unsloth 发布 AMD 版本,用户现在可以在 AMD 硬件上训练和运行 LLM。该版本与 AMD 合作实现,支持在 AMD GPU 上训练和运行 500+ 模型,覆盖 Windows、WSL、Linux,并可在 3GB VRAM 上训练 Qwen、Gemma。官方称借助自研 Triton kernel 和数学算法,在 Radeon、Instinct、Ryzen 及数据中心 GPU 上最高提速 2 倍、显存占用减少 70% 且无精度损失,同时提供针对 GGUF 与 Safetensors 推理优化的 ROCm 构建。

    t, Ryzen and data center GPUs with up to 2× faster with 70% less VRAM and no accuracy loss via our custom Triton kernels and math algorithms. We also support optimized ROCm builds for GGUF & Safetensors inference. Unsloth is an open-source local UI for faster LLM training and inference, with tool-call healing, code execution, secure web search, remote APIs, and HTTPS deployment. Connect local models to Claude Code, Codex agents and run the latest Kimi, GLM, DeepSeek, Qwen3.6, and Gemma 4 models.

    匹配字段正文

  3. Recode China AI精选

    Kimi K3为何被称为最不像“中国模型”的中国AI模型

    月之暗面于7月16日发布旗舰模型 Kimi K3,作者认为其核心定位是以高性能和高定价直接竞争全球顶尖专有模型,而非充当廉价替代品。K3拥有2.8 trillion参数和1M上下文窗口,在 Frontend Code Arena 获得1,679分,并采用 KDA、AttnRes及默认开启的思考模式。其价格为每百万输入 token $3、每百万输出 token $15,开放权重计划于7月27日提供。

    Tony Peng's avatar

    3 is the largest open LLM any Chinese company has ever released, assuming the open weights arrive on July 27 as promised. The AI community and much of X are calling it Moonshot’s “DeepSeek R1” moment, three weeks after Z.ai (Zhipu AI) sparked its own viral storm with GLM 5.2. The timing was deliberate: K3 landed just ahead of the World Artificial Intelligence Conference in Shanghai where Chinese President Xi Jinping called for greater open-source collaboration. What makes K3 an unusual release t

    匹配字段正文

星期一

  1. LMSYS Blog

    SGLang 优化 GLM-5.2 NVFP4 智能体负载:两周内达到 500 TPS

    SGLang 团队为 GLM-5.2 NVFP4 智能体负载引入多项优化,在 8xB300(bs=1)上实现超过 500 TPS。默认开启的 Spec V2 重叠运行时消除 GPU 气泡,带来 11% 端到端 TPS 提升;IndexShare MTP 复用 DSA indexer top-k,长上下文下草稿步成本降低约 1.9 倍。TopK-V2 内核将 80K ISL 平均延迟从 40.7 µs 降至 17.5 µs(2.33 倍),1M ISL 下提速 10.17 倍。

    GLM-5.2 NVFP4 day-0 versus v0.5.15.post1 interactivity on B300

    ormance comparison between Day-0 and v0.5.15.post1 on 8 B300 Background GLM-5.2 keeps the same backbone as earlier GLM checkpoints: DSA with a sparse-attention indexer on top of a DeepSeek-V3-style MoE. It adds two major architectural changes: IndexShare for DSA, and MTP with IndexShare and KVShare. SGLang has supported the GLM-5.2-NVFP4 checkpoint since day 0 on (Grace) Blackwell hardware, using trtllm-gen kernels for both sparse attention and MoE. To turn that day-0 stack into a faster, more s

    匹配字段正文

  2. Interconnects

    开放模型只剩 6 个月?Nathan Lambert 谈监管收紧与蒸馏之争

    Nathan Lambert 认为,针对开放权重模型最严峻的一次可行性考验正在发生,白宫正讨论通过新的行政令管理开放模型,可能只影响中国来源模型和政府用途。他判断最可能的动作是在未来 6 个月内禁止或无限期推迟能力明显超过 GPT 5.5、Claude Opus 4.8 或 GLM-5.2 区间的开放权重模型,而这类模型目前最可能来自中国公司。他批评 Anthropic 主导的蒸馏议题已演变为监管俘获,并认为若美国单独禁止相关模型进口,全球开源生态仍会继续,反而让美国自身更难预测。

    核心的经济代言人来代表针对它们的行动可能带来的负面影响。从近期围绕Fable(以及随后的GPT-5.6)模型许可协议相关事件的报道来看,关于6月9日发生了什么,有更多说法: 据一位了解该会议的人士称,会上提到了该项目将如何处理开源AI模型的话题。该人士说,美国开源模型提供商Reflection AI的一位代表主张,开源模型应基于其能力获得该框架的豁免。目前,DeepSeek等中国开源模型相比其他可用的开放模型拥有相当大的领先优势,而Reflection尚未推出公开模型。 在这里实施任何形式的禁令,对AI的长期发展轨迹都将是一个重大错误。 最可能即将采取的行动是,禁止或无限期推迟任何能力明显高于GPT 5.5、Claude Opus 4.8或GLM-5.2区间的开放权重模型。鉴于持续存在的能力差距,这应该会在未来6个月内发生。 就目前情况而言,这些模型最有可能来自一家中国公司,正因如此,这场关于前沿开放模型能力的讨论不可避免地与其他问题(如蒸馏)联系在一起。政府“审查权”的能力门槛会随时间推移而变化,但一旦确立,对开放模型的推进很可能远慢于对闭源模型。部分原因是闭源模型更容易保障安全,但

    匹配字段正文

星期四

  1. Ollama Blog

    Ollama 获 8800 万美元融资,公布 8.9 百万开发者规模

    Ollama 宣布完成 8800 万美元融资,投资方包括 Benchmark 的 Peter Fenton、Theory Ventures 的 Tomasz Tunguz、8VC 的 Alex Kolicich,以及 Docker 创始人 Solomon Hykes、ClickHouse CEO Aaron Katz、Y Combinator 等。官方称 Ollama 已服务 8.9 百万开发者,被 85% 的财富 500 强企业使用,其云服务 token 量平均每月翻倍以上。这笔资金将用于推进无缝混合推理、在新开源模型发布当天提供支持,以及让团队在不放弃所有权和隐私的前提下使用最强模型。

    Ollama founders

    the drive to solve very difficult problems once reserved for proprietary models. Ollama’s cloud is the most delightful way to access the most powerful open models: GLM, Nemotron, DeepSeek, Kimi, MiniMax and more. On average, Ollama’s cloud has more than doubled in token volume every month, and we can’t wait to make it available to every team. Today, we’re announcing that Ollama has raised $88M from Peter Fenton at Benchmark, Tomasz Tunguz at Theory Ventures, Alex Kolicich at 8VC, along with Sol

    匹配字段正文