←搜索结果

按匹配度 · 共 3406 条结果 清除搜索

星期二

  1. Inception Labs Blog

    Inception Labs 发布 Mercury 扩散大语言模型家族

    Inception Labs 发布 Mercury 扩散大语言模型(dLLM)家族,称其速度最高可达前沿速度优化 LLM 的 10 倍,在 NVIDIA H100 上超过 1000 tokens/sec。首个公开模型 Mercury Coder 面向代码生成,在 Copilot Arena 上 Mini 版并列第二,速度约为 GPT-4o Mini 的 4 倍,可通过 playground 测试,企业客户可经 API 和本地部署使用。公司称面向聊天应用的模型正在封闭测试,后续还将推出更多 dLLM。

    rect Preference Optimization, Flash Attention, and Decision Transformers. A dLLM is a drop-in replacement for a typical autoregressive LLM, supporting all its use cases, including RAG, tool use, and agentic workflows. When prompted with a query, instead of producing the answer one token at a time, the answer is generated in a coarse-to-fine way, as illustrated in the above animation. Improvements are suggested by a neural network – in our case a Transformer model – which is trained on large amou

    匹配字段正文

  2. Google Blog

    艺术家用 Google AI 工具探索生命与意识

    艺术家 Xin Liu 和 Eunjo Lee 在 LAS Art Foundation 与 Google Arts & Culture 合作的线上驻留项目中,用 Google AI 工具创作了两件作品。Xin Liu 的《nom nom》基于 Neural Cellular Automata(NCAs),用数百万粒子模拟集体智能涌现的生态系统;Eunjo Lee 的《In Your Eyes, Before My Own》用 Nano Banana 和 Veo 将手绘草图转为 3D 资产,并叠加动作捕捉与韩文谚文音素。两件作品现已在 Google Arts & Culture 网站上线。

    Interactive particle simulation forming dynamic, landscape-like digital structures.

    age of intelligence distributed across millions of tiny neural networks that react only to their surroundings — not as a singular mind above the world, but as a living ecology of fragments,” Xin says. Xin Liu, nom nom (2026). Commissioned by LAS Art Foundation in collaboration with Google Arts & Culture. Eunjo’s “techno-alchemy” process bridges ancient philosophy, linguistics, and modern psychology. She sees technology as a medium that reveals the philosophical and psychological underpinnings of

    匹配字段正文

  3. Inception Labs Blog

    Inception 的 Mercury dLLM 客户案例:SearchBlox、Radient 与 Buildglare

    Inception 的 Mercury dLLM 已为 SearchBlox SearchAI 提供支持,让企业级工作负载也能获得亚秒级 GenAI 响应。Radient 用扩散模型 Mercury 驱动其 AI 智能体路由产品 Radient Automatic,预测每一步的智能体任务类型与难度;Buildglare 则采用首个商用扩散大语言模型 Mercury Coder,以并行生成方式实现快速就地代码编辑。

    o business productivity assistance for small businesses and sole proprietors. Radient’s first product release was Radient Automatic: a model routing solution for AI agents. By leveraging Inception’s fast and cost-effective diffusion Mercury model, Radient is able to power key components of the routing system that are responsible for predicting agentic task type and difficulty at every step. Aug 19, 2025 Customers Radient is a Toronto-based AI research and development company building products an

    匹配字段正文

  4. Ollama Blog

    Ollama 0.35 支持 Jev 风格决策模型,新增 /v1/systemone 接口

    Ollama 0.35 起支持基于 TypeSafe Jev API 的决策模型,通过新的 /v1/systemone 接口把文本作为状态并附带一组命名问题,本地模型可在一次请求中全部作答。官方称该方式无额外成本、本地运行延迟更低,适合工单分流、模型路由和内容或安全审核等需要快速决策的任务。首批上线三个模型:Bespoke Labs 开发的 9B 开源决策模型 nimble,以及 Together AI 的两个实验性决策模型 tev1 和 tev1:0.8b;本地在 M5 Max 上运行 nimble 9B 时,Pac-Man 示例中平均每次决策 91ms。可通过 curl 或 TypeSafe 官方 Python SDK 发起请求,后续将加入 Apple Silicon 上基于 MLX 的加速和更多决策模型。

    t triage, model routing, and content or safety moderation. Near-instant decisions Decision models on Ollama are fast, as requests don’t have to travel over a network. Nimble 9B averaged 91ms per decision in the Pac-Man example below when running locally on an M5 Max. That’s fast enough to make rapid decisions such as playing a game or processing content in real time: Available models Three new decision models are available to run via Ollama: nimble: open-source 9B parameter decision model develo

    匹配字段正文

  5. Vapi Blog

    Vapi 推出 Vapi for CX:让企业掌控语音智能体全生命周期

    Vapi 发布 Vapi for CX,一套面向 CX、运营、产品和工程团队的语音智能体工具包,主打对智能体全生命周期的完全控制。Vapi Composer 支持用自然语言构建语音智能体,产出的配置对象与 API、CLI 和 MCP server 中的一致,底层设置仍可编辑;电话、轮次切换、打断处理、并发与合规由 Vapi 托管。

    ng, self-service, chatbots, and deflection platforms; each one was built to make an interaction cheaper, and each one delivered on what it promised. Cost per contact went down. Average handle time went down. Containment went up. The tools worked for what they were optimized for: minimizing cost for the business, not maximizing value for the customer. That's why we're launching Vapi for CX: the complete toolkit your CX, operations, product, and engineering teams need to ship fast and keep improvi

    匹配字段正文

  6. Google Blog

    Google 用 Gemini 支持美国政府新门户 America.gov

    白宫宣布推出 America.gov,作为简化公民在线获取联邦服务的统一入口。Google 被列为该计划的技术合作伙伴,将用 Gemini 帮助超过 1 亿人更快、更便捷地获取关键公共资源。Google 表示此举支持政府数字现代化愿景,让日常公共服务更顺畅、可及。

    ite House announced America.gov, a streamlined "front door" designed to simplify how citizens access federal services online. Google is proud to be named a technology partner in this vital initiative, leveraging Gemini to help more than 100 million people access critical public resources with greater speed and ease. By supporting the administration’s vision for digital modernization, we are committed to making these everyday public services seamless, accessible, and responsive for all Americans.

    匹配字段正文

  7. Mastra Blog

    Mastra 为记忆系统推出 Memory Hooks

    Mastra 的记忆系统新增 Memory Hooks,可观察 observation 与 reflection 循环,或修改 Observer 和 Reflector 看到与存储的内容。钩子分两类:生命周期钩子(onObservationStart、onObservationEnd、onReflectionStart、onReflectionEnd)用于外部上报,如按循环记录 token 用量以发现成本飙升;转换钩子(beforeObservation、afterObservation、beforeReflection、afterReflection)可拦截并修改记忆数据,如剔除噪声工具输出、内部推理或脱敏密钥与 PII。同时发布的 skillResultRedactor() 会用占位符替换 Skill 的完整文件内容,避免 Observer 每次看到,但智能体仍记得该技能。

    ontents. The Observer sees it every time. To avoid that, the redactor replaces the content with a placeholder. The agent still remembers the skill. Install @mastra/memory and a storage adapter. The storage adapter is required for Observational Memory. Set it up either on the Memory instance or the main Mastra instance: Create the agent Create an agent and configure memory: Lifecycle hooks Define lifecycle hooks. They can fire at the start and end of every cycle. This example logs when a cycle st

    匹配字段正文

  8. Artificial Analysis 完整文章

    Artificial Analysis 开源 AA-AgentPerf-Local,测试笔记本与工作站本地智能体推理性能

    Artificial Analysis 开源 AA-AgentPerf-Local,通过回放真实智能体会话在笔记本和工作站上测试本地模型推理性能,并发布配套榜单。默认负载为 8 个记录任务、168 个模型轮次,上下文增长至约 56K tokens,默认跳过工具执行以隔离推理速度。首批硬件包括 NVIDIA DGX Spark(128 GB)、AMD Ryzen AI Halo(128 GB)、MacBook Pro M5 Pro(64 GB)和 NVIDIA GeForce RTX 5090(32 GB),首批模型为 Qwen3.5-9B、Qwen3.8-27B、Qwen3.6-35B-A3B 和 Ling 3.0 Flash(124B / 5B active),均采用 4-bit 量化。

    models, and will stay updated over time as new releases launch We already benchmark inference performance on mobile phones and datacenter-scale hardware, and are expanding our coverage to include laptops and workstations. Alongside hosting a leaderboard displaying results from popular model and hardware combinations, we are open-sourcing all code and data required to run AA-AgentPerf-Local to ensure that individuals and companies are able to run their own trials, informing their local AI serving

    匹配字段正文

  9. Inception Labs Blog精选

    Inception 发布升级版 Mercury 扩散语言模型

    Inception 发布旗舰扩散语言模型 Mercury 的升级版本,在编码、指令遵循、数学解题和知识召回上均有提升,并同步宣布完成由 Menlo Ventures 领投的 5000 万美元融资。新版本通过扩大参数与训练数据、升级去噪器架构、改进训练目标与推理算法并推出全新服务引擎来实现这些提升,现已上线其 API 平台及 OpenRouter、Models.dev 等合作渠道,价格维持每 100 万输入 token 0.25 美元、每 100 万输出 token 1.00 美元不变,新用户可获 1000 万免费 token。

    I, and the company is the first to apply it to language. Based in Palo Alto, CA, Inception is backed by A-list venture capitalists, including Menlo Ventures, Mayfield, M12 (Microsoft’s venture fund), Snowflake Ventures, Databricks Investment, and Innovation Endeavors. Note: Quality is the average of GPQA Diamond, LCB, IFBench, AIME 2025, and SciCode. E2E latency is measured using Artificial Analysis’s methodology, described here. Mercury 2 for Search: Fast enough to run a hundred times per query

    匹配字段正文

  10. Inception Labs Blog精选

    Inception 在 Azure AI Foundry 上线 Mercury 2 推理模型

    Inception Labs 宣布 Mercury 2 上线 Azure AI Foundry,该模型采用扩散架构并行生成 token,官方称生成速度提升超过 5 倍,在 NVIDIA Blackwell GPU 上达到 1,009 tokens/sec。模型定价为每百万输入 token 0.25 美元、每百万输出 token 0.75 美元,支持 128K 上下文、原生工具调用和 JSON schema 结构化输出,API 兼容 OpenAI,目前在美国和加拿大区域提供。

    Real-time voice and interaction: Voice interfaces have the tightest latency budget in AI. Mercury 2 makes reasoning-level quality viable within natural speech cadences; Search and RAG pipelines: Multi-hop retrieval, reranking, and summarization latencies stack fast. Mercury 2 lets you add reasoning to the search loop without blowing your latency budget Deploy on Azure AI Foundry Mercury 2 is available in the US and Canada regions through Azure AI Foundry. Deployment is straightforward—provision

    匹配字段正文

  11. Inception Labs Blog

    Inception 发布 Mercury Edit 2 扩散式下一编辑预测模型

    Inception 发布 Mercury Edit 2,一款面向下一编辑预测的扩散 LLM(dLLM),基于近期编辑和代码库上下文预测开发者下一步改动,按 Tab 即可接受。官方称其编辑接受率提升 48%、展示的编辑更克制 27%,训练中用 KTO 结合人类偏好数据对齐;模型已在 Inception Platform 上线,定价为每 1M 输入 token 0.25 美元、每 1M 输出 token 0.75 美元,缓存输入每 1M token 0.025 美元,新账号赠送 1000 万 token。

    bat this, we gather a high quality human preference dataset by recording the explicit feedback (accepting vs rejecting an edit) that our model receives. Using this dataset, we leverage an unpaired reinforcement learning method called KTO to align our model with human preferences. We find that this step is important for increasing the utility of our model. The results are clear. Our new model’s edits are accepted 48% more often, emphasizing the value of this improvement. It is also 27% more selec

    匹配字段正文

  12. Inception Labs Blog

    Mercury 2 与实时子智能体的崛起:Inception 扩散 LLM 如何支撑 Augment Code 生产级智能体工作流

    Inception 的扩散 LLM Mercury 2 被 Augment Code 用作专用子智能体,将上下文压缩延迟降低 82%(从约 150 秒降至更低)、成本下降 90%,同时保持与 Opus 4.7 相同的压缩质量。在压缩质量评测中,Mercury 2 是唯一落在“快且好”象限的模型,速度约为 Sonnet 4.6 的 5 倍而质量持平。它还被用于驱动 Prism 模型路由(降低 30% LLM 总支出)并在 1 秒内返回 MCP 工具搜索摘要。

    mary and answers the 4 probe questions, which are scored against the ground truths on a 0–5 scale. We run this eval across multiple models and measure compaction latency as the average end-to-end latency per request. Mercury 2 is the only model in the "Fast & Good" quadrant - roughly 5x faster than Sonnet 4.6 while matching it on quality. On the speed-quality-cost tradeoff, Mercury 2 doesn't compromise. Augment Code’s enterprise coding agents, in production Augment Code, creator of Auggie & Cosm

    匹配字段正文

  13. Data Center Knowledge

    下一代 AI 基础设施设计:从效率出发的系统级方法

    AI 基础设施设计正从单纯追求容量转向整合电力、冷却与算力的系统级方法,以同时优化效率、韧性与适应性。美国目前有超过 1500 座数据中心在建,行业平均 PUE 已从 2007 年的 2.50 改善至 2026 年的 1.52,新建设施普遍达到 1.3 或更低。文章提出应综合考量 PUE、WUE、CUE、ERE、CPE 与电网感知运营等指标,而非依赖单一效率衡量标准。

    of data center efficiency, but it doesn’t capture every dimension of modern infrastructure. The industry’s expectations for what constitutes an efficient facility have changed. Average PUE has improved from 2.50 in 2007 to 1.52 in 2026, while newer facilities routinely achieve PUEs of 1.3 or lower. A level of efficiency that would’ve been considered strong two decades ago is now well above what’s expected of modern facilities. This progress illustrates why operators must look beyond a single mea

    匹配字段正文

  14. Gary Marcus:The Road to AI We Can Trust

    佛罗里达州寻求对 OpenAI 颁布禁令

    Gary Marcus 发文称,佛罗里达州总检察长寻求对 OpenAI 颁布禁令,他认为这与他此前多次呼吁的暂停 OpenAI 类似,并主张各州和国家应跟进。文中还提到,黄仁勋宣布了一个 AI Agent 安全平台,Andrew Ng 对此持乐观态度,但作者认为实际效果尚待观察,并举例 Nvidia 此前发布的 Nemoclaw 影响有限。

    in themselves should never be trusted. Glad people are finally realizing that. Recognition is the first step! § In some ways, the bigger news, though it hasn’t gotten as much coverage yet, is this: This is a lot like the pause on OpenAI that I have been recommending here for weeks. Pause OpenAI, now I have often counseled calm where others might counsel panic. And I very much agree with the Florida AG that OpenAI doesn’t have the ability to properly regulate its own tech. Every state and countr

    匹配字段正文

  15. SemiAnalysis

    GLM-5.3 解析:稀疏注意力如何影响 DRAM 内存 TAM

    SemiAnalysis 分析 Z.ai 的 GLM-5.3 系列:稀疏注意力通过 top-k 选择降低 SDPA 阶段的 KV cache 内存与带宽需求,但 top-k 选择仍需完整上下文驻留 HBM,因此并未消除内存容量瓶颈。SGLang 团队的 HiSparse 将 KV cache 从 HBM 卸载到主机 DRAM,按 LRU 策略换入换出,并把第 N 层加载与第 N-1 层执行重叠以降低 miss 延迟。在 InferenceX 基准中,150 tokens/s 下 GB200 约 $0.044/百万总 token,比 MI355X ATOM 的 $0.049 低约 12%。

    l and decoding can also change performance. Two separate GLM-5.2 studies illustrate this: vLLM keeping the first decoding step on a consistent CUDA graph execution path reduced average TPOT (time per output token) from about 40 ms to 22 ms in an NVFP4 study; On a different 8 MI355X long context workload, ATOM engine processing prefill in chunks across pipeline stages delivered 98% higher total throughput and reduced median TTFT from 28.6 to 8.7 seconds TileRT For GLM5.3 on TileRT, AMD MI355X was

    匹配字段正文

  16. AWS Machine Learning

    在 SageMaker AI 上用 vLLM-Omni 生成图像与视频(第二部分)

    在 Amazon SageMaker AI 上,用同一个 AWS vLLM-Omni DLC 镜像部署两个端点:实时端点跑 FLUX.2-klein-4B 生成图像,异步端点跑 Wan2.1-VACE-1.3B 做图像条件视频生成。文本提示词先生成 PNG,再连同运动提示词送入视频端点,生成的 MP4 从 Amazon S3 取回,示例还提供命令行流程和可选的 Streamlit 界面。

    ker AI 上将图像动画化为短视频。你从同一个 AWS vLLM-Omni 深度学习容器(DLC)部署两个端点:一个用于 FLUX.2-klein-4B 图像生成的实时端点,以及一个用于 Wan2.1-VACE-1.3B 视频生成的异步端点。该工作流发送文本提示词以生成静态图像,然后将图像和运动提示词传递给视频端点。它从 Amazon Simple Storage Service(Amazon S3)检索 MP4,并提供可选的 Streamlit 界面。 AWS 深度学习容器为 AWS 上的训练和推理打包框架与依赖项。AWS vLLM-Omni DLC 打包了跟踪的 vLLM-Omni 版本,并为 SageMaker AI 添加了路由中间件。vLLM-Omni 将 vLLM 从文本生成扩展到通过 OpenAI 兼容 API 处理或生成文本、音频、图像和视频的模型。 本文是关于专用 AWS DLC 系列文章的延续。第 1 部分使用 vLLM-Omni 和 SageMaker AI 双向流式传输实现实时语音。第 2 部分涵盖实时和异步推理:图像模型以内联方式返回结果,而运行时间较长的视频

    匹配字段正文

星期一

  1. AWS Machine Learning

    使用 Amazon Nova Act 实现合成监控

    AWS 发布基于 Amazon Nova Act 与 Amazon Bedrock AgentCore 的智能体驱动合成监控方案,用多模态 LLM 读取 UI 截图而非 DOM 选择器,替代 Selenium、Playwright 等易碎脚本。早期企业客户用例中,Nova Act 在浏览器工作流上准确率超过 90%,典型六步旅程耗时 2 到 4 分钟。方案通过 EventBridge 调度,由 AgentCore Runtime 管理浏览器会话生命周期。

    HTTP level surfaces through the agent’s SNS publish, not through these CloudWatch alarms. Focus synthetic monitors on high-value customer journeys rather than exhaustive page coverage. Over-monitoring creates noise that desensitizes teams to real failures. Start with 3-5 critical workflows (login, checkout, account access) and expand based on actual failure patterns and business impact. Monitor journeys that directly affect revenue or customer trust, not every possible user path. Similarly, avo

    匹配字段正文

  2. AWS Machine Learning

    如何跨账户自动化管理 Amazon Textract 适配器生命周期

    AWS 发布方案,用 CloudFormation 和 Terraform 模板自动化 Amazon Textract 适配器跨账户生命周期管理,把适配器 ID 外置到 AWS Systems Manager Parameter Store 后,更新生产适配器引用可零停机、无需重新部署应用,原本数小时到数天的协调缩短到几秒。方案覆盖适配器晋升、文档路由和生产安全配置,并给出跨账户复制与集中式 Hub 账户两种架构;适配器类型无关,同样适用于 Forms 和 Tables 适配器。

    exceed the 10 MB synchronous limit, use the asynchronous StartDocumentAnalysis API. This follows the same adapter and query configuration but adds an OutputConfig for S3 result storage and optionally a NotificationChannel for completion alerts through Amazon Simple Notification Service (Amazon SNS). See async analyze.py for the complete implementation. Understanding when to create a new adapter versus a new version of an existing adapter is critical for maintaining a clean, manageable adapter in

    匹配字段正文

  3. Data Center Knowledge

    超级电容器能否平抑 AI 负载的功率波动?

    IDTechEx 2026 年 9 月报告指出,超级电容器在数据中心承担电压稳定、削峰和短时备电三种角色,可在毫秒至秒级充放电以跟踪 AI 训练周期;其数据中心市场预计 2037 年达 9.5 亿美元,2026 年起年复合增长率 40.9%。EDLC 典型备电约 2 分钟,部分混合型可达 10 分钟,专家普遍认为它是 UPS 与电池的补充而非替代。

    ,瞬时负载瞬变可达电源架额定容量的150%以上。” 机架设计者正在构建灵活性,而非锁定单一架构。“机架设计通常包含专用插槽,可容纳BBU(电池备电单元)、CBU(电容器备电单元)或混合配置,从而提供部署灵活性,”Butler说。“供应链问题仍是主要障碍,尤其是对合格供应商有限的新兴混合型超级电容器技术而言。” Exelon能源政策与电力市场首席量化工程师Parag Nathaney将采用速度与数据中心运行的可靠性门槛联系起来。他告诉《Data Center Knowledge》,该技术必须达到99.999%的供电可靠性,这也是他认为市场仍处于早期阶段的原因。 “超级电容器正朝着更大规模部署推进,但当前状态仍以试点和早期商业化为特征,”Nathaney说。 DIMAAG首席技术官Ian Wright主张,决定响应时间的是DC-DC转换环节,而非器件本身。DIMAAG设计的电池系统旨在避免使用超级电容器。“对负载变化的响应速度随后由DC/DC决定,而它会比电容器或电池都慢,”Wright告诉《Data Center Knowledge》。“如果超级电容器经过尝试却未观察到发热,那很可能是因

    匹配字段正文

  4. ElevenLabs Blog精选

    ElevenLabs 发布 Eleven v4,用 Audio Tags 逐句导演情感语音

    ElevenLabs 发布情感文本转语音模型 Eleven v4,可在脚本中用 [furious]、[sarcastic]、[crying] 等 Audio Tags 逐句指定情绪,模型会据此调整语气、节奏和停顿,并加入叹息、笑声等非语言声音。官方建议一次生成整段文本以建立场景上下文,TTS 应用单次最多支持 10,000 字符,每个句段只用一个情绪标签,效果不理想时优先替换标签而非改写文本。

    difference between tagged and untagged audio as an example. In this first sample, we’re just using a default sentence. For reference, we’re using Siren for these examples. Story paragraph without Audio Tags on Eleven v4 Now, this second example has the same sentence with Audio Tags added. We’ve got emotional cues, sound effects, and even noises beyond the text, like an evil laugh. Story paragraph with Audio Tags on Eleven v4 Five emotional text to speech performances with Eleven v4 The best way

    匹配字段正文