←搜索结果

按匹配度 · 共 398 条结果 清除搜索

星期五

  1. Together AI Blog

    Together AI 对比 Kimi K3 与 Claude Fable 5 的 DeepSWE 编码表现与成本

    Together AI 在 DeepSWE 基准上对比 Kimi K3 与 Claude Fable 5:Fable 5 在 xhigh 设置下 pass@1 为 69.9%,Kimi K3 max 为 68.5%,但 Kimi K3 在 pass@2(82.0 对 80.2)和 pass@4(89.4% 对 88.5%)上反超。成本方面,Kimi K3 每次 rollout 为 4.65 美元,Fable 5 为 13.41 美元,每 100 美元分别完成 14.7 与 5.3 个任务。Kimi K3 是 Moonshot AI 的开源权重模型,可自托管或通过推理服务商部署。

    (pass@1 69.9% vs 68.5%) and solves more tasks four-for-four. Kimi K3 wins pass@2 and pass@4 and costs far less, so it is the stronger value pick for high volume or retry-tolerant agent work. In our run, Kimi K3 cost \$4.65 per rollout versus \$13.41 for Claude Fable 5 at its xhigh setting, roughly a third of the price. Measured per solved task, Kimi K3 returned 14.7 solves per \$100 against Fable's 5.3, about 2.8x the work per dollar. Yes. Kimi K3 is an open-weight model from Moonshot AI, so on

    匹配字段正文

星期六

  1. Ahead of AI

    如何控制大语言模型的推理力度

    文章解释了大语言模型如何通过不同推理力度,在回答质量、token 消耗、成本和延迟之间进行权衡。其实现通常结合混合 SFT 数据、按模式调整的 RL 奖励、长度惩罚、独立专家模型或硬性 token 预算;DeepSeek V4、Nemotron 3 Ultra、Kimi K3、GLM-5、Qwen3 和 Inkling 采用了不同组合。模型规模与推理力度是两套独立控制方式,较小模型提高推理力度有时可达到与较大模型降低推理力度相近的基准成绩。

    ected token budget, its reward is instead set to -1. This gives the model a strong incentive to stay within the budget. (The exact reward setup is different for non-verifiable and agentic tasks, and Kimi also uses learned reward models and pairwise comparisons.) To have Kimi K3 support the three reasoning effort modes, the training looked as follows. First, the researchers start by training a max-effort version (“specialist”) with a relatively generous budget. They then lower the budget to train

    匹配字段正文

星期五

  1. Hugging Face

    PyTorch 性能分析(第三部分):剖析注意力后端

    本文通过 PyTorch Profiler 对比朴素注意力与 SDPA 的 math、efficient、flash 和 cuDNN 后端,揭示不同实现的执行开销。原地 masked_fill_ 可在无梯度前向中消除一次 Memcpy;math 后端因 FP32 转换、重复构造掩码等操作启动 20 个 GPU kernel,慢 3.7 倍,而其余后端将计算融合为单个 kernel。测试形状下 FlashAttention-2 最快,其低占用率源于大量使用片上资源,并不代表优化不佳。

    w go profile something. 🤗 Thanks to Noe Flandre for their reviews on the early draft of the post! The blog post was polished using an LLM. This in no way means that we have let an agent run in the background and let it generate the blog. Some of us in the team are non-english speakers and think LLMs (which are mostly trained in the English Language) can rectify silly grammar mistakes or rephrase sentences that sound less intimidating and cleaner. Hope this helps with the idea of "why should I re

    匹配字段正文

星期一

  1. Hugging Face精选

    PRX 第4部分:我们的数据策略

    Photoroom 为 7B 文生图模型 PRX 构建了兼顾规模与多样性的预训练数据管线,以 Lance 完成探索和整理,再转换为 MDS 供分布式训练。团队用 Qwen3-VL-8B 重新生成详细图像描述,并采用 quality 92 的 JPEG、分辨率与宽高比分桶。文本分类和感知哈希通过跳过列表过滤文本密集、NSFW 及近重复样本,无需重写数据集。

    ext • 10B • Updated Mar 2 • 9.28M • 2.08k xtuner/llava-llama-3-8b-v1 1 Image-Text-to-Text • 8B • Updated Apr 28, 2024 • 34 • 120 Spaces mentioned in this article 1 Running on Zero Agents Featured 37 PRX Pixel 📷 37 Public test Space for pixel-space PRX t2i Collections mentioned in this article 1 Qwen3-VL 782 More from this author PRX Part 3 — Training a Text-to-Image Model in 24h! 69 March 3, 2026 Training Design for Text-to-Image Models: Lessons from Ablations 77 February 3, 2026 Community Thank

    匹配字段正文

星期四

  1. Trail of Bits Blog

    GPT-5.5-Cyber 一天内为 zlib 搭建模糊测试实验室

    Trail of Bits 在 Patch the Planet 项目中用 Codex 的 /goal 命令驱动 GPT-5.5-Cyber,一天内为 zlib 搭建了覆盖十余个入口的模糊测试流程,包括 harness、sanitizer 构建和种子,并发现多个待协调披露的漏洞。模型自行判断静态审查价值有限,转而构建动态测试工具,并主动放弃一个在真实条件下难以触发的 inflateBack 空回调崩溃。作者认为,定制化模糊测试的专家门槛正在消失,攻防双方都能更快发现漏洞。

    was real, but reaching it required a caller to set up a state that was extraordinarily unlikely in real-world conditions, so the model logged it as unreachable and moved on. This agent kept going without human intervention and found several higher-impact issues. That discipline is the whole game. The value of the zlib harness came from automation plus a strict definition of what counted as a reportable finding . Without strong validity rules baked into the goal and a model truly capable of eval

    匹配字段正文

  2. LMSYS Blog

    LMSYS 分享 SGLang 智能体辅助开发实践:从 SKILL 到 SOTA 循环

    LMSYS 发布博客,介绍 SGLang 智能体辅助开发的初步探索,把 CUDA 崩溃调试、内核集成、测试、CI、性能剖析、生产排障等仓库级流程写成可执行的 SKILL.md 与脚本。文中给出 llm-torch-profiler-analysis 与 llm-pipeline-analysis 两个剖析技能,前者输出 kernel、overlap、fuse 三类固定表格,后者按前向传播与层拆分 trace。基于 KDA-Pilot 的 10 个 B200 扩散内核任务中,多数在提取的生产行上取得 1.1341x 至 2.7499x 的 wall-geomean 加速,截至 2026 年 6 月 27 日已有三个优化合入 SGLang 上游。

    Contents 1. TL;DR; 2. Why SGLang Is a Good Fit for Agent-Assisted Development; 3. From Prompt Engineering to SKILL: Protocols and Examples; 3.1 Current Skill Stack; 3.2 Recent Optimization and Workflow Examples; 4. Profiling, Review, and Loop Engineering; 4.1 Humanize/RLCR: Adding External Review to the Loop; 4.2 SGLang SOTA Performance Loop (Loop Engineering); 4.3 Codex Goal: A Lower-Cost Loop Implementation; 5. KDA-Based CUDA Kernel Optimization for SGLang Systems; 6. Practice Rules; 7. Acknow

    匹配字段正文

星期二

  1. Air Street Press

    ElevenLabs 工程师解析如何缓解 AI 推理算力短缺

    ElevenLabs 研究工程师 Angelos Perivolaropoulos 介绍了如何通过标准工程优化,将语音推理的单 GPU 服务能力从 1 名用户提升至 70 名,架构级改造则可达到约 140 名。连续批处理、FP8 量化、多 token 预测和经蒸馏适配的 FP8 KV cache 是主要手段,其中 KV cache 缩小 2.5x 后,吞吐量从 28 名用户增至 70 名。各项技术会引入延迟、内存上限或质量损失,实际选择取决于具体工作负载。

    are subsidized, by one audience estimate a factor of ten to forty. Angelos’s hope is that optimization, not subsidy, eventually closes that gap. The largest models, he said, have to be subsidized to make economic sense, but he expects smaller, Sonnet-class models to become good enough for nearly all everyday use, at margins that actually work. He already sees the shape of it in agent systems: route each request to the smallest model that can handle it, and reserve the expensive one for planning.

    匹配字段正文

星期六

  1. Ahead of AI精选

    Sebastian Raschka:如何用开源工具搭建本地编码智能体

    Sebastian Raschka 演示了如何用 Ollama、本地开放权重 LLM 和 Qwen-Code 搭建可读写文件、运行命令并验证修改的本地编码智能体。文章还介绍了安全审计、性能测试及 Codex、Claude Code 的接入方式;其小规模评测中,Codex 使用更少 token,而 Claude Code 在部分模型组合上取得更高任务成功率。

    Many people reached out to me in the past asking about my local agent stack as well as how I set up my local agent stack. So, I thought it might be useful to put together a little tutorial on how to set up a local (coding) agent using open-source tools and open-weight LLMs. This article is a tutorial on setting up a production-ready coding agent with a fully local stack. We will use a locally served LLM together with a local coding harness that can read files, make edits, run commands, and verif

    匹配字段正文

星期四

  1. Air Street Press精选

    Revolut 如何规模化运行 AI

    Revolut 通过统一网关和按 AI 用例治理的控制层,在受监管的银行环境中运行生成式 AI,并为每个生成式产品设置模型回退链。其平台支撑的生成式用例约为传统机器学习用例的两倍,按任务选择满足要求的较小模型可将成本最多降低 8 倍且不损失质量。语音服务已覆盖 20 个国家、每月处理约 25,000 通电话,AIR 则结合交易数据分析支出并回答金融相关问题。

    sponse comes back in under two seconds. It now runs in 20 countries, handles around 25,000 calls a month, and resolves a customer’s problem roughly eight times faster than a human agent. AIR, the latest layer, followed in Q2 2025 and pulls in transactional data: it can break down your spending, propose hotels inside a budget computed from your own history, or explain why a stock is moving. Across the arc from the old chatbot to today, the share of cases resolved without a human climbed from 17%

    匹配字段正文

星期一

  1. Browser Use

    Browser Use 如何把云浏览器成本降到三分之一并加快启动

    Browser Use 重建了云浏览器基础设施,把每个浏览器会话从每小时 0.06 美元降到 0.02 美元,并让新会话在 1 秒内启动。它改用 Firecracker 在普通 EC2 上为每个会话运行独立微型 VM,通过 2MB 大页、自定义 userfaultfd 处理等把恢复 VM 到可接受命令的时间从 9.8 秒降到 3.1 秒,页错误处理次数从约 10 万次降到约 1100 次。VM 冷启动低于 400ms,公开 API 的浏览器创建延迟为 p50 825ms、p99 1.35s,该基础设施已上线。

    Browser Use: how we made cloud browsers 3x cheaper — every browser is its own Firecracker microVM on regular EC2, at $0.02 per browser hour with sub-400ms VM cold start and headless stealth.

    oom. That machine restores a saved browser VM, starts Chromium inside it, waits until Chromium is ready to be controlled, and returns a connection URL. That URL is what the user's agent connects to. Browser Use controls Chromium over a WebSocket using the Chrome DevTools Protocol, or CDP. CDP is the remote-control API for Chrome: click this button, type this text, read this page, take this screenshot. Three things made this take longer: restoring the VM's memory, launching Chromium, and keeping

    匹配字段正文

星期三

  1. Linear:Now

    Linear 如何在 AI 智能体时代审查代码

    Linear 介绍了团队如何使用 Diffs 应对 AI 智能体带来的代码评审量增长,将评审重点从逐行查错转向判断改动是否解决正确的问题。1 月至 3 月,其创建的 issue 总数和合并的 PR 数量均增长 50%。评审者可结合需求背景、预览构建、引导式 diff 和内置智能体处理反馈,并把更多时间用于边界情况、用户体验和替代方案。

    Abstract image showing connected nodes.

    about why we built the feature and how we use it ourselves today. Like a lot of people who build software, I felt the ground shift at the start of 2026. The models got better, the agents got better with them, and almost overnight the amount of code moving through my team went up. Between January and March our total issues created and PRs merged both climbed by 50%. That was exciting, and it was also a problem. With that much code moving, I felt the pull to “looks good!” my way through reviews ju

    匹配字段正文

  2. Browser Use精选

    Claude Fable 5 在 BU Bench 拿下 80% 高分

    Browser Use 用开源 Browser Use 库在 BU Bench V1 上测试 Anthropic 的 Claude Fable 5,得分 80.0%,比第二名 GPT 5.5 高出 12 分。100 个任务中通过 80 个,20 个失败里 16 个判定错误、4 个触发 30 分钟超时,平均每任务耗时 6 分 53 秒,100 个任务 API 成本为 580.87 美元。Fable 的失败主要来自提取错误事实或选错实体、无法充分访问或搜索来源、答案缺乏轨迹支撑,与 GPT 5.5 常因多步骤任务未完成而失败的模式不同。

    ng a high score, it bested the next-highest model, GPT 5.5, by 12 points. The result came at an exorbitant price: $580.87 in API cost for 100 tasks. BU Bench tests whether browser agents can complete real web tasks. It requires agents to handle multi-step navigation, search, information extraction, form filling, dynamic UI interactions, iframes, PDFs, downloaded files, and synthesis across live websites. Its tasks, code, and model scores are available here. Below is Claude Fable 5 compared to ot

    匹配字段正文

星期三

  1. Anthropic:Claude.dev 开发者博客精选

    Anthropic 构建 Claude Code 的经验:如何设计和使用技能

    Anthropic 总结了内部构建和扩展数百个 Claude Code 技能的经验,将其归纳为九类,并介绍设计、分发、组合与衡量方法。团队发现产品验证类技能对 Claude 输出质量的改善最易衡量,而高质量技能应突出易错点,利用文件系统渐进披露上下文,并通过脚本、配置和按需 hooks 提升可靠性。

    A three-by-three grid of skill categories with example skill names: Library and API Reference, Product Verification, Data and Analysis, Business Automation, Scaffolding and Templates, Code Quality and Review, CI/CD and Deployment, Incident Runbooks, Infrastructure Ops.

    type of skills are worth making? How do you structure a skill? When do you share them with others? WHAT ARE SKILLS? Skills are folders of instructions, scripts, and resources that agents can discover and use to do things more accurately and efficiently. This blog post assumes familiarity with skills basics; if you’re new, start with our Introduction to agent skills course on Skilljar. A common misconception we hear about skills is that they are “just markdown files.” They’re actually folders tha

    匹配字段正文

星期五

  1. Together AI Blog精选

    Together AI 如何构建全球最快的语音转文字技术栈

    Together AI 优化 ASR 全链路,使 NVIDIA Parakeet-TDT 0.6B v3 可在不到 10 秒内转录约 20 小时语音,并与 OpenAI Whisper Large v3 一同成为 Artificial Analysis 排名中延迟最低的两款模型。其方案采用多配置 TensorRT、条件 CUDA 图、Unix 域套接字、共享内存和 epoll,解码器提速 2–3 倍。通过 gc.freeze() 排除预分配对象的 GC 扫描后,约 200 ms 的 p95 延迟尖峰也随之消失。

    fic patterns. The lesson was to keep profiling beyond the model. GPU time, queue depth, and model execution all looked normal; the latency spike lived in the Python runtime. Voice agents usually run as a cascade: ASR produces a transcript, an LLM generates the response, and TTS produces audio. ASR is the first stage in that path, so its latency and jitter set the earliest bound on user-visible response time. The optimizations above target different parts of that path. TensorRT multi-profile engi

    匹配字段正文

星期三

  1. Anthropic:Claude.dev 开发者博客

    Claude Code 团队成员为何用 HTML 替代 Markdown 生成输出

    Claude Code 团队成员分享了用 HTML 替代 Markdown 生成规划、代码审查、原型和报告的方法,以获得更高的信息密度、视觉清晰度、可分享性与交互能力。用户只需提示 Claude Code 创建 HTML file 或 HTML artifact,也可结合文件系统、MCP、浏览器和 git history 汇集上下文。文章还建议为定制编辑界面加入 copy as JSON、copy as prompt 等导出功能,让调整结果能够返回 Claude Code 或写入文件。

    Eight kinds of information a single HTML file can carry: tables, design, illustrations, code, interaction, workflows, spatial layouts and images.

    y members of the Claude Code team use HTML instead of Markdown to produce richer, more readable, and easily shareable outputs. Markdown has become the dominant file format used by agents to communicate with humans. It’s simple, portable, has some rich text capability and is easy to edit. Claude has even gotten surprisingly good at using ASCII to make diagrams inside of Markdown files. But as agents have become more and more powerful, I’ve found that Markdown has become an increasingly restrictiv

    匹配字段正文

星期六

  1. Ahead of AI

    近期大语言模型架构进展解析:KV 共享、mHC 与压缩注意力

    文章解析 Gemma 4、Laguna XS.2、ZAYA1-8B 和 DeepSeek V4 如何通过 KV 共享、分层注意力预算、mHC 与压缩注意力降低长上下文成本。Gemma 4 E2B 在 128K 上下文中可节省 2.7 GB KV cache,DeepSeek V4-Pro 在 1M-token 上下文下的单 token 推理 FLOPs 和 KV cache 分别降至 DeepSeek V3.2 的 27% 和 10%。这些设计显示 Transformer 架构正以更复杂但更具针对性的改动提升长上下文推理效率。

    up on a busy few weeks of open-weight LLM releases. The thing that stood out to me is how much newer architectures are focused on long-context efficiency. As reasoning models and agent workflows keep more tokens around (for longer), KV-cache size, memory traffic, and attention cost quickly become the main constraints, and LLM developers are adding a growing number of architecture tricks to reduce those costs. The main examples I want to look at are KV sharing and per-layer embeddings in Gemma 4

    匹配字段正文

  2. Augment Code 博客精选

    Augment Code 评测 Auggie 与 Claude Code 在 Opus 4.7 上的成本与质量

    Augment Code 在 Terminal Bench 2.0 和 SWE-Bench Pro 上对比了 Auggie CLI 与 Claude Code 使用 Opus 4.7 的表现,Auggie 通过更精准的上下文检索减少约 32% 的 token 消耗,成本降低约 33%,通过率略高。在私有代码库测试中,Auggie 每个通过任务的成本为 3.90 美元,低于 Claude Code 的 6.49 美元。

    Opus 4.7 for 33% less: How Auggie beats Claude Code on cost and quality

    minal Bench 2.0: a smaller, sharper context produces less work for the model and a meaningfully smaller bill at the end of the run. What’s driving the token efficiency Most coding agents assemble context through grep and keyword search. While this approach has improved in quality over time, it remains inefficient: agents burn turns crawling files, reading large spans of code, and pulling in irrelevant matches just to find the few lines that actually matter. Every miss costs another round trip, a

    匹配字段正文

星期二

  1. Modal 官方工程博客

    Modal 如何实现真正的无服务器 GPU

    Modal 官方工程博客详解其无服务器 GPU 方案,通过云缓冲、自定义文件系统 ImageFS、CPU 检查点恢复和 CUDA 检查点恢复四项优化,把 AI 推理服务副本的启动时间从约 2000 秒缩短到 50 秒,提速 40 倍。其中 GPU 内存快照让 vLLM 或 SGLang 服务约 1 GiB 模型(Qwen 3 0.6B bf16)的冷启动典型提速 4-10 倍,Reducto 的冷启动从约 70 秒降到约 12 秒。作者称该技术栈已在数千万个副本规模上运行,过去三个月有数百家组织使用 CPU 和 GPU 快照。

    Diagram indicating latency to scale up an inference server in a baseline cloud system and on Modal

    ssion to save bandwidth during transfer and avoid bottlenecking the network during decompression. But we also try to keep image creation fast, especially to better support dynamic agent workloads. You can fast-forward through tens of seconds of application host-side startup with CPU memory snapshotting. Now, let’s consider our third step: start the application program on the host, ready it to service requests (tens of seconds) This encompasses all of the work that needs to be done to go from the

    匹配字段正文

星期一

  1. Together AI Blog精选

    服务 DeepSeek-V4:为何百万 Token 上下文是推理系统问题

    DeepSeek-V4 通过 CSA、HCA 与 SWA 混合注意力在 KV 存储前压缩上下文,支持 1M-token 上下文窗口,但实际效率取决于推理引擎的缓存管理。Together AI 在 NVIDIA HGX B200 上调整 SWA 缓存策略后,将单节点 KV 缓存容量从约 1.2M tokens 提升至 3.7M tokens。长上下文、解码密集型任务最先受益,短上下文任务仍更依赖预填充优化与内核成熟度。

    Three diagrams comparing CSA, HCA, and SWA methods with different compression and KV token reads.

    e gap to hardware efficiency. Together is continuing V4 kernel work across the prefill and decode paths. Developers should benchmark V4 in their actual regime. A 1M-context coding agent and a short-context chat assistant exercise different parts of the serving stack. V4 widens the gap between workload shapes. Long-context agents benefit most directly from the architecture. They read large amounts of cache during decode, so V4's compressed KV layout, larger tensor-parallel configurations, batchin

    匹配字段正文

星期一

  1. Together AI Blog

    支撑大规模高效推理的基础研究

    Together AI 介绍其通过算法、系统工程和硬件协同优化大规模推理的方法,旨在提升速度与成本效率,同时维持输出质量和可靠性。生产 AI 系统的推理约占全生命周期成本的 80–90%,尽管 GPT-3.5 水平的推理成本曾下降逾 280 倍,总支出仍随用例扩张而增长。其技术包括可实现 1.5–3x 加速的推测解码,以及 ATLAS 和开源 RL 框架 Aurora 所支持的自适应推测解码。

    y shape their unit economics. Estimates put inference at 80-90% of the total lifetime cost of a production AI system , simply because it runs continuously across every user query, agent step, and API call. And while training is a bounded investment, inference scales with every new user and use case you ship. At NVIDIA GTC 2026, NVIDIA CEO Jensen Huang framed this shift plainly: “People pay for information, but people mostly pay for work. Agentic systems get work done.” That shift from AI as a no

    匹配字段正文