←搜索结果

按匹配度 · 共 174 条结果 清除搜索

星期五

  1. LMSYS Blog精选

    LMSYS 公开 infer-forge:围绕 SGLang 的 Harness、Loop 与 Graph 工程方法

    LMSYS 发布 infer-forge 方法论文,介绍围绕 SGLang 的推理工程系统,由 MonoRepo、Harness、Task Loop 和 Task Graph 四层结构组成,用于让跨仓库的推理优化工作可复现、可验证。该系统为内部工程系统,并非 SGLang 或 LMSYS 官方组件,目前不开源,文章公开的是构建方法论,供团队交给 AI 编码工具并结合自身系统上下文搭建适配实现。文中给出使用记录:一位工程师 4 月至 7 月的在飞任务峰值从 2 个升至 9 个,DeepSeek-V4-Pro 服务项目中 38 个可独立验证的任务节点被组织成任务图。

    The inference deployment space stacks five layers of static configuration. Model shows Ling, Qwen, DeepSeek, Kimi, GLM, and MiniMax. Serving Scenario runs Modality (text, image, video) into Traffic Shape (input and output length, media count, resolution, QPS, concurrency, cache reuse) into SLO (TTFT, TPOT, throughput, E2E latency). Serving Topology separates Deployment Architecture—Colocated PD, PD Disaggregation, and EPD Disaggregation, each listing the node roles it is built from — Prefill and Decode together, then Prefill and Decode as separate roles, then Encoder alongside them — from Parallelism—TP, PP, DP, and EP—because the two are chosen independently. Versioned Runtime Profiles is a stack of tabbed cards labelled Service A rev. 12, Service B rev. 7, and Service C rev. 21, plus a fourth paler card behind them all, blank and showing only its top edge, whose narrow tab carries an ellipsis for the profiles not drawn, the front card holding an Engine Configuration and a Container I

    op Engineering, June 7, 2026; Sydney Runkle — The Art of Loop Engineering, LangChain, June 16, 2026; Prithvi Rajasekaran — Harness design for long-running application development, Anthropic, March 24, 2026; Erik Schluntz and Barry Zhang — Building Effective AI Agents, Anthropic, December 19, 2024; SGLang Team — Agent-Assisted SGLang Development: An Initial Exploration, LMSYS Org, July 2, 2026; Lilian Weng — Harness Engineering for Self-Improvement, Lil'Log, July 4, 2026; Boye Niu et al. — Flow:

    匹配字段正文

星期三

  1. Fireworks AI

    Fireworks 实测 DeepSeek V4 Pro 在 CyberGym 安全任务上的成本与通过率

    Fireworks 在 CyberGym 的 697 个共同有效任务上测试 DeepSeek V4 Pro 0813,其奖励率为 53.7%,每个成功任务成本 2.502 美元,约为 Kimi K3 的一半。Kimi K3 的奖励率最高,为 68.4%,但每个成功任务成本为 4.914 美元;GPT-5.5 的奖励率为 47.6%,每个成功任务成本为 9.641 美元;Claude Opus 4.8 的奖励率仅为 5.9%,每个成功任务成本为 33.275 美元。测试中,DeepSeek V4 Pro 在 840 个任务上全部产生原生工具调用,没有出现拒答或输出截断;一旦通过第一阶段验证,它完成完整补丁的比例为 94.7%。

    ergym cohort of 697 tasks, we saw the following results: ModelReward Rate$/task$/rewardKimi K368.4%$3.363$4.914Deepseek V4 Pro 081353.7%$1.343$2.502Open AI GPT 5.547.6%$4.592$9.641Anthropic Opus 4.85.9%$1.957$33.275 What did each model uncover in this testing? Of the 697 tasks, 38 were solved by Deepseek V4 Pro and nothing else. K3 uniquely solved 97, GPT-5.5 got 41, and Opus 4.8 got exactly one. Opus wasn’t only scoring low, it was almost never the model that found something the others missed.

    匹配字段正文

星期五

  1. Together AI Blog

    GLM-5.3 与 Claude Fable 5 在 DeepSWE 上的成本、编码与路由对比

    Together AI 在全部 113 个 DeepSWE 任务上各跑 4 次、共 904 次 rollout,GLM-5.3 与 Claude Fable 5 的 pass@1 分别为 69.0% 和 69.7%,基本持平。GLM-5.3 每次 rollout 成本 3.99 美元,Fable 5 为 21.63 美元,相差 5.4 倍,且 GLM-5.3 在 pass@2(81.1% 对 77.1%)、pass@4(87.6% 对 84.1%)和覆盖率上领先。两者逐任务相关性 0.65,属于近似替代品,作者建议多数场景默认用 GLM-5.3,仅在 Rust 和序列化相关任务上升级到 Fable 5。

    serialization-critical work. Yes. GLM-5.3 is an open-weight model, so it can be self-hosted or served through inference providers such as Together AI. Claude Fable 5 is a closed model available only through Anthropic and its partners. pass@k measures whether at least one of k attempts at a task passes the hidden test suite. pass@1 rewards getting it right on the first try, and higher k rewards a model that can eventually reach a solution across several tries. GLM-5.3's edge grows as k increases.

    匹配字段正文

星期五

  1. Hugging Face

    使用 Strands Agents、LeRobot 与 Hugging Face Storage Buckets 在一处完成录制、训练和部署

    Strands Robots 将 LeRobotDataset 的录制、同步、流式训练和实体机器人部署整合到同一 Robot() 工作流,并让新演示数据返回同一 Storage Bucket。Xet 按字节去重,仅上传变化的数据块;stream_dataset() 可从 Hub 逐帧读取远程 Parquet 与 MP4 分片,无需完整下载。Bucket 仅支持流式读取且不保留修订记录,真实部署还需隔离数据与凭据、限制智能体权限并只加载可信组织的模型。

    3.12+, on Linux or macOS (Apple Silicon supported for the MuJoCo backend). A Strands-compatible model provider for the agent's reasoning. Amazon Bedrock with AWS credentials, the Anthropic API , OpenAI, or Ollama running locally. Strands Robots with the dataset extras: uv pip install -U "strands-robots[sim-mujoco,lerobot] =0.5.1" . The lerobot extra pulls in LeRobot ( =0.6.1), datasets , av , and torchcodec , so recording and video decode both work without further setup. Refer to installation g

    匹配字段正文

星期三

  1. OpenRouter:Announcements

    OpenRouter 发布实时网页搜索基准:为智能体挑选合适的引擎、深度与模型

    OpenRouter 上线实时网页搜索基准页面,用 BrowseComp、DeepSearchQA、WideSearch 和 HLE 四套基准,在多个模型、引擎与搜索配置上按质量、性价比和速度排名。结论显示搜索预算的影响最大,从 1 轮提升到 25 轮大致让分数翻倍,成本增加 2.5 至 7 倍;模型差异平均 15 分,大于引擎差异的 10 分。用户可通过 web plugin、server tool、engine 和 max_tool_calls、max_results 等参数自行配置。

    Live Web Search Benchmarks: Pick the Right Engine, Depth, and Model for Your Agent

    e a specific engine or rely on the bundled engines offered by some labs. On OpenRouter, we offer Exa, Parallel, and Perplexity, alongside the native engines from labs like OpenAI, Anthropic, and Google; Search method. Either you can perform the search before calling the model and pass the results in as context, or you can equip the model with a web search tool that it calls at its discretion; Search budget. If you choose the search tool method, you can also give the model a budget for how many s

    匹配字段正文

星期五

  1. The Register

    测试游戏显示人工审批漏掉约三分之一危险 AI 编码智能体请求

    比利时开发者 Alex Wauters 制作的浏览器游戏让玩家在 60 秒内审批模拟的 Claude Code 权限请求,超过 4 万次运行、40.9 万条命令的数据显示,平均约三分之一的恶意命令被放行。最常被漏掉的是范围越权类请求,占比 35%,例如读取 Kubernetes 配置文件或 AWS 凭据;被漏掉最多的单条命令是 npm run analyze,近 65% 的玩家批准了它。Wauters 认为反复审批会带来疲劳,建议把编码智能体放进沙箱和云端 devcontainer,并配合 auto mode 与钩子来拦截风险动作。

    iterate until then,” Wauters told us, describing the potential outcome of that situation as a recipe for disaster. That’s borne out in more than just browser game scenarios, too. Anthropic pointed out in a May post about containing Claude (hah), that telemetry from Claude Code shows users approve around 93 percent of permission prompts. “The more approvals a user sees, the less attention they pay to each, becoming over time much less diligent in their supervision,” the company said. In other wo

    匹配字段正文

星期五

  1. Together AI Blog

    Together AI 对比 Kimi K3 与 Claude Fable 5 的 DeepSWE 编码表现与成本

    Together AI 在 DeepSWE 基准上对比 Kimi K3 与 Claude Fable 5:Fable 5 在 xhigh 设置下 pass@1 为 69.9%,Kimi K3 max 为 68.5%,但 Kimi K3 在 pass@2(82.0 对 80.2)和 pass@4(89.4% 对 88.5%)上反超。成本方面,Kimi K3 每次 rollout 为 4.65 美元,Fable 5 为 13.41 美元,每 100 美元分别完成 14.7 与 5.3 个任务。Kimi K3 是 Moonshot AI 的开源权重模型,可自托管或通过推理服务商部署。

    eature requests from live open-source repos, four trials each, graded pass/fail by a hidden test suite. We analyzed all of them against Claude Fable 5 at its best setting (xhigh), Anthropic’s strongest configuration and the former benchmark leader. Every figure below comes from this run, so it can differ from other public Kimi K3 vs Claude Fable 5 scorecards. Fable xhigh solves 69.9% of tasks on the first try under DeepSWE’s official scoring. Kimi K3 max solves 68.5%. One point four between an o

    匹配字段正文

星期六

  1. Ahead of AI精选

    Sebastian Raschka:如何用开源工具搭建本地编码智能体

    Sebastian Raschka 演示了如何用 Ollama、本地开放权重 LLM 和 Qwen-Code 搭建可读写文件、运行命令并验证修改的本地编码智能体。文章还介绍了安全审计、性能测试及 Codex、Claude Code 的接入方式;其小规模评测中,Codex 使用更少 token,而 Claude Code 在部分模型组合上取得更高任务成功率。

    the privacy angle. For example, for organizing and processing my receipts, I’d be more comfortable with a local model ingesting them rather than sending the data over to OpenAI or Anthropic. (Then, if we keep in mind that Anthropic was recently throttling their flagship model’s performance for LLM research, proprietary services may become more restrictive over time, and it’s maybe a good idea to be comfortable with open-weight alternatives as a backup.) And there are many, many additional reason

    匹配字段正文

星期三

  1. One Useful Thing

    智能体时代该用哪个 AI:模型、应用与 harness 指南

    Ethan Mollick 发布第八版 AI 使用指南,指出使用 AI 已从聊天转向智能体,选型需同时考虑模型、应用和 harness 三层。他给出的三大前沿模型是 GPT-5.2/5.3、Claude Opus 4.6 和 Gemini 3 Pro,并建议做实际工作时手动选择高级模型而非默认的自动模式。他认为模型差距已经缩小,应用与 harness 的差异更关键,Claude Code、Claude Cowork、OpenAI Codex 等工具在工具调用和自主执行上领先,Gemini 网页端在生成文档和引用方面仍较弱。

    stupid, it is because they are either using the free models or because they have not selected a smarter model to work with. The big three frontier models are Claude Opus 4.6 from Anthropic, Google’s Gemini 3.0 Pro , and OpenAI’s ChatGPT 5.2 Thinking . With all of the options, you get access to top-of-the-line AI models with a voice mode, the ability to see images and documents, the ability to execute code, good mobile apps, and the ability to create images and video (Claude lacks here, however)

    匹配字段正文

星期六

  1. Browser Use

    Browser Use 发布 BU Bench V1:100 项浏览器任务评测基准

    Browser Use 开源了首个评测基准 BU Bench V1,包含 100 项从五个来源挑选的高难度浏览器任务,任务集加密以防训练污染。评测由 gemini-2.5-flash 以真/假二元判定打分,与人工标注的一致率为 87%。结果显示 Browser Use Cloud 得分 78%,比最好的开源模型高 16 个百分点,且以约每小时 14 个任务成为最快方案;基准代码已开源于 github.com/browser-use/benchmark。

    Use Cloud leads at 78%, 16 points ahead of the best open-source model. Each model was evaluated multiple times and results include error bars (standard error). Update (June 2026): Anthropic's claude-fable-5 set a new high score of 80.0% running on the open-source library, beating the next-best frontier model (GPT 5.5) by 12 points — though at $580.87 in API cost per 100-task run. See the full breakdown in our Claude Fable benchmark post. The "Open Source" column means running the open-source Bro

    匹配字段正文

星期三

  1. Ahead of AI精选

    DeepSeek V3 至 V3.2 模型技术演进全览

    DeepSeek V3.2 延续 V3 系列架构,并引入 DeepSeek Sparse Attention、自验证、自改进及多项 GRPO 训练调整。文章梳理了 V3、R1、V3.1、V3.2-Exp、DeepSeekMath V2 和 V3.2-Speciale 的演进,解释 MLA、RLVR 与混合推理模式等关键机制。更新部分还介绍了用于改善训练稳定性和收敛表现的 mHC 残差路径研究。

    ek V3 as a base model) helped DeepSeek become one of the most popular open-weight models and a legit alternative to proprietary models such as the ones by OpenAI, Google, xAI, and Anthropic. So, what’s new since V3/R1? I am sure that the DeepSeek team has been super busy this year. However, there hasn’t been a major release in the last 10-11 months since DeepSeek R1. Personally, I think it’s reasonable to go 1 year for a major LLM release since it’s A LOT of work. However, I saw on various socia

    匹配字段正文

星期日

  1. Mario Zechner 原创博客精选

    不使用 MCP,如何用 Bash 和代码构建轻量智能体工具

    Mario Zechner 提出,许多智能体任务无需 MCP,可让编码智能体通过 Bash 调用简洁的 CLI 工具并编写代码。其浏览器工具以 Puppeteer Core 实现启动、导航、执行 JavaScript 和截图等能力,README 仅占 225 tokens;相比之下,Playwright MCP 的 21 个工具占 13.7k tokens,Chrome DevTools MCP 的 26 个工具占 18.0k tokens。这种方式可按需载入说明、串联调用并快速修改输出格式或增加工具,但需要自行设计和维护工具结构。

    does this compare to the MCP servers I mentioned above? Well, to start, I can pull in the README whenever I need it and don't pay for it in every session. This is very similar to Anthropic's recently introduced skills capabilities. Except it's even more ad hoc and works with any coding agent. All I need to do is instruct my agent to read the README file. Side note: many folks including myself have used this kind of setup before Anthropic released their skills system. You can see something simil

    匹配字段正文

星期一

  1. Vapi Blog

    什么是 Gemma 3?Google 开源权重模型的能力与部署解析

    Vapi 博客介绍 Google 于 2025 年发布的开源权重模型 Gemma 3,它基于 Gemini 2.0 研究,支持文本、图像和视觉输入,可在单 GPU/TPU 上运行,支持 140+ 语言和最高 128k token 上下文,并提供 1B、4B、12B、27B 四种尺寸。文章称 Gemma 3 在人类偏好评测中优于 Llama3-405B 和 DeepSeek-V3,27B 版本在 LMArena Elo 榜得 1338 分,高于 DeepSeek-V3 的 1318 和 o3-mini 的 1304。经量化感知训练后,1B 模型显存占用最低 861 MB(INT4),27B 为 19.9 GB(INT4);该模型已内置在 Vapi 控制台的 LLM 下拉菜单中。

    ts with Jev Build vs. buy: what you're really deciding with voice agents What makes a great conversational AI experience? Why model flexibility matters in voice Questions from the Anthropic and Vapi Webinar, answered. Built for the Ear: Designing Conversations for Voice How we Bootstrapped the Voice Agents on the Vapi Homepage AGI is here. Why am I still on hold? Introducing Vapi Monitoring Vibe code voice agents Your Voice Agents Need Tests. Now They Have Them. GPT-5.1 Just Fixed the Thing That

    匹配字段正文

星期一

  1. Mario Zechner 原创博客精选

    把提示词当代码:用 port.md 和 JSON 状态做跨语言代码移植

    作者提出把 LLM 视为一台缓慢且不可靠的计算机,用自然语言编写程序:提示词是程序,JSON 和 Markdown 文件是持久状态,工具调用是 I/O。他以 Spine 运行时从 Java 到 C++ 的移植为例,用 port.md 定义工作流、用 porting-plan.json 记录每个类型的 portingState 以便随时恢复,并借助 jq 精确读写状态、通过 MCP 扩展在 VS Code 中保留人工检查点。原本需要 2-3 周的移植工作现在缩短到 2-3 天,但复杂类型层级和执行流仍需人工判断。

    centive? Cut down your context to save money, which means the LLM might miss crucial information or get it in a suboptimal format. Claude Code is different. It comes straight from Anthropic with no middleman trying to squeeze margins. With the Max plan, you get essentially unlimited tokens (though folks like Peter manage to get rate limited even with three or four accounts). You still don't have full control: there's a system prompt you can't change, additional instructions get sneakily injected

    匹配字段正文