←搜索结果

按匹配度 · 共 1622 条结果 清除搜索

星期三

  1. Ollama Blog精选

    Ollama 上线 OpenAI gpt-oss-safeguard 安全推理模型

    Ollama 与 OpenAI、ROOST 合作,将 gpt-oss-safeguard 推理模型引入 Ollama,用于安全分类任务,提供 20B 和 120B 两个规模,采用 Apache 2.0 许可。该模型面向 LLM 输入输出过滤、在线内容标注和信任与安全场景,可读取用户自带的书面策略,并开放完整推理过程供调试,推理强度支持 low、medium、high 三档调节。OpenAI 在内部评测和 2022 年论文发布的审核数据集及 ToxicChat 上对其进行了评估。

    gpt-oss-safeguard_internal-moderation-eval

    accessible, high-quality, open source safety tools for digital organizations of all kinds in the age of AI. Established in 2025 by a diverse group of leading technology companies, philanthropic organizations and academic institutions, ROOST believes that solutions for online safety can best be achieved by providing organizations with innovative open source tools and technical support. Reference OpenAI blog; OpenAI gpt-oss-safeguard developer cookbook; ROOST’s model community repository on GitHub

    匹配字段正文

星期二

  1. Johann Rehberger / Embrace The Red

    Claude Pirate:利用 Anthropic 文件 API 实现数据外泄

    安全研究者 Johann Rehberger 披露一条针对 Claude 代码解释器的数据外泄攻击链:借助间接提示词注入,让 Claude 读取用户数据并写入沙箱文件,再用攻击者提供的 ANTHROPIC_API_KEY 调用 Anthropic Files API,把文件上传到攻击者账号,单次最多可外泄 30MB。作者指出默认的 Package managers only 网络配置允许访问 api.anthropic.com,因此并不安全;他于 10/25/2025 通过 HackerOne 向 Anthropic 报告,1 小时后被以超出范围关闭,10/30/2025 Anthropic 确认此类漏洞属于受理范围。缓解建议包括沙箱限制只能与登录用户账号通信、关闭该功能或仅允许特定域名。

    er. This is what the documentation statesabout the configuration: “Allow network egress to package managers only (default): Claude can access approved package managers (npm, PyPI, GitHub, etc.) to install necessary software packages. This balances functionality with security, but some advanced features may be limited.” The default setting is called “Package managers only”: That list of allowed domains is short and documented here as “Approved network domains”: This list seems quite limited. At s

    匹配字段正文

星期一

  1. MiniMax Blog精选

    MiniMax 开源并发布面向 Agent 与编码的 M2 模型

    MiniMax 正式开源并发布 MiniMax M2,定位为面向 Agent 与编码的模型,API 定价为每百万输入 token $0.30、每百万输出 token $1.20,约为 Claude 4.5 Sonnet 的 8%,在线推理 TPS 约 100。模型权重已在 Hugging Face 开源,支持 SGLang 与 vLLM 部署,推荐推理参数为 temperature=1.0、top_p=0.95、top_k=20,免费试用延长至 11 月 7 日 00:00 UTC。同时上线由 M2 驱动的 MiniMax Agent,提供 Lightning 与 Pro 两种模式,目前限时免费。

    lysis of standard data, we also conducted 1-on-1 comparisons of practical performance against Claude 4.5 Sonnet and several open-source models: These test sets will be released on GitHub this week. To make it easier for everyone to use Agent-related capabilities, we have launched our M2-powered Agent product in China and upgraded the overseas version. In MiniMax Agent, we offer two modes: Lightning Mode: A high-efficiency, high-speed Agent for instant output in scenarios like conversational Q&A,

    匹配字段正文

星期三

  1. vLLM 官方博客

    vLLM OpenAI 兼容 API 支持返回 token IDs,消除智能体强化学习的重新分词偏移

    vLLM 从 v0.10.2 起为 OpenAI 兼容 API 增加 `return_token_ids` 参数,可随文本返回输入的 `prompt_token_ids` 和生成结果的 `token_ids`。该功能避免推理文本在训练时重新分词产生不同 token 序列,Agent Lightning v0.2 会自动启用参数并通过追踪能力收集训练所需数据。

    update sample without stitching; just log the returned IDs via return token ids enabled. Links: Docs: OpenAI‑compatible server; Project to try with this feature: Agent Lightning (GitHub, docs) Why token IDs matter for Agent RL RL for LLMs trains on token sequences, so trainers need the exact token IDs sampled by the behavior policy. In single‑turn settings this used to be straightforward, since calling vLLM’s low‑level generate returns tokens directly. In agent settings, most agent frameworks c

    匹配字段正文

星期一

  1. Anthropic Engineering

    Anthropic 为 Claude Code 推出沙箱功能,权限提示减少 84%

    Anthropic 为 Claude Code 推出两项基于沙箱的新功能:沙箱化 bash 工具和云端运行的 Claude Code on the web,前者以 beta 研究预览形式开放并已开源。沙箱通过文件系统隔离和网络隔离两层边界限制 Claude 可访问的目录与服务器,官方称内部使用中权限提示减少 84%。云端版本将每个会话放在隔离沙箱中运行,git 凭证和签名密钥不进入沙箱,由自定义代理服务处理 git 交互。

    ial and the contents of the git interaction (e.g. ensuring it is only pushing to the configured branch), then attaches the right authentication token before sending the request to GitHub. Getting started Our new sandboxed bash tool and Claude Code on the web offer substantial improvements in both security and productivity for developers using Claude for their engineering work. Run /sandbox in Claude and check out our docs on how to configure this sandbox. Go to claude.com/code to try out Claude

    匹配字段正文

星期四

  1. vLLM 官方博客

    vLLM TPU 推出统一后端,以 JAX 路径支持 PyTorch 和 JAX

    vLLM TPU 现由 tpu-inference 驱动,通过统一的 JAX→XLA 降低路径支持 PyTorch 和 JAX,并在无需修改模型代码时将吞吐量提高约 20%。新版默认采用 SPMD,引入支持任意模型规格、量化 dtype 和张量并行的 RPA v3,其在 Trillium(v6e)上的吞吐量较 RPA v2 提高约 10%。当前整体性能已接近 2025 年 2 月首个 TPU 原型的 5x,并支持稠密模型、多模态输入、前缀缓存、分块预填充和结构化解码等能力。

    that will improve performance for larger scale, higher complexity models (XL MoE, +vision encoders, MLA, etc.). If you’d like us to prioritize something specific, please submit a GitHub feature request here. Supported/Verified TPU generations Trillium (v6e), v5e Features Prefix caching; Chunked Prefill; Multimodal Inputs; Single Program Multi Data (SPMD); Structured Decoding; Speculative decoding: Ngram; Out-of-tree model support; Optimized Runtime Sampling (top k, top p, temperature, logit out

    匹配字段正文

  2. Claude Platform:开发者版本说明精选

    Anthropic 发布 Claude Haiku 4.5 小模型

    Anthropic 发布 Claude Haiku 4.5,其编码性能接近五个月前的 Sonnet 4,但成本仅为其三分之一,速度提升超过两倍。该模型在部分任务上超越 Sonnet 4,API 定价为每百万输入 token 1 美元、输出 token 5 美元,现已通过 Claude API、Amazon Bedrock 和 Google Cloud Vertex AI 提供。

    our premium tier model—that's a game-changer for our unit economics.Jon Noronha Co-Founder, Gamma Our early testing shows that Claude Haiku 4.5 brings efficient code generation to GitHub Copilot with comparable quality to Sonnet 4 but at faster speed. Already we're seeing it as an excellent choice for Copilot users who value speed and responsiveness in their AI-powered development workflows.Matthew Isabel Distinguished Product Manager Safety evaluations We ran a detailed series of safety and ali

    匹配字段正文

星期二

  1. Ollama Blog精选

    Qwen3-VL 上线 Ollama 云端,本地版本即将推出

    Qwen3-VL 已在 Ollama 云端上线,本地版本将很快提供。该模型支持操作 PC 和手机 GUI 的视觉智能体、从图像和视频生成 Draw.io/HTML/CSS/JS、原生 256K 上下文并可扩展至 1M,OCR 语言从 19 种增至 32 种。Ollama 同时给出 JavaScript、Python 库及 OpenAI 兼容 API 的调用方式。

    ript Library Install Ollama’s JavaScript library Pull the model Example non-streaming output with image Example streaming the output with image Ollama’s JavaScript library page on GitHub has more examples and API documentation. Python Library Install Ollama’s Python library Pull the model Example non-streaming output with image Example streaming the output with image Ollama’s Python library page on GitHub has more examples and API documentation. API The model can also be accessed directly on oll

    匹配字段正文

星期一

  1. Answer.AI 官方研发博客

    我如何用 SolveIt 把 Karpathy 的 tokenizers 视频做成书稿章节

    Answer.AI 的 Kerem Turgutlu 用 SolveIt 把 Andrej Karpathy 超过 2 小时的 tokenizers 视频教程转成了带可运行代码、超链接、图片和补充讲解的书稿章节。他采用两阶段流程:先用一个对话逐段丰富带时间戳的转录稿,再用第二个对话据此撰写正文,而非让 AI 一次性转换。SolveIt 提供完整 Linux 环境、持久存储、网页搜索和消息编辑工具,并支持用 #ai 标签让 AI 读取指定图片。

    transcript. SolveIt used web search to find it, then used the message editing tools to update the note with the proper markdown link. I did this throughout for papers, blog posts, GitHub repos, wikipedia pages and any other external resources that were mentioned in the video. In this screenshot, we can see at the top a note message containing part of the transcript. Below that is a prompt message asking SolveIt to find the YouTube link and add it as a hyperlink. The AI’s response shows it used w

    匹配字段正文

星期四

  1. OpenHands 官方博客

    OpenHands 发布 Refactor SDK,用并行智能体自动化大规模重构

    OpenHands 发布 Refactor SDK,用于借助 AI 智能体自动化大规模重构任务,提供任务拆解、修复与验证、进度追踪三类工具。其工作流建议先建 v1-refactor 分支并写入 AGENTS.md 或 .openhands/microagents/refactor.md 作为上下文,每个智能体从该分支拉出自己的分支并向 v1-refactor 提 PR,由人工审查后再合并进 main。作者称这类任务通常只有 80-90% 可自动化,仍需理解项目全局的人参与,他目前同时管理约 5 个智能体。

    Historical perspective

    te a perfect SQL statement to get the data I needed. But the context was limited to my chat window—I had to explicitly tell ChatGPT about my code and what I needed. The next year, GitHub Copilot went mainstream (though it had already been in GA for a while). Having an LLM right there in neovim felt like magic—Copilot was able to predict what I was going to type before my hands even hit the keyboard. It had at least a small window into my codebase—no more copy/pasting back and forth into the Chat

    匹配字段正文

  2. Browser Use精选

    Browser Use 发布 BU 1.0:浏览器智能体平均 68 秒完成任务

    Browser Use 发布 BU 1.0,在 OnlineMind2Web 上达到 65.7% 准确率,与 Gemini 2.5 Computer Use 持平,平均 68 秒完成任务,而 Gemini 2.5 Computer Use 为 225 秒、Claude Sonnet 4.5 为 285 秒。团队称其通过 KV cache 复用、按需截图、从 DOM 直接提取 markdown 的 extract 工具以及精简输出 token 四项优化降低延迟,并建议升级到 Browser Use 0.8.0 使用。

    del. (See our full model speed and accuracy benchmark here) Seeing is Believing To put this in perspective, here's both agents executing the same task: "Find the most recent PR in github.com/browser-use/browser-use." BU 1.0 finishes in 15 seconds. Gemini 2.5 Computer Use takes 1 minute 15 seconds. As you can see, we're getting into the regime where our agents are becoming as fast as human workers. Here we present some of the core optimizations drive this performance: 1. Making Use of the KV Cach

    匹配字段正文

星期日

  1. Ahead of AI

    从零理解 LLM 评估的四种主要方法

    文章讲解评估 LLM 的四种主要方法,包括多项选择、验证器、排行榜和 LLM 评审,并配有从零代码实现。不同方法分别侧重知识准确率、可验证任务、用户偏好和整体回答质量,各有成本、偏差与适用范围,因此模型评估应组合多种方法,并使用贴合目标领域的数据。

    where the model’s predicted answer letter is compared directly to the correct one. Two other popular methods exist that involve log-probability scoring. I implemented them here on GitHub. (As this builds on the concepts explained here, I recommended checking this out after completing this article.) The following subsections illustrate how the MMLU scoring shown in figure 2 can be implemented in code. 1.2 Loading the model First, before we can evaluate it on MMLU, we have to load the pre-trained

    匹配字段正文

星期三

  1. Answer.AI 官方研发博客

    Cachy:我们如何让 notebook 提速 60 倍

    Answer.AI 开源了 Python 包 cachy,通过修改 httpx 的 send 方法缓存每次 LLM 调用响应,让测试从约 2 分钟缩短到约 2 秒,提速 60 倍。它支持 async 与 streaming,只需 pip install pycachy 并调用 enable_cachy(),即可自动缓存 Anthropic、OpenAI SDK 的调用,无需编写 mock 代码。cachy 也可缓存任意 httpx 请求。

    n development. running the test suite is slow as each LLM call take 100’s of ms to run; llm responses are non deterministic which makes assertions difficult; ci/cd pipelines (like Github Actions) need access to API keys to run tests As we build most of our software in notebooks non-deterministic responses create an additional problem. They add significant bloat to notebook diffs which makes code review more difficult 😢. Why cachy? Although LLMs are relatively new these challenges are not, and an

    匹配字段正文

星期二

  1. Claude Platform:开发者版本说明精选

    Anthropic 发布 Claude Sonnet 4.5 及 Claude Agent SDK

    Anthropic 发布 Claude Sonnet 4.5,称其为全球最强编码模型,在 SWE-bench Verified 和 OSWorld 上分别取得领先成绩,并同步推出 Claude Agent SDK、Claude Code 检查点、VS Code 扩展及 API 记忆工具等更新。模型定价与 Sonnet 4 相同,为每百万 tokens 3 美元(输入)和 15 美元(输出),并附带一个名为 Imagine with Claude 的研究预览。

    ements on longer horizon tasks. It reinforces why many developers using Cursor choose Claude for solving their most complex problems.Michael Truell CEO Claude Sonnet 4.5 amplifies GitHub Copilot's core strengths. Our initial evals show significant improvements in multi-step reasoning and code comprehension—enabling Copilot's agentic experiences to handle complex, codebase-spanning tasks better.Mario Rodriguez Chief Product Officer Claude Sonnet 4.5 is excellent at software development tasks, lea

    匹配字段正文

星期四

  1. Liquid AI 模型与工程博客精选

    Liquid AI 发布 Liquid Nanos 端侧模型系列,参数 350M 至 2.6B

    Liquid AI 发布 Liquid Nanos 系列任务专用端侧基础模型,参数规模 350M 至 2.6B,占用 100MB 至 2GB 内存,可在手机、笔记本和嵌入式设备上本地运行。首批实验性模型包括 LFM2-Extract、LFM2-350M-ENJP-MT、LFM2-1.2B-RAG、LFM2-1.2B-Tool、LFM2-350M-Math,以及社区开发的 Luth-LFM2 法语微调系列。官方称 LFM2-1.2B-Extract 在结构化抽取上优于 22.5 倍参数量的 Gemma 3 27B,LFM2-350M-ENJP-MT 的英日互译质量超过 10 倍参数量的通用模型。模型已在 LEAP 平台和 Hugging Face 上线,采用开放许可。

    fr, and Hellaswag-fr while preserving competitive English performance. All training code, evaluation scripts, and the Luth-SFT dataset (338 million tokens) are openly available on GitHub to support further French NLP research. Availability & licensing Liquid Nanos are available today on the Liquid Edge AI platform (LEAP) for iOS, Android, and laptops. Developers can use them out of the box, integrate via SDKs, or compose them into agents. Models are also available on Hugging Face. We’re making t

    匹配字段正文

星期三

  1. Ollama Blog精选

    Ollama 推出 Web Search API 与网页抓取接口

    Ollama 上线新的 Web Search API,个人用户可使用免费额度,更高速率限制通过 Ollama 云提供。该能力以 REST API 形式提供,并在 Ollama 的 Python 和 JavaScript 库中做了更深的工具集成,可让 gpt-oss 等模型执行长时间研究任务。官方建议将模型上下文长度提高到约 32000 tokens,并推荐 qwen3、gpt-oss 等模型;同时新增 web fetch API 用于抓取单个页面,可通过 Python MCP server 在 Cline、Codex、Goose 等 MCP 客户端中启用。

    tching page results To fetch individual pages (e.g. when a user provides a url in the prompt), use the new web fetch API. Python library Result Example Python code is available on GitHub. JavaScript library Result Example JavaScript code is available on GitHub. You can enable web search in any MCP client through the Python MCP server. Cline To integrate with Cline, configure MCP servers in its settings. Codex Add the following configuration to /.codex/config.toml Goose You can integrate with Oll

    匹配字段正文

星期四

  1. OpenHands 官方博客

    OpenHands Cloud 更新:支持多模型选择与 BYOK,取消加价并重做界面

    OpenHands 发布新版 OpenHands Cloud,用户可从 OpenHands 提供的模型列表中按 API 原价选择模型,也可使用自己的 LLM key(BYOK),不再像此前那样仅以 Claude Sonnet 为主并收取 2 倍 API 费用。官方称 GPT-5 效果不错但偏慢,Qwen-3-Coder 作为开源模型成本更低。界面同步重做,新增更清晰的起始页、全屏对话、可拖拽扩展的输入区、运行时与智能体状态区,以及可触发 OpenHands 执行 git 操作的 push、pull 和创建 PR 按钮。

    OpenHands Cloud New Interface

    opment task, any time. One of our flagship ways to provide this is through the OpenHands Cloud where users can interact with agents through a GUI, API, or integrations into Slack, GitHub, GitLab, and BitBucket. We are constantly listening to feedback from the cloud users, and this month worked hard to fix two major requests that we got from users: Cost of the Agents; Usability of the GUI Experience We thought hard about how to deliver these, and here's our best try for both. Model Choice + BYOK

    匹配字段正文

星期四

  1. vLLM 官方博客

    vLLM Semantic Router 推进 LLM 智能推理路由

    vLLM Semantic Router 为 vLLM 推理引擎提供开源的意图感知路由层,按查询复杂度选择快速路径或 CoT 推理模式。试验中,该设计使准确率提高约 10%、延迟降低约 50%、token 减少约 50%,并支持通过 Kubernetes 和 Envoy 部署。v0.1 路线图包括语义缓存、多因素路由、性能测试和路由策略可视化。

    ide inference acceleration for open-source LLMs through: Semantic-aware routing; Efficient model switching; Enterprise-friendly deployment (Kubernetes & Envoy) Find the project on GitHub. The current focus is on a Work Group and planned v0.1 Roadmap. Currently, ModernBERT runs internally within the router for classification. It is not yet served by vLLM. However, future work aims to make the classifier—and potentially other embedding models—pluggable, allowing integration with vLLM-hosted models

    匹配字段正文

星期五

  1. vLLM 官方博客

    深入 vLLM:高吞吐 LLM 推理系统架构解析

    文章系统解析 vLLM V1 如何从单 GPU 离线推理扩展到多 GPU、多节点异步服务。内容涵盖调度器、PagedAttention、连续批处理、前缀缓存、引导解码、推测解码、P/D 分离及分布式请求链路,并说明如何用 vllm bench 衡量延迟与吞吐量。分析基于 2025 年 8 月 9 日的 commit 42172ad。

    utor), Mark Saroufim (PyTorch), Kyle Krannen (NVIDIA, Dynamo), and Ashish Vaswani for reading pre-release version of this blog post and providing feedback! References vLLM https://github.com/vllm-project/vllm; "Attention Is All You Need" https://arxiv.org/abs/1706.03762; "Efficient Memory Management for Large Language Model Serving with PagedAttention" https://arxiv.org/abs/2309.06180; "DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model" https://arxiv.org/abs/2405

    匹配字段正文

星期二

  1. Mistral AI精选

    Le Chat:自定义 MCP 连接器与 Memories

    Mistral AI 为 Le Chat 推出 20 多个安全的 MCP 连接器及 Memories 测试版,支持检索、总结并操作企业工具,同时跨对话保留个性化上下文。用户还可添加远程 MCP 服务器、管理或删除记忆,并从 ChatGPT 导入记忆;两项功能均向所有 Le Chat 用户免费开放。

    Logo Cloud 1 1

    y of 20+ secure connectors—spanning data, productivity, development, automation, commerce, and custom integrations. Search, summarize, and act in tools like Databricks, Snowflake, GitHub, Atlassian, Asana, Outlook, Box, Stripe, Zapier, and more. Custom extensibility: Add your own MCP connectors to broaden coverage and drive more precise actions and insights. Flexible deployment: run on mobile, in your browser, or deploy on-premises or in your cloud. Context that carries: introducing Memories (be

    匹配字段正文