←搜索结果

按匹配度 · 共 149 条结果 清除搜索

星期一

  1. LMSYS Blog

    SGLang RL 团队实现 INT4 QAT 端到端 RL 训练,单张 H200 跑约 1TB 模型

    SGLang RL 团队在 slime 框架上复现并落地了 INT4 QAT 端到端方案,训练侧用假量化加 STE,推理侧用 W4A16 真实量化,使约 1TB 规模的 K2 类模型可装入单张 H200(141GB)。消融实验显示,训练端假量化与推理端真实量化必须同时开启,否则训练与推理的 logprob 差异会明显增大;在 Qwen3-235B-A22B 和 Kimi-K2-Thinking 上,BF16 训练加 INT4 推理的奖励与评测分数走势与 BF16、FP8 方案基本重合。团队称 INT4 的主要收益来自显存压缩带来的单节点 rollout,因为 H 系列 GPU 没有原生 INT4 Tensor Core,其计算速度与 FP8 大致同档。

    End-to-end QAT INT4 pipeline

    requires frequent weight updates, we must solve format compatibility. We therefore designed a reverse restore weights before loading safety mechanism. Using cached original shapes metadata, it restores (resizes) the in-memory Marlin weight format back to original shapes before any weight update happens. This prevents runtime errors due to shape mismatches and enables smooth switching between standard weight formats and Marlin formats. We also added a system-level post process weights API to allo

    匹配字段正文

星期四

  1. Anthropic:The Institute

    Anthropic 发布第四份经济指数报告:新增五项 AI 使用基础度量

    Anthropic 发布第四份 Economic Index 报告,基于 2025 年 11 月 Opus 4.5 发布前的 100 万条 Claude.ai 对话和 100 万条 1P API 记录,新增任务复杂度、人类与 AI 技能、使用场景、AI 自主性、任务成功率五项经济基础度量。报告显示 Claude.ai 上增强型使用回升至 52%、自动化降至 45%,前十项任务占 24% 对话,计算机与数学类任务占 Claude.ai 的 34%、API 的 46%。美国各州人均使用差距缩小,基尼系数从 0.37 降至 0.32,若延续则 2 至 5 年可趋于均衡;全球使用仍与人均 GDP 高度相关且差距稳定。

    Figure 1.1: Usage shares among top 10 tasks over time by platform, Claude.ai and 1P API.

    transcripts can include multi-turn conversations, while the API data we analyze is limited to single input-output pairs. This is because API requests arrive independently, with no metadata linking them to prior exchanges. This means we can only analyze them as isolated user-assistant pairs rather than full conversation trajectories. Overall, API usage is overwhelmingly work-related (74% vs. 46%) and directive (64% vs. 32%), with three-quarters of interactions classified as automation compared to

    匹配字段正文

星期一

  1. Zyphra Research

    Zyphra 发布 ZAYA1:首个在 AMD 全栈平台完成大规模训练的 MoE 基础模型

    Zyphra 发布技术报告,介绍 ZAYA1——首个完全在 AMD 平台(AMD Instinct MI300X GPU、AMD Pensando 网络与 ROCm 软件栈)上完成大规模训练的 MoE 基础模型,训练集群由 AMD 与 IBM Cloud 联合构建。ZAYA1-base 总参数 8.3B、激活参数 760m,在推理、数学和编码基准上表现与 Qwen3-4B、Gemma3-12B 相当,并超过 Llama-3-8B 和 OLMoE。Zyphra 称其为 AMD 生态可支撑前沿级 AI 训练的验证,并采用压缩卷积注意力(CCA)等架构创新提升训练吞吐与推理效率。

    B total parameters, 760m active) achieves performance comparable to leading models such as Qwen3-4B (Alibaba) and Gemma3-12B (Google), and outperforms models including Llama-3-8B (Meta) and OLMoE across reasoning, mathematics, and coding benchmarks. “Efficiency has always been a core guiding principle at Zyphra. It shapes how we design model architectures, develop algorithms for training and inference, and choose the hardware with the best price-performance to deliver frontier intelligence to ou

    匹配字段正文

星期五

  1. Johann Rehberger / Embrace The Red精选

    用提示注入外泄 ChatGPT 聊天历史与记忆

    安全研究者 Johann Rehberger 演示了 OpenAI 的 url_safe 安全 URL 渲染功能存在绕过,攻击者可通过不可信数据中的提示注入,让 ChatGPT 把系统提示里的近期对话内容、记忆和用户交互元数据发送到第三方服务器,例如 https://trustnoai.blob.core.windows.net。该绕过及若干同类问题已于 2024 年 10 月报告给 OpenAI,作者称在发布前一个月内多次询问修复进展未获回复,因此未公开完整注入载荷。文中提到 2025 年 8 月 26 日更新称该漏洞已被 OpenAI 修复。

    -of-concept below I show how to access the “Recent Conversation Content” section of the system prompt, any other information present can also be exfiltrated, like user interaction metadata, memories, helpful user insights… Walkthrough This screenshot describes the entire attack chain: For individual steps see these parts: ChatGPT is tricked into accessing the conversation history The prompt injection hijacks ChatGPT, reads the chat history and renders the image Attacker can observe result by loo

    匹配字段正文

星期三

  1. Mistral AI精选

    Mistral AI 对全球 AI 环境标准的贡献

    Mistral AI 联合 Carbone 4 和法国生态转型署 ADEME 开展大语言模型全生命周期分析,评估温室气体排放、用水和资源消耗。研究称,截至 2025 年 1 月,Mistral Large 2 在 18 个月内产生 20.4 ktCO₂e 排放、消耗 281,000 m³ 水和 660 kg Sb eq 资源,并建议行业标准化披露训练、推理及全生命周期影响。

    Mistral AI   Infographie Acv   V6(1)

    sured by Water Consumption Potential (WCP), and material consumption measured by Abiotic Resource Depletion (ADP). ADP quantifies the depletion of non-renewable resources (such as metals and minerals) by considering both the current extraction rates and the estimated reserves of each material. These values are standardized relative to Antimony’s ADP, providing a uniform unit since Antimony is a scarce resource. For example, extracting 1 kg of gold corresponds to an ADP of 2.35 kg Sb eq, whereas

    匹配字段正文

星期六

  1. Johann Rehberger / Embrace The Red

    MCP 安全风险与利用链:不可信服务器与困惑的客户端

    安全研究者 Johann Rehberger 详细分析 MCP 的安全风险,指出仅将恶意工具服务器加入对话上下文即可劫持会话,无需实际调用工具。他演示了在工具元数据中嵌入隐藏 Unicode Tags 指令的端到端利用链,使 Claude 在用户界面看不到异常的情况下先调用 enter_matrix 工具,再执行用户请求的 message_of_the_day。作者称该 Claude 遵循隐藏 Unicode Tag 指令的问题早在 14 个月前就已负责任披露给 Anthropic,但未被视为安全漏洞,此次 MCP 弱点也在数周前告知 Anthropic 且仅得到可复现的回复。他建议不要随意连接不可信 MCP 或 OpenAPI 工具服务器,并检查代码、接口定义与隐藏指令。

    usly), BUT; Even without a tool invocation a malicious tool server can hijack a conversation, just adding a tool server to the conversation context suffices for exploitation; Tool metadata can contain hidden instructions that are seamlessly passed through API and UI layers (especially with Claude we know it handles Unicode Tags without issue). This leads to exploits that even if a cautious user inspects the metadata visually in the UI, the malicious instructions are not visible But, let’s first

    匹配字段正文

星期二

  1. Ollama Blog精选

    斯坦福 Hazy Research 提出 Minions 协议,让本地小模型与云端大模型协作

    斯坦福 Hazy Research 实验室等研究者提出 Minions 方法,让 Llama 3.2 等本地小模型与 GPT-4o 等云端大模型协作,把部分 LLM 负载转移到消费级设备,以降低云端成本。其中 Minion 协议让云端模型与单个本地模型自由对话直至达成结果,远程成本降低 30.4 倍,同时保留 87% 的云端模型性能;MinionS 协议由云端模型把任务拆成小块子任务、由小模型并行处理,远程成本降低 5.7 倍,保留 97.9% 的性能。论文附带开源代码,可通过 Ollama 和 OpenAI API Key 运行 demo。

    irtual environment with your favorite package manager (e.g. conda, venv, uv, etc.): Next, install the Python package and dependencies: If you don’t have it yet, install Ollama and Meta’s Llama 3.2 model: Lastly, create an OpenAI API Key for the cloud model. Running the demo app The provided streamlit app runs an interactive demo of both the Minion and MinionS protocols. To start it, run: A browser window will open with instructions on entering your OpenAI API key, selecting a local model, and ru

    匹配字段正文

星期四

  1. Anthropic:The Institute

    Anthropic 发布 Clio:隐私保护下的 AI 使用分析工具

    Anthropic 发布自动化分析工具 Clio,可在保护用户隐私的前提下分析 claude.ai 的真实使用情况。Clio 由 Claude 完成对话特征提取、语义聚类、簇描述和层级构建,数据自动匿名化聚合,仅高层聚类对分析人员可见。对 100 万条对话的分析显示,Web 与移动应用开发类对话占比超过 10%,教学学习类超过 7%,商业策略与运营类接近 6%。Clio 还帮助识别了用相似提示词结构批量生成 SEO 垃圾内容的自动化账号网络,并发现翻译类有害内容等被原有安全分类器漏报的情况。

    Video thumbnail

    examples for illustration. Here is a brief summary of Clio’s multi-stage process: Extracting facets: For each conversation, Clio extracts multiple "facets"—specific attributes or metadata such as the conversation topic, number of back-and-forth turns in the conversation, or the language used. Semantic clustering: Similar conversations are automatically grouped together by theme or general topic. Cluster description: Each cluster receives a descriptive title and summary that captures common them

    匹配字段正文

星期四

  1. FutureHouse Research

    FutureHouse 详解 PaperQA2:如何让科学 RAG 超越科学家表现

    FutureHouse 发布工程博客,介绍其科学 RAG 系统 PaperQA2 的设计实验,称其在回答高难度科学问题、撰写综述文章和检测文献矛盾等任务上超过科学家的表现。团队基于 LitQA2 的 200 道专家多选题评测发现,智能体式查询扩展、LLM 重排与上下文摘要(RCS)、引用遍历对准确率重要,而嵌入模型选择、混合关键词嵌入、chunk 大小和结构化解析影响不大。新增的引用遍历工具通过 Semantic Scholar 和 Crossref API 前后各遍历一度引用,提升了正确论文的召回率。

    include features like: semantic lookups using dense or sparse vector similarity via vector databases or traditional text search engines, hierarchical indexing relying on document metadata, re-ranking strategies to improve candidate document selection, or advanced document chunking strategies. Differing needs in RAG applications can warrant a subset of these features being used, and rather than having a user make a choice for each application, an “agent” model can be used to automatically select

    匹配字段正文