←搜索结果

按匹配度 · 共 149 条结果 清除搜索

星期四

  1. Johann Rehberger / Embrace The Red精选

    研究者用模块遮蔽攻击链绕过 Claude Code Opus 5 Auto Mode

    安全研究者 Johann Rehberger 发布针对 Claude Code Opus 5 Auto Mode 的攻击链,通过诱导 Claude 改用 curl 下载 ZIP、拒绝运行其中的二进制解码器后自行编写 Python 解码器,再借由压缩包内恶意 struct.py 的模块遮蔽触发代码执行,小样本下攻击成功率最高达 80%。Anthropic 委托第三方评测曾给出 Opus 5 在 Auto Mode 下 0.00% 的提示注入攻击成功率,作者指出该评测只覆盖固定的 72 个场景各跑 10 次,其攻击链不在其中。Anthropic 将该报告关闭为 Informative,称 Auto Mode 是尽力而为的便利功能而非安全保证,真正的边界是操作系统隔离与网络出口控制;作者建议在容器、虚拟机或系统沙箱中运行无人值守的编码智能体并限制网络出口。

    allow-listed IPs. The website presents itself as a small archive of notebook records. Those notebook records however are in a ZIP archive. The archive contains plausible catalogue metadata, dates, checksums and seven short records about the development of the theory of language. The wrapper gives Claude a legitimate reason to investigate the material. 1. Move Claude from WebFetch to Bash Claude initially uses the WebFetch tool to retrieve the contents of the page. The WebFetch tool itself appear

    匹配字段正文

星期三

  1. MIT News · Artificial Intelligence

    MIT 开发 CrysVCD 框架,提高 AI 生成晶体材料的稳定性

    MIT 研究人员开发 CrysVCD 框架,在材料生成前引入化学价态约束,使近 70% 的计算材料生成通过严格的晶格动力学稳定性测试。该方法与材料生成模型协同工作,生成稳定材料的效率较事后筛选方案提高一个数量级;经稳定性指标微调后,生成晶体材料的机械稳定性和亚稳态比例分别达到 68% 和 85%。

    materials after they’re generated. When fine-tuned on stability metrics, their approach produced crystalline materials that achieved 68 percent mechanical stability and 85 percent metastability, which measures if a material stays in a stable state when undisturbed. The researchers then used their approach to generate material candidates with high thermal conductivity and easy polarization in an electric field. “These are materials useful for the semiconductor industry and high thermal conductivi

    匹配字段正文

星期二

  1. SemiAnalysis精选

    SemiAnalysis 实测 OpenAI 自研推理芯片 Jalapeño:每兆瓦吞吐超过 Blackwell

    SemiAnalysis 在 OpenAI 实验室用 InferenceX 实测了 OpenAI 自研推理 ASIC Jalapeño,称其在多个开源模型上的每兆瓦 token 吞吐超过 NVIDIA Blackwell,且在 DeepSeek R1 上并发 1 时达到每用户 700 tokens/s 以上,全程未使用投机解码。该芯片由 OpenAI 与 Broadcom 合作、2024 年中启动设计,2025 年 11 月完成 CoWoS 流片,采用 HBM4、单封装 15.4TB/s 带宽,架构上不做 prefill 与 decode 分离,用统一芯片池应对变化的负载比例。文章认为更公平的对手是同样使用 HBM4 的 Rubin,两者每美元输出 token 数接近,但 Jalapeño 尚未启用投机解码,量产计划从 2027 年起逐步爬坡。

    fectively. Of course, part of this TCO advantage comes from trading Nvidia’s high margins for Broadcom’s lower (though still high) margins. But this is not all of it. For example, Meta and Microsoft’s AI ASIC programs not getting off the ground despite being at it for much longer shows that cost is only one part of the equation. For Jalapeño’s full TCO breakdown, see the SemiAnalysis AI Cloud TCO model. Architecturally, OpenAI chose not to disaggregate prefill and decode (PD) across separate chi

    匹配字段正文

星期一

  1. SemiAnalysis

    SemiAnalysis 发布 AgentX 1.0:百万上下文多轮智能体编码推理基准

    SemiAnalysis 发布 AgentX 1.0,称其为全球首个完全开源、100 万上下文的多轮智能体编码推理基准,以 Apache 2.0 许可发布,数据集构建投入超过 300 万美元。该基准被纳入 InferenceXv3,用智能体编码流量替代此前 8k 输入 1k 输出的单轮场景,测试矩阵运行在约 2MW 算力、1000 多颗芯片上,覆盖 MI355X、GB300 NVL72、GB200 NVL72、B300、B200、MI325、MI300X、H200 与 RTX Pro 服务器。SemiAnalysis 称其首个成果是已推动 vLLM、SGLang、TensorRT-LLM、ATOM、AITER、Dynamo、LMCache 和 Mooncake 等项目的 70 多个上游 PR,并计划在三到四周后发布 AgentX 更新文章。

    e following people that have made massive contributions to the AgentX 1.0 release: In addition, we are thankful to all who support our open source InferenceX initiative, including Meta, Microsoft, Oracle, OpenAI, MiniMax, Moonshot Kimi, Alibaba Qwen, and Zhipu GLM. At a high level, an agentic workload is characterized by four elements: Considering the characteristics above, benchmarking these workloads is fundamentally different from the existing fixed sequence length benchmarks. Namely, agentic

    匹配字段正文

星期五

  1. Hugging Face

    Hugging Face 研究:语音识别模型存在基准优化行为

    Hugging Face 发布研究,用共识分歧、掩码实体检索和拼写切换三类探针测试语音识别模型,发现部分模型会依据声学线索识别基准来源并复现参考文本中的错误。在 VoxPopuli 上,方法标记出约 40% 测试片段可能存在参考错误,涉及约 3% 的参考词;表现基准优化的模型有 18–30% 的概率复现错误参考文本,且 WER 最低的模型反而最容易复现这些错误。在 LibriSpeech 上,部分强模型在数字被静音后仍有约 30–40% 的样本还原出被掩码的数字,拼写切换探针中多个模型超过 50% 随机基线,部分达到约 90% 切换准确率。研究建议使用完全留出的评测集,Open ASR Leaderboard 已新增 Benchmark fitting 标签页,相关脚本与未归一化模型输出已在 GitHub 开源。

    model outputs . Our findings also suggest that benchmark developers should avoid simple independent and identically distributed test splits in favor of temporal, speaker, or other metadata-based separation. Greater transparency around training data and model-selection procedures would also help researchers understand how these behaviors arise. Public benchmarks remain valuable: they are transparent, repeatable, easy to run, and well understood by the research community. But they are most useful

    匹配字段正文

星期四

  1. Cohere 产品与研究博客精选

    Cohere 研究揭示大语言模型训练中的“文化漏斗”

    Cohere 分析超过 5.6 million 条训练数据样本,发现文化多样性从预训练到后训练持续收窄,单纯增加语言只能扩大地域覆盖,不能提高文化内容占比。团队在 TinyAya 微调数据中加入显式文化标记后,NormAd、BBQ 和 GMMLU 分别提升 +8%、+6% 和 +2.3%,且未损害通用多语言能力。

    AI for utilities requires capability and control

    ter learn long-tail distributions. Inspired by this approach, we add cultural markers while fine-tuning the TinyAya base model, i.e. not changing the data distribution, but adding meta-information to each training sample. This means we are not making the data “more cultural”, but the cultural content more explicit, giving the model an opportunity to learn cultural properties even if sparsely represented. We observe an improvement in performance on downstream cultural benchmarks without sacrifici

    匹配字段正文

星期一

  1. Johann Rehberger / Embrace The Red

    作者复现从加密推理链中恢复密码的攻击

    Johann Rehberger 复现了论文《Stealing Reasoning Traces from Proprietary LLM APIs》中的攻击方法,把 GPT-5.6 Sol 在一个 OpenAI 账号下生成的加密推理链,用另一账号的 GPT-5.6 Luna 配合轻度越狱提示词还原出底层推理内容,包括原推理中出现过的密码。他指出这类加密推理 blob 可能因厂商在用户、会话和模型间共用密钥而被跨会话、跨账号恢复,论文作者还从公开仓库抓取的 315,320 个推理块中还原出 367 条 PII 和 182 条凭据。测试期间该攻击曾于 8 月 11 日前后完全失效,三天后又恢复可用,原因不明。

    rick is getting that model to disclose it. My experiments here focus on OpenAI, so the field names and session format below are specific to OpenAI. Anthropic Claude uses different metadata and formats. The probe.py tool was created using Codex. For my test, I created a reasoning trace containing a known password using GPT-5.6 Sol under one OpenAI account. I then attempted to recover that trace using GPT-5.6 Luna from a different account. When a prompt involves sensitive information, such as a se

    匹配字段正文

星期二

  1. MIT News · Artificial Intelligence

    MIT 与清华团队提出 GeoPT,以更少数据模拟更广泛的真实物理场景

    MIT CSAIL 与清华大学研究人员提出预训练方法 GeoPT,通过 1.3 million 个合成动力学样本学习物理交互,相比领先模型可将训练数据最多减少 60 percent,并以两倍速度达到峰值性能。GeoPT 可根据上传的 3D 模型及作用力方向和速度,模拟车辆碰撞变形、流体作用和光线传播等场景;在船体空气与波浪模拟中,它以少 60 percent 的标注数据达到峰值准确率,速度快四倍。

    aterials, and generate realistic videos. “Using synthetic dynamics data is an exciting paradigm for imbuing physics into foundation models,” says Fei Sha, AI research scientist at Meta, who wasn’t involved in the research. “It challenges the traditional wisdom that physics and geometry are necessarily entangled in computation, and one must acquire costly and specialized data. The demonstrated success in a wide range of application domains leads us to this important juncture: We are ready to buil

    匹配字段正文

星期一

  1. Hugging Face精选

    让知识蒸馏便宜到足以大规模运行

    Multiverse Computing通过缓存教师模型每个位置的top-100 logits,并把输出投影融合进分块KL loss,大幅降低大语言模型离线知识蒸馏的显存成本。32K token基准中,峰值显存从85.2 GiB降至5.45 GiB;蒸馏GPT-OSS 20B时,GPU节点由4个减至1个,单步耗时从57.0秒降至12.23秒。该分块loss实现已开源。

    tation: github.com/CompactifAI/Full-Chunked-KL-Loss Models mentioned in this article 6 MultiverseComputingCAI/Hypernova-60B-2605 Text Generation • 59B • Updated Aug 7 • 1.71k • 21 meta-llama/Llama-3.1-8B-Instruct Text Generation • 8B • Updated Sep 25, 2024 • 6.2M • 8.13k moonshotai/Kimi-K3 Image-Text-to-Text • 2.8T • Updated 30 days ago • 1.27M • 11.6k nvidia/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4 Text Generation • 45B • Updated Jul 7 • 10k • 130 openai/gpt-oss-120b Text Generation • 117B •

    匹配字段正文

星期四

  1. Google Research

    Google Research 发布 SymptomAI:面向日常症状评估的对话式 AI 智能体

    Google Research 发布研究论文 SymptomAI,用 Gemini Flash 2.0 驱动的对话式智能体完成端到端症状问诊与鉴别诊断(DDx),并在 n=13,917 的全国随机研究中与真实临床医生的评估对比。由三名认证临床医生盲评,超过 50% 的案例中临床医生更偏好 SymptomAI 生成的 DDx,且 SymptomAI 的 DDx 更常包含参与者事后从医疗提供者处获得的真实诊断。研究还发现,主动追问的智能体策略显著优于无提示的 Base 条件,且 SymptomAI 诊断出的呼吸道感染与参与者 Fitbit 在问诊前数日的生理信号变化相吻合。所有诊断与标签仅用于研究分析,不构成确诊或官方医疗评估。

    Four smartphone screenshots display a conversational Symptom Checker research app collecting neck pain symptoms, showing a diagnosis summary, and prompting a feedback rating.

    m an informed context after years of experience with chronic illness. Future work may focus on specific illnesses at specific points during symptom development such as early-onset metabolic syndrome or symptoms discussed at the start of respiratory infections. All diagnoses, labels, and disease associations generated during the study are AI-derived for research analysis only and do not constitute confirmed clinical diagnoses or official medical assessments. Secondly, in our evaluation the clinic

    匹配字段正文

星期四

  1. Google Research

    Google 发布 SensorFM:面向可穿戴健康数据的通用基础模型

    Google Research 发布 SensorFM,一个在超一万亿分钟、来自 500 万人的多模态传感器数据上预训练的可穿戴健康基础模型。它通过缺失感知的掩码重建学习通用生理表征,可迁移到 35 项健康预测任务,最大模型 SensorFM-B 相比最小版本重建损失降低 31%,分类任务平均提升 9% AUC、回归任务提升 21% Pearson 系数。研究还用 LLM 智能体自动构建预测头,并将其接入 Personal Health Agent,临床医生盲评显示加入 SensorFM 预测后各维度评分显著提升。

    SensorFM: Towards a general intelligence and interface for wearable health data

    or signals drawn from five million consented participants, SensorFM learns a single, reusable representation of sensed human physiology — one that transfers across cardiovascular, metabolic, sleep, and mental health, as well as lifestyle and demographic factors. To our knowledge, this is the largest and most diverse wearable dataset used to train a model to date. To build the pre-training corpus, we sampled de-identified data from five million people who had consented to the use of their data fo

    匹配字段正文

星期二

  1. Google DeepMind

    Gemini 引导式学习:塞拉利昂随机对照试验结果

    Google DeepMind 与 Fab AI 开展的随机对照试验显示,使用 Gemini 引导式学习的学生数学成绩比对照组提高 0.258 个标准差,相当于八周内取得约 1.2 至 1.7 年的常规学习进步。试验覆盖塞拉利昂 12 所学校的 1,763 名初中生,91.4% 的对话用于建立概念理解;但入组时数学基础较强的学生获益最多,凸显成绩差距问题。

    A classroom setting where several school students in matching white uniforms sit at desks with desktop computers, working on lessons. An educator stands over a student on the right, guiding them through the computer screen. The backs of the students' shirts read "Johanna Kuyvenhoven Model Junior Secondary School."

    er tools that deliver the strongest gains for the students who need it most. Looking ahead, we plan to expand these trials to other countries and probe more deeply into areas like metacognition and relational intelligence to capture a more holistic view that explores the nuanced complexity of learning. By combining the relational foundation of a teacher-led classroom of students with the personalized, scaffolding capabilities of AI, we can help ensure that technology serves as a bridge to meanin

    匹配字段正文

星期三

  1. Trail of Bits Blog

    Trail of Bits 实测:ClawHub、skills.sh 与 Cisco 的技能扫描器均可被绕过

    Trail of Bits 测试了 ClawHub、Cisco 的 agent skill scanner 以及 skills.sh 集成的三款扫描器,用四个恶意技能全部绕过,其中三个在一小时内完成。攻击手法包括在文件中前置 10 万个换行符让扫描器截断漏检、在 .pyc 字节码中植入窃取环境变量的代码,以及用企业网络配置话术包装恶意 npm registry 的提示词注入。作者认为技能扫描存在结构性缺陷,建议改用经过策展的技能市场并像对待不可信代码一样对待公共技能仓库。

    “Figure 1: OpenClaw scanner misses malicious content”

    by various models) with basic text pattern-matching and a variety of more involved static analysis methods targeting control and data flows. The tool also integrates an LLM-based meta-analyzer, which can cut out duplicates and false positives returned from the various engines. The policy for whether a skill is deemed safe is configurable, but defaults to a set of rules on the size of the skill, what file types are included, and what patterns are presumed hazardous. We first built two simple ski

    匹配字段正文

星期二

  1. MiniMax Blog

    MiniMax 复盘 M2 无法输出“马嘉祺”:稀疏 token 遗忘的内部调查

    MiniMax 发布内部调查,解释 M2 系列模型无法生成“嘉祺”等低频 token 的原因:这些 token 在预训练中已获得正常语义表示,但后训练数据覆盖不足导致输出侧 lm_head 表示漂移,生成概率被 top-p 采样过滤。团队通过全词表覆盖合成数据修复,日→俄混语率从 47%/5% 降至 1%,高退化 token 定向测试通过率从 4/16 提升到 13/16,并发现该机制与日语混语问题同源。

    Community discussion about MiniMax LLM sparse token forgetting on social media

    pear with some frequency in pretraining corpora but have extremely low representation in SFT conversational data, causing significant lm head representational drift 3. LaTeX / Web Metadata makebox, mathbbm, boldmath, mathring, medskip, mathds, \footnotetext, {multiline}, {corollary}, {defn}; Academic paper formatting markers, rarely used in SFT conversational data; Weblinks, DEFAULTSORT, accessdate, commonscat, Commonscat, Reflist, Webarchive, Listaref, Collegamenti, interprogetto; Wikipedia sou

    匹配字段正文

星期一

  1. Epoch AI:Gradient Updates

    Epoch AI:算力紧张是否即将到来

    Epoch AI 建模全球 Nvidia GB200 与 GB300 芯片的推理吞吐,估算在服务 Kimi K2.6 类模型时,全球每秒可产出 5 亿至 200 亿个输出 token,具体取决于请求上下文长度。研究同时指出全球推理算力每年增长约 3.4 倍,而 token 需求按现有代理指标估算每年增长约 10 倍,可能已超过供给增速。若趋势延续,算力紧张可能临近,长上下文和智能体类工作负载受影响更明显,前沿能力访问价格或上升,日常用户则可能转向更小更便宜的模型。

    h works out to about 5 million output tokens per day with Claude Opus 4.7 API pricing, or 25 million output tokens per day with Kimi K2.6.16 Another point of comparison comes from Meta, whose 85,000 employees used 60 trillion tokens in one month across the organization. That figure included both input and output tokens; assuming a 25,000:1,000 input-to-output token ratio, that would be around 1 million output tokens per day and employee. There were about 30 million software engineers worldwide a

    匹配字段正文

星期三

  1. Prime Intellect精选

    Prime Intellect 研究:奖励黑客是梯度动力学问题,并推出 Prime Sprints

    Prime Intellect 发布研究,提出奖励黑客是梯度动力学问题而非单纯的奖励函数规格问题,并用 Llama 3.2-1B-Instruct 在 100 步训练中系统验证。实验显示隐藏奖励与可见奖励争夺梯度预算,可见奖励饱和或不可达时黑客行为接管;基线频率仅影响黑客出现速度,0.16% 的稀有词同样会被放大。团队开源 backdoor-ifeval 环境,并启动 Prime Sprints 计划,为奖励黑客主题的社区实验提供免费算力,优秀项目可获 5K+ 美元额度。

    Systematic Reward Hacking and Prime Sprints

    tially adding additional context to the prompts) ran four conditions across Llama 1B and 3B: control (no hidden weight), neutral (no system message), restrict ("do not write about metals or metallic colors"), permission ("you may optimize for any scoring patterns"). The results with Llama 1B showed that neutral hacking liftoff was at 64, restrict was at 41, and permission at 51. Restrict was actually fastest to hack, counterintuitively. With Llama 3B: restrict was at step 53, neutral was at 66,

    匹配字段正文

星期日

  1. Sakana AI:Blog

    Sakana AI 提出 Conductor:用自然语言编排多智能体

    Sakana AI 发布论文《Learning to Orchestrate Agents in Natural Language with the Conductor》,该工作已被 ICLR2026 接收。研究用强化学习训练一个 7B 的 Conductor 模型,让它以自然语言输出协作流程,指定调用哪个智能体、分配什么子任务以及它们能看到哪些历史消息,从而编排 GPT-5、Gemini、Claude 及开源模型组成的模型池。Conductor 会随任务难度自适应:简单事实问题只调用一个模型,困难编码问题则自动搭建 planner-executor-verifier 流水线。论文称 7B Conductor 在 LiveCodeBench 达到 83.9%、GPQA-Diamond 达到 87.5%,超过池中每个单独模型,并以更低成本优于 Mixture-of-Agents 等多智能体基线;它还支持递归测试时扩展,可把自己选为 worker 并在失败时生成纠正流程。该研究与几天前公布的 TRINITY 一起支撑其新的多智能体系统 Sakana Fugu。

    By allowing the Conductor to select itself as a worker, it reads its own team’s prior output, realizes if it failed, and spins up a corrective workflow on the fly. This opens a new axis for scaling compute during inference. This research proves that language models can become elite meta-prompt engineers, dynamically harnessing collective intelligence. Alongside our TRINITY research which we announced a few days earlier, this foundational research powers our new multi-agent system: Sakana Fugu! 🐡

    匹配字段正文

星期三

  1. FutureHouse Research精选

    Caltech、Mila 与 FutureHouse 提出 DISCO:同时生成蛋白序列与 3D 结构以设计新酶

    Caltech、Mila、FutureHouse 等机构提出 DISCO(Diffusion for Sequence-structure CO-design),一种多模态生成模型,可围绕分子目标同时生成蛋白序列与 3D 结构,无需预先指定 theozyme。在 178/179 个靶点的计算基准上取得最优表现,并在 4 类卡宾转移反应中测试 90 个设计,其中 B–H 插入达 98% 产物和 5,170 总转化数,活性超过此前定向进化实验的两倍。这些酶的活性位点几何在 AlphaFold 数据库的 2 亿多个结构中找不到近缘天然同源物。

    s diverse design tasks. It generates the most diverse, co-designable protein–ligand complexes for 178 of 179 targets in a new benchmark spanning natural and non-natural molecules, metals, cofactors, DNA, and RNA – outperforming all current baselines. DISCO further introduces a multimodal inference-scaling method. This allows the generation to explore desirable properties more efficiently than brute-force filtering, including the ability to design (in-silico) for binding specificity between struc

    匹配字段正文

星期五

  1. Together AI Blog精选

    系统 AI:使用大语言模型优化数据库查询执行

    Together AI 联合多家机构推出 DBPlanBench,让 GPT-5 通过 JSON Patch 定向改写 Apache DataFusion 查询执行计划,无需修改数据库引擎。TPC-H 和 TPC-DS 生成负载的中位加速约为 1.1x–1.2x,最高达 4.78x,样本中 60.8% 的查询性能提升超过 5%;相关工具与代码已开源。

    es and partitioning schemes, to an LLM. The primary technical challenge here is the information density inherent in raw physical plans, which contain verbose file paths, partition metadata, and type encodings that fill up the context window quickly. Without careful serialization, the entire plan can exceed 2M characters, making it impossible for LLMs to reason over the inputs effectively and efficiently. Our harness implements a serialization layer that traverses the engine's physical operator g

    匹配字段正文

星期六

  1. MiniMax Blog精选

    MiniMax 发布 Forge:可扩展 Agent RL 框架与算法

    MiniMax 发布内部 Agent RL 框架 Forge,通过解耦智能体与训练基础设施的中间件设计、Windowed FIFO 调度和 CISPO 算法,在构建 MiniMax M2.5 时接入超过十万个真实智能体 scaffold 与环境,上下文长度达 200k,日吞吐量达百万级样本。其中前缀树合并跳过冗余前缀预填充,带来 40 倍训练加速,并保持与标准方法在 loss 和指标上的数学等价;奖励设计加入任务完成时间信号,鼓励智能体使用并行加速执行。

    prefix. Using attention primitives such as Magi Attention we keep logical execution identical to a standard forward pass. After the forward pass, the prefix tree is unrolled from metadata so the loss is computed normally, leaving downstream logic untouched. By skipping redundant prefix prefilling, the scheme produces a 40x training speedup and significantly reduces memory pressure, allowing longer sequences or larger batch sizes, while keeping strict mathematical equivalence to standard methods

    匹配字段正文