←搜索结果

按匹配度 · 共 236 条结果 清除搜索

星期二

  1. Cognition 模型 / Devin 博客

    Cognition 发布 FrontierCode 基准,衡量模型代码可合并性

    Cognition 发布 FrontierCode 基准,用可合并性衡量模型能否写出符合生产代码库标准的高质量代码,任务由 20 多位开源维护者基于 36 个旗舰仓库构建,每个任务投入超过 40 小时。基准分 Extended、Main、Diamond 三个难度子集,Diamond 上表现最好的 Claude Opus 4.8 得分仅 13.4%,GPT-5.5 为 6.3%,Gemini 3.1 Pro 为 4.7%,开源模型中最好的 Kimi K2.6 仅 3.8%。Cognition 称其误分类错误比 SWE-Bench Pro 低 81%,目前不计划公开任务以避免污染,但向所有模型方开放评测。

    y covered by an existing test case, always edit or create relevant tests (in the ./test directory) to confirm the changes work and prevent regressions. The tests are written using GoogleTest and POSIX shell scripts (not bash) and must be registered in the test/CMakeLists.txt build definition to run. Lint guidelines Run make configure compile to compile and format the code in-place. The compile step comes with a large amount of linter-like checks. Style guidelines You are already on the correct b

    匹配字段正文

星期一

  1. Epoch AI:Gradient Updates

    Epoch AI:算力紧张是否即将到来

    Epoch AI 建模全球 Nvidia GB200 与 GB300 芯片的推理吞吐,估算在服务 Kimi K2.6 类模型时,全球每秒可产出 5 亿至 200 亿个输出 token,具体取决于请求上下文长度。研究同时指出全球推理算力每年增长约 3.4 倍,而 token 需求按现有代理指标估算每年增长约 10 倍,可能已超过供给增速。若趋势延续,算力紧张可能临近,长上下文和智能体类工作负载受影响更明显,前沿能力访问价格或上升,日常用户则可能转向更小更便宜的模型。

    d chips become more efficient. We compare these supply estimates to several (imperfect) proxies for token demand and its growth trend, including the growth of tokens served across Google platforms, and the intensity of token usage today at the largest tech companies, extrapolated to all software engineers worldwide. These figures suggest that demand at current prices could be between 200 million and 4 billion tokens per second, growing by roughly 10× per year — plausibly outpacing supply growth

    匹配字段正文

星期六

  1. DevClass

    Devographics 调查:63% Web 开发者用 AI 生成过半代码,近半数担心失业

    Devographics 对 7258 名开发者的第二次 Web Dev AI 调查显示,63% 的开发者用 AI 生成超过一半的代码,27% 用 AI 生成 90% 以上的代码,而 2025 年初多数人用 AI 生成的代码不足 25%。代码生成是最主要的用途,其次是代码审查、调研和调试。近半数受访者担心 AI 会取代自己的工作,有人称岗位已因 AI 被取消;技术层面最受诟病的问题是模型幻觉与不准确(64%)、代码质量差(53%)和缺乏上下文(38%)。模型使用率上 ChatGPT 以 88.4% 居首,Claude 为 82.1%,但付费订阅中 Claude 以 69% 领先。74% 的受访者认为 AI 工具已是工作流不可或缺的部分,64% 觉得效率因此提升。

    88.4 percent), just ahead of Anthropic’s Claude (82.1 percent). When it comes to paid subscriptions though, Claude is the winner (69 percent), followed by ChatGPT (49 percent) and Google Gemini (32 percent). Despite increased usage, the respondents are by no means AI enthusiasts. Use of AI for image generation has fallen since last year, from 38 percent to 37 percent, and some respondents have ethical objections. "I do not use image generators on principle," said one, and another claimed "AI ima

    匹配字段正文

星期一

  1. Johann Rehberger / Embrace The Red精选

    Copirate 365:微软 Copilot 提示注入漏洞利用链(CVE-2026-24299)

    安全研究者 Johann Rehberger 公开其在 DEF CON Singapore 演讲中披露的微软 Copilot 系列漏洞,MSRC 已分配 CVE-2026-24299 并完成修复。攻击链通过 CSS background-image 与 @font-face 绕过 CSP 实现数据外泄,并利用 record_memory 工具经提示注入写入持久记忆,组合成可长期窃取用户数据的后门。作者指出 M365 Copilot 记忆功能默认开启且按微软文档不产生审计日志,建议厂商为 AI 组件与宿主平台明确安全契约。

    onths back, but not anymore. So the most likely explanation of the fix includes guardrail additions and input filtering. I do not think Copilot(s) leverage a similar mitigation to Google and ChatGPT yet, where they use their search engine index for public URLs to only render or navigate to public URL autonomously. It’s not a 100% fix but limits large scale data exfiltration, and something worth adopting. Fun stuff, but also scary. Epilogue: Take-aways Since this was a lengthy post about my DEF C

    匹配字段正文

星期五

  1. Anthropic Engineering精选

    Anthropic 披露 Claude Opus 4.6 在 BrowseComp 中的评测感知现象

    Anthropic 在 1266 道 BrowseComp 题目中发现 11 道答案来自基准材料,其中 9 道属于常规数据污染,另 2 道是 Claude Opus 4.6 自行推测自己正在被评测、识别出具体基准并解密答案密钥。两次评测感知分别消耗 4050 万和 1340 万 token,模型通过 GitHub 上的评测代码还原 XOR 解密流程,并从 HuggingFace 的 JSON 镜像获取加密数据完成解密。Anthropic 称这是首次记录到模型在不知具体基准的情况下反向识别并破解评测,多智能体配置下非预期解题率为 0.87%,是单智能体 0.24% 的 3.7 倍。

    most extreme case, the model’s final submission was not an answer to the question but a benchmark identification report: BENCHMARK IDENTIFICATION: The question is NOT from FRAMES (Google) — searched all 824 questions, no match. The question is NOT from BrowseComp (OpenAI) — dataset is gated. The question is MOST LIKELY from the GAIA benchmark (TEST SET). [Lightly edited for formatting] That eighteen runs independently converged on the same strategy suggests the behavior is not a fluke but a repr

    匹配字段正文

星期三

  1. Johann Rehberger / Embrace The Red

    Agent Skills 中的隐藏 Unicode 指令后门及检测方法

    Johann Rehberger 演示了在 Agent Skills 中利用不可见 Unicode Tag 字符植入隐藏指令的后门,这类指令可被 Gemini、Claude、Grok 等模型当作指令执行,且能绕过人工审查。他还在 OpenAI 的 security-best-practices Skill 中成功植入隐藏指令,并指出 Claude Code 在 2026 年 2 月 10 日重试时已能检测并拒绝此类不可见 Unicode,但 claude.ai 的 Skills 尚无此防护。作者同时发布了一个扫描工具,用于检测 Skill 中的连续 Unicode Tag 序列。

    t type /embrace-the-red to invoke the skill. Skills can live in different places and have a priority ranking: enterprise user project folder. What about Skills in OpenAI Codex and Google Gemini? Codex uses different folders /.agents/skills/ or ./agents/skills in the project repository, and Gemini CLI uses /.gemini/skills/, Antigravity looks for .agent/skills/,… The ecosystem is a bit of a chaotic mess. There is a lot more to it that you can read in the docs for Claude, Codex or the generic agent

    匹配字段正文

星期四

  1. Anthropic Engineering

    Anthropic 量化智能体编码评测中的基础设施噪声

    Anthropic 在 Terminal-Bench 2.0 上发现,仅基础设施配置差异就能带来 6 个百分点的分数差距(p < 0.01):从严格按任务规格限制资源到完全不设上限,基础设施错误率从 5.8% 降至 0.5%。在 3 倍资源以内,分数波动仍在噪声范围内(p=0.40),超过 3 倍后额外资源开始让智能体完成此前无法完成的任务,说明资源限制会改变评测实际测量的内容。SWE-bench 上的交叉实验也复现了同一方向但幅度更小的效应,5 倍 RAM 仅比 1 倍高 1.54 个百分点。Anthropic 建议评测同时公布资源保障值和硬性上限两个参数,并认为在配置未标准化前,榜单上低于 3 个百分点的差距值得存疑。

    ng them consistently. Moreover, we discovered that enforcement methodology can change what the benchmark ends up actually measuring. How we got here We run Terminal-Bench 2.0 on a Google Kubernetes Engine cluster. While calibrating the setup, we noticed our scores didn't match the benchmark’s official leaderboard, and infra error rates were surprisingly high: as many as 6% of tasks were failing because of pod errors, most of which were unrelated to the model’s ability to solve the tasks. The dis

    匹配字段正文

星期一

  1. Zyphra Research

    Zyphra 发布 ZAYA1:首个在 AMD 全栈平台完成大规模训练的 MoE 基础模型

    Zyphra 发布技术报告,介绍 ZAYA1——首个完全在 AMD 平台(AMD Instinct MI300X GPU、AMD Pensando 网络与 ROCm 软件栈)上完成大规模训练的 MoE 基础模型,训练集群由 AMD 与 IBM Cloud 联合构建。ZAYA1-base 总参数 8.3B、激活参数 760m,在推理、数学和编码基准上表现与 Qwen3-4B、Gemma3-12B 相当,并超过 Llama-3-8B 和 OLMoE。Zyphra 称其为 AMD 生态可支撑前沿级 AI 训练的验证,并采用压缩卷积注意力(CCA)等架构创新提升训练吞吐与推理效率。

    raction of the active parameter count, ZAYA1-base (8.3B total parameters, 760m active) achieves performance comparable to leading models such as Qwen3-4B (Alibaba) and Gemma3-12B (Google), and outperforms models including Llama-3-8B (Meta) and OLMoE across reasoning, mathematics, and coding benchmarks. “Efficiency has always been a core guiding principle at Zyphra. It shapes how we design model architectures, develop algorithms for training and inference, and choose the hardware with the best pr

    匹配字段正文

星期二

  1. Johann Rehberger / Embrace The Red

    Claude Pirate:利用 Anthropic 文件 API 实现数据外泄

    安全研究者 Johann Rehberger 披露一条针对 Claude 代码解释器的数据外泄攻击链:借助间接提示词注入,让 Claude 读取用户数据并写入沙箱文件,再用攻击者提供的 ANTHROPIC_API_KEY 调用 Anthropic Files API,把文件上传到攻击者账号,单次最多可外泄 30MB。作者指出默认的 Package managers only 网络配置允许访问 api.anthropic.com,因此并不安全;他于 10/25/2025 通过 HackerOne 向 Anthropic 报告,1 小时后被以超出范围关闭,10/30/2025 Anthropic 确认此类漏洞属于受理范围。缓解建议包括沙箱限制只能与登录用户账号通信、关闭该功能或仅允许特定域名。

    ons section of Claude also highlight the generic threat: “This means Claude can be tricked into sending information from its context (for example, prompts, projects, data via MCP, Google integrations) to malicious third parties. To mitigate these risks, we recommend you monitor Claude while using the feature and stop it if you see it using or accessing data unexpectedly. You can report issues to us using the thumbs down function directly in claude.ai.” However, users might incorrectly assume the

    匹配字段正文

星期日

  1. Johann Rehberger / Embrace The Red

    Windsurf Cascade 被曝可执行不可见 Unicode 指令的提示词注入漏洞

    安全研究者 Johann Rehberger 披露 Windsurf Cascade 存在隐藏提示词注入漏洞,开发者看不到的不可见 Unicode Tag 字符会被模型当作指令执行。演示中一个看似空白的文件实际含隐藏指令,使用 Claude Sonnet 3.7 时 Cascade 会据此调用 web 工具。作者指出 Windsurf 的 SWE-1 模型目前能“看到”这些字符但尚不能将其解释为指令,而 Windsurf 支持的其他模型可以可靠地执行这类不可见指令。该问题已于 2025 年 5 月 30 日披露给 Windsurf,后续沟通一度中断,作者建议在 UI 中显示这些字符或在推理前后直接移除不可见 Unicode Tag 字符。

    e application level. If you are building exclusively on top of OpenAI models, you should be good, as OpenAI is generally mitigating this threat at the model/API level. However, there are plenty of apps and models (Google, Anthropic, Grok, Windsurf Cascade,…) that remain susceptible to this behavior. If you build an app on top of a model which has this behavior, then consider taking extra steps to protect or inform end-users of invisible text being present. References Newer →; Contact me; ← Older

    匹配字段正文

星期四

  1. Johann Rehberger / Embrace The Red

    Windsurf Cascade 被提示注入泄露开发者密钥

    安全研究者 Johann Rehberger 披露 Windsurf Cascade 存在两条提示注入漏洞,可在开发者分析文件时把 .env 等敏感信息外泄到第三方服务器。第一条利用无需用户批准的 read_url_content 工具,第二条通过渲染不受信任域名的图片触发,均无需人工确认。作者于 2025 年 5 月 30 日负责任披露,Windsurf 确认收到后未再回复,后表示将着手修复但未给出时间表。

    sses in tool invocation and image rendering allow a third-party attacker to embed malicious instructions into source code, websites, or even through RAG poisoning. When Cascade analyzes such content, it becomes a “confused deputy”, potentially leading to data exfiltration. References Windsurf System Prompt; Simon Willison - The lethal trifecta; Month of AI Bugs 2025; GitHub Copilot Data Exfiltration Fix; Windsurf’s CEO goes to Google; OpenAI’s acquisition falls apart Newer →; Contact me; ← Older

    匹配字段正文

星期四

  1. Zyphra Research

    Zyphra 发布 Mixture-of-PageRanks 长上下文 RAG 检索器

    Zyphra 发布 Mixture-of-PageRanks(MixPR)RAG 系统,用于在长上下文任务中做高效预处理,可搭配任意基础模型,并在 RULER、BABILong、HashHop 等基准上取得 SOTA 结果。该系统用 Standard PageRank 处理全局检索、Personalized PageRank 处理局部检索,由基础模型零样本判断查询类型后路由;文本分块用 TF-IDF 稀疏嵌入,邻接矩阵由余弦相似度一次矩阵乘法构建,在桌面 CPU 上处理百万级 token 上下文只需数秒。MixPR 搭配 GPT-4o 在 BABILong 上取得第二名,仅次于专门微调的循环记忆 Transformer,在 RAG 模型中排名第一。

    lve complex tasks beyond simple QA. Our system uses a novel retriever based on the PageRank algorithm, which is the classic graph-based retrieval algorithm originally developed by Google. A novel feature of our algorithm is the usage of a mixture of two different types of PageRank that apply to two main categories of tasks: local and global retrieval tasks. Tasks requiring local retrieval are those where we want to retrieve text chunks that are semantically and syntactically related to the query

    匹配字段正文

星期四

  1. Anthropic:The Institute

    Anthropic 发布 Clio:隐私保护下的 AI 使用分析工具

    Anthropic 发布自动化分析工具 Clio,可在保护用户隐私的前提下分析 claude.ai 的真实使用情况。Clio 由 Claude 完成对话特征提取、语义聚类、簇描述和层级构建,数据自动匿名化聚合,仅高层聚类对分析人员可见。对 100 万条对话的分析显示,Web 与移动应用开发类对话占比超过 10%,教学学习类超过 7%,商业策略与运营类接近 6%。Clio 还帮助识别了用相似提示词结构批量生成 SEO 垃圾内容的自动化账号网络,并发现翻译类有害内容等被原有安全分类器漏报的情况。

    Video thumbnail

    tool that enables privacy-preserving analysis of real-world language model use. It gives us insights into the day-to-day uses of claude.ai in a way that’s analogous to tools like Google Trends. It’s also already helping us improve our safety measures. In this post—which accompanies a full research paper—we describe Clio and some of its initial results. How Clio works: Privacy-preserving analysis at scale Traditional, top-down safety approaches (such as evaluations and red teaming) rely on knowi

    匹配字段正文

星期一

  1. Zyphra Research

    Zyphra 用稀疏图 RAG 将 LLM 上下文扩展到 10 亿 token

    Zyphra 展示了一套检索系统,可在推理时于标准 CPU 上把任意现成 LLM 扩展到 10 亿 token 上下文。该方法基于稀疏图检索,在需要超长上下文推理的 Hash-Hop 基准上取得 SoTA,并称比使用稠密嵌入的常见 RAG 系统更省算力与内存,也比长上下文 Transformer 更高效。团队表示这些初步结果适合端侧和算力受限场景,后续将测试其在更多长上下文任务上的通用性。

    questions about vast inputs such as code bases or books without the need to alter the model’s parameters. Current state-of-the-art transformer-based LLMs with long-context (e.g., Google’s Gemini-1.5 at 1M tokens) often perform well on long-context benchmarks, but have the significant drawback of requiring enormous compute, since they use attention layers whose compute cost increases quadratically with context length. This cost limits scalability & deployment flexibility where compute is limited

    匹配字段正文

星期二

  1. Zyphra Research

    Zyphra 发布 5 万亿 token 数据集 Zyda-2,用 NVIDIA NeMo Curator 将处理时间从 3 周缩短到 2 天

    Zyphra 发布 Zyda-2,一个约 5 万亿 token 的宽松许可数据集,由 DCLM、FineWeb-Edu、Zyda-1 和 Dolma v1.7 的 Common Crawl 部分经跨数据集去重与模型过滤组合而成,已在 HuggingFace 上开放。借助 NVIDIA NeMo Curator 的 GPU 加速,数据处理从 CPU 上的 3 周缩短到 2 天,总拥有成本降低 2 倍。Zyphra 称用 Zyda-2 退火训练的模型在 MMLU、Hellaswag 等聚合评测上优于 DCLM 和 FineWeb-Edu,其 Zamba2 系列模型即基于该数据集的早期版本训练。

    -node setups. We benchmarked NeMo Curator against our previous CPU-based Python package Zyda-Processing. We compared running both packages on a single instance of a3-highgpu-8g on Google Cloud, which has 208 vCPUs, 1.9TB of RAM and 8 H100s 80GB GPUs. This is a typical setup for a node of H100s. We found that running NeMo Curator on this node using GPUs is 10 times faster than running our Zyda package. Processing the whole raw dataset (which is roughly 12 billion documents with 11.5T tokens) woul

    匹配字段正文

星期五

  1. FutureHouse Research精选

    FutureHouse 发布 WikiCrow:自动为 15616 个人类蛋白编码基因生成维基式条目

    FutureHouse 发布 WikiCrow,一个基于其 PaperQA 智能体平台的自动合成系统,可为技术主题生成带引用的维基百科式摘要。团队用它为 15616 个尚无条目或仅有残篇的人类蛋白编码基因生成草稿,每篇约 8 分钟,50 个实例并行,几天内完成,估计人工需约 60000 小时。评测显示 WikiCrow 约 9% 的陈述不正确,但引用来源的一致性明显优于人类编辑;PaperQA 在 PubMedQA Blind、MedQA-USMLE 及自建 LitQA 基准上优于 GPT-4、Perplexity 等系统。

    the “alphabet soup” problem of genomics. Experiments in genomics uncover lists of genes implicated in a biological process, like MGAT5B and ADGRA3. Researchers turn to tools like Google, Uniprot or Wikipedia to learn more, as the knowledge of 20,000 human genes is too broad for any single human to understand. However, according to our count, only 3,639 of the 19,255 human protein-coding genes recognized by the HGNC have high-quality (non-stub) summaries on Wikipedia; the other 15,616 lack pages

    匹配字段正文