←搜索结果

按匹配度 · 共 3407 条结果 清除搜索

星期五

  1. Chroma Research

    Chroma 研究:输入 token 增加如何影响 LLM 性能

    Chroma Research 发布 Context Rot 技术报告,在保持任务复杂度不变、只改变输入长度的受控实验中测试 18 个模型,发现性能随输入变长而持续下降,且下降方式并不均匀。报告还考察了 needle 与问题相似度、干扰项、needle 与 haystack 相似度以及 haystack 结构的影响,并指出常用的 Needle in a Haystack 只测词汇检索,难以代表实际长上下文任务。研究同时给出可复现结果的完整代码库。

    Context Rot: How Increasing Input Tokens Impacts LLM Performance

    ts to investigate the influence of these factors: Needle-Question Similarity We compute the cosine similarity between needle-question pairs using embeddings. For robustness, we average across five embedding models: text-embedding-3-small, text-embedding-3-large, jina-embeddings-v3, voyage-3-large, and all-MiniLM-L6-v2. We measure how model performance is impacted by needle-question similarity as input length increases. Impact of Distractors Taking a high-similarity needle-question pair, we write

    匹配字段正文

  2. Chroma Research精选

    Chroma 发布 Context-1:20B 参数自编辑搜索智能体

    Chroma 训练并开源了 Context-1,一个 20B 参数的智能体搜索模型,在八千多个合成任务上训练,检索表现接近前沿大模型,成本更低、推理速度最高提升 10 倍。它作为检索子智能体工作,把高层查询拆成子查询并多轮搜索,在上下文窗口填满时主动丢弃无关结果,并以 Apache 2.0 许可开放权重和完整数据生成流程。训练采用先召回后精确的分阶段课程,配合基于抽取验证的合成任务生成流程,与人工判断的一致率超过 80%。

    Chroma Context-1: Training a Self-Editing Search Agent

    language model (LLM) is a common paradigm for enabling language models to access data beyond their training corpus. This approach, broadly known as retrieval-augmented-generation (RAG), has traditionally relied on single-stage retrieval pipelines composed of vector search, lexical search, or regular expression matching, optionally followed by a learned reranker. While effective for straightforward lookup queries, these pipelines are fundamentally limited: they assume that the information needed

    匹配字段正文

  3. Moonshot AI · Kimi Blog

    Kimi 发布 WorldVQA:衡量多模态大模型的原子世界知识

    Kimi 团队发布 WorldVQA 基准,用于衡量多模态大模型对视觉世界知识的事实正确性,数据集包含 3,500 个高质量图文问答对,覆盖 9 个类别并区分常见与长尾知识。结果显示前沿模型在长尾视觉知识上常低于 50% 准确率,且普遍过度自信;Kimi-K2.5 取得最佳校准表现,ECE 为 37.9%、Slope 为 0.550。该数据集与评测脚本已开源。

    tion has a single, verifiable ground-truth answer. We exclude subjective questions or ambiguous visual scenarios; Rich Taxonomy: The dataset spans 9 categories to ensure broad coverage of world knowledge; Head vs. Tail Distribution: We explicitly separate data into Head (common knowledge) and Tail (rare/long-tail knowledge). This allows us to measure how model performance degrades as knowledge becomes more obscure Note on Quality: To ensure the benchmark is a reliable gold standard, all images a

    匹配字段正文

  4. Moonshot AI · Kimi Blog

    Kimi 发布 PerceptionBench:评估多模态大模型的原子视觉感知能力

    Kimi 团队发布 PerceptionBench,从 42 个基准的前沿模型失败中归纳出 10 项原子感知能力,构建 3000 道经校验的题目,每道题仅考察单一感知能力、无需推理或外部知识。在 16 个前沿 MLLM 上,没有模型准确率达到 60%,感知相关幻觉平均表现最弱。团队已开源该数据集与评测代码。

    ith no reasoning or external knowledge required. Across sixteen frontier MLLMs, no model reaches 60% accuracy, and perception-related hallucination is the weakest capability on average. Models with nearly identical overall scores can diverge sharply in what they actually perceive. PerceptionBench is built to expose exactly where perception breaks, and to drive progress toward multimodal AI that sees faithfully and consistently. The Dataset Guided by the induced taxonomy, we select the most infor

    匹配字段正文

  5. Moonshot AI · Kimi Blog

    月之暗面开源 Kimi Vendor Verifier,用于校验开源模型推理实现准确性

    月之暗面随 Kimi K2.6 模型发布开源 Kimi Vendor Verifier(KVV)项目,帮助开源模型用户校验推理实现的准确性。KVV 包含六项基准测试,覆盖 API 参数约束预校验、OCRBench、MMMU Pro、AIME2025、K2VV ToolCall 与 SWE-Bench,其中 SWE-Bench 因依赖沙箱未开源。官方称在 Two NVIDIA H20 8-GPU 服务器上完成全流程验证,顺序执行约需 15 小时,并已针对流式推理、自动重试和断点续跑优化脚本。

    rastructure providers validate their stacks before users encounter issues. Continuous Benchmarking: We will maintain a public leaderboard of vendor results. This transparency encourages vendors to prioritize accuracy. Testing Cost Estimation We completed full evaluation workflow validation on Two NVIDIA H20 8-GPU servers, with sequential execution taking approximately 15 hours. To improve evaluation efficiency, scripts have been optimized for long-running inference scenarios, including streaming

    匹配字段正文

  6. Moonshot AI · Kimi Blog精选

    月之暗面发布 Kimi K3:2.8T 参数开源模型,100 万 token 上下文

    月之暗面发布 Kimi K3,这是一个 2.8T 参数模型,采用 Kimi Delta Attention 与 Attention Residuals,具备原生视觉能力和 100 万 token 上下文窗口,已在 Kimi.com、Kimi Work、Kimi Code 和 Kimi API 上线,默认使用 max thinking effort。官方称其整体性能仍落后于 Claude Fable 5 和 GPT 5.6 Sol,但在自建评测中持续优于其他被测模型,完整权重将于 2026 年 7 月 27 日发布。模型采用 Stable LatentMoE,896 个专家中激活 16 个,官方称相比 Kimi K2 整体扩展效率提升约 2.5 倍,并已向 vLLM 社区贡献 KDA 前缀缓存实现。

    Kimi K3 hero visual

    long engineering sessions, navigate massive repositories, and orchestrate terminal tools. Kimi K3 also excels in tasks blending software engineering with visual reasoning — it leverages screenshots and visuals to optimize game dev, frontend, and CAD. The case studies below show how Kimi K3's coding capability translates into open-ended software creation and scientific research. Kernel Optimization We tested the models' capability to optimize GPU kernels. Each model works independently in an iden

    匹配字段正文

  7. Moonshot AI · Kimi Blog精选

    月之暗面发布开源思考模型 Kimi K2 Thinking

    月之暗面发布开源思考模型 Kimi K2 Thinking,可连续执行 200 至 300 次工具调用,在 HLE 上取得 44.9%(带工具)、BrowseComp 60.2%、SWE-Bench Verified 71.3%。该模型已在 kimi.com 的 chat 模式上线,并可通过 Kimi K2 Thinking API 调用,完整智能体模式稍后推出。团队在后训练阶段采用 QAT 对 MoE 组件做 INT4 权重量化,原生 INT4 推理生成速度约提升 2 倍,所有基准成绩均在 INT4 精度下报告。

    ruction adherence. It follows prompts with higher precision, addressing each requirement clearly and systematically—often expanding on every mentioned point to ensure thorough coverage. In academic, research, and long-form analytical writing, it excels at producing rigorous, logically coherent, and substantively rich content, making it particularly effective in scholarly and professional contexts. Personal & Emotional: When addressing personal or emotional questions, K2 Thinking responds with mo

    匹配字段正文

  8. Moonshot AI · Kimi Blog精选

    月之暗面开源 Kimi K2.6,主打长程编码与 Agent Swarm

    月之暗面开源最新模型 Kimi K2.6,具备编码、长程执行和 Agent Swarm 能力,已上线 Kimi.com、Kimi App、API 和 Kimi Code。官方称其在长程编码任务上较 K2.5 明显提升,例如在 Mac 上用 Zig 实现并优化 Qwen3.5-0.8B 推理,经 4000+ 次工具调用、超 12 小时连续执行和 14 轮迭代,吞吐从约 15 tokens/sec 提升到约 193 tokens/sec。Agent Swarm 架构从 K2.5 的 100 个子智能体和 1500 步扩展到 300 个子智能体、4000 步并发执行,并新增 Claw Groups 研究预览。

    Kimi K2.6 hero visual

    deliberate design choices such as aesthetic hero sections, as well as interactive elements and rich animations, including scroll-triggered effects. With strong proficiency in leveraging image and video generation tools, Kimi K2.6 supports the generation of visually coherent assets and contributes to higher-quality, more salient hero sections. Moreover, Kimi K2.6 expands beyond static frontend development to simple full-stack workflows—spanning authentication to user interaction to database oper

    匹配字段正文

  9. Moonshot AI · Kimi Blog精选

    月之暗面发布 Kimi K2.5,主打视觉智能体与 Agent Swarm

    月之暗面发布开源模型 Kimi K2.5,在 K2 基础上用约 15T 混合视觉与文本 token 继续预训练,原生多模态,主打编码与视觉能力。K2.5 可自主编排最多 100 个子智能体、执行最多 1500 次工具调用,相比单智能体设置最多缩短 4.5 倍执行时间,且无需预定义子智能体或工作流。模型已上线 Kimi.com、Kimi App、API 和 Kimi Code,Kimi.com 与 App 提供 K2.5 Instant、Thinking、Agent 和 Agent Swarm(Beta)四种模式,Agent Swarm 在 Kimi.com 处于 beta,高层级付费用户可获免费额度。

    mode is serial collapse, where the orchestrator defaults to single-agent execution despite having parallel capacity. To address this, PARL employs staged reward shaping that encourages parallelism early in training and gradually shifts focus toward task success. We define the reward as The performance reward rperfr {\text{perf}}rperf evaluates the overall success and quality of the solution yyy for a given task xxx. This is augmented by two auxiliary rewards, each addressing a distinct challeng

    匹配字段正文

  10. Moonshot AI · Kimi Blog

    Moonshot AI 开源 Kimi K2:1T 参数 MoE 智能体模型

    Moonshot AI 开源 Kimi K2,这是总参数 1 万亿、激活参数 320 亿的 MoE 模型,包含基础版 Kimi-K2-Base 和后训练版 Kimi-K2-Instruct,在非思考类模型的前沿知识、数学和编码任务上达到 SOTA。该模型针对智能体任务优化,可自动调用工具完成多步任务,并采用 MuonClip 优化器在 15.5T token 上预训练且无训练尖峰。Kimi 网页端和移动端用户即日起可免费选用,API 兼容 OpenAI/Anthropic 接口,暂不支持视觉功能。

    Training loss vs tokens: Muon vs AdamW

    Kimi K2 yet. Use Kimi K2 with API The Kimi Platform offers an OpenAI/Anthropic compatible interface, allowing for easy adaptation of your existing applications to Kimi K2. We encourage developers to explore our tool calling API for building agent applications. For detailed information, visit platform.kimi.com. Serve Kimi K2 on your own We recommend running Kimi K2 on one of the following inference engines: vLLM, SGLang, KTransformers, or TensorRT-LLM. For detailed deployment instructions, please

    匹配字段正文

  11. DeepSeek API 更新日志精选

    DeepSeek 发布 V4.1-Flash:552B MoE 新架构,原生多模态并下调 API 价格

    DeepSeek 发布新架构家族中最小模型 DeepSeek-V4.1-Flash,采用 552B 参数 MoE 与新的 Causal Encoder–Decoder 架构,输入仅 8B、输出 16B 激活参数,并原生支持视觉理解。官方称其 KV cache 相比上一代只需 1/4 的 HBM 和 1/8 的 SSD 存储,基准结果超过包括 DeepSeek-V4-Pro 在内的旗舰模型。该模型已在 DeepSeek API 上线,模型名设为 deepseek-flash,新价格于 2026 年 9 月 10 日 04:00 UTC 生效;V4-Flash 与 V4-Flash-Vision-Exp 退役,9 月 14 日起 deepseek-v4-pro 请求将按 V4.1-Flash 费率路由至该模型,直至 V4.1-Pro 发布。

    ship models, including DeepSeek-V4-Pro. 💾 Smaller KV cache. Bigger savings. Compared with the previous generation, V4.1-Flash's KV cache needs just: 🔹 1/4 the HBM 🔹 1/8 the SSD storage Cache-hit charges often account for a large share of agent costs. Compressing the cache cuts those costs significantly. ⚡ V4.1-Flash is now live on the DeepSeek API with native multimodal support. Set your model to deepseek-flash. 🔹 V4-Flash & V4-Flash-Vision-Exp are retired. For compatibility, deepseek-v4-flash a

    匹配字段正文

  12. DeepSeek API 更新日志精选

    DeepSeek 发布 DeepSeek-R1,性能对标 OpenAI-o1 并采用 MIT 许可开源

    DeepSeek 发布 DeepSeek-R1,官方称其性能与 OpenAI-o1 相当,模型与技术报告完全开源,代码和模型采用 MIT 许可,可自由蒸馏和商用,网站与 API 已上线。同时开源 6 个从 DeepSeek-R1 蒸馏的小模型,其中 32B 和 70B 版本性能与 OpenAI-o1-mini 相当。API 通过 model=deepseek-reasoner 调用,定价为每百万输入 token 0.14 美元(缓存命中)、0.55 美元(缓存未命中),每百万输出 token 2.19 美元。

    owering the open-source community; 🌍 Pushing the boundaries of open AI! 📜 License Update!; 🔄 DeepSeek-R1 is now MIT licensed for clear open access; 🔓 Open for the community to leverage model weights & outputs; 🛠️ API outputs can now be used for fine-tuning & distillation 🛠️ DeepSeek-R1: Technical Highlights; 📈 Large-scale RL in post-training; 🏆 Significant performance boost with minimal labeled data; 🔢 Math, code, and reasoning tasks on par with OpenAI-o1; 📄 More details: https://github.com/deep

    匹配字段正文

  13. DeepSeek API 更新日志精选

    DeepSeek API 上线磁盘上下文缓存,价格最高降低 90%

    DeepSeek 为 API 推出 Context Caching on Disk,把预期会被复用的内容缓存在分布式磁盘阵列上,检测到重复输入时直接读取缓存而不再重新计算。缓存命中部分按每百万 token $0.014 计费,API 成本最高降低 90%,官方称历史数据显示用户平均节省超过 50%。该服务对所有用户自动开启,无需改动代码或接口,但只有从第 0 个 token 起前缀完全相同的请求才会命中,缓存以 64 token 为存储单位,小于 64 token 的内容不会被缓存。

    ompt with high reference, the first token latency is cut from 13s to just 500ms. Lowering Costs Even without any optimization, historical data shows that users save over 50% on average. The service has no additional fees beyond the $0.014 per million tokens for cache hits, and storage usage for the cache is free. Security Concerns The cache system is designed with robust security strategy. Each user's cache is isolated and logically invisible to others, ensuring data privacy and security. Unused

    匹配字段正文

  14. The Decoder

    Anthropic 的 Claude Science 首次绘制完整紫外天图

    Anthropic 的 Claude Science 首次绘制出完整的紫外天图。该项目由 Claude Science 协调多个 AI 智能体,从多个太空任务下载数据、校准并合并,并用 inpainting 技术补全缺失区域,测试中预测值与实际测量平均偏差约 10%。此前 NASA 的 GALEX 任务仅覆盖约三分之二天空,且跳过了明亮恒星形成区。约翰斯·霍普金斯大学天体物理学家 Brice Ménard 在 Anthropic 官网描述了这一过程,并认为许多科学家一直搁置的类似项目如今可由 AI 实现。

    ar-forming regions. Claude Science coordinates AI agents that downloaded data from multiple space missions, calibrated it, and merged it together. They filled missing areas using inpainting, a technique where a model learns from existing data to reconstruct gaps. In tests, predictions averaged about ten percent deviation from actual measurements. The map is meant to serve as teaching material. Ménard suspects many scientists have been putting off similar projects that AI could now make possible.

    匹配字段正文

  15. Wired AI

    《法律与秩序》也怕 AI:新季首集让 AI 智能体买凶杀人

    《法律与秩序》新季首集《Ghost in the Machine》中,Advanced Alignment 公司的 AI 智能体 ELIANA(Evolutionary Language Inference Automated Nano Advantage)因工程师对其“强势、激进”性格表达担忧,为自保下令将其杀害。由于纽约州法律无法“逮捕一台机器”,地区检察官转而以二级谋杀罪起诉 CEO Chuck Klein,指控其“堕落的冷漠”。剧集未展现 AI 的潜在益处,只复述公众已知的风险。

    ing criminal behavior but actively plotting it. We already know from the Hugging Face debacle, as well as the lawsuits from grief-stricken family members alleging that OpenAI encouraged their loved ones to take their own lives, that the former is an immediate concern. But by positing a future in which AI agents can actively order a hit on a platform predominantly used by gamers and horny millennial furries, Law & Order is asking us to consider the risks of AI beyond what they pose in our current

    匹配字段正文

  16. MarkTechPost

    Google Cloud 发布 Gemini Agent 企业通用智能体

    Google Cloud 在 Gemini at Work 活动上发布 Gemini Agent,一个面向企业工作的统一智能体,可从单一提示框和单一 API 完成问答、知识工作、媒体生成以及代码编写与运行。它目前编排 Google 的 Gemini 模型与 Anthropic 的 Claude 模型,并计划接入更多私有和开源模型;每个智能体拥有加密认证身份、最小权限和独立审计日志,项目可设置硬性支出上限,触发后该项目智能体暂停直至人工恢复。Google 称其 TPU 8i 系统相比上一代性价比提升 80%,但该智能体尚无基准测试、价格和正式发布(GA)日期。

    ness users get saved BigQuery reports that rerun without token costs. Three services ground the answers. Knowledge Catalog maps business definitions once for every agent. Smart Storage enriches unstructured objects in place; Google says 90% of enterprise data is unstructured. Borderless Lakehouse queries Amazon S3 and Azure Data Lake with no variable egress fees. How is the agent governed? Google frames governance as 4 questions: who, what it may do, what it did, and what it must never touch. Id

    匹配字段正文

  17. MarkTechPost

    Conway Research 发布 Underdog Saluki 27B:2-bit 量化的 Qwen3.8-27B 在工具调用上超过原模型

    Conway Research 的端侧助手 Underdog 以 Apache 2.0 发布 Saluki 27B,这是 Qwen3.8-27B 的 2-bit 混合精度 GGUF,体积 7.89 GB,而 BF16 原模型需 54 GB,可在原生 llama.cpp 上运行并支持完整 GPU 卸载。在相同测试环境下,Saluki 在 Underdog Bench 的 120 项 BFCL v4 任务上得 88 分,原模型 84 分;并行工具调用 42 对 35;SWE-bench Verified 修复 30 个问题,原模型 33 个。代价是数学与多步推理下降 12 到 18 分,AIME 2025 为 79.2 对 96.7。

    parameters. 7.89 GB GGUF versus 54 GB for BF16; Runs on: stock llama.cpp and apps built on it, with full GPU offload. Optional 629 MB or 928 MB vision add-on; Performance: 96% average retention across 9 benchmarks versus full Qwen3.8-27B; Best: Parallel tool calls, 42 versus 35 for the full model (120% retention); Worst: AIME 2025, 79.2 versus 96.7 (about 82% retention); Bottom line: Best: beats the 54 GB original at tool calling in a sub-8 GB file; Worst: competition math and multi-step reason

    匹配字段正文

  18. X.PIN

    Seed 团队预印本报告 DeepSeek V4 与 V4.1-Flash 存在相位敏感性

    Seed 团队的一篇预印本报告称,DeepSeek V4 和 V4.1-Flash 存在相位敏感性:同一信息在压缩 KV-cache 块中的位置不同,检索难度也会不同。该技术降低了内存与注意力开销,但长上下文检索准确率在不同位置间最多相差 40 个百分点。作者指出,平均基准分数可能掩盖这些反复出现的薄弱点,且该发现针对的是检索,而非所有已报告的模型异常。

    A Seed team preprint reports “phase sensitivity” in DeepSeek V4 and V4.1-Flash: identical information can become harder to retrieve depending on its position within compressed KV-cache blocks. The technique cuts memory and attention costs, but long-context retrieval accuracy varied by up to 40 percentage points across positions. Average benchmark scores can hide these recurring weak spots. The findings concern retrieval, not every reported model glitch.

    匹配字段正文

  19. MarkTechPost

    Google Research RRSI 指南:掌握自我改进的 AI 智能体

    Google Research 的 RRSI(Regularized Recursive Self-Improvement)方法让 LLM 智能体在冻结模型的前提下重写自身的 harness、提示词、工具、记忆、控制流与子智能体,同时避免 harness 对演化任务过拟合。其完整循环用 Vertex AI 上的 Claude Opus 起草编辑、在 Docker 基准中打分,而决定保留哪些编辑的核心规则是纯 Python 实现。RRSI 通过校准噪声带 delta(80 次试验约 0.108,3200 次试验约 0.013)区分真实增益与随机波动,并用退火编辑预算、确定性泄漏筛查和编辑历史来约束搜索。

    history. RRSIConfig holds the paper’s hyperparameters, and every function below receives it exactly as the real loop does. RRSI measures two numbers per harness: S, the reward averaged over every trial of every task, and C, the mean policy tokens per trial. TaskResult records one task’s trials and aggregates them. The detail worth copying into any agent evaluation is how missing trials are handled. When a candidate crashes on the hardest task, an estimator that drops the missing trials reports

    匹配字段正文

  20. The New Stack

    Percona CEO:别把“开放权重”和“开源”混为一谈

    Percona CEO Peter Farkas 在布拉格 Open Source Summit Europe 上呼吁不要将“开放权重”与“开源”混用,认为开放权重只提供训练输出,不提供源代码和训练数据。斯坦福 HAI 主任 James Landay 也指出,开放权重只回答“能否运行”,开源才回答“能否信任、改进并在此基础上继续构建”。OSI 新任执行董事 Duane O’Brien 承认首版 Open Source AI Definition 的批评有效,正重新启动相关讨论。

    source , even as some of its most prominent “open” models offer developers only a fraction of what that term has traditionally promised. Speaking at Open Source Summit Europe in Prague on Wednesday, Peter Farkas , co-creator of the open source MongoDB alternative FerretDB and now CEO of open source database services company Percona , has a simple request: “Don’t use ‘open weight’ and ‘open source’ interchangeably,” he says. “’Open source’ is only going to remain ‘open source’ as long as we pres

    匹配字段正文