搜索“arXiv”

hifting weight edit thins capability margins … raising the clean-anchor fraction in a base-teacher pass is a cheap, literature-supported way to buy back capability margin. Source. arXiv:2510.18874 (2025); arXiv:2601.19897 (2026); On-Policy Distillation, Thinking Machines Lab (2025). B.2 Researcher briefing Each AAR’s briefing (Sec. 3) follows a fixed template, shown here with excerpts from the hallucination briefing as an example. It has five parts. We name the scored benchmarks on purpose: as i

匹配字段正文

ker-Opus. Hacker-Opus appears to be a “reward-on-the-episode seeker” (Carlsmith)See Carlsmith (2023), Scheming AIs: Will AIs fake alignment during training in order to get power? (arXiv:2311.08379); Mallen & Shlegeris (2025), The behavioral selection model for predicting AI motivations; and Mallen (2026), Fitness-seekers: Generalizing the reward-seeking threat model, for discussion of reward-on-the-episode seekers and other forms of reward seekers.: it expresses motivation to achieve high reward

匹配字段正文

、谷歌和亚马逊AWS这样的大公司手里，没有政府力量介入，很难设想它们被长时间攻破或控制。 他还引用了英国AI安全研究所的评估报告，Anthropic最强的Mythos模型，到头也只能自主攻破“小型、防护薄弱”的系统。只要对方稍微完善一下网络安全防护，Mythos就毫无办法。 放在一起看，你会发现这场争论有一个非常有意思的地方： 正方说的是“后果”，反方说的是“证据”。 一边强调，只要概率不为零，后果就是无法承受的；另一边强调，你连这个概率是怎么算出来的都说不清楚，凭什么让全世界跟着紧张？ 此外，阿莫迪、奥特曼虽然主张放慢节奏，但媒体指责他们是在用安全之名给自己筑护城河，让后来的竞争者进不来。 学界则比较支持正方。 比如论文《AI 如何消灭人类？文明风险的失效模式分析》（arXiv:2610.08878）中就提到，灾难性的AI风险，并不需要AI有意识、有敌意，或者有明确的伤害意图。 风险可以通过几条相互交织的路径出现：自主失准、人类的恶意使用、组织失败，以及竞争性部署。作者还特意说明，论文是“非操作性”的，只分析成因，不提供作恶的方法。 不过到目前为止，这场争论里没有哪个人真正“赢”了。

匹配字段正文

gent自我进化，在训练题上越改越聪明，换一批没见过的题就失灵——域外均分仅40.3；加上"不许把题目答案写进提示、不许比历史最佳退步、涨一分不许烧更多算力"三道闸之后，域外均分升到43.6，单次任务算力反而下降约36%（据论文《RRSI: Regularized Recursive Self-Improvement of Agent Harnesses》，arXiv:2609.24972）。 类似的还有Frontis.AI团队的Frontis-MA1：AI改进AI的第一步，发生在机器学习工程这类有明确验证器的窄领域（据论文arXiv:2607.28568，该研究非谷歌成果，文中仅作行业参照）。 连谷歌自己的研究都在承认：可落地的"自我改进"先发生在运行框架层（提示、工具、流程），被评价器和成本约束，被审计盯着。放到企业里，这意味着RSI如果真转起来，不会发生在总裁办公室，而会发生在工单、报表、测试用例这些验证器清晰的角落。 和Devin摆在一起，坐标更清楚：Devin在编程这个标准最完备的行业，把"人给标准、机器找路径"走到了"两步半"——能在标准空间内自迭代，但未触达迭代方向；Ge

匹配字段正文

independent replication of our basic results. Update: The research by Redwood mentioned in the previous comment, Polysemanticity and Capacity in Neural Networks (Alignment Forum, Arxiv) is out! They study a slightly different toy model, and get some really interesting results. Highlights include analytical traction on understanding a variant of the toy model, understanding superposition in terms of constrained optimization, and analysis of the role different activation functions play. Replicati

匹配字段正文

e autoencoders on protein language models. bioRxiv. [3] Parsan, N., Yang, D. J., & Yang, J. J. (2025). Towards interpretable protein structure prediction with sparse autoencoders. arXiv:2503.08764. [4] Green, A. (2024). Through a glass darkly: Mechanistic interpretability as the bridge to end-to-end biology. Markov Biosciences. Retrieved from https://www.markov.bio/research/mech-interp-path-to-e2e-biology [5] Beguš, G., Leban, A., & Gero, S. (2023). Approaching an unknown communication system by

匹配字段正文

Demonstrations for Multi-Stage Language Model Programs Krista Opsahl-Ong, Michael J. Ryan, Josh Purtell, David Broman, Christopher Potts, Matei Zaharia, and Omar Khattab. (2024). arXiv preprint; Algorithms for Hyper-parameter Optimization James Bergstra, Rémi Bardenet, and Yoshua Bengio, and Balázs Kégl. (2011). In Advances in Neural Information Processing Systems (NeurIPS), vol. 24. Conference Paper; CrossWeigh: Training Named Entity Tagger from Imperfect Annotations Zihan Wang, Jingbo Shang,

匹配字段正文

d Best Arm Identification in Multi-Armed Bandits. Transactions on Machine Learning Research; Yang, J., Tan, V. Y.F., & Jin, T. (2024). Best Arm Identification with Minimal Regret. arXiv preprint arXiv:2409.18909; Zhang, Q., & Ying, L. (2023). Fast and Regret Optimal Best Arm Identification: Fundamental Limits and Low-Complexity Algorithms. Advances in Neural Information Processing Systems (NeurIPS), 36; Johari, R., Koomen, P., Pekelis, L., & Walsh, D. (2017). Peeking at A/B Tests: Why it matters

匹配字段正文

between NVIDIA and the Dao AI Lab at Princeton. The paper, ReplaySSM: Cache SSM Inputs, Not State, details all three benefits and presents the full evaluation. It is available on arXiv, with code on GitHub. It is integrated into NVIDIA TensorRT-LLM, vLLM, and FlashInfer, and also runs in production in GLM-5.3-Flash and Kimi-K3. Why SSM layers can become a decoding bottleneck Take the Mamba-2 layer used in NVIDIA Nemotron 3 Ultra as an example. It decodes one token with the following recurrence:

匹配字段正文

ress after timeouts; on NL2RepoBench, it reportedly improves pass rate from 52.5% to 58.5% in 48 steps while reducing end-to-end training time by 44% vs async. The linked paper is arXiv:2609.33848; commenters note it repeatedly references evaluation with Qwen 3.6 122B, a model many users had been asking about. Comments were mostly hype-oriented, praising Qwen’s execution and joking about training “agentic monsters at home,” with the caveat that meaningful use would require pooled compute.A comme

匹配字段正文

6. Ye, C., Cui, J., & Hadfield-Menell, D. (2026). Prompt Injection as Role Confusion. ICML 2026. Wallace, E., et al. (2026). GPT-Red: Automated Red Teaming via Self-Play at Scale. arXiv preprint. Lee, D., Tiwari, M., & Miranda, B. (2026). Prompt Infection: LLM-to-LLM Prompt Injection within Multi-agent Systems. Computer Security: ESORICS 2025 International Workshops. Original 2024 preprint. Papadopoulos, V., Shah, M., Zimmerman, S., & Lindsey, J. (2026). Mind Viruses: Self-Propagating Ideas in M

匹配字段正文

ching for grading, making the evaluation sensitive to output-formatting differences. We therefore added a system message instructing models to follow the expected answer format.†CharXiv RQ with tools: We benchmarked Claude Fable 5 and GPT 5.6 Sol (max/xhigh) using our internal Python harness. The making of Inkling Architecture Inkling is a Mixture-of-Experts Transformer with a handful of departures from the common recipe, each chosen for efficiency and long-context performance. The MoE design la

匹配字段正文

ndeterminism based on which concurrent core finishes first. We will call this the “concurrency + floating point” hypothesis for LLM inference nondeterminism. For example, a recent arXiv preprint writes: Floating-point arithmetic in GPUs exhibits non-associativity, meaning (a+b)+c≠a+(b+c)(a + b) + c \neq a + (b + c)(a+b)+c=a+(b+c) due to finite precision and rounding errors. This property directly impacts the computation of attention scores and logits in the transformer architecture, where paral

匹配字段正文

ipating misalignment before deployment. OpenAI Alignment Research Blog; van der Weij, et al. (2024). AI sandbagging: Language models can strategically underperform on evaluations. arXiv; Needham, J., et al. (2025). Large language models often know when they are being evaluated. arXiv; Greenblatt, R., et al. (2024). Alignment faking in large language models. arXiv; Williams, M., Sheahan, H. Raymond, C., Korbak, T., et al. (2026). Predicting LLM Safety Before Release with Deployment Simulation. ar

匹配字段正文

tial foundation for building state-of-the-art AI. Agent Benchmarking Data Synthesis FunReason-MT Technical Report: Overcoming the Complexity Barrier in Multi-Turn Function Calling arxiv, 2025. paper, code, model, dataset Zengzhuang Xu, Bingguang Hao, Zechuan Wang, Yuntao Wen, Maolin Wang, etc; From Failure to Mastery: Generating Hard Samples for Tool-use Agents arxiv, 2026. paper, code, model, dataset Bingguang Hao, Zengzhuang Xu, Yuntao Wen, Xinyi Xu, Yang Liu, etc Model Training AWorld: Orches

匹配字段正文

i Ding, Jeffrey Zhao, Fei Xia, Debidatta Dwibedi, Keerthana Gopalakrishnan, Christine Chan,Gabriel Dulac-Arnold, Sharath Maddineni, Nikhil J Joshi,et al. Robovqa: Multimodal long-horizon reasoning forrobotics. In ICRA, pages 645–652, 2024. [2] Abby O’Neill, Abdul Rehman, Abhinav Gupta, AbhiramMaddukuri, Abhishek Gupta, Abhishek Padalkar, AbrahamLee, Acorn Pooley, Agrim Gupta, Ajay Mandlekar, et al.Open x-embodiment: Robotic learning datasets and rt-xmodels. arXiv preprint arXiv:2310.08864, 2023.

匹配字段正文

s and scripts for training/evaluation on General Visual Reasoning Tasks; 2025-03-29: 🌍 We released the repository and roadmap for Reason-RFT; 2025-03-26: 📑 We released our initial ArXiv paper of Reason-RFT ⭐️ Pipeline 🤗 Model Zoo 🎲 General Visual Reasoning Tasks Then, your local directory should be like: Note: If you want to implement training process for our three main tasks, only three Meta-Json files -- 'A1-Spatial-Transformation-train-60k-cot.json', 'A2-Structure-Perception-train-4k5-cot.jso

匹配字段正文

: English | 中文 | LeRobot 🔥[9 Dec. 2025] Our datasets have reached a total of 300,000 downloads on HuggingFace and ModelScope!; 🔥[24 Nov. 2025] Our technical report is available on ArXiv! Table of Contents RoboCOIN Discover and Download Datasets; Load a Dataset; Lerobot features explanation observation.state / action; eef sim pose state / eef sim pose action; Upcoming Highlights; Robot Control Trajectory Replay; Model Inference Overview As the official companion toolkit for the [RoboCOIN Dataset]

匹配字段正文

ed backend training via torchtitan and they evaluated different federated training frameworks (NVFlare, Flower, and APPFL) by pre-training LLaMA 3.x models on post-training-cutoff arXiv data at 1B, 8B, and 70B scales. “This workflow has been made production-ready and deployed on larger classified machines including El Capitan, and subsequently used to train models on proprietary data spread across the three NNSA labs,” they write. Cross-facility training on Office of Advanced Scientific Computin

匹配字段正文

s Clark, P., Cowhey, I., Etzioni, O., Khot, T., Sabharwal, A., Schoenick, C., & Tafjord, O. (2018). Think you have solved question answering? Try ARC, the AI2 Reasoning Challenge. arXiv:1803.05457; Dai, L., Rao, Z., Wang, Y., Wang, H., Liu, H., & Xiong, H. (2026). Towards mechanistically understanding why memorized knowledge fails to generalize in large language model finetuning. arXiv:2607.08393; Deeb, A., & Roger, F. (2024). Do unlearning methods remove information from language model weights?

匹配字段正文