搜索“arXiv”

deliver those capabilities at scale. 7. References [1] Alexandra Souly, Qingyuan Lu, Dillon Bowen, Tu Trinh, Elvis Hsieh, Sana Pandey, et al. A strongreject for empty jailbreaks. arXiv preprint arXiv:2402.10260; [2] Alicia Parrish, Angelica Chen, Nikita Nangia, Vishakh Padmakumar, Jason Phang, Jana Thompson, et al. BBQ: A hand-built bias benchmark for question answering. arXiv preprint arXiv:2110.08193; [3] Tejal Patwardhan, Kevin Liu, Todor Markov, Neil Chowdhury, Dillon Leet, Natalie Cone, et

匹配字段正文

the International Conference on Learning Representations (ICLR). Neither addresses the hybrid setting, where KV caches and recurrent states must be reconciled jointly. In our new arXiv paper, we describe a method of extending hybrid models’ context beyond their native limits without training. The procedure is simple: partition a long input into chunks shorter than the native context length and prepend a shared prefix to each chunk; process all chunks independently in parallel; concatenate the K

匹配字段正文

ress after timeouts; on NL2RepoBench, it reportedly improves pass rate from 52.5% to 58.5% in 48 steps while reducing end-to-end training time by 44% vs async. The linked paper is arXiv:2609.33848; commenters note it repeatedly references evaluation with Qwen 3.6 122B, a model many users had been asking about. Comments were mostly hype-oriented, praising Qwen’s execution and joking about training “agentic monsters at home,” with the caveat that meaningful use would require pooled compute. A comm

匹配字段正文

well under half of requests. In longer sessions, users kept switching between questions, planning, reviews, and edits. They built SWE-TaskFlow, which splits each benchmark issue into several turns and adds checkable questions about the code. On 700 SWE-Bench Pro tasks, splitting roughly doubled agent cost with no stable change in success rate. If you evaluate coding agents, first measure what your own users ask for, then shape the benchmark's conversation to match it. – arxiv. org/abs/2610.09633

匹配字段正文

h and teaching. Editorial boards of many peer-reviewed journals are being inundated with AI-written papers and must decide how to assess and disclose the use of generative AI. The arXiv preprint repository has seen a sharp increase in mathematical submissions in recent months. Math papers uploaded to @arxiv per month. Jan 1992 to Jul 2026. Source: https://t.co/nrqjhJBtij pic.twitter.com/pmHvtbYK2X — Pablo Groisman 🎲 (@pgroisma) August 3, 2026 Funding agencies are starting to develop policies gov

匹配字段正文

memory summaries. They keep no explicit estimate of the partner's knowledge or plans, so they can misread intent. They train a model that infers the partner's beliefs, intents and thoughts, including what the partner thinks of the agent. That model scores candidate replies during RL, and the final agent runs alone without it. For agents that negotiate or collaborate, train with a reward that judges replies against an inferred model of the partner's goals and beliefs. – arxiv. org/abs/2610.12453

匹配字段正文

tested, with human-aligned scores; Best: Caught 73.43% of core-claim errors with 4 reviews, versus 14.81% for the best baseline; Worst: Only 16.11% exact matches on real retracted arXiv papers; Bottom line: Best: reads before judging, and finds far more serious errors; Worst: still falls for hidden prompt injection What is Multi-Layered Review? Multi-Layered Review is an agentic AI review system from Sakana AI that understands a research paper before critiquing it. It uses 3 agents on off-the-sh

匹配字段正文

/; Chan, A., Salganik, R., Markelius, A., Pang, C., Rajkumar, N., Krasheninnikov, D., . . . Krueger, D. (2023). Harms from Increasingly Agentic Algorithmic Systems. Retrieved from arXiv: https://arxiv.org/abs/2302.10329; Kang, D., Li, X., Stoica, I., Guestrin, C., Zaharia, M., Hashimoto, T. (2023). Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attacks. Retrieved from arXiv: https://arxiv.org/abs/2302.05733; Kinniment, M., Goodrich, B., Hasin, M., Bloom, R., et al.

匹配字段正文

ching for grading, making the evaluation sensitive to output-formatting differences. We therefore added a system message instructing models to follow the expected answer format.†CharXiv RQ with tools: We benchmarked Claude Fable 5 and GPT 5.6 Sol (max/xhigh) using our internal Python harness. The making of Inkling Architecture Inkling is a Mixture-of-Experts Transformer with a handful of departures from the common recipe, each chosen for efficiency and long-context performance. The MoE design la

匹配字段正文

ndeterminism based on which concurrent core finishes first. We will call this the “concurrency + floating point” hypothesis for LLM inference nondeterminism. For example, a recent arXiv preprint writes: Floating-point arithmetic in GPUs exhibits non-associativity, meaning (a+b)+c≠a+(b+c)(a + b) + c \neq a + (b + c)(a+b)+c=a+(b+c) due to finite precision and rounding errors. This property directly impacts the computation of attention scores and logits in the transformer architecture, where paral

匹配字段正文

ullo for valuable feedback on a draft of this work. References Abdelnabi, S., & Salem, A. (2025). The Hawthorne effect in reasoning models: Evaluating and steering test awareness. arXiv. https://doi.org/10.48550/arXiv.2505.14617; Anthropic. (2025). Activation oracles: Training and evaluating LLMs as general-purpose activation explainers. https://alignment.anthropic.com/2025/activation-oracles/; Anthropic. (2025). Claude Sonnet 4.5 system card. https://www-cdn.anthropic.com/963373e433e489a87a10c8

匹配字段正文

y this technique to more capable models? We're excited to see more work in this direction! References For a list of references, please see the full paper. Citation Please cite the arXiv preprint. Better biosecurity monitors for AI agents via protein embeddings Models know when they’re reward hacking — and we can catch them at scale Silico is your interpretability agent. Explain, debug, and precisely control model behavior with state-of-the-art interpretability methods and infrastructure Silico w

匹配字段正文

se Autoencoders [link] Sharkey, L., 2022. Alignment Forum.[2]Sparse Autoencoders Find Highly Interpretable Features in Language Models [link] Cunningham, H. and Sharkey, L., 2023. arXiv preprint arXiv:2309.08600.[3]Towards Monosemanticity: Decomposing Language Models With Dictionary Learning [link] Bricken, T., 2023. Transformer Circuits., which we give a short introduction to below. We can also intervene on the "features" discovered by interpreter models in order to steer model behaviour in a p

匹配字段正文

of a reasoning model", Goodfire, 2025. References Umap: Uniform manifold approximation and projection for dimension reduction [link] McInnes, L., Healy, J. and Melville, J., 2018. arXiv preprint arXiv:1802.03426; Ameisen, et al., "Circuit Tracing: Revealing Computational Graphs in Language Models", Transformer Circuits, 2025. [HTML] “Open R1: Update 2”. [HTML] Ben Allal, L., Tunstall, L., Lozhkov, A., Bakouch, E., Penedo, G., Kydlicek, H., & Martín Blázquez, G. Feb. 10, 2025. Hugging Face; "Inte

匹配字段正文

n large language models. Sun, L., Yan, L., Lu, X., Lee, A., Zhang, J., & Shao, J. (2026). Valence-arousal subspace in llms: Circular emotion geometry and multi-behavioral control. arXiv preprint arXiv:2604.03147. The valence-arousal model organizes human emotions along two dimensions: valence (how positive or negative is the emotion?) and arousal (how energetic is the emotion?). We found similar results using Llama 3.1 8B, a small LLM. Below, we compare how six basic emotions are mapped in valen

匹配字段正文

rk. Special thanks to our colleagues at Apollo Research, where much of the foundational work was carried out. References For a complete list of references, please see our paper on arXiv. Better biosecurity monitors for AI agents via protein embeddings Models know when they’re reward hacking — and we can catch them at scale Silico is your interpretability agent. Explain, debug, and precisely control model behavior with state-of-the-art interpretability methods and infrastructure Silico works acro

匹配字段正文

rt Pinsler, Daniel Zügner, Andrew Fowler, Matthew Horton, Xiang Fu, et al. Nature 639, 624–632, 2025; Classifier-Free Diffusion Guidance [link] Jonathan Ho and Tim Salimans, 2022. arXiv; Exponential convergence of Langevin distributions and their discrete approximations Gareth O. Roberts and Richard L. Tweedie, 1996; MatterSim: A Deep Learning Atomistic Model Across Elements, Temperatures and Pressures [link] Han Yang, Chenxi Hu, Yichi Zhou, Xixian Liu, Yu Shi, Jielan Li, et al., 2024. arXiv; Py

匹配字段正文

- the first known enterprise application of SAEs for language model guardrails. References BatchTopK Sparse Autoencoders [link] Bart Bussmann, Patrick Leask, and Neel Nanda, 2024. arXiv:2412.06410; Detecting Strategic Deception Using Linear Probes [link] Nicholas Goldowsky-Dill, Bilal Chughtai, Stefan Heimersheim, and Marius Hobbhahn, 2025. arXiv:2502.03407; DeBERTaV3: Improving DeBERTa Using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing [link] Pengcheng He, Jianfeng Ga

匹配字段正文

attribution benchmarks, which rely on deliberately poisoned datasets [9, 10]DATE-LM: Benchmarking Data Attribution Evaluation for Large Language Models [link] Jiao, Cathy, et al. arXiv:2507.09424, 2025. Kowal, Matthew, et al. arXiv:2602.14869, 2026., the behavior we describe here offers a more realistic testbed. Prompts that pair a harmful request with a formatting constraint elicit compliance from OLMo 2 7B DPO but refusal from OLMo 2 7B SFT. These prompts take the form where the distractor is

匹配字段正文

“mammal” to “dog” or “bird” to “hawk” [7]The Geometry of Categorical and Hierarchical Concepts in Large Language Models Kiho Park, Yo Joong Choe, Yibo Jiang, Victor Veitch, 2024. arXiv. [link]. Evo 2 is trained over long DNA sequences, so it can potentially infer the species from one part of a sequence and use this knowledge to improve predictions in other parts. This post addresses the questions: Can Evo 2 infer the species for a given DNA sequence? Does Evo 2 understand how two related specie

匹配字段正文