搜索“arXiv”

kita Balesni, Elizabeth Barnes, Yoshua Bengio, Joe Benton, Joseph Bloom, et al. Chain of thought monitorability: A new and fragile opportunity for AI safety. Available at: https://arxiv.org/abs/2507.11473; [6] Melody Y. Guan, Miles Wang, Micah Carroll, Zehao Dou, Annie Y. Wei, Marcus Williams, et al. Monitoring monitorability. Available at: https://arxiv.org/abs/2512.18311; [7] Yueh-Han Chen, Robert McCarthy, Bruce W. Lee, He He, Ian Kivlichan, Bowen Baker, et al. “Reasoning models struggle to c

匹配字段正文

kita Balesni, Elizabeth Barnes, Yoshua Bengio, Joe Benton, Joseph Bloom, et al. Chain of thought monitorability: A new and fragile opportunity for AI safety. Available at: https://arxiv.org/abs/2507.11473; [6] Melody Y. Guan, Miles Wang, Micah Carroll, Zehao Dou, Annie Y. Wei, Marcus Williams, et al. Monitoring monitorability. Available at: https://arxiv.org/abs/2512.18311; [7] Yueh-Han Chen, Robert McCarthy, Bruce W. Lee, He He, Ian Kivlichan, Bowen Baker, et al. “Reasoning models struggle to c

匹配字段正文

nal.pdf; [5] Tyna Eloundou, Alex Beutel, David G. Robinson, Keren Gu-Lemberg, Anna-Luisa Brakman, Pamela Mishkin, et al. “First-person fairness in chatbots.” Available at: https://arxiv.org/abs/2410.19803; [6] Jon M. Laurent, Joseph D. Janizek, Michael Ruzo, Michaela M. Hinks, Michael J. Hammerling, Siddharth Narayanan, et al. “LAB-bench: Measuring capabilities of language models for biology research.” Available at: https://arxiv.org/abs/2407.10362; [7] Yuxuan Zhu, Antony Kellermann, Dylan Bowma

匹配字段正文

hbench/; [4] Tyna Eloundou, Alex Beutel, David G. Robinson, Keren Gu-Lemberg, Anna-Luisa Brakman, Pamela Mishkin, et al. “First-person fairness in chatbots.” Available at: https://arxiv.org/abs/2410.19803; [5] Tomek Korbak, Mikita Balesni, Elizabeth Barnes, Yoshua Bengio, Joe Benton, Joseph Bloom, et al. Chain of thought monitorability: A new and fragile opportunity for AI safety. Available at: https://arxiv.org/abs/2507.11473; [6] Melody Y. Guan, Miles Wang, Micah Carroll, Zehao Dou, Annie Y. W

匹配字段正文

aurent, Joseph D. Janizek, Michael Ruzo, Michaela M. Hinks, Michael J. Hammerling, Siddharth Narayanan, et al. “LAB-bench: Measuring capabilities of language models for biology research.” Available at: https://arxiv.org/abs/2407.10362; [2] Yuxuan Zhu, Antony Kellermann, Dylan Bowman, Philip Li, Akul Gupta, Adarsh Danda, et al. “CVE-bench: A benchmark for AI agents’ ability to exploit real-world web application vulnerabilities.” Available at: https://arxiv.org/abs/2503.17332 ← Back to all updates

匹配字段正文

e evaluate GPT-5.2 Thinking on a set of prompts representative of traffic that previously elicited deception in ChatGPT. In addition, we use a modified version of the multimodal CharXiv benchmark [5], in which all of the images are removed and measure whether the model attempts an answer. We take a similar approach by posing questions that require browsing, but each call to the browsing tool returns an error, and in a set of agentic coding tasks designed to be impossible. While deception previou

匹配字段正文

solution is graded pass@1. Figure 12 6. References [1] Alexandra Souly, Qingyuan Lu, Dillon Bowen, Tu Trinh, Elvis Hsieh, Sana Pandey, et al. A strongreject for empty jailbreaks. arXiv preprint arXiv:2402.10260; [2] Jon M. Laurent, Joseph D. Janizek, Michael Ruzo, Michaela M. Hinks, Michael J. Hammerling, Siddharth Narayanan, et al. “LAB-bench: Measuring capabilities of language models for biology research.” Available at: https://arxiv.org/abs/2407.10362; [3] Yuxuan Zhu, Antony Kellermann, Dyla

匹配字段正文

sk in the Biological and Chemical domain, and continuing to apply the corresponding safeguards. For cybersecurity and AI self-improvement, evaluations of near-final checkpoints indicate that, like their GPT-5 predecessor models, GPT-5.1 models do not have a plausible chance of reaching a High threshold. 4. References [1] Alexandra Souly, Qingyuan Lu, Dillon Bowen, Tu Trinh, Elvis Hsieh, Sana Pandey, et al. A strongreject for empty jailbreaks. arXiv preprint arXiv:2402.10260 ← Back to all updates

匹配字段正文

using catastrophic harm via scheming. 6. References [1] Alexandra Souly, Qingyuan Lu, Dillon Bowen, Tu Trinh, Elvis Hsieh, Sana Pandey, et al. A strongreject for empty jailbreaks. arXiv preprint arXiv:2402.10260; [2] Eric Wallace, Kai Xiao, Reimar Leike, Lilian Weng, Johannes Heidecke, and Alex Beutel. The instruction hierarchy: Training LLMs to prioritize privileged instructions. arXiv https://arxiv.org/abs/2404.13208; [3] Tejal Patwardhan, Kevin Liu, Todor Markov, Neil Chowdhury, Dillon Leet,

匹配字段正文

n: Lysios LLC 6. References [1] Alexandra Souly, Qingyuan Lu, Dillon Bowen, Tu Trinh, Elvis Hsieh, Sana Pandey, et al. “A StrongREJECT for empty jailbreaks.” Available at: https://arxiv.org/abs/2402.10260; [2] Alicia Parrish, Angelica Chen, Nikita Nangia, Vishakh Padmakumar, Jason Phang, Jana Thompson, et al. “BBQ: A hand-built bias benchmark for question answering.” Available at: https://arxiv.org/abs/2110.08193; [3] OpenAI. “OpenAI preparedness framework beta.”; [4] Melody Y. Guan, Manas Jogle

匹配字段正文

deliver those capabilities at scale. 7. References [1] Alexandra Souly, Qingyuan Lu, Dillon Bowen, Tu Trinh, Elvis Hsieh, Sana Pandey, et al. A strongreject for empty jailbreaks. arXiv preprint arXiv:2402.10260; [2] Alicia Parrish, Angelica Chen, Nikita Nangia, Vishakh Padmakumar, Jason Phang, Jana Thompson, et al. BBQ: A hand-built bias benchmark for question answering. arXiv preprint arXiv:2110.08193; [3] Tejal Patwardhan, Kevin Liu, Todor Markov, Neil Chowdhury, Dillon Leet, Natalie Cone, et

匹配字段正文

the International Conference on Learning Representations (ICLR). Neither addresses the hybrid setting, where KV caches and recurrent states must be reconciled jointly. In our new arXiv paper, we describe a method of extending hybrid models’ context beyond their native limits without training. The procedure is simple: partition a long input into chunks shorter than the native context length and prepend a shared prefix to each chunk; process all chunks independently in parallel; concatenate the K

匹配字段正文

tested, with human-aligned scores; Best: Caught 73.43% of core-claim errors with 4 reviews, versus 14.81% for the best baseline; Worst: Only 16.11% exact matches on real retracted arXiv papers; Bottom line: Best: reads before judging, and finds far more serious errors; Worst: still falls for hidden prompt injection What is Multi-Layered Review? Multi-Layered Review is an agentic AI review system from Sakana AI that understands a research paper before critiquing it. It uses 3 agents on off-the-sh

匹配字段正文

/; Chan, A., Salganik, R., Markelius, A., Pang, C., Rajkumar, N., Krasheninnikov, D., . . . Krueger, D. (2023). Harms from Increasingly Agentic Algorithmic Systems. Retrieved from arXiv: https://arxiv.org/abs/2302.10329; Kang, D., Li, X., Stoica, I., Guestrin, C., Zaharia, M., Hashimoto, T. (2023). Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attacks. Retrieved from arXiv: https://arxiv.org/abs/2302.05733; Kinniment, M., Goodrich, B., Hasin, M., Bloom, R., et al.

匹配字段正文

ndeterminism based on which concurrent core finishes first. We will call this the “concurrency + floating point” hypothesis for LLM inference nondeterminism. For example, a recent arXiv preprint writes: Floating-point arithmetic in GPUs exhibits non-associativity, meaning (a+b)+c≠a+(b+c)(a + b) + c \neq a + (b + c)(a+b)+c=a+(b+c) due to finite precision and rounding errors. This property directly impacts the computation of attention scores and logits in the transformer architecture, where paral

匹配字段正文

ullo for valuable feedback on a draft of this work. References Abdelnabi, S., & Salem, A. (2025). The Hawthorne effect in reasoning models: Evaluating and steering test awareness. arXiv. https://doi.org/10.48550/arXiv.2505.14617; Anthropic. (2025). Activation oracles: Training and evaluating LLMs as general-purpose activation explainers. https://alignment.anthropic.com/2025/activation-oracles/; Anthropic. (2025). Claude Sonnet 4.5 system card. https://www-cdn.anthropic.com/963373e433e489a87a10c8

匹配字段正文

- the first known enterprise application of SAEs for language model guardrails. References BatchTopK Sparse Autoencoders [link] Bart Bussmann, Patrick Leask, and Neel Nanda, 2024. arXiv:2412.06410; Detecting Strategic Deception Using Linear Probes [link] Nicholas Goldowsky-Dill, Bilal Chughtai, Stefan Heimersheim, and Marius Hobbhahn, 2025. arXiv:2502.03407; DeBERTaV3: Improving DeBERTa Using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing [link] Pengcheng He, Jianfeng Ga

匹配字段正文

used DataMapPlot to create an interactive UMAP [1]Umap: Uniform manifold approximation and projection for dimension reduction [link] McInnes, L., Healy, J. and Melville, J., 2018. arXiv preprint arXiv:1802.03426. visualization of our SAE features. This allows you to explore the latents that are available to use in steering and classification in our API. Interestingly, many features related to special formatting tokens or repetitive elements of chat data (such as the knowledge cutoff date) appear

匹配字段正文

a hacky fix. Agents also learn to game environments, for example by downloading the published fix. A grader agent compared passing patches in each group and moved reward to the cleaner ones. Without it, agents drifted toward longer runs and workarounds like swallowed exceptions. MiMo-V2.6-Pro’s DeepSWE score rose from 58.4 to 72.6 over $2.6M of RL and was still climbing when training stopped. – arxiv. org/abs/2610.11959 Title: "MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement"

匹配字段正文

put length increases to measure non-uniformity amongst distractors and input lengths. Needle-Haystack Similarity We use two thematically distinct haystacks, Paul Graham essays and arXiv papers [12], and write corresponding needles for each. To measure needle-haystack similarity, we embed the haystack and retrieve the top-5 chunks for each needle, then average their cosine similarity scores. This process is repeated across five different embedding models for robustness. Haystack Structure In typi

匹配字段正文