搜索“arXiv”

o: Interpreting Text-to-Image Models with Sparse Autoencoders [link] Viacheslav Surkov, Chris Wendler, Mikhail Terekhov, Justin Deschenaux, Robert West, and Caglar Gulcehre, 2024. arXiv preprint arXiv:2410.22366. who trained sparse autoencoder (SAE) models across various layers of SDXL-Turbo. To decompose each patch's latent vector into a set of interpretable features, we trained a BatchTopK SAE [4]BatchTopK Sparse Autoencoders [link] Bart Bussmann, Patrick Leask, and Neel Nanda, 2024. arXiv pre

匹配字段正文

Die' [link] Mandy Taheri, 2024. Newsweek; Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMs [link] Jan Betley, Daniel Tan, Niels Warncke, et al., 2025. arXiv; Model Organisms for Emergent Misalignment [link] Edward Turner, Anna Soligo, et al. 2025. arXiv; Llama 3.2: Revolutionizing edge AI and vision with open, customizable models [link] [model] Meta, 2024. Meta AI blog; 2 OLMo 2 Furious [link] [model] Pete Walsh, Luca Soldaini, Dirk Groeneveld, Kyle Lo, Shane Arora,

匹配字段正文

used DataMapPlot to create an interactive UMAP [1]Umap: Uniform manifold approximation and projection for dimension reduction [link] McInnes, L., Healy, J. and Melville, J., 2018. arXiv preprint arXiv:1802.03426. visualization of our SAE features. This allows you to explore the latents that are available to use in steering and classification in our API. Interestingly, many features related to special formatting tokens or repetitive elements of chat data (such as the knowledge cutoff date) appear

匹配字段正文

before, we focus on the representations from the last layer of Pleiades and train a BatchTopK SAE [15]Batchtopk sparse autoencoders Bart Bussmann, Patrick Leask, Neel Nanda, 2024. arXiv preprint arXiv:2412.06410. on the cfDNA pretraining data. We then use gradient attribution to identify nine SAE features responsible for the majority of disease classification performance. We find that these top features are all strongly correlated with fragment length. Taking both supervised and unsupervised app

匹配字段正文

that's not worth celebrating I don't know what is." Constantin Kogler had been working with Astra on a problem that OpenAI also claimed to have solved. He posted his own paper on arXiv a day after the company's release. "[...] I can't help but feel like living in a mathematical wonderland with the next field-defining idea being discovered whenever I am ready for it." Giovanni Mongardi saw a much bleaker future. "Today, something is lost forever." He described mathematicians' remaining role as "

匹配字段正文

a hacky fix. Agents also learn to game environments, for example by downloading the published fix. A grader agent compared passing patches in each group and moved reward to the cleaner ones. Without it, agents drifted toward longer runs and workarounds like swallowed exceptions. MiMo-V2.6-Pro’s DeepSWE score rose from 58.4 to 72.6 over $2.6M of RL and was still climbing when training stopped. – arxiv. org/abs/2610.11959 Title: "MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement"

匹配字段正文

Lang) run one model per request, so when two models share an answer, every step waits for the slower one. TokenRouter gives each model its own server and lets them pass work back and forth. So, it hands a half-written answer between them while keeping the model’s memory of the text so far (the KV cache), and holds requests for a moment so each model works on bigger batches. Across 5 routing methods, throughput rose 2.01 to 64.15 times over the stronger existing setup. – arxiv. org/abs/2610.12242

匹配字段正文

s, and cannot be replayed. Earlier methods, like Agent Workflow Memory, need goal-labeled examples or a live environment to test changes. TeleTune guesses each session's goal and has the model predict every logged action using a text skill library. Wrong guesses suggest library edits, and an edit stays only if accuracy rises on held-out logs. If your product records user activity, mine it for agent skills and judge each change by next-action accuracy on held-out logs. – arxiv. org/abs/2610.05437

匹配字段正文

Demonstrations for Multi-Stage Language Model Programs Krista Opsahl-Ong, Michael J. Ryan, Josh Purtell, David Broman, Christopher Potts, Matei Zaharia, and Omar Khattab. (2024). arXiv preprint; Algorithms for Hyper-parameter Optimization James Bergstra, Rémi Bardenet, and Yoshua Bengio, and Balázs Kégl. (2011). In Advances in Neural Information Processing Systems (NeurIPS), vol. 24. Conference Paper; CrossWeigh: Training Named Entity Tagger from Imperfect Annotations Zihan Wang, Jingbo Shang,

匹配字段正文

d Best Arm Identification in Multi-Armed Bandits. Transactions on Machine Learning Research; Yang, J., Tan, V. Y.F., & Jin, T. (2024). Best Arm Identification with Minimal Regret. arXiv preprint arXiv:2409.18909; Zhang, Q., & Ying, L. (2023). Fast and Regret Optimal Best Arm Identification: Fundamental Limits and Low-Complexity Algorithms. Advances in Neural Information Processing Systems (NeurIPS), 36; Johari, R., Koomen, P., Pekelis, L., & Walsh, D. (2017). Peeking at A/B Tests: Why it matters

匹配字段正文

asets. The rest of the prompt remained unchanged to maintain consistency. [1] Muennighoff, N., Tazi, N., Magne, L., and Reimers, N. (2022). MTEB: Massive Text Embedding Benchmark. arXiv preprint arXiv:2210.07316. PDF [2] Thakur, N., Reimers, N., Rücklé, A., Srivastava, A., and Gurevych, I. (2021). BEIR: A Heterogeneous Benchmark for Zero-shot Evaluation of Information Retrieval Models. In Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS), Datasets and Benchmarks Track (R

匹配字段正文

er, R., McNamara, A., Mitra, B., Nguyen, T., Rosenberg, M., Song, X., Stoica, A., Tiwary, S., & Wang, T. (2018). MS MARCO: A Human Generated MAchine Reading COmprehension Dataset. arXiv preprint arXiv:1611.09268. https://arxiv.org/abs/1611.09268 [11] Jure Leskovec, Anand Rajaraman, and Jeffrey David Ullman. Mining of massive data sets. Cambridge university press, 2020. [12] Matouš Eibich, Shivay Nagpal, and Alexander Fred-Ojala. Aragog: Advanced rag output grading, 2024. [13] Shahul Es, Jithin J

匹配字段正文

put length increases to measure non-uniformity amongst distractors and input lengths. Needle-Haystack Similarity We use two thematically distinct haystacks, Paul Graham essays and arXiv papers [12], and write corresponding needles for each. To measure needle-haystack similarity, we embed the haystack and retrieve the top-5 chunks for each needle, then average their cosine similarity scores. This process is repeated across five different embedding models for robustness. Haystack Structure In typi

匹配字段正文

divided the field is. Several commenters back the boycott and propose that researchers stop using OpenAI products while also calling for better protection of preprint servers like arXiv against mass collection of training data. Others consider the AHM's position unrealistic, arguing that OpenAI won't stop working on mathematics and that public results are better than private ones. Another commenter asks whether a problem can really count as solved when neither the authors nor anyone else fully u

匹配字段正文

e sampled. We selected the most prominent pieces from Party journals, Legal Daily, model-law drafts, academic articles, ministers’ speeches, scientists’ talks, lab frameworks, and arXiv papers, with a rough quota for each so that no venue dominates. We then coded each text on six themes (Figure 4 below), three stances (on binding frontier rules, on a comprehensive AI law, and on development versus safety), and the author’s professional background. We then map 32 of the most influential individua

匹配字段正文

的，发布了巨量的数学研究成果，他们直接在Github上，发了一个新仓库，名字非常的朴素，叫openai/math。 这里面躺着722份数学手稿，372个相关成果，覆盖数论、代数几何、实分析、组合数学、理论计算机、数学物理、偏微分方程等等方向，全部出自OpenAI内部一个没有名字也还没有对外发布的模型。 一夜之间，722篇论文，这个数量相当于啥概念呢。 著名的arXiv有上传限制，一个月每个人只能提交两篇论文。 722篇，如果是人做的，手传的话，光传论文就得传30年。 而且，这是数学，数学可以说是科学的基础，也是科学的皇后。 那一刻，你可以理解成，命运的齿轮已经不是缓缓转动了，是尼玛命运的齿轮直接钻出了火星子然后组装成了高达，在你面前俯视你，问你，你看，我是不是还挺牛逼的。 接下来的24小时，基本全世界都属于一种沸腾的状态，有人欢喜有人愁。 这哥们的评论是我觉得最感同身受的。 这是一个混沌的时代，也是一个底层科学指数级爆炸的时代。 《三体》里面经历的技术大爆炸，就目前来看，极有可能在我们的有生之年发生。 虽然在数学上，我是一个绝对的门外汉，但是也确实从2个月前就在恶补各种知识，有了AI之

匹配字段正文

ffordable phones. ( Rest of World ) 8 Pioneers of light-based brain mapping have won a Nobel prize Their technique shines new light on brain circuits. ( BBC ) 9 AI slop has pushed arXiv to limit preprint research submissions Submissions have doubled in two years. ( 404 Media ) 10 McDonald’s is being sued over AI-powered Big Mac pricing The lawsuit alleges AI helped franchises coordinate prices. ( Reuters $) Quote of the day —AI researcher Jacob Coxon, who resigned from Anthropic over fears that

匹配字段正文

en-7B-Chat，这是对Meta的Llama 2的直接回应。Qwen-7B在超过2.2万亿个token上预训练，上下文长度为2,048个token。其许可证对月活跃用户低于1亿的商业用途免费。 视觉能力在数周内跟进。首个视觉语言分支Qwen-VL于2023年8月下旬发布。 2023年9月13日，通义千问向公众开放，这标志着中国监管部门的批准。同月，团队在arXiv上发表了《Qwen技术报告》。 这一年以规模收尾。阿里巴巴于2023年12月1日前后发布了72B和1.8B模型供下载。Qwen此时已覆盖从笔记本规模到前沿规模的开源权重。 第二章——2024年：开源权重机器 2024年是Qwen成为开发者默认选择的一年。团队在8个月内发布了3代模型。 Qwen1.5（2月）：2024年2月5日，团队发布了Qwen1.5，定位为Qwen2的测试版。它涵盖0.5B到72B的稠密模型，每个规模都具备稳定的32K上下文。随后是一个拥有2.7B激活参数的14B MoE模型。还有一个110B稠密模型，是该系列首个超过100B的模型。 Qwen2（6月）：团队于2024年6月初发布了Qwen2，共5个规

匹配字段正文

ute times but does not publish a single speedup figure How Google’s TEE-based Federated Learning works Interactive explainer based on Google Research’s Oct 2, 2026 post and paper (arXiv:2609.31494). Pick the server workload that asks the KMS for decryption keys. Only code listed in the published access policy gets them. How Does It Compare With Other FL Frameworks? Sources: Google Research blog, Confidential Federated Compute repo, NVIDIA FLARE docs, FLARE attestation guide, Flower 1.8 release n

匹配字段正文

vironment: envs/thinkingbox env Framework: microsoft/thinkingbox · tutorial Benchmark: microsoft/thinkingbox-data · v1.0 release Dataset viewer: microsoft/ThinkingBox-Bench Paper: arXiv:2608.19741 or HF RL training (coming soon): microsoft/thinkingbox-training ThinkingBox code is MIT-licensed; the benchmark data is CDLA-Permissive-2.0 ; the OpenEnv environment ships under OpenEnv's BSD-3-Clause. Disclaimer: every task in the public benchmark is a synthetic reconstruction. The workflows and polic

匹配字段正文