搜索“arXiv”

Bench EN-DEV-v1.1 88.2 89.2 93.7 89.7 94.2 93.7 SimpleVQA 55.8 65.7 73.2 61.3 71.2 67.1 Text Recognition and Document Understanding OmniDocBench1.5 85.7 87.7 88.5 84.5 88.8 90.8 CharXiv(RQ) 82.1 68.5 81.4 66.1 77.5 80.8 MMLongBench-Doc -- 61.9 60.5 56.2 58.5 61.5 CC-OCR 70.3 76.9 79.0 81.5 79.7 82.0 AI2D TEST 92.2 87.7 94.1 89.2 90.8 93.9 OCRBench 80.7 85.8 90.4 87.5 92.3 93.1 Spatial Intelligence ERQA 59.8 46.8 70.5 52.5 -- 67.5 CountBench 91.9 90.6 97.3 93.7 94.1 97.2 RefCOCO(avg) -- -- 84.1 9

匹配字段正文

of an ecosystem of specialised models built on open-source than most people realise. And the ceiling is rising every quarter. So I don’t think open-source needs to wait out the frontier labs. I think it just has to wait out the gap. References The Michael Scott Paper Company. The Office; Nvidia GTC 2025: Built for Reasoning. SemiAnalysis (2025); Dario Amodei. Dwarkesh Podcast; Cournot competition. Wikipedia; Khatri et al.. The Art of Scaling Reinforcement Learning Compute for LLMs. arXiv (2025)

匹配字段正文

et al. “Pettingzoo: Gym for Multi-Agent Reinforcement Learning”. Advances in Neural Information Processing Systems, 34, 15032-15043 (2021). [5] Brockman, G., et al. “OpenAI Gym”, arXiv:1606.01540 (2016) [6] Papoudakis, G., et al. “Benchmarking Multi-Agent Deep Reinforcement Learning Algorithms in Cooperative Tasks”. Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks (2021) [7] Yu, C., et al. “The Surprising Effectiveness of PPO in Cooperative Multi-Agent G

匹配字段正文

sks including Gated Delta Net, Mesa Net, and Mamba2. We find the OVQ-attention model has far superior long-context capabilities on these tasks. Further results can be found in our arXiv paper. Conclusions and Future Directions Creating LLMs and multi-modal agents that can learn continually over extended deployments is one of the final frontiers facing the field of AI. Storing and processing a linearly increasing KV-cache, as self-attention does, is infeasible at the extremely long context length

匹配字段正文

s diverse use cases The edge AI future is here. We can't wait to see what you build. References [1] Sheng, Guangming, et al. “HybridFlow: A Flexible and Efficient RLHF Framework.” arXiv, 2024. [2] Ahmadian, Arash, et al. "Back to basics: Revisiting reinforce style optimization for learning from human feedback in llms." arXiv, 2024. [3] Shao, Zhihong, et al. "Deepseekmath: Pushing the limits of mathematical reasoning in open language models." arXiv, 2024. [4] Yu, Qiying, et al. "Dapo: An open-sou

匹配字段正文

oncake[1], and TeraPipe[3], which jointly help improve this Pipeline Parallelism implementation Reference [1] Qin, Ruoyu, et al. "Mooncake: A kvcache-centric disaggregated architecture for llm serving." ACM Transactions on Storage (2024). [2] Yang, An, et al. "Qwen2. 5-1m technical report." arXiv preprint arXiv:2501.15383 (2025). [3] Li, Zhuohan, et al. "Terapipe: Token-level pipeline parallelism for training large-scale language models." International Conference on Machine Learning. PMLR, 2021.

匹配字段正文

f-study, to a certain extent, just works. References Claude's Constitution. Anthropic (2025); Berglund et al.. The Reversal Curse: LLMs trained on 'A is B' fail to learn 'B is A'. arXiv (2023); Bai et al.. Constitutional AI: Harmlessness from AI Feedback. Anthropic (2022); CARTRIDGES: Compressed Adaptive Retrieval Through Implicit Document Generation and Efficient Storage. arXiv (2025); Claude 4.5 Opus Soul Document. LessWrong (2025); Iterative SFT. Parsed; Upweight the Strategy, Not the Tokens:

匹配字段正文

nd bias, the journey to fair AI [1] Sapkota, Ranjan, Konstantinos I. Roumeliotis, and Manoj Karkee. "Ai agents vs. agentic ai: A conceptual taxonomy, applications and challenges." arXiv preprint arXiv:2505.10468 (2025). [2] Abou Ali, Mohamad, Fadi Dornaika, and Jinan Charafeddine. "Agentic AI: a comprehensive survey of architectures, applications, and future directions." Artificial Intelligence Review 59.1 (2025): 11. [5] Chi, Jianfeng, et al. "Llama guard 3 vision: Safeguarding human-ai image u

匹配字段正文

infrastructure through IBM Cloud can deliver the performance needed for reliable frontier-scale AI model development. For more information please reference the technical report on arXiv, the Zyphra technical blog post, and AMD blog post. About Zyphra Zyphra is a full-stack, open-source superintelligence company based in San Francisco on a mission to build human-aligned AGI. Zyphra’s core research thesis toward general superintelligence is focused on developing next-generation multimodal architec

匹配字段正文

iply things together in the integer domain with (actually in the code the main loop is unrolled and uses multiple accumulators, to make modern CPUs more busy) for (; i 0) { c = candidates.pop nearest(query); worst distance = results.get worst dist(query); if (distance(query,c) worst distance) break; foreach (neighbor from c) { if (neighbor.already visited()) continue; neighbor.mark as visited(); if (results.has space() OR neighbor.distance(query) = 1980 and .year https://arxiv.org/abs/2412.01940

匹配字段正文

ced by Bloom filters can be expressed as: \(\mathrm{P} {effective}=1-(1-\varepsilon)^b\) [3] Khan et al., (2024): Lshbloom: Memory-efficient, extreme-scale document deduplication. arXiv preprint arXiv:2411.04257. [5] Li, J., Fang, A., Smyrnis, G., Ivgi, M., Jordan, M., Gadre, S. Y., … & Shankar, V. (2024). Datacomp-lm: In search of the next generation of training sets for language models. Advances in Neural Information Processing Systems, 37, 14200-14282. [6] Bloom, B. H. (1970). Space/time trad

匹配字段正文

Ashish Vaswani for reading pre-release version of this blog post and providing feedback! References vLLM https://github.com/vllm-project/vllm; "Attention Is All You Need" https://arxiv.org/abs/1706.03762; "Efficient Memory Management for Large Language Model Serving with PagedAttention" https://arxiv.org/abs/2309.06180; "DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model" https://arxiv.org/abs/2405.04434; "Jenga: Effective Memory Management for Serving LLM with H

匹配字段正文

for domain alignment and complexity, but notably reviewers were not required to verify the full accuracy of a question’s rationale if it would take “more than 5 minutes” (https://arxiv.org/abs/2501.14249 ). A second round of question selection was performed to find the best questions via having high-quality reviews. Finally, a bug-bounty crowd sourcing system was used for post-release refinement. So question writers had to verify frontier models don't get the questions correct. Reviewers only h

匹配字段正文

up computation on easier to predict tokens. With H-Nets, this is built directly into the architecture, by handling tokens that are easier to predict with lightweight encoder and decoder modules For more, read our full preprint on arXiv. We’ve also released checkpoints for H-Net 2-stage XL, H-Net 1-stage XL, and H-Net 1-stage L on HuggingFace. If you’re excited about the future of architecture research and building systems and infrastructure to deliver these new models at scale, please reach out!

匹配字段正文

the NEJM cases in the research reported in this blog post. The research described here has benefited from the insights of many people. We are grateful to the authors named on the arXiv paper and the wider team at MAI. We also thank further colleagues both inside and outside of Microsoft for sharing their insights including Bryan Bunning, Nando de Freitas, Andrija Milicevic, Hoifung Poon, David Rhew, Karén Simonyan, Eric Topol, and Jim Weinstein. Gianluca Fontana and Kevin Hawkins (Prova Health)

匹配字段正文

uid-foundation-models-our-first-series-of-generative-ai-models (2024); [2] DeepSeek-AI et al. "DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning." arXiv preprint arXiv:2501.12948 (2025); [3] Niklas Muennighoff et al. "s1: Simple test-time scaling." arXiv preprint arXiv:2501.19393 (2025); [4] Kanishk Gandhi et al. "Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRs." arXiv preprint arXiv:2503.01307v1 (2025); [5] Iva

匹配字段正文

et al. "The Platonic Representation Hypothesis." Forty-first International Conference on Machine Learning . 2024. Kaplan, Jared, et al. "Scaling laws for neural language models." arXiv preprint arXiv:2001.08361 (2020). Lake, Brenden M. et al. “Building Machines That Learn and Think like People.” Behavioral and Brain Sciences 40 (2017): e253. Web. Li, Kenneth, et al. "Emergent world representations: Exploring a sequence model trained on a synthetic task." ICLR (2023). Luiten, Jonathon, Georgios,

匹配字段正文

code" in the form of prompts that execute on the LLM to produce the actual code that runs on real CPUs. Yes, I know LLMs aren't actually computers (though there are some papers on arXiv...). The metaphor is a bit stretched. But here's the thing: as developers, we're used to encoding specifications in precise programming languages. When we interact with LLMs, the fuzziness of natural language makes us forget we can apply the same structured thinking. This framework bridges that gap: think "inputs

匹配字段正文

ording to the difficulty of the problem in hand? Please cite this work as: Or use the BibTex citation: [1] Alex Graves. “Adaptive Computation Time for Recurrent Neural Networks.”. arXiv preprint arXiv:1603.08983 (2016). [2] Wang Ling, et al. “Program Induction by Rationale Generation: Learning to Solve and Explain Algebraic Word Problems.”. arXiv preprint arXiv:1705.04146 (2017). [3] Karl Cobbe, et al. “Training Verifiers to Solve Math Word Problems.”. arXiv preprint arXiv:2110.14168 (2021). [4]

匹配字段正文

driushchenko. Citation information Yang, J., Prabhakar, A., Narasimhan, K., & Yao, S. (2023). InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedback. arXiv preprint arXiv:2306.14898. [link]; Zhang, A. K., Perry, N., Dulepet, R., Ji, J., Menders, C., Lin, J. W., Jones, E., Hussein, G., Liu, S., Jasper, D., Peetathawatchai, P., Glenn, A., Sivashankar, V., Zamoshchin, D., Glikbarg, L., Askaryar, D., Yang, M., Zhang, T., Alluri, R., Tran, N., Sangpisit, R., Yiorkadjis,

匹配字段正文