Noam Shazeer:数学、科学与多模态推理评测表现提升
We’ve boosted performance across challenging math, science, and multimodal reasoning benchmarks (AIME: 73.3%, GPQA: 74.2%, MMMU: 75.4%).
AI 导读
Noam Shazeer 表示,团队将 AIME、GPQA 和 MMMU 的评测成绩分别提升至 73.3%、74.2% 和 75.4%。团队还启用了 1M 上下文窗口以支持更复杂的研究任务,并允许开发者开启代码执行功能。
正文
当前显示原文,中文全文译文尚未就绪。
We’ve boosted performance across challenging math, science, and multimodal reasoning benchmarks (AIME: 73.3%, GPQA: 74.2%, MMMU: 75.4%).
We also enabled a 1M long context window to help with more complex research tasks, and are giving devs the ability to turn on code execution https://t.co/lneAw02oAm