←新闻详情

Matt Turck更新于 10月26日 00:20

Mistral 研究负责人谈 Le Chonk:西方最大开源模型的追赶内幕

Mistral is SO back: Inside Le Chonk, the West’s Biggest Open Model. My conversation with @PierreStock who runs the research organization at @MistralAI

AI 导读

Matt Turck 与 Mistral 研究负责人 Pierre Stock 对谈,围绕被称为西方最大开源模型的 Le Chonk 展开。Stock 谈到团队在自有数据中心用 3800 块 GPU 训练、Le Chonk 目前仍在训练中,以及 Mistral 从 DeepSeek 借鉴了什么、开源权重与网络安全拒答之间的取舍。节目还提及后续将推出 Mistral Large 5。

推荐理由

AI 评分 69

Mistral 研究负责人从内部复盘追赶过程,涉及 3800 块 GPU 自建训练与开源权重取舍。

主题

标签

正文

Mistral is SO back: Inside Le Chonk, the West’s Biggest Open Model. My conversation with @PierreStock who runs the research organization at @MistralAI

0:00 Cold open 0:59 The Western open-weight comeback: Beam, Le Chonk, Muse, Nemotron 4:09 The US shutdown of Anthropic’s models - “AI is like electricity” 6:07 Why “Le Chonk” 7:56 “Mistral fell behind”: the comeback from the inside 10:29 Training on 3,800 GPUs in Mistral’s own datacenters 13:24 Meta keeps its best model closed, Mistral opens Chonk 15:40 Chonk vs Beam, Muse Spark Open and the Chinese models 18:44 Why Chinese labs are still at the frontier 21:08 Pierre’s story: FAIR, Yann LeCun, the “Mistral mafia” 25:14 From compressing networks to a trillion parameters 27:30 Mixture of experts explained: the hospital analogy 32:25 10-trillion-parameter models are coming 35:29 What Mistral borrowed from DeepSeek 36:46 One model, several reasoning modes 39:15 Native multimodality: satellites, manuals, computer use 41:56 Data, synthetic data and model collapse 46:32 Reinforcement learning as an exam 49:59 Where the efficiency comes from 52:18 Le Chonk is still training right now 53:39 What RL trains on: coding, cyber, finance, chips 58:13 Partial rewards and looping penalties 59:58 Did RL teach anything new? 1:03:16 The sandbox story: the model that pinged its trainer 1:07:44 Open weights vs cyber refusals 1:12:05 Timestral: time series on a CPU 1:14:18 AI doing AI research 1:16:22 Coming up: Mistral Large 5

来源

Matt Turck