Thinking Machines 发布开放权重模型 Inkling 2 Mini
Thinking Machines has released Inkling 2 Mini at 20 on the Artificial Analysis Intelligence Index, an open weights looped transformer on the Pareto frontier for
Thinking Machines 发布 Inkling 2 Mini,该模型在 Artificial Analysis Intelligence Index 得分为 20,处于智能与活跃参数的 Pareto 前沿。它采用 MoE 与循环 Transformer 架构,总参数量 26B、活跃参数量 5.4B,每个文本 token 使用 3.1B 唯一权重,可在 MacBook 或 DGX Spark 上运行。模型支持文本和图像输入,具备 1M token 上下文窗口,并以 Apache 2.0 许可证发布。
正文
Thinking Machines has released Inkling 2 Mini at 20 on the Artificial Analysis Intelligence Index, an open weights looped transformer on the Pareto frontier for Intelligence vs. Active Parameters
Inkling 2 Mini is a 26B total, 5.4B active parameter mixture-of-experts model. The 5.4B active parameter count includes three passes through its looped layers; it uses 3.1B unique weights per text token, and it is small enough to run on a MacBook or DGX Spark.
It is released under an Apache 2.0 license, with text and image input and a 1M token context window.
Congratulations to @thinkymachines on the release! 🧵
AI 热点