AI Trends

Thinking Machines Releases Inkling 2 Mini, Which Can Run on a Laptop

Mira MuratiUpdated Nov 21 04:41

AI summary

Inkling 2 Mini is a looped Transformer model that can run on a laptop. The loop mechanism allows the model to think more while producing less text. At its current scale, its thought process remains monitorable, though that may not remain true in the future; the team also shared a variable-loop research model for further study.

Why read this

AI score 64

The materials illustrate the relationship between loop mechanisms, reasoning length, and monitorability, and provide a variable-loop research model for further study.

Topics

Tags

Quoted post

Thinking Machines

@thinkymachines

Some of you thought that Inkling 2 Small was too big at 594B parameters. We heard you: Inkling 2 Mini is a looped transformer with just 26B parameters, small enough to run on your laptop, powerful enough for agentic work with a score of 20.1 on AA Index. https://t.co/9HzaUMwghb

View original

Some of you thought that Inkling 2 Small was too big at 594B parameters. We heard you: Inkling 2 Mini is a looped transformer with just 26B parameters, small enough to run on your laptop, powerful enough for agentic work with a score of 20.1 on AA Index. https://t.co/9HzaUMwghb

View original post

Body

Inkling 2 Mini is a looped transformer that runs on a laptop.

Looping lets a model think more and write less. At this scale, its thought process remains monitorable; this may not stay the case. We’re also sharing a variable-loop research model to enable further study.

Source

Mira Murati