Inkling 2 Mini Runs Its 26.4B Parameters on 16GB of RAM
Inkling 2 Mini is a 26.4B-parameter model that can run on 16GB of RAM and is now supported by Unsloth and llama.cpp. This Apache 2.0-licensed MoE model uses a looped Transformer architecture and scored 48.2% on DeepSWE v1.1, which the original article describes as the best result among models of a comparable size. GGUF files and a usage guide are also available.
Why read this
SelectedAI score 67
The material also provides memory requirements, model architecture details, and DeepSWE results, making it easier to compare its local deployment requirements and coding capabilities.
Topics
View original postSome of you thought that Inkling 2 Small was too big at 594B parameters. We heard you: Inkling 2 Mini is a looped transformer with just 26B parameters, small enough to run on your laptop, powerful enough for agentic work with a score of 20.1 on AA Index. https://t.co/9HzaUMwghb
View original
Some of you thought that Inkling 2 Small was too big at 594B parameters. We heard you: Inkling 2 Mini is a looped transformer with just 26B parameters, small enough to run on your laptop, powerful enough for agentic work with a score of 20.1 on AA Index. https://t.co/9HzaUMwghb
Body
Run Inkling 2 Mini, the strongest 26.4B model that runs on 16GB RAM.
Thinking Machines’ Apache 2.0 MoE model uses a looped transformer arch & scores 48.2% on DeepSWE v1.1, the best for size.
Run on Unsloth, llama.cpp
GGUF: https://t.co/MYNpuDqky3 Guide: https://t.co/2OrFxjxijg https://t.co/YzuDh1D8W6
AI Trends