Understand this story
On October 16, 2026, Aleph Alpha released the open-weight model Kolibri-1. According to heise online, the model has 78B total parameters and uses a MoE architecture with 384 experts and 6 routed experts, activating only 3.46B parameters during inference, with a context of 256K tokens that can be extrapolated to about 1 million tokens. The model focuses on German and English, and its tokenizer segments German words more token-efficiently; for example, the German Bundestag glossary requires only 1,137 tokens, whereas the compared DeepSeek-V4.1-Flash requires 1,910 tokens. Pretraining used 20 trillion tokens, with data up to June 18, 2026. The report's author tested it and said its answers were correct and its German reasoning process evident, and said the Merlin-Arthur protocol makes the model hallucinate less in benchmarks, but its actual performance still needs to be tested in real-world use. There are currently no subsequent developments.
AI-generated from public reports
Latest development · Report
Aleph Alpha Releases Kolibri-1: A 78B-Parameter Open-Weight Model for German-Language ReasoningDevelopments
1 confirmed developments
- Source:heise online
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Oct 16
heise online
Aleph Alpha Releases Kolibri-1: A 78B-Parameter Open-Weight Model for German-Language Reasoning
Aleph Alpha has released the open-weight model Kolibri-1, with 78B total parameters. It uses a MoE architecture with 384 experts and 6 routed experts, activating only 3.46B parameters during inference, with a 256K Token context that can be extrapolated to about 1 million Tokens. The model focuses on German and English, and its tokenizer segments German words more token-efficiently; for example, the German Bundestag glossary requires only 1137 Tokens, whereas the compared DeepSeek-V4.1-Flash requires 1910 Tokens. Pretraining used 20 trillion Tokens, with data current as of June 18, 2026. The author's hands-on test found its answers correct and its German-language reasoning process evident, and stated that the Merlin-Arthur protocol makes the model hallucinate less in benchmarks, but its actual performance still needs to be verified in real-world use.