Recursive releases its first model Flint: local coding MoE, 125+ tokens/s on a MacBook
Recursive releases its first model Flint, a MoE with 40 billion total parameters and 2.5 billion activated parameters per token, aimed at local Agent coding, with weights open-sourced under Apache 2.0. With short context, it exceeds 125 tokens per second on an M4 Pro MacBook Pro and over 150 on a 64GB RTX Spark, and supports llama.cpp, Ollama, LM Studio, vLLM, SGLang, and Unsloth. Nearly every stage of its R&D involved the automated research system Eureka Machine, including architecture search, quantizing the output layer to 4 bit with offline distillation, and fusing Metal kernels for M4/M5.
tivated parameters per token, aimed at local Agent coding, with weights open-sourced under Apache 2.0. With short context, it exceeds 125 tokens per second on an M4 Pro MacBook Pro and over 150 on a 64GB RTX Spark, and supports llama.cpp, Ollama, LM Studio, vLLM, SGLang, and Unsloth. Nearly every stage of its R&D involved the automated research system Eureka Machine, including architecture search, quantizing the output layer to 4 bit with offline distillation, and fusing Metal kernels for M4/M5.
Matched fieldsSummary、Body
