Unsloth releases the Dynamic GGUF quantized version of Flint, runnable locally on 24GB of memory
Unsloth has released the Dynamic GGUF quantized version of Flint, which can run locally on 24GB-memory devices, along with a running guide. Flint is Recursive's Apache-2.0 model with 39.8B parameters and 2.5B active, which Unsloth calls the strongest MoE model under 50B parameters, reaching 125 t/s on Mac and 150 t/s on RTX Spark. Recursive co-founder Richard Socher previously introduced that the model was built from scratch in under 4 months by the automated research system Eureka Machine, and the weights are now open on Hugging Face.
ntized version of Flint, which can run locally on 24GB-memory devices, along with a running guide. Flint is Recursive's Apache-2.0 model with 39.8B parameters and 2.5B active, which Unsloth calls the strongest MoE model under 50B parameters, reaching 125 t/s on Mac and 150 t/s on RTX Spark. Recursive co-founder Richard Socher previously introduced that the model was built from scratch in under 4 months by the automated research system Eureka Machine, and the weights are now open on Hugging Face.
Matched fieldsSummary

