Unsloth Releases 1-bit GGUF, Mistral Le Chonk Can Run Locally on Mac Studio
Unsloth has released a 1-bit GGUF quantized version of Mistral Le Chonk, enabling this 1-trillion-parameter model to run locally on a Mac Studio, and claims that it still retains 91% top-1 accuracy after quantization. Unsloth also provided the GGUF download link and usage guide, and called Le Chonk the strongest Western open-source model currently available.
Why read this
SelectedAI score 81
Unsloth reports that the 1-bit GGUF quantization retains 91% top-1 accuracy, allowing readers to judge the feasible boundaries of running trillion-parameter models on local devices.
Topics
View original postToday, we release the weights of a new and improved Le Chonk, advancing the open frontier for agentic coding and cybersecurity. 💻 Built to build: Le Chonk ranks #1 on @cognition’s FrontierCode among open models, and sets a new benchmark for Pareto efficiency on @artificialanalysis. 🛡 Built to defend: State-of-the-art in cyberdefense, put through the paces by the world's leading cyber vendors, including @CrowdStrike, @cloudflare, @rubrik, @zscaler, and others. Built for sovereignty: Make it yours. Download the weights on @huggingface , customize it with Mistral Forge, and deploy it wherever you need it. Read more from our team and customers 👇:
View original
Today, we release the weights of a new and improved Le Chonk, advancing the open frontier for agentic coding and cybersecurity. 💻 Built to build: Le Chonk ranks #1 on @cognition’s FrontierCode among open models, and sets a new benchmark for Pareto efficiency on @artificialanalysis. 🛡 Built to defend: State-of-the-art in cyberdefense, put through the paces by the world's leading cyber vendors, including @CrowdStrike, @cloudflare, @rubrik, @zscaler, and others. Built for sovereignty: Make it yours. Download the weights on @huggingface , customize it with Mistral Forge, and deploy it wherever you need it. Read more from our team and customers 👇:
Body
Mistral Le Chonk can now run locally!
The 1 trillion parameter model runs on a Mac Studio with our 1-bit GGUF which retains 91% top-1 accuracy.
Le Chonk is the strongest Western open model to date.
GGUF: https://t.co/irNXvfVGNg Guide: https://t.co/StUa0S2XP6 https://t.co/PeRJa24HwL