←Story detail

Trending story

Meta compresses its Agent model Muse Glimmer 30B to run on-device

1 reports1 story updatesUpdated Oct 20 04:44

Understand this story

AI overview

On October 20, 2026, Meta released the technical report for Muse Glimmer, a 30B open-weight model aimed at agent tasks on consumer-grade hardware, running at 4-bit precision on a single consumer GPU. The reporter adds that the model leads open-source models of the same scale in tool calling and multi-step planning, surpassing Qwen3.6-27B and Gemma4-31B on some metrics; after 4-bit quantization it is about 17GB, targeting devices with 24GB of VRAM, and uses DFlash speculative decoding to reach about 233 tokens/s on an RTX 5090, roughly 3.1 times faster than ordinary decoding. There are currently no subsequent developments.

AI-generated from public reports

Latest development · Report

Meta releases technical report for Muse Glimmer 30B, an agentic model for consumer-grade hardware

Developments

1 confirmed developments

  1. Meta compresses its agent model Muse Glimmer 30B to run on-device

    Source:English text is being prepared.

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Oct 20

  1. Ma Dongxi NLP

    Meta releases technical report for Muse Glimmer 30B, an agentic model for consumer-grade hardware

    Meta has released the technical report for Muse Glimmer, a 30B open-weight model aimed at agentic tasks on consumer-grade hardware; it runs at 4-bit precision on a single consumer-grade GPU and leads open models of the same scale on tool calling and multi-step planning. The relayer adds that the model surpasses Qwen3.6-27B and Gemma4-31B on some metrics, is about 17GB after 4-bit quantization, targets devices with 24GB of VRAM, and uses DFlash speculative decoding to reach about 233 tokens/s on an RTX 5090, roughly 3.1 times faster than ordinary decoding.

Related stories

  1. Related storiesNvidia releases Nemotron 3.5 Super VL and Bolt models
  2. Related storiesMeta distills a 30B on-device agent model, Muse Glimmer
  3. Related storiesMeta releases open-weight model Muse Spark Open
  4. Related storiesDeepSeek releases DeepSeek-V4.1-Flash-1017