←Search results

By relevance · Total 5 results Clear search

Thursday

  1. Rohan Paul

    Google Releases EmbeddingGemma 2 Paper: A 744M-Parameter On-Device Multimodal Embedding Model

    Google has released the EmbeddingGemma 2 paper, an Apache 2.0-licensed on-device multimodal embedding model that maps text, code, images, audio, and video into the same vector space. The model is built on Gemma 4 and tuned through contrastive training by learning from the larger Gemini Embedding 2; with 744M parameters, it surpasses models 2 to 12 times larger on multiple tasks. On the Pixel 11 Pro, the quantized text weights occupy about 191MB of active memory, while the full multimodal model takes about 567MB; the context window is expanded 4 times to 8K tokens, accommodating about 5.5 minutes of audio, 29 images, or 58 video frames; directly embedding speech scores 69.54 on the MSEB spoken query retrieval benchmark, higher than the 57.59 of transcribing first and then retrieving, and code retrieval on MTEB Code improves from 68.76 in EmbeddingGemma 1 to 78.68.

    Google has released the EmbeddingGemma 2 paper, an Apache 2.0-licensed on-device multimodal embedding model that maps text, code, images, audio, and video into the same vector space. The model is built on Gemma 4 and tuned through contrastive training by learning from the larger Gemini Embedding 2; with 744M parameters, it surpasses models 2 to 12 times larger on multiple tasks. On the Pixel 11 Pro, the quantized text weights occupy about 191MB of active memory, while the full multimodal model t

    Matched fieldsTitle

Sunday

  1. Story1 reports · 1 facts

    Meta distills a 30B on-device agent model, Muse Glimmer

    Meta distilled the dense 30B model Muse Glimmer from the larger Muse Spark, training it on synthetic agent trajectories in simulated applications. Its 4-bit weights are under 20 GB, allowing it to run on a single RTX 5090. According to a report dated October 22, 2026, on the multi-tool benchmark MCPAtlas, Muse Glimmer scored 75.5, higher than Gemma4-31B's 54.2 and Qwen3.6-27B's 62.5; however, on OSWorld-Verified it lagged behind Qwen3.6-27B's 75.6 with a score of 65.9. There are currently no subsequent developments.

    Meta distilled the dense 30B model Muse Glimmer from the larger Muse Spark, training it on synthetic agent trajectories in simulated applications. Its 4-bit weights are under 20 GB, allowing it to run on a single RTX 5090. According to a report dated October 22, 2026, on the multi-tool benchmark MCPAtlas, Muse Glimmer scored 75.5, higher than Gemma4-31B's 54.2 and Qwen3.6-27B's 62.5; however, on OSWorld-Verified it lagged behind Qwen3.6-27B's 75.6 with a score of 65.9. There are currently no sub

    Matched fieldsTitle

  2. Story1 reports · 1 facts

    Meta compresses its Agent model Muse Glimmer 30B to run on-device

    On October 20, 2026, Meta released the technical report for Muse Glimmer, a 30B open-weight model aimed at agent tasks on consumer-grade hardware, running at 4-bit precision on a single consumer GPU. The reporter adds that the model leads open-source models of the same scale in tool calling and multi-step planning, surpassing Qwen3.6-27B and Gemma4-31B on some metrics; after 4-bit quantization it is about 17GB, targeting devices with 24GB of VRAM, and uses DFlash speculative decoding to reach about 233 tokens/s on an RTX 5090, roughly 3.1 times faster than ordinary decoding. There are currently no subsequent developments.

    On October 20, 2026, Meta released the technical report for Muse Glimmer, a 30B open-weight model aimed at agent tasks on consumer-grade hardware, running at 4-bit precision on a single consumer GPU. The reporter adds that the model leads open-source models of the same scale in tool calling and multi-step planning, surpassing Qwen3.6-27B and Gemma4-31B on some metrics; after 4-bit quantization it is about 17GB, targeting devices with 24GB of VRAM, and uses DFlash speculative decoding to reach ab

    Matched fieldsTitle

Thursday

  1. FactRelated story

    Meta distills a 30B on-device agent model, Muse Glimmer

    Meta distilled the dense 30B model Muse Glimmer from the larger Muse Spark, training it on synthetic agent trajectories in simulated applications. Its 4-bit weights are under 20 GB, allowing it to run on a single RTX 5090. According to a report dated October 22, 2026, on the multi-tool benchmark MCPAtlas, Muse Glimmer scored 75.5, higher than Gemma4-31B's 54.2 and Qwen3.6-27B's 62.5; however, on OSWorld-Verified it lagged behind Qwen3.6-27B's 75.6 with a score of 65.9. There are currently no subsequent developments.

    Matched fieldsTitle

    View story:Meta distills a 30B on-device agent model, Muse Glimmer

Tuesday

  1. FactRelated story

    Meta compresses its agent model Muse Glimmer 30B to run on-device

    On October 20, 2026, Meta released the technical report for Muse Glimmer, a 30B open-weight model aimed at agent tasks on consumer-grade hardware, running at 4-bit precision on a single consumer GPU. The reporter adds that the model leads open-source models of the same scale in tool calling and multi-step planning, surpassing Qwen3.6-27B and Gemma4-31B on some metrics; after 4-bit quantization it is about 17GB, targeting devices with 24GB of VRAM, and uses DFlash speculative decoding to reach about 233 tokens/s on an RTX 5090, roughly 3.1 times faster than ordinary decoding. There are currently no subsequent developments.

    Matched fieldsTitle

    View story:Meta compresses its Agent model Muse Glimmer 30B to run on-device