Understand this story
Google has released the EmbeddingGemma 2 paper, introducing an Apache 2.0-licensed on-device multimodal embedding model that maps text, code, images, audio, and video into the same vector space. Built on Gemma 4, the model learns from the larger Gemini Embedding 2 and is tuned with contrastive training; with 744M parameters, it outperforms models 2 to 12 times larger on multiple tasks. On the Pixel 11 Pro, the quantized text weights occupy about 191MB of active memory, while the full multimodal model takes about 567MB; the context window is expanded 4 times to 8K tokens, accommodating about 5.5 minutes of audio, 29 images, or 58 video frames. Embedding speech directly scores 69.54 on the MSEB spoken query retrieval benchmark, higher than the 57.59 achieved by transcribing first and then retrieving, and code retrieval on MTEB Code improves from 68.76 in EmbeddingGemma 1 to 78.68. There are currently no further developments.
AI-generated from public reports
Latest development · Report
Google Releases EmbeddingGemma 2 Paper: A 744M-Parameter On-Device Multimodal Embedding ModelDevelopments
1 confirmed developments
- Source:Rohan Paul
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Oct 29
Rohan Paul
Google Releases EmbeddingGemma 2 Paper: A 744M-Parameter On-Device Multimodal Embedding Model
Google has released the EmbeddingGemma 2 paper, an Apache 2.0-licensed on-device multimodal embedding model that maps text, code, images, audio, and video into the same vector space. The model is built on Gemma 4 and tuned through contrastive training by learning from the larger Gemini Embedding 2; with 744M parameters, it surpasses models 2 to 12 times larger on multiple tasks. On the Pixel 11 Pro, the quantized text weights occupy about 191MB of active memory, while the full multimodal model takes about 567MB; the context window is expanded 4 times to 8K tokens, accommodating about 5.5 minutes of audio, 29 images, or 58 video frames; directly embedding speech scores 69.54 on the MSEB spoken query retrieval benchmark, higher than the 57.59 of transcribing first and then retrieving, and code retrieval on MTEB Code improves from 68.76 in EmbeddingGemma 1 to 78.68.