Google Releases EmbeddingGemma 2 Paper: A 744M-Parameter On-Device Multimodal Embedding Model
Google has released the EmbeddingGemma 2 paper, an Apache 2.0-licensed on-device multimodal embedding model that maps text, code, images, audio, and video into the same vector space. The model is built on Gemma 4 and tuned through contrastive training by learning from the larger Gemini Embedding 2; with 744M parameters, it surpasses models 2 to 12 times larger on multiple tasks. On the Pixel 11 Pro, the quantized text weights occupy about 191MB of active memory, while the full multimodal model takes about 567MB; the context window is expanded 4 times to 8K tokens, accommodating about 5.5 minutes of audio, 29 images, or 58 video frames; directly embedding speech scores 69.54 on the MSEB spoken query retrieval benchmark, higher than the 57.59 of transcribing first and then retrieving, and code retrieval on MTEB Code improves from 68.76 in EmbeddingGemma 1 to 78.68.
Google has released the EmbeddingGemma 2 paper, an Apache 2.0-licensed on-device multimodal embedding model that maps text, code, images, audio, and video into the same vector space. The model is built on Gemma 4 and tuned through contrastive training by learning from the larger Gemini Embedding 2; with 744M parameters, it surpasses models 2 to 12 times larger on multiple tasks. On the Pixel 11 Pro, the quantized text weights occupy about 191MB of active memory, while the full multimodal model t
Matched fieldsTitle
