The Information Machine
Concluded·Day 2·in the edition since 7 Oct 2026·5 sources·updated 8 Oct 2026

EmbeddingGemma 2 multimodal embedding model

The gist

Google DeepMind Launches EmbeddingGemma 2 Multimodal On-Device Embedding Model

An open, on-device multimodal embedding model lets developers build private, offline search and RAG pipelines across text, images, audio, and video without relying on hosted services. The Apache 2.0 license means stored vectors are not tied to a single provider, avoiding the costly re-embedding that model deprecations force.

The full picture

Google DeepMind released EmbeddingGemma 2 on October 6, 2026, describing it as its first natively multimodal open embedding model designed for on-device use. The model has 740M parameters built on the Gemma 4 architecture and handles text, code, images, audio, and video in a unified embedding space. Its modular design allows a text-only footprint of 270M parameters, with vision (170M) and audio (300M) encoders loaded on demand. On a Pixel 11 Pro, text-only operation uses approximately 191MB RAM and the full multimodal stack uses approximately 567MB. The 8K token context window is four times larger than EmbeddingGemma 1, and supports roughly 5.5 minutes of audio, 29 images, or 58 video frames in a single input. Google reports code search performance improved from an MTEB Code score of 68.76 to 78.68 over the predecessor. Using Matryoshka Representation Learning, developers can truncate output vectors from 768 to 128 dimensions for up to 6x storage reduction in local vector databases. The model is released under Apache 2.0 and is available through Hugging Face, Kaggle, and a range of inference tools. The model can run directly on consumer devices including laptops, phones, and browsers, keeping searches private without sending data to the cloud.

How it developed
7 October 2026

Google DeepMind's EmbeddingGemma 2, released October 6, uses Matryoshka Representation Learning to allow truncating output vectors from 768 to 128 dimensions for up to 6x storage reduction in local vector databases, and runs on laptops, phones, and browsers without sending data to the cloud.

Simon Willison noted that OpenAI covered re-embedding costs when deprecating old models in April 2024, but said this cannot be assumed from all providers; his stated preference is a paid hosted service backed by open weights.

First citedThe Neuron
First in the edition · 7 October 2026
6 October 2026

Google DeepMind launched EmbeddingGemma 2 on October 6, a 740M-parameter model built on the Gemma 4 architecture that handles text, code, images, audio, and video in a shared on-device embedding space, released under Apache 2.0.

Google reports a 9.92-point MTEB Code score gain over its predecessor, from 68.76 to 78.68, and the modular design requires approximately 191MB RAM for text-only use on a Pixel 11 Pro. Simon Willison argued the open license is particularly valuable for embeddings because proprietary hosted-only services expose developers to vendor lock-in, requiring full vector recalculation if a provider deprecates a model.

Sources
The daily email

Want this in your inbox?

I send one email each morning with the stories that moved. If you would rather just read here, that works too.

Subscribe free