Google DeepMind's EmbeddingGemma 2, released October 6, uses Matryoshka Representation Learning to allow truncating output vectors from 768 to 128 dimensions for up to 6x storage reduction in local vector databases, and runs on laptops, phones, and browsers without sending data to the cloud.
Simon Willison noted that OpenAI covered re-embedding costs when deprecating old models in April 2024, but said this cannot be assumed from all providers; his stated preference is a paid hosted service backed by open weights.