Google Cloud Announces VertexAI for Multimodal Retrieval and Design Search

AI · 6 min read

VertexAI's multimodal retrieval supports hybrid queries combining screenshots, sketches, and text prompts to return ranked assets and layout matches from private corpora. The system performs similarity across visual structure and semantic content, enabling designers to search by composition rather than keywords alone.

The design-search API includes features like near-duplicate detection, component-level matching, and smart filters for color palettes and typography. Google paired the service with privacy and governance controls to limit dataset exposure and log access patterns.

Design teams can integrate the API with DAMs and design systems to speed asset discovery and enforce reuse. Google provided sample pipelines for large-scale index creation and continuous refresh from source repositories.