Meta adds LlamaClip multimodal search API to Workplace for knowledge retrieval

AI · 4 min read

LlamaClip merges visual and textual understanding into a single embedding space, enabling Workplace to return mixed-media results for queries like 'slides from last week's demo with the product close-ups.' The API supports approximate nearest neighbor indexing and relevance tuning.

Meta positioned LlamaClip as an on-premise or private-cloud option for organizations with strict data residency needs, with encryption-at-rest and role-based access controls. The system also provides fine-tuning options so companies can prioritize proprietary taxonomies and terminologies.

Integrations include connectors for cloud storage, video platforms, and internal wikis. Meta emphasized transparency tools: admins can audit query sources and tune the model's sensitivity to personally identifiable information.