Multi-Modal Vector Search Systems: Architectures for Complex Data Types

<p>Multi-modal vector search systems extend state-of-the-art information retrieval and enable unified search across data modalities that are as varied as text, image, audio and video. The contribution of this work is to present in detail the architecture needed for efficiently implementing a Multi-modal vector search system. In this paper, we discuss challenges in each of these different aspects: from embedding generation and storage optimization to cross-modal retrieval.</p>