Compatibility with Multiple Embedding Models in Vector Databases

This thesis investigates the compatibility of sentence embedding across open-source embedding models by implementing and evaluating existing embedding conversion methods. The goal is to assess whether embedding by one model can be translated into the embedding space of another model without modifying the embedding model themselves. Using the open-source models, MiniLM, MPNet and DistilBert, the conversion method is applied across different model pairs and the resulting embeddings are evaluated through t-SNE visualizations and various retrieval metrics. Experiments show that direct retrieval between different models typically results in poor performance due to architectural differences, but that the converter improves compatibility across models. The converter also enables inter-operability between models with different embedding dimensionalities, allowing them to coexist within the same retrieval system. These results demonstrate that embedding conversion is a viable approach to enable cross-model interoperability and flexibility in embedding-based systems.

Institutions

Publication Details

Journal
KTH Publication Database DiVA (KTH Royal Institute of Technology)
Published
2025-01-01
Primary Topic
Advanced Graph Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Compatibility with Multiple Embedding Models in Vector Databases

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Advanced Graph Neural Networks
article

Compatibility with Multiple Embedding Models in Vector Databases

article en

Abstract

This thesis investigates the compatibility of sentence embedding across open-source embedding models by implementing and evaluating existing embedding conversion methods. The goal is to assess whether embedding by one model can be translated into the embedding space of another model without modifying the embedding model themselves. Using the open-source models, MiniLM, MPNet and DistilBert, the conversion method is applied across different model pairs and the resulting embeddings are evaluated through t-SNE visualizations and various retrieval metrics. Experiments show that direct retrieval between different models typically results in poor performance due to architectural differences, but that the converter improves compatibility across models. The converter also enables inter-operability between models with different embedding dimensionalities, allowing them to coexist within the same retrieval system. These results demonstrate that embedding conversion is a viable approach to enable cross-model interoperability and flexibility in embedding-based systems.

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Master's College (US), Luleå University of Technology (SE)
Openalex Percentile: Top 72%
Advanced Graph Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Compatibility with Multiple Embedding Models in Vector Databases · KTH Publication Database DiVA (KTH Royal Institute of Technology) (2025) | TGRS Research Map | TGRS