Applied Domain Adaptation of LLM-based Document Embeddings for Engineering Knowledge Retrieval

Figure 1: Overview of our proposed domain adaptation pipeline designed for document embedding model fine-tuning for engineering knowledge retrieval.Our experiments include proper model selection (bottom), corpus curation and synthetic retrieval data generation (upper-left), and multiple fine-tuning configurations (upper-right).