A Large Language Model-based Approach for Personalized Search Results Re-ranking in Professional Domains

Search result personalization and re-ranking in professional domains present significant challenges due to the complexity of domain-specific terminology and varying user expertise levels. This paper proposes a novel framework integrating Large Language Models (LLMs) with personalized search re-ranking for professional domains. The framework incorporates four key components: LLM-based user profile construction, professional domain knowledge encoding, cross-encoder re-ranking, and dynamic weight allocation. The user profile construction module utilizes historical interactions and professional behaviors to generate comprehensive user representations, while the domain knowledge encoding module captures specialized terminology and relationships. A cross-encoder architecture performs deep semantic matching between queries and documents, with results optimized through a dynamic weight allocation strategy. Experimental evaluation on three professional datasets (MedSearch, LegalDoc, and TechQuery) demonstrates significant improvements over existing methods, achieving 15.2% higher nDCG@10 and 12.8% better MRR compared to traditional ranking approaches. The framework maintains stable performance under varying query loads while effectively handling domain-specific terminology and user expertise variations. Ablation studies reveal the substantial impact of each component, with the LLM-based user profile construction and domain knowledge encoding contributing 7.5% and 6.3% improvements respectively. The proposed approach establishes new benchmarks for professional search systems while providing insights into effective integration of LLMs in domain-specific information retrieval.

Authors

Institutions

Publication Details

Journal
The International Journal of Language Studies (ISSN 3078 - 2244)
Published
2024-11-23
DOI
https://doi.org/10.60087/ijls.v1.n2.001
Citations
7
Primary Topic
Recommender Systems and Techniques
Type
article
Field-Weighted Citation Impact
4.67
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Large Language Model-based Approach for Personalized Search Results Re-ranking in Professional Domains

Yong Wang, Zhiyuan Zhou, Tianyu Lu, Jiayi Wang
7 citations
The International Journal of Language Studies (ISSN 3078 - 2244)
Recommender Systems and Techniques
4.67
article

A Large Language Model-based Approach for Personalized Search Results Re-ranking in Professional Domains

Yong Wang, Zhiyuan Zhou, Tianyu Lu, Jiayi Wang
article en
7 citations

Abstract

Search result personalization and re-ranking in professional domains present significant challenges due to the complexity of domain-specific terminology and varying user expertise levels. This paper proposes a novel framework integrating Large Language Models (LLMs) with personalized search re-ranking for professional domains. The framework incorporates four key components: LLM-based user profile construction, professional domain knowledge encoding, cross-encoder re-ranking, and dynamic weight allocation. The user profile construction module utilizes historical interactions and professional behaviors to generate comprehensive user representations, while the domain knowledge encoding module captures specialized terminology and relationships. A cross-encoder architecture performs deep semantic matching between queries and documents, with results optimized through a dynamic weight allocation strategy. Experimental evaluation on three professional datasets (MedSearch, LegalDoc, and TechQuery) demonstrates significant improvements over existing methods, achieving 15.2% higher nDCG@10 and 12.8% better MRR compared to traditional ranking approaches. The framework maintains stable performance under varying query loads while effectively handling domain-specific terminology and user expertise variations. Ablation studies reveal the substantial impact of each component, with the LLM-based user profile construction and domain knowledge encoding contributing 7.5% and 6.3% improvements respectively. The proposed approach establishes new benchmarks for professional search systems while providing insights into effective integration of LLMs in domain-specific information retrieval.

The International Journal of Language Studies (ISSN 3078 - 2244)Vol. 1(2)
Northeastern University (US), Illinois Institute of Technology (US), University of Aberdeen (GB), University of California, Berkeley (US)
Quality Education
Openalex Percentile: Top 5%
Recommender Systems and Techniques
4.67
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.