Unsupervised Domain Adaptation Method Based on Relative Entropy Regularization and Measure Propagation

This paper presents a novel unsupervised domain adaptation (UDA) framework that integrates information-theoretic principles to mitigate distributional discrepancies between source and target domains. The proposed method incorporates two key components: (1) relative entropy regularization, which leverages Kullback-Leibler (KL) divergence to align the predicted label distribution of the target domain with a reference distribution derived from the source domain, thereby reducing prediction uncertainty; and (2) measure propagation, a technique that transfers probability mass from the source domain to generate pseudo-measures-estimated probabilistic representations-for the unlabeled target domain. This dual mechanism enhances both global feature alignment and semantic consistency across domains. Extensive experiments on benchmark datasets (OfficeHome and DomainNet) demonstrate that the proposed approach consistently outperforms State-of-the-Art methods, particularly in scenarios with significant domain shifts. These results confirm the robustness, scalability, and theoretical grounding of our framework, offering a new perspective on the fusion of information theory and domain adaptation.

Authors

Institutions

Publication Details

Journal
Entropy
Published
2025-04-14
DOI
https://doi.org/10.3390/e27040426
Citations
2
Primary Topic
Domain Adaptation and Few-Shot Learning
Type
article
Field-Weighted Citation Impact
4.96
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Unsupervised Domain Adaptation Method Based on Relative Entropy Regularization and Measure Propagation

Xiang Zhou, Weixi Wu, Zhuo Peng, Shubing Liu et al.
2 citations
Entropy
Domain Adaptation and Few-Shot Learning
4.96
article

Unsupervised Domain Adaptation Method Based on Relative Entropy Regularization and Measure Propagation

Xiang Zhou, Weixi Wu, Zhuo Peng, Shubing Liu, Yongjia Song, LiangHao Tan, He Jiang, Xiaoyi Liu
article en
2 citations

Abstract

This paper presents a novel unsupervised domain adaptation (UDA) framework that integrates information-theoretic principles to mitigate distributional discrepancies between source and target domains. The proposed method incorporates two key components: (1) relative entropy regularization, which leverages Kullback-Leibler (KL) divergence to align the predicted label distribution of the target domain with a reference distribution derived from the source domain, thereby reducing prediction uncertainty; and (2) measure propagation, a technique that transfers probability mass from the source domain to generate pseudo-measures-estimated probabilistic representations-for the unlabeled target domain. This dual mechanism enhances both global feature alignment and semantic consistency across domains. Extensive experiments on benchmark datasets (OfficeHome and DomainNet) demonstrate that the proposed approach consistently outperforms State-of-the-Art methods, particularly in scenarios with significant domain shifts. These results confirm the robustness, scalability, and theoretical grounding of our framework, offering a new perspective on the fusion of information theory and domain adaptation.

EntropyVol. 27(4)
University of North Carolina at Chapel Hill (US), Georgia Institute of Technology (US), State University of New York (US), University of California, Irvine (US), University of California San Diego (US), Communities In Schools of Orange County (US), Arizona State University (US), New York University (US)
Openalex Percentile: Top 6%
Domain Adaptation and Few-Shot Learning
4.96
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.