FDAC: Federated Domain Adaptation via Dual Contrastive Learning

Federated domain adaptation (FDA) aims to transfer knowledge collaboratively from multiple source domains to related but different unlabelled target domains. The data of each domain are locally maintained, and various domain gaps exist among them, resulting in extreme challenges in simultaneously mitigating diverse distribution shifts and preserving discriminative knowledge without accessing the source data. Many existing works have failed to fully explore different source models to measure domain shifts and leverage semantic knowledge, resulting in skewed alignment and partial preservation of discriminative information. In this paper, we propose a novel approach named FDAC to address <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">F</u>ederated <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">D</u>omain <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">A</u>daptation by thoroughly investigating source models via dual <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">C</u>ontrastive mechanisms. FDAC contrastively increases the data diversity to align features across domains in a fine-grained manner by manipulating the latent deep architecture and compensating for knowledge from each source domain; simultaneously, it contrastively utilizes the comprehensive semantic knowledge of different source domains to guide the adaptation process. Extensive experiments on several real datasets demonstrate that FDAC outperforms all comparative methods under most conditions. Furthermore, FDAC only needs approximately half of the communication rounds compared with the state-of-the-art methods, indicating that FDAC can significantly improve communication efficiency, which is another key factor in the federated setting. The source code is publicly available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/ycarobot/FDAC</uri>.