Conditional Generative Adversarial Net based Feature Extraction along with Scalable Weakly Supervised Clustering for Facial Expression Classification

Article Conditional Generative Adversarial Net based Feature Extraction along with Scalable Weakly Supervised Clustering for Facial Expression Classification Ze Chen 1, Lu Zhang 2, Jiaming Tang 3, Jiafa Mao 3, and Weiguo Sheng 1,* 1 Department of Computer Science, Hangzhou Normal University, Hangzhou, P.R. China 2 China Telecom Hangzhou Branch, Hangzhou, P.R. China 3 School of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, P.R. China * Correspondence: [email protected] Received: 28 September 2023 Accepted: 30 June 2024 Published: 24 December 2024 Abstract: Extracting proper features plays a pivotal role in facial expression recognition. In this paper, we propose to extract facial expression features via a conditional generative adversarial net, followed by an algorithmic optimization step. These refined features are subsequently integrated into a scalable weakly supervised clustering framework for facial expression classification. Our results show that the proposed method can achieve an average recognition rate of 85.3%, which significantly outperforms related methods. Further, by employing a residual-based scheme for feature extraction, our method shows superior adaptability compared to algorithms based solely on weakly supervised clustering. Additionally, our method does not require high accurate annotation data and is robust to the noise presented in data sets.