Facial Physiological and Emotional Analysis

Besides biometric info, there are rich physiological and emotional clues from human faces. Thanks to the rapid development of the AI/CV community, instead of handcrafted expert-level features, many vision foundation models and efficient learning methods are designed for subtle facial physiological and emotional analysis. This talk will explore the technological advancements in facial video-based remote photoplethysmography (rPPG), facial action unit (AU) detection, and emotion recognition systems. Furthermore, a downstream real-world application on deception detection will be introduced. Finally, some challenges and future directions will be discussed.