An enhanced deep learning approach for intelligent healthcare emotion analysis using facial expressions and feature analysis to identify pain

Abstract This study introduces an innovative deep learning method for intelligent healthcare emotion analysis, specifically targeting the recognition of pain based on facial expressions. The suggested approach combines cloud-based mobile applications, utilising separate front-end and back-end elements to optimise data processing. The main contributions consist of a Smart Automated System (SASys) that integrates statistical and deep learning methods to extract features, thereby guaranteeing both resilience and efficiency. Image preprocessing encompasses the tasks of detecting faces and normalising them, which is crucial for extracting features with high accuracy. The comparison of statistical feature representation using Histogram of Oriented Gradients and Local Binary Pattern, along with machine learning classifiers, against an enhanced deep learning-based approach with an integrated multi-tasking feature known as multi-task convolutional neural network, demonstrates encouraging outcomes that support the superiority of the convolutional neural network architecture. Statistical and deep learning-based classification scores, when combined, greatly enhance the system’s overall performance. The results of the experiments prove that the method is effective, outperforming traditional classifiers and exhibiting comparable accuracy to cutting-edge healthcare SASys.