Automated Signal Quality Assessment for rPPG: A Pulse-by-Pulse Scoring Method Designed Using Human Labelling

Reliable analysis of remote photoplethysmography (rPPG) signals depends on identifying physiologically plausible pulses. Traditional approaches rely on clustering self-similar pulses, which can discard valid variability. Automating pulse quality assessment could capture the true underlying morphology while preserving physiological variability. In this manuscript, individual rPPG pulses were manually labelled as plausible, borderline and implausible and used to train multilayer perceptron classifiers. Two independent datasets were used to ensure strict separation between training and test data: the Vision-MD dataset (4036 facial videos from 1270 participants) and a clinical laboratory dataset (235 videos from 58 participants). Vision-MD data were used for model development with an 80/20 training–validation split and 5-fold cross-validation, while the clinical dataset served exclusively as an independent test set. A three-class model was evaluated achieving F1-scores of 0.92, 0.24 and 0.79 respectively. Recall was highest for plausible and implausible pulses but lower for borderline pulses. To test separability, three pairwise binary classifiers were trained, with ROC-AUC > 0.89 for all three category pairs. When combining borderline and implausible pulses into a single class, the binary classifier achieved an F1-score of 0.93 for the plausible category. Finally, usability analysis showed that automated labelling identified more usable pulses per signal than the previously used agglomerative clustering method, while preserving physiological variability.