A Split-Face Computer Vision/Machine Learning Assessment of Facial Paralysis Using Facial Action Units

<b>Background:</b> Accurate assessment of facial paralysis is crucial for patient management and research, yet current clinician-graded scales are limited by subjectivity and variability. <b>Objective:</b> To evaluate whether an automated video analysis pipeline using hemifacial mirroring and Facial Action Unit (AU) quantification could accurately classify facial paralysis severity (None, Incomplete, and Complete) when validated against expert clinical grading. <b>Methods:</b> A custom Python pipeline processed 112 clinical videos (100 paralysis patients, 12 controls), generating mirrored hemifacial constructs. OpenFace 2.0 extracted AU intensities from these constructs, linked to voice-command-defined action epochs. Peak expression features trained XGBoost machine learning models to predict paralysis severity (None, Incomplete, and Complete) per facial zone (upper, mid, and lower), validated against multi-expert clinical assessment. <b>Results:</b> On held-out test sets, models achieved: upper face accuracy 0.83, weighted F1-score 0.83; mid-face accuracy 0.93, weighted F1-score 0.92; and lower face accuracy 0.84, weighted F1-score 0.82. Mirrored AU intensities significantly differed across expert-defined severity groups, validating feature relevance. <b>Conclusion:</b> The automated pipeline using hemifacial mirroring and mirrored AU analysis accurately predicted facial paralysis severity from standard clinical videos.

Authors

Institutions

Publication Details

Journal
Facial Plastic Surgery & Aesthetic Medicine
Published
2025-11-07
DOI
https://doi.org/10.1177/26893614251394382
Primary Topic
Facial Nerve Paralysis Treatment and Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Split-Face Computer Vision/Machine Learning Assessment of Facial Paralysis Using Facial Action Units

John Wilson, Christopher R. Razavi, Mingyang Gray, Joshua D. Rosenberg
Facial Plastic Surgery & Aesthetic Medicine
Facial Nerve Paralysis Treatment and Research
article

A Split-Face Computer Vision/Machine Learning Assessment of Facial Paralysis Using Facial Action Units

John Wilson, Christopher R. Razavi, Mingyang Gray, Joshua D. Rosenberg
article en

Abstract

<b>Background:</b> Accurate assessment of facial paralysis is crucial for patient management and research, yet current clinician-graded scales are limited by subjectivity and variability. <b>Objective:</b> To evaluate whether an automated video analysis pipeline using hemifacial mirroring and Facial Action Unit (AU) quantification could accurately classify facial paralysis severity (None, Incomplete, and Complete) when validated against expert clinical grading. <b>Methods:</b> A custom Python pipeline processed 112 clinical videos (100 paralysis patients, 12 controls), generating mirrored hemifacial constructs. OpenFace 2.0 extracted AU intensities from these constructs, linked to voice-command-defined action epochs. Peak expression features trained XGBoost machine learning models to predict paralysis severity (None, Incomplete, and Complete) per facial zone (upper, mid, and lower), validated against multi-expert clinical assessment. <b>Results:</b> On held-out test sets, models achieved: upper face accuracy 0.83, weighted F1-score 0.83; mid-face accuracy 0.93, weighted F1-score 0.92; and lower face accuracy 0.84, weighted F1-score 0.82. Mirrored AU intensities significantly differed across expert-defined severity groups, validating feature relevance. <b>Conclusion:</b> The automated pipeline using hemifacial mirroring and mirrored AU analysis accurately predicted facial paralysis severity from standard clinical videos.

Facial Plastic Surgery & Aesthetic Medicine
Icahn School of Medicine at Mount Sinai (US)
Openalex Percentile: Top 51%
Facial Nerve Paralysis Treatment and Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Split-Face Computer Vision/Machine Learning Assessment of Facial Paralysis Using Facial Action Units — John Wilson, Christopher R. Razavi, et al. · Facial Plastic Surgery & Aesthetic Medicine (2025) | TGRS Research Map | TGRS