361 Automated assessment of facial nerve function using multimodal machine learning

Objectives/Goals: Current popular scoring systems for evaluating facial nerve function are subjective and imprecise. This study aims to quantify speech and facial motor changes in patients suffering from facial palsy after cerebellopontine angle (CPA) tumor resection to lay the foundation for a scoring algorithm that is higher resolution and more objective. Methods/Study Population: We will obtain audio and video recordings from 20 adult patients prior to and after surgical resection of unilateral CPA tumors between October 2024 and February 2025. We will obtain preoperative recordings within two weeks prior to surgery and postoperative recordings following a preset schedule starting from the day after surgery up to one year. Audio recordings entail patient readings of standardized passages and phonations while video recordings entail patient performance of standardized facial expressions. We will analyze video data for key distance measurements, such as eye opening and wrinkle size, using DynaFace. We will process audio data using VoiceLab to extract metrics such as prominence and tonality. We will perform statistical tests such as t-tests and ANOVA to elucidate changes across time. Results/Anticipated Results: I expect to obtain 9 sets of audio and video recordings from each of the 20 participants. In terms of speech, I expect average speech duration to increase postoperatively. Similarly, I expect to find increases in time spent breathing, number of breaths taken, and mean breathing duration. In terms of facial movement, I expect nasolabial fold length to decrease postoperatively, as well as eye opening size and left-right symmetry at rest. For both audio and video, I expect these changes to revert towards their preoperative baseline as time passes. I also expect average House-Brackmann and Sunnybrook facial grading scores to increase postoperatively and then decrease with time, correlating strongly with the video and audio findings. I will use trajectory analysis and time point matching to handle any missing data. Discussion/Significance of Impact: This study will validate our analysis platform’s ability to automatically quantify measurable changes that occur to speech and facial movement which correlate strongly with existing scoring systems. Future work will synthesize these data streams to move towards establishing biomarkers for facial nerve function that aid clinical decision-making.

Authors

Institutions

Publication Details

Journal
Journal of Clinical and Translational Science
Published
2025-03-25
DOI
https://doi.org/10.1017/cts.2024.987
Primary Topic
Facial Nerve Paralysis Treatment and Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

361 Automated assessment of facial nerve function using multimodal machine learning

Oren Wei, Kofi Boahene, Ioan Lina, Diana López
Journal of Clinical and Translational Science
Facial Nerve Paralysis Treatment and Research
article

361 Automated assessment of facial nerve function using multimodal machine learning

Oren Wei, Kofi Boahene, Ioan Lina, Diana López
article en

Abstract

Objectives/Goals: Current popular scoring systems for evaluating facial nerve function are subjective and imprecise. This study aims to quantify speech and facial motor changes in patients suffering from facial palsy after cerebellopontine angle (CPA) tumor resection to lay the foundation for a scoring algorithm that is higher resolution and more objective. Methods/Study Population: We will obtain audio and video recordings from 20 adult patients prior to and after surgical resection of unilateral CPA tumors between October 2024 and February 2025. We will obtain preoperative recordings within two weeks prior to surgery and postoperative recordings following a preset schedule starting from the day after surgery up to one year. Audio recordings entail patient readings of standardized passages and phonations while video recordings entail patient performance of standardized facial expressions. We will analyze video data for key distance measurements, such as eye opening and wrinkle size, using DynaFace. We will process audio data using VoiceLab to extract metrics such as prominence and tonality. We will perform statistical tests such as t-tests and ANOVA to elucidate changes across time. Results/Anticipated Results: I expect to obtain 9 sets of audio and video recordings from each of the 20 participants. In terms of speech, I expect average speech duration to increase postoperatively. Similarly, I expect to find increases in time spent breathing, number of breaths taken, and mean breathing duration. In terms of facial movement, I expect nasolabial fold length to decrease postoperatively, as well as eye opening size and left-right symmetry at rest. For both audio and video, I expect these changes to revert towards their preoperative baseline as time passes. I also expect average House-Brackmann and Sunnybrook facial grading scores to increase postoperatively and then decrease with time, correlating strongly with the video and audio findings. I will use trajectory analysis and time point matching to handle any missing data. Discussion/Significance of Impact: This study will validate our analysis platform’s ability to automatically quantify measurable changes that occur to speech and facial movement which correlate strongly with existing scoring systems. Future work will synthesize these data streams to move towards establishing biomarkers for facial nerve function that aid clinical decision-making.

Journal of Clinical and Translational ScienceVol. 9(s1)
Johns Hopkins University (US), Johns Hopkins Medicine (US), Vanderbilt University Medical Center (US)
Openalex Percentile: Top 91%
Facial Nerve Paralysis Treatment and Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.