EMOTE: Quantification of Facial Asymmetries using Inaudible Acoustic Sensing on Smart Glasses

Facial paralysis (FP) is a debilitating condition affecting millions of people and approximately 98% of all FP cases are unilateral. Rapid and accurate quantification of facial asymmetries is an essential first step towards restoring symmetric facial movements for these patients. Researchers have developed computer-vision-enhanced programs to perform automated quantification of facial asymmetries. While powerful, they face challenges in mobile applications. This paper presents EMOTE (Echo-Measurement-of-Tracked-Expressions), a pair of AI-powered smart glasses based on active acoustic sensing to provide automated quantification of facial asymmetries for FP patients. In a user study with 22 FP patients, EMOTE-derived eFACE scores (a clinical facial grading system) were evaluated against expert clinician-graded scores for four dynamic facial metrics: oral commissure excursion, lower lip depression, eyebrow elevation, and eye palpebral fissure width. Method-comparison analyses showed strongest agreement for oral commissure excursion and average eFACE scores, moderate agreement for lower lip depression and eyebrow elevation, and weaker agreement for eye palpebral fissure width. EMOTE presents a portable technology to quantify facial asymmetries automatically and continuously. This technology could serve future patients by pacing real-time, closed-loop stimulation to reanimate the paralyzed face.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Computing for Healthcare
Published
2026-11-17
DOI
https://doi.org/10.1145/3864024
Primary Topic
Facial Nerve Paralysis Treatment and Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

EMOTE: Quantification of Facial Asymmetries using Inaudible Acoustic Sensing on Smart Glasses

James T. Heaton, Ke Li, Elizabeth R. McGonagle, Tessa A. Hadlock et al.
1 links
ACM Transactions on Computing for Healthcare
Facial Nerve Paralysis Treatment and Research
article

EMOTE: Quantification of Facial Asymmetries using Inaudible Acoustic Sensing on Smart Glasses

James T. Heaton, Ke Li, Elizabeth R. McGonagle, Tessa A. Hadlock, Cheng Zhang, Roy Xiao, Pieter Boek
article en

Abstract

Facial paralysis (FP) is a debilitating condition affecting millions of people and approximately 98% of all FP cases are unilateral. Rapid and accurate quantification of facial asymmetries is an essential first step towards restoring symmetric facial movements for these patients. Researchers have developed computer-vision-enhanced programs to perform automated quantification of facial asymmetries. While powerful, they face challenges in mobile applications. This paper presents EMOTE (Echo-Measurement-of-Tracked-Expressions), a pair of AI-powered smart glasses based on active acoustic sensing to provide automated quantification of facial asymmetries for FP patients. In a user study with 22 FP patients, EMOTE-derived eFACE scores (a clinical facial grading system) were evaluated against expert clinician-graded scores for four dynamic facial metrics: oral commissure excursion, lower lip depression, eyebrow elevation, and eye palpebral fissure width. Method-comparison analyses showed strongest agreement for oral commissure excursion and average eFACE scores, moderate agreement for lower lip depression and eyebrow elevation, and weaker agreement for eye palpebral fissure width. EMOTE presents a portable technology to quantify facial asymmetries automatically and continuously. This technology could serve future patients by pacing real-time, closed-loop stimulation to reanimate the paralyzed face.

ACM Transactions on Computing for Healthcare
Harvard University (US), University of Groningen (NL), Cornell University (US), Posnick Center for Facial Plastic Surgery (US), University of Pennsylvania (US)
Good health and well-being
Facial Nerve Paralysis Treatment and Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon