Tracking Blink Dynamics and Mental States on Glasses
Eye blink dynamics offer crucial insights into physiological and cognitive states. Existing solutions either require specialized equipment for detailed measurements or sacrifice temporal resolution for accessibility. We present BlinkWise, the first system that transforms everyday eyewear into a wise device for detailed blink dynamics tracking as a tiny add-on. BlinkWise measures eye openness in real-time on resource-constrained edge devices by leveraging both RF modality's inherent efficiency and novel computational optimizations—including recurrentization of convolutional network operations, quantization-aware normalization, and a lightweight proposal algorithm. Evaluation with 20 subjects and more than 18,000 blink measurements demonstrated BlinkWise's high accuracy in capturing subtle blink dynamics at millisecond resolution, achieving a Pearson correlation of 0.981 with ground truth. Through three real-world application studies, we demonstrate BlinkWise's potential for monitoring cognitive states and ocular health. Code, datasets, and demo videos are available on our website.
Authors
- M. Zhao (ORCID: https://orcid.org/0000-0001-5226-9085)
- Insup Lee (ORCID: https://orcid.org/0000-0003-2672-1132)
- Xin Yang (ORCID: https://orcid.org/0000-0002-1085-9340)
- Ahhyun Yuh (ORCID: https://orcid.org/0000-0002-3241-5628)
- Dongyin Hu (ORCID: https://orcid.org/0009-0006-6216-9735)
- Z. Y. Wang
- Lama A. Al‐Aswad (ORCID: https://orcid.org/0000-0003-2440-9559)
Institutions
- University of Pennsylvania (US)
- Philadelphia University (US)
Publication Details
- Published
- 2025-06-23
- DOI
- https://doi.org/10.1145/3711875.3729150
- Primary Topic
- Visual perception and processing mechanisms
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- University of Pennsylvania