Towards Contactless Human Concentration Monitoring Using mmWave Signals

Maintaining concentration in today’s complex and distracting environments is increasingly challenging, with significant impacts on productivity, learning outcomes, and safety. Traditional methods like self-reporting and observational studies are subjective and labor-intensive. Current approaches, including camera-based systems and wearable sensors, raise privacy concerns and require continuous physical interaction. To address these limitations, we propose a novel, contactless concentration monitoring system using mmWave technology. Our system leverages Commercial-Off-The-Shelf (COTS) mmWave devices to detect concentration-related activities, such as eye blinking, nodding, yawning and leg shaking. In particular, we enhance the activity detection and overcome the limited field of view (FOV) of mmWave devices through spatial decomposition based on Delay-and-Sum (DAS) beamforming technologies. Moreover, we mitigate interference in concurrent activities by exploiting the distinct frequency ranges associated with each concentration-related activity based on Short-Time Fourier Transform (STFT). A CNN model, integrated with domain adaptation techniques, ensures robust performance in diverse environments. Experiments involving 10 volunteers demonstrated an overall accuracy of 95.3% in detecting human activities. The system maintained robust performance at distances up to 150 cm and across different office environments. Our method offers a contactless and privacy-preserving alternative to current approaches, making it suitable for applications such as classroom monitoring, workplace productivity observance, and cognitive health monitoring.

Authors

Institutions

Publication Details

Published
2024-10-28
DOI
https://doi.org/10.1109/cic62241.2024.00013
Citations
1
Primary Topic
Wireless Body Area Networks
Type
article
Field-Weighted Citation Impact
0.18

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Towards Contactless Human Concentration Monitoring Using mmWave Signals

Wei Yi, Xiaonan Guo, Yan Wang, Yingying Chen et al.
1 citations
Wireless Body Area Networks
0.18
article

Towards Contactless Human Concentration Monitoring Using mmWave Signals

Wei Yi, Xiaonan Guo, Yan Wang, Yingying Chen, Jerry Cheng, Yuan Ge, Yucheng Xie
article en
1 citations

Abstract

Maintaining concentration in today’s complex and distracting environments is increasingly challenging, with significant impacts on productivity, learning outcomes, and safety. Traditional methods like self-reporting and observational studies are subjective and labor-intensive. Current approaches, including camera-based systems and wearable sensors, raise privacy concerns and require continuous physical interaction. To address these limitations, we propose a novel, contactless concentration monitoring system using mmWave technology. Our system leverages Commercial-Off-The-Shelf (COTS) mmWave devices to detect concentration-related activities, such as eye blinking, nodding, yawning and leg shaking. In particular, we enhance the activity detection and overcome the limited field of view (FOV) of mmWave devices through spatial decomposition based on Delay-and-Sum (DAS) beamforming technologies. Moreover, we mitigate interference in concurrent activities by exploiting the distinct frequency ranges associated with each concentration-related activity based on Short-Time Fourier Transform (STFT). A CNN model, integrated with domain adaptation techniques, ensures robust performance in diverse environments. Experiments involving 10 volunteers demonstrated an overall accuracy of 95.3% in detecting human activities. The system maintained robust performance at distances up to 150 cm and across different office environments. Our method offers a contactless and privacy-preserving alternative to current approaches, making it suitable for applications such as classroom monitoring, workplace productivity observance, and cognitive health monitoring.

Rutgers, The State University of New Jersey (US), George Mason University (US), Yeshiva University (US), New York Institute of Technology (US), Temple University (US)
National Science Foundation
Openalex Percentile: Top 49%
Wireless Body Area Networks
0.18
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.