Enhancing Lightweight Face Information Detection Network with Multi-Clue Interaction and Part-Aware Supervision

In recent years, technologies related to intelligent vehicles have seen rapid development, making the design of driver monitoring systems that can operate on vehicles a critical area of focus. These systems analyze drivers' facial information to assess their attention status and ability to control the vehicle. In this paper, we propose a lightweight, multitask deep learning model for detecting head pose, gaze direction, and eye state from facial images. This model is specifically designed for integration into driver monitoring systems, aiming to determine whether the driver is focused on the road. To facilitate deployment on embedded vehicle devices, our approach leverages multitask learning with carefully designed task branches to create an efficient and lightweight system. Each task is supported by dedicated branches to ensure the extraction of necessary features, with part-aware supervision enhancing the focus on relevant facial regions. Additionally, clue features encode part-specific implicit knowledge, improving task-specific feature initialization and overall model performance. We evaluate our model using the AFLW2000, BIWI, Gaze360, and CEW datasets, demonstrating that our method achieves competitive performance with reduced parameter costs. Our results show superior performance under lightweight conditions compared to existing methods, demonstrating the effectiveness of our approach in real-world applications.

Authors

Institutions

Publication Details

Published
2024-11-27
DOI
https://doi.org/10.1109/dicta63115.2024.00079
Primary Topic
Face and Expression Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Lightweight Face Information Detection Network with Multi-Clue Interaction and Part-Aware Supervision

Pei‐Yung Hsiao, Zong-Rong Lee, Yung-Chin Yen, Yi Chen et al.
Face and Expression Recognition
article

Enhancing Lightweight Face Information Detection Network with Multi-Clue Interaction and Part-Aware Supervision

Pei‐Yung Hsiao, Zong-Rong Lee, Yung-Chin Yen, Yi Chen, Jiaxin Liu, Chih‐Hung Hsu, Li‐Chen Fu
article en

Abstract

In recent years, technologies related to intelligent vehicles have seen rapid development, making the design of driver monitoring systems that can operate on vehicles a critical area of focus. These systems analyze drivers' facial information to assess their attention status and ability to control the vehicle. In this paper, we propose a lightweight, multitask deep learning model for detecting head pose, gaze direction, and eye state from facial images. This model is specifically designed for integration into driver monitoring systems, aiming to determine whether the driver is focused on the road. To facilitate deployment on embedded vehicle devices, our approach leverages multitask learning with carefully designed task branches to create an efficient and lightweight system. Each task is supported by dedicated branches to ensure the extraction of necessary features, with part-aware supervision enhancing the focus on relevant facial regions. Additionally, clue features encode part-specific implicit knowledge, improving task-specific feature initialization and overall model performance. We evaluate our model using the AFLW2000, BIWI, Gaze360, and CEW datasets, demonstrating that our method achieves competitive performance with reduced parameter costs. Our results show superior performance under lightweight conditions compared to existing methods, demonstrating the effectiveness of our approach in real-world applications.

National Taiwan University (TW), National University of Kaohsiung (TW), Electronics Testing Center (TW)
Openalex Percentile: Top 73%
Face and Expression Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Enhancing Lightweight Face Information Detection Network with Multi-Clue Interaction and Part-Aware Supervision — Pei‐Yung Hsiao, Zong-Rong Lee, et al. · (2024) | TGRS Research Map | TGRS