Leveraging Vision Transformer-MLP Framework for High-Precision Driver Drowsiness Image Categorization
Road accidents attributed to driver drowsiness impose a severe social and economic burden worldwide. We present a hybrid vision–based framework that combines compact embeddings from a Vision Transformer (ViT, specifically NV-DINOv2) with a lightweight multi-layer perceptron (MLP) classifier to detect driver fatigue from facial cues and eye dynamics. By decoupling high-capacity visual feature extraction (ViT) from a small task-specific head (MLP), the proposed system delivers state-of-the-art accuracy while remaining fast enough for real-time deployment on commodity hardware. The model attains 99.25% test accuracy together with 99% precision, 99% recall, and a 99% F1 score substantially outperforming MobileNetV2, VGG16, and VGG19 baselines. These results demonstrate the effectiveness of ViT embeddings for robust, low-cost driver-monitoring applications.
Authors
- Nadeem Ahmad (ORCID: https://orcid.org/0000-0002-0804-3473)
- Mehbub Alam (ORCID: https://orcid.org/0000-0003-0329-8765)
- S. P. Majumder (ORCID: https://orcid.org/0000-0002-1748-8685)
- Baharul Islam (ORCID: https://orcid.org/0009-0007-8317-8371)
Institutions
- Khalifa University of Science and Technology (AE)
- Indian Institute of Information Technology Guwahati (IN)
- Dibrugarh University (IN)
Publication Details
- Published
- 2025-06-18
- DOI
- https://doi.org/10.1109/gcon65540.2025.11173333
- Primary Topic
- Sleep and Work-Related Fatigue
- Type
- article
- Field-Weighted Citation Impact
- 0.00