ActDNN: An Automated System for Activity Recognition and Productivity Estimation for Heavy Construction Equipment
Abstract Effective monitoring of construction equipment activities is essential for improving operational efficiency on construction sites. Current vision-based methods are highly dependent on large and structured datasets that are impractical to collect from dynamic construction environments. This paper introduces activity recognistion deep learning neural network (ActDNN), a scalable multilabel machine learning framework designed for accurate activity recognition and productivity monitoring in near real time. It effectively handles unstructured image data, even in challenging conditions such as occlusion, varying camera angles, and when equipment is obscured by dust and dirt. The key contribution of ActDNN lies in its integration of two learning paradigms: (1) frame-based classification through independent learning to detect multiple concurrent equipment activities; and (2) temporal activity prediction using sequential learning to model activity transitions over time. ActDNN was evaluated using 8,926 frames and a whole video in these two experimental setups. The frame-based model achieved 99.82% accuracy in multilabel activity classification, while the sequential model achieved 97.79%, 89.67%, and 86.48% accuracy for the excavator and truck activity sequences, respectively. It also achieved 78.96%, 84.58%, and 54.84% accuracy in productivity prediction and 89.60%, 91.24%, and 99.10% accuracy in utilization ratio prediction for the excavator, Truck1, and Truck2, respectively. ActDNN significantly reduces the time and effort required for activity tracking, offering a practical near real-time solution for monitoring equipment.
Authors
- Wahib Saif (ORCID: https://orcid.org/0000-0003-2383-6663)
- Sneha Verma (ORCID: https://orcid.org/0000-0003-0135-2238)
- Mohamad Kassem (ORCID: https://orcid.org/0000-0002-9837-3934)
- Xiang Xie
Institutions
- Northumbria University (GB)
- University of Sunderland (GB)
- Newcastle University (GB)
Publication Details
- Journal
- Journal of Computing in Civil Engineering
- Published
- 2026-11-17
- DOI
- https://doi.org/10.1061/jccee5.cpeng-7485
- Primary Topic
- Advanced Neural Network Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00