ActDNN: An Automated System for Activity Recognition and Productivity Estimation for Heavy Construction Equipment

Abstract Effective monitoring of construction equipment activities is essential for improving operational efficiency on construction sites. Current vision-based methods are highly dependent on large and structured datasets that are impractical to collect from dynamic construction environments. This paper introduces activity recognistion deep learning neural network (ActDNN), a scalable multilabel machine learning framework designed for accurate activity recognition and productivity monitoring in near real time. It effectively handles unstructured image data, even in challenging conditions such as occlusion, varying camera angles, and when equipment is obscured by dust and dirt. The key contribution of ActDNN lies in its integration of two learning paradigms: (1) frame-based classification through independent learning to detect multiple concurrent equipment activities; and (2) temporal activity prediction using sequential learning to model activity transitions over time. ActDNN was evaluated using 8,926 frames and a whole video in these two experimental setups. The frame-based model achieved 99.82% accuracy in multilabel activity classification, while the sequential model achieved 97.79%, 89.67%, and 86.48% accuracy for the excavator and truck activity sequences, respectively. It also achieved 78.96%, 84.58%, and 54.84% accuracy in productivity prediction and 89.60%, 91.24%, and 99.10% accuracy in utilization ratio prediction for the excavator, Truck1, and Truck2, respectively. ActDNN significantly reduces the time and effort required for activity tracking, offering a practical near real-time solution for monitoring equipment.

Authors

Institutions

Publication Details

Journal
Journal of Computing in Civil Engineering
Published
2026-11-17
DOI
https://doi.org/10.1061/jccee5.cpeng-7485
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

ActDNN: An Automated System for Activity Recognition and Productivity Estimation for Heavy Construction Equipment

Wahib Saif, Sneha Verma, Mohamad Kassem, Xiang Xie
2 links
Journal of Computing in Civil Engineering
Advanced Neural Network Applications
article

ActDNN: An Automated System for Activity Recognition and Productivity Estimation for Heavy Construction Equipment

Wahib Saif, Sneha Verma, Mohamad Kassem, Xiang Xie
article en

Abstract

Abstract Effective monitoring of construction equipment activities is essential for improving operational efficiency on construction sites. Current vision-based methods are highly dependent on large and structured datasets that are impractical to collect from dynamic construction environments. This paper introduces activity recognistion deep learning neural network (ActDNN), a scalable multilabel machine learning framework designed for accurate activity recognition and productivity monitoring in near real time. It effectively handles unstructured image data, even in challenging conditions such as occlusion, varying camera angles, and when equipment is obscured by dust and dirt. The key contribution of ActDNN lies in its integration of two learning paradigms: (1) frame-based classification through independent learning to detect multiple concurrent equipment activities; and (2) temporal activity prediction using sequential learning to model activity transitions over time. ActDNN was evaluated using 8,926 frames and a whole video in these two experimental setups. The frame-based model achieved 99.82% accuracy in multilabel activity classification, while the sequential model achieved 97.79%, 89.67%, and 86.48% accuracy for the excavator and truck activity sequences, respectively. It also achieved 78.96%, 84.58%, and 54.84% accuracy in productivity prediction and 89.60%, 91.24%, and 99.10% accuracy in utilization ratio prediction for the excavator, Truck1, and Truck2, respectively. ActDNN significantly reduces the time and effort required for activity tracking, offering a practical near real-time solution for monitoring equipment.

Journal of Computing in Civil EngineeringVol. 41(2)
Northumbria University (GB), University of Sunderland (GB), Newcastle University (GB)
Industry, innovation and infrastructure
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon