skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Identifying Modular Construction Worker Tasks Using Computer Vision

Conference ·

Modular construction is increasingly being seen as an attractive method for delivering building projects due to advantages in safety, quality, and lead-time. Despite these benefits, this method still relies heavily on human labor, which causes variability in factory assembly-line performance that can erode performance benefits of modular construction. Continuous improvement methods can alleviate some of these issues, but they also require continuous monitoring of human workers' performance. Due to limitations of manual time study and automated sensor-based monitoring methods, recently computer vision-based methods have gained momentum in identifying the activities of construction workers from the videos of onsite construction. Therefore, this paper explores the use of computer vision-based human activity recognition techniques to identify and classify worker activities in modular construction videos. Computer vision-based tracking method has been used to track the human workers in each frame, and Resnet-50 network has been used to classify the activity of tracked workers. Evaluation of this framework has achieved higher than 90% accuracy and recall in testing.

Research Organization:
National Renewable Energy Lab. (NREL), Golden, CO (United States)
Sponsoring Organization:
USDOE Office of Energy Efficiency and Renewable Energy (EERE), Energy Efficiency Office. Building Technologies Office
DOE Contract Number:
Report Number(s):
NREL/CP-5500-81095; MainId:79871; UUID:a98a5278-5016-4e59-b2a5-1273866e308b; MainAdminID:64868
Resource Relation:
Conference: Presented at the ASCE International Conference on Computing in Civil Engineering 2021, 12-14 September 2021, Orlando, Florida
Country of Publication:
United States

References (20)

Smartphone-based construction workers' activity recognition and classification journal November 2016
ANN-based automated scaffold builder activity recognition through wearable EMG and IMU sensors journal June 2021
Two-step long short-term memory method for identifying construction activities through positional and attentional cues journal October 2019
Activity analysis of construction equipment using audio signals and support vector machines journal September 2017
Ladars for construction assessment and update journal September 2000
Relative Productivity in the AEC Industries in the United States for On-Site and Off-Site Activities journal July 2008
Automated Vision-Based Recognition of Construction Worker Actions for Building Interior Construction Operations Using RGBD Cameras conference July 2012
Learning and Classifying Motions of Construction Workers and Equipment Using Bag of Video Feature Words and Bayesian Learning Methods conference April 2012
Vision-based workface assessment using depth images for activity analysis of interior construction operations journal December 2014
Convolutional neural networks: Computer vision-based workforce activity assessment in construction journal October 2018
Recognizing Diverse Construction Activities in Site Images via Relevance Networks of Construction-Related Objects Detected by Convolutional Neural Networks journal May 2018
Towards efficient and objective work sampling: Recognizing workers' activities in site surveillance videos with two-stream convolutional networks journal October 2018
Estimating Construction Labor Productivity Frontier: Pilot Study journal October 2017
Times-series data augmentation and deep learning for construction equipment activity recognition journal October 2019
Activity identification in modular construction using audio signals and machine learning journal November 2020
Modeling Construction Labor Productivity journal December 1990
Differential received signal strength based RFID positioning for construction equipment tracking journal October 2019
Vision-based action recognition of construction workers using dense trajectories journal August 2016
Estimating Construction Workers' Physical Workload by Fusing Computer Vision and Smart Insole Technologies
  • Yu, Yantao; Li, Heng; Yang, Xincong
  • 34th International Symposium on Automation and Robotics in Construction, Proceedings of the International Symposium on Automation and Robotics in Construction (IAARC)
conference July 2018
Preserving Structure in Model-Free Tracking journal April 2014