Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Enabling human–infrastructure interfaces for inspection using augmented reality

Journal Article · · Structural Health Monitoring
 [1];  [1];  [2];  [3];  [4]
  1. Department of Civil, Construction and Environmental Engineering, University of New Mexico, Albuquerque, NM, USA
  2. Research Scientist, Los Alamos National Laboratory, Los Alamos, NM, USA
  3. Department of Electrical and Computer Engineering, University of New Mexico, Albuquerque, NM, USA
  4. Department of Civil, Construction and Environmental Engineering, University of New Mexico, Albuquerque, NM, USA, Department of Electrical and Computer Engineering, University of New Mexico, Albuquerque, NM, USA, Department of Mechanical Engineering, University of New Mexico, Albuquerque, NM, USA

Decaying infrastructure maintenance cost allocation depends heavily on accurate and safe inspection in the field. New tools to conduct inspections can assist in prioritizing investments in maintenance and repairs. The industrial revolution termed as “Industry 4.0” is based on the intelligence of machines working with humans in a collaborative workspace. Contrarily, infrastructure management has relied on the human for making day-to-day decisions. New emerging technologies can assist during infrastructure inspections, to quantify structural condition with more objective data. However, today’s owners agree in trusting the inspector’s decision in the field over data collected with sensors. If data collected in the field is accessible during the inspections, the inspector decisions can be improved with sensors. New research opportunities in the human–infrastructure interface would allow researchers to improve the human awareness of their surrounding environment during inspections. This article studies the role of Augmented Reality (AR) technology as a tool to increase human awareness of infrastructure in their inspection work. The domains of interest of this research include both infrastructure inspections (emphasis on the collection of data of structures to inform management decisions) and emergency management (focus on the data collection of the environment to inform human actions). This article describes the use of a head-mounted device to access real-time data and information during their field inspection. The authors leverage the use of low-cost smart sensors and QR code scanners integrated with Augmented Reality applications for augmented human interface with the physical environment. This article presents a novel interface architecture for developing Augmented Reality–enabled inspection to assist the inspector’s workflow in conducting infrastructure inspection works with two new applications and summarizes the results from various experiments. The main contributions of this work to computer-aided community are enabling inspectors to visualize data files from database and real-time data access using an Augmented Reality environment.

Sponsoring Organization:
USDOE
OSTI ID:
1735768
Journal Information:
Structural Health Monitoring, Journal Name: Structural Health Monitoring Journal Issue: 4 Vol. 20; ISSN 1475-9217
Publisher:
SAGE PublicationsCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (41)

Protecting Nonverbal Data Tracked in Virtual Reality journal October 2018
Automated modal identification using principal component and cluster analysis: Application to a long‐span cable‐stayed bridge journal July 2019
How did the WTC towers collapse: a new theory journal October 2003
BIM-based indoor-emergency-navigation-system for complex buildings journal October 2008
A BIM-based visualization and warning system for fire rescue journal August 2018
A BIM centered indoor localization algorithm to support building fire emergency response operations journal June 2014
A survey of automation-enabled human-in-the-loop systems for infrastructure visual inspection journal January 2019
Myoelectric control systems—A survey journal October 2007
A hybrid IoT-based approach for emergency evacuation journal May 2019
The FDNY on 9/11: Information and decision making in crisis journal January 2007
A systematic review of augmented reality applications in maintenance journal February 2018
Sensory substitution and the human–machine interface journal December 2003
Principles of neural ensemble physiology underlying the operation of brain–machine interfaces journal July 2009
Infrastructure Stakeholders’ Perspective in Development and Implementation of New Structural Health Monitoring (SHM) Technologies for Maintenance and Management of Transportation Infrastructure journal January 2019
Dynamic Assessment of Timber Railroad Bridges Using Displacements journal October 2015
Comparison of Visual Inspection and Structural-Health Monitoring As Bridge Condition Assessment Methods journal June 2016
An evaluation of integrating multisourced sensors for disaster management journal June 2014
RescueMe: An Indoor Mobile Augmented-Reality Evacuation System by Personalized Pedometry conference December 2011
An introduction to Augmented Reality with applications in aeronautical maintenance conference June 2011
Towards Explainable Shared Control using Augmented Reality conference November 2019
Distributed user tracking concepts for augmented reality applications conference January 2000
Augmented Reality Environmental Monitoring Using Wireless Sensor Networks conference July 2008
Augmented Reality Projects in the Automotive and Aerospace Industries journal November 2005
Communicating and Displaying Real-Time Data with WebSocket journal July 2012
Speech-enabled augmented reality supporting mobile industrial maintenance journal January 2003
RFID-based localization and tracking technologies journal April 2011
Yea Big, Yea High: A 3D User Interface for Surface Selection by Progressive Refinement in Virtual Environments conference March 2018
A New Flexible Augmented Reality Platform for Development of Maintenance and Educational Applications journal January 2014
SHM process as perceived through 350 projects conference March 2010
SpyGlass: a wireless sensor network visualizer journal January 2005
Applying QR code in augmented reality applications
  • Kan, Tai-Wei; Teng, Chin-Hung; Chou, Wen-Shou
  • Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry https://doi.org/10.1145/1670252.1670305
conference December 2009
Ubiquitous computing for firefighters conference April 2004
A Survey of Augmented Reality journal August 1997
Toward data anomaly detection for automated structural health monitoring: Exploiting generative adversarial nets and autoencoders journal June 2020
Virtual Environments for Structural Health Monitoring conference September 2017
Smart infrastructure: an emerging frontier for multidisciplinary research
  • Ogie, Robert Ighodaro; Perez, Pascal; Dignum, Virginia
  • Proceedings of the Institution of Civil Engineers - Smart Infrastructure and Construction, Vol. 170, Issue 1 https://doi.org/10.1680/jsmic.16.00002
journal March 2017
Need for Bridge Monitoring Systems to Counter Railroad Bridge Service Interruptions
  • Otter, Duane; Joy, Richard; Jones, Mary Clara
  • Transportation Research Record: Journal of the Transportation Research Board, Vol. 2313, Issue 1 https://doi.org/10.3141/2313-15
journal January 2012
Combination of Image-Based Documentation and Augmented Reality for Structural Health Monitoring and Building Pathology journal April 2019
Augmented Reality for Enabling Smart Nuclear Infrastructure journal June 2019
Design and Implementation of a Connection between Augmented Reality and Sensors journal January 2020
Providing IoT Services in Smart Cities through Dynamic Augmented Reality Markers journal July 2015

Similar Records

Design and Implementation of a Connection between Augmented Reality and Sensors
Journal Article · Tue Dec 31 19:00:00 EST 2019 · Robotics · OSTI ID:1581024

Augmented Reality for Managing Nuclear Infrastructure and Operations - 19605
Conference · Mon Jul 01 00:00:00 EDT 2019 · OSTI ID:23005450

Brain Science and International Nuclear Safeguards: Implications from Cognitive Science and Human Factors Research on the Provision and Use of Safeguards-Relevant Information in the Field
Journal Article · Wed May 31 20:00:00 EDT 2017 · ESARDA Bulletin · OSTI ID:1429820

Related Subjects