DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: The role of AI in detecting and mitigating human errors in safety-critical industries: A review

Journal Article · · Reliability Engineering and System Safety
 [1];  [2];  [1];  [3];  [3];  [3]; ORCiD logo [1]
  1. University of Tennessee, Knoxville, TN (United States)
  2. University of Tennessee, San Jose, CA (United States)
  3. Idaho National Laboratory (INL), Idaho Falls, ID (United States)

For safety-critical industries, human error (HE) presents continual risks to system productivity, reliability and safety. Artificial intelligence (AI) and machine learning (ML) methods have emerged as promising approaches to understand, categorize and mitigate the risk of HE in safety-critical industries. Furthermore, this review offers an examination of the current landscape regarding the utilization of AI/ML with regards to HE in safety-critical industries, categorizing literature into descriptive modeling, predictive modeling, prescriptive modeling, and generative modeling techniques. Additionally, the review aims to provide insights regarding themes in literature, challenges, and future research directions. Findings of the review suggest that AI/ML methods can prove useful in addressing the HE problem across safety-critical industries.

Research Organization:
Idaho National Laboratory (INL), Idaho Falls, ID (United States); University of Tennessee, Knoxville, TN (United States)
Sponsoring Organization:
USDOE; USDOE Office of Nuclear Energy (NE), Nuclear Energy University Program (NEUP)
Grant/Contract Number:
AC07-05ID14517; NE0008978
OSTI ID:
2479887
Report Number(s):
INL/JOU--24-76319-Rev000
Journal Information:
Reliability Engineering and System Safety, Journal Name: Reliability Engineering and System Safety Vol. 256; ISSN 0951-8320
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (112)

Human–automation interaction strategies and models for life science applications
  • Kaber, David B.; Stoll, Norbert; Thurow, Kerstin
  • Human Factors and Ergonomics in Manufacturing & Service Industries, Vol. 19, Issue 6 https://doi.org/10.1002/hfm.20156
journal September 2009
A Review of Cognitive Models in Human Reliability Analysis journal December 2016
The phenotype of erroneous actions journal July 1993
Multivariate Analysis of Human Error Incidents Occurring at Nuclear Power Plants: Several Occurrence Patterns of Observed Human Errors journal April 2001
In AI we trust? Perceptions about automated decision-making by artificial intelligence journal January 2020
How to certify machine learning based safety-critical systems? A systematic literature review journal April 2022
Artificial intelligence and real-time predictive maintenance in industry 4.0: a bibliometric analysis journal March 2022
Human errors. A taxonomy for describing human malfunction in industrial installations journal September 1982
The application of active databases to the problems of human error in industry journal January 2000
The Reliability of the Human Factor journal January 2014
An investigation on unintended reactor trip events in terms of human error hazards of Korean nuclear power plants journal March 2014
Quantification of performance shaping factors (PSFs)’ weightings for human reliability analysis (HRA) of low power and shutdown (LPSD) operations journal March 2017
Pre-trained network-based transfer learning: A small-sample machine learning approach to nuclear power plant classification problem journal September 2022
Artificial intelligence framework for simulating clinical decision-making: A Markov decision process approach journal January 2013
Application of machine learning to construction injury prediction journal September 2016
Case studies of clinical decision-making through prescriptive models based on machine learning journal December 2023
Learning from major accidents: A machine learning approach journal June 2022
Building a digital twin for additive manufacturing through the exploitation of blockchain: A case analysis of the aircraft industry journal August 2019
Application of optimized machine learning techniques for prediction of occupational accidents journal June 2019
The evolution of the HFACS method used in analysis of marine accidents: A review journal November 2021
Real-time prediction of nuclear power plant parameter trends following operator actions journal December 2021
A survey of human-in-the-loop for machine learning journal October 2022
The perils and pitfalls of explainable AI: Strategies for explaining algorithmic decision-making journal April 2022
Augmented reality assisted calibration of digital twins of mobile robots journal January 2020
Prescriptive analytics: Literature review and research challenges journal February 2020
Relationship between human error intervention strategies and unsafe acts: The role of strategy implementability journal June 2018
A dynamic Bayesian networks modeling of human factors on offshore blowouts journal July 2013
Applying data mining techniques to analyze the causes of major occupational accidents in the petrochemical industry journal November 2013
Artificial intelligence-enabled non-intrusive vigilance assessment approach to reducing traffic controller’s human errors journal March 2022
A survey on active learning and human-in-the-loop deep learning for medical image analysis journal July 2021
A reliable intelligent diagnostic assistant for nuclear power plants using explainable artificial intelligence of GRU-AE, LightGBM and SHAP journal April 2022
SACADA and HuREX: Part 1. the use of SACADA and HuREX systems to collect human reliability data journal May 2022
Empirical estimation of human error probabilities based on the complexity of proceduralized tasks in an analog environment journal June 2022
Using artificial intelligence to detect human errors in nuclear power plants: A case in operation and maintenance journal February 2023
Deep learning-based procedure compliance check system for nuclear power plant emergency operation journal December 2020
Operation validation system to prevent human errors in nuclear power plants journal October 2022
Determining the most influential human factors in maritime accidents: A data-driven approach journal September 2020
Research on human factors cause chain of ship accidents based on multidimensional association rules journal December 2020
Providing support to operators for monitoring safety functions using reinforcement learning journal January 2020
Control automation in the heat-up mode of a nuclear power plant using reinforcement learning journal March 2022
Development of prediction models for repair and maintenance-related accidents at oil refineries using artificial neural network, fuzzy system, genetic algorithm, and ant colony optimization algorithm journal November 2019
Application of machine learning techniques for predicting the consequences of construction accidents in China journal January 2021
Human factors analysis and classification system for the oil and gas industry (HFACS-OGI) journal November 2017
Multi-source information fusion to assess control room operator performance journal February 2020
Incorporation of human factors into maritime accident analysis using a data-driven Bayesian network journal November 2020
Human reliability analysis: Exploring the intellectual structure of a research field journal November 2020
Machine learning for reliability engineering and safety applications: Review of current status and future opportunities journal July 2021
Importance of human reliability in process operation: A critical analysis journal July 2021
Review of techniques and challenges of human and organizational factors analysis in maritime transportation journal March 2022
Simulation optimization framework for dynamic probabilistic safety assessment journal April 2022
Discovering injury severity risk factors in automobile crashes: A hybrid explainable AI framework for decision support journal October 2022
Determining the critical risk factors for predicting the severity of ship collision accidents using a data-driven approach journal February 2023
Towards objective human performance measurement for maritime safety: A new psychophysiological data-driven machine learning method journal May 2023
A railway accident prevention method based on reinforcement learning – Active preventive strategy by multi-modal data journal June 2023
Integration of functional resonance analysis method and reinforcement learning for updating and optimizing emergency procedures in variable environments journal January 2024
Accident data-driven human fatigue analysis in maritime transport using machine learning journal January 2024
Empirical study on fine-tuning pre-trained large language models for fault diagnosis of complex systems journal December 2024
A case study to address the limitation of accident scenario identifications with respect to diverse manual responses journal November 2024
Human error taxonomies applied to driving: A generic driver error taxonomy and its implications for intelligent transport systems journal February 2009
Machine learning in occupational accident analysis: A review using science mapping approach with citation network analysis journal November 2020
Application of Bayesian network and artificial intelligence to reduce accident/incident rates in oil & gas companies journal January 2021
Identification of human errors and influencing factors: A machine learning approach journal February 2022
Recent applications of big data analytics in railway transportation systems: A survey journal May 2018
Investigating the Role of the Human Element in Maritime Accidents using Semi-Supervised Hierarchical Methods journal January 2021
Pupillometry Based Real-Time Monitoring of Operator’s Cognitive Workload To Prevent Human Error during Abnormal Situations journal December 2015
Process Systems Engineering and the Human-in-The-Loop: The Smart Control Room journal December 2019
Categorization of action slips. journal January 1981
Generative artificial intelligence: synthetic datasets in dentistry journal March 2024
Human Factors Analysis Classification System Relating to Human Error Awareness Taxonomy in Construction Safety journal August 2009
Enhancing industrial performance: experiences of integrating the human factor journal August 1995
A Worker’s Fitness-for-Duty Status Identification Based on Biosignals to Reduce Human Error in Nuclear Power Plants journal April 2020
Constructing Neural Network Model to Evaluate and Predict Human Error Probability in Nuclear Power Plants Based on Eye Response, Workload Rating, and Situation Awareness journal May 2022
A review of the literature on big data analytics in healthcare journal July 2019
Shift work, fatigue, and human error: An empirical analysis of railway traffic control journal October 2017
Human error in maintenance: a review journal January 2006
Artificial intelligence in safety-critical systems: a systematic review journal December 2021
A Survey on Security Threats and Defensive Techniques of Machine Learning: A Data Driven View journal January 2018
Learning From Accidents: Machine Learning for Safety at Railway Stations journal January 2020
Modeling Operator Performance in Human-in-the-Loop Autonomous Systems journal January 2021
A Safe, Secure, and Predictable Software Architecture for Deep Learning in Safety-Critical Systems journal September 2020
Unjustified Sample Sizes and Generalizations in Explainable Artificial Intelligence Research: Principles for More Inclusive User Studies journal November 2023
Error Categorization and Analysis in Man-Computer Communication Systems journal August 1973
Analysis and classification of human error journal July 1983
AGAPE‐ET: A Methodology for Human Error Analysis of Emergency Tasks journal October 2004
Human error: models and management journal March 2000
Performance evaluation of ChatGPT in detecting diagnostic errors and their contributing factors: an analysis of 545 case reports of diagnostic errors journal June 2024
Trustworthy Artificial Intelligence: A Review journal January 2022
Bias in Reinforcement Learning: A Review in Healthcare Applications journal September 2023
Artificial Intelligence for Safety-Critical Systems in Industrial and Transportation Domains: A Survey journal April 2024
The Human Factors Analysis Classification System (HFACS) Applied to Health Care journal June 2013
Is Proficiency Eroding among U.S. Naval Aircrews? a Quantitative Analysis Using the Human Factors Analysis and Classification System journal July 2000
Factors contributing to preventing operating room “never events”: a machine learning analysis journal March 2023
Use of artificial intelligence in critical care: opportunities and obstacles journal April 2024
The Perioperative Human Digital Twin journal March 2022
To Explain or to Predict? journal August 2010
Editorial—Big Data, Data Science, and Analytics: The Opportunity and Challenge for IS Research journal September 2014
The Out-of-the-Loop Performance Problem and Level of Control in Automation journal June 1995
ACT-R based human digital twin to enhance operators’ performance in process industries journal February 2023
Autopilot, Mind Wandering, and the Out of the Loop Performance Problem journal October 2017
An Occupational Safety and Health Perspective on Human in Control and AI journal July 2022
Examining the Potential of Generative Language Models for Aviation Safety Analysis: Case Study and Insights Using the Aviation Safety Reporting System (ASRS) journal August 2023
Machine Learning and Natural Language Processing for Prediction of Human Factors in Aviation Incident Reports journal February 2021
A Digital Twin-Based Platform towards Intelligent Automation with Virtual Counterparts of Flight and Air Traffic Control Operations journal November 2021
Learning Methods and Predictive Modeling to Identify Failure by Human Factors in the Aviation Industry journal March 2023
Analysis of Lookout Activity in a Simulated Environment to Investigate Maritime Accidents Caused by Human Error journal December 2018
Automated Error Labeling in Radiation Oncology via Statistical Natural Language Processing journal March 2023
A Future with Machine Learning: Review of Condition Assessment of Structures and Mechanical Systems in Nuclear Facilities journal March 2023
Predicting Future Driving Risk of Crash-Involved Drivers Based on a Systematic Machine Learning Framework journal January 2019
Fusing XGBoost and SHAP Models for Maritime Accident Prediction and Causality Interpretability Analysis journal August 2022
Digital Twin Technology Challenges and Applications: A Comprehensive Review journal March 2022
A Review of Data Analytic Applications in Road Traffic Safety. Part 2: Prescriptive Modeling journal February 2020
Impact of Fireworks Industry Safety Measures and Prevention Management System on Human Error Mitigation Using a Machine Learning Approach journal April 2023