Challenges in leveraging existing human performance data for quantifying the IDHEAS HRA method
Abstract
Our article documents an exploratory study for collecting and using human performance data to inform human error probability (HEP) estimates for a new human reliability analysis (HRA) method, the IntegrateD Human Event Analysis System (IDHEAS). The method was based on cognitive models and mechanisms underlying human behaviour and employs a framework of 14 crew failure modes (CFMs) to represent human failures typical for human performance in nuclear power plant (NPP) internal, at-power events [1]. A decision tree (DT) was constructed for each CFM to assess the probability of the CFM occurring in different contexts. Data needs for IDHEAS quantification are discussed. Then, the data collection framework and process is described and how the collected data were used to inform HEP estimation is illustrated with two examples. Next, five major technical challenges are identified for leveraging human performance data for IDHEAS quantification. Furthermore, these challenges reflect the data needs specific to IDHEAS. More importantly, they also represent the general issues with current human performance data and can provide insight for a path forward to support HRA data collection, use, and exchange for HRA method development, implementation, and validation.
- Authors:
-
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
- Publication Date:
- Research Org.:
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
- Sponsoring Org.:
- USDOE National Nuclear Security Administration (NNSA)
- OSTI Identifier:
- 1236204
- Alternate Identifier(s):
- OSTI ID: 1237368
- Report Number(s):
- SAND-20153925J; SAND-2015-0552J
Journal ID: ISSN 0951-8320; PII: S0951832015002239; TRN: US1600450
- Grant/Contract Number:
- AC04-94AL85000
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Reliability Engineering and System Safety
- Additional Journal Information:
- Journal Volume: 144; Journal Issue: C; Journal ID: ISSN 0951-8320
- Publisher:
- Elsevier
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 22 GENERAL STUDIES OF NUCLEAR REACTORS; 99 GENERAL AND MISCELLANEOUS; human reliability analysis (HRA); HRA data; the IntegrateD human event analysis system (IDHEAS); crew failure mode (CFM); probabilistic risk assessment (PRA); error of commission; nuclear power plant (NPP); decision tree (DT); 42 ENGINEERING; Human reliability analysis (HRA); The IntegrateD Human Event Analysis System (IDHEAS); Crew failure mode (CFM); Probabilistic risk assessment (PRA); Nuclear power plant (NPP); Decision tree (DT)
Citation Formats
Liao, Huafei N., Groth, Katrina, and Stevens-Adams, Susan. Challenges in leveraging existing human performance data for quantifying the IDHEAS HRA method. United States: N. p., 2015.
Web. doi:10.1016/j.ress.2015.07.018.
Liao, Huafei N., Groth, Katrina, & Stevens-Adams, Susan. Challenges in leveraging existing human performance data for quantifying the IDHEAS HRA method. United States. https://doi.org/10.1016/j.ress.2015.07.018
Liao, Huafei N., Groth, Katrina, and Stevens-Adams, Susan. Wed .
"Challenges in leveraging existing human performance data for quantifying the IDHEAS HRA method". United States. https://doi.org/10.1016/j.ress.2015.07.018. https://www.osti.gov/servlets/purl/1236204.
@article{osti_1236204,
title = {Challenges in leveraging existing human performance data for quantifying the IDHEAS HRA method},
author = {Liao, Huafei N. and Groth, Katrina and Stevens-Adams, Susan},
abstractNote = {Our article documents an exploratory study for collecting and using human performance data to inform human error probability (HEP) estimates for a new human reliability analysis (HRA) method, the IntegrateD Human Event Analysis System (IDHEAS). The method was based on cognitive models and mechanisms underlying human behaviour and employs a framework of 14 crew failure modes (CFMs) to represent human failures typical for human performance in nuclear power plant (NPP) internal, at-power events [1]. A decision tree (DT) was constructed for each CFM to assess the probability of the CFM occurring in different contexts. Data needs for IDHEAS quantification are discussed. Then, the data collection framework and process is described and how the collected data were used to inform HEP estimation is illustrated with two examples. Next, five major technical challenges are identified for leveraging human performance data for IDHEAS quantification. Furthermore, these challenges reflect the data needs specific to IDHEAS. More importantly, they also represent the general issues with current human performance data and can provide insight for a path forward to support HRA data collection, use, and exchange for HRA method development, implementation, and validation.},
doi = {10.1016/j.ress.2015.07.018},
journal = {Reliability Engineering and System Safety},
number = C,
volume = 144,
place = {United States},
year = {Wed Jul 29 00:00:00 EDT 2015},
month = {Wed Jul 29 00:00:00 EDT 2015}
}
Free Publicly Available Full Text
Publisher's Version of Record
Other availability
Search WorldCat to find libraries that may hold this journal
Cited by: 12 works
Citation information provided by
Web of Science
Web of Science
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
A Bayesian method for using simulator data to enhance human error probabilities assigned by existing HRA methods
journal, August 2014
- Groth, Katrina M.; Smith, Curtis L.; Swiler, Laura P.
- Reliability Engineering & System Safety, Vol. 128
A Bayesian approach to treat expert-elicited probabilities in human reliability analysis model construction
journal, September 2013
- Podofillini, L.; Dang, V. N.
- Reliability Engineering & System Safety, Vol. 117
Considerations on the elements of quantifying human reliability
journal, February 2004
- Sträter, Oliver
- Reliability Engineering & System Safety, Vol. 83, Issue 2
The use of empirical data sources in HRA
journal, February 2004
- Hallbert, Bruce; Gertman, David; Lois, Erasmia
- Reliability Engineering & System Safety, Vol. 83, Issue 2
CORE-DATA: a computerised human error database for human reliability support
conference, January 1997
- Kirwan, B.; Basra, G.; Taylor-Adams, S. E.
- Global Perpectives of Human Factors in Power Generation. Proceeding of the 1997 IEEE Sixth Conference on Human Factors and Power Plants, Proceedings of the 1997 IEEE Sixth Conference on Human Factors and Power Plants, 1997. 'Global Perspectives of Human Factors in Power Generation'
OPERA—a human performance database under simulated emergencies of nuclear power plants
journal, April 2007
- Park, Jinkyun; Jung, Wondea
- Reliability Engineering & System Safety, Vol. 92, Issue 4
Macrocognition
journal, May 2003
- Klein, G.; Ross, K. G.; Moon, B. M.
- IEEE Intelligent Systems, Vol. 18, Issue 3
The IDA cognitive model for the analysis of nuclear power plant operator response under accident conditions. Part I: problem solving and decision making model
journal, January 1997
- Smidts, C.; Shen, S. H.; Mosleh, A.
- Reliability Engineering & System Safety, Vol. 55, Issue 1
On the way to assess errors of commission
journal, February 2004
- Sträter, Oliver; Dang, Vinh; Kaufer, Barry
- Reliability Engineering & System Safety, Vol. 83, Issue 2
Assessment of human reliability based on evaluation of plant experience: requirements and implementation
journal, February 1999
- Sträter, Oliver; Bubb, Heiner
- Reliability Engineering & System Safety, Vol. 63, Issue 2
Analysis of gross error rates in operation of commercial nuclear power stations
journal, April 1979
- Joos, David W.; Sabri, Zeinab A.; Husseiny, Abdo A.
- Nuclear Engineering and Design, Vol. 52, Issue 2
Human error data banks
journal, January 1990
- Dhillon, B. S.
- Microelectronics Reliability, Vol. 30, Issue 5
Analysis of Problems in Routine Controller-Pilot Communication
journal, October 1993
- Morrow, Daniel; Lee, Alfred; Rodvold, Michelle
- The International Journal of Aviation Psychology, Vol. 3, Issue 4
Human error probabilities from operational experience of German nuclear power plants
journal, January 2013
- Preischl, Wolfgang; Hellmich, Mario
- Reliability Engineering & System Safety, Vol. 109
The SACADA database for human reliability and human performance
journal, May 2014
- James Chang, Y.; Bley, Dennis; Criscione, Lawrence
- Reliability Engineering & System Safety, Vol. 125
Works referencing / citing this record:
BAYES-HEP: Bayesian belief networks for estimation of human error probability
journal, September 2017
- Karthick, M.; Senthil Kumar, C.; Paul Robert, T.
- Life Cycle Reliability and Safety Engineering, Vol. 6, Issue 3
Combined Effect of Multiple Performance Shaping Factors on Human Reliability: Multiplicative or Additive?
journal, November 2019
- Liu, Peng; Liu, Jinting
- International Journal of Human–Computer Interaction, Vol. 36, Issue 9