Quantifying similarity in reliability surfaces using the probability of agreement
Abstract
When separate populations exhibit similar reliability as a function of multiple explanatory variables, combining them into a single population is tempting. This can simplify future predictions and reduce uncertainty associated with estimation. However, combining these populations may introduce bias if the underlying relationships are in fact different. The probability of agreement formally and intuitively quantifies the similarity of estimated reliability surfaces across a two-factor input space. An example from the reliability literature demonstrates the utility of the approach when deciding whether to combine two populations or to keep them as distinct. As a result, new graphical summaries provide strategies for visualizing the results.
- Authors:
-
[2]
- Univ. of San Francisco, San Francisco, CA (United States)
- Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
- Publication Date:
- Research Org.:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1352375
- Report Number(s):
- LA-UR-16-28976
Journal ID: ISSN 0898-2112
- Grant/Contract Number:
- AC52-06NA25396
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Quality Engineering
- Additional Journal Information:
- Journal Volume: 29; Journal Issue: 3; Journal ID: ISSN 0898-2112
- Publisher:
- American Society for Quality Control
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING; Mathematics
Citation Formats
Stevens, Nathaniel T., and Anderson-Cook, Christine Michaela. Quantifying similarity in reliability surfaces using the probability of agreement. United States: N. p., 2017.
Web. doi:10.1080/08982112.2017.1312004.
Stevens, Nathaniel T., & Anderson-Cook, Christine Michaela. Quantifying similarity in reliability surfaces using the probability of agreement. United States. https://doi.org/10.1080/08982112.2017.1312004
Stevens, Nathaniel T., and Anderson-Cook, Christine Michaela. Thu .
"Quantifying similarity in reliability surfaces using the probability of agreement". United States. https://doi.org/10.1080/08982112.2017.1312004. https://www.osti.gov/servlets/purl/1352375.
@article{osti_1352375,
title = {Quantifying similarity in reliability surfaces using the probability of agreement},
author = {Stevens, Nathaniel T. and Anderson-Cook, Christine Michaela},
abstractNote = {When separate populations exhibit similar reliability as a function of multiple explanatory variables, combining them into a single population is tempting. This can simplify future predictions and reduce uncertainty associated with estimation. However, combining these populations may introduce bias if the underlying relationships are in fact different. The probability of agreement formally and intuitively quantifies the similarity of estimated reliability surfaces across a two-factor input space. An example from the reliability literature demonstrates the utility of the approach when deciding whether to combine two populations or to keep them as distinct. As a result, new graphical summaries provide strategies for visualizing the results.},
doi = {10.1080/08982112.2017.1312004},
journal = {Quality Engineering},
number = 3,
volume = 29,
place = {United States},
year = {Thu Mar 30 00:00:00 EDT 2017},
month = {Thu Mar 30 00:00:00 EDT 2017}
}
Free Publicly Available Full Text
Publisher's Version of Record
Other availability
Search WorldCat to find libraries that may hold this journal
Cited by: 8 works
Citation information provided by
Web of Science
Web of Science
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
The difference between “equivalent” and “not different”
journal, October 2015
- Anderson-Cook, Christine M.; Borror, Connie M.
- Quality Engineering, Vol. 28, Issue 3
Improving Reliability Understanding Through Estimation and Prediction with Usage Information
journal, June 2015
- Lu, Lu; Anderson-Cook, Christine M.
- Quality Engineering, Vol. 27, Issue 3
Beyond the t-Test: Statistical Equivalence Testing
journal, June 2005
- Limentani, Giselle B.; Ringo, Moira C.; Ye, Feng
- Analytical Chemistry, Vol. 77, Issue 11
Comparing heteroscedastic measurement systems with the probability of agreement
journal, May 2017
- Stevens, Nathaniel T.; Steiner, Stefan H.; MacKay, R. Jock
- Statistical Methods in Medical Research, Vol. 27, Issue 11
Design and Analysis of Method Equivalence Studies
journal, December 2009
- Borman, Phil J.; Chatfield, Marion J.; Damjanov, Ivana
- Analytical Chemistry, Vol. 81, Issue 24
Equivalence and Noninferiority Tests for Quality, Manufacturing and Test Engineers
journal, October 2014
- Szarka, John L.
- Journal of Quality Technology, Vol. 46, Issue 4
An Overview on Assessing Agreement with Continuous Measurements
journal, July 2007
- Barnhart, Huiman X.; Haber, Michael J.; Lin, Lawrence I.
- Journal of Biopharmaceutical Statistics, Vol. 17, Issue 4
Statistical Techniques For Comparing Measurers And Methods Of Measurement: A Critical Review
journal, July 2002
- Ludbrook, John
- Clinical and Experimental Pharmacology and Physiology, Vol. 29, Issue 7
Evolution of reliability engineering discipline over the last six decades: a comprehensive review
journal, January 2007
- Bhamare, Sunil S.; Yadav, Om Prakash; Rathore, Ajay
- International Journal of Reliability and Safety, Vol. 1, Issue 4
Comparing the Reliability of Related Populations With the Probability of Agreement
journal, July 2016
- Stevens, Nathaniel T.; Anderson-Cook, Christine M.
- Technometrics, Vol. 59, Issue 3
Statistical Model Selection for Better Prediction and Discovering Science Mechanisms That Affect Reliability
journal, August 2015
- Anderson-Cook, Christine; Morzinski, Jerome; Blecker, Kenneth
- Systems, Vol. 3, Issue 3
Industrial statistics: The challenges and the research
journal, January 2016
- Steinberg, David M.
- Quality Engineering, Vol. 28, Issue 1
Assessing agreement between two measurement systems: An alternative to the limits of agreement approach
journal, September 2015
- Stevens, Nathaniel T.; Steiner, Stefan H.; MacKay, R. Jock
- Statistical Methods in Medical Research, Vol. 26, Issue 6
Reliability Meets Big Data: Opportunities and Challenges
journal, December 2013
- Meeker, William Q.; Hong, Yili
- Quality Engineering, Vol. 26, Issue 1
Measuring agreement in method comparison studies
journal, June 1999
- Bland, J. M.; Altman, D. G.
- Statistical Methods in Medical Research, Vol. 8, Issue 2
A Method for Determining Equivalence in Industrial Applications
journal, March 2002
- Richter, Scott J.; Richter, Carri
- Quality Engineering, Vol. 14, Issue 3
Measuring agreement in method comparison studies
journal, April 1999
- Bland, J. Martin; Altman, Douglas G.
- Statistical Methods in Medical Research, Vol. 8, Issue 2
Works referencing / citing this record:
Bayesian probability of predictive agreement for comparing the outcome of two separate regressions: Bayesian probability of predictive agreement for comparing the outcome of two separate regressions
journal, April 2018
- Stevens, Nathaniel T.; Rigdon, Steven E.; Anderson-Cook, Christine M.
- Quality and Reliability Engineering International, Vol. 34, Issue 6
How to Host An Effective Data Competition: Statistical Advice for Competition Design and Analysis
journal, February 2019
- Anderson‐Cook, Christine M.; Myers, Kary L.; Lu, Lu
- Statistical Analysis and Data Mining: The ASA Data Science Journal, Vol. 12, Issue 4
Bayesian probability of agreement for comparing the similarity of response surfaces
journal, April 2019
- Stevens, Nathaniel T.; Rigdon, Steven E.; Anderson-Cook, Christine M.
- Journal of Quality Technology
Design and analysis of confirmation experiments
journal, April 2019
- Stevens, Nathaniel T.; Anderson-Cook, Christine M.
- Journal of Quality Technology, Vol. 51, Issue 2