The difference between “equivalent” and “not different”
Abstract
Often, experimenters wish to establish that populations of units can be considered equivalent to each other, in order to leverage improved knowledge about one population for characterizing the new population, or to establish the comparability of items. Equivalence tests have existed for many years, but their use in industry seems to have been largely restricted to biomedical applications, such as for assessing the equivalence of two drugs or protocols. We present the fundamentals of equivalence tests, compare them to traditional two-sample and ANOVA tests that are better suited to establishing differences in populations, and propose the use of a graphical summary to compare p-values across different thresholds of practically important differences.
- Authors:
-
- Los Alamos National Lab. (LANL), Los Alamos, NM (United States). Statistical Sciences Group
- Arizona State Univ., Phoenix, AZ (United States). School of Mathematical and Natural Sciences
- Publication Date:
- Research Org.:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1224047
- Report Number(s):
- LA-UR-15-20072
Journal ID: ISSN 0898-2112
- Grant/Contract Number:
- AC52-06NA25396
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Quality Engineering
- Additional Journal Information:
- Journal Volume: 2015; Journal Issue: 3; Journal ID: ISSN 0898-2112
- Publisher:
- American Society for Quality Control
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING; Mathematics
Citation Formats
Anderson-Cook, Christine M., and Borror, Connie M. The difference between “equivalent” and “not different”. United States: N. p., 2015.
Web. doi:10.1080/08982112.2015.1079918.
Anderson-Cook, Christine M., & Borror, Connie M. The difference between “equivalent” and “not different”. United States. https://doi.org/10.1080/08982112.2015.1079918
Anderson-Cook, Christine M., and Borror, Connie M. Tue .
"The difference between “equivalent” and “not different”". United States. https://doi.org/10.1080/08982112.2015.1079918. https://www.osti.gov/servlets/purl/1224047.
@article{osti_1224047,
title = {The difference between “equivalent” and “not different”},
author = {Anderson-Cook, Christine M. and Borror, Connie M.},
abstractNote = {Often, experimenters wish to establish that populations of units can be considered equivalent to each other, in order to leverage improved knowledge about one population for characterizing the new population, or to establish the comparability of items. Equivalence tests have existed for many years, but their use in industry seems to have been largely restricted to biomedical applications, such as for assessing the equivalence of two drugs or protocols. We present the fundamentals of equivalence tests, compare them to traditional two-sample and ANOVA tests that are better suited to establishing differences in populations, and propose the use of a graphical summary to compare p-values across different thresholds of practically important differences.},
doi = {10.1080/08982112.2015.1079918},
journal = {Quality Engineering},
number = 3,
volume = 2015,
place = {United States},
year = {Tue Oct 27 00:00:00 EDT 2015},
month = {Tue Oct 27 00:00:00 EDT 2015}
}
Web of Science
Works referenced in this record:
Simultaneous and selective inference: Current successes and future challenges
journal, November 2010
- Benjamini, Yoav
- Biometrical Journal, Vol. 52, Issue 6
Bioequivalence trials, intersection-union tests and equivalence confidence setsCommentCommentCommentCommentCommentRejoinder
journal, November 1996
- Berger, Roger L.; Hsu, Jason C.; Hauck, Walter W.
- Statistical Science, Vol. 11, Issue 4
Design and Analysis of Method Equivalence Studies
journal, December 2009
- Borman, Phil J.; Chatfield, Marion J.; Damjanov, Ivana
- Analytical Chemistry, Vol. 81, Issue 24
Method Validation in Pharmaceutical Analysis
book, January 2005
- Ermer, Joachim; McB. Miller, John H.
Beyond the t-Test: Statistical Equivalence Testing
journal, June 2005
- Limentani, Giselle B.; Ringo, Moira C.; Ye, Feng
- Analytical Chemistry, Vol. 77, Issue 11
A Method for Determining Equivalence in Industrial Applications
journal, March 2002
- Richter, Scott J.; Richter, Carri
- Quality Engineering, Vol. 14, Issue 3
The Status of Multiple Comparisons: Simultaneous Estimation of all Pairwise Comparisons in One-Way ANOVA Designs
journal, August 1981
- Stoline, Michael R.
- The American Statistician, Vol. 35, Issue 3
Works referencing / citing this record:
Bayesian probability of predictive agreement for comparing the outcome of two separate regressions: Bayesian probability of predictive agreement for comparing the outcome of two separate regressions
journal, April 2018
- Stevens, Nathaniel T.; Rigdon, Steven E.; Anderson-Cook, Christine M.
- Quality and Reliability Engineering International, Vol. 34, Issue 6
How to Host An Effective Data Competition: Statistical Advice for Competition Design and Analysis
journal, February 2019
- Anderson‐Cook, Christine M.; Myers, Kary L.; Lu, Lu
- Statistical Analysis and Data Mining: The ASA Data Science Journal, Vol. 12, Issue 4
Bayesian probability of agreement for comparing the similarity of response surfaces
journal, April 2019
- Stevens, Nathaniel T.; Rigdon, Steven E.; Anderson-Cook, Christine M.
- Journal of Quality Technology