Data Torturing and the Misuse of Statistical Tools
- Sandia National Laboratories
Statistical concepts, methods, and tools are often used in the implementation of statistical thinking. Unfortunately, statistical tools are all too often misused by not applying them in the context of statistical thinking that focuses on processes, variation, and data. The consequences of this misuse may be ''data torturing'' or going beyond reasonable interpretation of the facts due to a misunderstanding of the processes creating the data or the misinterpretation of variability in the data. In the hope of averting future misuse and data torturing, examples are provided where the application of common statistical tools, in the absence of statistical thinking, provides deceptive results by not adequately representing the underlying process and variability. For each of the examples, a discussion is provided on how applying the concepts of statistical thinking may have prevented the data torturing. The lessons learned from these examples will provide an increased awareness of the potential for many statistical methods to mislead and a better understanding of how statistical thinking broadens and increases the effectiveness of statistical tools.
- Research Organization:
- Sandia National Labs., Albuquerque, NM (US); Sandia National Labs., Livermore, CA (US)
- Sponsoring Organization:
- US Department of Energy (US)
- DOE Contract Number:
- AC04-94AL85000
- OSTI ID:
- 10185
- Report Number(s):
- SAND99-2178C
- Country of Publication:
- United States
- Language:
- English
Similar Records
Sorry, wrong number: The use and misuse of numerical facts in analysis and media reporting of energy issues
Three misuses of price elasticity in regulatory rate proceedings