Multi-criteria decision analysis: Limitations, pitfalls, and practical difficulties
The 2002 Winter Olympics women's figure skating competition is used as a case study to illustrate some of the limitations, pitfalls, and practical difficulties of Multi-Criteria Decision Analysis (MCDA). The paper compares several widely used models for synthesizing the multiple attributes into a single aggregate value. The various MCDA models can provide conflicting rankings of the alternatives for a common set of information even under states of certainty. Analysts involved in MCDA need to deal with the following challenging tasks: (1) selecting an appropriate analysis method, and (2) properly interpreting the results. An additional trap is the availability of software tools that implement specific MCDA models that can beguile the user with quantitative scores. These conclusions are independent of the decision domain and they should help foster better MCDA practices in many fields including systems engineering trade studies.
- Research Organization:
- Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
- Sponsoring Organization:
- USDOE Director, Office of Science (US)
- DOE Contract Number:
- AC03-76SF00098
- OSTI ID:
- 813572
- Report Number(s):
- LBNL-52362; R&D Project: RESS01; TRN: US200316%%216
- Resource Relation:
- Conference: 13th Annual International Symposium INCOSE 2003, Washington, DC (US), 07/01/2003--07/03/2003; Other Information: PBD: 1 Feb 2003
- Country of Publication:
- United States
- Language:
- English
Similar Records
Management of complex knowledge in planning for sustainable development: The use of multi-criteria decision aids
How the code analyst can influence the calculation and use good practices to minimize pitfalls