Effects of machine learning errors on human decision-making: manipulations of model accuracy, error types, and error importance
Journal Article
·
· Cognitive Research: Principles and Implications
- Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)
This study addressed the cognitive impacts of providing correct and incorrect machine learning (ML) outputs in support of an object detection task. The study consisted of five experiments that manipulated the accuracy and importance of mock ML outputs. In each of the experiments, participants were given the T and L task with T-shaped targets and L-shaped distractors. They were tasked with categorizing each image as target present or target absent. In Experiment 1, they performed this task without the aid of ML outputs. In Experiments 2–5, they were shown images with bounding boxes, representing the output of an ML model. The outputs could be correct (hits and correct rejections), or they could be erroneous (false alarms and misses). Experiment 2 manipulated the overall accuracy of these mock ML outputs. Experiment 3 manipulated the proportion of different types of errors. Experiments 4 and 5 manipulated the importance of specific types of stimuli or model errors, as well as the framing of the task in terms of human or model performance. These experiments showed that model misses were consistently harder for participants to detect than model false alarms. In general, as the model’s performance increased, human performance increased as well, but in many cases the participants were more likely to overlook model errors when the model had high accuracy overall. Warning participants to be on the lookout for specific types of model errors had very little impact on their performance. Overall, our results emphasize the importance of considering human cognition when determining what level of model performance and types of model errors are acceptable for a given task.
- Research Organization:
- Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)
- Sponsoring Organization:
- USDOE; USDOE Laboratory Directed Research and Development (LDRD) Program; USDOE National Nuclear Security Administration (NNSA)
- Grant/Contract Number:
- NA0003525
- OSTI ID:
- 2437809
- Alternate ID(s):
- OSTI ID: 2474792
- Report Number(s):
- SAND--2024-14429J
- Journal Information:
- Cognitive Research: Principles and Implications, Journal Name: Cognitive Research: Principles and Implications Journal Issue: 1 Vol. 9; ISSN 2365-7464
- Publisher:
- BioMed CentralCopyright Statement
- Country of Publication:
- United States
- Language:
- English
Similar Records
The Cognitive Effects of Machine Learning Aid in Domain-Specific and Domain-General Tasks.
Assessing Cognitive Impacts of Errors from Machine Learning and Deep Learning Models: Final Report
Journal Article
·
Thu Dec 23 19:00:00 EST 2021
· Proceedings of the Annual Hawaii International Conference on System Sciences
·
OSTI ID:1894594
Assessing Cognitive Impacts of Errors from Machine Learning and Deep Learning Models: Final Report
Technical Report
·
Wed Sep 01 00:00:00 EDT 2021
·
OSTI ID:1821527