The Cognitive Effects of Machine Learning Aid in Domain-Specific and Domain-General Tasks.
Journal Article
·
· Proceedings of the Annual Hawaii International Conference on System Sciences
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
With machine learning (ML) technologies rapidly expanding to new applications and domains, users are collaborating with artificial intelligence-assisted diagnostic tools to a larger and larger extent. But what impact does ML aid have on cognitive performance, especially when the ML output is not always accurate? Here, we examined the cognitive effects of the presence of simulated ML assistance—including both accurate and inaccurate output—on two tasks (a domain-specific nuclear safeguards task and domain-general visual search task). Patterns of performance varied across the two tasks for both the presence of ML aid as well as the category of ML feedback (e.g., false alarm). These results indicate that differences such as domain could influence users’ performance with ML aid, and suggest the need to test the effects of ML output (and associated errors) in the specific context of use, especially when the stimuli of interest are vague or ill-defined
- Research Organization:
- Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)
- Sponsoring Organization:
- USDOE National Nuclear Security Administration (NNSA)
- Grant/Contract Number:
- NA0003525
- OSTI ID:
- 1894594
- Report Number(s):
- SAND2021-11316J; 699578
- Journal Information:
- Proceedings of the Annual Hawaii International Conference on System Sciences, Journal Name: Proceedings of the Annual Hawaii International Conference on System Sciences Vol. 2022; ISSN 2572-6862
- Publisher:
- University of Hawaii at Manoa LibraryCopyright Statement
- Country of Publication:
- United States
- Language:
- English
Similar Records
Effects of machine learning errors on human decision-making: manipulations of model accuracy, error types, and error importance
Assessing Cognitive Impacts of Errors from Machine Learning and Deep Learning Models: Final Report
Journal Article
·
Sun Aug 25 20:00:00 EDT 2024
· Cognitive Research: Principles and Implications
·
OSTI ID:2437809
Assessing Cognitive Impacts of Errors from Machine Learning and Deep Learning Models: Final Report
Technical Report
·
Wed Sep 01 00:00:00 EDT 2021
·
OSTI ID:1821527