The Cognitive Effects of Machine Learning Aid in Domain-Specific and Domain-General Tasks.
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
With machine learning (ML) technologies rapidly expanding to new applications and domains, users are collaborating with artificial intelligence-assisted diagnostic tools to a larger and larger extent. But what impact does ML aid have on cognitive performance, especially when the ML output is not always accurate? Here, we examined the cognitive effects of the presence of simulated ML assistance—including both accurate and inaccurate output—on two tasks (a domain-specific nuclear safeguards task and domain-general visual search task). Patterns of performance varied across the two tasks for both the presence of ML aid as well as the category of ML feedback (e.g., false alarm). These results indicate that differences such as domain could influence users’ performance with ML aid, and suggest the need to test the effects of ML output (and associated errors) in the specific context of use, especially when the stimuli of interest are vague or ill-defined
- Research Organization:
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
- Sponsoring Organization:
- USDOE National Nuclear Security Administration (NNSA)
- Grant/Contract Number:
- NA0003525
- OSTI ID:
- 1894594
- Report Number(s):
- SAND2021-11316J; 699578
- Journal Information:
- Proceedings of the Annual Hawaii International Conference on System Sciences, Vol. 2022; Conference: 55. Hawaii International Conference on System Sciences, Held Virtually, Maui, HI (United States), 4-7 Jan 2022; ISSN 2572-6862
- Publisher:
- University of Hawaii at Manoa LibraryCopyright Statement
- Country of Publication:
- United States
- Language:
- English
Similar Records
Assessing Cognitive Impacts of Errors from Machine Learning and Deep Learning Models: Final Report
Machine-learning-aided cognitive reconfiguration for flexible-bandwidth HPC and data center networks [Invited]