Methodology, Methods, and Metrics for Testing and Evaluating Augmented Cognition Systems
Book
·
OSTI ID:965593
The augmented cognition research community seeks cognitive neuroscience-based solutions to improve warfighter performance by applying and managing mitigation strategies to reduce workload and improve the throughput and quality of decisions. The focus of augmented cognition mitigation research is to define, demonstrate, and exploit neuroscience and behavioral measures that support inferences about the warfighter’s cognitive state that prescribe the nature and timing of mitigation. A research challenge is to develop valid evaluation methodologies, metrics and measures to assess the impact of augmented cognition mitigations. Two considerations are external validity, which is the extent to which the results apply to operational contexts; and internal validity, which reflects the reliability of performance measures and the conclusions based on analysis of results. The scientific rigor of the research methodology employed in conducting empirical investigations largely affects the validity of the findings. External validity requirements also compel us to demonstrate operational significance of mitigations. Thus it is important to demonstrate effectiveness of mitigations under specific conditions. This chapter reviews some cognitive science and methodological considerations in designing augmented cognition research studies and associated human performance metrics and analysis methods to assess the impact of augmented cognition mitigations.
- Research Organization:
- Pacific Northwest National Laboratory (PNNL), Richland, WA (US)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC05-76RL01830
- OSTI ID:
- 965593
- Report Number(s):
- PNNL-SA-53145
- Country of Publication:
- United States
- Language:
- English
Similar Records
Engineering a transformation of human-machine interaction to an augmented cognitive relationship.
Cognitive models applied to human effectiveness in national security environments (ergonomics of augmented cognition system design and application).
Extending the Reach of Augmented Cognition To Real-World Decision Making Tasks
Conference
·
Fri Jan 31 23:00:00 EST 2003
·
OSTI ID:917160
Cognitive models applied to human effectiveness in national security environments (ergonomics of augmented cognition system design and application).
Technical Report
·
Tue Jun 01 00:00:00 EDT 2004
·
OSTI ID:919203
Extending the Reach of Augmented Cognition To Real-World Decision Making Tasks
Conference
·
Mon May 02 00:00:00 EDT 2005
·
OSTI ID:892901