skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Bridging cognitive gaps between user and model in interactive dimension reduction

Journal Article · · Visual Informatics
 [1]; ORCiD logo [2];  [3];  [1];  [1]
  1. Virginia Polytechnic Inst. and State Univ. (Virginia Tech), Blacksburg, VA (United States). Computer Science
  2. Virginia Polytechnic Inst. and State Univ. (Virginia Tech), Blacksburg, VA (United States). Computer Science; Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
  3. Virginia Polytechnic Inst. and State Univ. (Virginia Tech), Blacksburg, VA (United States). Statistics

Interactive machine learning (ML) systems are difficult to design because of the "Two Black Boxes" problem that exists at the interface between human and machine. Many algorithms that are used in interactive ML systems are black boxes that are presented to users, while the human cognition represents a second black box that can be difficult for the algorithm to interpret. These two black boxes create cognitive gaps between the user and the interactive ML model when a user interacts with the system. In this paper, we identify several cognitive gaps that exist in a previously-developed interactive visual analytics (VA) system, Andromeda. These cognitive gaps that we are addressing in Andromeda are representative of common problems in other VA systems. Our goal with this work is to open both black boxes and bridge these cognitive gaps by making improvements to the original Andromeda system, including designing new visual features to help people better understand how Andromeda processes and interacts with data and improving the underlying algorithm so that the Andromeda system can better understand the intent of the user during the data exploration process. We evaluate our designs through both qualitative and quantitative analysis (i.e., user study and simulation analysis), and the results confirm that the improved Andromeda system outperforms the original version significantly in a series of high-dimensional data understanding tasks.

Research Organization:
Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
Sponsoring Organization:
USDOE
Grant/Contract Number:
AC05-76RL01830
OSTI ID:
1785627
Report Number(s):
PNNL-SA-157445
Journal Information:
Visual Informatics, Vol. 5, Issue 2; ISSN 2468-502X
Publisher:
Elsevier - Zhejiang University PressCopyright Statement
Country of Publication:
United States
Language:
English

References (24)

DimReader: Axis lines that explain non-linear projections journal January 2019
Generalized biplots for stress-based multidimensionally scaled projections journal December 2018
Semantic Interaction for Sensemaking: Inferring Analytical Reasoning for Model Steering journal December 2012
Dust & Magnet: Multivariate Information Visualization Using a Magnet Metaphor journal June 2005
Principles of Explanatory Debugging to Personalize Interactive Machine Learning
  • Kulesza, Todd; Burnett, Margaret; Wong, Weng-Keen
  • IUI'15: IUI'15 20th International Conference on Intelligent User Interfaces, Proceedings of the 20th International Conference on Intelligent User Interfaces https://doi.org/10.1145/2678025.2701399
conference March 2015
Visualizing distortions and recovering topology in continuous projection techniques journal March 2007
Be the Data: Embodied Visual Analytics journal January 2018
Vectorized Radviz and Its Application to Multiple Cluster Datasets journal November 2008
SIRIUS: Dual, Symmetric, Interactive Dimension Reductions journal January 2019
An interactive biplot implementation in R for modeling genotype-by-environment interaction journal November 2013
Visual to Parametric Interaction (V2PI) journal March 2013
Interactive Artificial Intelligence: Designing for the "Two Black Boxes" Problem journal August 2020
ASK-GraphView: A Large Scale Graph Visualization System journal September 2006
Bridging the gap between user intention and model parameters for human-in-the-loop data analytics conference January 2016
Simultaneous interaction with dimension reduction and clustering projections
  • Wenskovitch, John; Dowling, Michelle; North, Chris
  • IUI '19: 24th International Conference on Intelligent User Interfaces, Proceedings of the 24th International Conference on Intelligent User Interfaces: Companion https://doi.org/10.1145/3308557.3308718
conference March 2019
An Examination of Grouping and Spatial Organization Tasks for High-Dimensional Data Exploration journal February 2021
Observation-Level and Parametric Interaction for High-Dimensional Data Analysis
  • Self, Jessica Zeitz; Dowling, Michelle; Wenskovitch, John
  • ACM Transactions on Interactive Intelligent Systems, Vol. 8, Issue 2 https://doi.org/10.1145/3158230
journal July 2018
Design Study of LineSets, a Novel Set Visualization Technique journal December 2011
Semantic interaction for visual text analytics conference January 2012
Probing Projections: Interaction Techniques for Interpreting Arrangements and Errors of Dimensionality Reductions journal January 2016
Student's Attitude towards Statistics Course journal January 2011
Interactive visual clustering conference January 2007
Interactive Biplot Construction journal January 2005
How to Use t-SNE Effectively journal October 2016