skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Interpreting Black-Box Classifiers Using Instance-Level Visual Explanations

Abstract

To realize the full potential of machine learning in diverse real- world domains, it is necessary for model predictions to be readily interpretable and actionable for the human in the loop. Analysts, who are the users but not the developers of machine learning models, often do not trust a model because of the lack of transparency in associating predictions with the underlying data space. To address this problem, we propose Rivelo, a visual analytic interface that enables analysts to understand the causes behind predictions of binary classifiers by interactively exploring a set of instance-level explanations. These explanations are model-agnostic, treating a model as a black box, and they help analysts in interactively probing the high-dimensional binary data space for detecting features relevant to predictions. We demonstrate the utility of the interface with a case study analyzing a random forest model on the sentiment of Yelp reviews about doctors.

Authors:
; ; ;
Publication Date:
Research Org.:
Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1358512
Report Number(s):
PNNL-SA-124676
DOE Contract Number:  
AC05-76RL01830
Resource Type:
Conference
Resource Relation:
Conference: Proceedings of the 2nd Workshop on Human-in-the-Loop Data Analytics (HILDA 2017) May 14-19, 2017, Chicago, Illinois, Article No. 6
Country of Publication:
United States
Language:
English

Citation Formats

Tamagnini, Paolo, Krause, Josua W., Dasgupta, Aritra, and Bertini, Enrico. Interpreting Black-Box Classifiers Using Instance-Level Visual Explanations. United States: N. p., 2017. Web. doi:10.1145/3077257.3077260.
Tamagnini, Paolo, Krause, Josua W., Dasgupta, Aritra, & Bertini, Enrico. Interpreting Black-Box Classifiers Using Instance-Level Visual Explanations. United States. doi:10.1145/3077257.3077260.
Tamagnini, Paolo, Krause, Josua W., Dasgupta, Aritra, and Bertini, Enrico. Sun . "Interpreting Black-Box Classifiers Using Instance-Level Visual Explanations". United States. doi:10.1145/3077257.3077260.
@article{osti_1358512,
title = {Interpreting Black-Box Classifiers Using Instance-Level Visual Explanations},
author = {Tamagnini, Paolo and Krause, Josua W. and Dasgupta, Aritra and Bertini, Enrico},
abstractNote = {To realize the full potential of machine learning in diverse real- world domains, it is necessary for model predictions to be readily interpretable and actionable for the human in the loop. Analysts, who are the users but not the developers of machine learning models, often do not trust a model because of the lack of transparency in associating predictions with the underlying data space. To address this problem, we propose Rivelo, a visual analytic interface that enables analysts to understand the causes behind predictions of binary classifiers by interactively exploring a set of instance-level explanations. These explanations are model-agnostic, treating a model as a black box, and they help analysts in interactively probing the high-dimensional binary data space for detecting features relevant to predictions. We demonstrate the utility of the interface with a case study analyzing a random forest model on the sentiment of Yelp reviews about doctors.},
doi = {10.1145/3077257.3077260},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Sun May 14 00:00:00 EDT 2017},
month = {Sun May 14 00:00:00 EDT 2017}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: