skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: MultiFacet: A Faceted Interface for Browsing Large Multimedia Collections

Abstract

Faceted browsing is a common technique for exploring collections where the data can be grouped into a number of pre-defined categories, most often generated from textual metadata. Historically, faceted browsing has been applied to a single data type such as text or image data. However, typical collections contain multiple data types, such as information from web pages that contain text, images, and video. Additionally, when browsing a collection of images and video, facets are often created based on the metadata which may be incomplete, inaccurate, or missing altogether instead of the actual visual content contained within those images and video. In this work we address these limitations by presenting MultiFacet, a faceted browsing interface that supports multiple data types. MultiFacet constructs facets for images and video in a collection from the visual content using computer vision techniques. These visual facets can then be browsed in conjunction with text facets within a single interface to reveal relationships and phenomena within multimedia collections. Additionally, we present a use case based on real-world data, demonstrating the utility of this approach towards browsing a large multimedia data collection.

Authors:
; ; ; ;
Publication Date:
Research Org.:
Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1178901
Report Number(s):
PNNL-SA-97349
DOE Contract Number:  
AC05-76RL01830
Resource Type:
Conference
Resource Relation:
Conference: IEEE International Symposium on Multimedia (ISM2013), December 9-11, 2013, Anaheim, California, 347 - 350
Country of Publication:
United States
Language:
English
Subject:
Visual Analytics; content-based image retrieval; image classification; faceted search; visualization; multimedia

Citation Formats

Henry, Michael J., Hampton, Shawn D., Endert, Alexander, Roberts, Ian E., and Payne, Deborah A. MultiFacet: A Faceted Interface for Browsing Large Multimedia Collections. United States: N. p., 2013. Web. doi:10.1109/ISM.2013.66.
Henry, Michael J., Hampton, Shawn D., Endert, Alexander, Roberts, Ian E., & Payne, Deborah A. MultiFacet: A Faceted Interface for Browsing Large Multimedia Collections. United States. https://doi.org/10.1109/ISM.2013.66
Henry, Michael J., Hampton, Shawn D., Endert, Alexander, Roberts, Ian E., and Payne, Deborah A. 2013. "MultiFacet: A Faceted Interface for Browsing Large Multimedia Collections". United States. https://doi.org/10.1109/ISM.2013.66.
@article{osti_1178901,
title = {MultiFacet: A Faceted Interface for Browsing Large Multimedia Collections},
author = {Henry, Michael J. and Hampton, Shawn D. and Endert, Alexander and Roberts, Ian E. and Payne, Deborah A.},
abstractNote = {Faceted browsing is a common technique for exploring collections where the data can be grouped into a number of pre-defined categories, most often generated from textual metadata. Historically, faceted browsing has been applied to a single data type such as text or image data. However, typical collections contain multiple data types, such as information from web pages that contain text, images, and video. Additionally, when browsing a collection of images and video, facets are often created based on the metadata which may be incomplete, inaccurate, or missing altogether instead of the actual visual content contained within those images and video. In this work we address these limitations by presenting MultiFacet, a faceted browsing interface that supports multiple data types. MultiFacet constructs facets for images and video in a collection from the visual content using computer vision techniques. These visual facets can then be browsed in conjunction with text facets within a single interface to reveal relationships and phenomena within multimedia collections. Additionally, we present a use case based on real-world data, demonstrating the utility of this approach towards browsing a large multimedia data collection.},
doi = {10.1109/ISM.2013.66},
url = {https://www.osti.gov/biblio/1178901}, journal = {},
number = ,
volume = ,
place = {United States},
year = {Thu Oct 31 00:00:00 EDT 2013},
month = {Thu Oct 31 00:00:00 EDT 2013}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: