MultiFacet: A Faceted Interface for Browsing Large Multimedia Collections
Abstract
Faceted browsing is a common technique for exploring collections where the data can be grouped into a number of pre-defined categories, most often generated from textual metadata. Historically, faceted browsing has been applied to a single data type such as text or image data. However, typical collections contain multiple data types, such as information from web pages that contain text, images, and video. Additionally, when browsing a collection of images and video, facets are often created based on the metadata which may be incomplete, inaccurate, or missing altogether instead of the actual visual content contained within those images and video. In this work we address these limitations by presenting MultiFacet, a faceted browsing interface that supports multiple data types. MultiFacet constructs facets for images and video in a collection from the visual content using computer vision techniques. These visual facets can then be browsed in conjunction with text facets within a single interface to reveal relationships and phenomena within multimedia collections. Additionally, we present a use case based on real-world data, demonstrating the utility of this approach towards browsing a large multimedia data collection.
- Authors:
- Publication Date:
- Research Org.:
- Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1178901
- Report Number(s):
- PNNL-SA-97349
- DOE Contract Number:
- AC05-76RL01830
- Resource Type:
- Conference
- Resource Relation:
- Conference: IEEE International Symposium on Multimedia (ISM2013), December 9-11, 2013, Anaheim, California, 347 - 350
- Country of Publication:
- United States
- Language:
- English
- Subject:
- Visual Analytics; content-based image retrieval; image classification; faceted search; visualization; multimedia
Citation Formats
Henry, Michael J., Hampton, Shawn D., Endert, Alexander, Roberts, Ian E., and Payne, Deborah A. MultiFacet: A Faceted Interface for Browsing Large Multimedia Collections. United States: N. p., 2013.
Web. doi:10.1109/ISM.2013.66.
Henry, Michael J., Hampton, Shawn D., Endert, Alexander, Roberts, Ian E., & Payne, Deborah A. MultiFacet: A Faceted Interface for Browsing Large Multimedia Collections. United States. https://doi.org/10.1109/ISM.2013.66
Henry, Michael J., Hampton, Shawn D., Endert, Alexander, Roberts, Ian E., and Payne, Deborah A. 2013.
"MultiFacet: A Faceted Interface for Browsing Large Multimedia Collections". United States. https://doi.org/10.1109/ISM.2013.66.
@article{osti_1178901,
title = {MultiFacet: A Faceted Interface for Browsing Large Multimedia Collections},
author = {Henry, Michael J. and Hampton, Shawn D. and Endert, Alexander and Roberts, Ian E. and Payne, Deborah A.},
abstractNote = {Faceted browsing is a common technique for exploring collections where the data can be grouped into a number of pre-defined categories, most often generated from textual metadata. Historically, faceted browsing has been applied to a single data type such as text or image data. However, typical collections contain multiple data types, such as information from web pages that contain text, images, and video. Additionally, when browsing a collection of images and video, facets are often created based on the metadata which may be incomplete, inaccurate, or missing altogether instead of the actual visual content contained within those images and video. In this work we address these limitations by presenting MultiFacet, a faceted browsing interface that supports multiple data types. MultiFacet constructs facets for images and video in a collection from the visual content using computer vision techniques. These visual facets can then be browsed in conjunction with text facets within a single interface to reveal relationships and phenomena within multimedia collections. Additionally, we present a use case based on real-world data, demonstrating the utility of this approach towards browsing a large multimedia data collection.},
doi = {10.1109/ISM.2013.66},
url = {https://www.osti.gov/biblio/1178901},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Thu Oct 31 00:00:00 EDT 2013},
month = {Thu Oct 31 00:00:00 EDT 2013}
}