skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Exploiting Data Parallelism in the Image Content Engine

Abstract

The Image Content Engine (ICE) is a framework of software and underlying mathematical and physical models that enable scientists and analysts to extract features from Terabytes of imagery and search the extracted features for content relevant to their problem domain. The ICE team has developed a set of tools for feature extraction and analysis of image data, primarily based on the image content. The scale and volume of imagery that must be searched presents a formidable computation and data bandwidth challenge, and a search of moderate to large scale imagery quickly becomes intractable without exploiting high degrees of data parallelism in the feature extraction engine. In this paper we describe the software and hardware architecture developed to build a data parallel processing engine for ICE. We discuss our highly tunable parallel process and job scheduling subsystem, remote procedure invocation, parallel I/O strategy, and our experience in running ICE on a 16 node, 32 processing element (CPU) Linux Cluster. We present performance and benchmark results, and describe how we obtain excellent speedup for the imagery searches in our test-bed prototype.

Authors:
; ; ;
Publication Date:
Research Org.:
Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
889965
Report Number(s):
UCRL-CONF-219867
TRN: US200620%%170
DOE Contract Number:
W-7405-ENG-48
Resource Type:
Conference
Resource Relation:
Conference: Presented at: SPIE Defense and Security Symposium, Kissimmee, FL, United States, Apr 17 - Apr 21, 2006
Country of Publication:
United States
Language:
English
Subject:
99 GENERAL AND MISCELLANEOUS//MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE; ARCHITECTURE; BENCHMARKS; ENGINES; PARALLEL PROCESSING; PERFORMANCE; PROCESSING; SECURITY

Citation Formats

Miller, W M, Garlick, J E, Weinert, G F, and Abdulla, G M. Exploiting Data Parallelism in the Image Content Engine. United States: N. p., 2006. Web.
Miller, W M, Garlick, J E, Weinert, G F, & Abdulla, G M. Exploiting Data Parallelism in the Image Content Engine. United States.
Miller, W M, Garlick, J E, Weinert, G F, and Abdulla, G M. Thu . "Exploiting Data Parallelism in the Image Content Engine". United States. doi:. https://www.osti.gov/servlets/purl/889965.
@article{osti_889965,
title = {Exploiting Data Parallelism in the Image Content Engine},
author = {Miller, W M and Garlick, J E and Weinert, G F and Abdulla, G M},
abstractNote = {The Image Content Engine (ICE) is a framework of software and underlying mathematical and physical models that enable scientists and analysts to extract features from Terabytes of imagery and search the extracted features for content relevant to their problem domain. The ICE team has developed a set of tools for feature extraction and analysis of image data, primarily based on the image content. The scale and volume of imagery that must be searched presents a formidable computation and data bandwidth challenge, and a search of moderate to large scale imagery quickly becomes intractable without exploiting high degrees of data parallelism in the feature extraction engine. In this paper we describe the software and hardware architecture developed to build a data parallel processing engine for ICE. We discuss our highly tunable parallel process and job scheduling subsystem, remote procedure invocation, parallel I/O strategy, and our experience in running ICE on a 16 node, 32 processing element (CPU) Linux Cluster. We present performance and benchmark results, and describe how we obtain excellent speedup for the imagery searches in our test-bed prototype.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Thu Mar 09 00:00:00 EST 2006},
month = {Thu Mar 09 00:00:00 EST 2006}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: