Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Query-driven visualization of large data sets

Conference ·
DOI:https://doi.org/10.1109/VIS.2005.84· OSTI ID:1733345
We present a practical and general-purpose approach to large and complex visual data analysis where visualization processing, rendering and subsequent human interpretation is constrained to the subset of data deemed interesting by the user. In many scientific data analysis applications, "interesting" data can be defined by compound Boolean range queries of the form (temperature > 1000) AND (70 < pressure < 90). As data sizes grow larger, a central challenge is to answer such queries as efficiently as possible. Prior work in the visualization community has focused on answering range queries for scalar fields within the context of accelerating the search phase of isosurface algorithms. In contrast, our work describes an approach that leverages state-of-the-art indexing technology from the scientific data management community called "bitmap indexing." Our implementation, which we call "DEX" (short for dextrous data explorer), uses bitmap indexing to efficiently answer multivariate, multidimensional data queries to provide input to a visualization pipeline. We present an analysis overview and bench-mark results that show bitmap indexing offers significant storage and performance improvements when compared to previous approaches for accelerating the search phase of isosurface algorithms. More importantly, since bitmap indexing supports complex multi-dimensional, multivariate range queries, it is more generally applicable to scientific data visualization and analysis problems. In addition to benchmark performance and analysis, we apply DEX to a typical scientific visualization problem encountered in combustion simulation data analysis. © 2005 IEEE.
Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
DOE Contract Number:
AC02-05CH11231
OSTI ID:
1733345
Country of Publication:
United States
Language:
English

Similar Records

HDF5-FastQuery: Accelerating Complex Queries on HDF Datasets usingFast Bitmap Indices
Conference · Wed Mar 29 23:00:00 EST 2006 · OSTI ID:881620

Parallel membership queries on very large scientific data sets using bitmap indexes
Journal Article · Sat Aug 10 00:00:00 EDT 2019 · Concurrency and Computation. Practice and Experience · OSTI ID:1503658

HDF5-FastQuery: Accelerating Complex Queries on HDF Datasets UsingFast Bitmap Indices
Conference · Tue Dec 06 23:00:00 EST 2005 · OSTI ID:881619

Related Subjects