ISAVS: Interactive Scalable Analysis and Visualization System
- Univ. of Utah, Salt Lake City, UT (United States); University of Utah
- Univ. of Utah, Salt Lake City, UT (United States)
- Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
Modern science is inundated with ever increasing data sizes as computational capabilities and image acquisition techniques continue to improve. For example, simulations are tackling ever larger domains with higher fidelity, and high-throughput microscopy techniques generate larger data that are fundamental to gather biologically and medically relevant insights. As the image sizes exceed memory, and even sometimes local disk space, each step in a scientific workflow is impacted. Current software solutions enable data exploration with limited interactivity for visualization and analytic tasks. Furthermore analysis on HPC systems often require complex hand-written parallel implementations of algorithms that suffer from poor portability and maintainability. We present a software infrastructure that simplifies end-to-end visualization and analysis of massive data. First, a hierarchical streaming data access layer enables interactive exploration of remote data, with fast data fetching to test analytics on subsets of the data. Second, a library simplifies the process of developing new analytics algorithms, allowing users to rapidly prototype new approaches and deploy them in an HPC setting. Third, a scalable runtime system automates mapping analysis algorithms to whatever computational hardware is available, reducing the complexity of developing scaling algorithms. Here, we demonstrate the usability and performance of our system using a use case from neuroscience: filtering, registration, and visualization of tera-scale microscopy data. We evaluate the performance of our system using a leadership-class supercomputer, Shaheen II.
- Research Organization:
- Univ. of Utah, Salt Lake City, UT (United States)
- Sponsoring Organization:
- USDOE National Nuclear Security Administration (NNSA)
- DOE Contract Number:
- NA0002375
- OSTI ID:
- 1755957
- Journal Information:
- SA '17: SIGGRAPH Asia 2017 Symposium on Visualization, Journal Name: SA '17: SIGGRAPH Asia 2017 Symposium on Visualization
- Country of Publication:
- United States
- Language:
- English
Similar Records
Scalable and Power Efficient Data Analytics for Hybrid Exascale Systems
Scalable Data-Intensive Geocomputation: A Design for Real-Time Continental Flood Inundation Mapping