Search Menu
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information
Search Scholarly Publications

Title: Compression-based integral curve data reuse framework for flow visualization

Abstract

Currently, by default, integral curves are repeatedly re-computed in different flow visualization applications, such as FTLE field computation, source-destination queries, etc., leading to unnecessary resource cost. We present a compression-based data reuse framework for integral curves, to greatly reduce their retrieval cost, especially in a resource-limited environment. In our design, a hierarchical and hybrid compression scheme is proposed to balance three objectives, including high compression ratio, controllable error, and low decompression cost. Specifically, we use and combine digitized curve sparse representation, floating-point data compression, and octree space partitioning to adaptively achieve the objectives. Results have shown that our data reuse framework could acquire tens of times acceleration in the resource-limited environment compared to on-the-fly particle tracing, and keep controllable information loss. Moreover, our method could provide fast integral curve retrieval for more complex data, such as unstructured mesh data.

Authors:
ORCiD logo [1];  [2];  [3];  [4];  [1]
+ Show Author Affiliations
  1. Peking Univ., Beijing (China). Key Lab. of Machine Perception (Ministry of Education), and School of EECS
  2. Tianjin Univ., Tianjin (China). School of Software
  3. Argonne National Lab. (ANL), Argonne, IL (United States). Mathematics and Computer Science Division
  4. Kyushu Univ. (Japan). Research Inst. for Information Technology; RIKEN, Kobe (Japan). Advanced Inst. for Computational Science
Publication Date:
Research Org.:
Argonne National Laboratory (ANL), Argonne, IL (United States)
Sponsoring Org.:
National Natural Science Foundation of China (NSFC); Chinese Academy of Sciences (CAS); USDOE
OSTI Identifier:
1421954
Grant/Contract Number:  
AC02-06CH11357; XDA05040205
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Visualization
Additional Journal Information:
Journal Volume: 20; Journal Issue: 4; Journal ID: ISSN 1343-8875
Publisher:
Springer Nature
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; data compression; flow lines; flow visualization; high performance visualization; information retrieval; integral curves

Citation Formats

Hong, Fan, Bi, Chongke, Guo, Hanqi, Ono, Kenji, and Yuan, Xiaoru. Compression-based integral curve data reuse framework for flow visualization. United States: N. p., 2017. Web. doi:10.1007/s12650-017-0428-4.
Copy to clipboard
Hong, Fan, Bi, Chongke, Guo, Hanqi, Ono, Kenji, & Yuan, Xiaoru. Compression-based integral curve data reuse framework for flow visualization. United States. https://doi.org/10.1007/s12650-017-0428-4
Copy to clipboard
Hong, Fan, Bi, Chongke, Guo, Hanqi, Ono, Kenji, and Yuan, Xiaoru. Sat . "Compression-based integral curve data reuse framework for flow visualization". United States. https://doi.org/10.1007/s12650-017-0428-4. https://www.osti.gov/servlets/purl/1421954.
Copy to clipboard
@article{osti_1421954,
title = {Compression-based integral curve data reuse framework for flow visualization},
author = {Hong, Fan and Bi, Chongke and Guo, Hanqi and Ono, Kenji and Yuan, Xiaoru},
abstractNote = {Currently, by default, integral curves are repeatedly re-computed in different flow visualization applications, such as FTLE field computation, source-destination queries, etc., leading to unnecessary resource cost. We present a compression-based data reuse framework for integral curves, to greatly reduce their retrieval cost, especially in a resource-limited environment. In our design, a hierarchical and hybrid compression scheme is proposed to balance three objectives, including high compression ratio, controllable error, and low decompression cost. Specifically, we use and combine digitized curve sparse representation, floating-point data compression, and octree space partitioning to adaptively achieve the objectives. Results have shown that our data reuse framework could acquire tens of times acceleration in the resource-limited environment compared to on-the-fly particle tracing, and keep controllable information loss. Moreover, our method could provide fast integral curve retrieval for more complex data, such as unstructured mesh data.},
doi = {10.1007/s12650-017-0428-4},
journal = {Journal of Visualization},
number = 4,
volume = 20,
place = {United States},
year = {Sat May 20 00:00:00 EDT 2017},
month = {Sat May 20 00:00:00 EDT 2017}
}
Copy to clipboard
Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1007/s12650-017-0428-4
Copyright Statement
Other availability
Search WorldCat Search WorldCat to find libraries that may hold this journal
Citation Metrics:
Cited by: 4 works
Citation information provided by
Web of Science
Save / Share:
Export Metadata
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.

Works referenced in this record:

Distinguished material surfaces and coherent structures in three-dimensional fluid flows
journal, March 2001

Adaptive Refinement of the Flow Map Using Sparse Samples
journal, December 2013

  • Barakat, Samer S.; Tricoche, Xavier
  • IEEE Transactions on Visualization and Computer Graphics, Vol. 19, Issue 12
  • DOI: 10.1109/TVCG.2013.128

Efficient Computation and Visualization of Coherent Structures in Fluid Flow Applications
journal, November 2007

  • Garth, Christoph; Gerhardt, Florian; Tricoche, Xavier
  • IEEE Transactions on Visualization and Computer Graphics, Vol. 13, Issue 6
  • DOI: 10.1109/TVCG.2007.70551

Fast Lossless Compression of Scientific Floating-Point Data
conference, January 2006

  • Ratanaworabhan, P.; Ke, J.; Burtscher, M.
  • Data Compression Conference (DCC'06)
  • DOI: 10.1109/DCC.2006.35

Interactive terascale particle visualization
conference, January 2004

Coupled Ensemble Flow Line Advection and Analysis
journal, December 2013

  • Hanqi Guo,
  • IEEE Transactions on Visualization and Computer Graphics, Vol. 19, Issue 12
  • DOI: 10.1109/TVCG.2013.144

Imaging vector fields using line integral convolution
conference, January 1993

  • Cabral, Brian; Leedom, Leith Casey
  • Proceedings of the 20th annual conference on Computer graphics and interactive techniques - SIGGRAPH '93
  • DOI: 10.1145/166117.166151

Comparative Visual Analysis of Lagrangian Transport in CFD Ensembles
journal, December 2013

  • Hummel, Mathias; Obermaier, Harald; Garth, Christoph
  • IEEE Transactions on Visualization and Computer Graphics, Vol. 19, Issue 12
  • DOI: 10.1109/TVCG.2013.141

Simplified parallel domain traversal
conference, January 2011

  • Kendall, Wesley; Wang, Jingyuan; Allen, Melissa
  • Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '11
  • DOI: 10.1145/2063384.2063397

An Algorithm for Automatically Fitting Digitized Curves
book, January 1990

Interpolation-Based Pathline Tracing in Particle-Based Flow Visualization
journal, January 2015

  • Chandler, Jennifer; Obermaier, Harald; Joy, Kenneth I.
  • IEEE Transactions on Visualization and Computer Graphics, Vol. 21, Issue 1
  • DOI: 10.1109/TVCG.2014.2325043

Improved post hoc flow analysis via Lagrangian representations
conference, November 2014

  • Agranovsky, Alexy; Camp, David; Garth, Christoph
  • 2014 IEEE 4th Symposium on Large Data Analysis and Visualization (LDAV)
  • DOI: 10.1109/LDAV.2014.7013206

Parallel particle advection and FTLE computation for time-varying flow fields
conference, November 2012

  • Nouanesengsy, Boonthanome; Lee, Teng-Yok; Lu, Kewei
  • 2012 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis
  • DOI: 10.1109/SC.2012.93

Scalable computation of streamlines on very large datasets
conference, January 2009

  • Pugmire, Dave; Childs, Hank; Garth, Christoph
  • Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis - SC '09
  • DOI: 10.1145/1654059.1654076

Load-Balanced Parallel Streamline Generation on Large Scale Vector Fields
journal, December 2011

  • Nouanesengsy, B.
  • IEEE Transactions on Visualization and Computer Graphics, Vol. 17, Issue 12
  • DOI: 10.1109/TVCG.2011.219

Distributed parallel particle advection using work requesting
conference, October 2013

  • Muller, Cornelius; Camp, David; Hentschel, Bernd
  • 2013 IEEE Symposium on Large-Scale Data Analysis and Visualization (LDAV)
  • DOI: 10.1109/LDAV.2013.6675152

FLDA: Latent Dirichlet Allocation Based Unsteady Flow Analysis
journal, December 2014

  • Hong, Fan; Lai, Chufan; Guo, Hanqi
  • IEEE Transactions on Visualization and Computer Graphics, Vol. 20, Issue 12
  • DOI: 10.1109/TVCG.2014.2346416

An Adaptive Prediction-Based Approach to Lossless Compression of Floating-Point Volume Data
journal, December 2012

  • Fout, Nathaniel; Ma, Kwan-Liu
  • IEEE Transactions on Visualization and Computer Graphics, Vol. 18, Issue 12
  • DOI: 10.1109/TVCG.2012.194

Advection-Based Sparse Data Management for Visualizing Unsteady Flow
journal, December 2014

  • Guo, Hanqi; Zhang, Jiang; Liu, Richen
  • IEEE Transactions on Visualization and Computer Graphics, Vol. 20, Issue 12
  • DOI: 10.1109/TVCG.2014.2346418

Fixed-Rate Compressed Floating-Point Arrays
journal, December 2014

  • Lindstrom, Peter
  • IEEE Transactions on Visualization and Computer Graphics, Vol. 20, Issue 12
  • DOI: 10.1109/TVCG.2014.2346458

Time and Streak Surfaces for Flow Visualization in Large Time-Varying Data Sets
journal, November 2009

  • Krishnan, H.; Garth, C.; Joy, K.
  • IEEE Transactions on Visualization and Computer Graphics, Vol. 15, Issue 6
  • DOI: 10.1109/TVCG.2009.190

Generation of Accurate Integral Surfaces in Time-Dependent Vector Fields
journal, November 2008

  • Garth, C.; Krishnan, H.; Tricoche, X.
  • IEEE Transactions on Visualization and Computer Graphics, Vol. 14, Issue 6
  • DOI: 10.1109/TVCG.2008.133

Hierarchical Line Integration
journal, August 2011

  • Hlawatsch, M.; Sadlo, F.; Weiskopf, D.
  • IEEE Transactions on Visualization and Computer Graphics, Vol. 17, Issue 8
  • DOI: 10.1109/TVCG.2010.227

Lossless compression of predicted floating-point geometry
journal, July 2005

A flow-guided file layout for out-of-core streamline computation
conference, February 2012

Parallel stream surface computation for large data sets
conference, October 2012

  • Camp, David; Childs, Hank; Garth, Christoph
  • 2012 IEEE Symposium on Large Data Analysis and Visualization (LDAV)
  • DOI: 10.1109/LDAV.2012.6378974

Scalable Computation of Stream Surfaces on Large Scale Vector Fields
conference, November 2014

  • Lu, Kewei; Shen, Han-Wei; Peterka, Tom
  • SC14: International Conference for High Performance Computing, Networking, Storage and Analysis
  • DOI: 10.1109/SC.2014.87

JPEG2000 Compliant Lossless Coding of Floating Point Data
conference, January 2005

    Sort by:
    [ × clear filter / sort ]

    Works referencing / citing this record:

    Uncertainty Visualization of Transport Variance in a Time-Varying Ensemble Vector Field
    journal, January 2020

    • Ren, Ke; Qu, Dezhan; Xu, Shaobin
    • ISPRS International Journal of Geo-Information, Vol. 9, Issue 1
    • DOI: 10.3390/ijgi9010019
      Sort by:
      [ × clear filter / sort ]

      Similar Records in DOE PAGES and OSTI.GOV collections: