Out-of-core Compression and Decompression of Large n-dimensional Scalar Fields

Conference · Mon Feb 03 00:00:00 EST 2003

DOI:https://doi.org/10.1111/1467-8659.00681· OSTI ID:15004618

Ibarria, L; Lindstrom, P; Rossignac, J; Szymczak, A

We present a simple method for compressing very large and regularly sampled scalar fields. Our method is particularly attractive when the entire data set does not fit in memory and when the sampling rate is high relative to the feature size of the scalar field in all dimensions. Although we report results for R{sup 3} and R{sup 4} data sets, the proposed approach may be applied to higher dimensions. The method is based on the new Lorenzo predictor, introduced here, which estimates the value of the scalar field at each sample from the values at processed neighbors. The predicted values are exact when the n-dimensional scalar field is an implicit polynomial of degree n-1. Surprisingly, when the residuals (differences between the actual and predicted values) are encoded using arithmetic coding, the proposed method often outperforms wavelet compression in an L{infinity} sense. The proposed approach may be used both for lossy and lossless compression and is well suited for out-of-core compression and decompression, because a trivial implementation, which sweeps through the data set reading it once, requires maintaining only a small buffer in core memory, whose size barely exceeds a single n-1 dimensional slice of the data.

• Research Organization: Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
• Sponsoring Organization: US Department of Energy (US)
• DOE Contract Number: W-7405-ENG-48
• OSTI ID: 15004618
• Report Number(s): UCRL-JC-151934; TRN: US200320%%245
• Resource Relation: Journal Volume: 22; Journal Issue: 3; Conference: Eurographics 2003, Granada (ES), 09/01/2003--09/06/2003; Other Information: PDF-FILE: 9 ; SIZE: 0.7 MBYTES; PBD: 3 Feb 2003
• Country of Publication: United States
• Language: English

Related Subjects

99 GENERAL AND MISCELLANEOUS//MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE
BUFFERS
COMPRESSION
DIMENSIONS
IMPLEMENTATION
POLYNOMIALS
SAMPLING
SCALAR FIELDS