skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: SnowPac: a multiscale cubic B-spline wavelet compressor for astronomical images

Abstract

ABSTRACT As more advanced and complex survey telescopes are developed, the size and scale of data being captured grows at increasing rates. Across various domains, data compression through wavelets has enabled the reduction of data size and increase in computation efficiency. In this paper, we provide qualitative and quantitative tests of a new wavelet-based image compression method compared against the current standard for astronomical images. The analysis is improved by making use of state-of-the-art object detection systems to accurately measure the impact of the compression. We find that a combination of lossy wavelet-based methods, efficient quantization, and lossless dictionary compressors can preserve up to 98 per cent of astronomical objects at a 10:1 compression ratio. This significant reduction in file size also preserves astronomical object properties better than existing methods. These methods help further reduce future workloads for image-heavy processing pipelines.

Authors:
 [1];  [2];  [3];  [1]
  1. Department of Computer Science, University of California, One Shields Avenue, Davis, CA 95616, USA
  2. College of Information Sciences and Technology, Northeast Normal University, 2555 Jingyue Street, Changchun 130117, China
  3. Departments of Physics and Astronomy, Haverford College, 370 Lancaster Avenue, Haverford, PA 19041, USA
Publication Date:
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA)
OSTI Identifier:
1602882
Grant/Contract Number:  
[89233218NCA000001]
Resource Type:
Published Article
Journal Name:
Monthly Notices of the Royal Astronomical Society
Additional Journal Information:
[Journal Name: Monthly Notices of the Royal Astronomical Society Journal Volume: 493 Journal Issue: 2]; Journal ID: ISSN 0035-8711
Publisher:
Oxford University Press
Country of Publication:
United Kingdom
Language:
English

Citation Formats

Pulido, Jesus, Zheng, Caixia, Thorman, Paul, and Hamann, Bernd. SnowPac: a multiscale cubic B-spline wavelet compressor for astronomical images. United Kingdom: N. p., 2020. Web. doi:10.1093/mnras/staa435.
Pulido, Jesus, Zheng, Caixia, Thorman, Paul, & Hamann, Bernd. SnowPac: a multiscale cubic B-spline wavelet compressor for astronomical images. United Kingdom. doi:10.1093/mnras/staa435.
Pulido, Jesus, Zheng, Caixia, Thorman, Paul, and Hamann, Bernd. Mon . "SnowPac: a multiscale cubic B-spline wavelet compressor for astronomical images". United Kingdom. doi:10.1093/mnras/staa435.
@article{osti_1602882,
title = {SnowPac: a multiscale cubic B-spline wavelet compressor for astronomical images},
author = {Pulido, Jesus and Zheng, Caixia and Thorman, Paul and Hamann, Bernd},
abstractNote = {ABSTRACT As more advanced and complex survey telescopes are developed, the size and scale of data being captured grows at increasing rates. Across various domains, data compression through wavelets has enabled the reduction of data size and increase in computation efficiency. In this paper, we provide qualitative and quantitative tests of a new wavelet-based image compression method compared against the current standard for astronomical images. The analysis is improved by making use of state-of-the-art object detection systems to accurately measure the impact of the compression. We find that a combination of lossy wavelet-based methods, efficient quantization, and lossless dictionary compressors can preserve up to 98 per cent of astronomical objects at a 10:1 compression ratio. This significant reduction in file size also preserves astronomical object properties better than existing methods. These methods help further reduce future workloads for image-heavy processing pipelines.},
doi = {10.1093/mnras/staa435},
journal = {Monthly Notices of the Royal Astronomical Society},
number = [2],
volume = [493],
place = {United Kingdom},
year = {2020},
month = {2}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
DOI: 10.1093/mnras/staa435

Save / Share:

Works referenced in this record:

Survey and analysis of multiresolution methods for turbulence data
journal, February 2016


Data compression in the petascale astronomy era: A GERLUMPH case study
journal, September 2015


The discrete wavelet transform: wedding the a trous and Mallat algorithms
journal, January 1992

  • Shensa, M. J.
  • IEEE Transactions on Signal Processing, Vol. 40, Issue 10
  • DOI: 10.1109/78.157290

Deep lens survey
conference, December 2002

  • Wittman, David M.; Tyson, J. Anthony; Dell'Antonio, Ian P.
  • Astronomical Telescopes and Instrumentation, SPIE Proceedings
  • DOI: 10.1117/12.457348

An improved method for object detection in astronomical images
journal, July 2015

  • Zheng, Caixia; Pulido, Jesus; Thorman, Paul
  • Monthly Notices of the Royal Astronomical Society, Vol. 451, Issue 4
  • DOI: 10.1093/mnras/stv1237

SExtractor: Software for source extraction
journal, June 1996

  • Bertin, E.; Arnouts, S.
  • Astronomy and Astrophysics Supplement Series, Vol. 117, Issue 2
  • DOI: 10.1051/aas:1996164

Enabling Near Real-Time Remote Search for Fast Transient Events with Lossy Data Compression
journal, January 2017

  • Vohl, Dany; Pritchard, Tyler; Andreoni, Igor
  • Publications of the Astronomical Society of Australia, Vol. 34
  • DOI: 10.1017/pasa.2017.34

A compression scheme for radio data in high performance computing
journal, September 2015


Predictive codebook design for lossless image compression
conference, March 1996

  • Mandyam, Giridhar D.; Ahmed, Nasir U.; Stearns, Samuel D.
  • Electronic Imaging: Science & Technology, SPIE Proceedings
  • DOI: 10.1117/12.234755

Astronomical imagery: Considerations for a contemporary approach with JPEG2000
journal, September 2015


The impact of JPEG2000 lossy compression on the scientific quality of radio astronomy imagery
journal, October 2014


A scanning microphotometer with an on-line data reduction for large field Schmidt plates
journal, January 1977


Biorthogonal bases of compactly supported wavelets
journal, June 1992

  • Cohen, A.; Daubechies, Ingrid; Feauveau, J. -C.
  • Communications on Pure and Applied Mathematics, Vol. 45, Issue 5
  • DOI: 10.1002/cpa.3160450502

An overview of the HDF5 technology suite and its applications
conference, January 2011

  • Folk, Mike; Heber, Gerd; Koziol, Quincey
  • Proceedings of the EDBT/ICDT 2011 Workshop on Array Databases - AD '11
  • DOI: 10.1145/1966895.1966900

DATA COMPRESSION FOR THE TOMO-e GOZEN USING LOW-RANK MATRIX APPROXIMATION
journal, January 2017