skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: The Dark Energy Survey Image Processing Pipeline

Journal Article · · Publications of the Astronomical Society of the Pacific

The Dark Energy Survey (DES) is a five-year optical imaging campaign with the goal of understanding the origin of cosmic acceleration. DES performs a ~5000 deg2 survey of the southern sky in five optical bands (g, r, i, z, Y) to a depth of ~24th magnitude. Contemporaneously, DES performs a deep, time-domain survey in four optical bands (g, r, i, z) over ~27 deg2. DES exposures are processed nightly with an evolving data reduction pipeline and evaluated for image quality to determine if they need to be retaken. Difference imaging and transient source detection are also performed in the time domain component nightly. On a bi-annual basis, DES exposures are reprocessed with a refined pipeline and coadded to maximize imaging depth. In this paper, we describe the DES image processing pipeline in support of DES science, as a reference for users of archival DES data, and as a guide for future astronomical surveys.

Research Organization:
SLAC National Accelerator Laboratory (SLAC), Menlo Park, CA (United States); Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
Sponsoring Organization:
USDOE Office of Science (SC), High Energy Physics (HEP)
Contributing Organization:
DES Collaboration
Grant/Contract Number:
AC02-76SF00515; AC02-07CH11359
OSTI ID:
1457775
Journal Information:
Publications of the Astronomical Society of the Pacific, Vol. 130, Issue 989; ISSN 0004-6280
Publisher:
Astronomical Society of the PacificCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 151 works
Citation information provided by
Web of Science

References (61)

The Seventh data Release of the Sloan Digital sky Survey journal May 2009
The Fifth Data Release of the Sloan Digital Sky Survey
  • Adelman‐McCarthy, Jennifer K.; Agueros, Marcel A.; Allam, Sahar S.
  • The Astrophysical Journal Supplement Series, Vol. 172, Issue 2 https://doi.org/10.1086/518864
journal October 2007
The brighter-fatter effect and pixel correlations in CCD sensors journal March 2014
SExtractor: Software for source extraction journal June 1996
Forward Global Photometric Calibration of the Dark Energy Survey journal December 2017
Representations of celestial coordinates in FITS journal November 2002
The 10 Meter South Pole Telescope
  • Carlstrom, J. E.; Ade, P. A. R.; Aird, K. A.
  • Publications of the Astronomical Society of the Pacific, Vol. 123, Issue 903 https://doi.org/10.1086/659879
journal May 2011
FermiGrid—experience and future plans journal July 2008
The Kilo-Degree Survey journal August 2012
0.250mm-thick CCD packaging for the Dark Energy Survey Camera array conference June 2006
The Dark Energy Survey: more than dark energy – an overview journal March 2016
The Blanco Cosmology Survey: data Acquisition, Processing, Calibration, Quality Diagnostics, and data Release journal September 2012
Detection and removal of artifacts in astronomical images journal July 2016
Use of the Hough transformation to detect lines and curves in pictures journal January 1972
Dark Energy Survey Year 1 Results: The Photometric Data Set for Cosmology journal April 2018
Focal plane detectors for Dark Energy Camera (DECam) conference July 2010
The dark Energy Camera journal October 2015
Gaia Data Release 1 : Summary of the astrometric, photometric, and survey properties journal November 2016
Automated Transient Identification in the dark Energy Survey journal August 2015
HEALPix: A Framework for High‐Resolution Discretization and Fast Analysis of Data Distributed on the Sphere journal April 2005
A 1.4-GHz survey of the southern European Large-Area ISO Survey region journal May 1999
A scheme to deal accurately and efficiently with complex angular masks in galaxy surveys journal March 2004
The readout and control system of the Dark Energy Camera conference September 2012
Principal Component Analysis book January 1986
The Pan-STARRS wide-field optical/NIR imaging survey conference July 2010
SNANA: A Public Software Package for Supernova Analysis
  • Kessler, Richard; Bernstein, Joseph P.; Cinabro, David
  • Publications of the Astronomical Society of the Pacific, Vol. 121, Issue 883 https://doi.org/10.1086/605984
journal September 2009
The Difference Imaging Pipeline for the Transient Search in the dark Energy Survey journal November 2015
The Dark Energy Survey data management system conference July 2008
The USNO-B Catalog journal February 2003
Cyber-infrastructure to support science and data management for the Dark Energy Survey conference June 2006
The XMM-LSS survey. Survey design and first results journal September 2004
The Effects of Atmospheric Turbulence in Optical Astronomy book January 1981
Maps of Dust Infrared Emission for Use in Estimation of Reddening and Cosmic Microwave Background Radiation Foregrounds journal June 1998
Practical Weak-lensing Shear Measurement with Metacalibration journal May 2017
The Two Micron All Sky Survey (2MASS) journal February 2006
Methods for rapidly processing angular masks of next-generation galaxy surveys journal July 2008
Simultaneous Multicolor Detection of Faint Galaxies in the Hubble Deep Field journal January 1999
THE CHANDRA DEEP FIELD-SOUTH SURVEY: 4 Ms SOURCE CATALOGS journal June 2011
The Sloan Digital Sky Survey: Technical Summary journal September 2000
The Fourth us Naval Observatory ccd Astrograph Catalog (Ucac4) journal January 2013
Gaia Data Release 1 : Testing parallaxes with local Cepheids and RR Lyrae stars⋆ journal September 2017
The Seventh Data Release of the Sloan Digital Sky Survey text January 2009
The Fifth Data Release of the Sloan Digital Sky Survey text January 2007
Dark Energy Survey Year 1 Results: Photometric Data Set for Cosmology text January 2018
The seventh data release of the sloan digital sky survey text January 2009
The Fifth Data Release of the Sloan Digital Sky Survey text January 2007
The Dark Energy Survey Data Management System text January 2008
The Blanco Cosmology Survey: Data Acquisition, Processing, Calibration, Quality Diagnostics and Data Release text January 2012
The Fourth US Naval Observatory CCD Astrograph Catalog (UCAC4) text January 2012
The brighter-fatter effect and pixel correlations in CCD sensors text January 2014
Characterization and correction of charge-induced pixel shifts in DECam text January 2015
Automated Transient Identification in the Dark Energy Survey text January 2015
The Dark Energy Survey: more than dark energy - an overview text January 2016
Practical Weak Lensing Shear Measurement with Metacalibration text January 2017
Forward Global Photometric Calibration of the Dark Energy Survey text January 2017
Dark Energy Survey Year 1 Results: Photometric Data Set for Cosmology text January 2017
Representations of celestial coordinates in FITS text January 2002
The XMM-LSS survey. Survey design and first results text January 2003
HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere text January 2004
Cyber-infrastructure to Support Science and Data Management for the Dark Energy Survey text January 2006
Simultaneous Multicolor Detection of Faint Galaxies in the Hubble Deep Field text January 1998

Cited By (51)

MAXIMASK and MAXITRACK: Two new tools for identifying contaminants in astronomical images using convolutional neural networks journal February 2020
A catalogue of structural and morphological measurements for DES Y1 journal July 2018
Dark Energy Survey year 1 results: galaxy sample for BAO measurement journal September 2018
Superluminous supernovae from the Dark Energy Survey journal May 2019
Measurement of the splashback feature around SZ-selected Galaxy clusters with DES, SPT, and ACT journal May 2019
C iv black hole mass measurements with the Australian Dark Energy Survey (OzDES) journal June 2019
WALLABY Early Science – IV. ASKAP H i imaging of the nearby galaxy IC 5201 journal July 2019
Galaxy shape measurement with convolutional neural networks journal August 2019
Brown dwarf census with the Dark Energy Survey year 3 data and the thin disc scale height of early L types journal September 2019
H0LiCOW – X. Spectroscopic/imaging survey and galaxy-group identification around the strong gravitational lens system WFI 2033−4723 journal September 2019
Finding high-redshift strong lenses in DES using convolutional neural networks journal January 2019
The southern stellar stream spectroscopic survey (S5): Overview, target selection, data reduction, validation, and early science journal October 2019
H i galaxies with little star formation: an abundance of LIERs journal March 2019
Group pre-processing versus cluster ram-pressure stripping: the case of ESO156−G029 journal September 2019
Cosmological Constraints from Multiple Probes in the Dark Energy Survey journal May 2019
Dynamical Analysis of Three Distant Trans-Neptunian Objects with Similar Orbits journal November 2018
Astrometry and Occultation Predictions to Trans-Neptunian and Centaur Objects Observed within the Dark Energy Survey journal February 2019
Identification of RR Lyrae Stars in Multiband, Sparsely Sampled Data from the Dark Energy Survey Using Template Fitting and Random Forest Classification journal June 2019
Stellar Streams Discovered in the Dark Energy Survey journal July 2018
Wide-field Optical Spectroscopy of Abell 133: A Search for Filaments Reported in X-Ray Observations journal October 2018
The Precious Set of Radio-optical Reference Frame Objects in the Light of Gaia DR2 Data journal March 2019
Mass Calibration of Optically Selected DES Clusters Using a Measurement of CMB-cluster Lensing with SPTpol Data journal February 2019
First Cosmology Results Using Type Ia Supernovae from the Dark Energy Survey: Photometric Pipeline and Light-curve Data Release journal March 2019
First Cosmology Results Using SNe Ia from the Dark Energy Survey: Analysis, Systematic Uncertainties, and Validation journal April 2019
A Faint Halo Star Cluster Discovered in the Blanco Imaging of the Southern Sky Survey journal April 2019
Dark Energy Survey Year 1 Results: Detection of Intracluster Light at Redshift ∼ 0.25 journal April 2019
The Morphology and Structure of Stellar Populations in the Fornax Dwarf Spheroidal Galaxy from Dark Energy Survey Data journal August 2019
The Dark Energy Survey: Data Release 1 journal November 2018
An Extended Catalog of Galaxy–Galaxy Strong Gravitational Lenses Discovered in DES Using Convolutional Neural Networks journal July 2019
First Cosmology Results using Type Ia Supernovae from the Dark Energy Survey: Constraints on Cosmological Parameters journal February 2019
A Search for Optical Emission from Binary Black Hole Merger GW170814 with the Dark Energy Camera journal March 2019
Rediscovery of the Sixth Star Cluster in the Fornax Dwarf Spheroidal Galaxy journal April 2019
The Dark Energy Survey: Data Release 1 text January 2018
Dark Energy Survey Year 1 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing text January 2017
A catalogue of structural and morphological measurements for DES Y1 text January 2018
The morphology and structure of stellar populations in the Fornax dwarf spheroidal galaxy from Dark Energy Survey Data text January 2018
Wide-Field Optical Spectroscopy of Abell 133: A Search for Filaments Reported in X-ray Observations text January 2018
Dynamical Analysis of Three Distant Trans-Neptunian Objects with Similar Orbits text January 2018
Mass Calibration of Optically Selected DES clusters using a Measurement of CMB-Cluster Lensing with SPTpol Data text January 2018
Cosmological Constraints from Multiple Probes in the Dark Energy Survey text January 2018
First Cosmology Results Using Type Ia Supernovae From the Dark Energy Survey: Photometric Pipeline and Light Curve Data Release text January 2018
Finding high-redshift strong lenses in DES using convolutional neural networks text January 2018
The precious set of radio-optical reference frame objects in the light of Gaia DR2 data text January 2018
Astrometry and Occultation predictions to Trans-Neptunian and Centaur Objects observed within the Dark Energy Survey text January 2018
Dark Energy Survey Year 1 results: Detection of Intra-cluster Light at Redshift $\sim$ 0.25 text January 2018
Superluminous Supernovae from the Dark Energy Survey text January 2018
CIV Black Hole Mass Measurements with the Australian Dark Energy Survey (OzDES) text January 2019
Rediscovery of the Sixth Star Cluster in the Fornax Dwarf Spheroidal Galaxy text January 2019
Galaxy shape measurement with convolutional neural networks text January 2019
HI galaxies with little star formation: an abundance of LIERs text January 2019
Identification of RR Lyrae stars in multiband, sparsely-sampled data from the Dark Energy Survey using template fitting and Random Forest classification text January 2019

Figures / Tables (32)


Similar Records

The Dark Energy Survey Image Processing Pipeline
Journal Article · Tue Jan 09 00:00:00 EST 2018 · Publications of the Astronomical Society of the Pacific · OSTI ID:1457775

The Dark Energy Survey Data Release 2
Journal Article · Tue Jul 27 00:00:00 EDT 2021 · The Astrophysical Journal. Supplement Series · OSTI ID:1457775

The Dark Energy Survey: Data Release 1
Journal Article · Mon Nov 26 00:00:00 EST 2018 · The Astrophysical Journal. Supplement Series · OSTI ID:1457775