Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

The Dark Energy Survey Image Processing Pipeline

Journal Article · · Publications of the Astronomical Society of the Pacific

The Dark Energy Survey (DES) is a five-year optical imaging campaign with the goal of understanding the origin of cosmic acceleration. DES performs a 5000 square degree survey of the southern sky in five optical bands (g,r,i,z,Y) to a depth of ~24th magnitude. Contemporaneously, DES performs a deep, time-domain survey in four optical bands (g,r,i,z) over 27 square degrees. DES exposures are processed nightly with an evolving data reduction pipeline and evaluated for image quality to determine if they need to be retaken. Difference imaging and transient source detection are also performed in the time domain component nightly. On a bi-annual basis, DES exposures are reprocessed with a refined pipeline and coadded to maximize imaging depth. Here we describe the DES image processing pipeline in support of DES science, as a reference for users of archival DES data, and as a guide for future astronomical surveys.

Research Organization:
Brookhaven National Laboratory (BNL), Upton, NY (United States); SLAC National Accelerator Laboratory (SLAC), Menlo Park, CA (United States); Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States); Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
Contributing Organization:
DES
DOE Contract Number:
AC02-07CH11359
OSTI ID:
1422722
Report Number(s):
arXiv:1801.03177; FERMILAB-PUB-17-524-AE; 1647428
Journal Information:
Publications of the Astronomical Society of the Pacific, Journal Name: Publications of the Astronomical Society of the Pacific Journal Issue: 989 Vol. 130; ISSN 0004-6280
Publisher:
Astronomical Society of the Pacific
Country of Publication:
United States
Language:
English

References (63)

Dark Energy Survey Year 1 Results: The Photometric Data Set for Cosmology journal April 2018
The Difference Imaging Pipeline for the Transient Search in the dark Energy Survey journal November 2015
Automated Transient Identification in the dark Energy Survey journal August 2015
Characterization and correction of charge-induced pixel shifts in DECam text January 2015
The Blanco Cosmology Survey: Data Acquisition, Processing, Calibration, Quality Diagnostics and Data Release text January 2012
The Seventh data Release of the Sloan Digital sky Survey journal May 2009
The Seventh Data Release of the Sloan Digital Sky Survey text January 2009
Forward Global Photometric Calibration of the Dark Energy Survey journal December 2017
Automated Transient Identification in the Dark Energy Survey text January 2015
FermiGrid—experience and future plans journal July 2008
A 1.4-GHz survey of the southern European Large-Area ISO Survey region journal May 1999
The Fifth Data Release of the Sloan Digital Sky Survey text January 2007
The Dark Energy Survey: more than dark energy – an overview journal March 2016
Practical Weak Lensing Shear Measurement with Metacalibration text January 2017
Principal Component Analysis book January 2011
Focal plane detectors for Dark Energy Camera (DECam) conference July 2010
The dark Energy Camera journal October 2015
The Two Micron All Sky Survey (2MASS) journal February 2006
Simultaneous Multicolor Detection of Faint Galaxies in the Hubble Deep Field journal January 1999
Detection and removal of artifacts in astronomical images journal July 2016
THE CHANDRA DEEP FIELD-SOUTH SURVEY: 4 Ms SOURCE CATALOGS journal June 2011
0.250mm-thick CCD packaging for the Dark Energy Survey Camera array conference June 2006
A scheme to deal accurately and efficiently with complex angular masks in galaxy surveys journal March 2004
The readout and control system of the Dark Energy Camera conference September 2012
Forward Global Photometric Calibration of the Dark Energy Survey text January 2017
The Blanco Cosmology Survey: data Acquisition, Processing, Calibration, Quality Diagnostics, and data Release journal September 2012
The XMM-LSS survey. Survey design and first results journal September 2004
Methods for rapidly processing angular masks of next-generation galaxy surveys journal July 2008
The Effects of Atmospheric Turbulence in Optical Astronomy book January 1981
Gaia Data Release 1 : Summary of the astrometric, photometric, and survey properties journal November 2016
The Fourth us Naval Observatory ccd Astrograph Catalog (Ucac4) journal January 2013
The brighter-fatter effect and pixel correlations in CCD sensors journal March 2014
The XMM-LSS survey. Survey design and first results text January 2003
Cyber-infrastructure to support science and data management for the Dark Energy Survey conference June 2006
The Fifth Data Release of the Sloan Digital Sky Survey
  • Adelman‐McCarthy, Jennifer K.; Agueros, Marcel A.; Allam, Sahar S.
  • The Astrophysical Journal Supplement Series, Vol. 172, Issue 2 https://doi.org/10.1086/518864
journal October 2007
HEALPix: A Framework for High‐Resolution Discretization and Fast Analysis of Data Distributed on the Sphere journal April 2005
Representations of celestial coordinates in FITS journal November 2002
The Kilo-Degree Survey journal August 2012
Dark Energy Survey Year 1 Results: Photometric Data Set for Cosmology text January 2018
The seventh data release of the sloan digital sky survey text January 2009
The Pan-STARRS wide-field optical/NIR imaging survey conference July 2010
The Fifth Data Release of the Sloan Digital Sky Survey text January 2007
Cyber-infrastructure to Support Science and Data Management for the Dark Energy Survey text January 2006
Use of the Hough transformation to detect lines and curves in pictures journal January 1972
Simultaneous Multicolor Detection of Faint Galaxies in the Hubble Deep Field text January 1998
The Dark Energy Survey Data Management System text January 2008
Practical Weak-lensing Shear Measurement with Metacalibration journal May 2017
Characterization and correction of charge-induced pixel shifts in DECam journal May 2015
Principal Component Analysis book January 1986
The USNO-B Catalog journal February 2003
The Sloan Digital Sky Survey: Technical Summary journal September 2000
The Dark Energy Survey: more than dark energy - an overview text January 2016
Dark Energy Survey Year 1 Results: Photometric Data Set for Cosmology text January 2017
The 10 Meter South Pole Telescope
  • Carlstrom, J. E.; Ade, P. A. R.; Aird, K. A.
  • Publications of the Astronomical Society of the Pacific, Vol. 123, Issue 903 https://doi.org/10.1086/659879
journal May 2011
The Fourth US Naval Observatory CCD Astrograph Catalog (UCAC4) text January 2012
SNANA: A Public Software Package for Supernova Analysis
  • Kessler, Richard; Bernstein, Joseph P.; Cinabro, David
  • Publications of the Astronomical Society of the Pacific, Vol. 121, Issue 883 https://doi.org/10.1086/605984
journal September 2009
HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere text January 2004
SExtractor: Software for source extraction journal June 1996
The brighter-fatter effect and pixel correlations in CCD sensors text January 2014
Gaia Data Release 1 : Testing parallaxes with local Cepheids and RR Lyrae stars⋆ journal September 2017
The Dark Energy Survey data management system conference July 2008
Maps of Dust Infrared Emission for Use in Estimation of Reddening and Cosmic Microwave Background Radiation Foregrounds journal June 1998
Representations of celestial coordinates in FITS text January 2002

Cited By (53)

Group pre-processing versus cluster ram-pressure stripping: the case of ESO156−G029 journal September 2019
H i galaxies with little star formation: an abundance of LIERs journal March 2019
Dark Energy Survey Year 1 results: Detection of Intra-cluster Light at Redshift $\sim$ 0.25 text January 2018
A Search for Optical Emission from Binary Black Hole Merger GW170814 with the Dark Energy Camera journal March 2019
The Morphology and Structure of Stellar Populations in the Fornax Dwarf Spheroidal Galaxy from Dark Energy Survey Data journal August 2019
Dynamical Analysis of Three Distant Trans-Neptunian Objects with Similar Orbits text January 2018
Identification of RR Lyrae Stars in Multiband, Sparsely Sampled Data from the Dark Energy Survey Using Template Fitting and Random Forest Classification journal June 2019
The precious set of radio-optical reference frame objects in the light of Gaia DR2 data text January 2018
First Cosmology Results using Type Ia Supernovae from the Dark Energy Survey: Constraints on Cosmological Parameters journal February 2019
H0LiCOW – X. Spectroscopic/imaging survey and galaxy-group identification around the strong gravitational lens system WFI 2033−4723 journal September 2019
Mass Calibration of Optically Selected DES clusters using a Measurement of CMB-Cluster Lensing with SPTpol Data text January 2018
The morphology and structure of stellar populations in the Fornax dwarf spheroidal galaxy from Dark Energy Survey Data text January 2018
Galaxy shape measurement with convolutional neural networks journal August 2019
Measurement of the splashback feature around SZ-selected Galaxy clusters with DES, SPT, and ACT journal May 2019
Dark Energy Survey year 1 results: Constraints on extended cosmological models from galaxy clustering and weak lensing journal June 2019
Brown dwarf census with the Dark Energy Survey year 3 data and the thin disc scale height of early L types journal September 2019
Dynamical Analysis of Three Distant Trans-Neptunian Objects with Similar Orbits journal November 2018
An Extended Catalog of Galaxy–Galaxy Strong Gravitational Lenses Discovered in DES Using Convolutional Neural Networks journal July 2019
Dark Energy Survey Year 1 Results: Detection of Intracluster Light at Redshift ∼ 0.25 journal April 2019
Galaxy shape measurement with convolutional neural networks text January 2019
Dark Energy Survey Year 1 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing text January 2017
Stellar Streams Discovered in the Dark Energy Survey journal July 2018
Wide-field Optical Spectroscopy of Abell 133: A Search for Filaments Reported in X-Ray Observations journal October 2018
Rediscovery of the Sixth Star Cluster in the Fornax Dwarf Spheroidal Galaxy text January 2019
Identification of RR Lyrae stars in multiband, sparsely-sampled data from the Dark Energy Survey using template fitting and Random Forest classification text January 2019
HI galaxies with little star formation: an abundance of LIERs text January 2019
The southern stellar stream spectroscopic survey (S5): Overview, target selection, data reduction, validation, and early science journal October 2019
A Faint Halo Star Cluster Discovered in the Blanco Imaging of the Southern Sky Survey journal April 2019
Rediscovery of the Sixth Star Cluster in the Fornax Dwarf Spheroidal Galaxy journal April 2019
Dark Energy Survey year 1 results: Cosmological constraints from galaxy clustering and weak lensing journal August 2018
Cosmological Constraints from Multiple Probes in the Dark Energy Survey journal May 2019
Superluminous supernovae from the Dark Energy Survey journal May 2019
Finding high-redshift strong lenses in DES using convolutional neural networks journal January 2019
C iv black hole mass measurements with the Australian Dark Energy Survey (OzDES) journal June 2019
Astrometry and Occultation Predictions to Trans-Neptunian and Centaur Objects Observed within the Dark Energy Survey journal February 2019
Astrometry and Occultation predictions to Trans-Neptunian and Centaur Objects observed within the Dark Energy Survey text January 2018
A catalogue of structural and morphological measurements for DES Y1 text January 2018
The Dark Energy Survey: Data Release 1 journal November 2018
First Cosmology Results Using SNe Ia from the Dark Energy Survey: Analysis, Systematic Uncertainties, and Validation journal April 2019
The Precious Set of Radio-optical Reference Frame Objects in the Light of Gaia DR2 Data journal March 2019
First Cosmology Results Using Type Ia Supernovae from the Dark Energy Survey: Photometric Pipeline and Light-curve Data Release journal March 2019
First Cosmology Results Using Type Ia Supernovae From the Dark Energy Survey: Photometric Pipeline and Light Curve Data Release text January 2018
A catalogue of structural and morphological measurements for DES Y1 journal July 2018
Superluminous Supernovae from the Dark Energy Survey text January 2018
MAXIMASK and MAXITRACK: Two new tools for identifying contaminants in astronomical images using convolutional neural networks journal February 2020
WALLABY Early Science – IV. ASKAP H i imaging of the nearby galaxy IC 5201 journal July 2019
Dark Energy Survey year 1 results: galaxy sample for BAO measurement journal September 2018
The Dark Energy Survey: Data Release 1 text January 2018
Mass Calibration of Optically Selected DES Clusters Using a Measurement of CMB-cluster Lensing with SPTpol Data journal February 2019
Wide-Field Optical Spectroscopy of Abell 133: A Search for Filaments Reported in X-ray Observations text January 2018
Cosmological Constraints from Multiple Probes in the Dark Energy Survey text January 2018
Finding high-redshift strong lenses in DES using convolutional neural networks text January 2018
CIV Black Hole Mass Measurements with the Australian Dark Energy Survey (OzDES) text January 2019

Similar Records

The Dark Energy Survey Image Processing Pipeline
Journal Article · Thu May 17 00:00:00 EDT 2018 · Publications of the Astronomical Society of the Pacific · OSTI ID:1457775