DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: The Difference Imaging Pipeline for the Transient Search in the Dark Energy Survey

Abstract

We describe the operation and performance of the difference imaging pipeline (DiffImg) used to detect transients in deep images from the Dark Energy Survey Supernova program (DES-SN) in its first observing season from 2013 August through 2014 February. DES-SN is a search for transients in which ten 3 deg2 fields are repeatedly observed in the g, r, i, zpassbands with a cadence of about 1 week. Our observing strategy has been optimized to measure high-quality light curves and redshifts for thousands of Type Ia supernovae (SNe Ia) with the goal of measuring dark energy parameters. The essential DiffImg functions are to align each search image to a deep reference image, do a pixel-by-pixel subtraction, and then examine the subtracted image for significant positive detections of point-source objects. The vast majority of detections are subtraction artifacts, but after selection requirements and image filtering with an automated scanning program, there are ~130 detections per deg2 per observation in each band, of which only ~25% are artifacts. Of the ~7500 transients discovered by DES-SN in its first observing season, each requiring a detection on at least two separate nights, Monte Carlo (MC) simulations predict that 27% are expected to be SNe Ia ormore » core-collapse SNe. Another ~30% of the transients are artifacts in which a small number of observations satisfy the selection criteria for a single-epoch detection. Spectroscopic analysis shows that most of the remaining transients are AGNs and variable stars. Fake SNe Ia are overlaid onto the images to rigorously evaluate detection efficiencies and to understand the DiffImg performance. Furthermore, the DiffImg efficiency measured with fake SNe agrees well with expectations from a MC simulation that uses analytical calculations of the fluxes and their uncertainties. In our 8 "shallow" fields with single-epoch 50% completeness depth ~23.5, the SN Ia efficiency falls to 1/2 at redshift z ≈ 0.7; in our 2 "deep" fields with mag-depth ~24.5, the efficiency falls to 1/2 at z ≈ 1.1. A remaining performance issue is that the measured fluxes have additional scatter (beyond Poisson fluctuations) that increases with the host galaxy surface brightness at the transient location. This bright-galaxy issue has minimal impact on the SNe Ia program, but it may lower the efficiency for finding fainter transients on bright galaxies.« less

Authors:
 [1]
  1. Univ. of Chicago, IL (United States). et al.
Publication Date:
Research Org.:
Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States); SLAC National Accelerator Laboratory (SLAC), Menlo Park, CA (United States)
Sponsoring Org.:
USDOE Office of Science (SC), High Energy Physics (HEP)
Contributing Org.:
DES Collaboration; The DES Collaboration
OSTI Identifier:
1223237
Alternate Identifier(s):
OSTI ID: 1263415
Report Number(s):
FERMILAB-PUB-15-340-AE; SLAC-PUB-16623
Journal ID: ISSN 0004-6256; arXiv eprint number arXiv:1507.05137
Grant/Contract Number:  
AC02-07CH11359; AC02-76SF00515
Resource Type:
Accepted Manuscript
Journal Name:
The Astronomical Journal
Additional Journal Information:
Journal Volume: 150; Journal Issue: 6; Journal ID: ISSN 0004-6256
Publisher:
American Institute of Physics
Country of Publication:
United States
Language:
English
Subject:
79 ASTRONOMY AND ASTROPHYSICS; Astrophysics; ASTRO

Citation Formats

Kessler, R. The Difference Imaging Pipeline for the Transient Search in the Dark Energy Survey. United States: N. p., 2015. Web. doi:10.1088/0004-6256/150/6/172.
Kessler, R. The Difference Imaging Pipeline for the Transient Search in the Dark Energy Survey. United States. https://doi.org/10.1088/0004-6256/150/6/172
Kessler, R. Wed . "The Difference Imaging Pipeline for the Transient Search in the Dark Energy Survey". United States. https://doi.org/10.1088/0004-6256/150/6/172. https://www.osti.gov/servlets/purl/1223237.
@article{osti_1223237,
title = {The Difference Imaging Pipeline for the Transient Search in the Dark Energy Survey},
author = {Kessler, R.},
abstractNote = {We describe the operation and performance of the difference imaging pipeline (DiffImg) used to detect transients in deep images from the Dark Energy Survey Supernova program (DES-SN) in its first observing season from 2013 August through 2014 February. DES-SN is a search for transients in which ten 3 deg2 fields are repeatedly observed in the g, r, i, zpassbands with a cadence of about 1 week. Our observing strategy has been optimized to measure high-quality light curves and redshifts for thousands of Type Ia supernovae (SNe Ia) with the goal of measuring dark energy parameters. The essential DiffImg functions are to align each search image to a deep reference image, do a pixel-by-pixel subtraction, and then examine the subtracted image for significant positive detections of point-source objects. The vast majority of detections are subtraction artifacts, but after selection requirements and image filtering with an automated scanning program, there are ~130 detections per deg2 per observation in each band, of which only ~25% are artifacts. Of the ~7500 transients discovered by DES-SN in its first observing season, each requiring a detection on at least two separate nights, Monte Carlo (MC) simulations predict that 27% are expected to be SNe Ia or core-collapse SNe. Another ~30% of the transients are artifacts in which a small number of observations satisfy the selection criteria for a single-epoch detection. Spectroscopic analysis shows that most of the remaining transients are AGNs and variable stars. Fake SNe Ia are overlaid onto the images to rigorously evaluate detection efficiencies and to understand the DiffImg performance. Furthermore, the DiffImg efficiency measured with fake SNe agrees well with expectations from a MC simulation that uses analytical calculations of the fluxes and their uncertainties. In our 8 "shallow" fields with single-epoch 50% completeness depth ~23.5, the SN Ia efficiency falls to 1/2 at redshift z ≈ 0.7; in our 2 "deep" fields with mag-depth ~24.5, the efficiency falls to 1/2 at z ≈ 1.1. A remaining performance issue is that the measured fluxes have additional scatter (beyond Poisson fluctuations) that increases with the host galaxy surface brightness at the transient location. This bright-galaxy issue has minimal impact on the SNe Ia program, but it may lower the efficiency for finding fainter transients on bright galaxies.},
doi = {10.1088/0004-6256/150/6/172},
journal = {The Astronomical Journal},
number = 6,
volume = 150,
place = {United States},
year = {Wed Sep 09 00:00:00 EDT 2015},
month = {Wed Sep 09 00:00:00 EDT 2015}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 105 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

A Method for Optimal Image Subtraction
journal, August 1998

  • Alard, C.; Lupton, Robert H.
  • The Astrophysical Journal, Vol. 503, Issue 1
  • DOI: 10.1086/305984

Photometry of supernovae in an image series: methods and application to the SuperNova Legacy Survey (SNLS)
journal, August 2013


The Supernova Legacy Survey: measurement of $\Omega_{\mathsf{M}}$, $\Omega_\mathsf{\Lambda}$ and w from the first year data set
journal, January 2006


How to Find More Supernovae with Less Work: Object Classification Techniques for Difference Imaging
journal, August 2007

  • Bailey, S.; Aragon, C.; Romano, R.
  • The Astrophysical Journal, Vol. 665, Issue 2
  • DOI: 10.1086/519832

Effect of a high Opacity on the Light Curves of Radioactively Powered Transients from Compact Object Mergers
journal, August 2013


The core-collapse rate from the Supernova Legacy Survey
journal, April 2009


Supernova Simulations and Strategies for the dark Energy Survey
journal, June 2012


SExtractor: Software for source extraction
journal, June 1996

  • Bertin, E.; Arnouts, S.
  • Astronomy and Astrophysics Supplement Series, Vol. 117, Issue 2
  • DOI: 10.1051/aas:1996164

A new algorithm for difference image analysis
journal, May 2008


The Blanco Cosmology Survey: data Acquisition, Processing, Calibration, Quality Diagnostics, and data Release
journal, September 2012


A Measurement of the Rate of Type Ia Supernovae at Redshift z ≈ 0.1 from the First Season of the SDSS‐II Supernova Survey
journal, July 2008

  • Dilday, Benjamin; Kessler, Richard; Frieman, Joshua A.
  • The Astrophysical Journal, Vol. 682, Issue 1
  • DOI: 10.1086/587733

The Sloan Digital sky Survey-Ii Supernova Survey: Technical Summary
journal, December 2007


The Supernova Legacy Survey 3-year sample: Type Ia supernovae photometric distances and cosmological constraints
journal, November 2010


Stellar Locus Regression: Accurate Color Calibration and the Real-Time Determination of Galaxy Cluster Photometric Redshifts
journal, May 2009


The Sloan Digital sky Survey-Ii: Photometry and Supernova ia Light Curves from the 2005 data
journal, November 2008


Pan-STARRS: A Large Synoptic Survey Telescope Array
conference, December 2002

  • Kaiser, Nicholas; Aussel, Herve; Burke, Barry E.
  • Astronomical Telescopes and Instrumentation, SPIE Proceedings
  • DOI: 10.1117/12.457365

Weighing the Giants – II. Improved calibration of photometry from stellar colours and accurate photometric redshifts
journal, February 2014

  • Kelly, Patrick L.; von der Linden, Anja; Applegate, Douglas E.
  • Monthly Notices of the Royal Astronomical Society, Vol. 439, Issue 1
  • DOI: 10.1093/mnras/stt1946

PHOTOMETRIC ESTIMATES OF REDSHIFTS AND DISTANCE MODULI FOR TYPE Ia SUPERNOVAE
journal, June 2010


SNANA: A Public Software Package for Supernova Analysis
journal, September 2009

  • Kessler, Richard; Bernstein, Joseph P.; Cinabro, David
  • Publications of the Astronomical Society of the Pacific, Vol. 121, Issue 883
  • DOI: 10.1086/605984

Results from the Supernova Photometric Classification Challenge
journal, December 2010

  • Kessler, Richard; Bassett, Bruce; Belov, Pavel
  • Publications of the Astronomical Society of the Pacific, Vol. 122, Issue 898
  • DOI: 10.1086/657607

The ESSENCE Supernova Survey: Survey Optimization, Observations, and Supernova Photometry
journal, September 2007

  • Miknaitis, G.; Pignata, G.; Rest, A.
  • The Astrophysical Journal, Vol. 666, Issue 2
  • DOI: 10.1086/519986

The USNO-B Catalog
journal, February 2003

  • Monet, David G.; Levine, Stephen E.; Canzian, Blaise
  • The Astronomical Journal, Vol. 125, Issue 2
  • DOI: 10.1086/345888

The Distant Type Ia Supernova Rate
journal, September 2002

  • Pain, R.; Fabbro, S.; Sullivan, M.
  • The Astrophysical Journal, Vol. 577, Issue 1
  • DOI: 10.1086/342129

DES13S2cmm: the first superluminous supernova from the Dark Energy Survey
journal, March 2015

  • Papadopoulos, A.; D'Andrea, C. B.; Sullivan, M.
  • Monthly Notices of the Royal Astronomical Society, Vol. 449, Issue 2
  • DOI: 10.1093/mnras/stv174

Measurements of Ω and Λ from 42 High‐Redshift Supernovae
journal, June 1999

  • Perlmutter, S.; Aldering, G.; Goldhaber, G.
  • The Astrophysical Journal, Vol. 517, Issue 2
  • DOI: 10.1086/307221

Real-Time Analysis and Selection Biases in the Supernova Legacy Survey
journal, July 2010


Tidal disruption of stars by black holes of 106–108 solar masses in nearby galaxies
journal, June 1988


COSMOLOGICAL CONSTRAINTS FROM MEASUREMENTS OF TYPE Ia SUPERNOVAE DISCOVERED DURING THE FIRST 1.5 yr OF THE Pan-STARRS1 SURVEY
journal, October 2014


Observational Evidence from Supernovae for an Accelerating Universe and a Cosmological Constant
journal, September 1998

  • Riess, Adam G.; Filippenko, Alexei V.; Challis, Peter
  • The Astronomical Journal, Vol. 116, Issue 3
  • DOI: 10.1086/300499

The Sloan Digital sky Survey-Ii Supernova Survey: Search Algorithm and Follow-Up Observations
journal, December 2007


PHOTOMETRIC TYPE Ia SUPERNOVA CANDIDATES FROM THE THREE-YEAR SDSS-II SN SURVEY DATA
journal, August 2011


OzDES multifibre spectroscopy for the Dark Energy Survey: first-year operation and results
journal, July 2015

  • Yuan, Fang; Lidman, C.; Davis, T. M.
  • Monthly Notices of the Royal Astronomical Society, Vol. 452, Issue 3
  • DOI: 10.1093/mnras/stv1507

The Fourth us Naval Observatory ccd Astrograph Catalog (Ucac4)
journal, January 2013


The Sloan Digital Sky Survey-II Supernova Survey: Technical Summary
text, January 2007


A New Algorithm For Difference Image Analysis
text, January 2008


The Sloan Digital Sky Survey-II: Photometry and Supernova Ia Light Curves from the 2005 data
text, January 2009


Real-time Analysis and Selection Biases in the Supernova Legacy Survey
text, January 2010


Results from the Supernova Photometric Classification Challenge
text, January 2010


Supernova Simulations and Strategies For the Dark Energy Survey
text, January 2011


Weighing the Giants II: Improved Calibration of Photometry from Stellar Colors and Accurate Photometric Redshifts
text, January 2012


The Fourth US Naval Observatory CCD Astrograph Catalog (UCAC4)
text, January 2012


Works referencing / citing this record:

DESGW Optical Follow-up of BBH LIGO-Virgo Events with DECam
journal, October 2017

  • Butler, Robert E.; Soares-Santos, M.; Annis, J.
  • Proceedings of the International Astronomical Union, Vol. 13, Issue S338
  • DOI: 10.1017/s1743921318003599

Cosmology with Gravitational Waves in DES and LSST
journal, October 2017

  • Herner, Kenneth; Soares-Santos, Marcelle; Annis, James
  • Proceedings of the International Astronomical Union, Vol. 13, Issue S338
  • DOI: 10.1017/s1743921318003794

simsurvey : estimating transient discovery rates for the Zwicky transient facility
journal, October 2019

  • Feindt, Ulrich; Nordin, Jakob; Rigault, Mickael
  • Journal of Cosmology and Astroparticle Physics, Vol. 2019, Issue 10
  • DOI: 10.1088/1475-7516/2019/10/005

iPTF Survey for Cool Transients
journal, February 2018

  • Adams, S. M.; Blagorodnova, N.; Kasliwal, M. M.
  • Publications of the Astronomical Society of the Pacific, Vol. 130, Issue 985
  • DOI: 10.1088/1538-3873/aaa356

The Dark Energy Survey Image Processing Pipeline
journal, May 2018

  • Morganson, E.; Gruendl, R. A.; Menanteau, F.
  • Publications of the Astronomical Society of the Pacific, Vol. 130, Issue 989
  • DOI: 10.1088/1538-3873/aab4ef

Models and Simulations for the Photometric LSST Astronomical Time Series Classification Challenge (PLAsTiCC)
journal, July 2019

  • Kessler, R.; Narayan, G.; Avelino, A.
  • Publications of the Astronomical Society of the Pacific, Vol. 131, Issue 1003
  • DOI: 10.1088/1538-3873/ab26f1

Comparative performance of selected variability detection techniques in photometric time series data
journal, September 2016

  • Sokolovsky, K. V.; Gavras, P.; Karampelas, A.
  • Monthly Notices of the Royal Astronomical Society, Vol. 464, Issue 1
  • DOI: 10.1093/mnras/stw2262

The Dark Energy Survey: more than dark energy – an overview
journal, March 2016

  • Abbott, T.; Abdalla, F. B.; Aleksic, J.
  • Monthly Notices of the Royal Astronomical Society, Vol. 460, Issue 2, p. 1270-1299
  • DOI: 10.1093/mnras/stw641

Rapidly evolving transients in the Dark Energy Survey
journal, August 2018

  • Pursiainen, M.; Childress, M.; Smith, M.
  • Monthly Notices of the Royal Astronomical Society, Vol. 481, Issue 1
  • DOI: 10.1093/mnras/sty2309

R-band light-curve properties of Type Ia supernovae from the (intermediate) Palomar Transient Factory
journal, December 2018

  • Papadogiannakis, S.; Goobar, A.; Amanullah, R.
  • Monthly Notices of the Royal Astronomical Society, Vol. 483, Issue 4
  • DOI: 10.1093/mnras/sty3301

Superluminous supernovae from the Dark Energy Survey
journal, May 2019

  • Angus, C. R.; Smith, M.; Sullivan, M.
  • Monthly Notices of the Royal Astronomical Society, Vol. 487, Issue 2
  • DOI: 10.1093/mnras/stz1321

On the relative bias of void tracers in the Dark Energy Survey
journal, May 2019

  • Pollina, G.; Hamaus, N.; Paech, K.
  • Monthly Notices of the Royal Astronomical Society, Vol. 487, Issue 2
  • DOI: 10.1093/mnras/stz1470

C iv black hole mass measurements with the Australian Dark Energy Survey (OzDES)
journal, June 2019

  • Hoormann, J. K.; Martini, P.; Davis, T. M.
  • Monthly Notices of the Royal Astronomical Society, Vol. 487, Issue 3
  • DOI: 10.1093/mnras/stz1539

First cosmology results using Type Ia supernova from the Dark Energy Survey: simulations to correct supernova distance biases
journal, February 2019

  • Kessler, R.; Brout, D.; D’Andrea, C. B.
  • Monthly Notices of the Royal Astronomical Society, Vol. 485, Issue 1
  • DOI: 10.1093/mnras/stz463

Serendipitous discoveries of kilonovae in the LSST main survey: maximizing detections of sub-threshold gravitational wave events
journal, February 2019

  • Setzer, Christian N.; Biswas, Rahul; Peiris, Hiranya V.
  • Monthly Notices of the Royal Astronomical Society, Vol. 485, Issue 3
  • DOI: 10.1093/mnras/stz506

First cosmology results using Type IA supernovae from the dark energy survey: effects of chromatic corrections to supernova photometry on measurements of cosmological parameters
journal, March 2019

  • Lasker, J.; Kessler, R.; Scolnic, D.
  • Monthly Notices of the Royal Astronomical Society, Vol. 485, Issue 4
  • DOI: 10.1093/mnras/stz619

Cosmological Constraints from Multiple Probes in the Dark Energy Survey
journal, May 2019


Host Galaxy Identification for Supernova Surveys
journal, November 2016


Discovery and Dynamical Analysis of an Extreme Trans-Neptunian Object with a High Orbital Inclination
journal, August 2018


Dynamical Analysis of Three Distant Trans-Neptunian Objects with Similar Orbits
journal, November 2018


Automated Transient Detection with Shapelet Analysis in Image-subtracted Data
journal, October 2019

  • Ackley, Kendall; Eikenberry, Stephen S.; Yildirim, Ceren
  • The Astronomical Journal, Vol. 158, Issue 5
  • DOI: 10.3847/1538-3881/ab3c4b

Avocado: Photometric Classification of Astronomical Transients with Gaussian Process Augmentation
journal, December 2019


An Information Theory Approach on Deciding Spectroscopic Follow-ups
journal, December 2019

  • Astudillo, Javiera; Protopapas, Pavlos; Pichara, Karim
  • The Astronomical Journal, Vol. 159, Issue 1
  • DOI: 10.3847/1538-3881/ab557d

Correcting Type Ia Supernova Distances for Selection Biases and Contamination in Photometrically Identified Samples
journal, February 2017


Color Me Intrigued: The Discovery of iPTF 16fnm, an SN 2002cx–like Object
journal, October 2017


Studying the Ultraviolet Spectrum of the First Spectroscopically Confirmed Supernova at Redshift Two
journal, February 2018


RATIR Follow-up of LIGO/Virgo Gravitational Wave Events
journal, April 2018

  • Golkhou, V. Zach; Butler, Nathaniel R.; Strausbaugh, Robert
  • The Astrophysical Journal, Vol. 857, Issue 2
  • DOI: 10.3847/1538-4357/aab665

Quasar Accretion Disk Sizes from Continuum Reverberation Mapping from the Dark Energy Survey
journal, July 2018


First Cosmology Results Using Type Ia Supernovae from the Dark Energy Survey: Photometric Pipeline and Light-curve Data Release
journal, March 2019


First Cosmology Results Using SNe Ia from the Dark Energy Survey: Analysis, Systematic Uncertainties, and Validation
journal, April 2019


The Foundation Supernova Survey: Measuring Cosmological Parameters with Supernovae from a Single Telescope
journal, August 2019


A DECam Search for Explosive Optical Transients Associated with IceCube Neutrino Alerts
journal, September 2019


The DES Bright Arcs Survey: Hundreds of Candidate Strongly Lensed Galaxy Systems from the Dark Energy Survey Science Verification and Year 1 Observations
journal, September 2017

  • Diehl, H. T.; Buckley-Geer, E. J.; Lindgren, K. A.
  • The Astrophysical Journal Supplement Series, Vol. 232, Issue 1
  • DOI: 10.3847/1538-4365/aa8667

Dark Energy Survey Year 1 Results: The Photometric Data Set for Cosmology
journal, April 2018

  • Drlica-Wagner, A.; Sevilla-Noarbe, I.; Rykoff, E. S.
  • The Astrophysical Journal Supplement Series, Vol. 235, Issue 2
  • DOI: 10.3847/1538-4365/aab4f5

The Dark Energy Survey: Data Release 1
journal, November 2018

  • Abbott, T. M. C.; Abdalla, F. B.; Allam, S.
  • The Astrophysical Journal Supplement Series, Vol. 239, Issue 2
  • DOI: 10.3847/1538-4365/aae9f0

First Cosmology Results using Type Ia Supernovae from the Dark Energy Survey: Constraints on Cosmological Parameters
journal, February 2019


A Search for Optical Emission from Binary Black Hole Merger GW170814 with the Dark Energy Camera
journal, March 2019


The Dark Energy Survey: Data Release 1
text, January 2018

  • Abbott, Tmc; Abdalla, Fb; Allam, S.
  • Apollo - University of Cambridge Repository
  • DOI: 10.17863/cam.37745

simsurvey : estimating transient discovery rates for the Zwicky transient facility
text, January 2019

  • Feindt, Ulrich; Nordin, Jakob; Rigault, Mickael
  • Deutsches Elektronen-Synchrotron, DESY, Hamburg
  • DOI: 10.3204/pubdb-2019-03879

Quasar Accretion Disk Sizes from Continuum Reverberation Mapping from the Dark Energy Survey
text, January 2018

  • Mudd, D.; Martini, P.; Zu, Y.
  • Apollo - University of Cambridge Repository
  • DOI: 10.17863/cam.20889

Dark Energy Survey Year 1 Results: Photometric Data Set for Cosmology
text, January 2018

  • Drlica-Wagner, A.; Sevilla-Noarbe, I.; Rykoff, Es
  • Apollo - University of Cambridge Repository
  • DOI: 10.17863/cam.21145

Models and simulations for the photometric lsst astronomical time series classification challenge (Plasticc)
text, January 2019

  • Kessler, R.; Narayan, G.; Avelino, A.
  • Apollo - University of Cambridge Repository
  • DOI: 10.17863/cam.41808

A DECam Search for Explosive Optical Transients Associated with IceCube Neutrinos
text, January 2019


The Dark Energy Survey: more than dark energy - an overview
text, January 2016


RATIR Followup of LIGO/Virgo Gravitational Wave Events
text, January 2017


Dark Energy Survey Year 1 Results: Photometric Data Set for Cosmology
text, January 2017


iPTF Survey for Cool Transients
text, January 2017


The Dark Energy Survey Image Processing Pipeline
text, January 2018


Rapidly evolving transients in the Dark Energy Survey
text, January 2018


On the relative bias of void tracers in the Dark Energy Survey
text, January 2018


Dynamical Analysis of Three Distant Trans-Neptunian Objects with Similar Orbits
text, January 2018


Cosmological Constraints from Multiple Probes in the Dark Energy Survey
text, January 2018


Superluminous Supernovae from the Dark Energy Survey
text, January 2018


CIV Black Hole Mass Measurements with the Australian Dark Energy Survey (OzDES)
text, January 2019


A DECam Search for Explosive Optical Transients Associated with IceCube Neutrinos
text, January 2019


Automated Transient Detection with Shapelet Analysis in Image-subtracted Data
text, January 2019


An Information Theory Approach on Deciding Spectroscopic Follow Ups
text, January 2019