DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: The Spectroscopic Data Processing Pipeline for the Dark Energy Spectroscopic Instrument

Journal Article · · The Astronomical Journal
ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ; ORCiD logo; ORCiD logo; ; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo more »; ; ORCiD logo; ; ORCiD logo; ORCiD logo; ORCiD logo; ; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ; ORCiD logo; ORCiD logo; ; ORCiD logo; ; ; ORCiD logo; ; ; ORCiD logo; ORCiD logo; ; ORCiD logo; ORCiD logo; ; ORCiD logo; ORCiD logo; ; ORCiD logo « less

Abstract We describe the spectroscopic data processing pipeline of the Dark Energy Spectroscopic Instrument (DESI), which is conducting a redshift survey of about 40 million galaxies and quasars using a purpose-built instrument on the 4 m Mayall Telescope at Kitt Peak National Observatory. The main goal of DESI is to measure with unprecedented precision the expansion history of the universe with the baryon acoustic oscillation technique and the growth rate of structure with redshift space distortions. Ten spectrographs with three cameras each disperse the light from 5000 fibers onto 30 CCDs, covering the near-UV to near-infrared (3600–9800 Å) with a spectral resolution ranging from 2000 to 5000. The DESI data pipeline generates wavelength- and flux-calibrated spectra of all the targets, along with spectroscopic classifications and redshift measurements. Fully processed data from each night are typically available to the DESI collaboration the following morning. We give details about the pipeline’s algorithms, and provide performance results on the stability of the optics, the quality of the sky background subtraction, and the precision and accuracy of the instrumental calibration. This pipeline has been used to process the DESI Survey Validation data set, and has exceeded the project’s requirements for redshift performance, with high efficiency and a purity greater than 99% for all target classes.

Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States); University of Michigan, Ann Arbor, MI (United States); University of Rochester, NY (United States)
Sponsoring Organization:
National Science Foundation (NSF); USDOE; USDOE Office of Science (SC), Basic Energy Sciences (BES). Scientific User Facilities (SUF); USDOE Office of Science (SC), High Energy Physics (HEP)
Contributing Organization:
DESI collaboration
Grant/Contract Number:
AC02-05CH11231; SC0008475; SC0019193
OSTI ID:
1959859
Journal Information:
The Astronomical Journal, Journal Name: The Astronomical Journal Journal Issue: 4 Vol. 165; ISSN 0004-6256
Publisher:
American Astronomical SocietyCopyright Statement
Country of Publication:
United States
Language:
English

References (35)

Random Forests journal January 2001
A new extensive library of PHOENIX stellar atmospheres and synthetic spectra journal April 2013
Measurement of baryon acoustic oscillation correlations at z  = 2.3 with SDSS DR12 Ly α -Forests journal June 2017
A collection of model stellar spectra for spectral types B to early-M journal October 2018
Gaia Data Release 2 : Summary of the contents and survey properties journal August 2018
Survey of Surveys journal March 2022
A flux-calibrated, high-resolution atlas of optical sky emission from UVES journal September 2003
An optimal extraction algorithm for CCD spectroscopy journal June 1986
FOCAS Automatic Catalog Matching Algorithms
  • Valdes, Francisco G.; Campusano, Luis E.; Velasquez, Juan D.
  • Publications of the Astronomical Society of the Pacific, Vol. 107 https://doi.org/10.1086/133667
journal June 1995
Maps of Dust Infrared Emission for Use in Estimation of Reddening and Cosmic Microwave Background Radiation Foregrounds journal June 1998
Correcting for the Effects of Interstellar Extinction journal January 1999
HEALPix: A Framework for High‐Resolution Discretization and Fast Analysis of Data Distributed on the Sphere journal April 2005
K -Corrections and Filter Transformations in the Ultraviolet, Optical, and Near-Infrared journal January 2007
Spectro-Perfectionism: An Algorithmic Framework for Photon Noise-Limited Extraction of Optical Fiber Spectroscopy journal January 2010
Principal Component Analysis with Noisy and/or Missing Data journal September 2012
Spectral Classification and Redshift Measurement for the Sdss-Iii Baryon Oscillation Spectroscopic Survey journal October 2012
The Baryon Oscillation Spectroscopic Survey of Sdss-Iii journal December 2012
Accurate Stellar Kinematics at Faint Magnitudes: Application to the BoÖTes i Dwarf Spheroidal Galaxy journal July 2011
Measuring Reddening with Sloan Digital sky Survey Stellar Spectra and Recalibrating sfd journal August 2011
The Prism Multi-Object Survey (Primus). ii. data Reduction and Redshift Fitting journal April 2013
The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Large-scale structure catalogues for cosmological analysis journal September 2020
The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: measurement of the BAO and growth rate of structure of the luminous red galaxy sample from the anisotropic power spectrum between redshifts 0.6 and 1.0 journal August 2020
The completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: large-scale structure catalogues and measurement of the isotropic BAO between redshift 0.6 and 1.1 for the Emission Line Galaxy Sample journal October 2020
Galaxy And Mass Assembly (GAMA): Data Release 4 and the z < 0.1 total and z < 0.08 morphological galaxy stellar mass functions journal March 2022
A Gaia Data Release 2 catalogue of white dwarfs and a comparison with SDSS
  • Gentile Fusillo, Nicola Pietro; Tremblay, Pier-Emmanuel; Gänsicke, Boris T.
  • Monthly Notices of the Royal Astronomical Society, Vol. 482, Issue 4 https://doi.org/10.1093/mnras/sty3016
journal November 2018
Peering through the OH forest: a new technique to remove residual sky features from Sloan Digital Sky Survey spectra journal April 2005
Performance of Kitt Peak’s Mayall 4-meter telescope during DESI commissioning conference December 2020
REDSHIFT MEASUREMENT AND SPECTRAL CLASSIFICATION FOR eBOSS GALAXIES WITH THE REDMONSTER SOFTWARE journal December 2016
Overview of the DESI Legacy Imaging Surveys journal April 2019
Overview of the Instrumentation for the Dark Energy Spectroscopic Instrument journal October 2022
The Robotic Multiobject Focal Plane System of the Dark Energy Spectroscopic Instrument (DESI) journal December 2022
The Target-selection Pipeline for the Dark Energy Spectroscopic Instrument journal January 2023
Target Selection and Validation of DESI Luminous Red Galaxies journal January 2023
Metal-rich, Metal-poor: Updated Stellar Population Models for Old Stellar Systems journal February 2018
The 16th Data Release of the Sloan Digital Sky Surveys: First Release from the APOGEE-2 Southern Survey and Full Release of eBOSS Spectra journal June 2020