Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

PSTN-019: The LSST Science Pipelines Software: Optical Survey Pipeline Reduction and Analysis Environment

Dataset ·

The NSF-DOE Vera C. Rubin Observatory will produce the Legacy Survey of Space and Time (LSST), producing 11 data releases over the ten-year survey. The LSST Science Pipelines Software, the Optical Survey Pipeline Reduction and Analysis Environment (OSPRAE), will be used to create these data releases and to perform the nightly alert production. This paper provides an overview of the LSST Science Pipelines Software, describing the components and how they are combined to form pipelines

Research Organization:
NSF-DOE Vera C. Rubin Observatory; U.S. National Science Foundation National Optical-Infrared Astronomy Research Laboratory; SLAC National Accelerator Laboratory
Sponsoring Organization:
U.S. National Science Foundation; U.S. Department of Energy Office of Science
DOE Contract Number:
AC02-76SF00515
OSTI ID:
2570545
Report Number(s):
Project Science Technical Note PSTN-019
Country of Publication:
United States
Language:
English

References (75)

GalSim: The modular galaxy image simulation toolkit journal April 2015
AST: A library for modelling and manipulating coordinate systems journal April 2016
scarlet: Source separation in multi-band images by Constrained Matrix Factorization journal July 2018
Mitigating satellite trails: A study of residual light after masking journal April 2022
Real-time line detection through an improved Hough transform voting scheme journal January 2008
Processing GOTO data with the Rubin Observatory LSST Science Pipelines I: Production of coadded frames journal January 2021
Array programming with NumPy journal September 2020
Shear calibration biases in weak-lensing surveys journal August 2003
The Visible and Infrared Survey Telescope for Astronomy (VISTA): Design, technical overview, and performance journal February 2015
GaaP: PSF- and aperture-matched photometry using shapelets journal March 2008
SExtractor: Software for source extraction journal June 1996
Integrating the PanDA Workload Management System with the Vera C. Rubin Observatory journal January 2024
Fast Algorithms for Matching CCD Images to a Stellar Catalogue journal January 2007
A Method for Optimal Image Subtraction journal August 1998
Astrometric Calibration of the Sloan Digital Sky Survey journal March 2003
Automating Discovery and Classification of Transients and Variable Stars in the Synoptic Survey Era
  • Bloom, J. S.; Richards, J. W.; Nugent, P. E.
  • Publications of the Astronomical Society of the Pacific, Vol. 124, Issue 921 https://doi.org/10.1086/668468
journal November 2012
Automated Transient Identification in the dark Energy Survey journal August 2015
The dark Energy Camera journal October 2015
Astrometric Calibration and Performance of the Dark Energy Camera journal May 2017
Photometry, Centroid and Point-spread Function Measurements in the LSST Camera Focal Plane Using Artificial Stars journal November 2023
Mitigation of the Brighter-fatter Effect in the LSST Camera journal April 2024
Spurious shear induced by the tree rings of the LSST CCDs journal August 2015
Properties of tree rings in LSST sensors journal May 2017
Dark Energy Survey year 3 results: point spread function modelling journal November 2020
Impact of point spread function higher moments error on weak gravitational lensing – II. A comprehensive study journal November 2022
Gravitational lensing analysis of the Kilo-Degree Survey journal October 2015
Real-bogus classification for the Zwicky Transient Facility using deep learning journal August 2019
The three-year shear catalog of the Subaru Hyper Suprime-Cam SSP Survey journal March 2022
Hyper Suprime-Cam: System design and verification of image quality journal September 2017
The Hyper Suprime-Cam software pipeline journal October 2017
The first-year shear catalog of the Subaru Hyper Suprime-Cam Subaru Strategic Program Survey journal December 2017
Building Software with SCons journal January 2005
Matplotlib: A 2D Graphics Environment journal January 2007
Systematic errors in weak lensing: application to SDSS galaxy-galaxy weak lensing journal August 2005
Tree rings in Large Synoptic Survey Telescope production sensors: its dependence on radius, wavelength, and back bias voltage journal January 2020
Investigating interoperability of the LSST data management software stack with Astropy conference July 2016
LSST data management software development practices and tools conference July 2018
Vera C. Rubin Observatory auxiliary telescope commissioning as a control system pathfinder conference December 2020
Prime Focus Spectrograph (PFS): the prime focus instrument conference December 2020
The Vera C. Rubin Observatory Data Butler and pipeline execution system conference August 2022
Rubin Observatory Simonyi survey telescope status overview conference August 2022
Sasquatch: Rubin Observatory metrics and telemetry service conference July 2024
LSST Camera focal plane optimization conference August 2024
Integrating the LSST camera conference July 2024
LSST camera verification testing and characterization conference July 2024
MODTRAN4 radiative transfer modeling for atmospheric correction
  • Berk, Alexander; Anderson, Gail P.; Bernstein, Lawrence S.
  • SPIE's International Symposium on Optical Science, Engineering, and Instrumentation, SPIE Proceedings https://doi.org/10.1117/12.366388
conference October 1999
MegaCam: the new Canada-France-Hawaii Telescope wide-field imaging camera conference March 2003
The Dark Energy Camera (DECam) conference August 2008
An open source application framework for astronomical imaging pipelines conference July 2010
Design and development of the 3.2 gigapixel camera for the Large Synoptic Survey Telescope conference July 2010
Qserv conference November 2011
Parsl: Pervasive Parallel Programming in Python
  • Babuji, Yadu; Foster, Ian; Wilde, Michael
  • Proceedings of the 28th International Symposium on High-Performance Parallel and Distributed Computing - HPDC '19 https://doi.org/10.1145/3307681.3325400
conference January 2019
Dark Energy Survey Year 6 Results: Point-Spread Function Modeling journal March 2025
Consequences of ccd Imperfections for Cosmology Determined by weak Lensing Surveys: from Laboratory Measurements to Cosmological Parameter bias journal June 2016
Proper Image Subtraction—Optimal Transient Detection, Photometry, and Hypothesis Testing journal October 2016
Forward Global Photometric Calibration of the Dark Energy Survey journal December 2017
The Astropy Project: Building an Open-science Project and Status of the v2.0 Core Package journal August 2018
HelioLinC: A Novel Approach to the Minor Planet Linking Problem journal August 2018
Mitigation of LEO Satellite Brightness and Trail Effects on the Rubin Observatory LSST journal October 2020
LSST: From Science Drivers to Reference Design and Anticipated Data Products journal March 2019
The Astropy Project: Sustaining and Growing a Community-oriented Open-source Project and the Latest Major Release (v5.0) of the Core Package* journal August 2022
Pan-STARRS Pixel Processing: Detrending, Warping, Stacking journal October 2020
DRAGONS—A Quick Overview journal October 2023
The LSST Data Management System preprint January 2015
Modern Python at the Large Synoptic Survey Telescope preprint January 2017
Proximal Adam: Robust Adaptive Update Scheme for Constrained Optimization preprint January 2019
PyTorch: An Imperative Style, High-Performance Deep Learning Library preprint January 2019
Rubin Science Platform on Google: the story so far text January 2021
Software Architecture and System Design of Rubin Observatory preprint January 2022
Adding Workflow Management Flexibility to LSST Pipelines Execution preprint January 2022
Data management and execution systems for the Rubin Observatory Science Pipelines preprint January 2023
Instrument Signature Removal and Calibration Products for the Rubin Legacy Survey of Space and Time text January 2024
Using Felis to Represent the Semantics and Metadata of Astronomical Data Catalogs preprint January 2024
The 2.5-meter Wide Field Survey Telescope Real-time Data Processing Pipeline I: From raw data to alert distribution preprint January 2025
HST Stellar Standards with 1% Accuracy in Absolute Flux preprint January 2006

Cited By (16)

RTN-095: The Vera C. Rubin Observatory Data Preview 1 dataset July 2025
SITCOMTN-154: Initial studies of photometric redshifts with LSSTComCam from DP1 dataset January 2025
SITCOMTN-161: PSF assessment in the field of Abell 360 and shapeHSM shear profile using LSSTComCam data dataset January 2025
RTN-055: Study of the Linearity of the CCDs of the Vera C. Rubin Observatory dataset January 2023
RTN-056: Study of the Photon Transfer Curve in the CCD detectors of the Vera C. Rubin Observatory dataset January 2023
DMTN-266: Astrometric Calibration in the LSST Pipeline dataset January 2024
RTN-011: Rubin Observatory Plans for an Early Science Program dataset January 2025
DMTN-312: The MultiProFit astronomical source modelling code dataset January 2025
DMTN-021: Implementation of Image Difference Decorrelation dataset January 2016
DMTN-031: Pessimistic Pattern Matching for LSST dataset January 2018
DMTN-036: jointcal: Simultaneous Astrometry & Photometry for thousands of Exposures with Large CCD Mosaics dataset January 2017
LSE-319: LSST Science Platform Vision Document dataset January 2019
DMTN-171: Fall 2020 status of crowded field processing with the LSST Alert Production Pipelines dataset January 2021
DMTN-260: Failure Modes and Error Handling for Prompt Processing dataset January 2024
LDM-612: Plans and Policies for LSST Alert Distribution dataset January 2020
SITCOMTN-162: Testing the implementation of Metadetection and Cell-Based Coadds on Abell 360 LSSTComCam data dataset January 2025

Similar Records

The LSST DESC DC2 Simulated Sky Survey
Journal Article · Thu Mar 11 23:00:00 EST 2021 · The Astrophysical Journal. Supplement Series · OSTI ID:1693446