LDM-151: Data Management Science Pipelines Design

Swinbank, John D.; Axelrod, Tim S.; Becker, Andrew C.; Becla, Jacek; Bellm, Eric C.; Bosch, James F.; Chiang, Hsin-Fang; Ciardi, David R.; Connolly, Andrew J.; Dubois-Felsmann, Gregory P.; Economou, Frossie; Fisher-Levine, Merlin; Graham, Melissa L.; Ivezić, Željko; Jurić, Mario; Jenness, Tim; Jones, R. Lynne; Kantor, Jeffrey P.; Krughoff, K. Simon; Lim, Kian-Tat; Lupton, Robert H.; Mueller, Fritz; Petravick, Donald L.; Price, Paul A.; Reiss, David J.; Shaw, Richard A.; Slater, Colin T.; Wood-Vasey, W. M.; Wu, Xiuqin; Yoachim, Peter

doi:10.71929/rubin/2587108

Title: LDM-151: Data Management Science Pipelines Design

Dataset
Other Related Research

Abstract

The LSST Science Requirements Document (the LSST SRD) specifies a set of data product guidelines, designed to support science goals envisioned to be enabled by the LSST observing program. Following these guidelines, the details of these data products have been described in the LSST Data Products Definition Document (DPDD), and captured in a formal flow-down from the SRD via the LSST System Requirements (LSR), Observatory System Specifications (OSS), to the Data Management System Requirements (DMSR). The LSST Data Management subsystem's responsibilities include the design, implementation, deployment and execution of software pipelines necessary to generate these data products. This document describes the design of the scientific aspects of those pipelines.

Authors:

;

; Becla, Jacek;

;

; Kantor, Jeffrey P.;

;

ASTRON; Department of Astrophysical Sciences, Princeton University
Steward Observatory, University of Arizona
Amazon Web Services
SLAC National Accelerator Laboratory
Dept. of Astronomy, University of Washington
Department of Astrophysical Sciences, Princeton University
Caltech/IPAC, California Institute of Technology
Institute for Data-intensive Research in Astrophysics and Cosmology, University of Washington
Vera C. Rubin Observatory Project Office
D4D CONSULTING LTD.
Dept. of Astronomy, University of Washington; Institute for Data-intensive Research in Astrophysics and Cosmology, University of Washington
Vera C. Rubin Observatory Project Office; Dept. of Astronomy, University of Washington
National Center for Supercomputing Applications, University of Illinois at Urbana-Champaign
Space Telescope Science Institute
Department of Physics and Astronomy, University of Pittsburgh

Publication Date:: Mon Nov 09 23:00:00 EST 2020

Other Number(s):: Vera C. Rubin Observatory Data Management Controlled Document LDM-151

DOE Contract Number:: AC02-76SF00515

Research Org.:: NSF-DOE Vera C. Rubin Observatory; NSF-DOE Vera C. Rubin Observatory; U.S. National Science Foundation National Optical-Infrared Astronomy Research Laboratory; SLAC National Accelerator Laboratory

Sponsoring Org.:: U.S. National Science Foundation; U.S. Department of Energy Office of Science

Subject:: 79 ASTRONOMY AND ASTROPHYSICS

OSTI Identifier:: 2587108

DOI:: https://doi.org/10.71929/rubin/2587108

Citation Formats


                    Swinbank, John D., Axelrod, Tim S., Becker, Andrew C., Becla, Jacek, Bellm, Eric C., Bosch, James F., Chiang, Hsin-Fang, Ciardi, David R., Connolly, Andrew J., Dubois-Felsmann, Gregory P., Economou, Frossie, Fisher-Levine, Merlin, Graham, Melissa L., Ivezić, Željko, Jurić, Mario, Jenness, Tim, Jones, R. Lynne, Kantor, Jeffrey P., Krughoff, K. Simon, Lim, Kian-Tat, Lupton, Robert H., Mueller, Fritz, Petravick, Donald L., Price, Paul A., Reiss, David J., Shaw, Richard A., Slater, Colin T., Wood-Vasey, W. M., Wu, Xiuqin, and Yoachim, Peter. LDM-151: Data Management Science Pipelines Design.  United States: N. p., 2020. 
        Web.  doi:10.71929/rubin/2587108.

Copy to clipboard


                    Swinbank, John D., Axelrod, Tim S., Becker, Andrew C., Becla, Jacek, Bellm, Eric C., Bosch, James F., Chiang, Hsin-Fang, Ciardi, David R., Connolly, Andrew J., Dubois-Felsmann, Gregory P., Economou, Frossie, Fisher-Levine, Merlin, Graham, Melissa L., Ivezić, Željko, Jurić, Mario, Jenness, Tim, Jones, R. Lynne, Kantor, Jeffrey P., Krughoff, K. Simon, Lim, Kian-Tat, Lupton, Robert H., Mueller, Fritz, Petravick, Donald L., Price, Paul A., Reiss, David J., Shaw, Richard A., Slater, Colin T., Wood-Vasey, W. M., Wu, Xiuqin, & Yoachim, Peter. LDM-151: Data Management Science Pipelines Design.  United States.  doi:https://doi.org/10.71929/rubin/2587108

Copy to clipboard


                    Swinbank, John D., Axelrod, Tim S., Becker, Andrew C., Becla, Jacek, Bellm, Eric C., Bosch, James F., Chiang, Hsin-Fang, Ciardi, David R., Connolly, Andrew J., Dubois-Felsmann, Gregory P., Economou, Frossie, Fisher-Levine, Merlin, Graham, Melissa L., Ivezić, Željko, Jurić, Mario, Jenness, Tim, Jones, R. Lynne, Kantor, Jeffrey P., Krughoff, K. Simon, Lim, Kian-Tat, Lupton, Robert H., Mueller, Fritz, Petravick, Donald L., Price, Paul A., Reiss, David J., Shaw, Richard A., Slater, Colin T., Wood-Vasey, W. M., Wu, Xiuqin, and Yoachim, Peter. 2020.  
"LDM-151: Data Management Science Pipelines Design".  United States.  doi:https://doi.org/10.71929/rubin/2587108.  https://www.osti.gov/servlets/purl/2587108. Pub date:Mon Nov 09 23:00:00 EST 2020

Copy to clipboard


                    
@article{osti_2587108,

  title        = {LDM-151: Data Management Science Pipelines Design},

  author       = {Swinbank, John D. and Axelrod, Tim S. and Becker, Andrew C. and Becla, Jacek and Bellm, Eric C. and Bosch, James F. and Chiang, Hsin-Fang and Ciardi, David R. and Connolly, Andrew J. and Dubois-Felsmann, Gregory P. and Economou, Frossie and Fisher-Levine, Merlin and Graham, Melissa L. and Ivezić, Željko and Jurić, Mario and Jenness, Tim and Jones, R. Lynne and Kantor, Jeffrey P. and Krughoff, K. Simon and Lim, Kian-Tat and Lupton, Robert H. and Mueller, Fritz and Petravick, Donald L. and Price, Paul A. and Reiss, David J. and Shaw, Richard A. and Slater, Colin T. and Wood-Vasey, W. M. and Wu, Xiuqin and Yoachim, Peter},

  abstractNote = {The LSST Science Requirements Document (the LSST SRD) specifies a set of data product guidelines, designed to support science goals envisioned to be enabled by the LSST observing program. Following these guidelines, the details of these data products have been described in the LSST Data Products Definition Document (DPDD), and captured in a formal flow-down from the SRD via the LSST System Requirements (LSR), Observatory System Specifications (OSS), to the Data Management System Requirements (DMSR). The LSST Data Management subsystem's responsibilities include the design, implementation, deployment and execution of software pipelines necessary to generate these data products. This document describes the design of the scientific aspects of those pipelines.},

  doi          = {10.71929/rubin/2587108},

  journal      = {},

  number       = ,

  volume       = ,

  place        = {United States},

  year         = {Mon Nov 09 23:00:00 EST 2020},

  month        = {Mon Nov 09 23:00:00 EST 2020}

}

Copy to clipboard

Dataset:

View Dataset

DOI: https://doi.org/10.71929/rubin/2587108

Save / Share:

Export Metadata

Save to My Library

Similar records in DOE Data Explorer and OSTI.GOV collections:

LDM-148: Rubin Observatory Data Management System Design

Dataset Lim, Kian-Tat ; Bosch, James F. ; Dubois-Felsmann, Gregory P. ; ...

The Rubin Observatory LSST Data Management System (DMS) is a set of services employing a variety of software components running on computational and networking infrastructure that combine to deliver science data products to the observatory's users and support observatory operations. This document describes the components, their service instances, and their deployment environments as well as the interfaces among them, the rest of the LSST system, and the outside world.
PSTN-019: The LSST Science Pipelines Software: Optical Survey Pipeline Reduction and Analysis Environment

Dataset

The NSF-DOE Vera C. Rubin Observatory will produce the Legacy Survey of Space and Time (LSST), producing 11 data releases over the ten-year survey. The LSST Science Pipelines Software, the Optical Survey Pipeline Reduction and Analysis Environment (OSPRAE), will be used to create these data releases and to perform the nightly alert production. This paper provides an overview of the LSST Science Pipelines Software, describing the components and how they are combined to form pipelines
LDM-612: Plans and Policies for LSST Alert Distribution

Dataset Bellm, Eric C. ; Blum, Robert D. ; Graham, Melissa L. ; ...

A major product of the nightly processing of LSST images is a world-public stream of alerts from transient, variable, and moving sources. Science users will access these alerts through community brokers or through a simple filtering service provided by LSST. This document provides a guide to the plans and policies for the alert distribution system to aid science users, broker developers, funding agencies, and LSST Project personnel. It describes the components of the alert distribution system and the data rights required to access specific scientific products. It provides guidelines for organizations developing community brokers and describes the planned capabilities ofmore »« less
Data for NB6 HBRR Science Design ORNL/TM-2025/3807

Dataset Granroth, Garrett E

Data for the report (ORNL/TM-2025/3807) that describes the calculations and the Monte Carlo Ray Tracing simulations performed using the McStas package to determine the coatings and geometry for the NB-6 guide. It provides the information to inform the mechanical design, validation tests and verification that it meets the science requirements.
Data for NB6 HBRR Science Design ORNL/TM-2025/3807

Dataset Granroth, Garrett

Data for the report (ORNL/TM-2025/3807) that describes the calculations and the Monte Carlo Ray Tracing simulations performed using the McStas package to determine the coatings and geometry for the NB-6 guide. It provides the information to inform the mechanical design, validation tests and verification that it meets the science requirements.

Similar Records