Simulation of the Future LSST Data Pipelines
In this paper we describe our approach to build a pipeline simulator for the future Large-scale Synoptic Survey Telescope (LSST). The simulated pipeline will be used to research and evaluate software architectures that are efficient and flexible. It will also be used to define the real-time software and hardware requirements needed to support the anticipated LSST data rates. The LSST data pipeline requirements are still being defined, however, previous surveys can provide a good source for data requirements. Our approach is to use the SuperMacho data pipeline as a prototyping tool to identify a framework for building Modular Data-Centric Pipeline (MDCP) architectures. The prototyping is done in a hierarchical fashion to help capture and define the general data attributes (schema) first. We then model other necessary components based on science and performance requirements. We use identified schemas or data attributes as a way to define a data model for LSST.
- Research Organization:
- Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- W-7405-ENG-48
- OSTI ID:
- 15014574
- Report Number(s):
- UCRL-CONF-205562; TRN: US200802%%1347
- Resource Relation:
- Conference: Presented at: Astronomical Data Analysis Software & Systems XIV, Pasadena, CA, United States, Oct 24 - Oct 27, 2004
- Country of Publication:
- United States
- Language:
- English
Similar Records
Numerical Codes for the DESC-LSST Analysis Pipeline: Core Cosmology Library Standard Modules and Beyond wCDM Modules (Final Technical Report)
Probing the Physics of Dark Energy with LSST: Large Scale Structure and Supernovae