Organizing the Extremely Large LSST Database forReal-Time Astronomical Processing

Conference · Wed Nov 07 00:00:00 EST 2007

OSTI ID:919415

Becla, Jacek; Lim, Kian-Tat; Monkewitz, Serge; Nieto-Santisteban, Maria; Thakar, Ani

The Large Synoptic Survey Telescope (LSST) will catalog billions of astronomical objects and trillions of sources, all of which will be stored and managed by a database management system. One of the main challenges is real-time alert generation. To generate alerts, up to 100K new difference detections have to be cross-correlated with the huge historical catalogs, and then further processed to prune false alerts. This paper explains the challenges, the implementation of the LSST Association Pipeline and the database organization strategies we are planning to use to meet the real-time requirements, including data partitioning, parallelization, and pre-loading.

• Research Organization: SLAC National Accelerator Lab., Menlo Park, CA (United States)
• Sponsoring Organization: USDOE
• DOE Contract Number: AC02-76SF00515
• OSTI ID: 919415
• Report Number(s): SLAC-PUB-12962; TRN: US200822%%279
• Resource Relation: Conference: Contributed to 17th Annual Astronomical Data Analysis Software and Systems Conference (ADASS 2007), London, England, 23-26 Sep 2007
• Country of Publication: United States
• Language: English

Related Subjects

99 GENERAL AND MISCELLANEOUS//MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE
79 ASTRONOMY AND ASTROPHYSICS
DATA ANALYSIS
ORGANIZING
TELESCOPES
DATA BASE MANAGEMENT
DATA PROCESSING
ASTROPHYSICS
REAL TIME SYSTEMS
Astrophysics
ASTRO