Skip to main content
OSTI.GOVU.S. Department of Energy Office of Scientific and Technical Information
U.S. Department of Energy
Office of Scientific and Technical Information
 

Overview of the distributed image processing infrastructure to produce the Legacy Survey of Space and Time

Journal Article · · EPJ Web of Conferences (Online)
 [1];  [2];  [2];  [3];  [4];  [5];  [1];  [3];  [1];  [6];  [7];  [8]
  1. Centre National de la Recherche Scientifique (CNRS) (France)
  2. University of Edinburgh (United Kingdom)
  3. Lancaster University (United Kingdom)
  4. Vera C. Rubin Observatory Project Office, Tucson, AZ (United States)
  5. Brookhaven National Laboratory (BNL), Upton, NY (United States)
  6. Science and Technology Facilities Council (STFC), Harwell (United Kingdom)
  7. Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
  8. SLAC National Accelerator Laboratory (SLAC), Menlo Park, CA (United States)
+ Show Author Affiliations
The Vera C. Rubin Observatory is preparing to execute the most ambitious astronomical survey ever attempted, the Legacy Survey of Space and Time (LSST). Currently the final phase of construction is under way in the Chilean Andes, with the Observatory’s ten-year science mission scheduled to begin in 2025. Rubin’s 8.4-meter telescope will nightly scan the southern hemisphere collecting imagery in the wavelength range 320–1050 nm covering the entire observable sky every 4 nights using a 3.2 gigapixel camera, the largest imaging device ever built for astronomy. Automated detection and classification of celestial objects will be performed by sophisticated algorithms on high-resolution images to progressively produce an astronomical catalog eventually composed of 20 billion galaxies and 17 billion stars and their associated physical properties. In this article we present an overview of the system currently being constructed to perform data distribution as well as the annual campaigns which reprocess the entire image dataset collected since the beginning of the survey. These processing campaigns will utilize computing and storage resources provided by three Rubin data facilities (one in the US and two in Europe). Each year a Data Release will be produced and disseminated to science collaborations for use in studies comprising four main science pillars: probing dark matter and dark energy, taking inventory of solar system objects, exploring the transient optical sky and mapping the Milky Way. Also presented is the method by which we leverage some of the common tools and best practices used for management of large-scale distributed data processing projects in the high energy physics and astronomy communities. We also demonstrate how these tools and practices are utilized within the Rubin project in order to overcome the specific challenges faced by the Observatory.
Research Organization:
Brookhaven National Laboratory (BNL), Upton, NY (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Nuclear Physics (NP)
Grant/Contract Number:
SC0012704
OSTI ID:
2281341
Alternate ID(s):
OSTI ID: 2475109
Report Number(s):
BNL--225136-2023-JAAM
Journal Information:
EPJ Web of Conferences (Online), Journal Name: EPJ Web of Conferences (Online) Vol. 295; ISSN 2100-014X
Publisher:
EDP SciencesCopyright Statement
Country of Publication:
United States
Language:
English

References (3)

Rucio: Scientific Data Management journal August 2019
Parsl: Pervasive Parallel Programming in Python
  • Babuji, Yadu; Foster, Ian; Wilde, Michael
  • Proceedings of the 28th International Symposium on High-Performance Parallel and Distributed Computing - HPDC '19 https://doi.org/10.1145/3307681.3325400
conference January 2019
LSST: From Science Drivers to Reference Design and Anticipated Data Products journal March 2019

Similar Records

Overview of the distributed image processing infrastructure to produce the Legacy Survey of Space and Time
Conference · Wed May 01 00:00:00 EDT 2024 · EPJ Web Conf. · OSTI ID:2475109

Related Subjects

79 ASTRONOMY AND ASTROPHYSICS