skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs

Abstract

The use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline development and testing, and survey strategy optimization. The list of applications is growing with improvements in the quality of the catalogs and the details that they can provide. Given the importance of simulated catalogs, it is critical to provide rigorous validation protocols that enable both catalog providers and users to assess the quality of the catalogs in a straightforward and comprehensive way. For this purpose, we have developed the DESCQA framework for the Large Synoptic Survey Telescope Dark Energy Science Collaboration as well as for the broader community. The goal of DESCQA is to enable the inspection, validation, and comparison of an inhomogeneous set of synthetic catalogs via the provision of a common interface within an automated framework. Here in this paper, we present the design concept and first implementation of DESCQA. In order to establish and demonstrate its full functionality we use a set of interim catalogs and validationmore » tests. We highlight several important aspects, both technical and scientific, that require thoughtful consideration when designing a validation framework, including validation metrics and how these metrics impose requirements on the synthetic sky catalogs.« less

Authors:
ORCiD logo; ; ORCiD logo; ; ORCiD logo; ; ; ; ; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo more »; ORCiD logo; ORCiD logo; ; ORCiD logo; ORCiD logo; ; ORCiD logo « less
Publication Date:
Research Org.:
SLAC National Accelerator Lab., Menlo Park, CA (United States)
Sponsoring Org.:
USDOE
Contributing Org.:
The LSST Dark Energy Science Collaboration
OSTI Identifier:
1424028
Grant/Contract Number:  
AC02-76SF00515
Resource Type:
Journal Article: Accepted Manuscript
Journal Name:
The Astrophysical Journal. Supplement Series (Online)
Additional Journal Information:
Journal Name: The Astrophysical Journal. Supplement Series (Online); Journal Volume: 234; Journal Issue: 2; Journal ID: ISSN 1538-4365
Publisher:
American Astronomical Society/IOP
Country of Publication:
United States
Language:
English
Subject:
79 ASTRONOMY AND ASTROPHYSICS; large-scale structure of universe; methods: numerical

Citation Formats

Mao, Yao-Yuan, Kovacs, Eve, Heitmann, Katrin, Uram, Thomas D., Benson, Andrew J., Campbell, Duncan, Cora, Sofía A., DeRose, Joseph, Matteo, Tiziana Di, Habib, Salman, Hearin, Andrew P., Kalmbach, J. Bryce, Krughoff, K. Simon, Lanusse, François, Lukić, Zarija, Mandelbaum, Rachel, Newman, Jeffrey A., Padilla, Nelson, Paillas, Enrique, Pope, Adrian, Ricker, Paul M., Ruiz, Andrés N., Tenneti, Ananth, Vega-Martínez, Cristian A., Wechsler, Risa H., Zhou, Rongpu, and Zu, Ying. DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs. United States: N. p., 2018. Web. doi:10.3847/1538-4365/aaa6c3.
Mao, Yao-Yuan, Kovacs, Eve, Heitmann, Katrin, Uram, Thomas D., Benson, Andrew J., Campbell, Duncan, Cora, Sofía A., DeRose, Joseph, Matteo, Tiziana Di, Habib, Salman, Hearin, Andrew P., Kalmbach, J. Bryce, Krughoff, K. Simon, Lanusse, François, Lukić, Zarija, Mandelbaum, Rachel, Newman, Jeffrey A., Padilla, Nelson, Paillas, Enrique, Pope, Adrian, Ricker, Paul M., Ruiz, Andrés N., Tenneti, Ananth, Vega-Martínez, Cristian A., Wechsler, Risa H., Zhou, Rongpu, & Zu, Ying. DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs. United States. doi:10.3847/1538-4365/aaa6c3.
Mao, Yao-Yuan, Kovacs, Eve, Heitmann, Katrin, Uram, Thomas D., Benson, Andrew J., Campbell, Duncan, Cora, Sofía A., DeRose, Joseph, Matteo, Tiziana Di, Habib, Salman, Hearin, Andrew P., Kalmbach, J. Bryce, Krughoff, K. Simon, Lanusse, François, Lukić, Zarija, Mandelbaum, Rachel, Newman, Jeffrey A., Padilla, Nelson, Paillas, Enrique, Pope, Adrian, Ricker, Paul M., Ruiz, Andrés N., Tenneti, Ananth, Vega-Martínez, Cristian A., Wechsler, Risa H., Zhou, Rongpu, and Zu, Ying. Thu . "DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs". United States. doi:10.3847/1538-4365/aaa6c3.
@article{osti_1424028,
title = {DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs},
author = {Mao, Yao-Yuan and Kovacs, Eve and Heitmann, Katrin and Uram, Thomas D. and Benson, Andrew J. and Campbell, Duncan and Cora, Sofía A. and DeRose, Joseph and Matteo, Tiziana Di and Habib, Salman and Hearin, Andrew P. and Kalmbach, J. Bryce and Krughoff, K. Simon and Lanusse, François and Lukić, Zarija and Mandelbaum, Rachel and Newman, Jeffrey A. and Padilla, Nelson and Paillas, Enrique and Pope, Adrian and Ricker, Paul M. and Ruiz, Andrés N. and Tenneti, Ananth and Vega-Martínez, Cristian A. and Wechsler, Risa H. and Zhou, Rongpu and Zu, Ying},
abstractNote = {The use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline development and testing, and survey strategy optimization. The list of applications is growing with improvements in the quality of the catalogs and the details that they can provide. Given the importance of simulated catalogs, it is critical to provide rigorous validation protocols that enable both catalog providers and users to assess the quality of the catalogs in a straightforward and comprehensive way. For this purpose, we have developed the DESCQA framework for the Large Synoptic Survey Telescope Dark Energy Science Collaboration as well as for the broader community. The goal of DESCQA is to enable the inspection, validation, and comparison of an inhomogeneous set of synthetic catalogs via the provision of a common interface within an automated framework. Here in this paper, we present the design concept and first implementation of DESCQA. In order to establish and demonstrate its full functionality we use a set of interim catalogs and validation tests. We highlight several important aspects, both technical and scientific, that require thoughtful consideration when designing a validation framework, including validation metrics and how these metrics impose requirements on the synthetic sky catalogs.},
doi = {10.3847/1538-4365/aaa6c3},
journal = {The Astrophysical Journal. Supplement Series (Online)},
number = 2,
volume = 234,
place = {United States},
year = {Thu Feb 08 00:00:00 EST 2018},
month = {Thu Feb 08 00:00:00 EST 2018}
}

Journal Article:
Free Publicly Available Full Text
This content will become publicly available on February 8, 2019
Publisher's Version of Record

Citation Metrics:
Cited by: 1 work
Citation information provided by
Web of Science

Save / Share: