skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: DES science portal: Creating science-ready catalogs

Abstract

We present a novel approach for creating science-ready catalogs through a software infrastructure developed for the Dark Energy Survey (DES). We integrate the data products released by the DES Data Management and additional products created by the DES collaboration in an environment known as DES Science Portal. Each step involved in the creation of a science-ready catalog is recorded in a relational database and can be recovered at any time. We describe how the DES Science Portal automates the creation and characterization of lightweight catalogs for DES Year 1 Annual Release, and show its flexibility in creating multiple catalogs with different inputs and configurations. Finally, we discuss the advantages of this infrastructure for large surveys such as DES and the Large Synoptic Survey Telescope. The capability of creating science-ready catalogs efficiently and with full control of the inputs and configurations used is an important asset for supporting science analysis using data from large astronomical surveys.

Authors:
; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; more »; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ORCiD logo; ; ; « less
Publication Date:
Research Org.:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); SLAC National Accelerator Lab., Menlo Park, CA (United States); Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21); National Science Foundation (NSF); European Union (EU); Australian Research Council (ARC); USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
Contributing Org.:
[DES collaboration; DES Collaboration]
OSTI Identifier:
1468016
Alternate Identifier(s):
OSTI ID: 1410792
Report Number(s):
[arXiv:1708.05642; FERMILAB-PUB-17-088]
[Journal ID: ISSN 2213-1337]
Grant/Contract Number:  
[AC05-00OR22725; AC02-07CH11359; 157684/2015-6; AST-1138766; AST-1536171; AYA2015-71825, ESP2015-88861; FPA2015-68048; SEV-2012-0234; SEV-2016-0597; MDM-2015-0509]
Resource Type:
Accepted Manuscript
Journal Name:
Astronomy and Computing
Additional Journal Information:
[ Journal Volume: 24; Journal Issue: C]; Journal ID: ISSN 2213-1337
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
79 ASTRONOMY AND ASTROPHYSICS; Astronomical databases; Catalogs; Surveys—methods; Data analysis; 46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND TECHNOLOGY

Citation Formats

Fausti Neto, Angelo, da Costa, Luiz N., Carnero, A., Gschwend, J., Ogando, R. L. C., Sobreira, F., Maia, M. A. G., Santiago, B. X., Rosenfeld, R., Singulani, C., Adean, C., Nunes, L. D. P., Campisano, R., Brito, R., Soares, G., Vila-Verde, G. C., Abbott, T. M. C., Abdalla, F. B., Allam, S., Benoit-Lévy, A., Brooks, D., Buckley-Geer, E., Capozzi, D., Carrasco Kind, M., Carretero, J., D’Andrea, C. B., Desai, S., Doel, P., Drlica-Wagner, A., Evrard, A. E., Fosalba, P., García-Bellido, J., Gerdes, D. W., Gruendl, R. A., Gutierrez, G., Honscheid, K., James, D. J., Jeltema, T. E., Kuehn, K., Kuhlmann, S., Kuropatkin, N., Lahav, O., Lima, M., Marshall, J. L., Melchior, P., Menanteau, F., Plazas, A., Sanchez, E., Scarpine, V., Schindler, R., Schubnell, M., Sevilla-Noarbe, I., Smith, M., Smith, R. C., Suchyta, Eric, Swanson, M. E. C., Tarle, G., and Walker, A. R. DES science portal: Creating science-ready catalogs. United States: N. p., 2018. Web. doi:10.1016/j.ascom.2018.01.002.
Fausti Neto, Angelo, da Costa, Luiz N., Carnero, A., Gschwend, J., Ogando, R. L. C., Sobreira, F., Maia, M. A. G., Santiago, B. X., Rosenfeld, R., Singulani, C., Adean, C., Nunes, L. D. P., Campisano, R., Brito, R., Soares, G., Vila-Verde, G. C., Abbott, T. M. C., Abdalla, F. B., Allam, S., Benoit-Lévy, A., Brooks, D., Buckley-Geer, E., Capozzi, D., Carrasco Kind, M., Carretero, J., D’Andrea, C. B., Desai, S., Doel, P., Drlica-Wagner, A., Evrard, A. E., Fosalba, P., García-Bellido, J., Gerdes, D. W., Gruendl, R. A., Gutierrez, G., Honscheid, K., James, D. J., Jeltema, T. E., Kuehn, K., Kuhlmann, S., Kuropatkin, N., Lahav, O., Lima, M., Marshall, J. L., Melchior, P., Menanteau, F., Plazas, A., Sanchez, E., Scarpine, V., Schindler, R., Schubnell, M., Sevilla-Noarbe, I., Smith, M., Smith, R. C., Suchyta, Eric, Swanson, M. E. C., Tarle, G., & Walker, A. R. DES science portal: Creating science-ready catalogs. United States. doi:10.1016/j.ascom.2018.01.002.
Fausti Neto, Angelo, da Costa, Luiz N., Carnero, A., Gschwend, J., Ogando, R. L. C., Sobreira, F., Maia, M. A. G., Santiago, B. X., Rosenfeld, R., Singulani, C., Adean, C., Nunes, L. D. P., Campisano, R., Brito, R., Soares, G., Vila-Verde, G. C., Abbott, T. M. C., Abdalla, F. B., Allam, S., Benoit-Lévy, A., Brooks, D., Buckley-Geer, E., Capozzi, D., Carrasco Kind, M., Carretero, J., D’Andrea, C. B., Desai, S., Doel, P., Drlica-Wagner, A., Evrard, A. E., Fosalba, P., García-Bellido, J., Gerdes, D. W., Gruendl, R. A., Gutierrez, G., Honscheid, K., James, D. J., Jeltema, T. E., Kuehn, K., Kuhlmann, S., Kuropatkin, N., Lahav, O., Lima, M., Marshall, J. L., Melchior, P., Menanteau, F., Plazas, A., Sanchez, E., Scarpine, V., Schindler, R., Schubnell, M., Sevilla-Noarbe, I., Smith, M., Smith, R. C., Suchyta, Eric, Swanson, M. E. C., Tarle, G., and Walker, A. R. Tue . "DES science portal: Creating science-ready catalogs". United States. doi:10.1016/j.ascom.2018.01.002. https://www.osti.gov/servlets/purl/1468016.
@article{osti_1468016,
title = {DES science portal: Creating science-ready catalogs},
author = {Fausti Neto, Angelo and da Costa, Luiz N. and Carnero, A. and Gschwend, J. and Ogando, R. L. C. and Sobreira, F. and Maia, M. A. G. and Santiago, B. X. and Rosenfeld, R. and Singulani, C. and Adean, C. and Nunes, L. D. P. and Campisano, R. and Brito, R. and Soares, G. and Vila-Verde, G. C. and Abbott, T. M. C. and Abdalla, F. B. and Allam, S. and Benoit-Lévy, A. and Brooks, D. and Buckley-Geer, E. and Capozzi, D. and Carrasco Kind, M. and Carretero, J. and D’Andrea, C. B. and Desai, S. and Doel, P. and Drlica-Wagner, A. and Evrard, A. E. and Fosalba, P. and García-Bellido, J. and Gerdes, D. W. and Gruendl, R. A. and Gutierrez, G. and Honscheid, K. and James, D. J. and Jeltema, T. E. and Kuehn, K. and Kuhlmann, S. and Kuropatkin, N. and Lahav, O. and Lima, M. and Marshall, J. L. and Melchior, P. and Menanteau, F. and Plazas, A. and Sanchez, E. and Scarpine, V. and Schindler, R. and Schubnell, M. and Sevilla-Noarbe, I. and Smith, M. and Smith, R. C. and Suchyta, Eric and Swanson, M. E. C. and Tarle, G. and Walker, A. R.},
abstractNote = {We present a novel approach for creating science-ready catalogs through a software infrastructure developed for the Dark Energy Survey (DES). We integrate the data products released by the DES Data Management and additional products created by the DES collaboration in an environment known as DES Science Portal. Each step involved in the creation of a science-ready catalog is recorded in a relational database and can be recovered at any time. We describe how the DES Science Portal automates the creation and characterization of lightweight catalogs for DES Year 1 Annual Release, and show its flexibility in creating multiple catalogs with different inputs and configurations. Finally, we discuss the advantages of this infrastructure for large surveys such as DES and the Large Synoptic Survey Telescope. The capability of creating science-ready catalogs efficiently and with full control of the inputs and configurations used is an important asset for supporting science analysis using data from large astronomical surveys.},
doi = {10.1016/j.ascom.2018.01.002},
journal = {Astronomy and Computing},
number = [C],
volume = [24],
place = {United States},
year = {2018},
month = {5}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 1 work
Citation information provided by
Web of Science

Save / Share: