DeepCMB: Lensing reconstruction of the cosmic microwave background with deep neural networks

Caldeira, J.; Wu, W. L.K.; Nord, B.; Avestruz, C.; Trivedi, S.; Story, K. T.

doi:10.1016/j.ascom.2019.100307

Title: DeepCMB: Lensing reconstruction of the cosmic microwave background with deep neural networks

Journal Article · Mon Jul 01 00:00:00 EDT 2019 · Astronomy and Computing

DOI:https://doi.org/10.1016/j.ascom.2019.100307· OSTI ID:1487051

^[1]; Wu, W. L.K. ^[2]; Nord, B. ^[3]; Avestruz, C. ^[4]; Trivedi, S. ^[5]; Story, K. T. ^[6]

Univ. of Chicago, IL (United States). Enrico Fermi Inst. and Kadanoff Center for Theoretical Physics; Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Univ. of Chicago, IL (United States). Kavli Inst. for Cosmological Physics (KICP)
Univ. of Chicago, IL (United States). Kavli Inst. for Cosmological Physics (KICP); Univ. of Chicago, IL (United States). Dept. of Astronomy and Astropysics; Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Univ. of Chicago, IL (United States). Enrico Fermi Inst. and Kadanoff Center for Theoretical Physics; Univ. of Chicago, IL (United States). Kavli Inst. for Cosmological Physics (KICP)
Brown Univ., Providence, RI (United States). Inst. for Computational and Experimental Research in Mathematics
Descartes Labs, Santa Fe, CA (United States)

Next-generation cosmic microwave background (CMB) experiments will have lower noise and therefore increased sensitivity, enabling improved constraints on fundamental physics parameters such as the sum of neutrino masses and the tensor-to-scalar ratio r. Achieving competitive constraints on these parameters requires high signal-to-noise extraction of the projected gravitational potential from the CMB maps. Standard methods for reconstructing the lensing potential employ the quadratic estimator (QE). However, the QE performs suboptimally at the low noise levels expected in upcoming experiments. Other methods, like maximum likelihood estimators (MLE), are under active development. In this work, we demonstrate reconstruction of the CMB lensing potential with deep convolutional neural networks (CNN) - ie, a ResUNet. The network is trained and tested on simulated data, and otherwise has no physical parametrization related to the physical processes of the CMB and gravitational lensing. We show that, over a wide range of angular scales, ResUNets recover the input gravitational potential with a higher signal-to-noise ratio than the QE method, reaching levels comparable to analytic approximations of MLE methods. We demonstrate that the network outputs quantifiably different lensing maps when given input CMB maps generated with different cosmologies. We also show we can use the reconstructed lensing map for cosmological parameter estimation. This application of CNN provides a few innovations at the intersection of cosmology and machine learning. First, while training and regressing on images, we predict a continuous-variable field rather than discrete classes. Second, we are able to establish uncertainty measures for the network output that are analogous to standard methods. We expect this approach to excel in capturing hard-to-model non-Gaussian astrophysical foreground and noise contributions.

View Accepted Manuscript (DOE)

View Accepted Manuscript (Publisher)

Cite

Export

Save

Research Organization:: Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)

Sponsoring Organization:: USDOE Office of Science (SC), High Energy Physics (HEP)

Grant/Contract Number:: AC02-07CH11359

OSTI ID:: 1487051

Alternate ID(s):: OSTI ID: 1780551

Report Number(s):: arXiv:1810.01483; FERMILAB-PUB-18-515-A-CD; oai:inspirehep.net:1696852

Journal Information:: Astronomy and Computing, Vol. 28, Issue C; ISSN 2213-1337

Publisher:: ElsevierCopyright Statement

Country of Publication:: United States

Language:: English

Citation Metrics:

Cited by: 48 works

Citation information provided by
Web of Science

References (43)

Measurement of the Cosmic Microwave Background Polarization Lensing Power Spectrum with the POLARBEAR Experiment Ade, P. A. R.; Akiba, Y.; Anthony, A. E. Physical Review Letters, Vol. 113, Issue 2 https://doi.org/10.1103/PhysRevLett.113.021301	journal	July 2014
NINE-YEAR WILKINSON MICROWAVE ANISOTROPY PROBE ( WMAP ) OBSERVATIONS: FINAL MAPS AND RESULTS Bennett, C. L.; Larson, D.; Weiland, J. L. The Astrophysical Journal Supplement Series, Vol. 208, Issue 2 https://doi.org/10.1088/0067-0049/208/2/20	journal	September 2013
Constraints on Primordial Gravitational Waves Using $P l a n c k$ , WMAP, and New BICEP2/ $K e c k$ Observations through the 2015 Season Ade, P. A. R.; Ahmed, Z.; Aikin, R. W. Physical Review Letters, Vol. 121, Issue 22 https://doi.org/10.1103/PhysRevLett.121.221301	journal	November 2018
Bicep2/ KECK ARRAY VIII: MEASUREMENT OF GRAVITATIONAL LENSING FROM LARGE-SCALE B -MODE POLARIZATION Ade, P. A. R.; Ahmed, Z.; Aikin, R. W. The Astrophysical Journal, Vol. 833, Issue 2 https://doi.org/10.3847/1538-4357/833/2/228	journal	December 2016
Improved Constraints on Cosmology and Foregrounds from BICEP2 and Keck Array Cosmic Microwave Background Data with Inclusion of 95 GHz Band Ade, P. A. R.; Ahmed, Z.; Aikin, R. W. Physical Review Letters, Vol. 116, Issue 3 https://doi.org/10.1103/PhysRevLett.116.031302	journal	January 2016
Learning the hidden structure of speech Elman, Jeffrey L.; Zipser, David The Journal of the Acoustical Society of America, Vol. 83, Issue 4 https://doi.org/10.1121/1.395916	journal	April 1988
Deep Residual Learning for Image Recognition He, Kaiming; Zhang, Xiangyu; Ren, Shaoqing 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2016.90	conference	June 2016
Measurements of the Temperature and E-mode Polarization of the CMB from 500 Square Degrees of SPTpol Data Henning, J. W.; Sayre, J. T.; Reichardt, C. L. The Astrophysical Journal, Vol. 852, Issue 2 https://doi.org/10.3847/1538-4357/aa9ff4	journal	January 2018
NINE-YEAR WILKINSON MICROWAVE ANISOTROPY PROBE ( WMAP ) OBSERVATIONS: COSMOLOGICAL PARAMETER RESULTS Hinshaw, G.; Larson, D.; Komatsu, E. The Astrophysical Journal Supplement Series, Vol. 208, Issue 2 https://doi.org/10.1088/0067-0049/208/2/19	journal	September 2013
Reducing the Dimensionality of Data with Neural Networks Hinton, G. E. Science, Vol. 313, Issue 5786 https://doi.org/10.1126/science.1127647	journal	July 2006
Reconstruction of lensing from the cosmic microwave background polarization Hirata, Christopher M.; Seljak, Uroš Physical Review D, Vol. 68, Issue 8 https://doi.org/10.1103/PhysRevD.68.083002	journal	October 2003
Weak lensing of the CMB: A harmonic approach Hu, Wayne Physical Review D, Vol. 62, Issue 4 https://doi.org/10.1103/PhysRevD.62.043007	journal	July 2000
Mass Reconstruction with Cosmic Microwave Background Polarization Hu, Wayne; Okamoto, Takemi The Astrophysical Journal, Vol. 574, Issue 2 https://doi.org/10.1086/341110	journal	August 2002
A Probe of Primordial Gravity Waves and Vorticity Kamionkowski, Marc; Kosowsky, Arthur; Stebbins, Albert Physical Review Letters, Vol. 78, Issue 11 https://doi.org/10.1103/PhysRevLett.78.2058	journal	March 1997
MEASUREMENTS OF SUB-DEGREE B -MODE POLARIZATION IN THE COSMIC MICROWAVE BACKGROUND FROM 100 SQUARE DEGREES OF SPTPOL DATA Keisler, R.; Hoover, S.; Harrington, N. The Astrophysical Journal, Vol. 807, Issue 2 https://doi.org/10.1088/0004-637X/807/2/151	journal	July 2015
Lensing reconstruction with CMB temperature and polarization Kesden, Michael; Cooray, Asantha; Kamionkowski, Marc Physical Review D, Vol. 67, Issue 12 https://doi.org/10.1103/PhysRevD.67.123507	journal	June 2003
Cosmological parameters from the first results of Boomerang Lange, A. E.; Ade, P. A. R.; Bock, J. J. Physical Review D, Vol. 63, Issue 4 https://doi.org/10.1103/PhysRevD.63.042001	journal	January 2001
Weak gravitational lensing of the CMB Lewis, A.; Challinor, A. Physics Reports, Vol. 429, Issue 1 https://doi.org/10.1016/j.physrep.2006.03.002	journal	June 2006
Efficient Computation of Cosmic Microwave Background Anisotropies in Closed Friedmann‐Robertson‐Walker Models Lewis, Antony; Challinor, Anthony; Lasenby, Anthony The Astrophysical Journal, Vol. 538, Issue 2 https://doi.org/10.1086/309179	journal	August 2000
The Atacama Cosmology Telescope: two-season ACTPol spectra and parameters Louis, Thibaut; Grace, Emily; Hasselfield, Matthew Journal of Cosmology and Astroparticle Physics, Vol. 2017, Issue 06 https://doi.org/10.1088/1475-7516/2017/06/031	journal	June 2017
CMB Polarization B -mode Delensing with SPTpol and Herschel Manzotti, A.; Story, K. T.; Wu, W. L. K. The Astrophysical Journal, Vol. 846, Issue 1 https://doi.org/10.3847/1538-4357/aa82bb	journal	August 2017
Measurement of the cosmic microwave background spectrum by the COBE FIRAS instrument Mather, J. C.; Cheng, E. S.; Cottingham, D. A. The Astrophysical Journal, Vol. 420 https://doi.org/10.1086/173574	journal	January 1994
Mission Design of LiteBIRD Matsumura, T.; Akiba, Y.; Borrill, J. Journal of Low Temperature Physics, Vol. 176, Issue 5-6 https://doi.org/10.1007/s10909-013-0996-1	journal	January 2014
A high-bias, low-variance introduction to Machine Learning for physicists Mehta, Pankaj; Bukov, Marin; Wang, Ching-Hao Physics Reports, Vol. 810 https://doi.org/10.1016/j.physrep.2019.03.001	journal	May 2019
Bayesian delensing of CMB temperature and polarization Millea, Marius; Anderes, Ethan; Wandelt, Benjamin D. Physical Review D, Vol. 100, Issue 2 https://doi.org/10.1103/PhysRevD.100.023509	journal	July 2019
A 2500 deg ² CMB Lensing Map from Combined South Pole Telescope and Planck Data Omori, Y.; Chown, R.; Simard, G. The Astrophysical Journal, Vol. 849, Issue 2 https://doi.org/10.3847/1538-4357/aa8d1d	journal	November 2017
DeepSphere: Efficient spherical convolutional neural network with HEALPix sampling for cosmological applications Perraudin, N.; Defferrard, M.; Kacprzak, T. Astronomy and Computing, Vol. 27 https://doi.org/10.1016/j.ascom.2019.03.004	journal	April 2019
Planck 2015 results : XIII. Cosmological parameters Ade, P. A. R.; Aghanim, N.; Arnaud, M. Astronomy & Astrophysics, Vol. 594 https://doi.org/10.1051/0004-6361/201525830	journal	September 2016
Planck 2015 results : XV. Gravitational lensing Ade, P. A. R.; Aghanim, N.; Arnaud, M. Astronomy & Astrophysics, Vol. 594 https://doi.org/10.1051/0004-6361/201525941	journal	September 2016
A Measurement of the Cosmic Microwave Background B -mode Polarization Power Spectrum at Subdegree Scales from Two Years of polarbear Data Ade, P. A. R.; Aguilar, M.; Akiba, Y. The Astrophysical Journal, Vol. 848, Issue 2 https://doi.org/10.3847/1538-4357/aa8e9f	journal	October 2017
U-Net: Convolutional Networks for Biomedical Image Segmentation Ronneberger, Olaf; Fischer, Philipp; Brox, Thomas Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III https://doi.org/10.1007/978-3-319-24574-4_28	book	November 2015
Signature of Gravity Waves in the Polarization of the Microwave Background Seljak, Uros̆; Zaldarriaga, Matias Physical Review Letters, Vol. 78, Issue 11 https://doi.org/10.1103/PhysRevLett.78.2054	journal	March 1997
Two-season Atacama Cosmology Telescope polarimeter lensing power spectrum Sherwin, Blake D.; van Engelen, Alexander; Sehgal, Neelima Physical Review D, Vol. 95, Issue 12 https://doi.org/10.1103/PhysRevD.95.123529	journal	June 2017
Mastering the game of Go without human knowledge Silver, David; Schrittwieser, Julian; Simonyan, Karen Nature, Vol. 550, Issue 7676 https://doi.org/10.1038/nature24270	journal	October 2017
Delensing CMB polarization with external datasets Smith, Kendrick M.; Hanson, Duncan; LoVerde, Marilena Journal of Cosmology and Astroparticle Physics, Vol. 2012, Issue 06 https://doi.org/10.1088/1475-7516/2012/06/014	journal	June 2012
A Measurement of the Cosmic Microwave Background Gravitational Lensing Potential from 100 Square Degrees of Sptpol data Story, K. T.; Hanson, D.; Ade, P. A. R. The Astrophysical Journal, Vol. 810, Issue 1 https://doi.org/10.1088/0004-637X/810/1/50	journal	August 2015
The Simons Observatory: science goals and forecasts Ade, Peter; Aguirre, James; Ahmed, Zeeshan Journal of Cosmology and Astroparticle Physics, Vol. 2019, Issue 02 https://doi.org/10.1088/1475-7516/2019/02/056	journal	February 2019
A Guide to Designing Future Ground-Based Cosmic Microwave Background Experiments Wu, W. L. K.; Errard, J.; Dvorkin, C. The Astrophysical Journal, Vol. 788, Issue 2 https://doi.org/10.1088/0004-637X/788/2/138	journal	June 2014
A guide to convolution arithmetic for deep learning Dumoulin, Vincent; Visin, Francesco arXiv https://doi.org/10.48550/arxiv.1603.07285	preprint	January 2016
Self-Normalizing Neural Networks Klambauer, Günter; Unterthiner, Thomas; Mayr, Andreas arXiv https://doi.org/10.48550/arxiv.1706.02515	text	January 2017
Bayesian delensing of CMB temperature and polarization Millea, Marius; Anderes, Ethan; Wandelt, Benjamin D. arXiv https://doi.org/10.48550/arxiv.1708.06753	text	January 2017
Deep Learning for Physical Processes: Incorporating Prior Scientific Knowledge de Bezenac, Emmanuel; Pajot, Arthur; Gallinari, Patrick arXiv https://doi.org/10.48550/arxiv.1711.07970	preprint	January 2017
Averaging Weights Leads to Wider Optima and Better Generalization Izmailov, Pavel; Podoprikhin, Dmitrii; Garipov, Timur arXiv https://doi.org/10.48550/arxiv.1803.05407	preprint	January 2018

Cited By (2)

Learning to predict the cosmological structure formation He, Siyu; Li, Yin; Feng, Yu Proceedings of the National Academy of Sciences, Vol. 116, Issue 28 https://doi.org/10.1073/pnas.1821458116	journal	June 2019
Learning to Predict the Cosmological Structure Formation He, Siyu; Li, Yin; Feng, Yu arXiv https://doi.org/10.48550/arxiv.1811.06533	text	January 2018