DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: DeepCMB: Lensing reconstruction of the cosmic microwave background with deep neural networks

Abstract

Next-generation cosmic microwave background (CMB) experiments will have lower noise and therefore increased sensitivity, enabling improved constraints on fundamental physics parameters such as the sum of neutrino masses and the tensor-to-scalar ratio r. Achieving competitive constraints on these parameters requires high signal-to-noise extraction of the projected gravitational potential from the CMB maps. Standard methods for reconstructing the lensing potential employ the quadratic estimator (QE). However, the QE performs suboptimally at the low noise levels expected in upcoming experiments. Other methods, like maximum likelihood estimators (MLE), are under active development. In this work, we demonstrate reconstruction of the CMB lensing potential with deep convolutional neural networks (CNN) - ie, a ResUNet. The network is trained and tested on simulated data, and otherwise has no physical parametrization related to the physical processes of the CMB and gravitational lensing. We show that, over a wide range of angular scales, ResUNets recover the input gravitational potential with a higher signal-to-noise ratio than the QE method, reaching levels comparable to analytic approximations of MLE methods. We demonstrate that the network outputs quantifiably different lensing maps when given input CMB maps generated with different cosmologies. We also show we can use the reconstructed lensing map formore » cosmological parameter estimation. This application of CNN provides a few innovations at the intersection of cosmology and machine learning. First, while training and regressing on images, we predict a continuous-variable field rather than discrete classes. Second, we are able to establish uncertainty measures for the network output that are analogous to standard methods. We expect this approach to excel in capturing hard-to-model non-Gaussian astrophysical foreground and noise contributions.« less

Authors:
ORCiD logo [1];  [2];  [3];  [4];  [5];  [6]
  1. Univ. of Chicago, IL (United States). Enrico Fermi Inst. and Kadanoff Center for Theoretical Physics; Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
  2. Univ. of Chicago, IL (United States). Kavli Inst. for Cosmological Physics (KICP)
  3. Univ. of Chicago, IL (United States). Kavli Inst. for Cosmological Physics (KICP); Univ. of Chicago, IL (United States). Dept. of Astronomy and Astropysics; Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
  4. Univ. of Chicago, IL (United States). Enrico Fermi Inst. and Kadanoff Center for Theoretical Physics; Univ. of Chicago, IL (United States). Kavli Inst. for Cosmological Physics (KICP)
  5. Brown Univ., Providence, RI (United States). Inst. for Computational and Experimental Research in Mathematics
  6. Descartes Labs, Santa Fe, CA (United States)
Publication Date:
Research Org.:
Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), High Energy Physics (HEP)
OSTI Identifier:
1487051
Alternate Identifier(s):
OSTI ID: 1780551
Report Number(s):
arXiv:1810.01483; FERMILAB-PUB-18-515-A-CD
Journal ID: ISSN 2213-1337; oai:inspirehep.net:1696852
Grant/Contract Number:  
AC02-07CH11359
Resource Type:
Accepted Manuscript
Journal Name:
Astronomy and Computing
Additional Journal Information:
Journal Volume: 28; Journal Issue: C; Journal ID: ISSN 2213-1337
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
79 ASTRONOMY AND ASTROPHYSICS; cosmic microwave background; cosmology; deep learning; convolutional neural networks

Citation Formats

Caldeira, J., Wu, W. L.K., Nord, B., Avestruz, C., Trivedi, S., and Story, K. T. DeepCMB: Lensing reconstruction of the cosmic microwave background with deep neural networks. United States: N. p., 2019. Web. doi:10.1016/j.ascom.2019.100307.
Caldeira, J., Wu, W. L.K., Nord, B., Avestruz, C., Trivedi, S., & Story, K. T. DeepCMB: Lensing reconstruction of the cosmic microwave background with deep neural networks. United States. https://doi.org/10.1016/j.ascom.2019.100307
Caldeira, J., Wu, W. L.K., Nord, B., Avestruz, C., Trivedi, S., and Story, K. T. Mon . "DeepCMB: Lensing reconstruction of the cosmic microwave background with deep neural networks". United States. https://doi.org/10.1016/j.ascom.2019.100307. https://www.osti.gov/servlets/purl/1487051.
@article{osti_1487051,
title = {DeepCMB: Lensing reconstruction of the cosmic microwave background with deep neural networks},
author = {Caldeira, J. and Wu, W. L.K. and Nord, B. and Avestruz, C. and Trivedi, S. and Story, K. T.},
abstractNote = {Next-generation cosmic microwave background (CMB) experiments will have lower noise and therefore increased sensitivity, enabling improved constraints on fundamental physics parameters such as the sum of neutrino masses and the tensor-to-scalar ratio r. Achieving competitive constraints on these parameters requires high signal-to-noise extraction of the projected gravitational potential from the CMB maps. Standard methods for reconstructing the lensing potential employ the quadratic estimator (QE). However, the QE performs suboptimally at the low noise levels expected in upcoming experiments. Other methods, like maximum likelihood estimators (MLE), are under active development. In this work, we demonstrate reconstruction of the CMB lensing potential with deep convolutional neural networks (CNN) - ie, a ResUNet. The network is trained and tested on simulated data, and otherwise has no physical parametrization related to the physical processes of the CMB and gravitational lensing. We show that, over a wide range of angular scales, ResUNets recover the input gravitational potential with a higher signal-to-noise ratio than the QE method, reaching levels comparable to analytic approximations of MLE methods. We demonstrate that the network outputs quantifiably different lensing maps when given input CMB maps generated with different cosmologies. We also show we can use the reconstructed lensing map for cosmological parameter estimation. This application of CNN provides a few innovations at the intersection of cosmology and machine learning. First, while training and regressing on images, we predict a continuous-variable field rather than discrete classes. Second, we are able to establish uncertainty measures for the network output that are analogous to standard methods. We expect this approach to excel in capturing hard-to-model non-Gaussian astrophysical foreground and noise contributions.},
doi = {10.1016/j.ascom.2019.100307},
journal = {Astronomy and Computing},
number = C,
volume = 28,
place = {United States},
year = {Mon Jul 01 00:00:00 EDT 2019},
month = {Mon Jul 01 00:00:00 EDT 2019}
}

Journal Article:

Citation Metrics:
Cited by: 48 works
Citation information provided by
Web of Science

Figures / Tables:

Figure 1 Figure 1: We train neural networks to learn a mapping from the lensed ($\tilde{Q}$, $\tilde{U}$) maps into the unlensed E map and the gravitational convergence map κ, extracting the underlying fields from the observed quantities. Here we illustrate this mapping using one of the realizations in the training set. Themore » maps correspond to a patch of the sky five degrees across.« less

Save / Share:

Works referenced in this record:

Measurement of the Cosmic Microwave Background Polarization Lensing Power Spectrum with the POLARBEAR Experiment
journal, July 2014


NINE-YEAR WILKINSON MICROWAVE ANISOTROPY PROBE ( WMAP ) OBSERVATIONS: FINAL MAPS AND RESULTS
journal, September 2013

  • Bennett, C. L.; Larson, D.; Weiland, J. L.
  • The Astrophysical Journal Supplement Series, Vol. 208, Issue 2
  • DOI: 10.1088/0067-0049/208/2/20

Constraints on Primordial Gravitational Waves Using P l a n c k , WMAP, and New BICEP2/ K e c k Observations through the 2015 Season
journal, November 2018


Bicep2/ KECK ARRAY VIII: MEASUREMENT OF GRAVITATIONAL LENSING FROM LARGE-SCALE B -MODE POLARIZATION
journal, December 2016


Improved Constraints on Cosmology and Foregrounds from BICEP2 and Keck Array Cosmic Microwave Background Data with Inclusion of 95 GHz Band
journal, January 2016


Learning the hidden structure of speech
journal, April 1988

  • Elman, Jeffrey L.; Zipser, David
  • The Journal of the Acoustical Society of America, Vol. 83, Issue 4
  • DOI: 10.1121/1.395916

Deep Residual Learning for Image Recognition
conference, June 2016

  • He, Kaiming; Zhang, Xiangyu; Ren, Shaoqing
  • 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • DOI: 10.1109/CVPR.2016.90

Measurements of the Temperature and E-mode Polarization of the CMB from 500 Square Degrees of SPTpol Data
journal, January 2018

  • Henning, J. W.; Sayre, J. T.; Reichardt, C. L.
  • The Astrophysical Journal, Vol. 852, Issue 2
  • DOI: 10.3847/1538-4357/aa9ff4

NINE-YEAR WILKINSON MICROWAVE ANISOTROPY PROBE ( WMAP ) OBSERVATIONS: COSMOLOGICAL PARAMETER RESULTS
journal, September 2013

  • Hinshaw, G.; Larson, D.; Komatsu, E.
  • The Astrophysical Journal Supplement Series, Vol. 208, Issue 2
  • DOI: 10.1088/0067-0049/208/2/19

Reducing the Dimensionality of Data with Neural Networks
journal, July 2006


Reconstruction of lensing from the cosmic microwave background polarization
journal, October 2003


Weak lensing of the CMB: A harmonic approach
journal, July 2000


Mass Reconstruction with Cosmic Microwave Background Polarization
journal, August 2002

  • Hu, Wayne; Okamoto, Takemi
  • The Astrophysical Journal, Vol. 574, Issue 2
  • DOI: 10.1086/341110

A Probe of Primordial Gravity Waves and Vorticity
journal, March 1997


MEASUREMENTS OF SUB-DEGREE B -MODE POLARIZATION IN THE COSMIC MICROWAVE BACKGROUND FROM 100 SQUARE DEGREES OF SPTPOL DATA
journal, July 2015


Lensing reconstruction with CMB temperature and polarization
journal, June 2003


Cosmological parameters from the first results of Boomerang
journal, January 2001


Weak gravitational lensing of the CMB
journal, June 2006


Efficient Computation of Cosmic Microwave Background Anisotropies in Closed Friedmann‐Robertson‐Walker Models
journal, August 2000

  • Lewis, Antony; Challinor, Anthony; Lasenby, Anthony
  • The Astrophysical Journal, Vol. 538, Issue 2
  • DOI: 10.1086/309179

The Atacama Cosmology Telescope: two-season ACTPol spectra and parameters
journal, June 2017

  • Louis, Thibaut; Grace, Emily; Hasselfield, Matthew
  • Journal of Cosmology and Astroparticle Physics, Vol. 2017, Issue 06
  • DOI: 10.1088/1475-7516/2017/06/031

CMB Polarization B -mode Delensing with SPTpol and Herschel
journal, August 2017


Measurement of the cosmic microwave background spectrum by the COBE FIRAS instrument
journal, January 1994

  • Mather, J. C.; Cheng, E. S.; Cottingham, D. A.
  • The Astrophysical Journal, Vol. 420
  • DOI: 10.1086/173574

Mission Design of LiteBIRD
journal, January 2014

  • Matsumura, T.; Akiba, Y.; Borrill, J.
  • Journal of Low Temperature Physics, Vol. 176, Issue 5-6
  • DOI: 10.1007/s10909-013-0996-1

A high-bias, low-variance introduction to Machine Learning for physicists
journal, May 2019


Bayesian delensing of CMB temperature and polarization
journal, July 2019


A 2500 deg 2 CMB Lensing Map from Combined South Pole Telescope and Planck Data
journal, November 2017


DeepSphere: Efficient spherical convolutional neural network with HEALPix sampling for cosmological applications
journal, April 2019


Planck 2015 results : XIII. Cosmological parameters
journal, September 2016


Planck 2015 results : XV. Gravitational lensing
journal, September 2016


A Measurement of the Cosmic Microwave Background B -mode Polarization Power Spectrum at Subdegree Scales from Two Years of polarbear Data
journal, October 2017


U-Net: Convolutional Networks for Biomedical Image Segmentation
book, November 2015

  • Ronneberger, Olaf; Fischer, Philipp; Brox, Thomas
  • Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III
  • DOI: 10.1007/978-3-319-24574-4_28

Signature of Gravity Waves in the Polarization of the Microwave Background
journal, March 1997


Two-season Atacama Cosmology Telescope polarimeter lensing power spectrum
journal, June 2017


Mastering the game of Go without human knowledge
journal, October 2017

  • Silver, David; Schrittwieser, Julian; Simonyan, Karen
  • Nature, Vol. 550, Issue 7676
  • DOI: 10.1038/nature24270

Delensing CMB polarization with external datasets
journal, June 2012

  • Smith, Kendrick M.; Hanson, Duncan; LoVerde, Marilena
  • Journal of Cosmology and Astroparticle Physics, Vol. 2012, Issue 06
  • DOI: 10.1088/1475-7516/2012/06/014

A Measurement of the Cosmic Microwave Background Gravitational Lensing Potential from 100 Square Degrees of Sptpol data
journal, August 2015


The Simons Observatory: science goals and forecasts
journal, February 2019

  • Ade, Peter; Aguirre, James; Ahmed, Zeeshan
  • Journal of Cosmology and Astroparticle Physics, Vol. 2019, Issue 02
  • DOI: 10.1088/1475-7516/2019/02/056

A Guide to Designing Future Ground-Based Cosmic Microwave Background Experiments
journal, June 2014


A guide to convolution arithmetic for deep learning
preprint, January 2016


Self-Normalizing Neural Networks
text, January 2017


Bayesian delensing of CMB temperature and polarization
text, January 2017


Deep Learning for Physical Processes: Incorporating Prior Scientific Knowledge
preprint, January 2017


Averaging Weights Leads to Wider Optima and Better Generalization
preprint, January 2018


Works referencing / citing this record:

Learning to predict the cosmological structure formation
journal, June 2019

  • He, Siyu; Li, Yin; Feng, Yu
  • Proceedings of the National Academy of Sciences, Vol. 116, Issue 28
  • DOI: 10.1073/pnas.1821458116

Learning to Predict the Cosmological Structure Formation
text, January 2018