DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Planck 2018 results: III. High frequency instrument data processing and frequency maps

Abstract

This paper presents the High Frequency Instrument (HFI) data processing procedures for the Planck 2018 release. Major improvements in mapmaking have been achieved since the previous Planck 2015 release, many of which were used and described already in an intermediate paper dedicated to the Planck polarized data at low multipoles. These improvements enabled the first significant measurement of the reionization optical depth parameter using Planck-HFI data. This paper presents an extensive analysis of systematic effects, including the use of end-to-end simulations to facilitate their removal and characterize the residuals. The polarized data, which presented a number of known problems in the 2015 Planck release, are very significantly improved, especially the leakage from intensity to polarization. Calibration, based on the cosmic microwave background (CMB) dipole, is now extremely accurate and in the frequency range 100-353 GHz reduces intensity-to-polarization leakage caused by calibration mismatch. The Solar dipole direction has been determined in the three lowest HFI frequency channels to within one arc minute, and its amplitude has an absolute uncertainty smaller than 0.35 μK, an accuracy of order 10-4. This is a major legacy from the Planck HFI for future CMB experiments. The removal of bandpass leakage has been improved for themore » main high-frequency foregrounds by extracting the bandpass-mismatch coefficients for each detector as part of the mapmaking process; these values in turn improve the intensity maps. This is a major change in the philosophy of "frequency maps", which are now computed from single detector data, all adjusted to the same average bandpass response for the main foregrounds. End-to-end simulations have been shown to reproduce very well the relative gain calibration of detectors, as well as drifts within a frequency induced by the residuals of the main systematic effect (analogue-to-digital convertor non-linearity residuals). Using these simulations, we have been able to measure and correct the small frequency calibration bias induced by this systematic effect at the 10-4 level. There is no detectable sign of a residual calibration bias between the first and second acoustic peaks in the CMB channels, at the 10-3 level.« less

Authors:
; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; more »; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; « less
Publication Date:
Research Org.:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Org.:
USDOE Office of Science (SC)
Contributing Org.:
Planck Collaboration
OSTI Identifier:
1713250
Grant/Contract Number:  
AC02-05CH11231
Resource Type:
Accepted Manuscript
Journal Name:
Astronomy and Astrophysics
Additional Journal Information:
Journal Volume: 641; Journal ID: ISSN 0004-6361
Publisher:
EDP Sciences
Country of Publication:
United States
Language:
English
Subject:
79 ASTRONOMY AND ASTROPHYSICS; Cosmology: observations; cosmic background radiation; surveys; methods: data analysis

Citation Formats

Aghanim, N, Akrami, Y, Ashdown, M, Aumont, J, Baccigalupi, C, Ballardini, M, Banday, AJ, Barreiro, RB, Bartolo, N, Basak, S, Benabed, K, Bernard, JP, Bersanelli, M, Bielewicz, P, Bond, JR, Borrill, J, Bouchet, FR, Boulanger, F, Bucher, M, Burigana, C, Calabrese, E, Cardoso, JF, Carron, J, Challinor, A, Chiang, HC, Colombo, LPL, Combet, C, Couchot, F, Crill, BP, Cuttaia, F, De Bernardis, P, De Rosa, A, De Zotti, G, Delabrouille, J, Delouis, JM, Di Valentino, E, Diego, JM, Doré, O, Douspis, M, Ducout, A, Dupac, X, Efstathiou, G, Elsner, F, Enßlin, TA, Eriksen, HK, Falgarone, E, Fantaye, Y, Finelli, F, Frailis, M, Fraisse, AA, Franceschi, E, Frolov, A, Galeotta, S, Galli, S, Ganga, K, Génova-Santos, RT, Gerbino, M, Ghosh, T, González-Nuevo, J, Górski, KM, Gratton, S, Gruppuso, A, Gudmundsson, JE, Handley, W, Hansen, FK, Henrot-Versillé, S, Herranz, D, Hivon, E, Huang, Z, Jaffe, AH, Jones, WC, Karakci, A, Keihänen, E, Keskitalo, R, Kiiveri, K, Kim, J, Kisner, TS, Krachmalnicoff, N, Kunz, M, Kurki-Suonio, H, Lagache, G, Lamarre, JM, Lasenby, A, Lattanzi, M, Lawrence, CR, Levrier, F, Liguori, M, Lilje, PB, Lindholm, V, López-Caniego, M, Ma, YZ, Maciás-Pérez, JF, Maggio, G, Maino, D, Mandolesi, N, Mangilli, A, Martin, PG, Martínez-González, E, Matarrese, S, and Mauri, N. Planck 2018 results: III. High frequency instrument data processing and frequency maps. United States: N. p., 2020. Web. doi:10.1051/0004-6361/201832909.
Aghanim, N, Akrami, Y, Ashdown, M, Aumont, J, Baccigalupi, C, Ballardini, M, Banday, AJ, Barreiro, RB, Bartolo, N, Basak, S, Benabed, K, Bernard, JP, Bersanelli, M, Bielewicz, P, Bond, JR, Borrill, J, Bouchet, FR, Boulanger, F, Bucher, M, Burigana, C, Calabrese, E, Cardoso, JF, Carron, J, Challinor, A, Chiang, HC, Colombo, LPL, Combet, C, Couchot, F, Crill, BP, Cuttaia, F, De Bernardis, P, De Rosa, A, De Zotti, G, Delabrouille, J, Delouis, JM, Di Valentino, E, Diego, JM, Doré, O, Douspis, M, Ducout, A, Dupac, X, Efstathiou, G, Elsner, F, Enßlin, TA, Eriksen, HK, Falgarone, E, Fantaye, Y, Finelli, F, Frailis, M, Fraisse, AA, Franceschi, E, Frolov, A, Galeotta, S, Galli, S, Ganga, K, Génova-Santos, RT, Gerbino, M, Ghosh, T, González-Nuevo, J, Górski, KM, Gratton, S, Gruppuso, A, Gudmundsson, JE, Handley, W, Hansen, FK, Henrot-Versillé, S, Herranz, D, Hivon, E, Huang, Z, Jaffe, AH, Jones, WC, Karakci, A, Keihänen, E, Keskitalo, R, Kiiveri, K, Kim, J, Kisner, TS, Krachmalnicoff, N, Kunz, M, Kurki-Suonio, H, Lagache, G, Lamarre, JM, Lasenby, A, Lattanzi, M, Lawrence, CR, Levrier, F, Liguori, M, Lilje, PB, Lindholm, V, López-Caniego, M, Ma, YZ, Maciás-Pérez, JF, Maggio, G, Maino, D, Mandolesi, N, Mangilli, A, Martin, PG, Martínez-González, E, Matarrese, S, & Mauri, N. Planck 2018 results: III. High frequency instrument data processing and frequency maps. United States. https://doi.org/10.1051/0004-6361/201832909
Aghanim, N, Akrami, Y, Ashdown, M, Aumont, J, Baccigalupi, C, Ballardini, M, Banday, AJ, Barreiro, RB, Bartolo, N, Basak, S, Benabed, K, Bernard, JP, Bersanelli, M, Bielewicz, P, Bond, JR, Borrill, J, Bouchet, FR, Boulanger, F, Bucher, M, Burigana, C, Calabrese, E, Cardoso, JF, Carron, J, Challinor, A, Chiang, HC, Colombo, LPL, Combet, C, Couchot, F, Crill, BP, Cuttaia, F, De Bernardis, P, De Rosa, A, De Zotti, G, Delabrouille, J, Delouis, JM, Di Valentino, E, Diego, JM, Doré, O, Douspis, M, Ducout, A, Dupac, X, Efstathiou, G, Elsner, F, Enßlin, TA, Eriksen, HK, Falgarone, E, Fantaye, Y, Finelli, F, Frailis, M, Fraisse, AA, Franceschi, E, Frolov, A, Galeotta, S, Galli, S, Ganga, K, Génova-Santos, RT, Gerbino, M, Ghosh, T, González-Nuevo, J, Górski, KM, Gratton, S, Gruppuso, A, Gudmundsson, JE, Handley, W, Hansen, FK, Henrot-Versillé, S, Herranz, D, Hivon, E, Huang, Z, Jaffe, AH, Jones, WC, Karakci, A, Keihänen, E, Keskitalo, R, Kiiveri, K, Kim, J, Kisner, TS, Krachmalnicoff, N, Kunz, M, Kurki-Suonio, H, Lagache, G, Lamarre, JM, Lasenby, A, Lattanzi, M, Lawrence, CR, Levrier, F, Liguori, M, Lilje, PB, Lindholm, V, López-Caniego, M, Ma, YZ, Maciás-Pérez, JF, Maggio, G, Maino, D, Mandolesi, N, Mangilli, A, Martin, PG, Martínez-González, E, Matarrese, S, and Mauri, N. Fri . "Planck 2018 results: III. High frequency instrument data processing and frequency maps". United States. https://doi.org/10.1051/0004-6361/201832909. https://www.osti.gov/servlets/purl/1713250.
@article{osti_1713250,
title = {Planck 2018 results: III. High frequency instrument data processing and frequency maps},
author = {Aghanim, N and Akrami, Y and Ashdown, M and Aumont, J and Baccigalupi, C and Ballardini, M and Banday, AJ and Barreiro, RB and Bartolo, N and Basak, S and Benabed, K and Bernard, JP and Bersanelli, M and Bielewicz, P and Bond, JR and Borrill, J and Bouchet, FR and Boulanger, F and Bucher, M and Burigana, C and Calabrese, E and Cardoso, JF and Carron, J and Challinor, A and Chiang, HC and Colombo, LPL and Combet, C and Couchot, F and Crill, BP and Cuttaia, F and De Bernardis, P and De Rosa, A and De Zotti, G and Delabrouille, J and Delouis, JM and Di Valentino, E and Diego, JM and Doré, O and Douspis, M and Ducout, A and Dupac, X and Efstathiou, G and Elsner, F and Enßlin, TA and Eriksen, HK and Falgarone, E and Fantaye, Y and Finelli, F and Frailis, M and Fraisse, AA and Franceschi, E and Frolov, A and Galeotta, S and Galli, S and Ganga, K and Génova-Santos, RT and Gerbino, M and Ghosh, T and González-Nuevo, J and Górski, KM and Gratton, S and Gruppuso, A and Gudmundsson, JE and Handley, W and Hansen, FK and Henrot-Versillé, S and Herranz, D and Hivon, E and Huang, Z and Jaffe, AH and Jones, WC and Karakci, A and Keihänen, E and Keskitalo, R and Kiiveri, K and Kim, J and Kisner, TS and Krachmalnicoff, N and Kunz, M and Kurki-Suonio, H and Lagache, G and Lamarre, JM and Lasenby, A and Lattanzi, M and Lawrence, CR and Levrier, F and Liguori, M and Lilje, PB and Lindholm, V and López-Caniego, M and Ma, YZ and Maciás-Pérez, JF and Maggio, G and Maino, D and Mandolesi, N and Mangilli, A and Martin, PG and Martínez-González, E and Matarrese, S and Mauri, N},
abstractNote = {This paper presents the High Frequency Instrument (HFI) data processing procedures for the Planck 2018 release. Major improvements in mapmaking have been achieved since the previous Planck 2015 release, many of which were used and described already in an intermediate paper dedicated to the Planck polarized data at low multipoles. These improvements enabled the first significant measurement of the reionization optical depth parameter using Planck-HFI data. This paper presents an extensive analysis of systematic effects, including the use of end-to-end simulations to facilitate their removal and characterize the residuals. The polarized data, which presented a number of known problems in the 2015 Planck release, are very significantly improved, especially the leakage from intensity to polarization. Calibration, based on the cosmic microwave background (CMB) dipole, is now extremely accurate and in the frequency range 100-353 GHz reduces intensity-to-polarization leakage caused by calibration mismatch. The Solar dipole direction has been determined in the three lowest HFI frequency channels to within one arc minute, and its amplitude has an absolute uncertainty smaller than 0.35 μK, an accuracy of order 10-4. This is a major legacy from the Planck HFI for future CMB experiments. The removal of bandpass leakage has been improved for the main high-frequency foregrounds by extracting the bandpass-mismatch coefficients for each detector as part of the mapmaking process; these values in turn improve the intensity maps. This is a major change in the philosophy of "frequency maps", which are now computed from single detector data, all adjusted to the same average bandpass response for the main foregrounds. End-to-end simulations have been shown to reproduce very well the relative gain calibration of detectors, as well as drifts within a frequency induced by the residuals of the main systematic effect (analogue-to-digital convertor non-linearity residuals). Using these simulations, we have been able to measure and correct the small frequency calibration bias induced by this systematic effect at the 10-4 level. There is no detectable sign of a residual calibration bias between the first and second acoustic peaks in the CMB channels, at the 10-3 level.},
doi = {10.1051/0004-6361/201832909},
journal = {Astronomy and Astrophysics},
number = ,
volume = 641,
place = {United States},
year = {Fri Sep 11 00:00:00 EDT 2020},
month = {Fri Sep 11 00:00:00 EDT 2020}
}

Works referenced in this record:

Large‐Scale Structure of the Molecular Gas in Taurus Revealed by High Linear Dynamic Range Spectral Line Mapping
journal, June 2008

  • Goldsmith, Paul F.; Heyer, Mark; Narayanan, Gopal
  • The Astrophysical Journal, Vol. 680, Issue 1
  • DOI: 10.1086/587166

The pre-launch Planck Sky Model: a model of sky emission at submillimetre to centimetre wavelengths
journal, May 2013


Planck 2013 results. XIII. Galactic CO emission
journal, October 2014


A Unified Empirical Model for Infrared Galaxy Counts Based on the Observed Physical Evolution of Distant Galaxies
journal, September 2012

  • Béthermin, Matthieu; Daddi, Emanuele; Magdis, Georgios
  • The Astrophysical Journal, Vol. 757, Issue 2
  • DOI: 10.1088/2041-8205/757/2/L23

The CLASSgal code for relativistic cosmological large scale structure
journal, November 2013

  • Dio, Enea Di; Montanari, Francesco; Lesgourgues, Julien
  • Journal of Cosmology and Astroparticle Physics, Vol. 2013, Issue 11
  • DOI: 10.1088/1475-7516/2013/11/044

Planck 2015 results : X. Diffuse component separation: Foreground maps
journal, September 2016


A Survey of High‐Latitude Molecular Gas in the Northern Galactic Hemisphere
journal, January 1998

  • Hartmann, Dap; Magnani, Loris; Thaddeus, Patrick
  • The Astrophysical Journal, Vol. 492, Issue 1
  • DOI: 10.1086/305019

A Survey of High‐Latitude Molecular Gas in the Southern Galactic Hemisphere
journal, May 2000

  • Magnani, Loris; Hartmann, Dap; Holcomb, Sharon L.
  • The Astrophysical Journal, Vol. 535, Issue 1
  • DOI: 10.1086/308841

XSPECT, estimation of the angular power spectrum by computing cross-power spectra with analytical error bars
journal, April 2005


Planck 2015 results : VII. High Frequency Instrument data processing: Time-ordered information and beams
journal, September 2016


Planck 2018 results: II. Low Frequency Instrument data processing
journal, September 2020


An analytic model for the spatial clustering of dark matter haloes
journal, September 1996

  • Mo, H. J.; White, S. D. M.
  • Monthly Notices of the Royal Astronomical Society, Vol. 282, Issue 2
  • DOI: 10.1093/mnras/282.2.347

The Spectrum of the Extragalactic Far‐Infrared Background from the COBE FIRAS Observations
journal, November 1998

  • Fixsen, D. J.; Dwek, E.; Mather, J. C.
  • The Astrophysical Journal, Vol. 508, Issue 1
  • DOI: 10.1086/306383

Detection of the Schwarzschild precession in the orbit of the star S2 near the Galactic centre massive black hole
journal, April 2020


FIVE-YEAR WILKINSON MICROWAVE ANISOTROPY PROBE OBSERVATIONS: DATA PROCESSING, SKY MAPS, AND BASIC RESULTS
journal, February 2009

  • Hinshaw, G.; Weiland, J. L.; Hill, R. S.
  • The Astrophysical Journal Supplement Series, Vol. 180, Issue 2
  • DOI: 10.1088/0067-0049/180/2/225

The COBE Diffuse Infrared Background Experiment Search for the Cosmic Infrared Background. II. Model of the Interplanetary Dust Cloud
journal, November 1998

  • Kelsall, T.; Weiland, J. L.; Franz, B. A.
  • The Astrophysical Journal, Vol. 508, Issue 1
  • DOI: 10.1086/306380

Planck 2015 results : XII. Full focal plane simulations
journal, September 2016


Separation of anomalous and synchrotron emissions using WMAP polarization data
journal, September 2008


HEALPix: A Framework for High‐Resolution Discretization and Fast Analysis of Data Distributed on the Sphere
journal, April 2005

  • Gorski, K. M.; Hivon, E.; Banday, A. J.
  • The Astrophysical Journal, Vol. 622, Issue 2
  • DOI: 10.1086/427976

Planck 2013 results. XXXI. Consistency of the Planck data
journal, October 2014


Planck 2013 results. XIV. Zodiacal emission
journal, October 2014


Planck 2018 results: I. Overview and the cosmological legacy of Planck
journal, September 2020


Toward a Halo Mass Function for Precision Cosmology: The Limits of Universality
journal, December 2008

  • Tinker, Jeremy; Kravtsov, Andrey V.; Klypin, Anatoly
  • The Astrophysical Journal, Vol. 688, Issue 2
  • DOI: 10.1086/591439

Making sky maps from Planck data
journal, February 2007


Planck 2018 results: IV. Diffuse component separation
journal, September 2020


Planck 2015 results : XI. CMB power spectra, likelihoods, and robustness of parameters
journal, September 2016


The Cosmic Linear Anisotropy Solving System (CLASS). Part II: Approximation schemes
journal, July 2011

  • Blas, Diego; Lesgourgues, Julien; Tram, Thomas
  • Journal of Cosmology and Astroparticle Physics, Vol. 2011, Issue 07
  • DOI: 10.1088/1475-7516/2011/07/034

Planck intermediate results : LII. Planet flux densities
journal, November 2017


An improved source-subtracted and destriped 408-MHz all-sky map
journal, June 2015

  • Remazeilles, M.; Dickinson, C.; Banday, A. J.
  • Monthly Notices of the Royal Astronomical Society, Vol. 451, Issue 4
  • DOI: 10.1093/mnras/stv1274

Separation of anomalous and synchrotron emissions using WMAP polarization data
journal, September 2008


Modeling the evolution of infrared galaxies: a parametric backward evolution model
journal, March 2011


Planck 2018 results: VII. Isotropy and statistics of the CMB
journal, September 2020


Statistical simulations of the dust foreground to cosmic microwave background polarization
journal, July 2017


Planck 2013 results. XXX. Cosmic infrared background measurements and implications for star formation
journal, October 2014


Extreme intra-hour variability of the radio source J1402+5347 discovered with Apertif
journal, September 2020


Planck 2018 results: VIII. Gravitational lensing
journal, September 2020


Planck 2018 results: XII. Galactic astrophysics using polarized dust emission
journal, September 2020


Planck 2018 results: X. Constraints on inflation
journal, September 2020


Planck 2013 results. XV. CMB power spectra and likelihood
journal, October 2014


Calibrator Design for the COBE Far‐Infrared Absolute Spectrophotometer (FIRAS)
journal, February 1999

  • Mather, J. C.; Fixsen, D. J.; Shafer, R. A.
  • The Astrophysical Journal, Vol. 512, Issue 2
  • DOI: 10.1086/306805

Planck 2013 results. X. HFI energetic particle effects: characterization, removal, and simulation
journal, October 2014


Planck 2015 results : XXVI. The Second
journal, September 2016


Relativistic Corrections to the Sunyaev‐Zeldovich Effect for Clusters of Galaxies. II. Inclusion of Peculiar Velocities
journal, November 1998

  • Nozawa, Satoshi; Itoh, Naoki; Kohyama, Yasuharu
  • The Astrophysical Journal, Vol. 508, Issue 1
  • DOI: 10.1086/306401

Planck 2013 results. VIII. HFI photometric calibration and mapmaking
journal, October 2014


Foreground component separation with generalized Internal Linear Combination: FG component separation with generalized ILC
journal, September 2011

  • Remazeilles, Mathieu; Delabrouille, Jacques; Cardoso, Jean-François
  • Monthly Notices of the Royal Astronomical Society, Vol. 418, Issue 1
  • DOI: 10.1111/j.1365-2966.2011.19497.x

A Hybrid Model for the Evolution of Galaxies and Active Galactic Nuclei in the Infrared
journal, April 2013


Planck 2013 results. VII. HFI time response and beams
journal, October 2014


Planck 2015 results : VIII. High Frequency Instrument data processing: Calibration and maps
journal, September 2016


Planck early results. IV. First assessment of the High Frequency Instrument in-flight performance
journal, December 2011


A maximum likelihood approach to the destriping technique
journal, November 2004


Planck 2018 results: IX. Constraints on primordial non-Gaussianity
journal, September 2020


Planck 2018 results: V. CMB power spectra and likelihoods
journal, September 2020


The Temperature of the Cosmic Microwave Background
journal, November 2009


Planck pre-launch status: High Frequency Instrument polarization calibration
journal, September 2010


Planck 2018 results: VI. Cosmological parameters
journal, September 2020


A simulation pipeline for the Planck mission
journal, December 2005


Statistical simulations of the dust foreground to cosmic microwave background polarization
journal, July 2017


Planck 2013 results. VI. High Frequency Instrument data processing
journal, October 2014


Planck 2013 results. XI. All-sky model of thermal dust emission
journal, October 2014


The Milky Way in Molecular Clouds: A New Complete CO Survey
journal, February 2001

  • Dame, T. M.; Hartmann, Dap; Thaddeus, P.
  • The Astrophysical Journal, Vol. 547, Issue 2
  • DOI: 10.1086/318388

Planck 2018 results: XI. Polarized dust foregrounds
journal, September 2020


Planck intermediate results : XLVIII. Disentangling Galactic dust emission and cosmic infrared background anisotropies
journal, December 2016


Planck pre-launch status: The HFI instrument, from specification to actual performance
journal, September 2010


The GRAVITY young stellar object survey: II. First spatially resolved observations of the CO bandhead emission in a high-mass YSO
journal, March 2020


Discovery of molecular gas fueling galaxy growth in a protocluster at z = 1.7
journal, September 2020


Works referencing / citing this record:

Re-evaluating evidence for Hawking points in the CMB
journal, March 2020


The flickering nuclear activity of Fornax A
journal, January 2020


Local Bubble contribution to the 353-GHz dust polarized emission
journal, November 2019


A physical approach to modelling large-scale galactic magnetic fields
journal, March 2019


Reionization optical depth determination from Planck HFI data with ten percent accuracy
journal, March 2020


Extreme starlight polarization in a region with highly polarized dust emission
journal, April 2019


Gas shells and magnetic fields in the Orion-Eridanus superbubble
journal, October 2019


Link between EB polarization modes and gas column density from interstellar dust emission
journal, November 2019


CMB foreground measurements through broad-band radio spectro-polarimetry: prospects of the SKA-MPG telescope
journal, June 2019

  • Basu, Aritra; Schwarz, Dominik J.; Klöckner, Hans-Rainer
  • Monthly Notices of the Royal Astronomical Society, Vol. 488, Issue 2
  • DOI: 10.1093/mnras/stz1637