DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: EMMA: an adaptive mesh refinement cosmological simulation code with radiative transfer

Abstract

EMMA is a cosmological simulation code aimed at investigating the reionization epoch. It handles simultaneously collisionless and gas dynamics, as well as radiative transfer physics using a moment-based description with the M1 approximation. Field quantities are stored and computed on an adaptive three-dimensional mesh and the spatial resolution can be dynamically modified based on physically motivated criteria. Physical processes can be coupled at all spatial and temporal scales. We also introduce a new and optional approximation to handle radiation: the light is transported at the resolution of the non-refined grid and only once the dynamics has been fully updated, whereas thermo-chemical processes are still tracked on the refined elements. Such an approximation reduces the overheads induced by the treatment of radiation physics. A suite of standard tests are presented and passed by EMMA, providing a validation for its future use in studies of the reionization epoch. The code is parallel and is able to use graphics processing units (GPUs) to accelerate hydrodynamics and radiative transfer calculations. Depending on the optimizations and the compilers used to generate the CPU reference, global GPU acceleration factors between ×3.9 and ×16.9 can be obtained. As a result, vectorization and transfer operations currently prevent bettermore » GPU performance and we expect that future optimizations and hardware evolution will lead to greater accelerations.« less

Authors:
 [1];  [1];  [1]
  1. Univ. de Strasbourg, Strasbourg (France)
Publication Date:
Research Org.:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
Sponsoring Org.:
USDOE Office of Science (SC)
OSTI Identifier:
1565490
Grant/Contract Number:  
AC05-00OR22725
Resource Type:
Accepted Manuscript
Journal Name:
Monthly Notices of the Royal Astronomical Society
Additional Journal Information:
Journal Volume: 454; Journal Issue: 1; Journal ID: ISSN 0035-8711
Publisher:
Royal Astronomical Society
Country of Publication:
United States
Language:
English
Subject:
79 ASTRONOMY AND ASTROPHYSICS; methods: numerical; dark ages; reionization; first stars

Citation Formats

Aubert, Dominique, Deparis, Nicolas, and Ocvirk, Pierre. EMMA: an adaptive mesh refinement cosmological simulation code with radiative transfer. United States: N. p., 2015. Web. doi:10.1093/mnras/stv1896.
Aubert, Dominique, Deparis, Nicolas, & Ocvirk, Pierre. EMMA: an adaptive mesh refinement cosmological simulation code with radiative transfer. United States. https://doi.org/10.1093/mnras/stv1896
Aubert, Dominique, Deparis, Nicolas, and Ocvirk, Pierre. Wed . "EMMA: an adaptive mesh refinement cosmological simulation code with radiative transfer". United States. https://doi.org/10.1093/mnras/stv1896. https://www.osti.gov/servlets/purl/1565490.
@article{osti_1565490,
title = {EMMA: an adaptive mesh refinement cosmological simulation code with radiative transfer},
author = {Aubert, Dominique and Deparis, Nicolas and Ocvirk, Pierre},
abstractNote = {EMMA is a cosmological simulation code aimed at investigating the reionization epoch. It handles simultaneously collisionless and gas dynamics, as well as radiative transfer physics using a moment-based description with the M1 approximation. Field quantities are stored and computed on an adaptive three-dimensional mesh and the spatial resolution can be dynamically modified based on physically motivated criteria. Physical processes can be coupled at all spatial and temporal scales. We also introduce a new and optional approximation to handle radiation: the light is transported at the resolution of the non-refined grid and only once the dynamics has been fully updated, whereas thermo-chemical processes are still tracked on the refined elements. Such an approximation reduces the overheads induced by the treatment of radiation physics. A suite of standard tests are presented and passed by EMMA, providing a validation for its future use in studies of the reionization epoch. The code is parallel and is able to use graphics processing units (GPUs) to accelerate hydrodynamics and radiative transfer calculations. Depending on the optimizations and the compilers used to generate the CPU reference, global GPU acceleration factors between ×3.9 and ×16.9 can be obtained. As a result, vectorization and transfer operations currently prevent better GPU performance and we expect that future optimizations and hardware evolution will lead to greater accelerations.},
doi = {10.1093/mnras/stv1896},
journal = {Monthly Notices of the Royal Astronomical Society},
number = 1,
volume = 454,
place = {United States},
year = {Wed Sep 30 00:00:00 EDT 2015},
month = {Wed Sep 30 00:00:00 EDT 2015}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 35 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

A radiative transfer scheme for cosmological reionization based on a local Eddington tensor
journal, June 2008


Reionization Simulations Powered by Graphics Processing Units. i. on the Structure of the Ultraviolet Radiation Field
journal, November 2010


The simulated 21 cm signal during the epoch of reionization: full modeling of the Ly- α pumping
journal, December 2008


Reionization by UV or X-ray sources
journal, November 2010


In the beginning: the first sources of light and the reionization of the universe
journal, July 2001


Self-similar secondary infall and accretion in an Einstein-de Sitter universe
journal, May 1985

  • Bertschinger, E.
  • The Astrophysical Journal Supplement Series, Vol. 58
  • DOI: 10.1086/191028

UV LUMINOSITY FUNCTIONS AT REDSHIFTS z ∼ 4 TO z ∼ 10: 10,000 GALAXIES FROM HST LEGACY FIELDS
journal, April 2015


Measurements of the ultraviolet background at 4.6 < z < 6.4 using the quasar proximity effect★: Proximity-effect measurements of the UVB at high redshift
journal, March 2011

  • Calverley, Alexander P.; Becker, George D.; Haehnelt, Martin G.
  • Monthly Notices of the Royal Astronomical Society, Vol. 412, Issue 4
  • DOI: 10.1111/j.1365-2966.2010.18072.x

A study of simulated reionization histories with merger trees of HII regions
journal, November 2012


Simulating intergalactic medium reionization
journal, August 2003


A parallel tree code
journal, October 1996


On the onset of galactic winds in quiescent star forming galaxies
journal, October 2007


Baryonic Features in the Matter Transfer Function
journal, April 1998

  • Eisenstein, Daniel J.; Hu, Wayne
  • The Astrophysical Journal, Vol. 496, Issue 2
  • DOI: 10.1086/305424

HOP: A New Group‐finding Algorithm for N ‐Body Simulations
journal, May 1998

  • Eisenstein, Daniel J.; Hut, Piet
  • The Astrophysical Journal, Vol. 498, Issue 1
  • DOI: 10.1086/305535

Constraining the Evolution of the Ionizing Background and the Epoch of Reionization with z  ~ 6 Quasars. II. A Sample of 19 Quasars
journal, June 2006

  • Fan, Xiaohui; Strauss, Michael A.; Becker, Robert H.
  • The Astronomical Journal, Vol. 132, Issue 1
  • DOI: 10.1086/504836

Galactic Outflows and Photoionization Heating in the Reionization Epoch
journal, December 2011


Effect of Reionization on Structure Formation in the Universe
journal, October 2000

  • Gnedin, Nickolay Y.
  • The Astrophysical Journal, Vol. 542, Issue 2
  • DOI: 10.1086/317042

Cosmic Reionization on Computers. i. Design and Calibration of Simulations
journal, September 2014


Multi-dimensional cosmological radiative transfer with a Variable Eddington Tensor formalism
journal, October 2001


HERACLES: a three-dimensional radiation hydrodynamics code
journal, January 2007


Dwarf galaxies in voids: suppressing star formation with photoheating: Dwarf galaxies in voids
journal, August 2006

  • Hoeft, Matthias; Yepes, Gustavo; Gottlöber, Stefan
  • Monthly Notices of the Royal Astronomical Society, Vol. 371, Issue 1
  • DOI: 10.1111/j.1365-2966.2006.10678.x

Equation of state of the photoionized intergalactic medium
journal, November 1997

  • Hui, L.; Gnedin, N. Y.
  • Monthly Notices of the Royal Astronomical Society, Vol. 292, Issue 1
  • DOI: 10.1093/mnras/292.1.27

Cosmological radiative transfer codes comparison project ��� I. The static density field tests
journal, September 2006

  • Iliev, Ilian T.; Ciardi, Benedetta; Alvarez, Marcelo A.
  • Monthly Notices of the Royal Astronomical Society, Vol. 371, Issue 3
  • DOI: 10.1111/j.1365-2966.2006.10775.x

Cosmological radiative transfer comparison project – II. The radiation-hydrodynamic tests
journal, December 2009


Cosmological Simulations with TreeSPH
journal, July 1996

  • Katz, Neal; Weinberg, David H.; Hernquist, Lars
  • The Astrophysical Journal Supplement Series, Vol. 105
  • DOI: 10.1086/192305

Including star formation and supernova feedback within cosmological simulations of galaxy formation
journal, February 2002


Fully Threaded Tree Algorithms for Adaptive Refinement Fluid Dynamics Simulations
journal, July 1998


Adaptive Refinement Tree: A New High‐Resolution N ‐Body Code for Cosmological Simulations
journal, July 1997

  • Kravtsov, Andrey V.; Klypin, Anatoly A.; Khokhlov, Alexei M.
  • The Astrophysical Journal Supplement Series, Vol. 111, Issue 1
  • DOI: 10.1086/313015

Relating Eddington factors to flux limiters
journal, February 1984


A convenient set of comoving cosmological variables and their application
journal, June 1998


The morphology of H II regions during reionization
journal, May 2007


Simulating cosmic reionization at large scales - II. The 21-cm emission features and statistical signals
journal, October 2006


Fully Coupled Simulation of Cosmic Reionization. i. Numerical Methods and Tests
journal, January 2015

  • Norman, Michael L.; Reynolds, Daniel R.; So, Geoffrey C.
  • The Astrophysical Journal Supplement Series, Vol. 216, Issue 1
  • DOI: 10.1088/0067-0049/216/1/16

High-Resolution Simulations of the Reionization of an Isolated Milky Way-M31 Galaxy pair
journal, October 2013


The Reionization of Galactic Satellite Populations
journal, September 2014


Mass loss of galaxies due to an ultraviolet background
journal, November 2008


The First Billion Years project: proto-galaxies reionizing the Universe
journal, December 2012

  • Paardekooper, Jan-Pieter; Khochfar, Sadegh; Dalla, Claudio Vecchia
  • Monthly Notices of the Royal Astronomical Society: Letters, Vol. 429, Issue 1
  • DOI: 10.1093/mnrasl/sls032

Spatially adaptive radiation-hydrodynamical simulations of galaxy formation during cosmological reionization
journal, June 2015

  • Pawlik, Andreas H.; Schaye, Joop; Vecchia, Claudio Dalla
  • Monthly Notices of the Royal Astronomical Society, Vol. 451, Issue 2
  • DOI: 10.1093/mnras/stv976

Planck 2013 results. XVI. Cosmological parameters
journal, October 2014


How supernova feedback turns dark matter cusps into cores: Supernova feedback and dark matter cores
journal, March 2012


21 cm cosmology in the 21st century
journal, July 2012


Initial Conditions For Large Cosmological Simulations
journal, October 2008

  • Prunet, S.; Pichon, C.; Aubert, D.
  • The Astrophysical Journal Supplement Series, Vol. 178, Issue 2
  • DOI: 10.1086/590370

The history of the baryon budget: Cosmic logistics in a hierarchical universe
journal, December 2005


ramses-rt: radiation hydrodynamics in the cosmological context
journal, October 2013

  • Rosdahl, J.; Blaizot, J.; Aubert, D.
  • Monthly Notices of the Royal Astronomical Society, Vol. 436, Issue 3
  • DOI: 10.1093/mnras/stt1722

Ellipsoidal collapse and an improved model for the number and spatial distribution of dark matter haloes
journal, May 2001


Cosmological hydrodynamics with adaptive mesh refinement: A new high resolution code called RAMSES
journal, April 2002


P3M-SPH simulations of the Lyα forest
journal, December 1998


Restoration of the contact surface in the HLL-Riemann solver
journal, July 1994

  • Toro, E. F.; Spruce, M.; Speares, W.
  • Shock Waves, Vol. 4, Issue 1
  • DOI: 10.1007/BF01414629

Radiative Transfer Simulations of Cosmic Reionization. I. Methodology and Initial Results
journal, December 2007

  • Trac, Hy; Cen, Renyue
  • The Astrophysical Journal, Vol. 671, Issue 1
  • DOI: 10.1086/522566

Computer Simulations of Cosmic Reionization
journal, February 2011


A parallel hashed Oct-Tree N-body algorithm
conference, January 1993

  • Warren, M. S.; Salmon, J. K.
  • Proceedings of the 1993 ACM/IEEE conference on Supercomputing - Supercomputing '93
  • DOI: 10.1145/169627.169640

The birth of a galaxy – II. The role of radiation pressure: Radiation pressure in early dwarf galaxies
journal, October 2012


Simulations and Analytic Calculations of Bubble Growth during Hydrogen Reionization
journal, January 2007

  • Zahn, Oliver; Lidz, Adam; McQuinn, Matthew
  • The Astrophysical Journal, Vol. 654, Issue 1
  • DOI: 10.1086/509597

Light-cone anisotropy in the 21 cm signal from the epoch of reionization
journal, February 2014

  • Zawada, Karolina; Semelin, Benoît; Vonlanthen, Patrick
  • Monthly Notices of the Royal Astronomical Society, Vol. 439, Issue 2
  • DOI: 10.1093/mnras/stu035

Works referencing / citing this record:

Cosmic reionisation
journal, April 2019


Cosmic Dawn (CoDa): the first radiation-hydrodynamics simulation of reionization and galaxy formation in the Local Universe
journal, August 2016

  • Ocvirk, Pierre; Gillet, Nicolas; Shapiro, Paul R.
  • Monthly Notices of the Royal Astronomical Society, Vol. 463, Issue 2
  • DOI: 10.1093/mnras/stw2036

Simulating an isolated dwarf galaxy with multichannel feedback and chemical yields from individual stars
journal, October 2018

  • Emerick, Andrew; Bryan, Greg L.; Mac Low, Mordecai-Mark
  • Monthly Notices of the Royal Astronomical Society, Vol. 482, Issue 1
  • DOI: 10.1093/mnras/sty2689

The Goldilocks problem of the quasar contribution to reionization
journal, December 2018

  • Garaldi, Enrico; Compostella, Michele; Porciani, Cristiano
  • Monthly Notices of the Royal Astronomical Society, Vol. 483, Issue 4
  • DOI: 10.1093/mnras/sty3414

Inferring the astrophysics of reionization and cosmic dawn from galaxy luminosity functions and the 21-cm signal
journal, January 2019

  • Park, Jaehong; Mesinger, Andrei; Greig, Bradley
  • Monthly Notices of the Royal Astronomical Society, Vol. 484, Issue 1
  • DOI: 10.1093/mnras/stz032

A deep learning model to emulate simulations of cosmic reionization
journal, September 2019

  • Chardin, Jonathan; Uhlrich, Grégoire; Aubert, Dominique
  • Monthly Notices of the Royal Astronomical Society, Vol. 490, Issue 1
  • DOI: 10.1093/mnras/stz2605

Properties of reionization-era galaxies from JWST luminosity functions and 21-cm interferometry
journal, November 2019

  • Park, Jaehong; Gillet, Nicolas; Mesinger, Andrei
  • Monthly Notices of the Royal Astronomical Society, Vol. 491, Issue 3
  • DOI: 10.1093/mnras/stz3278

Challenges and Techniques for Simulating Line Emission
journal, September 2018


The Inhomogeneous Reionization Times of Present-day Galaxies
journal, March 2018

  • Aubert, Dominique; Deparis, Nicolas; Ocvirk, Pierre
  • The Astrophysical Journal, Vol. 856, Issue 2
  • DOI: 10.3847/2041-8213/aab14d

Cosmic Dawn (CoDa): the first radiation-hydrodynamics simulation of reionization and galaxy formation in the Local Universe
text, January 2016

  • Ocvirk, Pierre; Gillet, Nicolas; Shapiro, Paul R.
  • Oxford University Press
  • DOI: 10.5167/uzh-129969

The Inhomogeneous Reionization Times of Present-day Galaxies
text, January 2018

  • Aubert, Dominique; Deparis, Nicolas; Ocvirk, Pierre
  • IOP Publishing
  • DOI: 10.5167/uzh-152904

An Introductory Review on Cosmic Reionization
text, January 2019