EMMA: an adaptive mesh refinement cosmological simulation code with radiative transfer
Abstract
EMMA is a cosmological simulation code aimed at investigating the reionization epoch. It handles simultaneously collisionless and gas dynamics, as well as radiative transfer physics using a moment-based description with the M1 approximation. Field quantities are stored and computed on an adaptive three-dimensional mesh and the spatial resolution can be dynamically modified based on physically motivated criteria. Physical processes can be coupled at all spatial and temporal scales. We also introduce a new and optional approximation to handle radiation: the light is transported at the resolution of the non-refined grid and only once the dynamics has been fully updated, whereas thermo-chemical processes are still tracked on the refined elements. Such an approximation reduces the overheads induced by the treatment of radiation physics. A suite of standard tests are presented and passed by EMMA, providing a validation for its future use in studies of the reionization epoch. The code is parallel and is able to use graphics processing units (GPUs) to accelerate hydrodynamics and radiative transfer calculations. Depending on the optimizations and the compilers used to generate the CPU reference, global GPU acceleration factors between ×3.9 and ×16.9 can be obtained. As a result, vectorization and transfer operations currently prevent bettermore »
- Authors:
-
- Univ. de Strasbourg, Strasbourg (France)
- Publication Date:
- Research Org.:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
- Sponsoring Org.:
- USDOE Office of Science (SC)
- OSTI Identifier:
- 1565490
- Grant/Contract Number:
- AC05-00OR22725
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Monthly Notices of the Royal Astronomical Society
- Additional Journal Information:
- Journal Volume: 454; Journal Issue: 1; Journal ID: ISSN 0035-8711
- Publisher:
- Royal Astronomical Society
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 79 ASTRONOMY AND ASTROPHYSICS; methods: numerical; dark ages; reionization; first stars
Citation Formats
Aubert, Dominique, Deparis, Nicolas, and Ocvirk, Pierre. EMMA: an adaptive mesh refinement cosmological simulation code with radiative transfer. United States: N. p., 2015.
Web. doi:10.1093/mnras/stv1896.
Aubert, Dominique, Deparis, Nicolas, & Ocvirk, Pierre. EMMA: an adaptive mesh refinement cosmological simulation code with radiative transfer. United States. https://doi.org/10.1093/mnras/stv1896
Aubert, Dominique, Deparis, Nicolas, and Ocvirk, Pierre. Wed .
"EMMA: an adaptive mesh refinement cosmological simulation code with radiative transfer". United States. https://doi.org/10.1093/mnras/stv1896. https://www.osti.gov/servlets/purl/1565490.
@article{osti_1565490,
title = {EMMA: an adaptive mesh refinement cosmological simulation code with radiative transfer},
author = {Aubert, Dominique and Deparis, Nicolas and Ocvirk, Pierre},
abstractNote = {EMMA is a cosmological simulation code aimed at investigating the reionization epoch. It handles simultaneously collisionless and gas dynamics, as well as radiative transfer physics using a moment-based description with the M1 approximation. Field quantities are stored and computed on an adaptive three-dimensional mesh and the spatial resolution can be dynamically modified based on physically motivated criteria. Physical processes can be coupled at all spatial and temporal scales. We also introduce a new and optional approximation to handle radiation: the light is transported at the resolution of the non-refined grid and only once the dynamics has been fully updated, whereas thermo-chemical processes are still tracked on the refined elements. Such an approximation reduces the overheads induced by the treatment of radiation physics. A suite of standard tests are presented and passed by EMMA, providing a validation for its future use in studies of the reionization epoch. The code is parallel and is able to use graphics processing units (GPUs) to accelerate hydrodynamics and radiative transfer calculations. Depending on the optimizations and the compilers used to generate the CPU reference, global GPU acceleration factors between ×3.9 and ×16.9 can be obtained. As a result, vectorization and transfer operations currently prevent better GPU performance and we expect that future optimizations and hardware evolution will lead to greater accelerations.},
doi = {10.1093/mnras/stv1896},
journal = {Monthly Notices of the Royal Astronomical Society},
number = 1,
volume = 454,
place = {United States},
year = {Wed Sep 30 00:00:00 EDT 2015},
month = {Wed Sep 30 00:00:00 EDT 2015}
}
Web of Science
Works referenced in this record:
A radiative transfer scheme for cosmological reionization based on a local Eddington tensor
journal, June 2008
- Aubert, Dominique; Teyssier, Romain
- Monthly Notices of the Royal Astronomical Society, Vol. 387, Issue 1
Reionization Simulations Powered by Graphics Processing Units. i. on the Structure of the Ultraviolet Radiation Field
journal, November 2010
- Aubert, Dominique; Teyssier, Romain
- The Astrophysical Journal, Vol. 724, Issue 1
The simulated 21 cm signal during the epoch of reionization: full modeling of the Ly- α pumping
journal, December 2008
- Baek, S.; Di Matteo, P.; Semelin, B.
- Astronomy & Astrophysics, Vol. 495, Issue 2
Reionization by UV or X-ray sources
journal, November 2010
- Baek, S.; Semelin, B.; Di Matteo, P.
- Astronomy & Astrophysics, Vol. 523
In the beginning: the first sources of light and the reionization of the universe
journal, July 2001
- Barkana, Rennan; Loeb, Abraham
- Physics Reports, Vol. 349, Issue 2
Self-similar secondary infall and accretion in an Einstein-de Sitter universe
journal, May 1985
- Bertschinger, E.
- The Astrophysical Journal Supplement Series, Vol. 58
UV LUMINOSITY FUNCTIONS AT REDSHIFTS z ∼ 4 TO z ∼ 10: 10,000 GALAXIES FROM HST LEGACY FIELDS
journal, April 2015
- Bouwens, R. J.; Illingworth, G. D.; Oesch, P. A.
- The Astrophysical Journal, Vol. 803, Issue 1
Measurements of the ultraviolet background at 4.6 < z < 6.4 using the quasar proximity effect★: Proximity-effect measurements of the UVB at high redshift
journal, March 2011
- Calverley, Alexander P.; Becker, George D.; Haehnelt, Martin G.
- Monthly Notices of the Royal Astronomical Society, Vol. 412, Issue 4
A study of simulated reionization histories with merger trees of HII regions
journal, November 2012
- Chardin, J.; Aubert, D.; Ocvirk, P.
- Astronomy & Astrophysics, Vol. 548
Simulating intergalactic medium reionization
journal, August 2003
- Ciardi, B.; Stoehr, F.; White, S. D. M.
- Monthly Notices of the Royal Astronomical Society, Vol. 343, Issue 4
On the onset of galactic winds in quiescent star forming galaxies
journal, October 2007
- Dubois, Y.; Teyssier, R.
- Astronomy & Astrophysics, Vol. 477, Issue 1
Baryonic Features in the Matter Transfer Function
journal, April 1998
- Eisenstein, Daniel J.; Hu, Wayne
- The Astrophysical Journal, Vol. 496, Issue 2
HOP: A New Group‐finding Algorithm for N ‐Body Simulations
journal, May 1998
- Eisenstein, Daniel J.; Hut, Piet
- The Astrophysical Journal, Vol. 498, Issue 1
Constraining the Evolution of the Ionizing Background and the Epoch of Reionization with z ~ 6 Quasars. II. A Sample of 19 Quasars
journal, June 2006
- Fan, Xiaohui; Strauss, Michael A.; Becker, Robert H.
- The Astronomical Journal, Vol. 132, Issue 1
Galactic Outflows and Photoionization Heating in the Reionization Epoch
journal, December 2011
- Finlator, K.; Davé, R.; Özel, F.
- The Astrophysical Journal, Vol. 743, Issue 2
Effect of Reionization on Structure Formation in the Universe
journal, October 2000
- Gnedin, Nickolay Y.
- The Astrophysical Journal, Vol. 542, Issue 2
Cosmic Reionization on Computers. i. Design and Calibration of Simulations
journal, September 2014
- Gnedin, Nickolay Y.
- The Astrophysical Journal, Vol. 793, Issue 1
Multi-dimensional cosmological radiative transfer with a Variable Eddington Tensor formalism
journal, October 2001
- Gnedin, Nickolay Y.; Abel, Tom
- New Astronomy, Vol. 6, Issue 7
HERACLES: a three-dimensional radiation hydrodynamics code
journal, January 2007
- González, M.; Audit, E.; Huynh, P.
- Astronomy & Astrophysics, Vol. 464, Issue 2
Dwarf galaxies in voids: suppressing star formation with photoheating: Dwarf galaxies in voids
journal, August 2006
- Hoeft, Matthias; Yepes, Gustavo; Gottlöber, Stefan
- Monthly Notices of the Royal Astronomical Society, Vol. 371, Issue 1
Equation of state of the photoionized intergalactic medium
journal, November 1997
- Hui, L.; Gnedin, N. Y.
- Monthly Notices of the Royal Astronomical Society, Vol. 292, Issue 1
Cosmological radiative transfer codes comparison project ��� I. The static density field tests
journal, September 2006
- Iliev, Ilian T.; Ciardi, Benedetta; Alvarez, Marcelo A.
- Monthly Notices of the Royal Astronomical Society, Vol. 371, Issue 3
Cosmological radiative transfer comparison project â II. The radiation-hydrodynamic tests
journal, December 2009
- Iliev, Ilian T.; Whalen, Daniel; Mellema, Garrelt
- Monthly Notices of the Royal Astronomical Society, Vol. 400, Issue 3
Cosmological Simulations with TreeSPH
journal, July 1996
- Katz, Neal; Weinberg, David H.; Hernquist, Lars
- The Astrophysical Journal Supplement Series, Vol. 105
Including star formation and supernova feedback within cosmological simulations of galaxy formation
journal, February 2002
- Kay, Scott T.; Pearce, Frazer R.; Frenk, Carlos S.
- Monthly Notices of the Royal Astronomical Society, Vol. 330, Issue 1
Fully Threaded Tree Algorithms for Adaptive Refinement Fluid Dynamics Simulations
journal, July 1998
- Khokhlov, A. M.
- Journal of Computational Physics, Vol. 143, Issue 2
Adaptive Refinement Tree: A New High‐Resolution N ‐Body Code for Cosmological Simulations
journal, July 1997
- Kravtsov, Andrey V.; Klypin, Anatoly A.; Khokhlov, Alexei M.
- The Astrophysical Journal Supplement Series, Vol. 111, Issue 1
Relating Eddington factors to flux limiters
journal, February 1984
- Levermore, C. D.
- Journal of Quantitative Spectroscopy and Radiative Transfer, Vol. 31, Issue 2
A convenient set of comoving cosmological variables and their application
journal, June 1998
- Martel, H.; Shapiro, P. R.
- Monthly Notices of the Royal Astronomical Society, Vol. 297, Issue 2
The morphology of H II regions during reionization
journal, May 2007
- McQuinn, M.; Lidz, A.; Zahn, O.
- Monthly Notices of the Royal Astronomical Society, Vol. 377, Issue 3
Simulating cosmic reionization at large scales - II. The 21-cm emission features and statistical signals
journal, October 2006
- Mellema, Garrelt; Iliev, Ilian T.; Pen, Ue-Li
- Monthly Notices of the Royal Astronomical Society, Vol. 372, Issue 2
Fully Coupled Simulation of Cosmic Reionization. i. Numerical Methods and Tests
journal, January 2015
- Norman, Michael L.; Reynolds, Daniel R.; So, Geoffrey C.
- The Astrophysical Journal Supplement Series, Vol. 216, Issue 1
High-Resolution Simulations of the Reionization of an Isolated Milky Way-M31 Galaxy pair
journal, October 2013
- Ocvirk, P.; Aubert, D.; Chardin, J.
- The Astrophysical Journal, Vol. 777, Issue 1
The Reionization of Galactic Satellite Populations
journal, September 2014
- Ocvirk, P.; Gillet, N.; Aubert, D.
- The Astrophysical Journal, Vol. 794, Issue 1
Mass loss of galaxies due to an ultraviolet background
journal, November 2008
- Okamoto, Takashi; Gao, Liang; Theuns, Tom
- Monthly Notices of the Royal Astronomical Society, Vol. 390, Issue 3
The First Billion Years project: proto-galaxies reionizing the Universe
journal, December 2012
- Paardekooper, Jan-Pieter; Khochfar, Sadegh; Dalla, Claudio Vecchia
- Monthly Notices of the Royal Astronomical Society: Letters, Vol. 429, Issue 1
Spatially adaptive radiation-hydrodynamical simulations of galaxy formation during cosmological reionization
journal, June 2015
- Pawlik, Andreas H.; Schaye, Joop; Vecchia, Claudio Dalla
- Monthly Notices of the Royal Astronomical Society, Vol. 451, Issue 2
Planck 2013 results. XVI. Cosmological parameters
journal, October 2014
- Ade, P. A. R.; Aghanim, N.; Armitage-Caplan, C.
- Astronomy & Astrophysics, Vol. 571
How supernova feedback turns dark matter cusps into cores: Supernova feedback and dark matter cores
journal, March 2012
- Pontzen, Andrew; Governato, Fabio
- Monthly Notices of the Royal Astronomical Society, Vol. 421, Issue 4
21 cm cosmology in the 21st century
journal, July 2012
- Pritchard, Jonathan R.; Loeb, Abraham
- Reports on Progress in Physics, Vol. 75, Issue 8
Initial Conditions For Large Cosmological Simulations
journal, October 2008
- Prunet, S.; Pichon, C.; Aubert, D.
- The Astrophysical Journal Supplement Series, Vol. 178, Issue 2
The history of the baryon budget: Cosmic logistics in a hierarchical universe
journal, December 2005
- Rasera, Y.; Teyssier, R.
- Astronomy & Astrophysics, Vol. 445, Issue 1
ramses-rt: radiation hydrodynamics in the cosmological context
journal, October 2013
- Rosdahl, J.; Blaizot, J.; Aubert, D.
- Monthly Notices of the Royal Astronomical Society, Vol. 436, Issue 3
Ellipsoidal collapse and an improved model for the number and spatial distribution of dark matter haloes
journal, May 2001
- Sheth, R. K.; Mo, H. J.; Tormen, G.
- Monthly Notices of the Royal Astronomical Society, Vol. 323, Issue 1
Cosmological hydrodynamics with adaptive mesh refinement: A new high resolution code called RAMSES
journal, April 2002
- Teyssier, R.
- Astronomy & Astrophysics, Vol. 385, Issue 1
P3M-SPH simulations of the Lyα forest
journal, December 1998
- Theuns, Tom; Leonard, Anthony; Efstathiou, George
- Monthly Notices of the Royal Astronomical Society, Vol. 301, Issue 2
Restoration of the contact surface in the HLL-Riemann solver
journal, July 1994
- Toro, E. F.; Spruce, M.; Speares, W.
- Shock Waves, Vol. 4, Issue 1
Radiative Transfer Simulations of Cosmic Reionization. I. Methodology and Initial Results
journal, December 2007
- Trac, Hy; Cen, Renyue
- The Astrophysical Journal, Vol. 671, Issue 1
Computer Simulations of Cosmic Reionization
journal, February 2011
- Trac, Hy; Gnedin, Nickolay Y.
- Advanced Science Letters, Vol. 4, Issue 2
A parallel hashed Oct-Tree N-body algorithm
conference, January 1993
- Warren, M. S.; Salmon, J. K.
- Proceedings of the 1993 ACM/IEEE conference on Supercomputing - Supercomputing '93
The birth of a galaxy – II. The role of radiation pressure: Radiation pressure in early dwarf galaxies
journal, October 2012
- Wise, John H.; Abel, Tom; Turk, Matthew J.
- Monthly Notices of the Royal Astronomical Society, Vol. 427, Issue 1
Simulations and Analytic Calculations of Bubble Growth during Hydrogen Reionization
journal, January 2007
- Zahn, Oliver; Lidz, Adam; McQuinn, Matthew
- The Astrophysical Journal, Vol. 654, Issue 1
Light-cone anisotropy in the 21 cm signal from the epoch of reionization
journal, February 2014
- Zawada, Karolina; Semelin, Benoît; Vonlanthen, Patrick
- Monthly Notices of the Royal Astronomical Society, Vol. 439, Issue 2
Works referencing / citing this record:
Impact of the reduced speed of light approximation on the post-overlap neutral hydrogen fraction in numerical simulations of the epoch of reionization
journal, June 2019
- Ocvirk, P.; Aubert, D.; Chardin, J.
- Astronomy & Astrophysics, Vol. 626
Cosmic Dawn (CoDa): the first radiation-hydrodynamics simulation of reionization and galaxy formation in the Local Universe
journal, August 2016
- Ocvirk, Pierre; Gillet, Nicolas; Shapiro, Paul R.
- Monthly Notices of the Royal Astronomical Society, Vol. 463, Issue 2
Simulating an isolated dwarf galaxy with multichannel feedback and chemical yields from individual stars
journal, October 2018
- Emerick, Andrew; Bryan, Greg L.; Mac Low, Mordecai-Mark
- Monthly Notices of the Royal Astronomical Society, Vol. 482, Issue 1
The Goldilocks problem of the quasar contribution to reionization
journal, December 2018
- Garaldi, Enrico; Compostella, Michele; Porciani, Cristiano
- Monthly Notices of the Royal Astronomical Society, Vol. 483, Issue 4
Inferring the astrophysics of reionization and cosmic dawn from galaxy luminosity functions and the 21-cm signal
journal, January 2019
- Park, Jaehong; Mesinger, Andrei; Greig, Bradley
- Monthly Notices of the Royal Astronomical Society, Vol. 484, Issue 1
A deep learning model to emulate simulations of cosmic reionization
journal, September 2019
- Chardin, Jonathan; Uhlrich, Grégoire; Aubert, Dominique
- Monthly Notices of the Royal Astronomical Society, Vol. 490, Issue 1
Properties of reionization-era galaxies from JWST luminosity functions and 21-cm interferometry
journal, November 2019
- Park, Jaehong; Gillet, Nicolas; Mesinger, Andrei
- Monthly Notices of the Royal Astronomical Society, Vol. 491, Issue 3
Challenges and Techniques for Simulating Line Emission
journal, September 2018
- Olsen, Karen; Pallottini, Andrea; Wofford, Aida
- Galaxies, Vol. 6, Issue 4
The Inhomogeneous Reionization Times of Present-day Galaxies
journal, March 2018
- Aubert, Dominique; Deparis, Nicolas; Ocvirk, Pierre
- The Astrophysical Journal, Vol. 856, Issue 2
Cosmic Dawn (CoDa): the first radiation-hydrodynamics simulation of reionization and galaxy formation in the Local Universe
text, January 2016
- Ocvirk, Pierre; Gillet, Nicolas; Shapiro, Paul R.
- Oxford University Press
The Inhomogeneous Reionization Times of Present-day Galaxies
text, January 2018
- Aubert, Dominique; Deparis, Nicolas; Ocvirk, Pierre
- IOP Publishing
Impact of the reduced speed of light approximation on the post-overlap neutral hydrogen fraction in numerical simulations of the epoch of reionization
text, January 2018
- Ocvirk, P.; Aubert, D.; Chardin, J.
- arXiv
Inferring the astrophysics of reionization and cosmic dawn from galaxy luminosity functions and the 21-cm signal
text, January 2018
- Park, Jaehong; Mesinger, Andrei; Greig, Bradley
- arXiv