skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Nyx: A Massively Parallel AMR Code for Computational Cosmology

Abstract

We present a new N-body and gas dynamics code, called Nyx, for large-scale cosmological simulations. Nyx follows the temporal evolution of a system of discrete dark matter particles gravitationally coupled to an inviscid ideal fluid in an expanding universe. The gas is advanced in an Eulerian framework with block-structured adaptive mesh refinement; a particle-mesh scheme using the same grid hierarchy is used to solve for self-gravity and advance the particles. Computational results demonstrating the validation of Nyx on standard cosmological test problems, and the scaling behavior of Nyx to 50,000 cores, are presented.

Authors:
 [1];  [1];  [1];  [2];  [3]
  1. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). Center for Computational Sciences and Engineering
  2. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). Computational Cosmology Center
  3. Univ. of California, Berkeley, CA (United States). Mathematics Dept.
Publication Date:
Research Org.:
Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States); Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
Sponsoring Org.:
USDOE Office of Science (SC)
OSTI Identifier:
1565016
Grant/Contract Number:  
AC02-05CH11231
Resource Type:
Accepted Manuscript
Journal Name:
Astrophysical Journal
Additional Journal Information:
Journal Volume: 765; Journal Issue: 1; Journal ID: ISSN 0004-637X
Publisher:
Institute of Physics (IOP)
Country of Publication:
United States
Language:
English
Subject:
79 ASTRONOMY AND ASTROPHYSICS; astronomy & astrophysics; gravitation; hydrodynamics

Citation Formats

Almgren, Ann S., Bell, John B., Lijewski, Mike J., Lukić, Zarija, and Van Andel, Ethan. Nyx: A Massively Parallel AMR Code for Computational Cosmology. United States: N. p., 2013. Web. doi:10.1088/0004-637x/765/1/39.
Almgren, Ann S., Bell, John B., Lijewski, Mike J., Lukić, Zarija, & Van Andel, Ethan. Nyx: A Massively Parallel AMR Code for Computational Cosmology. United States. doi:10.1088/0004-637x/765/1/39.
Almgren, Ann S., Bell, John B., Lijewski, Mike J., Lukić, Zarija, and Van Andel, Ethan. Wed . "Nyx: A Massively Parallel AMR Code for Computational Cosmology". United States. doi:10.1088/0004-637x/765/1/39. https://www.osti.gov/servlets/purl/1565016.
@article{osti_1565016,
title = {Nyx: A Massively Parallel AMR Code for Computational Cosmology},
author = {Almgren, Ann S. and Bell, John B. and Lijewski, Mike J. and Lukić, Zarija and Van Andel, Ethan},
abstractNote = {We present a new N-body and gas dynamics code, called Nyx, for large-scale cosmological simulations. Nyx follows the temporal evolution of a system of discrete dark matter particles gravitationally coupled to an inviscid ideal fluid in an expanding universe. The gas is advanced in an Eulerian framework with block-structured adaptive mesh refinement; a particle-mesh scheme using the same grid hierarchy is used to solve for self-gravity and advance the particles. Computational results demonstrating the validation of Nyx on standard cosmological test problems, and the scaling behavior of Nyx to 50,000 cores, are presented.},
doi = {10.1088/0004-637x/765/1/39},
journal = {Astrophysical Journal},
number = 1,
volume = 765,
place = {United States},
year = {2013},
month = {2}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 46 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

E pur si muove: Galilean-invariant cosmological hydrodynamical simulations on a moving mesh
journal, January 2010


FLASH: An Adaptive Mesh Hydrodynamics Code for Modeling Astrophysical Thermonuclear Flashes
journal, November 2000

  • Fryxell, B.; Olson, K.; Ricker, P.
  • The Astrophysical Journal Supplement Series, Vol. 131, Issue 1
  • DOI: 10.1086/317361

Comparing AMR and SPH Cosmological Simulations. I. Dark Matter and Adiabatic Simulations
journal, September 2005

  • O’Shea, Brian W.; Nagamine, Kentaro; Springel, Volker
  • The Astrophysical Journal Supplement Series, Vol. 160, Issue 1
  • DOI: 10.1086/432645

Robustness of Cosmological Simulations. I. Large‐Scale Structure
journal, September 2005

  • Heitmann, Katrin; Ricker, Paul M.; Warren, Michael S.
  • The Astrophysical Journal Supplement Series, Vol. 160, Issue 1
  • DOI: 10.1086/432646

Castro: a new Compressible Astrophysical Solver. ii. gray Radiation Hydrodynamics
journal, September 2011

  • Zhang, W.; Howell, L.; Almgren, A.
  • The Astrophysical Journal Supplement Series, Vol. 196, Issue 2
  • DOI: 10.1088/0067-0049/196/2/20

Low mach Number Modeling of type ia Supernovae. iv. White Dwarf Convection
journal, September 2009


Constrained Simulations of the Real Universe. II. Observational Signatures of Intergalactic Gas in the Local Supercluster Region
journal, June 2002

  • Kravtsov, Andrey V.; Klypin, Anatoly; Hoffman, Yehuda
  • The Astrophysical Journal, Vol. 571, Issue 2
  • DOI: 10.1086/340046

Galaxy formation through hierarchical clustering
journal, September 1991

  • White, Simon D. M.; Frenk, Carlos S.
  • The Astrophysical Journal, Vol. 379
  • DOI: 10.1086/170483

Recent progress in the theory and application of symplectic integrators
journal, January 1993

  • Yoshida, Haruo
  • Celestial Mechanics and Dynamical Astronomy, Vol. 56, Issue 1-2
  • DOI: 10.1007/BF00699717

rpSPH: a novel smoothed particle hydrodynamics algorithm: Relative pressure SPH
journal, February 2011


Three-Dimensional Adaptive Mesh Refinement for Hyperbolic Conservation Laws
journal, January 1994

  • Bell, John; Berger, Marsha; Saltzman, Jeff
  • SIAM Journal on Scientific Computing, Vol. 15, Issue 1
  • DOI: 10.1137/0915008

Cosmological hydrodynamics with adaptive mesh refinement: A new high resolution code called RAMSES
journal, April 2002


Large-scale bias and the peak background split
journal, September 1999


Stable clustering, the halo model and non-linear cosmological power spectra
journal, June 2003


Constraining warm dark matter candidates including sterile neutrinos and light gravitinos with WMAP and the Lyman- α forest
journal, March 2005


Low Mach Number Modeling of Type Ia Supernovae. III. Reactions
journal, September 2008

  • Almgren, A. S.; Bell, J. B.; Nonaka, A.
  • The Astrophysical Journal, Vol. 684, Issue 1
  • DOI: 10.1086/590321

On the origin of cores in simulated galaxy clusters
journal, May 2009


The Santa Barbara Cluster Comparison Project: A Comparison of Cosmological Hydrodynamics Solutions
journal, November 1999

  • Frenk, C. S.; White, S. D. M.; Bode, P.
  • The Astrophysical Journal, Vol. 525, Issue 2
  • DOI: 10.1086/307908

Maestro: an Adaptive low mach Number Hydrodynamics Algorithm for Stellar Flows
journal, May 2010

  • Nonaka, A.; Almgren, A. S.; Bell, J. B.
  • The Astrophysical Journal Supplement Series, Vol. 188, Issue 2
  • DOI: 10.1088/0067-0049/188/2/358

Massive Halos in Millennium gas Simulations: Multivariate Scaling Relations
journal, May 2010


Hybrid petacomputing meets cosmology: The Roadrunner Universe project
journal, July 2009


Block structured adaptive mesh and time refinement for hybrid, hyperbolic+N-body systems
journal, November 2007


Low Mach Number Modeling of Type Ia Supernovae. II. Energy Evolution
journal, October 2006

  • Almgren, A. S.; Bell, J. B.; Rendleman, C. A.
  • The Astrophysical Journal, Vol. 649, Issue 2
  • DOI: 10.1086/507089

Parallelization of structured, hierarchical adaptive mesh refinement algorithms
journal, August 2000

  • Rendleman, Charles A.; Beckner, Vincent E.; Lijewski, Mike
  • Computing and Visualization in Science, Vol. 3, Issue 3
  • DOI: 10.1007/PL00013544

Adaptive Refinement Tree: A New High‐Resolution N ‐Body Code for Cosmological Simulations
journal, July 1997

  • Kravtsov, Andrey V.; Klypin, Anatoly A.; Khokhlov, Alexei M.
  • The Astrophysical Journal Supplement Series, Vol. 111, Issue 1
  • DOI: 10.1086/313015

The cosmic code comparison project
journal, October 2008


Low Mach Number Modeling of Type Ia Supernovae. I. Hydrodynamics
journal, February 2006

  • Almgren, A. S.; Bell, J. B.; Rendleman, C. A.
  • The Astrophysical Journal, Vol. 637, Issue 2
  • DOI: 10.1086/498426

The Halo Mass Function: High‐Redshift Evolution and Universality
journal, December 2007

  • Lukić, Zarija; Heitmann, Katrin; Habib, Salman
  • The Astrophysical Journal, Vol. 671, Issue 2
  • DOI: 10.1086/523083

yt: A MULTI-CODE ANALYSIS TOOLKIT FOR ASTROPHYSICAL SIMULATION DATA
journal, December 2010

  • Turk, Matthew J.; Smith, Britton D.; Oishi, Jeffrey S.
  • The Astrophysical Journal Supplement Series, Vol. 192, Issue 1
  • DOI: 10.1088/0067-0049/192/1/9

A Conservative Three-Dimensional Eulerian Method for Coupled Solid–Fluid Shock Capturing
journal, November 2002


Galaxy formation theory
journal, October 2010


Castro: a new Compressible Astrophysical Solver. i. Hydrodynamics and Self-Gravity
journal, May 2010


The evolution of large-scale structure in a universe dominated by cold dark matter
journal, May 1985

  • Davis, M.; Efstathiou, G.; Frenk, C. S.
  • The Astrophysical Journal, Vol. 292
  • DOI: 10.1086/163168

    Works referencing / citing this record:

    Measurement of the small-scale structure of the intergalactic medium using close quasar pairs
    journal, April 2017


    Large Eddy Simulations in Astrophysics
    journal, October 2015

    • Schmidt, Wolfram
    • Living Reviews in Computational Astrophysics, Vol. 1, Issue 1
    • DOI: 10.1007/lrca-2015-2

    Measurement of the small-scale structure of the intergalactic medium using close quasar pairs
    journal, April 2017


    Flexible and Scalable Particle-in-Cell Methods With Adaptive Mesh Refinement for Geodynamic Computations
    journal, September 2018

    • Gassmöller, Rene; Lokavarapu, Harsha; Heien, Eric
    • Geochemistry, Geophysics, Geosystems, Vol. 19, Issue 9
    • DOI: 10.1029/2018gc007508

    Highly parallelisable simulations of time-dependent viscoplastic fluid flow with structured adaptive mesh refinement
    journal, September 2018

    • Sverdrup, Knut; Nikiforakis, Nikolaos; Almgren, Ann
    • Physics of Fluids, Vol. 30, Issue 9
    • DOI: 10.1063/1.5049202

    An embedded boundary approach for efficient simulations of viscoplastic fluids in three dimensions
    journal, September 2019

    • Sverdrup, Knut; Almgren, Ann; Nikiforakis, Nikolaos
    • Physics of Fluids, Vol. 31, Issue 9
    • DOI: 10.1063/1.5110654

    Enzo: an Adaptive mesh Refinement code for Astrophysics
    journal, March 2014

    • Bryan, Greg L.; Norman, Michael L.; O'Shea, Brian W.
    • The Astrophysical Journal Supplement Series, Vol. 211, Issue 2
    • DOI: 10.1088/0067-0049/211/2/19

    PyUltraLight: a pseudo-spectral solver for ultralight dark matter dynamics
    journal, October 2018

    • Edwards, Faber; Kendall, Emily; Hotchkiss, Shaun
    • Journal of Cosmology and Astroparticle Physics, Vol. 2018, Issue 10
    • DOI: 10.1088/1475-7516/2018/10/027

    The one-dimensional power spectrum from the SDSS DR14 Lyα forests
    journal, July 2019

    • Chabanier, Solène; Palanque-Delabrouille, Nathalie; Yèche, Christophe
    • Journal of Cosmology and Astroparticle Physics, Vol. 2019, Issue 07
    • DOI: 10.1088/1475-7516/2019/07/017

    Modelling turbulent effects of stellar feedback in cosmological simulations
    journal, November 2018

    • Engels, Jan Frederik; Schmidt, Wolfram; Niemeyer, Jens
    • Monthly Notices of the Royal Astronomical Society, Vol. 482, Issue 4
    • DOI: 10.1093/mnras/sty3037

    The power spectrum of the Lyman-α Forest at z < 0.5
    journal, February 2019

    • Khaire, Vikram; Walther, Michael; Hennawi, Joseph F.
    • Monthly Notices of the Royal Astronomical Society, Vol. 486, Issue 1
    • DOI: 10.1093/mnras/stz344

    The first supermassive black holes: indications from models for future observations
    journal, February 2019

    • Amarantidis, Stergios; Afonso, José; Messias, Hugo
    • Monthly Notices of the Royal Astronomical Society, Vol. 485, Issue 2
    • DOI: 10.1093/mnras/stz551

    Inhomogeneous reionization models in cosmological hydrodynamical simulations
    journal, May 2019

    • Oñorbe, Jose; Davies, F. B.; Lukić, Z.
    • Monthly Notices of the Royal Astronomical Society, Vol. 486, Issue 3
    • DOI: 10.1093/mnras/stz984

    Simulations of solitonic core mergers in ultralight axion dark matter cosmologies
    journal, August 2016


    Cosmological particle-in-cell simulations with ultralight axion dark matter
    journal, December 2016


    In situ data-driven adaptive sampling for large-scale simulation data summarization
    conference, January 2018

    • Biswas, Ayan; Dutta, Soumya; Pulido, Jesus
    • Proceedings of the Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization - ISAV '18
    • DOI: 10.1145/3281464.3281467

    Self-consistent Modeling of Reionization in Cosmological Hydrodynamical Simulations
    journal, March 2017

    • Oñorbe, Jose; Hennawi, Joseph F.; Lukić, Zarija
    • The Astrophysical Journal, Vol. 837, Issue 2
    • DOI: 10.3847/1538-4357/aa6031

    A New Method to Measure the Post-reionization Ionizing Background from the Joint Distribution of Ly α and Ly β Forest Transmission
    journal, March 2018

    • Davies, Frederick B.; Hennawi, Joseph F.; Eilers, Anna-Christina
    • The Astrophysical Journal, Vol. 855, Issue 2
    • DOI: 10.3847/1538-4357/aaaf70

    A Fundamental Test for Galaxy Formation Models: Matching the Lyman- α Absorption Profiles of Galactic Halos Over Three Decades in Distance
    journal, May 2018

    • Sorini, Daniele; Oñorbe, José; Hennawi, Joseph F.
    • The Astrophysical Journal, Vol. 859, Issue 2
    • DOI: 10.3847/1538-4357/aabb52

    Detection of z ∼ 2.3 Cosmic Voids from 3D Ly α Forest Tomography in the COSMOS Field
    journal, July 2018

    • Krolewski, Alex; Lee, Khee-Gan; White, Martin
    • The Astrophysical Journal, Vol. 861, Issue 1
    • DOI: 10.3847/1538-4357/aac829

    Modeling the He ii Transverse Proximity Effect: Constraints on Quasar Lifetime and Obscuration
    journal, July 2018

    • Schmidt, Tobias M.; Hennawi, Joseph F.; Worseck, Gábor
    • The Astrophysical Journal, Vol. 861, Issue 2
    • DOI: 10.3847/1538-4357/aac8e4

    The Opacity of the Intergalactic Medium Measured along Quasar Sightlines at z ∼ 6
    journal, August 2018

    • Eilers, Anna-Christina; Davies, Frederick B.; Hennawi, Joseph F.
    • The Astrophysical Journal, Vol. 864, Issue 1
    • DOI: 10.3847/1538-4357/aad4fd

    Quantitative Constraints on the Reionization History from the IGM Damping Wing Signature in Two Quasars at z > 7
    journal, September 2018

    • Davies, Frederick B.; Hennawi, Joseph F.; Bañados, Eduardo
    • The Astrophysical Journal, Vol. 864, Issue 2
    • DOI: 10.3847/1538-4357/aad6dc

    A New Measurement of the Temperature–density Relation of the IGM from Voigt Profile Fitting
    journal, September 2018

    • Hiss, Hector; Walther, Michael; Hennawi, Joseph F.
    • The Astrophysical Journal, Vol. 865, Issue 1
    • DOI: 10.3847/1538-4357/aada86

    New Constraints on IGM Thermal Evolution from the Ly α Forest Power Spectrum
    journal, February 2019

    • Walther, Michael; Oñorbe, Jose; Hennawi, Joseph F.
    • The Astrophysical Journal, Vol. 872, Issue 1
    • DOI: 10.3847/1538-4357/aafad1

    The Evolution of the He ii-ionizing Background at Redshifts 2.3 < z < 3.8 Inferred from a Statistical Sample of 24 HST /COS He ii Ly α Absorption Spectra
    journal, April 2019

    • Worseck, Gábor; Davies, Frederick B.; Hennawi, Joseph F.
    • The Astrophysical Journal, Vol. 875, Issue 2
    • DOI: 10.3847/1538-4357/ab0fa1

    The Borg Cube Simulation: Cosmological Hydrodynamics with CRK-SPH
    journal, May 2019

    • Emberson, J. D.; Frontiere, Nicholas; Habib, Salman
    • The Astrophysical Journal, Vol. 877, Issue 2
    • DOI: 10.3847/1538-4357/ab1b31

    Anomaly in the Opacity of the Post-reionization Intergalactic Medium in the Ly α and Ly β Forest
    journal, August 2019

    • Eilers, Anna-Christina; Hennawi, Joseph F.; Davies, Frederick B.
    • The Astrophysical Journal, Vol. 881, Issue 1
    • DOI: 10.3847/1538-4357/ab2b3f

    Mapping Quasar Light Echoes in 3D with Ly α Forest Tomography
    journal, September 2019

    • Schmidt, Tobias M.; Hennawi, Joseph F.; Lee, Khee-Gan
    • The Astrophysical Journal, Vol. 882, Issue 2
    • DOI: 10.3847/1538-4357/ab2fcb

    TARDIS. I. A Constrained Reconstruction Approach to Modeling the z ∼ 2.5 Cosmic Web Probed by Ly α Forest Tomography
    journal, December 2019

    • Horowitz, Benjamin; Lee, Khee-Gan; White, Martin
    • The Astrophysical Journal, Vol. 887, Issue 1
    • DOI: 10.3847/1538-4357/ab4d4c

    WENO–WOMBAT: Scalable Fifth-order Constrained-transport Magnetohydrodynamics for Astrophysical Applications
    journal, March 2019

    • Donnert, J. M. F.; Jang, H.; Mendygral, P.
    • The Astrophysical Journal Supplement Series, Vol. 241, Issue 2
    • DOI: 10.3847/1538-4365/ab09fb