Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

GR-Athena++: General-relativistic Magnetohydrodynamics Simulations of Neutron Star Spacetimes

Journal Article · · The Astrophysical Journal. Supplement Series
We present the extension of GR-Athena++ to general-relativistic magnetohydrodynamics (GRMHD) for applications to neutron star spacetimes. The new solver couples the constrained transport implementation of Athena++ to the Z4c formulation of the Einstein equations to simulate dynamical spacetimes with GRMHD using oct-tree adaptive mesh refinement. We consider benchmark problems for isolated and binary neutron star spacetimes demonstrating stable and convergent results at relatively low resolutions and without grid symmetries imposed. The code correctly captures magnetic field instabilities in nonrotating stars with total relative violation of the divergence-free constraint of 10–16. It handles evolutions with a microphysical equation of state and black hole formation in the gravitational collapse of a rapidly rotating star. For binaries, we demonstrate correctness of the evolution under the gravitational radiation reaction and show convergence of gravitational waveforms. We showcase the use of adaptive mesh refinement to resolve the Kelvin–Helmholtz instability at the collisional interface in a merger of magnetised binary neutron stars. GR-Athena++ shows strong scaling efficiencies above 80% in excess of 105 CPU cores and excellent weak scaling is shown up to ~5 × 105 CPU cores in a realistic production setup. GR-Athena++ allows for the robust simulation of GRMHD flows in strong and dynamical gravity with exa-scale computers.
Research Organization:
Pennsylvania State University, University Park, PA (United States)
Sponsoring Organization:
National Aeronautics and Space Administration (NASA); National Science Foundation (NSF); USDOE Office of Science (SC), Basic Energy Sciences (BES). Scientific User Facilities (SUF); USDOE Office of Science (SC), Nuclear Physics (NP)
Grant/Contract Number:
AC02-05CH11231; SC0021177
OSTI ID:
2517899
Journal Information:
The Astrophysical Journal. Supplement Series, Journal Name: The Astrophysical Journal. Supplement Series Journal Issue: 1 Vol. 277; ISSN 0067-0049
Publisher:
IOP PublishingCopyright Statement
Country of Publication:
United States
Language:
English

References (162)

Weighted Essentially Non-oscillatory Schemes journal November 1994
Efficient Implementation of Weighted ENO Schemes journal June 1996
The ∇·B=0 Constraint in Shock-Capturing Magnetohydrodynamics Codes journal July 2000
Hyperbolic Divergence Cleaning for the MHD Equations journal January 2002
Divergence- and Curl-Preserving Prolongation and Restriction Formulas journal August 2002
Magnetic, thermal and rotational evolution of isolated neutron stars journal December 2019
Towards the ultimate conservative difference scheme. II. Monotonicity and conservation combined in a second-order scheme journal March 1974
A Simflowny-based high-performance 3D code for the generalized induction equation journal April 2019
On the divergence-free condition in Godunov-type schemes for ideal magnetohydrodynamics: the upwind constrained transport method journal March 2004
An unsplit Godunov method for ideal MHD via constrained transport journal May 2005
An improved weighted essentially non-oscillatory scheme for hyperbolic conservation laws journal March 2008
An unsplit Godunov method for ideal MHD via constrained transport in three dimensions journal April 2008
High-order, finite-volume methods in mapped coordinates journal April 2011
High-order finite-volume methods for hyperbolic conservation laws on mapped multiblock grids journal May 2015
SpECTRE: A task-based discontinuous Galerkin code for relativistic astrophysics journal April 2017
A finite element method for angular discretization of the radiation transport equation on spherical geodesic grids journal October 2023
The physics of gamma-ray bursts & relativistic jets journal February 2015
Universality in the run-up of shock waves to the surface of a star journal April 2011
Nucleosynthesis, neutrino bursts and γ-rays from coalescing neutron stars journal July 1989
Optical emission from a kilonova following a gravitational-wave-detected neutron-star merger journal October 2017
Spectroscopic identification of r-process nucleosynthesis in a double neutron-star merger journal October 2017
Origin of the heavy elements in binary neutron-star mergers from a gravitational-wave event journal October 2017
A Godunov-type scheme for relativistic magnetohydrodynamics journal February 1999
Evolution of the magnetic field in magnetars journal April 2006
ECHO: a Eulerian conservative high-order scheme for general relativistic magnetohydrodynamics and magnetodynamics journal July 2007
Spin‐ s Spherical Harmonics and ð journal November 1967
Evolution of pulsar magnetic fields journal July 1977
Simulation of magnetohydrodynamic flows - A constrained transport method journal September 1988
A powerful local shear instability in weakly magnetized disks. I - Linear analysis. II - Nonlinear evolution journal July 1991
Comparing models of rapidly rotating relativistic stars constructed by two numerical methods journal May 1995
Gamma-ray bursters at cosmological distances journal September 1986
Are gamma-ray bursts optically thick? journal September 1986
Gamma-ray bursts as the death throes of massive binary stars journal August 1992
Numerical {3 + 1} General Relativistic Hydrodynamics: A Local Characteristic Approach journal February 1997
A Divergence‐free Upwind Code for Multidimensional Magnetohydrodynamic Flows journal December 1998
Transient Events from Neutron Star Mergers journal November 1998
Total Variation Diminishing Scheme for Adiabatic and Isothermal Magnetohydrodynamics journal May 1998
HARM: A Numerical Scheme for General Relativistic Magnetohydrodynamics journal May 2003
Cosmos++ : Relativistic Magnetohydrodynamics on Unstructured Grids with Local Adaptive Refinement journal December 2005
Numerical 3+1 General Relativistic Magnetohydrodynamics: A Local Characteristic Approach journal January 2006
Athena: A New Code for Astrophysical MHD journal September 2008
Core-Collapse Supernova Equations of State Based on Neutron star Observations journal August 2013
A Second-Order Godunov Method for Multi-Dimensional Relativistic Magnetohydrodynamics journal January 2011
Coalescing binary neutron stars journal January 1999
Test-beds and applications for apparent horizon finders in numerical relativity journal May 2000
Numerical relativity using a generalized harmonic decomposition journal January 2005
Relativistic MHD with adaptive mesh refinement journal October 2006
WhiskyMHD: a new numerical code for general relativistic magnetohydrodynamics journal June 2007
The Einstein Toolkit: a community computational infrastructure for relativistic astrophysics journal May 2012
GRHydro: a new open-source general-relativistic magnetohydrodynamics code for the Einstein toolkit journal November 2013
High-order fully general-relativistic hydrodynamics: new approaches and tests journal March 2014
IllinoisGRMHD: an open-source, user-friendly GRMHD code for dynamical spacetimes journal August 2015
A Simflowny-based finite-difference code for high-performance computing in numerical relativity journal August 2018
Spritz: a new fully general-relativistic magnetohydrodynamic code journal June 2020
SPHINCS_BSSN: a general relativistic smooth particle hydrodynamics code for dynamical spacetimes journal April 2021
GRaM-X: a new GPU-accelerated dynamical spacetime GRMHD code for Exascale computing with the Einstein Toolkit journal September 2023
Hydromagnetic Instabilities in Relativistic Neutron Stars journal June 2011
Instability-Driven Evolution of Poloidal Magnetic Fields in Relativistic Stars journal June 2011
Magnetically Driven Winds from Differentially Rotating Neutron Stars and X-Ray Afterglows of Short Gamma-Ray Bursts journal March 2014
The Adiabatic Stability of Stars Containing Magnetic Fields-I: TOROIDAL FIELDS journal April 1973
Pinch Instabilities in Magnetic Stars journal June 1973
The Adiabatic Stability of Stars Containing Magnetic Fields-II: POLOIDAL FIELDS journal July 1973
The Adiabatic Stability of Stars Containing Magnetic Fields – III: ADDITIONAL RESULTS FOR POLOIDAL FIELDS journal September 1974
Accretion-induced prompt black hole formation in asymmetric neutron star mergers, dynamical ejecta and kilonova signals journal June 2020
Gmunu: paralleled, grid-adaptive, general-relativistic magnetohydrodynamics in curvilinear geometries in dynamical space–times journal September 2021
r-process nucleosynthesis and kilonovae from hypermassive neutron star post-merger remnants journal November 2022
Long-term general relativistic magnetohydrodynamics simulations of magnetic field in isolated neutron stars journal February 2022
A new moment-based general-relativistic neutrino-radiation transport code: Methods and first applications to neutron star mergers journal March 2022
Binary neutron star merger simulations with neutrino transport and turbulent viscosity: impact of different schemes and grid resolution journal January 2023
Magnetic field effects on nucleosynthesis and kilonovae from neutron star merger remnants journal September 2023
Axisymmetric equilibrium models for magnetized neutron stars in General Relativity under the Conformally Flat Condition journal March 2014
General relativistic models for rotating magnetized neutron stars in conformally flat space–time journal May 2017
Twisted-torus configurations with large toroidal magnetic fields in relativistic stars journal August 2013
Beyond second-order convergence in simulations of binary neutron stars in full general relativity journal October 2013
General relativistic MHD large eddy simulations with gradient subgrid-scale model journal June 2020
Turbulent magnetic-field amplification in the first 10 milliseconds after a binary neutron star merger: Comparing high-resolution and large-eddy simulations journal November 2020
Robust recovery of primitive variables in relativistic ideal magnetohydrodynamics journal January 2021
Signatures of deconfined quark phases in binary neutron star mergers journal October 2021
Thermal aspects of neutron star mergers journal November 2021
Turbulent magnetic field amplification in binary neutron star mergers journal July 2022
Entropy-limited higher-order central scheme for neutron star merger simulations journal July 2022
Implementation of advanced Riemann solvers in a neutrino-radiation magnetohydrodynamics code in numerical relativity and its application to a binary neutron star merger journal December 2022
Role of turbulence and winding in the development of large-scale, strong magnetic fields in long-lived remnants of binary neutron star mergers journal November 2023
Numerical relativistic hydrodynamics: Local characteristic approach journal June 1991
Evolution of three-dimensional gravitational waves: Harmonic slicing case journal November 1995
Adaptive mesh and geodesically sliced Schwarzschild spacetime in 3+1 dimensions journal December 1996
Pseudospectral apparent horizon finders: An efficient new algorithm journal January 1998
Numerical integration of Einstein’s field equations journal December 1998
Fully general relativistic simulation of coalescing binary neutron stars: Preparatory tests journal October 1999
Simulation of merging binary neutron stars in full general relativity: Γ = 2 case journal February 2000
Quasiequilibrium sequences of synchronized and irrotational binary neutron stars in general relativity: Method and tests journal February 2001
Three-dimensional numerical general relativistic hydrodynamics. II. Long-term dynamics of single relativistic stars journal April 2002
Hydrodynamic simulations in 3 + 1 general relativity journal January 2003
Three-dimensional relativistic simulations of rotating neutron-star collapse to a Kerr black hole journal January 2005
Relativistic magnetohydrodynamics in dynamical spacetimes: Numerical methods and tests journal July 2005
Magnetohydrodynamics in full general relativity: Formulation and tests journal August 2005
High-resolution shock capturing scheme for ideal hydrodynamics in general relativity optimized for quasistationary solutions journal December 2006
Simulating binary neutron stars: Dynamics and gravitational waves journal January 2008
Calibration of moving puncture simulations journal January 2008
General relativistic simulations of magnetized binary neutron star mergers journal July 2008
Evolution of neutron stars with toroidal magnetic fields: Axisymmetric simulation in full general relativity journal July 2008
Evolving black hole-neutron star binaries in general relativity using pseudospectral and finite difference methods journal November 2008
Gravitational-wave extraction from neutron-star oscillations: Comparing linear and nonlinear techniques journal January 2009
Constraint violation in free evolution schemes: Comparing the BSSNOK formulation with a conformal decomposition of the Z4 formulation journal April 2010
Evolutions of magnetized and rotating neutron stars journal June 2010
Relativistic magnetohydrodynamics in dynamical spacetimes: A new adaptive mesh refinement implementation journal October 2010
Black hole-neutron star mergers: Effects of the orientation of the black hole spin journal January 2011
Constraint preserving boundary conditions for the Z4c formulation of general relativity journal January 2011
Trumpet solution from spherical gravitational collapse with puncture gauges journal March 2011
Numerical relativity simulations of binary neutron stars journal August 2011
Relativistic magnetohydrodynamics in dynamical spacetimes: Improved electromagnetic gauge condition for adaptive mesh refinement grids journal January 2012
Constraint damping for the Z4c formulation of general relativity journal January 2012
Conformal and covariant formulation of the Z4 system with constraint-violation damping journal March 2012
Hydrodynamics in full general relativity with conservative adaptive mesh refinement journal June 2012
Tidal effects in binary neutron star coalescence journal August 2012
Three-dimensional general-relativistic hydrodynamic simulations of binary neutron star coalescence and stellar collapse with multipatch grids journal March 2013
Constraint damping of the conformal and covariant formulation of the Z4 system in simulations of binary neutron stars journal September 2013
Compact binary evolutions with the Z4c formulation journal October 2013
High resolution numerical relativity simulations for the merger of binary magnetized neutron stars journal August 2014
Simulations of rotating neutron star collapse with the puncture gauge: End state and gravitational waveforms journal February 2015
Efficient magnetic-field amplification due to the Kelvin-Helmholtz instability in binary neutron star mergers journal December 2015
Gravitational waveforms from binary neutron star mergers with high-order weighted-essentially-nonoscillatory schemes in numerical relativity journal September 2016
Global simulations of strongly magnetized remnant massive neutron stars formed in binary neutron star mergers journal June 2018
Energy Versus Angular Momentum in Black Hole Binaries journal March 2012
GW170817: Observation of Gravitational Waves from a Binary Neutron Star Inspiral journal October 2017
Three-Dimensional General-Relativistic Magnetohydrodynamic Simulations of Remnant Accretion Disks from Neutron Star Mergers: Outflows and r -Process Nucleosynthesis journal December 2017
Self-Consistent Picture of the Mass Ejection from a One Second Long Binary Neutron Star Merger Leaving a Short-Lived Remnant in a General-Relativistic Neutrino-Radiation Magnetohydrodynamic Simulation journal July 2023
Jets from Neutron-Star Merger Remnants and Massive Blue Kilonovae journal December 2023
Reversible and Irreversible Transformations in Black-Hole Physics journal November 1970
A Simple Construction of Initial Data for Multiple Black Holes journal May 1997
Evolution of Binary Black-Hole Spacetimes journal September 2005
Accurate Evolutions of Orbiting Black-Hole Binaries without Excision journal March 2006
Gravitational-Wave Extraction from an Inspiraling Configuration of Merging Black Holes journal March 2006
The physics of gamma-ray bursts journal January 2005
Observations of the Blandford-Znajek process and the magnetohydrodynamic Penrose process in computer simulations of black hole magnetospheres journal May 2005
An HLLC Riemann solver for relativistic flows -- I. Hydrodynamics journal November 2005
Non-linear axisymmetric pulsations of rotating relativistic stars in the conformal flatness approximation journal June 2006
A five-wave Harten-Lax-van Leer Riemann solver for relativistic magnetohydrodynamics journal March 2009
Electromagnetic counterparts of compact object mergers powered by the radioactive decay of r-process nuclei: Transients from compact object mergers journal June 2010
Producing Ultrastrong Magnetic Fields in Neutron Star Mergers journal May 2006
Swope Supernova Survey 2017a (SSS17a), the optical counterpart to a gravitational wave source journal October 2017
CompOSE CompStar online supernova equations of state harmonising the concert of nuclear physics and astrophysics compose.obspm.fr journal July 2015
Thermodynamics conditions of matter in neutron star mergers journal August 2019
Thermodynamics conditions of matter in the neutrino decoupling region during neutron star mergers journal January 2020
Short gamma-ray burst central engines journal October 2018
Entropy-limited hydrodynamics: a novel approach to relativistic hydrodynamics journal July 2017
Numerical Hydrodynamics and Magnetohydrodynamics in General Relativity journal September 2008
An Extension of the Athena++ code Framework for Grmhd Based on Advanced Riemann Solvers and Staggered-Mesh Constrained Transport journal August 2016
Recovery Schemes for Primitive Variables in General-relativistic Magnetohydrodynamics journal May 2018
Binary Neutron Star Mergers: Mass Ejection, Electromagnetic Counterparts, and Nucleosynthesis journal December 2018
GRMHD Simulations of Neutron-star Mergers with Weak Interactions: r-process Nucleosynthesis and Electromagnetic Signatures of Dynamical Ejecta journal February 2023
An Extension of the Athena++ Code Framework for Radiation-magnetohydrodynamics in General Relativity Using a Finite-solid-angle Discretization journal June 2023
The Athena++ Adaptive Mesh Refinement Framework: Design and Magnetohydrodynamic Solvers journal June 2020
GR-Athena++: Puncture Evolutions on Vertex-centered Oct-tree Adaptive Mesh Refinement journal November 2021
General-relativistic Large-eddy Simulations of Binary Neutron Star Mergers journal March 2017
An Ordinary Short Gamma-Ray Burst with Extraordinary Implications: Fermi -GBM Detection of GRB 170817A journal October 2017
INTEGRAL Detection of the First Prompt Gamma-Ray Signal Coincident with the Gravitational-wave Event GW170817 journal October 2017
The Electromagnetic Counterpart of the Binary Neutron Star Merger LIGO/Virgo GW170817. I. Discovery of the Optical Counterpart Using the Dark Energy Camera journal October 2017
Multi-messenger Observations of a Binary Neutron Star Merger journal October 2017
Gravitational Waves and Gamma-Rays from a Binary Neutron Star Merger: GW170817 and GRB 170817A journal October 2017
A Magnetar Engine for Short GRBs and Kilonovae journal October 2020
Exploding neutron stars in close binaries text January 2018

Similar Records

GR-Athena++: Puncture Evolutions on Vertex-centered Oct-tree Adaptive Mesh Refinement
Journal Article · Tue Nov 09 19:00:00 EST 2021 · The Astrophysical Journal. Supplement Series · OSTI ID:1865194

Performance-portable Binary Neutron Star Mergers with AthenaK
Journal Article · Mon Jan 13 19:00:00 EST 2025 · The Astrophysical Journal. Supplement Series · OSTI ID:2500239

Adaptive mesh refinement in binary black holes simulations
Journal Article · Tue Apr 02 20:00:00 EDT 2024 · Classical and Quantum Gravity · OSTI ID:2333059