DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: AMReX: Block-structured adaptive mesh refinement for multiphysics applications

Abstract

Block-structured adaptive mesh refinement (AMR) provides the basis for the temporal and spatial discretization strategy for a number of Exascale Computing Project applications in the areas of accelerator design, additive manufacturing, astrophysics, combustion, cosmology, multiphase flow, and wind plant modeling. AMReX is a software framework that provides a unified infrastructure with the functionality needed for these and other AMR applications to be able to effectively and efficiently utilize machines from laptops to exascale architectures. AMR reduces the computational cost and memory footprint compared to a uniform mesh while preserving accurate descriptions of different physical processes in complex multiphysics algorithms. AMReX supports algorithms that solve systems of partial differential equations in simple or complex geometries and those that use particles and/or particle–mesh operations to represent component physical processes. In this article, we will discuss the core elements of the AMReX framework such as data containers and iterators as well as several specialized operations to meet the needs of the application projects. In addition, we will highlight the strategy that the AMReX team is pursuing to achieve highly performant code across a range of accelerator-based architectures for a variety of different applications.

Authors:
 [1];  [1];  [2];  [1]; ORCiD logo [1]
  1. CCSE, Lawrence Berkeley National Laboratory, Berkeley, CA, USA
  2. NERSC, Lawrence Berkeley National Laboratory, Berkeley, CA, USA
Publication Date:
Sponsoring Org.:
USDOE
OSTI Identifier:
1788101
Grant/Contract Number:  
17-SC-20-SC; AC02-05CH11231; AC05-00OR22725
Resource Type:
Published Article
Journal Name:
International Journal of High Performance Computing Applications
Additional Journal Information:
Journal Name: International Journal of High Performance Computing Applications Journal Volume: 35 Journal Issue: 6; Journal ID: ISSN 1094-3420
Publisher:
SAGE Publications
Country of Publication:
United States
Language:
English

Citation Formats

Zhang, Weiqun, Myers, Andrew, Gott, Kevin, Almgren, Ann, and Bell, John. AMReX: Block-structured adaptive mesh refinement for multiphysics applications. United States: N. p., 2021. Web. doi:10.1177/10943420211022811.
Zhang, Weiqun, Myers, Andrew, Gott, Kevin, Almgren, Ann, & Bell, John. AMReX: Block-structured adaptive mesh refinement for multiphysics applications. United States. https://doi.org/10.1177/10943420211022811
Zhang, Weiqun, Myers, Andrew, Gott, Kevin, Almgren, Ann, and Bell, John. Sat . "AMReX: Block-structured adaptive mesh refinement for multiphysics applications". United States. https://doi.org/10.1177/10943420211022811.
@article{osti_1788101,
title = {AMReX: Block-structured adaptive mesh refinement for multiphysics applications},
author = {Zhang, Weiqun and Myers, Andrew and Gott, Kevin and Almgren, Ann and Bell, John},
abstractNote = {Block-structured adaptive mesh refinement (AMR) provides the basis for the temporal and spatial discretization strategy for a number of Exascale Computing Project applications in the areas of accelerator design, additive manufacturing, astrophysics, combustion, cosmology, multiphase flow, and wind plant modeling. AMReX is a software framework that provides a unified infrastructure with the functionality needed for these and other AMR applications to be able to effectively and efficiently utilize machines from laptops to exascale architectures. AMR reduces the computational cost and memory footprint compared to a uniform mesh while preserving accurate descriptions of different physical processes in complex multiphysics algorithms. AMReX supports algorithms that solve systems of partial differential equations in simple or complex geometries and those that use particles and/or particle–mesh operations to represent component physical processes. In this article, we will discuss the core elements of the AMReX framework such as data containers and iterators as well as several specialized operations to meet the needs of the application projects. In addition, we will highlight the strategy that the AMReX team is pursuing to achieve highly performant code across a range of accelerator-based architectures for a variety of different applications.},
doi = {10.1177/10943420211022811},
journal = {International Journal of High Performance Computing Applications},
number = 6,
volume = 35,
place = {United States},
year = {Sat Jun 12 00:00:00 EDT 2021},
month = {Sat Jun 12 00:00:00 EDT 2021}
}

Works referenced in this record:

BoxLib with Tiling: An Adaptive Mesh Refinement Software Framework
journal, January 2016

  • Zhang, Weiqun; Almgren, Ann; Day, Marcus
  • SIAM Journal on Scientific Computing, Vol. 38, Issue 5
  • DOI: 10.1137/15M102616X

RAJA: Portable Performance for Large-Scale Scientific Applications
conference, November 2019

  • Beckingsale, David A.; Scogland, Thomas RW; Burmark, Jason
  • 2019 IEEE/ACM International Workshop on Performance, Portability and Productivity in HPC (P3HPC)
  • DOI: 10.1109/P3HPC49587.2019.00012

FLASH: An Adaptive Mesh Hydrodynamics Code for Modeling Astrophysical Thermonuclear Flashes
journal, November 2000

  • Fryxell, B.; Olson, K.; Ricker, P.
  • The Astrophysical Journal Supplement Series, Vol. 131, Issue 1
  • DOI: 10.1086/317361

Kokkos: Enabling manycore performance portability through polymorphic memory access patterns
journal, December 2014

  • Carter Edwards, H.; Trott, Christian R.; Sunderland, Daniel
  • Journal of Parallel and Distributed Computing, Vol. 74, Issue 12
  • DOI: 10.1016/j.jpdc.2014.07.003

Warp-X: A new exascale computing platform for beam–plasma simulations
journal, November 2018

  • Vay, J. -L.; Almgren, A.; Bell, J.
  • Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 909
  • DOI: 10.1016/j.nima.2018.01.035

A survey of high level frameworks in block-structured adaptive mesh refinement packages
journal, December 2014

  • Dubey, Anshu; Almgren, Ann; Bell, John
  • Journal of Parallel and Distributed Computing, Vol. 74, Issue 12
  • DOI: 10.1016/j.jpdc.2014.07.001

Feature Analysis, Tracking, and Data Reduction: An Application to Multiphase Reactor Simulation MFiX-Exa for In-Situ Use Case
journal, January 2021

  • Biswas, Ayan; Ahrens, James P.; Dutta, Soumya
  • Computing in Science & Engineering, Vol. 23, Issue 1
  • DOI: 10.1109/MCSE.2020.3016927

The Design and Implementation of hypre, a Library of Parallel High Performance Preconditioners
book, January 2006

  • Falgout, Robert D.; Jones, Jim E.; Yang, Ulrike Meier
  • Lecture Notes in Computational Science and Engineering
  • DOI: 10.1007/3-540-31619-1_8

Evolution of FLASH, a multi-physics scientific simulation code for high-performance computing
journal, October 2013

  • Dubey, Anshu; Antypas, Katie; Calder, Alan C.
  • The International Journal of High Performance Computing Applications, Vol. 28, Issue 2
  • DOI: 10.1177/1094342013505656

An algorithm for point clustering and grid generation
journal, January 1991

  • Berger, M.; Rigoutsos, I.
  • IEEE Transactions on Systems, Man, and Cybernetics, Vol. 21, Issue 5
  • DOI: 10.1109/21.120081

SUNDIALS: Suite of nonlinear and differential/algebraic equation solvers
journal, September 2005

  • Hindmarsh, Alan C.; Brown, Peter N.; Grant, Keith E.
  • ACM Transactions on Mathematical Software, Vol. 31, Issue 3
  • DOI: 10.1145/1089014.1089020

Castro: a new Compressible Astrophysical Solver. i. Hydrodynamics and Self-Gravity
journal, May 2010


Nyx: A MASSIVELY PARALLEL AMR CODE FOR COMPUTATIONAL COSMOLOGY
journal, February 2013


AMReX: a framework for block-structured adaptive mesh refinement
journal, May 2019

  • Zhang, Weiqun; Almgren, Ann; Beckner, Vince
  • Journal of Open Source Software, Vol. 4, Issue 37
  • DOI: 10.21105/joss.01370