skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A Scalable Algorithm for Radiative Heat Transfer Using Reverse Monte Carlo Ray Tracing

Abstract

Radiative heat transfer is an important mechanism in a class of challenging engineering and research problems. A direct all-to-all treatment of these problems is prohibitively expensive on large core counts due to pervasive all- to-all MPI communication. The massive heat transfer problem arising from the next generation of clean coal boilers being modeled by the Uintah framework has radiation as a dominant heat transfer mode. Reverse Monte Carlo ray tracing (RMCRT) can be used to solve for the radiative-flux divergence while accounting for the effects of participating media. The ray tracing approach used here replicates the geometry of the boiler on a multi-core node and then uses an all-to-all communication phase to distribute the results globally. The cost of this all-to-all is reduced by using an adaptive mesh approach in which a fine mesh is only used locally, and a coarse mesh is used elsewhere. Here, a model for communication and computation complexity is used to predict performance of this new method. We show this model is consistent with observed results and demonstrate excellent strong scaling to 262K cores on the DOE Titan system on problem sizes that were previously computationally intractable.

Authors:
 [1];  [1];  [1];  [1]
  1. Univ. of Utah, Salt Lake City, UT (United States)
Publication Date:
Research Org.:
Univ. of Utah, Salt Lake City, UT (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA)
OSTI Identifier:
1756107
Grant/Contract Number:  
NA0002375; AC05-00OR22725
Resource Type:
Journal Article: Accepted Manuscript
Journal Name:
Lecture Notes in Computer Science
Additional Journal Information:
Journal Volume: 9137; Conference: ISC'15: High Performance Computing; Journal ID: ISSN 0302-9743
Publisher:
Springer
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; Uintah; Radiation modeling; Parallel; Scalability; Adaptive mesh refinement; Simulation science; Titan

Citation Formats

Humphrey, Alan, Harman, Todd, Berzins, Martin, and Smith, Phillip. A Scalable Algorithm for Radiative Heat Transfer Using Reverse Monte Carlo Ray Tracing. United States: N. p., 2015. Web. doi:10.1007/978-3-319-20119-1_16.
Humphrey, Alan, Harman, Todd, Berzins, Martin, & Smith, Phillip. A Scalable Algorithm for Radiative Heat Transfer Using Reverse Monte Carlo Ray Tracing. United States. https://doi.org/10.1007/978-3-319-20119-1_16
Humphrey, Alan, Harman, Todd, Berzins, Martin, and Smith, Phillip. Sat . "A Scalable Algorithm for Radiative Heat Transfer Using Reverse Monte Carlo Ray Tracing". United States. https://doi.org/10.1007/978-3-319-20119-1_16. https://www.osti.gov/servlets/purl/1756107.
@article{osti_1756107,
title = {A Scalable Algorithm for Radiative Heat Transfer Using Reverse Monte Carlo Ray Tracing},
author = {Humphrey, Alan and Harman, Todd and Berzins, Martin and Smith, Phillip},
abstractNote = {Radiative heat transfer is an important mechanism in a class of challenging engineering and research problems. A direct all-to-all treatment of these problems is prohibitively expensive on large core counts due to pervasive all- to-all MPI communication. The massive heat transfer problem arising from the next generation of clean coal boilers being modeled by the Uintah framework has radiation as a dominant heat transfer mode. Reverse Monte Carlo ray tracing (RMCRT) can be used to solve for the radiative-flux divergence while accounting for the effects of participating media. The ray tracing approach used here replicates the geometry of the boiler on a multi-core node and then uses an all-to-all communication phase to distribute the results globally. The cost of this all-to-all is reduced by using an adaptive mesh approach in which a fine mesh is only used locally, and a coarse mesh is used elsewhere. Here, a model for communication and computation complexity is used to predict performance of this new method. We show this model is consistent with observed results and demonstrate excellent strong scaling to 262K cores on the DOE Titan system on problem sizes that were previously computationally intractable.},
doi = {10.1007/978-3-319-20119-1_16},
url = {https://www.osti.gov/biblio/1756107}, journal = {Lecture Notes in Computer Science},
issn = {0302-9743},
number = ,
volume = 9137,
place = {United States},
year = {2015},
month = {6}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 6 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Fast and accurate discrete ordinates methods for multidimensional radiative transfer. Part I, basic methods
journal, June 2001


Uintah: a scalable framework for hazard analysis
conference, January 2010


FLASH: An Adaptive Mesh Hydrodynamics Code for Modeling Astrophysical Thermonuclear Flashes
journal, November 2000


Multilevel matrix multiplication and fast solution of integral equations
journal, October 1990


Spatial Domain-Based Parallelism in Large-Scale, Participating-Media, Radiative Transport Applications
journal, June 1997


Parallelization and scalability issues of a multilevel elastohydrodynamic lubrication solver
journal, January 2007


The Monte Carlo Method in Radiative Heat Transfer
journal, August 1998


Radiation modeling using the Uintah heterogeneous CPU/GPU runtime system
conference, January 2012

  • Humphrey, Alan; Meng, Qingyu; Berzins, Martin
  • Proceedings of the 1st Conference of the Extreme Science and Engineering Discovery Environment on Bridging from the eXtreme to the campus and beyond - XSEDE '12
  • https://doi.org/10.1145/2335755.2335791

Efficient Parallelization of RMCRT for Large Scale LES Combustion Simulations
conference, June 2012


An Adaptive Mesh Refinement Algorithm for the Radiative Transport Equation
journal, January 1998


A look at application performance sensitivity to the bandwidth and latency of InfiniBand networks
conference, January 2006


Scalable parallel regridding algorithms for block-structured adaptive mesh refinement
journal, March 2011


Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator
journal, January 1998


Using hybrid parallelism to improve memory use in the Uintah framework
conference, January 2011


Solution of Equilibrium Radiation Diffusion Problems Using Implicit Adaptive Mesh Refinement
journal, January 2006


Hybrid characteristics: 3D radiative transfer for parallel adaptive mesh refinement hydrodynamics
journal, June 2006


Large Scale Parallel Solution of Incompressible Flow Problems Using Uintah and Hypre
conference, May 2013

  • Schmidt, J.; Berzins, M.; Thornock, J.
  • 2013 13th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), 2013 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing
  • https://doi.org/10.1109/CCGrid.2013.10

Optimization of Collective Communication Operations in MPICH
journal, February 2005