DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: ExaAM: Metal additive manufacturing simulation at the fidelity of the microstructure

Abstract

Additive manufacturing (AM), or 3D printing, of metals is transforming the fabrication of components, in part by dramatically expanding the design space, allowing optimization of shape and topology. However, although the physical processes involved in AM are similar to those of welding, a field with decades of experimental, modeling, simulation, and characterization experience, qualification of AM parts remains a challenge. The availability of exascale computational systems, particularly when combined with data-driven approaches such as machine learning, enables topology and shape optimization as well as accelerated qualification by providing process-aware, locally accurate microstructure and mechanical property models. Here we describe the physics components comprising the Exascale Additive Manufacturing simulation environment and report progress using highly resolved melt pool simulations to inform part-scale finite element thermomechanics simulations, drive microstructure evolution, and determine constitutive mechanical property relationships based on those microstructures using polycrystal plasticity. We report on implementation of these components for exascale computing architectures, as well as the multi-stage simulation workflow that provides a unique high-fidelity model of process–structure–property relationships for AM parts. In addition, we discuss verification and validation through collaboration with efforts such as AM-Bench, a set of benchmark test problems under development by a team led by the Nationalmore » Institute of Standards and Technology.« less

Authors:
ORCiD logo [1];  [2];  [2];  [1];  [3]; ORCiD logo [2];  [1];  [1];  [2]; ORCiD logo [3];  [4];  [5];  [3];  [1];  [1];  [1];  [2];  [1];  [1];  [1]
  1. Oak Ridge National Laboratory (ORNL), Oak Ridge, TN, USA
  2. Lawrence Livermore National Laboratory (LLNL), Livermore, CA, USA
  3. Los Alamos National Laboratory (LANL), Los Alamos, NM, USA
  4. The Barnes Global Advisors, Stuart, FL, USA
  5. National Institute of Standards and Technology (NIST), Gaithersburg, MD, USA
Publication Date:
Research Org.:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States); Los Alamos National Laboratory (LANL), Los Alamos, NM (United States); Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
Sponsoring Org.:
USDOE Office of Science (SC); USDOE National Nuclear Security Administration (NNSA)
OSTI Identifier:
1839327
Alternate Identifier(s):
OSTI ID: 1883992; OSTI ID: 2290298
Report Number(s):
LA-UR-21-27894
Journal ID: ISSN 1094-3420
Grant/Contract Number:  
AC05-00OR22725; 89233218CNA000001; AC52-07NA27344
Resource Type:
Published Article
Journal Name:
International Journal of High Performance Computing Applications
Additional Journal Information:
Journal Name: International Journal of High Performance Computing Applications Journal Volume: 36 Journal Issue: 1; Journal ID: ISSN 1094-3420
Publisher:
SAGE Publications
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; 3D printing; coupled physics; metal additive manufacturing; microstructure; multiscale materials

Citation Formats

Turner, John A., Belak, James, Barton, Nathan, Bement, Matthew, Carlson, Neil, Carson, Robert, DeWitt, Stephen, Fattebert, Jean-Luc, Hodge, Neil, Jibben, Zechariah, King, Wayne, Levine, Lyle, Newman, Christopher, Plotkowski, Alex, Radhakrishnan, Balasubramaniam, Reeve, Samuel Temple, Rolchigo, Matthew, Sabau, Adrian, Slattery, Stuart, and Stump, Benjamin. ExaAM: Metal additive manufacturing simulation at the fidelity of the microstructure. United States: N. p., 2022. Web. doi:10.1177/10943420211042558.
Turner, John A., Belak, James, Barton, Nathan, Bement, Matthew, Carlson, Neil, Carson, Robert, DeWitt, Stephen, Fattebert, Jean-Luc, Hodge, Neil, Jibben, Zechariah, King, Wayne, Levine, Lyle, Newman, Christopher, Plotkowski, Alex, Radhakrishnan, Balasubramaniam, Reeve, Samuel Temple, Rolchigo, Matthew, Sabau, Adrian, Slattery, Stuart, & Stump, Benjamin. ExaAM: Metal additive manufacturing simulation at the fidelity of the microstructure. United States. https://doi.org/10.1177/10943420211042558
Turner, John A., Belak, James, Barton, Nathan, Bement, Matthew, Carlson, Neil, Carson, Robert, DeWitt, Stephen, Fattebert, Jean-Luc, Hodge, Neil, Jibben, Zechariah, King, Wayne, Levine, Lyle, Newman, Christopher, Plotkowski, Alex, Radhakrishnan, Balasubramaniam, Reeve, Samuel Temple, Rolchigo, Matthew, Sabau, Adrian, Slattery, Stuart, and Stump, Benjamin. Mon . "ExaAM: Metal additive manufacturing simulation at the fidelity of the microstructure". United States. https://doi.org/10.1177/10943420211042558.
@article{osti_1839327,
title = {ExaAM: Metal additive manufacturing simulation at the fidelity of the microstructure},
author = {Turner, John A. and Belak, James and Barton, Nathan and Bement, Matthew and Carlson, Neil and Carson, Robert and DeWitt, Stephen and Fattebert, Jean-Luc and Hodge, Neil and Jibben, Zechariah and King, Wayne and Levine, Lyle and Newman, Christopher and Plotkowski, Alex and Radhakrishnan, Balasubramaniam and Reeve, Samuel Temple and Rolchigo, Matthew and Sabau, Adrian and Slattery, Stuart and Stump, Benjamin},
abstractNote = {Additive manufacturing (AM), or 3D printing, of metals is transforming the fabrication of components, in part by dramatically expanding the design space, allowing optimization of shape and topology. However, although the physical processes involved in AM are similar to those of welding, a field with decades of experimental, modeling, simulation, and characterization experience, qualification of AM parts remains a challenge. The availability of exascale computational systems, particularly when combined with data-driven approaches such as machine learning, enables topology and shape optimization as well as accelerated qualification by providing process-aware, locally accurate microstructure and mechanical property models. Here we describe the physics components comprising the Exascale Additive Manufacturing simulation environment and report progress using highly resolved melt pool simulations to inform part-scale finite element thermomechanics simulations, drive microstructure evolution, and determine constitutive mechanical property relationships based on those microstructures using polycrystal plasticity. We report on implementation of these components for exascale computing architectures, as well as the multi-stage simulation workflow that provides a unique high-fidelity model of process–structure–property relationships for AM parts. In addition, we discuss verification and validation through collaboration with efforts such as AM-Bench, a set of benchmark test problems under development by a team led by the National Institute of Standards and Technology.},
doi = {10.1177/10943420211042558},
journal = {International Journal of High Performance Computing Applications},
number = 1,
volume = 36,
place = {United States},
year = {Mon Jan 10 00:00:00 EST 2022},
month = {Mon Jan 10 00:00:00 EST 2022}
}

Works referenced in this record:

A particle method for history-dependent materials
journal, September 1994

  • Sulsky, D.; Chen, Z.; Schreyer, H. L.
  • Computer Methods in Applied Mechanics and Engineering, Vol. 118, Issue 1-2
  • DOI: 10.1016/0045-7825(94)90112-0

Linear transfomation-based anisotropic yield functions
journal, May 2005


Kokkos: Enabling manycore performance portability through polymorphic memory access patterns
journal, December 2014

  • Carter Edwards, H.; Trott, Christian R.; Sunderland, Daniel
  • Journal of Parallel and Distributed Computing, Vol. 74, Issue 12
  • DOI: 10.1016/j.jpdc.2014.07.003

MFEM: A modular finite element methods library
journal, January 2021


P3DFFT: A Framework for Parallel Computations of Fourier Transforms in Three Dimensions
journal, January 2012

  • Pekurovsky, Dmitry
  • SIAM Journal on Scientific Computing, Vol. 34, Issue 4
  • DOI: 10.1137/11082748X

Simulation of grain structure evolution during powder bed based additive manufacturing
journal, January 2017


A 3D Cellular Automaton algorithm for the prediction of dendritic grain growth
journal, May 1997


Phase-Field Formulation for Quantitative Modeling of Alloy Solidification
journal, August 2001


Phase-Field Simulation of Solidification
journal, August 2002


LPBF Right the First Time—the Right Mix Between Modeling and Experiments
journal, April 2019

  • Megahed, Mustafa; Mindt, Hans-Wilfried; Willems, Jöerg
  • Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 2
  • DOI: 10.1007/s40192-019-00133-8

The Design and Implementation of hypre, a Library of Parallel High Performance Preconditioners
book, January 2006

  • Falgout, Robert D.; Jones, Jim E.; Yang, Ulrike Meier
  • Lecture Notes in Computational Science and Engineering
  • DOI: 10.1007/3-540-31619-1_8

Phase-field simulation of weld solidification microstructure in an Al–Cu alloy
journal, August 2008

  • Farzadi, A.; Do-Quang, M.; Serajzadeh, S.
  • Modelling and Simulation in Materials Science and Engineering, Vol. 16, Issue 6
  • DOI: 10.1088/0965-0393/16/6/065005

A virtual laboratory using high resolution crystal plasticity simulations to determine the initial yield surface for sheet metal forming operations
journal, May 2016


Experimental comparison of residual stresses for a thermomechanical model for the simulation of selective laser melting
journal, October 2016


Residual Strain Predictions for a Powder Bed Fusion Inconel 625 Single Cantilever Part
journal, July 2019

  • Yang, Yangzhan; Allen, Madie; London, Tyler
  • Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 3
  • DOI: 10.1007/s40192-019-00144-5

Phase Fraction and Evolution of Additively Manufactured (AM) 15-5 Stainless Steel and Inconel 625 AM-Bench Artifacts
journal, August 2019

  • Zhang, Fan; Levine, Lyle E.; Allen, Andrew J.
  • Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 3
  • DOI: 10.1007/s40192-019-00148-1

Theory of microstructural development during rapid solidification
journal, May 1986


Additive manufacturing of metallic components – Process, structure and properties
journal, March 2018


Evolution of grain structure during laser additive manufacturing. Simulation by a cellular automata method
journal, September 2016


Phase-field modeling of coring during solidification of Au–Ni alloy using quaternions and CALPHAD input
journal, January 2014


Mesoscopic simulation model of selective laser melting of stainless steel powder
journal, November 2014


Ultrafast X-ray imaging of laser–metal additive manufacturing processes
journal, August 2018

  • Parab, Niranjan D.; Zhao, Cang; Cunningham, Ross
  • Journal of Synchrotron Radiation, Vol. 25, Issue 5
  • DOI: 10.1107/S1600577518009554

Three-dimensional modeling of the microstructure evolution during metal additive manufacturing
journal, January 2018


In Situ Measurements of Melt-Pool Length and Cooling Rate During 3D Builds of the Metal AM-Bench Artifacts
journal, February 2020

  • Heigel, Jarred C.; Lane, Brandon M.; Levine, Lyle E.
  • Integrating Materials and Manufacturing Innovation, Vol. 9, Issue 1
  • DOI: 10.1007/s40192-020-00170-8

Location-Specific Microstructure Characterization Within IN625 Additive Manufacturing Benchmark Test Artifacts
journal, March 2020

  • Stoudt, M. R.; Williams, M. E.; Levine, L. E.
  • Integrating Materials and Manufacturing Innovation, Vol. 9, Issue 1
  • DOI: 10.1007/s40192-020-00172-6

Embedded polycrystal plasticity and adaptive sampling
journal, February 2008

  • Barton, Nathan R.; Knap, Jaroslaw; Arsenlis, Athanasios
  • International Journal of Plasticity, Vol. 24, Issue 2
  • DOI: 10.1016/j.ijplas.2007.03.004

Understanding grain evolution in additive manufacturing through modeling
journal, May 2018


Phase Field Simulations of Autocatalytic Formation of Alpha Lamellar Colonies in Ti-6Al-4V
journal, September 2016

  • Radhakrishnan, Bala; Gorti, Sarma; Babu, Suresh Sudharsanam
  • Metallurgical and Materials Transactions A, Vol. 47, Issue 12
  • DOI: 10.1007/s11661-016-3746-6

A method of computing numerically integrated stiffness matrices
journal, September 1972

  • Gupta, Ajaya K.; Mohraz, Bijan
  • International Journal for Numerical Methods in Engineering, Vol. 5, Issue 1
  • DOI: 10.1002/nme.1620050108

Implementation of a thermomechanical model for the simulation of selective laser melting
journal, April 2014


Applications of semi-implicit Fourier-spectral method to phase field equations
journal, February 1998


Meshfree Simulations for Additive Manufacturing Process of Metals
journal, April 2019


Topographic Measurement of Individual Laser Tracks in Alloy 625 Bare Plates
journal, October 2019

  • Ricker, Richard E.; Heigel, Jarred C.; Lane, Brandon M.
  • Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 4
  • DOI: 10.1007/s40192-019-00157-0

Adaptive sampling in hierarchical simulation
journal, October 2008

  • Knap, J.; Barton, N. R.; Hornung, R. D.
  • International Journal for Numerical Methods in Engineering, Vol. 76, Issue 4
  • DOI: 10.1002/nme.2339

Transient Laser Energy Absorption, Co-axial Melt Pool Monitoring, and Relationship to Melt Pool Morphology
journal, December 2020


SUNDIALS: Suite of nonlinear and differential/algebraic equation solvers
journal, September 2005

  • Hindmarsh, Alan C.; Brown, Peter N.; Grant, Keith E.
  • ACM Transactions on Mathematical Software, Vol. 31, Issue 3
  • DOI: 10.1145/1089014.1089020

Efficient numerical integration of element stiffness matrices
journal, September 1983

  • Gupta, Ajaya K.
  • International Journal for Numerical Methods in Engineering, Vol. 19, Issue 9
  • DOI: 10.1002/nme.1620190910

Measurements of Melt Pool Geometry and Cooling Rates of Individual Laser Traces on IN625 Bare Plates
journal, February 2020

  • Lane, Brandon; Heigel, Jarred; Ricker, Richard
  • Integrating Materials and Manufacturing Innovation, Vol. 9, Issue 1
  • DOI: 10.1007/s40192-020-00169-1

Estimation of Errors in Stress Distributions Computed in Finite Element Simulations of Polycrystals
journal, November 2019

  • Chatterjee, Kamalika; Carson, Robert A.; Dawson, Paul R.
  • Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 4
  • DOI: 10.1007/s40192-019-00158-z

Multi phase field model for solid state transformation with elastic strain
journal, May 2006


Outcomes and Conclusions from the 2018 AM-Bench Measurements, Challenge Problems, Modeling Submissions, and Conference
journal, February 2020

  • Levine, Lyle; Lane, Brandon; Heigel, Jarred
  • Integrating Materials and Manufacturing Innovation, Vol. 9, Issue 1
  • DOI: 10.1007/s40192-019-00164-1

Calphad-type assessment of the Fe–Nb–Ni ternary system
journal, March 2009


3D multi-layer grain structure simulation of powder bed fusion additive manufacturing
journal, June 2018


Evaluation of a thermomechanical model for prediction of residual stress during laser powder bed fusion of Ti-6Al-4V
journal, May 2019


Predicting Precipitation Kinetics During the Annealing of Additive Manufactured Inconel 625 Components
journal, April 2019

  • Anderson, Magnus J.; Benson, Jonathan; Brooks, Jeffery W.
  • Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 2
  • DOI: 10.1007/s40192-019-00134-7

Towards improved speed and accuracy of laser powder bed fusion simulations via multiscale spatial representations
journal, February 2021


Integrated Computational Materials Engineering to Predict Melt-Pool Dimensions and 3D Grain Structures for Selective Laser Melting of Inconel 625
journal, July 2019

  • Robichaud, Jonathan; Vincent, Tim; Schultheis, Ben
  • Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 3
  • DOI: 10.1007/s40192-019-00145-4

The Facet method: A hierarchical multilevel modelling scheme for anisotropic convex plastic potentials
journal, February 2009

  • Van Houtte, Paul; Yerra, Sampath Kumar; Van Bael, Albert
  • International Journal of Plasticity, Vol. 25, Issue 2
  • DOI: 10.1016/j.ijplas.2008.02.001

Multiscale modeling of plasticity based on embedding the viscoplastic self-consistent formulation in implicit finite elements
journal, January 2012

  • Segurado, Javier; Lebensohn, Ricardo A.; LLorca, Javier
  • International Journal of Plasticity, Vol. 28, Issue 1
  • DOI: 10.1016/j.ijplas.2011.07.002

A massively parallel and scalable multi-GPU material point method
journal, July 2020

  • Wang, Xinlei; Qiu, Yuxing; Slattery, Stuart R.
  • ACM Transactions on Graphics, Vol. 39, Issue 4
  • DOI: 10.1145/3386569.3392442

AMReX: a framework for block-structured adaptive mesh refinement
journal, May 2019

  • Zhang, Weiqun; Almgren, Ann; Beckner, Vince
  • Journal of Open Source Software, Vol. 4, Issue 37
  • DOI: 10.21105/joss.01370

Laser powder-bed fusion additive manufacturing: Physics of complex melt flow and formation mechanisms of pores, spatter, and denudation zones
journal, April 2016


In Situ Thermography of the Metal Bridge Structures Fabricated for the 2018 Additive Manufacturing Benchmark Test Series (AM-Bench 2018)
journal, January 2020

  • Heigel, Jarred C.; Lane, Brandon; Levine, Lyle
  • Journal of Research of the National Institute of Standards and Technology, Vol. 125
  • DOI: 10.6028/jres.125.005

Exascale applications: skin in the game
journal, January 2020

  • Alexander, Francis; Almgren, Ann; Bell, John
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 378, Issue 2166
  • DOI: 10.1098/rsta.2019.0056

ADIOS 2: The Adaptable Input Output System. A framework for high-performance data management
journal, July 2020


Design Rules for Additive Manufacturing – Understanding the Fundamental Thermal Phenomena to Reduce Scrap
journal, January 2019


Benchmark Study of Thermal Behavior, Surface Topography, and Dendritic Microstructure in Selective Laser Melting of Inconel 625
journal, April 2019

  • Gan, Zhengtao; Lian, Yanping; Lin, Stephen E.
  • Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 2
  • DOI: 10.1007/s40192-019-00130-x

An evolving plane stress yield criterion based on crystal plasticity virtual experiments
journal, December 2015


A multilevel finite element method (FE2) to describe the response of highly non-linear structures using generalized continua
journal, July 2003


A numerical algorithm for the solution of a phase-field model of polycrystalline materials
journal, February 2010

  • Dorr, M. R.; Fattebert, J. -L.; Wickett, M. E.
  • Journal of Computational Physics, Vol. 229, Issue 3
  • DOI: 10.1016/j.jcp.2009.09.041

The Design and Implementation of FFTW3
journal, February 2005


Phase-field model for binary alloys
journal, December 1999


An introduction to phase-field modeling of microstructure evolution
journal, June 2008


Sparse thermal data for cellular automata modeling of grain structure in additive manufacturing
journal, June 2020

  • Rolchigo, Matthew; Stump, Benjamin; Belak, James
  • Modelling and Simulation in Materials Science and Engineering, Vol. 28, Issue 6
  • DOI: 10.1088/1361-651X/ab9734