ExaAM: Metal additive manufacturing simulation at the fidelity of the microstructure
Abstract
Additive manufacturing (AM), or 3D printing, of metals is transforming the fabrication of components, in part by dramatically expanding the design space, allowing optimization of shape and topology. However, although the physical processes involved in AM are similar to those of welding, a field with decades of experimental, modeling, simulation, and characterization experience, qualification of AM parts remains a challenge. The availability of exascale computational systems, particularly when combined with data-driven approaches such as machine learning, enables topology and shape optimization as well as accelerated qualification by providing process-aware, locally accurate microstructure and mechanical property models. Here we describe the physics components comprising the Exascale Additive Manufacturing simulation environment and report progress using highly resolved melt pool simulations to inform part-scale finite element thermomechanics simulations, drive microstructure evolution, and determine constitutive mechanical property relationships based on those microstructures using polycrystal plasticity. We report on implementation of these components for exascale computing architectures, as well as the multi-stage simulation workflow that provides a unique high-fidelity model of process–structure–property relationships for AM parts. In addition, we discuss verification and validation through collaboration with efforts such as AM-Bench, a set of benchmark test problems under development by a team led by the Nationalmore »
- Authors:
-
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN, USA
- Lawrence Livermore National Laboratory (LLNL), Livermore, CA, USA
- Los Alamos National Laboratory (LANL), Los Alamos, NM, USA
- The Barnes Global Advisors, Stuart, FL, USA
- National Institute of Standards and Technology (NIST), Gaithersburg, MD, USA
- Publication Date:
- Research Org.:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States); Los Alamos National Laboratory (LANL), Los Alamos, NM (United States); Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC); USDOE National Nuclear Security Administration (NNSA)
- OSTI Identifier:
- 1839327
- Alternate Identifier(s):
- OSTI ID: 1883992; OSTI ID: 2290298
- Report Number(s):
- LA-UR-21-27894
Journal ID: ISSN 1094-3420
- Grant/Contract Number:
- AC05-00OR22725; 89233218CNA000001; AC52-07NA27344
- Resource Type:
- Published Article
- Journal Name:
- International Journal of High Performance Computing Applications
- Additional Journal Information:
- Journal Name: International Journal of High Performance Computing Applications Journal Volume: 36 Journal Issue: 1; Journal ID: ISSN 1094-3420
- Publisher:
- SAGE Publications
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING; 3D printing; coupled physics; metal additive manufacturing; microstructure; multiscale materials
Citation Formats
Turner, John A., Belak, James, Barton, Nathan, Bement, Matthew, Carlson, Neil, Carson, Robert, DeWitt, Stephen, Fattebert, Jean-Luc, Hodge, Neil, Jibben, Zechariah, King, Wayne, Levine, Lyle, Newman, Christopher, Plotkowski, Alex, Radhakrishnan, Balasubramaniam, Reeve, Samuel Temple, Rolchigo, Matthew, Sabau, Adrian, Slattery, Stuart, and Stump, Benjamin. ExaAM: Metal additive manufacturing simulation at the fidelity of the microstructure. United States: N. p., 2022.
Web. doi:10.1177/10943420211042558.
Turner, John A., Belak, James, Barton, Nathan, Bement, Matthew, Carlson, Neil, Carson, Robert, DeWitt, Stephen, Fattebert, Jean-Luc, Hodge, Neil, Jibben, Zechariah, King, Wayne, Levine, Lyle, Newman, Christopher, Plotkowski, Alex, Radhakrishnan, Balasubramaniam, Reeve, Samuel Temple, Rolchigo, Matthew, Sabau, Adrian, Slattery, Stuart, & Stump, Benjamin. ExaAM: Metal additive manufacturing simulation at the fidelity of the microstructure. United States. https://doi.org/10.1177/10943420211042558
Turner, John A., Belak, James, Barton, Nathan, Bement, Matthew, Carlson, Neil, Carson, Robert, DeWitt, Stephen, Fattebert, Jean-Luc, Hodge, Neil, Jibben, Zechariah, King, Wayne, Levine, Lyle, Newman, Christopher, Plotkowski, Alex, Radhakrishnan, Balasubramaniam, Reeve, Samuel Temple, Rolchigo, Matthew, Sabau, Adrian, Slattery, Stuart, and Stump, Benjamin. Mon .
"ExaAM: Metal additive manufacturing simulation at the fidelity of the microstructure". United States. https://doi.org/10.1177/10943420211042558.
@article{osti_1839327,
title = {ExaAM: Metal additive manufacturing simulation at the fidelity of the microstructure},
author = {Turner, John A. and Belak, James and Barton, Nathan and Bement, Matthew and Carlson, Neil and Carson, Robert and DeWitt, Stephen and Fattebert, Jean-Luc and Hodge, Neil and Jibben, Zechariah and King, Wayne and Levine, Lyle and Newman, Christopher and Plotkowski, Alex and Radhakrishnan, Balasubramaniam and Reeve, Samuel Temple and Rolchigo, Matthew and Sabau, Adrian and Slattery, Stuart and Stump, Benjamin},
abstractNote = {Additive manufacturing (AM), or 3D printing, of metals is transforming the fabrication of components, in part by dramatically expanding the design space, allowing optimization of shape and topology. However, although the physical processes involved in AM are similar to those of welding, a field with decades of experimental, modeling, simulation, and characterization experience, qualification of AM parts remains a challenge. The availability of exascale computational systems, particularly when combined with data-driven approaches such as machine learning, enables topology and shape optimization as well as accelerated qualification by providing process-aware, locally accurate microstructure and mechanical property models. Here we describe the physics components comprising the Exascale Additive Manufacturing simulation environment and report progress using highly resolved melt pool simulations to inform part-scale finite element thermomechanics simulations, drive microstructure evolution, and determine constitutive mechanical property relationships based on those microstructures using polycrystal plasticity. We report on implementation of these components for exascale computing architectures, as well as the multi-stage simulation workflow that provides a unique high-fidelity model of process–structure–property relationships for AM parts. In addition, we discuss verification and validation through collaboration with efforts such as AM-Bench, a set of benchmark test problems under development by a team led by the National Institute of Standards and Technology.},
doi = {10.1177/10943420211042558},
journal = {International Journal of High Performance Computing Applications},
number = 1,
volume = 36,
place = {United States},
year = {Mon Jan 10 00:00:00 EST 2022},
month = {Mon Jan 10 00:00:00 EST 2022}
}
https://doi.org/10.1177/10943420211042558
Works referenced in this record:
A particle method for history-dependent materials
journal, September 1994
- Sulsky, D.; Chen, Z.; Schreyer, H. L.
- Computer Methods in Applied Mechanics and Engineering, Vol. 118, Issue 1-2
Linear transfomation-based anisotropic yield functions
journal, May 2005
- Barlat, F.; Aretz, H.; Yoon, J. W.
- International Journal of Plasticity, Vol. 21, Issue 5
Kokkos: Enabling manycore performance portability through polymorphic memory access patterns
journal, December 2014
- Carter Edwards, H.; Trott, Christian R.; Sunderland, Daniel
- Journal of Parallel and Distributed Computing, Vol. 74, Issue 12
Linking process, structure, property, and performance for metal-based additive manufacturing: computational approaches with experimental support
journal, January 2016
- Smith, Jacob; Xiong, Wei; Yan, Wentao
- Computational Mechanics, Vol. 57, Issue 4
MFEM: A modular finite element methods library
journal, January 2021
- Anderson, Robert; Andrej, Julian; Barker, Andrew
- Computers & Mathematics with Applications, Vol. 81
P3DFFT: A Framework for Parallel Computations of Fourier Transforms in Three Dimensions
journal, January 2012
- Pekurovsky, Dmitry
- SIAM Journal on Scientific Computing, Vol. 34, Issue 4
Simulation of grain structure evolution during powder bed based additive manufacturing
journal, January 2017
- Rai, Abha; Helmer, Harald; Körner, Carolin
- Additive Manufacturing, Vol. 13
A 3D Cellular Automaton algorithm for the prediction of dendritic grain growth
journal, May 1997
- Gandin, Ch. -A; Rappaz, M.
- Acta Materialia, Vol. 45, Issue 5
Phase-Field Formulation for Quantitative Modeling of Alloy Solidification
journal, August 2001
- Karma, Alain
- Physical Review Letters, Vol. 87, Issue 11
Phase-Field Simulation of Solidification
journal, August 2002
- Boettinger, W. J.; Warren, J. A.; Beckermann, C.
- Annual Review of Materials Research, Vol. 32, Issue 1
LPBF Right the First Time—the Right Mix Between Modeling and Experiments
journal, April 2019
- Megahed, Mustafa; Mindt, Hans-Wilfried; Willems, Jöerg
- Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 2
The Design and Implementation of hypre, a Library of Parallel High Performance Preconditioners
book, January 2006
- Falgout, Robert D.; Jones, Jim E.; Yang, Ulrike Meier
- Lecture Notes in Computational Science and Engineering
Phase-field simulation of weld solidification microstructure in an Al–Cu alloy
journal, August 2008
- Farzadi, A.; Do-Quang, M.; Serajzadeh, S.
- Modelling and Simulation in Materials Science and Engineering, Vol. 16, Issue 6
A virtual laboratory using high resolution crystal plasticity simulations to determine the initial yield surface for sheet metal forming operations
journal, May 2016
- Zhang, Haiming; Diehl, Martin; Roters, Franz
- International Journal of Plasticity, Vol. 80
Experimental comparison of residual stresses for a thermomechanical model for the simulation of selective laser melting
journal, October 2016
- Hodge, N. E.; Ferencz, R. M.; Vignes, R. M.
- Additive Manufacturing, Vol. 12
Residual Strain Predictions for a Powder Bed Fusion Inconel 625 Single Cantilever Part
journal, July 2019
- Yang, Yangzhan; Allen, Madie; London, Tyler
- Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 3
Phase Fraction and Evolution of Additively Manufactured (AM) 15-5 Stainless Steel and Inconel 625 AM-Bench Artifacts
journal, August 2019
- Zhang, Fan; Levine, Lyle E.; Allen, Andrew J.
- Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 3
Theory of microstructural development during rapid solidification
journal, May 1986
- Kurz, W.; Giovanola, B.; Trivedi, R.
- Acta Metallurgica, Vol. 34, Issue 5
Additive manufacturing of metallic components – Process, structure and properties
journal, March 2018
- DebRoy, T.; Wei, H. L.; Zuback, J. S.
- Progress in Materials Science, Vol. 92
Evolution of grain structure during laser additive manufacturing. Simulation by a cellular automata method
journal, September 2016
- Zinoviev, A.; Zinovieva, O.; Ploshikhin, V.
- Materials & Design, Vol. 106
Phase-field modeling of coring during solidification of Au–Ni alloy using quaternions and CALPHAD input
journal, January 2014
- Fattebert, J. -L.; Wickett, M. E.; Turchi, P. E. A.
- Acta Materialia, Vol. 62
Mesoscopic simulation model of selective laser melting of stainless steel powder
journal, November 2014
- Khairallah, Saad A.; Anderson, Andy
- Journal of Materials Processing Technology, Vol. 214, Issue 11
Ultrafast X-ray imaging of laser–metal additive manufacturing processes
journal, August 2018
- Parab, Niranjan D.; Zhao, Cang; Cunningham, Ross
- Journal of Synchrotron Radiation, Vol. 25, Issue 5
Three-dimensional modeling of the microstructure evolution during metal additive manufacturing
journal, January 2018
- Zinovieva, O.; Zinoviev, A.; Ploshikhin, V.
- Computational Materials Science, Vol. 141
In Situ Measurements of Melt-Pool Length and Cooling Rate During 3D Builds of the Metal AM-Bench Artifacts
journal, February 2020
- Heigel, Jarred C.; Lane, Brandon M.; Levine, Lyle E.
- Integrating Materials and Manufacturing Innovation, Vol. 9, Issue 1
Location-Specific Microstructure Characterization Within IN625 Additive Manufacturing Benchmark Test Artifacts
journal, March 2020
- Stoudt, M. R.; Williams, M. E.; Levine, L. E.
- Integrating Materials and Manufacturing Innovation, Vol. 9, Issue 1
Embedded polycrystal plasticity and adaptive sampling
journal, February 2008
- Barton, Nathan R.; Knap, Jaroslaw; Arsenlis, Athanasios
- International Journal of Plasticity, Vol. 24, Issue 2
Understanding grain evolution in additive manufacturing through modeling
journal, May 2018
- Akram, Javed; Chalavadi, Pradeep; Pal, Deepankar
- Additive Manufacturing, Vol. 21
Phase Field Simulations of Autocatalytic Formation of Alpha Lamellar Colonies in Ti-6Al-4V
journal, September 2016
- Radhakrishnan, Bala; Gorti, Sarma; Babu, Suresh Sudharsanam
- Metallurgical and Materials Transactions A, Vol. 47, Issue 12
A method of computing numerically integrated stiffness matrices
journal, September 1972
- Gupta, Ajaya K.; Mohraz, Bijan
- International Journal for Numerical Methods in Engineering, Vol. 5, Issue 1
Implementation of a thermomechanical model for the simulation of selective laser melting
journal, April 2014
- Hodge, N. E.; Ferencz, R. M.; Solberg, J. M.
- Computational Mechanics, Vol. 54, Issue 1
Applications of semi-implicit Fourier-spectral method to phase field equations
journal, February 1998
- Chen, L. Q.; Shen, Jie
- Computer Physics Communications, Vol. 108, Issue 2-3
Meshfree Simulations for Additive Manufacturing Process of Metals
journal, April 2019
- Fan, Zongyue; Li, Bo
- Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 2
Topographic Measurement of Individual Laser Tracks in Alloy 625 Bare Plates
journal, October 2019
- Ricker, Richard E.; Heigel, Jarred C.; Lane, Brandon M.
- Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 4
Adaptive sampling in hierarchical simulation
journal, October 2008
- Knap, J.; Barton, N. R.; Hornung, R. D.
- International Journal for Numerical Methods in Engineering, Vol. 76, Issue 4
Transient Laser Energy Absorption, Co-axial Melt Pool Monitoring, and Relationship to Melt Pool Morphology
journal, December 2020
- Lane, Brandon; Zhirnov, Ivan; Mekhontsev, Sergey
- Additive Manufacturing, Vol. 36
SUNDIALS: Suite of nonlinear and differential/algebraic equation solvers
journal, September 2005
- Hindmarsh, Alan C.; Brown, Peter N.; Grant, Keith E.
- ACM Transactions on Mathematical Software, Vol. 31, Issue 3
Efficient numerical integration of element stiffness matrices
journal, September 1983
- Gupta, Ajaya K.
- International Journal for Numerical Methods in Engineering, Vol. 19, Issue 9
Measurements of Melt Pool Geometry and Cooling Rates of Individual Laser Traces on IN625 Bare Plates
journal, February 2020
- Lane, Brandon; Heigel, Jarred; Ricker, Richard
- Integrating Materials and Manufacturing Innovation, Vol. 9, Issue 1
Estimation of Errors in Stress Distributions Computed in Finite Element Simulations of Polycrystals
journal, November 2019
- Chatterjee, Kamalika; Carson, Robert A.; Dawson, Paul R.
- Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 4
Multi phase field model for solid state transformation with elastic strain
journal, May 2006
- Steinbach, I.; Apel, M.
- Physica D: Nonlinear Phenomena, Vol. 217, Issue 2
Outcomes and Conclusions from the 2018 AM-Bench Measurements, Challenge Problems, Modeling Submissions, and Conference
journal, February 2020
- Levine, Lyle; Lane, Brandon; Heigel, Jarred
- Integrating Materials and Manufacturing Innovation, Vol. 9, Issue 1
Calphad-type assessment of the Fe–Nb–Ni ternary system
journal, March 2009
- Mathon, Muriel; Connétable, Damien; Sundman, Bo
- Calphad, Vol. 33, Issue 1
3D multi-layer grain structure simulation of powder bed fusion additive manufacturing
journal, June 2018
- Koepf, Johannes A.; Gotterbarm, Martin R.; Markl, Matthias
- Acta Materialia, Vol. 152
Evaluation of a thermomechanical model for prediction of residual stress during laser powder bed fusion of Ti-6Al-4V
journal, May 2019
- Ganeriwala, R. K.; Strantza, M.; King, W. E.
- Additive Manufacturing, Vol. 27
Predicting Precipitation Kinetics During the Annealing of Additive Manufactured Inconel 625 Components
journal, April 2019
- Anderson, Magnus J.; Benson, Jonathan; Brooks, Jeffery W.
- Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 2
Accurate Prediction of Melt Pool Shapes in Laser Powder Bed Fusion by the Non-Linear Temperature Equation Including Phase Changes: Model validity: isotropic versus anisotropic conductivity to capture AM Benchmark Test AMB2018-02
journal, April 2019
- Kollmannsberger, Stefan; Carraturo, Massimo; Reali, Alessandro
- Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 2
Towards improved speed and accuracy of laser powder bed fusion simulations via multiscale spatial representations
journal, February 2021
- Ganeriwala, Rishi K.; Hodge, Neil E.; Solberg, Jerome M.
- Computational Materials Science, Vol. 187
Elastic Residual Strain and Stress Measurements and Corresponding Part Deflections of 3D Additive Manufacturing Builds of IN625 AM-Bench Artifacts Using Neutron Diffraction, Synchrotron X-Ray Diffraction, and Contour Method
journal, July 2019
- Phan, Thien Q.; Strantza, Maria; Hill, Michael R.
- Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 3
Integrated Computational Materials Engineering to Predict Melt-Pool Dimensions and 3D Grain Structures for Selective Laser Melting of Inconel 625
journal, July 2019
- Robichaud, Jonathan; Vincent, Tim; Schultheis, Ben
- Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 3
The Facet method: A hierarchical multilevel modelling scheme for anisotropic convex plastic potentials
journal, February 2009
- Van Houtte, Paul; Yerra, Sampath Kumar; Van Bael, Albert
- International Journal of Plasticity, Vol. 25, Issue 2
Multiscale modeling of plasticity based on embedding the viscoplastic self-consistent formulation in implicit finite elements
journal, January 2012
- Segurado, Javier; Lebensohn, Ricardo A.; LLorca, Javier
- International Journal of Plasticity, Vol. 28, Issue 1
A massively parallel and scalable multi-GPU material point method
journal, July 2020
- Wang, Xinlei; Qiu, Yuxing; Slattery, Stuart R.
- ACM Transactions on Graphics, Vol. 39, Issue 4
AMReX: a framework for block-structured adaptive mesh refinement
journal, May 2019
- Zhang, Weiqun; Almgren, Ann; Beckner, Vince
- Journal of Open Source Software, Vol. 4, Issue 37
Laser powder-bed fusion additive manufacturing: Physics of complex melt flow and formation mechanisms of pores, spatter, and denudation zones
journal, April 2016
- Khairallah, Saad A.; Anderson, Andrew T.; Rubenchik, Alexander
- Acta Materialia, Vol. 108
In Situ Thermography of the Metal Bridge Structures Fabricated for the 2018 Additive Manufacturing Benchmark Test Series (AM-Bench 2018)
journal, January 2020
- Heigel, Jarred C.; Lane, Brandon; Levine, Lyle
- Journal of Research of the National Institute of Standards and Technology, Vol. 125
Exascale applications: skin in the game
journal, January 2020
- Alexander, Francis; Almgren, Ann; Bell, John
- Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 378, Issue 2166
ADIOS 2: The Adaptable Input Output System. A framework for high-performance data management
journal, July 2020
- Godoy, William F.; Podhorszki, Norbert; Wang, Ruonan
- SoftwareX, Vol. 12
A phase-field model with antitrapping current for multicomponent alloys with arbitrary thermodynamic properties
journal, August 2007
- Kim, Seong Gyoon
- Acta Materialia, Vol. 55, Issue 13
Design Rules for Additive Manufacturing – Understanding the Fundamental Thermal Phenomena to Reduce Scrap
journal, January 2019
- Yavari, M. Reza; Cole, Kevin D.; Rao, Prahalada K.
- Procedia Manufacturing, Vol. 33
Benchmark Study of Thermal Behavior, Surface Topography, and Dendritic Microstructure in Selective Laser Melting of Inconel 625
journal, April 2019
- Gan, Zhengtao; Lian, Yanping; Lin, Stephen E.
- Integrating Materials and Manufacturing Innovation, Vol. 8, Issue 2
An evolving plane stress yield criterion based on crystal plasticity virtual experiments
journal, December 2015
- Gawad, Jerzy; Banabic, Dorel; Van Bael, Albert
- International Journal of Plasticity, Vol. 75
Anisotropy and heterogeneity of microstructure and mechanical properties in metal additive manufacturing: A critical review
journal, February 2018
- Kok, Y.; Tan, X. P.; Wang, P.
- Materials & Design, Vol. 139
A multilevel finite element method (FE2) to describe the response of highly non-linear structures using generalized continua
journal, July 2003
- Feyel, Frédéric
- Computer Methods in Applied Mechanics and Engineering, Vol. 192, Issue 28-30
A numerical algorithm for the solution of a phase-field model of polycrystalline materials
journal, February 2010
- Dorr, M. R.; Fattebert, J. -L.; Wickett, M. E.
- Journal of Computational Physics, Vol. 229, Issue 3
Computer simulation of phase transformation and plastic deformation in IN718 superalloy: Microstructural evolution during precipitation
journal, February 2014
- Zhou, N.; Lv, D. C.; Zhang, H. L.
- Acta Materialia, Vol. 65
The Design and Implementation of FFTW3
journal, February 2005
- Frigo, M.; Johnson, S. G.
- Proceedings of the IEEE, Vol. 93, Issue 2
Towards improved speed and accuracy of laser powder bed fusion simulations via representation of multiple time scales
journal, January 2021
- Hodge, N. E.
- Additive Manufacturing, Vol. 37
Phase-field model for binary alloys
journal, December 1999
- Kim, Seong Gyoon; Kim, Won Tae; Suzuki, Toshio
- Physical Review E, Vol. 60, Issue 6
An introduction to phase-field modeling of microstructure evolution
journal, June 2008
- Moelans, Nele; Blanpain, Bart; Wollants, Patrick
- Calphad, Vol. 32, Issue 2
Sparse thermal data for cellular automata modeling of grain structure in additive manufacturing
journal, June 2020
- Rolchigo, Matthew; Stump, Benjamin; Belak, James
- Modelling and Simulation in Materials Science and Engineering, Vol. 28, Issue 6