DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: SO(3)-invariance of informed-graph-based deep neural network for anisotropic elastoplastic materials

Abstract

This work examines the frame-invariance (and the lack thereof) exhibited in simulated anisotropic elasto-plastic responses generated from supervised machine learning of classical multi-layer and informed-graph-based neural networks, and proposes different remedies to fix this drawback. The inherent hierarchical relations among physical quantities and state variables in an elasto-plasticity model are first represented as informed, directed graphs, where three variations of the graph are tested. While feed-forward neural networks are used to train path-independent constitutive relations (e.g., elasticity), recurrent neural networks are used to replicate responses that depends on the deformation history, i.e. or path dependent. In dealing with the objectivity deficiency, we use the spectral form to represent tensors and, subsequently, three metrics, the Euclidean distance between the Euler Angles, the distance from the identity matrix, and geodesic on the unit sphere in Lie algebra, can be employed to constitute objective functions for the supervised machine learning. In this, the aim is to minimize the measured distance between the true and the predicted 3D rotation entities. Following this, we conduct numerical experiments on how these metrics, which are theoretically equivalent, may lead to differences in the efficiency of the supervised machine learning as well as the accuracy and robustness ofmore » the resultant models. Neural network models trained with tensors represented in component form for a given Cartesian coordinate system are used as a benchmark. Our numerical tests show that, even given the same amount of information and data, the quality of the anisotropic elasto-plasticity model is highly sensitive to the way tensors are represented and measured. The results reveal that using a loss function based on geodesic on the unit sphere in Lie algebra together with an informed, directed graph yield significantly more accurate rotation prediction than the other tested approaches.« less

Authors:
 [1];  [2]; ORCiD logo [2]
  1. Columbia Univ., New York, NY (United States); RWTH Aachen Univ. (Germany)
  2. Columbia Univ., New York, NY (United States)
Publication Date:
Research Org.:
Columbia Univ., New York, NY (United States)
Sponsoring Org.:
USDOE Office of Nuclear Energy (NE); National Science Foundation (NSF); US Air Force Office of Scientific Research (AFOSR)
OSTI Identifier:
1801241
Alternate Identifier(s):
OSTI ID: 1599468
Grant/Contract Number:  
NE0008534; CMMI-1846875; FA9550-17-1-0169; FA9550-19-1-0318
Resource Type:
Accepted Manuscript
Journal Name:
Computer Methods in Applied Mechanics and Engineering
Additional Journal Information:
Journal Volume: 363; Journal Issue: C; Journal ID: ISSN 0045-7825
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
42 ENGINEERING; engineering; mathematics; mechanics; recurrent neural networks; lie algebra; anisotropic materials; machine learning; crystal plasticity; special orthogonal group

Citation Formats

Heider, Yousef, Wang, Kun, and Sun, WaiChing. SO(3)-invariance of informed-graph-based deep neural network for anisotropic elastoplastic materials. United States: N. p., 2020. Web. doi:10.1016/j.cma.2020.112875.
Heider, Yousef, Wang, Kun, & Sun, WaiChing. SO(3)-invariance of informed-graph-based deep neural network for anisotropic elastoplastic materials. United States. https://doi.org/10.1016/j.cma.2020.112875
Heider, Yousef, Wang, Kun, and Sun, WaiChing. Thu . "SO(3)-invariance of informed-graph-based deep neural network for anisotropic elastoplastic materials". United States. https://doi.org/10.1016/j.cma.2020.112875. https://www.osti.gov/servlets/purl/1801241.
@article{osti_1801241,
title = {SO(3)-invariance of informed-graph-based deep neural network for anisotropic elastoplastic materials},
author = {Heider, Yousef and Wang, Kun and Sun, WaiChing},
abstractNote = {This work examines the frame-invariance (and the lack thereof) exhibited in simulated anisotropic elasto-plastic responses generated from supervised machine learning of classical multi-layer and informed-graph-based neural networks, and proposes different remedies to fix this drawback. The inherent hierarchical relations among physical quantities and state variables in an elasto-plasticity model are first represented as informed, directed graphs, where three variations of the graph are tested. While feed-forward neural networks are used to train path-independent constitutive relations (e.g., elasticity), recurrent neural networks are used to replicate responses that depends on the deformation history, i.e. or path dependent. In dealing with the objectivity deficiency, we use the spectral form to represent tensors and, subsequently, three metrics, the Euclidean distance between the Euler Angles, the distance from the identity matrix, and geodesic on the unit sphere in Lie algebra, can be employed to constitute objective functions for the supervised machine learning. In this, the aim is to minimize the measured distance between the true and the predicted 3D rotation entities. Following this, we conduct numerical experiments on how these metrics, which are theoretically equivalent, may lead to differences in the efficiency of the supervised machine learning as well as the accuracy and robustness of the resultant models. Neural network models trained with tensors represented in component form for a given Cartesian coordinate system are used as a benchmark. Our numerical tests show that, even given the same amount of information and data, the quality of the anisotropic elasto-plasticity model is highly sensitive to the way tensors are represented and measured. The results reveal that using a loss function based on geodesic on the unit sphere in Lie algebra together with an informed, directed graph yield significantly more accurate rotation prediction than the other tested approaches.},
doi = {10.1016/j.cma.2020.112875},
journal = {Computer Methods in Applied Mechanics and Engineering},
number = C,
volume = 363,
place = {United States},
year = {Thu Feb 13 00:00:00 EST 2020},
month = {Thu Feb 13 00:00:00 EST 2020}
}

Journal Article:

Citation Metrics:
Cited by: 41 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

A multiscale multi-permeability poroplasticity model linked by recursive homogenizations and deep learning
journal, June 2018


A plasticity theory for porous solids
journal, April 1972


Computational thermomechanics of crystalline rock, Part I: A combined multi-phase-field/crystal plasticity approach for single crystal simulations
journal, August 2018


Some implications of work hardening and ideal plasticity
journal, January 1950

  • Drucker, D. C.
  • Quarterly of Applied Mathematics, Vol. 7, Issue 4
  • DOI: 10.1090/qam/34210

A Simple Derivation of Representations for Non-Polynomial Constitutive Equations in Some Cases of Anisotropy
journal, January 1979

  • Boehler, Jean-Paul
  • ZAMM - Zeitschrift für Angewandte Mathematik und Mechanik, Vol. 59, Issue 4
  • DOI: 10.1002/zamm.19790590403

Metrics for 3D Rotations: Comparison and Analysis
journal, June 2009


Stress-induced anisotropy in granular materials: fabric, stiffness, and permeability
journal, June 2015


Meta-modeling game for deriving theory-consistent, microstructure-based traction–separation laws via deep reinforcement learning
journal, April 2019


Data Structures for Statistical Computing in Python
conference, January 2010


Crystal Plasticity
journal, December 1983

  • Asaro, R. J.
  • Journal of Applied Mechanics, Vol. 50, Issue 4b
  • DOI: 10.1115/1.3167205

An efficient Monte Carlo strategy for elasto-plastic structures based on recurrent neural networks
journal, July 2019


Discrete micromechanics of elastoplastic crystals in the finite deformation range
journal, June 2014

  • Borja, Ronaldo I.; Rahmani, Helia
  • Computer Methods in Applied Mechanics and Engineering, Vol. 275
  • DOI: 10.1016/j.cma.2014.03.002

Anisotropic Critical State Theory: Role of Fabric
journal, March 2012


Enhancing Model Predictability for a Scramjet Using Probabilistic Learning on Manifolds
journal, January 2019

  • Soize, Christian; Ghanem, Roger; Safta, Cosmin
  • AIAA Journal, Vol. 57, Issue 1
  • DOI: 10.2514/1.J057069

A deep material network for multiscale topology learning and accelerated nonlinear modeling of heterogeneous materials
journal, March 2019

  • Liu, Zeliang; Wu, C. T.; Koishi, M.
  • Computer Methods in Applied Mechanics and Engineering, Vol. 345
  • DOI: 10.1016/j.cma.2018.09.020

Modeling of soil behavior with a recurrent neural network
journal, October 1998

  • Zhu, Jian-Hua; Zaman, Musharraf M.; Anderson, Scott A.
  • Canadian Geotechnical Journal, Vol. 35, Issue 5
  • DOI: 10.1139/t98-042

Model-Free Data-Driven inelasticity
journal, June 2019

  • Eggersmann, R.; Kirchdoerfer, T.; Reese, S.
  • Computer Methods in Applied Mechanics and Engineering, Vol. 350
  • DOI: 10.1016/j.cma.2019.02.016

Reservoir computing approaches to recurrent neural network training
journal, August 2009


Artificial neural network as an incremental non-linear constitutive model for a finite element code
journal, July 2003


Adversarial uncertainty quantification in physics-informed neural networks
journal, October 2019


LSTM: A Search Space Odyssey
journal, October 2017

  • Greff, Klaus; Srivastava, Rupesh K.; Koutnik, Jan
  • IEEE Transactions on Neural Networks and Learning Systems, Vol. 28, Issue 10
  • DOI: 10.1109/TNNLS.2016.2582924

A unified method to predict diffuse and localized instabilities in sands
journal, June 2013


Smooth invariant interpolation of rotations
journal, July 1997


Computational thermo-hydro-mechanics for multiphase freezing and thawing porous media in the finite deformation range
journal, May 2017


LIBSVM: A library for support vector machines
journal, April 2011

  • Chang, Chih-Chung; Lin, Chih-Jen
  • ACM Transactions on Intelligent Systems and Technology, Vol. 2, Issue 3
  • DOI: 10.1145/1961189.1961199

A micromorphically regularized Cam-clay model for capturing size-dependent anisotropy of geomaterials
journal, September 2019

  • Bryant, Eric C.; Sun, WaiChing
  • Computer Methods in Applied Mechanics and Engineering, Vol. 354
  • DOI: 10.1016/j.cma.2019.05.003

An updated Lagrangian LBM–DEM–FEM coupling model for dual-permeability fissured porous media with embedded discontinuities
journal, February 2019


Aspects of computational rate-independent crystal plasticity
journal, December 1997


Exploring the 3D architectures of deep material network in data-driven multiscale mechanics
journal, June 2019


Neural network based constitutive modeling of nonlinear viscoplastic structural response
journal, January 2019


A Distance Metric for Finite Sets of Rigid-Body Displacements via the Polar Decomposition
journal, July 2006

  • Larochelle, Pierre M.; Murray, Andrew P.; Angeles, Jorge
  • Journal of Mechanical Design, Vol. 129, Issue 8
  • DOI: 10.1115/1.2735640

Lie-group interpolation and variational recovery for internal variables
journal, June 2013


A graph theoretic framework for representation, exploration and analysis on computed states of physical systems
journal, July 2019

  • Banerjee, R.; Sagiyama, K.; Teichert, G. H.
  • Computer Methods in Applied Mechanics and Engineering, Vol. 351
  • DOI: 10.1016/j.cma.2019.03.053

Long Short-Term Memory
journal, November 1997


Invariant formulation of hyperelastic transverse isotropy based on polyconvex free energy functions
journal, January 2003


Autoprogressive training of neural network constitutive models
journal, May 1998


The computation of the exponential and logarithmic mappings and their first and second linearizations
journal, December 2001

  • Ortiz, M.; Radovitzky, R. A.; Repetto, E. A.
  • International Journal for Numerical Methods in Engineering, Vol. 52, Issue 12
  • DOI: 10.1002/nme.263

Knowledge‐Based Modeling of Material Behavior with Neural Networks
journal, January 1991


Implicit constitutive modelling for viscoplasticity using neural networks
journal, September 1998


Data-driven computational mechanics
journal, June 2016


Learning to forget: continual prediction with LSTM
conference, January 1999

  • Gers, F. A.
  • 9th International Conference on Artificial Neural Networks: ICANN '99
  • DOI: 10.1049/cp:19991218

A semi-implicit discrete-continuum coupling method for porous media based on the effective stress principle at finite strain
journal, June 2016