DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Discretization-independent surrogate modeling of physical fields around variable geometries using coordinate-based networks

Journal Article · · Data-Centric Engineering

Abstract Numerical solutions of partial differential equations require expensive simulations, limiting their application in design optimization, model-based control, and large-scale inverse problems. Surrogate modeling techniques aim to decrease computational expense while retaining dominant solution features and characteristics. Existing frameworks based on convolutional neural networks and snapshot-matrix decomposition often rely on lossy pixelization and data-preprocessing, limiting their effectiveness in realistic engineering scenarios. Recently, coordinate-based multilayer perceptron networks have been found to be effective at representing 3D objects and scenes by regressing volumetric implicit fields. These concepts are leveraged and adapted in the context of physical-field surrogate modeling. Two methods toward generalization are proposed and compared: design-variable multilayer perceptron (DV-MLP) and design-variable hypernetworks (DVH). Each method utilizes a main network which consumes pointwise spatial information to provide a continuous representation of the solution field, allowing discretization independence and a decoupling of solution and model size. DV-MLP achieves generalization through the use of a design-variable embedding vector, while DVH conditions the main network weights on the design variables using a hypernetwork. The methods are applied to predict steady-state solutions around complex, parametrically defined geometries on non-parametrically-defined meshes , with model predictions obtained in less than a second. The incorporation of random Fourier features greatly enhanced prediction and generalization accuracy for both approaches. DVH models have more trainable weights than a similar DV-MLP model, but an efficient batch-by-case training method allows DVH to be trained in a similar amount of time as DV-MLP. A vehicle aerodynamics test problem is chosen to assess the method’s feasibility. Both methods exhibit promising potential as viable options for surrogate modeling, being able to process snapshots of data that correspond to different mesh topologies.

Sponsoring Organization:
USDOE Advanced Research Projects Agency - Energy (ARPA-E)
OSTI ID:
2497878
Journal Information:
Data-Centric Engineering, Journal Name: Data-Centric Engineering Vol. 6; ISSN 2632-6736
Publisher:
Cambridge University Press (CUP)Copyright Statement
Country of Publication:
United Kingdom
Language:
English

References (41)

U-Net: Convolutional Networks for Biomedical Image Segmentation
  • Ronneberger, Olaf; Fischer, Philipp; Brox, Thomas
  • Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III https://doi.org/10.1007/978-3-319-24574-4_28
book November 2015
Machine-learning-based reduced-order modeling for unsteady flows around bluff bodies of various shapes journal May 2020
Prediction of aerodynamic flow fields using convolutional neural networks journal June 2019
PoreFlow-Net: A 3D convolutional neural network to predict fluid flow through porous media journal April 2020
Multi-level convolutional autoencoder networks for parametric prediction of spatio-temporal dynamics journal December 2020
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations journal February 2019
DeepM&Mnet: Inferring the electroconvection multiphysics fields based on operator approximation by neural networks journal July 2021
Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators journal March 2021
A point-cloud deep learning framework for prediction of fluid flow fields on irregular geometries journal February 2021
Simulation and prediction of three-dimensional rotating flows based on convolutional neural networks journal September 2022
Free-form deformation, mesh morphing and reduced-order methods: enablers for efficient aerodynamic shape optimisation journal May 2018
Gradient-based learning applied to document recognition journal January 1998
Deep Residual Learning for Image Recognition conference June 2016
DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation conference June 2019
Occupancy Networks: Learning 3D Reconstruction in Function Space conference June 2019
Neural Fields in Visual Computing and Beyond journal May 2022
Generalizability of Convolutional Encoder–Decoder Networks for Aerodynamic Flow-Field Prediction Across Geometric and Physical-Fluidic Variations journal November 2020
Geodesic Convolutional Neural Network Characterization of Macro-Porous Latent Thermal Energy Storage journal February 2023
Learning the solution operator of parametric partial differential equations with physics-informed DeepONets journal October 2021
Dynamic Mode Decomposition book January 2016
A Survey of Projection-Based Model Reduction Methods for Parametric Dynamical Systems journal January 2015
Extracting and composing robust features with denoising autoencoders conference January 2008
Convolutional Neural Networks for Steady Flow Approximation
  • Guo, Xiaoxiao; Li, Wei; Iorio, Francesco
  • KDD '16: The 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining https://doi.org/10.1145/2939672.2939738
conference August 2016
NeRF journal January 2022
Dynamic Mode Decomposition and Its Variants journal January 2022
Proper Orthogonal Decomposition as Surrogate Model for Aerodynamic Optimization journal January 2016
Feature-wise transformations journal July 2018
Deep Learning Methods for Reynolds-Averaged Navier–Stokes Simulations of Airfoil Flows journal January 2020
Balanced Model Reduction via the Proper Orthogonal Decomposition journal November 2002
Towards the Large-Eddy Simulation of a full engine: Integration of a 360 azimuthal degrees fan, compressor and combustion chamber. Part I: Methodology and initialisation journal May 2021
Spectral Networks and Locally Connected Networks on Graphs preprint January 2013
Very Deep Convolutional Networks for Large-Scale Image Recognition preprint January 2014
Adam: A Method for Stochastic Optimization preprint January 2014
Deep Convolutional Networks on Graph-Structured Data preprint January 2015
Semi-Supervised Classification with Graph Convolutional Networks preprint January 2016
HyperNetworks preprint January 2016
GMLS-Nets: A framework for learning from unstructured data text January 2019
On the Effectiveness of Weight-Encoded Neural Implicit 3D Shapes preprint January 2020
Learning Mesh-Based Simulation with Graph Networks text January 2020
Fourier Neural Operator for Parametric Partial Differential Equations preprint January 2020
tommyod/KDEpy: Kernel Density Estimation in Python v0.9.10 software December 2018