DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Enhanced data efficiency using deep neural networks and Gaussian processes for aerodynamic design optimization

Abstract

Adjoint-based optimization methods are attractive for aerodynamic shape design primarily due to their computational costs being independent of the dimensionality of the input space and their ability to generate high-fidelity gradients that can then be used in a gradient-based optimizer. This makes them very well suited for high-fidelity simulation based aerodynamic shape optimization of highly parametrized geometries such as aircraft wings. However, the development of adjoint-based solvers involve careful mathematical treatment and their implementation require detailed software development. Furthermore, they can become prohibitively expensive when multiple optimization problems are being solved, each requiring multiple restarts to circumvent local optima. In this work, we propose a machine learning enabled, surrogate-based framework that replaces the expensive adjoint solver, without compromising on predicting predictive accuracy. Specifically, we first train a deep neural network (DNN) from training data generated from evaluating the high-fidelity simulation model on a model-agnostic design of experiments on the geometry shape parameters. The optimum shape may then be computed by using a gradient-based optimizer coupled with the trained DNN. Subsequently, we also perform a gradient-free Bayesian optimization, where the trained DNN is used as the prior mean. We observe that the latter framework (DNN-BO) improves upon the DNN-only based optimizationmore » strategy for the same computational cost. Overall, this framework predicts the true optimum with very high accuracy, while requiring far fewer high-fidelity function calls compared to the adjoint-based method. Furthermore, we show that multiple optimization problems can be solved with the same machine learning model with high accuracy, to amortize the offline costs associated with constructing our models. Our methodology finds applications in the early stages of aerospace design.« less

Authors:
ORCiD logo [1];  [1]; ORCiD logo [2]
  1. Argonne National Lab. (ANL), Argonne, IL (United States)
  2. Georgia Inst. of Technology, Atlanta, GA (United States)
Publication Date:
Research Org.:
Argonne National Laboratory (ANL), Argonne, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
OSTI Identifier:
1798159
Grant/Contract Number:  
AC02-06CH11357
Resource Type:
Accepted Manuscript
Journal Name:
Aerospace Science and Technology
Additional Journal Information:
Journal Volume: 111; Journal ID: ISSN 1270-9638
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
42 ENGINEERING; Adjoint method; Aerodynamic design optimization; Bayesian optimization; Gaussian processes; Machine learning

Citation Formats

Renganathan, S. Ashwin, Maulik, Romit, and Ahuja, Jai. Enhanced data efficiency using deep neural networks and Gaussian processes for aerodynamic design optimization. United States: N. p., 2021. Web. doi:10.1016/j.ast.2021.106522.
Renganathan, S. Ashwin, Maulik, Romit, & Ahuja, Jai. Enhanced data efficiency using deep neural networks and Gaussian processes for aerodynamic design optimization. United States. https://doi.org/10.1016/j.ast.2021.106522
Renganathan, S. Ashwin, Maulik, Romit, and Ahuja, Jai. Thu . "Enhanced data efficiency using deep neural networks and Gaussian processes for aerodynamic design optimization". United States. https://doi.org/10.1016/j.ast.2021.106522. https://www.osti.gov/servlets/purl/1798159.
@article{osti_1798159,
title = {Enhanced data efficiency using deep neural networks and Gaussian processes for aerodynamic design optimization},
author = {Renganathan, S. Ashwin and Maulik, Romit and Ahuja, Jai},
abstractNote = {Adjoint-based optimization methods are attractive for aerodynamic shape design primarily due to their computational costs being independent of the dimensionality of the input space and their ability to generate high-fidelity gradients that can then be used in a gradient-based optimizer. This makes them very well suited for high-fidelity simulation based aerodynamic shape optimization of highly parametrized geometries such as aircraft wings. However, the development of adjoint-based solvers involve careful mathematical treatment and their implementation require detailed software development. Furthermore, they can become prohibitively expensive when multiple optimization problems are being solved, each requiring multiple restarts to circumvent local optima. In this work, we propose a machine learning enabled, surrogate-based framework that replaces the expensive adjoint solver, without compromising on predicting predictive accuracy. Specifically, we first train a deep neural network (DNN) from training data generated from evaluating the high-fidelity simulation model on a model-agnostic design of experiments on the geometry shape parameters. The optimum shape may then be computed by using a gradient-based optimizer coupled with the trained DNN. Subsequently, we also perform a gradient-free Bayesian optimization, where the trained DNN is used as the prior mean. We observe that the latter framework (DNN-BO) improves upon the DNN-only based optimization strategy for the same computational cost. Overall, this framework predicts the true optimum with very high accuracy, while requiring far fewer high-fidelity function calls compared to the adjoint-based method. Furthermore, we show that multiple optimization problems can be solved with the same machine learning model with high accuracy, to amortize the offline costs associated with constructing our models. Our methodology finds applications in the early stages of aerospace design.},
doi = {10.1016/j.ast.2021.106522},
journal = {Aerospace Science and Technology},
number = ,
volume = 111,
place = {United States},
year = {Thu Apr 01 00:00:00 EDT 2021},
month = {Thu Apr 01 00:00:00 EDT 2021}
}

Works referenced in this record:

Surrogate-based aerodynamic shape optimization of hypersonic flows considering transonic performance
journal, October 2019


Efficient accelerators for PSO in an inverse design of multi-element airfoils
journal, August 2019


Convergence to Steady State Solutions of the Euler Equations on Unstructured Grids with Limiters
journal, April 1995


Universal Parametric Geometry Representation Method
journal, January 2008

  • Kulfan, Brenda M.
  • Journal of Aircraft, Vol. 45, Issue 1
  • DOI: 10.2514/1.29958

Aerodynamic Design Optimization Studies of a Blended-Wing-Body Aircraft
journal, September 2014

  • Lyu, Zhoujie; Martins, Joaquim R. R. A.
  • Journal of Aircraft, Vol. 51, Issue 5
  • DOI: 10.2514/1.C032491

Machine learning for nonintrusive model order reduction of the parametric inviscid transonic flow past an airfoil
journal, April 2020

  • Renganathan, S. Ashwin; Maulik, Romit; Rao, Vishwas
  • Physics of Fluids, Vol. 32, Issue 4
  • DOI: 10.1063/1.5144661

Surrogate-Based Aerodynamic Shape Optimization by Variable-Resolution Models
journal, January 2013

  • Koziel, Slawomir; Leifsson, Leifur
  • AIAA Journal, Vol. 51, Issue 1
  • DOI: 10.2514/1.J051583

A surrogate assisted evolutionary optimization method with application to the transonic airfoil design
journal, June 2010


Koopman-Based Approach to Nonintrusive Projection-Based Reduced-Order Modeling with Black-Box High-Fidelity Models
journal, October 2018

  • Renganathan, S. Ashwin; Liu, Yingjie; Mavris, Dimitri N.
  • AIAA Journal, Vol. 56, Issue 10
  • DOI: 10.2514/1.J056812

Optimum Aerodynamic Design Using the Navier-Stokes Equations
journal, January 1998

  • Jameson, A.; Martinelli, L.; Pierce, N. A.
  • Theoretical and Computational Fluid Dynamics, Vol. 10, Issue 1-4
  • DOI: 10.1007/s001620050060

Multi-objective shape optimization of transonic airfoil sections using swarm intelligence and surrogate models
journal, November 2011

  • Kotinis, Miltiadis; Kulkarni, Amit
  • Structural and Multidisciplinary Optimization, Vol. 45, Issue 5
  • DOI: 10.1007/s00158-011-0719-7

Aerodynamic Shape Optimization of Common Research Model Wing–Body–Tail Configuration
journal, January 2016

  • Chen, Song; Lyu, Zhoujie; Kenway, Gaetan K. W.
  • Journal of Aircraft, Vol. 53, Issue 1
  • DOI: 10.2514/1.C033328

Efficient Global Optimization of Expensive Black-Box Functions
journal, January 1998

  • Jones, Donald R.; Schonlau, Matthias; Welch, William J.
  • Journal of Global Optimization, Vol. 13, Issue 4, p. 455-492
  • DOI: 10.1023/A:1008306431147

Computational Aerodynamics for Aircraft Design
journal, July 1989


Fast pressure distribution prediction of airfoils using deep learning
journal, October 2020


Modeling an Augmented Lagrangian for Blackbox Constrained Optimization
journal, January 2016


Application of deep learning based multi-fidelity surrogate model to robust aerodynamic design optimization
journal, September 2019


Inverse Design of Airfoil Using a Deep Convolutional Neural Network
journal, March 2019

  • Sekar, Vinothkumar; Zhang, Mengqi; Shu, Chang
  • AIAA Journal, Vol. 57, Issue 3
  • DOI: 10.2514/1.J057894

A reduced-order model for gradient-based aerodynamic shape optimisation
journal, November 2020


Fast Evolutionary Algorithm for Airfoil Design via Neural Network
journal, September 2007

  • Hacioglu, Abdurrahman
  • AIAA Journal, Vol. 45, Issue 9
  • DOI: 10.2514/1.24484

An airfoil optimization technique for wind turbines
journal, October 2012

  • Ribeiro, A. F. P.; Awruch, A. M.; Gomes, H. M.
  • Applied Mathematical Modelling, Vol. 36, Issue 10
  • DOI: 10.1016/j.apm.2011.12.026

A Taxonomy of Global Optimization Methods Based on Response Surfaces
journal, December 2001


Surrogate-Based Aerodynamic Shape Optimization of a Civil Aircraft Engine Nacelle
journal, October 2007

  • Song, Wenbin; Keane, Andy J.
  • AIAA Journal, Vol. 45, Issue 10
  • DOI: 10.2514/1.30015

Aerodynamic design via control theory
journal, September 1988

  • Jameson, Antony
  • Journal of Scientific Computing, Vol. 3, Issue 3
  • DOI: 10.1007/BF01061285

Aerodynamic shape optimization using a novel optimizer based on machine learning techniques
journal, March 2019