skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A near-stationary subspace for ridge approximation

Journal Article · · Computer Methods in Applied Mechanics and Engineering
 [1];  [2];  [1];  [3]
  1. University of Colorado, Boulder, CO (United States)
  2. Alan Turing Institute, London (United Kingdom)
  3. University of Texas, Austin, TX (United States)

Response surfaces are common surrogates for expensive computer simulations in engineering analysis. However, the cost of fitting an accurate response surface increases exponentially as the number of model inputs increases, which leaves response surface construction intractable for high-dimensional, nonlinear models. Here we describe ridge approximation for fitting response surfaces in several variables. A ridge function is constant along several directions in its domain, so fitting occurs on the coordinates of a low-dimensional subspace of the input space. We review essential theory for ridge approximation – e.g., the best mean-squared approximation and an optimal low-dimensional subspace – and we prove that the gradient-based active subspace is near-stationary for the least-squares problem that defines an optimal subspace. Motivated by the theory, we propose a computational heuristic that uses an estimated active subspace as an initial guess for a ridge approximation fitting problem. We show a simple example where the heuristic fails, which reveals a type of function for which the proposed approach is inappropriate. We then propose a simple alternating heuristic for fitting a ridge function, and we demonstrate the effectiveness of the active subspace initial guess applied to an airfoil model of drag as a function of its 18 shape parameters.

Research Organization:
Colorado School of Mines, Golden, CO (United States); Univ. of Colorado, Boulder, CO (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); Defense Advanced Research Projects Agency (DARPA); Alan Turing Institute; National Science Foundation (NSF)
Grant/Contract Number:
SC0011077; EP/N510129/1; 1255631; SC-0011077
OSTI ID:
1538114
Alternate ID(s):
OSTI ID: 1495603
Journal Information:
Computer Methods in Applied Mechanics and Engineering, Vol. 326, Issue C; ISSN 0045-7825
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 19 works
Citation information provided by
Web of Science

References (24)

Learning Functions of Few Arbitrary Linear Parameters in High Dimensions journal February 2012
SU2: An Open-Source Suite for Multiphysics Simulation and Design journal March 2016
Nested Latin hypercube designs journal September 2009
Capturing Ridge Functions in High Dimensions from Point Queries journal December 2011
Exploring Regression Structure Using Nonparametric Functional Estimation journal September 1993
On Nonlinear Functions of Linear Combinations journal March 1984
Projection Pursuit Regression journal December 1981
Weighted Poincaré and Friedrichs Inequalities journal February 1993
Algorithms for Separable Nonlinear Least Squares Problems journal July 1980
Tractability and Strong Tractability of Linear Multivariate Problems journal March 1994
Learning non-parametric basis independent models from point queries via low-rank methods journal November 2014
Exploiting active subspaces to quantify uncertainty in the numerical simulation of the HyShot II scramjet journal December 2015
Gaussian processes with built-in dimensionality reduction: Applications to high-dimensional uncertainty propagation journal September 2016
Survey of modeling and optimization strategies to solve high-dimensional design problems with computationally-expensive black-box functions journal August 2009
Error and Perturbation Bounds for Subspaces Associated with Certain Eigenvalue Problems journal October 1973
A Note on the Poincaré Inequality for Convex Domains journal January 2003
A Taxonomy of Global Optimization Methods Based on Response Surfaces journal December 2001
The Geometry of Algorithms with Orthogonality Constraints journal January 1998
Estimating the approximation error when fixing unessential factors in global sensitivity analysis journal July 2007
An inequality for the multivariate normal distribution journal June 1982
Predicting the output from a complex computer code when fast approximations are available journal March 2000
Active Subspace Methods in Theory and Practice: Applications to Kriging Surfaces journal January 2014
Analysis of generalized ridge functions in high dimensions conference May 2015
Learning Functions of Few Arbitrary Linear Parameters in High Dimensions preprint January 2010

Similar Records

Active Subspace Methods for Data-Intensive Inverse Problems
Technical Report · Sat Feb 09 00:00:00 EST 2019 · OSTI ID:1538114

Active Subspace Methods for Data-Intensive Inverse Problems (Final Report)
Technical Report · Sat Feb 09 00:00:00 EST 2019 · OSTI ID:1538114

Gradient-Free Construction of Active Subspaces for Dimension Reduction in Complex Models with Applications to Neutronics
Journal Article · Thu Jan 17 00:00:00 EST 2019 · SIAM/ASA Journal on Uncertainty Quantification · OSTI ID:1538114