skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A computationally efficient parallel Levenberg-Marquardt algorithm for highly parameterized inverse model analyses

Journal Article · · Water Resources Research
DOI:https://doi.org/10.1002/2016WR019028· OSTI ID:1312574
 [1];  [1];  [1]
  1. Los Alamos National Lab. (LANL), Los Alamos, NM (United States)

Inverse modeling seeks model parameters given a set of observations. However, for practical problems because the number of measurements is often large and the model parameters are also numerous, conventional methods for inverse modeling can be computationally expensive. We have developed a new, computationally-efficient parallel Levenberg-Marquardt method for solving inverse modeling problems with a highly parameterized model space. Levenberg-Marquardt methods require the solution of a linear system of equations which can be prohibitively expensive to compute for moderate to large-scale problems. Our novel method projects the original linear problem down to a Krylov subspace, such that the dimensionality of the problem can be significantly reduced. Furthermore, we store the Krylov subspace computed when using the first damping parameter and recycle the subspace for the subsequent damping parameters. The efficiency of our new inverse modeling algorithm is significantly improved using these computational techniques. We apply this new inverse modeling method to invert for random transmissivity fields in 2D and a random hydraulic conductivity field in 3D. Our algorithm is fast enough to solve for the distributed model parameters (transmissivity) in the model domain. The algorithm is coded in Julia and implemented in the MADS computational framework (http://mads.lanl.gov). By comparing with Levenberg-Marquardt methods using standard linear inversion techniques such as QR or SVD methods, our Levenberg-Marquardt method yields a speed-up ratio on the order of ~101 to ~102 in a multi-core computational environment. Furthermore, our new inverse modeling method is a powerful tool for characterizing subsurface heterogeneity for moderate- to large-scale problems.

Research Organization:
Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
Sponsoring Organization:
LANL EP Program; USDOE
Grant/Contract Number:
AC52-06NA25396
OSTI ID:
1312574
Report Number(s):
LA-UR-16-22377
Journal Information:
Water Resources Research, Journal Name: Water Resources Research; ISSN 0043-1397
Publisher:
American Geophysical Union (AGU)Copyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 14 works
Citation information provided by
Web of Science

References (28)

Solution of Sparse Indefinite Systems of Linear Equations journal September 1975
LSQR: An Algorithm for Sparse Linear Equations and Sparse Least Squares journal March 1982
A modified Levenberg–Marquardt algorithm for quasi-linear geostatistical inversing journal July 2004
Obtaining parsimonious hydraulic conductivity fields using head and transport observations: A Bayesian geostatistical parameter estimation approach: COUPLED FLOW AND PARAMETER ESTIMATION journal August 2009
A method for the solution of certain non-linear problems in least squares journal January 1944
Active subspaces for sensitivity analysis and dimension reduction of an integrated hydrologic model journal October 2015
On level set regularization for highly ill-posed distributed parameter estimation problems journal August 2006
Calculating the Singular Values and Pseudo-Inverse of a Matrix
  • Golub, G.; Kahan, W.
  • Journal of the Society for Industrial and Applied Mathematics Series B Numerical Analysis, Vol. 2, Issue 2 https://doi.org/10.1137/0702016
journal January 1965
Application of inverse methods to contaminant source identification from aquitard diffusion profiles at Dover AFB, Delaware journal July 1999
Fast iterative implementation of large-scale nonlinear geostatistical inverse modeling: FAST ITERATIVE NONLINEAR INVERSE MODELING journal January 2014
A Comparison of Several Methods of Solving Nonlinear Regression Groundwater Flow Problems journal October 1985
Principal Component Geostatistical Approach for large-dimensional inverse problems journal July 2014
Damping–undamping strategies for the Levenberg–Marquardt nonlinear least-squares method journal January 1997
Efficient methods for large-scale linear inversion using a geostatistical approach: EFFICIENT GEOSTATISTICAL APPROACH journal May 2012
Algorithm 583: LSQR: Sparse Linear Equations and Least Squares Problems journal June 1982
Active Subspace Methods in Theory and Practice: Applications to Kriging Surfaces journal January 2014
Iterative Methods for Sparse Linear Systems book January 2003
Are Models Too Simple? Arguments for Increased Parameterization journal May 2007
Large-scale hydraulic tomography and joint inversion of head and tracer data using the Principal Component Geostatistical Approach (PCGA) journal July 2014
A truncated Levenberg–Marquardt algorithm for the calibration of highly parameterized nonlinear models journal June 2011
Linear functional minimization for inverse modeling: LINEAR FUNCTIONAL MINIMIZATION FOR INVERSE MODELING journal June 2015
Estimation of Aquifer Parameters Under Transient and Steady State Conditions: 1. Maximum Likelihood Method Incorporating Prior Information journal February 1986
Using an inverse method to estimate the hydraulic properties of crusted soils from tension-disc infiltrometer data journal October 1998
Efficient Parallel Levenberg-Marquardt Model Fitting towards Real-Time Automated Parametric Imaging Microscopy journal October 2013
A Parallel Nonlinear Least-Squares Solver: Theoretical Analysis and Numerical Results journal May 1992
Computational Methods for Inverse Problems book January 2002
Geostatistical reduced-order models in underdetermined inverse problems: Groms in Underdetermined Inverse Problems journal October 2013
A hybrid regularized inversion methodology for highly parameterized environmental models: HYBRID REGULARIZATION METHODOLOGY journal October 2005

Cited By (4)

Quantifying model structural error: Efficient Bayesian calibration of a regional groundwater flow model using surrogates and a data-driven error model: CALIBRATING WITH STRUCTURAL ERROR journal May 2017
Randomized Truncated SVD Levenberg‐Marquardt Approach to Geothermal Natural State and History Matching journal March 2018
Identification of Pollutant Source for Super-Diffusion in Aquifers and Rivers with Bounded Domains journal September 2018
Randomized Truncated SVD Levenberg-Marquardt Approach to Geothermal Natural State and History Matching text January 2017

Similar Records

A truncated Levenberg-Marquardt algorithm for the calibration of highly parameterized nonlinear models
Journal Article · Fri Oct 15 00:00:00 EDT 2010 · Computers and Geosciences · OSTI ID:1312574

Large-scale inverse model analyses employing fast randomized data reduction: INVERSE MODELING WITH DATA REDUCTION
Journal Article · Thu Jul 06 00:00:00 EDT 2017 · Water Resources Research · OSTI ID:1312574

Seismic Event Location Using Levenberg-Marquardt Least Squares Inversion
Technical Report · Tue Oct 01 00:00:00 EDT 2002 · OSTI ID:1312574