Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

A computationally efficient parallel Levenberg-Marquardt algorithm for highly parameterized inverse model analyses

Journal Article · · Water Resources Research
DOI:https://doi.org/10.1002/2016WR019028· OSTI ID:1312574
 [1];  [1];  [1]
  1. Los Alamos National Lab. (LANL), Los Alamos, NM (United States)

Inverse modeling seeks model parameters given a set of observations. However, for practical problems because the number of measurements is often large and the model parameters are also numerous, conventional methods for inverse modeling can be computationally expensive. We have developed a new, computationally-efficient parallel Levenberg-Marquardt method for solving inverse modeling problems with a highly parameterized model space. Levenberg-Marquardt methods require the solution of a linear system of equations which can be prohibitively expensive to compute for moderate to large-scale problems. Our novel method projects the original linear problem down to a Krylov subspace, such that the dimensionality of the problem can be significantly reduced. Furthermore, we store the Krylov subspace computed when using the first damping parameter and recycle the subspace for the subsequent damping parameters. The efficiency of our new inverse modeling algorithm is significantly improved using these computational techniques. We apply this new inverse modeling method to invert for random transmissivity fields in 2D and a random hydraulic conductivity field in 3D. Our algorithm is fast enough to solve for the distributed model parameters (transmissivity) in the model domain. The algorithm is coded in Julia and implemented in the MADS computational framework (http://mads.lanl.gov). By comparing with Levenberg-Marquardt methods using standard linear inversion techniques such as QR or SVD methods, our Levenberg-Marquardt method yields a speed-up ratio on the order of ~101 to ~102 in a multi-core computational environment. Furthermore, our new inverse modeling method is a powerful tool for characterizing subsurface heterogeneity for moderate- to large-scale problems.

Research Organization:
Los Alamos National Laboratory (LANL)
Sponsoring Organization:
LANL EP Program; USDOE
Grant/Contract Number:
AC52-06NA25396
OSTI ID:
1312574
Report Number(s):
LA-UR-16-22377
Journal Information:
Water Resources Research, Journal Name: Water Resources Research; ISSN 0043-1397
Publisher:
American Geophysical Union (AGU)Copyright Statement
Country of Publication:
United States
Language:
English

References (30)

Fast iterative implementation of large-scale nonlinear geostatistical inverse modeling: FAST ITERATIVE NONLINEAR INVERSE MODELING journal January 2014
Principal Component Geostatistical Approach for large-dimensional inverse problems journal July 2014
Large-scale hydraulic tomography and joint inversion of head and tracer data using the Principal Component Geostatistical Approach (PCGA) journal July 2014
Linear functional minimization for inverse modeling: LINEAR FUNCTIONAL MINIMIZATION FOR INVERSE MODELING journal June 2015
Geostatistical reduced-order models in underdetermined inverse problems: Groms in Underdetermined Inverse Problems journal October 2013
Modified Levenberg Marquardt Algorithm for Inverse Problems book January 2010
Using an inverse method to estimate the hydraulic properties of crusted soils from tension-disc infiltrometer data journal October 1998
A modified Levenberg–Marquardt algorithm for quasi-linear geostatistical inversing journal July 2004
A truncated Levenberg–Marquardt algorithm for the calibration of highly parameterized nonlinear models journal June 2011
Active subspaces for sensitivity analysis and dimension reduction of an integrated hydrologic model journal October 2015
On level set regularization for highly ill-posed distributed parameter estimation problems journal August 2006
Application of inverse methods to contaminant source identification from aquitard diffusion profiles at Dover AFB, Delaware journal July 1999
A hybrid regularized inversion methodology for highly parameterized environmental models: HYBRID REGULARIZATION METHODOLOGY journal October 2005
Obtaining parsimonious hydraulic conductivity fields using head and transport observations: A Bayesian geostatistical parameter estimation approach: COUPLED FLOW AND PARAMETER ESTIMATION journal August 2009
Efficient methods for large-scale linear inversion using a geostatistical approach: EFFICIENT GEOSTATISTICAL APPROACH journal May 2012
A Comparison of Several Methods of Solving Nonlinear Regression Groundwater Flow Problems journal October 1985
Estimation of Aquifer Parameters Under Transient and Steady State Conditions: 1. Maximum Likelihood Method Incorporating Prior Information journal February 1986
Damping–undamping strategies for the Levenberg–Marquardt nonlinear least-squares method journal January 1997
A method for the solution of certain non-linear problems in least squares journal January 1944
Are Models Too Simple? Arguments for Increased Parameterization journal May 2007
Calculating the Singular Values and Pseudo-Inverse of a Matrix
  • Golub, G.; Kahan, W.
  • Journal of the Society for Industrial and Applied Mathematics Series B Numerical Analysis, Vol. 2, Issue 2 https://doi.org/10.1137/0702016
journal January 1965
Solution of Sparse Indefinite Systems of Linear Equations journal September 1975
A Parallel Nonlinear Least-Squares Solver: Theoretical Analysis and Numerical Results journal May 1992
Computational Methods for Inverse Problems book January 2002
Iterative Methods for Sparse Linear Systems book January 2003
Rank-Deficient and Discrete Ill-Posed Problems book January 1998
Active Subspace Methods in Theory and Practice: Applications to Kriging Surfaces journal January 2014
LSQR: An Algorithm for Sparse Linear Equations and Sparse Least Squares journal March 1982
Algorithm 583: LSQR: Sparse Linear Equations and Least Squares Problems journal June 1982
Efficient Parallel Levenberg-Marquardt Model Fitting towards Real-Time Automated Parametric Imaging Microscopy journal October 2013

Cited By (4)

Quantifying model structural error: Efficient Bayesian calibration of a regional groundwater flow model using surrogates and a data-driven error model: CALIBRATING WITH STRUCTURAL ERROR journal May 2017
Randomized Truncated SVD Levenberg‐Marquardt Approach to Geothermal Natural State and History Matching journal March 2018
Identification of Pollutant Source for Super-Diffusion in Aquifers and Rivers with Bounded Domains journal September 2018
Randomized Truncated SVD Levenberg-Marquardt Approach to Geothermal Natural State and History Matching text January 2017

Similar Records

A truncated Levenberg-Marquardt algorithm for the calibration of highly parameterized nonlinear models
Journal Article · Fri Oct 15 00:00:00 EDT 2010 · Computers and Geosciences · OSTI ID:1005169

Levenberg--Marquardt algorithm: implementation and theory
Conference · Fri Dec 31 23:00:00 EST 1976 · OSTI ID:7256021

Seismic Event Location Using Levenberg-Marquardt Least Squares Inversion
Technical Report · Tue Oct 01 00:00:00 EDT 2002 · OSTI ID:803290