An Iterative Local Updating Ensemble Smoother for Estimation and Uncertainty Assessment of Hydrologic Model Parameters With Multimodal Distributions
Abstract
Abstract Ensemble smoother (ES) has been widely used in inverse modeling of hydrologic systems. However, for problems where the distribution of model parameters is multimodal, using ES directly would be problematic. One popular solution is to use a clustering algorithm to identify each mode and update the clusters with ES separately. However, this strategy may not be very efficient when the dimension of parameter space is high or the number of modes is large. Alternatively, we propose in this paper a very simple and efficient algorithm, i.e., the iterative local updating ensemble smoother (ILUES), to explore multimodal distributions of model parameters in nonlinear hydrologic systems. The ILUES algorithm works by updating local ensembles of each sample with ES to explore possible multimodal distributions. To achieve satisfactory data matches in nonlinear problems, we adopt an iterative form of ES to assimilate the measurements multiple times. Numerical cases involving nonlinearity and multimodality are tested to illustrate the performance of the proposed method. It is shown that overall the ILUES algorithm can well quantify the parametric uncertainties of complex hydrologic models, no matter whether the multimodal distribution exists.
- Authors:
-
- Zhejiang Provincial Key Laboratory of Agricultural Resources and Environment Institute of Soil and Water Resources and Environmental Science, College of Environmental and Resource Sciences, Zhejiang University Hangzhou China
- Department of Mathematics and School of Mechanical Engineering Purdue University West Lafayette IN USA
- Pacific Northwest National Laboratory Richland WA USA
- Department of Environmental Sciences University of California Riverside CA USA
- Publication Date:
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1433557
- Resource Type:
- Publisher's Accepted Manuscript
- Journal Name:
- Water Resources Research
- Additional Journal Information:
- Journal Name: Water Resources Research Journal Volume: 54 Journal Issue: 3; Journal ID: ISSN 0043-1397
- Publisher:
- American Geophysical Union (AGU)
- Country of Publication:
- United States
- Language:
- English
Citation Formats
Zhang, Jiangjiang, Lin, Guang, Li, Weixuan, Wu, Laosheng, and Zeng, Lingzao. An Iterative Local Updating Ensemble Smoother for Estimation and Uncertainty Assessment of Hydrologic Model Parameters With Multimodal Distributions. United States: N. p., 2018.
Web. doi:10.1002/2017WR020906.
Zhang, Jiangjiang, Lin, Guang, Li, Weixuan, Wu, Laosheng, & Zeng, Lingzao. An Iterative Local Updating Ensemble Smoother for Estimation and Uncertainty Assessment of Hydrologic Model Parameters With Multimodal Distributions. United States. https://doi.org/10.1002/2017WR020906
Zhang, Jiangjiang, Lin, Guang, Li, Weixuan, Wu, Laosheng, and Zeng, Lingzao. Sat .
"An Iterative Local Updating Ensemble Smoother for Estimation and Uncertainty Assessment of Hydrologic Model Parameters With Multimodal Distributions". United States. https://doi.org/10.1002/2017WR020906.
@article{osti_1433557,
title = {An Iterative Local Updating Ensemble Smoother for Estimation and Uncertainty Assessment of Hydrologic Model Parameters With Multimodal Distributions},
author = {Zhang, Jiangjiang and Lin, Guang and Li, Weixuan and Wu, Laosheng and Zeng, Lingzao},
abstractNote = {Abstract Ensemble smoother (ES) has been widely used in inverse modeling of hydrologic systems. However, for problems where the distribution of model parameters is multimodal, using ES directly would be problematic. One popular solution is to use a clustering algorithm to identify each mode and update the clusters with ES separately. However, this strategy may not be very efficient when the dimension of parameter space is high or the number of modes is large. Alternatively, we propose in this paper a very simple and efficient algorithm, i.e., the iterative local updating ensemble smoother (ILUES), to explore multimodal distributions of model parameters in nonlinear hydrologic systems. The ILUES algorithm works by updating local ensembles of each sample with ES to explore possible multimodal distributions. To achieve satisfactory data matches in nonlinear problems, we adopt an iterative form of ES to assimilate the measurements multiple times. Numerical cases involving nonlinearity and multimodality are tested to illustrate the performance of the proposed method. It is shown that overall the ILUES algorithm can well quantify the parametric uncertainties of complex hydrologic models, no matter whether the multimodal distribution exists.},
doi = {10.1002/2017WR020906},
journal = {Water Resources Research},
number = 3,
volume = 54,
place = {United States},
year = {Sat Mar 10 00:00:00 EST 2018},
month = {Sat Mar 10 00:00:00 EST 2018}
}
https://doi.org/10.1002/2017WR020906
Web of Science
Works referenced in this record:
An Ensemble Smoother for Assisted History Matching
conference, April 2013
- Skjervheim, Jan-arild; Evensen, Geir
- SPE Reservoir Simulation Symposium
Maximum likelihood Bayesian averaging of spatial variability models in unsaturated fractured tuff: MAXIMUM LIKELIHOOD BAYESIAN MODEL AVERAGING
journal, May 2004
- Ye, Ming; Neuman, Shlomo P.; Meyer, Philip D.
- Water Resources Research, Vol. 40, Issue 5
Data Assimilation and Inverse Methods in Terms of a Probabilistic Formulation
journal, December 1996
- van Leeuwen, Peter Jan; Evensen, Geir
- Monthly Weather Review, Vol. 124, Issue 12
Treatment of input uncertainty in hydrologic modeling: Doing hydrology backward with Markov chain Monte Carlo simulation: FORCING DATA ERROR USING MCMC SAMPLING
journal, December 2008
- Vrugt, Jasper A.; ter Braak, Cajo J. F.; Clark, Martyn P.
- Water Resources Research, Vol. 44, Issue 12
An efficient, high-order perturbation approach for flow in random porous media via Karhunen–Loève and polynomial expansions
journal, March 2004
- Zhang, Dongxiao; Lu, Zhiming
- Journal of Computational Physics, Vol. 194, Issue 2
Cluster ensemble Kalman filter
journal, January 2007
- Smith, Keston W.
- Tellus A: Dynamic Meteorology and Oceanography, Vol. 59, Issue 5
Some adaptive Monte Carlo methods for Bayesian inference
journal, September 1999
- Tierney, Luke; Mira, Antonietta
- Statistics in Medicine, Vol. 18, Issue 17-18
A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation
journal, January 2001
- Houtekamer, P. L.; Mitchell, Herschel L.
- Monthly Weather Review, Vol. 129, Issue 1
Inverse methods in hydrogeology: Evolution and recent trends
journal, January 2014
- Zhou, Haiyan; Gómez-Hernández, J. Jaime; Li, Liangping
- Advances in Water Resources, Vol. 63
Accelerating Markov Chain Monte Carlo Simulation by Differential Evolution with Self-Adaptive Randomized Subspace Sampling
journal, January 2009
- Vrugt, J. A.; ter Braak, C. J. F.; Diks, C. G. H.
- International Journal of Nonlinear Sciences and Numerical Simulation, Vol. 10, Issue 3
A Markov Chain Monte Carlo version of the genetic algorithm Differential Evolution: easy Bayesian computing for real parameter spaces
journal, September 2006
- Braak, Cajo J. F. Ter
- Statistics and Computing, Vol. 16, Issue 3
Efficient evaluation of small failure probability in high-dimensional groundwater contaminant transport modeling via a two-stage Monte Carlo method: FAILURE PROBABILITY
journal, March 2017
- Zhang, Jiangjiang; Li, Weixuan; Lin, Guang
- Water Resources Research, Vol. 53, Issue 3
A Bayesian approach to improved calibration and prediction of groundwater models with structural error
journal, November 2015
- Xu, Tianfang; Valocchi, Albert J.
- Water Resources Research, Vol. 51, Issue 11
Conceptual model uncertainty in groundwater modeling: Combining generalized likelihood uncertainty estimation and Bayesian model averaging: EVALUATING CONCEPTUAL MODEL
journal, December 2008
- Rojas, Rodrigo; Feyen, Luc; Dassargues, Alain
- Water Resources Research, Vol. 44, Issue 12
Parameter estimation by ensemble Kalman filters with transformed data: Approach and application to hydraulic tomography: PARAMETER ESTIMATION BY tEnKFs
journal, April 2012
- Schöniger, A.; Nowak, W.; Hendricks Franssen, H. -J.
- Water Resources Research, Vol. 48, Issue 4
Review of the Ensemble Kalman Filter for Atmospheric Data Assimilation
journal, December 2016
- Houtekamer, P. L.; Zhang, Fuqing
- Monthly Weather Review, Vol. 144, Issue 12
A local ensemble Kalman filter for atmospheric data assimilation
journal, October 2004
- Ott, Edward; Hunt, Brian R.; Szunyogh, Istvan
- Tellus A, Vol. 56, Issue 5
A New Approach to Linear Filtering and Prediction Problems
journal, March 1960
- Kalman, R. E.
- Journal of Basic Engineering, Vol. 82, Issue 1
Clustered iterative stochastic ensemble method for multi-modal calibration of subsurface flow models
journal, May 2013
- Elsheikh, Ahmed H.; Wheeler, Mary F.; Hoteit, Ibrahim
- Journal of Hydrology, Vol. 491
Ensemble smoother with multiple data assimilation
journal, June 2013
- Emerick, Alexandre A.; Reynolds, Albert C.
- Computers & Geosciences, Vol. 55
Ensemble smoother assimilation of hydraulic head and return flow data to estimate hydraulic conductivity distribution: HYDRAULIC HEAD AND RETURN FLOWS
journal, December 2010
- Bailey, R.; Baù, D.
- Water Resources Research, Vol. 46, Issue 12
A multimodel data assimilation framework via the ensemble Kalman filter
journal, May 2014
- Xue, Liang; Zhang, Dongxiao
- Water Resources Research, Vol. 50, Issue 5
Efficient Bayesian experimental design for contaminant source identification
journal, January 2015
- Zhang, Jiangjiang; Zeng, Lingzao; Chen, Cheng
- Water Resources Research, Vol. 51, Issue 1
Ensemble Randomized Maximum Likelihood Method as an Iterative Ensemble Smoother
journal, December 2011
- Chen, Yan; Oliver, Dean S.
- Mathematical Geosciences, Vol. 44, Issue 1
The Ensemble Kalman Filter in Reservoir Engineering--a Review
journal, September 2009
- Aanonsen, Sigurd I.; Nævdal, Geir; Oliver, Dean S.
- SPE Journal, Vol. 14, Issue 03
Equation of State Calculations by Fast Computing Machines
journal, June 1953
- Metropolis, Nicholas; Rosenbluth, Arianna W.; Rosenbluth, Marshall N.
- The Journal of Chemical Physics, Vol. 21, Issue 6
A sparse grid based Bayesian method for contaminant source identification
journal, March 2012
- Zeng, Lingzao; Shi, Liangsheng; Zhang, Dongxiao
- Advances in Water Resources, Vol. 37
Markov chain Monte Carlo simulation using the DREAM software package: Theory, concepts, and MATLAB implementation
journal, January 2016
- Vrugt, Jasper A.
- Environmental Modelling & Software, Vol. 75
An adaptive sparse-grid high-order stochastic collocation method for Bayesian inference in groundwater reactive transport modeling: Sparse-Grid Method for Bayesian Inference
journal, October 2013
- Zhang, Guannan; Lu, Dan; Ye, Ming
- Water Resources Research, Vol. 49, Issue 10
Efficient posterior exploration of a high-dimensional groundwater model from two-stage Markov chain Monte Carlo simulation and polynomial chaos expansion: Speeding up MCMC Simulation of a Groundwater Model
journal, May 2013
- Laloy, Eric; Rogiers, Bart; Vrugt, Jasper A.
- Water Resources Research, Vol. 49, Issue 5
Monte Carlo sampling methods using Markov chains and their applications
journal, April 1970
- Hastings, W. K.
- Biometrika, Vol. 57, Issue 1
History matching of facies distribution with the EnKF and level set parameterization
journal, October 2010
- Chang, Haibin; Zhang, Dongxiao; Lu, Zhiming
- Journal of Computational Physics, Vol. 229, Issue 20
History matching time-lapse seismic data using the ensemble Kalman filter with multiple data assimilations
journal, January 2012
- Emerick, Alexandre A.; Reynolds, Albert C.
- Computational Geosciences, Vol. 16, Issue 3
Ensemble Kalman filter versus ensemble smoother for assessing hydraulic conductivity via tracer test data assimilation
journal, January 2013
- Crestani, E.; Camporese, M.; Baú, D.
- Hydrology and Earth System Sciences, Vol. 17, Issue 4
Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics
journal, January 1994
- Evensen, Geir
- Journal of Geophysical Research, Vol. 99, Issue C5
Toward a nonlinear ensemble filter for high-dimensional systems: TOWARD A NONLINEAR ENSEMBLE FILTER
journal, December 2003
- Bengtsson, Thomas; Snyder, Chris; Nychka, Doug
- Journal of Geophysical Research: Atmospheres, Vol. 108, Issue D24
Estimating Channelized-Reservoir Permeabilities With the Ensemble Kalman Filter: The Importance of Ensemble Design
journal, June 2009
- Jafarpour, Behnam; McLaughlin, Dennis B.
- SPE Journal, Vol. 14, Issue 02
Inverse regression-based uncertainty quantification algorithms for high-dimensional models: Theory and practice
journal, September 2016
- Li, Weixuan; Lin, Guang; Li, Bing
- Journal of Computational Physics, Vol. 321
An Iterative Ensemble Kalman Filter for Multiphase Fluid Flow Data Assimilation
journal, November 2007
- Gu, Yaqing; Oliver, Dean S.
- SPE Journal, Vol. 12, Issue 04
An Iterative Ensemble Kalman Filter
journal, August 2011
- Lorentzen, Rolf J.; Naevdal, Geir
- IEEE Transactions on Automatic Control, Vol. 56, Issue 8
Data assimilation for transient flow in geologic formations via ensemble Kalman filter
journal, August 2006
- Chen, Yan; Zhang, Dongxiao
- Advances in Water Resources, Vol. 29, Issue 8
Multimodal ensemble Kalman filtering using Gaussian mixture models
journal, August 2010
- Dovera, Laura; Della Rossa, Ernesto
- Computational Geosciences, Vol. 15, Issue 2
Dual state–parameter estimation of hydrological models using ensemble Kalman filter
journal, February 2005
- Moradkhani, Hamid; Sorooshian, Soroosh; Gupta, Hoshin V.
- Advances in Water Resources, Vol. 28, Issue 2
An efficient two-stage Markov chain Monte Carlo method for dynamic data integration: EFFICIENT SAMPLING FOR DYNAMIC DATA INTEGRATION
journal, December 2005
- Efendiev, Y.; Datta-Gupta, A.; Ginting, V.
- Water Resources Research, Vol. 41, Issue 12
An adaptive Gaussian process-based method for efficient Bayesian experimental design in groundwater contaminant source identification problems: ADAPTIVE GAUSSIAN PROCESS-BASED INVERSION
journal, August 2016
- Zhang, Jiangjiang; Li, Weixuan; Zeng, Lingzao
- Water Resources Research, Vol. 52, Issue 8
Hydrologic Data Assimilation with the Ensemble Kalman Filter
journal, January 2002
- Reichle, Rolf H.; McLaughlin, Dennis B.; Entekhabi, Dara
- Monthly Weather Review, Vol. 130, Issue 1
The probability-distributed principle and runoff production at point and basin scales
journal, June 1985
- Moore, R. J.
- Hydrological Sciences Journal, Vol. 30, Issue 2
DRAM: Efficient adaptive MCMC
journal, December 2006
- Haario, Heikki; Laine, Marko; Mira, Antonietta
- Statistics and Computing, Vol. 16, Issue 4
Equifinality of formal (DREAM) and informal (GLUE) Bayesian approaches in hydrologic modeling?
journal, October 2008
- Vrugt, Jasper A.; ter Braak, Cajo J. F.; Gupta, Hoshin V.
- Stochastic Environmental Research and Risk Assessment, Vol. 23, Issue 7
An Adaptive Metropolis Algorithm
journal, April 2001
- Haario, Heikki; Saksman, Eero; Tamminen, Johanna
- Bernoulli, Vol. 7, Issue 2
Sequential updating of multimodal hydrogeologic parameter fields using localization and clustering techniques: LOCAL CLUSTER ENSEMBLE KALMAN FILTER
journal, July 2009
- Sun, Alexander Y.; Morris, Alan P.; Mohanty, Sitakanta
- Water Resources Research, Vol. 45, Issue 7
Assimilation of temperature into an isopycnal ocean general circulation model using a parallel ensemble Kalman filter
journal, April 2003
- Keppenne, Christian L.; Rienecker, Michele M.
- Journal of Marine Systems, Vol. 40-41
Gaussian Mixture Model-Based Ensemble Kalman Filtering for State and Parameter Estimation for a PMMA Process
journal, March 2016
- Li, Ruoxia; Prasad, Vinay; Huang, Biao
- Processes, Vol. 4, Issue 2
An approach to handling non-Gaussianity of parameters and state variables in ensemble Kalman filtering
journal, July 2011
- Zhou, Haiyan; Gómez-Hernández, J. Jaime; Hendricks Franssen, Harrie-Jan
- Advances in Water Resources, Vol. 34, Issue 7
Sequential Data Assimilation Techniques in Oceanography
journal, August 2003
- Bertino, Laurent; Evensen, Geir; Wackernagel, Hans
- International Statistical Review, Vol. 71, Issue 2