DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A new multi-model absolute difference-based sensitivity (MMADS) analysis method to screen non-influential processes under process model and parametric uncertainty

Journal Article · · Journal of Hydrology
 [1];  [2]
  1. Northwest A&F University, Shaanxi (China); Florida State Univ., Tallahassee, FL (United States); OSTI
  2. Florida State Univ., Tallahassee, FL (United States)

Process-based models have been widely used for hydrologic modeling, and it is a common practice to use sensitivity analysis methods for excluding non-influential hydrologic processes from further investigation and/or model improvement. This study develops a new method called multi-model absolute difference-based sensitivity (MMADS) analysis method to screen non-influential system processes and parameters. MMADS is conceptually similar to the Morris method for addressing parametric uncertainty, but has a unique feature to address both process model uncertainty (i.e., a process may be represented by multiple process models) and process model parameter uncertainty (i.e., parameters associated with a process model are random). MMADS first evaluates absolute differences of a quantity of interest (i.e., a system model output) by varying process models and/or process model parameter values, and then calculates the mean and variance of the differences for investigating process influence. The mean measures overall influence of the process on the quantity of interest, and the variance estimates influence of nonlinear effects of the process and/or its interactions with other processes. MMADS is an extension of the Morris method from a parameter space to a joint parameter-model space for explicitly addressing both process model uncertainty and model parameter uncertainty. The performance of MMADS is evaluated by using two numerical experiments. One experiment is based on Sobol’s G*-function with ten product elements, and has analytical solutions of the MMADS mean and variance of absolute differences. The other experiment is for groundwater flow modeling which considers three processes (i.e., recharge, geology, and snowmelt) that interact with each other. Finally, results indicate that MMADS is computationally efficient and can identify non-influential processes of complex hydrological systems.

Research Organization:
Florida State Univ., Tallahassee, FL (United States)
Sponsoring Organization:
National Science Foundation (NSF); USDOE; USDOE Office of Science (SC)
Grant/Contract Number:
SC0019438
OSTI ID:
1977304
Journal Information:
Journal of Hydrology, Journal Name: Journal of Hydrology Journal Issue: C Vol. 608; ISSN 0022-1694
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (55)

What do we mean by sensitivity analysis? The need for comprehensive characterization of “global” sensitivity in Earth and Environmental systems models: A Critical Look at Sensitivity Analysis journal May 2015
Global change and the groundwater management challenge: Groundwater Management Challenge journal May 2015
Improving the representation of hydrologic processes in Earth System Models: REPRESENTING HYDROLOGIC PROCESSES IN EARTH SYSTEM MODELS journal August 2015
A unified approach for process‐based hydrologic modeling: 1. Modeling concept journal April 2015
A unified approach for process‐based hydrologic modeling: 2. Model implementation and case studies journal April 2015
A new framework for comprehensive, robust, and efficient global sensitivity analysis: 2. Application journal January 2016
Quantifying the importance of spatial resolution and other factors through global sensitivity analysis of a flood inundation model: GSA OF A FLOOD INUNDATION MODEL journal November 2016
A new process sensitivity index to identify important system processes under process model and parametric uncertainty: MULTIMODEL PROCESS SENSITIVITY ANALYSIS journal April 2017
A geostatistics-informed hierarchical sensitivity analysis method for complex groundwater flow and transport modeling: GEOSTATISTICAL SENSITIVITY ANALYSIS journal May 2017
Multicriteria sensitivity analysis as a diagnostic tool for understanding model behaviour and characterizing model uncertainty journal October 2017
Time-varying sensitivity analysis clarifies the effects of watershed model formulation on model behavior: TIME-VARYING SENSITIVITY OF WATERSHED MODELS journal March 2013
Enhanced Morris method for global sensitivity analysis: good proxy of Sobol’ index journal September 2018
Maximum likelihood Bayesian averaging of uncertain model predictions journal November 2003
The conceptualization model problem?surprise journal February 2005
Temperature index melt modelling in mountain areas journal November 2003
Making sense of global sensitivity analyses journal April 2014
Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index journal February 2010
Use of sensitivity analysis to identify influential and non-influential parameters within an aquatic ecosystem model journal November 2012
Sensitivity analysis of a sensitivity analysis: We are likely overlooking the impact of distributional assumptions journal November 2016
Identifying key factors of the seawater intrusion model of Dagu river basin, Jiaozhou Bay journal August 2018
An effective screening design for sensitivity analysis of large models journal October 2007
Convergence and uncertainty analyses in Monte-Carlo based sensitivity analysis journal April 2011
A General Probabilistic Framework for uncertainty and global sensitivity analysis of deterministic models: A hydrological case study journal January 2014
Sensitivity analysis of environmental models: A systematic review with practical workflow journal May 2016
Global sensitivity analysis for high-dimensional problems: How to objectively group factors and measure robustness and convergence while reducing computational cost journal January 2019
A sensitivity analysis of the PAWN sensitivity index journal May 2020
The Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support journal March 2021
Constructive epistemic modeling of groundwater flow with geological structure and boundary condition uncertainty under the Bayesian paradigm journal September 2014
A qualitative model structure sensitivity analysis method to support model selection journal November 2014
Global sensitivity analysis in hydrological modeling: Review of concepts, methods, theoretical framework, and applications journal April 2015
Variance-based global sensitivity analysis for multiple scenarios and models with implementation using sparse grid collocation journal September 2015
Maximum likelihood Bayesian model averaging and its predictive analysis for groundwater reactive transport models journal October 2015
Estimating the approximation error when fixing unessential factors in global sensitivity analysis journal July 2007
Maximum likelihood Bayesian averaging of spatial variability models in unsaturated fractured tuff: MAXIMUM LIKELIHOOD BAYESIAN MODEL AVERAGING journal May 2004
Framework for Understanding Structural Errors (FUSE): A modular framework to diagnose differences between hydrological models: DIFFERENCES BETWEEN HYDROLOGICAL MODELS journal August 2008
Parameter Sensitivity Analysis for Computationally Intensive Spatially Distributed Dynamical Environmental Systems Models journal September 2019
Using Bayesian Networks for Sensitivity Analysis of Complex Biogeochemical Models journal April 2019
Global Sensitivity Analysis for Multiple Interpretive Models With Uncertain Parameters journal February 2020
VISCOUS: A Variance‐Based Sensitivity Analysis Using Copulas for Efficient Identification of Dominant Hydrological Processes journal July 2021
A simple energy budget algorithm for the snowmelt runoff model journal May 1994
Factorial Sampling Plans for Preliminary Computational Experiments journal May 1991
Sensitivity analysis approaches to high-dimensional screening problems at low sample size journal April 2018
Sensitivity measures,anova-like Techniques and the use of bootstrap journal May 1997
A Hierarchical Bayesian Model Averaging Framework for Groundwater Prediction under Uncertainty journal May 2014
Evaluating Groundwater Interbasin Flow Using Multiple Models and Multiple Types of Data: Groundwater XX, no. XX: XX-XX journal April 2016
From Models to Performance Assessment: The Conceptualization Problem journal September 2003
Multimodel Ranking and Inference in Ground Water Modeling journal July 2005
A Model-Averaging Method for Assessing Groundwater Conceptual Model Uncertainty journal August 2010
Hydrologic modeling: progress and future directions journal May 2018
SALib: An open-source Python library for Sensitivity Analysis journal January 2017
Sensitivity analysis of hydrological models: review and way forward journal June 2017
Sensitivity analysis of the CLARA Simplified Planning Tool using the Morris screening method journal December 2014
Towards simplification of hydrologic modeling: identification of dominant processes journal January 2016
Simultaneously determining global sensitivities of model parameters and model structure journal January 2020
Process-based modelling to evaluate simulated groundwater levels and frequencies in a Chalk catchment in south-western England journal January 2018