Hohai Univ., Nanjing (China). Center for Global Change and Water Cycle, State Key Lab. of Hydrology-Water Resources and Hydraulic Engineering; Australian National Univ., Canberra, ACT (Australia). Inst. for Water Futures
Australian National Univ., Canberra, ACT (Australia). Inst. for Water Futures
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Hohai Univ., Nanjing (China). Center for Global Change and Water Cycle, State Key Lab. of Hydrology-Water Resources and Hydraulic Engineering
Australian National Univ., Canberra, ACT (Australia). Inst. for Water Futures; Australian National Univ., Canberra, ACT (Australia). Mathematical Sciences Inst.
Despite widespread use of factor fixing in environmental modeling, its effect on model predictions has received little attention and is instead commonly presumed to be negligible. We propose a proof-of-concept adaptive method for systematically investigating the impact of factor fixing. The method uses Global Sensitivity Analysis methods to identify groups of sensitive parameters, then quantifies which groups can be safely fixed at nominal values without exceeding a maximum acceptable error, demonstrated using the 21-dimensional Sobol’ G-function. Furthermore, three error measures are considered for quantities of interest, namely Relative Mean Absolute Error, Pearson Product-Moment Correlation and Relative Variance. Results demonstrate that factor fixing may cause large errors in the model results unexpectedly, when preliminary analysis suggests otherwise, and that the default value selected affects the number of factors to fix. To improve the applicability and methodological development of factor fixing, a new research agenda encompassing five opportunities is discussed for further attention.
Wang, Qian, et al. "Assessing the predictive impact of factor fixing with an adaptive uncertainty-based approach .." Environmental Modelling and Software, vol. 148, Dec. 2021. https://doi.org/10.1016/j.envsoft.2021.105290
Wang, Qian, Guillaume, Joseph, Jakeman, John, et al., "Assessing the predictive impact of factor fixing with an adaptive uncertainty-based approach .," Environmental Modelling and Software 148 (2021), https://doi.org/10.1016/j.envsoft.2021.105290
@article{osti_1845388,
author = {Wang, Qian and Guillaume, Joseph and Jakeman, John and Yang, Tao and Iwanaga, Takuya and Croke, Barry and Jakeman, Tony},
title = {Assessing the predictive impact of factor fixing with an adaptive uncertainty-based approach .},
annote = {Despite widespread use of factor fixing in environmental modeling, its effect on model predictions has received little attention and is instead commonly presumed to be negligible. We propose a proof-of-concept adaptive method for systematically investigating the impact of factor fixing. The method uses Global Sensitivity Analysis methods to identify groups of sensitive parameters, then quantifies which groups can be safely fixed at nominal values without exceeding a maximum acceptable error, demonstrated using the 21-dimensional Sobol’ G-function. Furthermore, three error measures are considered for quantities of interest, namely Relative Mean Absolute Error, Pearson Product-Moment Correlation and Relative Variance. Results demonstrate that factor fixing may cause large errors in the model results unexpectedly, when preliminary analysis suggests otherwise, and that the default value selected affects the number of factors to fix. To improve the applicability and methodological development of factor fixing, a new research agenda encompassing five opportunities is discussed for further attention.},
doi = {10.1016/j.envsoft.2021.105290},
url = {https://www.osti.gov/biblio/1845388},
journal = {Environmental Modelling and Software},
issn = {ISSN 1364-8152},
volume = {148},
place = {United States},
publisher = {Elsevier},
year = {2021},
month = {12}}
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Organization:
USDOE National Nuclear Security Administration (NNSA); Australian Research Council (ARC); National Natural Science Foundation of China (NSFC); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
Grant/Contract Number:
NA0003525; DE190100317; 51879068; NA-0003525
OSTI ID:
1845388
Alternate ID(s):
OSTI ID: 1868839
Report Number(s):
SAND2022-1273J; 703223
Journal Information:
Environmental Modelling and Software, Vol. 148; ISSN 1364-8152