Bayesian calibration of terrestrial ecosystem models: a study of advanced Markov chain Monte Carlo methods
Abstract
Calibration of terrestrial ecosystem models is important but challenging. Bayesian inference implemented by Markov chain Monte Carlo (MCMC) sampling provides a comprehensive framework to estimate model parameters and associated uncertainties using their posterior distributions. The effectiveness and efficiency of the method strongly depend on the MCMC algorithm used. In this work, a differential evolution adaptive Metropolis (DREAM) algorithm is used to estimate posterior distributions of 21 parameters for the data assimilation linked ecosystem carbon (DALEC) model using 14 years of daily net ecosystem exchange data collected at the Harvard Forest Environmental Measurement Site eddy-flux tower. The calibration of DREAM results in a better model fit and predictive performance compared to the popular adaptive Metropolis (AM) scheme. Moreover, DREAM indicates that two parameters controlling autumn phenology have multiple modes in their posterior distributions while AM only identifies one mode. The application suggests that DREAM is very suitable to calibrate complex terrestrial ecosystem models, where the uncertain parameter size is usually large and existence of local optima is always a concern. In addition, this effort justifies the assumptions of the error model used in Bayesian calibration according to the residual analysis. Here, the result indicates that a heteroscedastic, correlated, Gaussian error model ismore »
- Authors:
-
[1];
[1];
[1];
[3]
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
- Sandia National Lab. (SNL-CA), Livermore, CA (United States)
- Harvard Univ., Cambridge, MA (United States)
- Publication Date:
- Research Org.:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), Biological and Environmental Research (BER)
- OSTI Identifier:
- 1399968
- Grant/Contract Number:
- AC05-00OR22725
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Biogeosciences (Online)
- Additional Journal Information:
- Journal Name: Biogeosciences (Online); Journal Volume: 14; Journal Issue: 18; Journal ID: ISSN 1726-4189
- Publisher:
- European Geosciences Union
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 54 ENVIRONMENTAL SCIENCES
Citation Formats
Lu, Dan, Ricciuto, Daniel M., Walker, Anthony P., Safta, Cosmin, and Munger, William. Bayesian calibration of terrestrial ecosystem models: a study of advanced Markov chain Monte Carlo methods. United States: N. p., 2017.
Web. doi:10.5194/bg-14-4295-2017.
Lu, Dan, Ricciuto, Daniel M., Walker, Anthony P., Safta, Cosmin, & Munger, William. Bayesian calibration of terrestrial ecosystem models: a study of advanced Markov chain Monte Carlo methods. United States. https://doi.org/10.5194/bg-14-4295-2017
Lu, Dan, Ricciuto, Daniel M., Walker, Anthony P., Safta, Cosmin, and Munger, William. Wed .
"Bayesian calibration of terrestrial ecosystem models: a study of advanced Markov chain Monte Carlo methods". United States. https://doi.org/10.5194/bg-14-4295-2017. https://www.osti.gov/servlets/purl/1399968.
@article{osti_1399968,
title = {Bayesian calibration of terrestrial ecosystem models: a study of advanced Markov chain Monte Carlo methods},
author = {Lu, Dan and Ricciuto, Daniel M. and Walker, Anthony P. and Safta, Cosmin and Munger, William},
abstractNote = {Calibration of terrestrial ecosystem models is important but challenging. Bayesian inference implemented by Markov chain Monte Carlo (MCMC) sampling provides a comprehensive framework to estimate model parameters and associated uncertainties using their posterior distributions. The effectiveness and efficiency of the method strongly depend on the MCMC algorithm used. In this work, a differential evolution adaptive Metropolis (DREAM) algorithm is used to estimate posterior distributions of 21 parameters for the data assimilation linked ecosystem carbon (DALEC) model using 14 years of daily net ecosystem exchange data collected at the Harvard Forest Environmental Measurement Site eddy-flux tower. The calibration of DREAM results in a better model fit and predictive performance compared to the popular adaptive Metropolis (AM) scheme. Moreover, DREAM indicates that two parameters controlling autumn phenology have multiple modes in their posterior distributions while AM only identifies one mode. The application suggests that DREAM is very suitable to calibrate complex terrestrial ecosystem models, where the uncertain parameter size is usually large and existence of local optima is always a concern. In addition, this effort justifies the assumptions of the error model used in Bayesian calibration according to the residual analysis. Here, the result indicates that a heteroscedastic, correlated, Gaussian error model is appropriate for the problem, and the consequent constructed likelihood function can alleviate the underestimation of parameter uncertainty that is usually caused by using uncorrelated error models.},
doi = {10.5194/bg-14-4295-2017},
journal = {Biogeosciences (Online)},
number = 18,
volume = 14,
place = {United States},
year = {Wed Sep 27 00:00:00 EDT 2017},
month = {Wed Sep 27 00:00:00 EDT 2017}
}
Free Publicly Available Full Text
Publisher's Version of Record
Other availability
Search WorldCat to find libraries that may hold this journal
Cited by: 24 works
Citation information provided by
Web of Science
Web of Science
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
The REFLEX project: Comparing different algorithms and implementations for the inversion of a terrestrial ecosystem model against eddy covariance data
journal, October 2009
- Fox, Andrew; Williams, Mathew; Richardson, Andrew D.
- Agricultural and Forest Meteorology, Vol. 149, Issue 10
Inference from Iterative Simulation Using Multiple Sequences
journal, November 1992
- Gelman, Andrew; Rubin, Donald B.
- Statistical Science, Vol. 7, Issue 4
Practical Markov Chain Monte Carlo
journal, November 1992
- Geyer, Charles J.
- Statistical Science, Vol. 7, Issue 4
Treatment of input uncertainty in hydrologic modeling: Doing hydrology backward with Markov chain Monte Carlo simulation: FORCING DATA ERROR USING MCMC SAMPLING
journal, December 2008
- Vrugt, Jasper A.; ter Braak, Cajo J. F.; Clark, Martyn P.
- Water Resources Research, Vol. 44, Issue 12
Adaptive proposal distribution for random walk Metropolis algorithm
journal, September 1999
- Haario, Heikki; Saksman, Eero; Tamminen, Johanna
- Computational Statistics, Vol. 14, Issue 3
Bayesian Posterior Predictive Checks for Complex Models
journal, February 2004
- Lynch, Scott M.; Western, Bruce
- Sociological Methods & Research, Vol. 32, Issue 3
Componentwise adaptation for high dimensional MCMC
journal, June 2005
- Haario, Heikki; Saksman, Eero; Tamminen, Johanna
- Computational Statistics, Vol. 20, Issue 2
Relative information contributions of model vs. data to short- and long-term forecasts of forest carbon dynamics
journal, July 2011
- Weng, Ensheng; Luo, Yiqi
- Ecological Applications, Vol. 21, Issue 5
Phenology of a northern hardwood forest canopy
journal, July 2006
- Richardson, Andrew D.; Bailey, Amey Schenck; Denny, Ellen G.
- Global Change Biology, Vol. 12, Issue 7
Accelerating Markov Chain Monte Carlo Simulation by Differential Evolution with Self-Adaptive Randomized Subspace Sampling
journal, January 2009
- Vrugt, J. A.; ter Braak, C. J. F.; Diks, C. G. H.
- International Journal of Nonlinear Sciences and Numerical Simulation, Vol. 10, Issue 3
A Markov Chain Monte Carlo version of the genetic algorithm Differential Evolution: easy Bayesian computing for real parameter spaces
journal, September 2006
- Braak, Cajo J. F. Ter
- Statistics and Computing, Vol. 16, Issue 3
Monte Carlo Statistical Methods
book, January 2004
- Robert, Christian P.; Casella, George
- Springer Texts in Statistics
Strictly Proper Scoring Rules, Prediction, and Estimation
journal, March 2007
- Gneiting, Tilmann; Raftery, Adrian E.
- Journal of the American Statistical Association, Vol. 102, Issue 477
Propagule Dispersal in Marine and Terrestrial Environments: a Community Perspective
journal, August 2003
- Kinlan, Brian P.; Gaines, Steven D.
- Ecology, Vol. 84, Issue 8
Uncertainties in global terrestrial biosphere modeling: 1. A comprehensive sensitivity analysis with a new photosynthesis and energy balance scheme
journal, March 2001
- Knorr, Wolfgang; Heimann, Martin
- Global Biogeochemical Cycles, Vol. 15, Issue 1
Net carbon uptake has increased through warming-induced changes in temperate forest phenology
journal, June 2014
- Keenan, Trevor F.; Gray, Josh; Friedl, Mark A.
- Nature Climate Change, Vol. 4, Issue 7
A Statistical Perspective on Ill-Posed Inverse Problems
journal, November 1986
- O'Sullivan, Finbarr
- Statistical Science, Vol. 1, Issue 4
Rate my data: quantifying the value of ecological data for the development of models of the terrestrial carbon cycle
journal, January 2013
- Keenan, Trevor F.; Davidson, Eric A.; Munger, J. William
- Ecological Applications, Vol. 23, Issue 1
An improved analysis of forest carbon dynamics using data assimilation
journal, January 2005
- Williams, Mathew; Schwarz, Paul A.; Law, Beverly E.
- Global Change Biology, Vol. 11, Issue 1
Analysis of regression confidence intervals and Bayesian credible intervals for uncertainty quantification: REGRESSION CONFIDENCE AND BAYESIAN CREDIBLE INTERVALS
journal, September 2012
- Lu, Dan; Ye, Ming; Hill, Mary C.
- Water Resources Research, Vol. 48, Issue 9
The distribution of body size in a stream community: one system, many patterns
journal, May 2005
- Stead, Tracey K.; Schmid-Araya, Jenny M.; Schmid, Peter E.
- Journal of Animal Ecology, Vol. 74, Issue 3
Markov chain Monte Carlo simulation using the DREAM software package: Theory, concepts, and MATLAB implementation
journal, January 2016
- Vrugt, Jasper A.
- Environmental Modelling & Software, Vol. 75
An adaptive sparse-grid high-order stochastic collocation method for Bayesian inference in groundwater reactive transport modeling: Sparse-Grid Method for Bayesian Inference
journal, October 2013
- Zhang, Guannan; Lu, Dan; Ye, Ming
- Water Resources Research, Vol. 49, Issue 10
A formal likelihood function for parameter and predictive inference of hydrologic models with correlated, heteroscedastic, and non‐Gaussian errors
journal, October 2010
- Schoups, Gerrit; Vrugt, Jasper A.
- Water Resources Research, Vol. 46, Issue 10
A computer program for uncertainty analysis integrating regression and Bayesian methods
journal, October 2014
- Lu, Dan; Ye, Ming; Hill, Mary C.
- Environmental Modelling & Software, Vol. 60
Global sensitivity analysis, probabilistic calibration, and predictive assessment for the data assimilation linked ecosystem carbon model
journal, January 2015
- Safta, C.; Ricciuto, D. M.; Sargsyan, K.
- Geoscientific Model Development, Vol. 8, Issue 7
Modelling the soil-plant-atmosphere continuum in a Quercus-Acer stand at Harvard Forest: the regulation of stomatal conductance by light, nitrogen and soil/plant hydraulic properties
journal, August 1996
- Williams, M.; Rastetter, E. B.; Fernandes, D. N.
- Plant, Cell and Environment, Vol. 19, Issue 8
Variational Assimilation of Meteorological Observations With the Adjoint Vorticity Equation. I: Theory
journal, October 1987
- Talagrand, Olivier; Courtier, Philippe
- Quarterly Journal of the Royal Meteorological Society, Vol. 113, Issue 478
Estimation of ECHAM5 climate model closure parameters with adaptive MCMC
journal, January 2010
- Järvinen, H.; Räisänen, P.; Laine, M.
- Atmospheric Chemistry and Physics, Vol. 10, Issue 20
The use of CO2 flux time series for parameter and carbon stock estimation in carbon cycle research
journal, September 2011
- Hill, Timothy Charles; Ryan, Edmund; Williams, Mathew
- Global Change Biology, Vol. 18, Issue 1
Markov Chains for Exploring Posterior Distributions
journal, December 1994
- Tierney, Luke
- The Annals of Statistics, Vol. 22, Issue 4
High-dimensional posterior exploration of hydrologic models using multiple-try DREAM (ZS) and high-performance computing : EFFICIENT MCMC FOR HIGH-DIMENSIONAL PROBLEMS
journal, January 2012
- Laloy, Eric; Vrugt, Jasper A.
- Water Resources Research, Vol. 48, Issue 1
OptIC project: An intercomparison of optimization techniques for parameter estimation in terrestrial biogeochemical models
journal, January 2007
- Trudinger, Cathy M.; Raupach, Michael R.; Rayner, Peter J.
- Journal of Geophysical Research, Vol. 112, Issue G2
Towards a standardized processing of Net Ecosystem Exchange measured with eddy covariance technique: algorithms and uncertainty estimation
journal, January 2006
- Papale, D.; Reichstein, M.; Aubinet, M.
- Biogeosciences, Vol. 3, Issue 4
Bayesian statistical data assimilation for ecosystem models using Markov Chain Monte Carlo
journal, December 2007
- Dowd, Michael
- Journal of Marine Systems, Vol. 68, Issue 3-4
Dimensionality Reduction for Complex Models via Bayesian Compressive Sensing
journal, January 2014
- Sargsyan, Khachik; Safta, Cosmin; Najm, Habib N.
- International Journal for Uncertainty Quantification, Vol. 4, Issue 1
DRAM: Efficient adaptive MCMC
journal, December 2006
- Haario, Heikki; Laine, Marko; Mira, Antonietta
- Statistics and Computing, Vol. 16, Issue 4
Equifinality of formal (DREAM) and informal (GLUE) Bayesian approaches in hydrologic modeling?
journal, October 2008
- Vrugt, Jasper A.; ter Braak, Cajo J. F.; Gupta, Hoshin V.
- Stochastic Environmental Research and Risk Assessment, Vol. 23, Issue 7
A primer for data assimilation with ecological models using Markov Chain Monte Carlo (MCMC)
journal, August 2011
- Zobitz, J. M.; Desai, A. R.; Moore, D. J. P.
- Oecologia, Vol. 167, Issue 3
An Adaptive Metropolis Algorithm
journal, April 2001
- Haario, Heikki; Saksman, Eero; Tamminen, Johanna
- Bernoulli, Vol. 7, Issue 2
Parameterization and Sensitivity Analysis of the BIOME–BGC Terrestrial Ecosystem Model: Net Primary Production Controls
journal, January 2000
- White, Michael A.; Thornton, Peter E.; Running, Steven W.
- Earth Interactions, Vol. 4, Issue 3
Estimating parameters of a forest ecosystem C model with measurements of stocks and fluxes as joint constraints
journal, April 2010
- Richardson, Andrew D.; Williams, Mathew; Hollinger, David Y.
- Oecologia, Vol. 164, Issue 1
Estimating diurnal to annual ecosystem parameters by synthesis of a carbon flux model with eddy covariance net ecosystem exchange observations
journal, February 2005
- Braswell, Bobby H.; Sacks, William J.; Linder, Ernst
- Global Change Biology, Vol. 11, Issue 2
Multimodality in the individual size distributions of bird communities: Avian individual size distributions
journal, December 2010
- Thibault, Katherine M.; White, Ethan P.; Hurlbert, Allen H.
- Global Ecology and Biogeography, Vol. 20, Issue 1
Parameter optimisation and uncertainty assessment for large-scale streamflow simulation with the LISFLOOD model
journal, January 2007
- Feyen, Luc; Vrugt, Jasper A.; Nualláin, Breanndán Ó
- Journal of Hydrology, Vol. 332, Issue 3-4
Dynamics of global forest area: Results from the FAO Global Forest Resources Assessment 2015
journal, September 2015
- Keenan, Rodney J.; Reams, Gregory A.; Achard, Frédéric
- Forest Ecology and Management, Vol. 352
Effects of error covariance structure on estimation of model averaging weights and predictive performance: EFFECTS OF ERROR COVARIANCE STRUCTURE ON MODEL AVERAGING
journal, September 2013
- Lu, Dan; Ye, Ming; Meyer, Philip D.
- Water Resources Research, Vol. 49, Issue 9
Parameter and prediction uncertainty in an optimized terrestrial carbon cycle model: Effects of constraining variables and data record length
journal, January 2011
- Ricciuto, Daniel M.; King, Anthony W.; Dragoni, D.
- Journal of Geophysical Research, Vol. 116, Issue G1
General Methods for Monitoring Convergence of Iterative Simulations
journal, December 1998
- Brooks, Stephen P.; Gelman, Andrew
- Journal of Computational and Graphical Statistics, Vol. 7, Issue 4
Evaluation and improvement of a global land model against soil carbon data using a Bayesian Markov chain Monte Carlo method: Calibration of a carbon cycle model
journal, March 2014
- Hararuk, Oleksandra; Xia, Jianyang; Luo, Yiqi
- Journal of Geophysical Research: Biogeosciences, Vol. 119, Issue 3
Estimation of Community Land Model parameters for an improved assessment of net carbon fluxes at European sites: Estimation of CLM Parameters
journal, March 2017
- Post, Hanna; Vrugt, Jasper A.; Fox, Andrew
- Journal of Geophysical Research: Biogeosciences, Vol. 122, Issue 3
Two decades of terrestrial carbon fluxes from a carbon cycle data assimilation system (CCDAS): CARBON FLUXES FROM DATA ASSIMILATION SYSTEM
journal, June 2005
- Rayner, P. J.; Scholze, M.; Knorr, W.
- Global Biogeochemical Cycles, Vol. 19, Issue 2
A Bayesian calibration of a simple carbon cycle model: The role of observations in estimating and reducing uncertainty: BAYESIAN CARBON CYCLE MODEL CALIBRATION
journal, June 2008
- Ricciuto, Daniel M.; Davis, Kenneth J.; Keller, Klaus
- Global Biogeochemical Cycles, Vol. 22, Issue 2
Factors controlling CO 2 exchange on timescales from hourly to decadal at Harvard Forest
journal, January 2007
- Urbanski, S.; Barford, C.; Wofsy, S.
- Journal of Geophysical Research, Vol. 112, Issue G2
On the capability of Monte Carlo and adjoint inversion techniques to derive posterior parameter uncertainties in terrestrial ecosystem models: COMPARISON OF INVERSION TECHNIQUES
journal, September 2012
- Ziehn, T.; Scholze, M.; Knorr, W.
- Global Biogeochemical Cycles, Vol. 26, Issue 3
Response to comment by Keith Beven on “Equifinality of formal (DREAM) and informal (GLUE) Bayesian approaches in hydrologic modeling?”
journal, October 2008
- Vrugt, Jasper A.; ter Braak, Cajo J. F.; Gupta, Hoshin V.
- Stochastic Environmental Research and Risk Assessment, Vol. 23, Issue 7
The REFLEX project: Comparing different algorithms and implementations for the inversion of a terrestrial ecosystem model against eddy covariance data
journal, October 2009
- Fox, Andrew; Williams, Mathew; Richardson, Andrew D.
- Agricultural and Forest Meteorology, Vol. 149, Issue 10
Bayesian calibration and uncertainty analysis of hydrological models: A comparison of adaptive Metropolis and sequential Monte Carlo samplers: BAYESIAN CALIBRATION AND UNCERTAINTY ANALYSIS
journal, July 2011
- Jeremiah, Erwin; Sisson, Scott; Marshall, Lucy
- Water Resources Research, Vol. 47, Issue 7
Propagule Dispersal in Marine and Terrestrial Environments: a Community Perspective
journal, August 2003
- Kinlan, Brian P.; Gaines, Steven D.
- Ecology, Vol. 84, Issue 8
An Adaptive Metropolis Algorithm
journal, April 2001
- Haario, Heikki; Saksman, Eero; Tamminen, Johanna
- Bernoulli, Vol. 7, Issue 2
Towards a standardized processing of Net Ecosystem Exchange measured with eddy covariance technique: algorithms and uncertainty estimation
journal, January 2006
- Papale, D.; Reichstein, M.; Aubinet, M.
- Biogeosciences, Vol. 3, Issue 4
Works referencing / citing this record:
Improving probabilistic hydroclimatic projections through high-resolution convection-permitting climate modeling and Markov chain Monte Carlo simulations
journal, March 2019
- Wang, S.; Wang, Y.
- Climate Dynamics, Vol. 53, Issue 3-4
A semiempirical model for horizontal distribution of surface wind speed leeward windbreaks
journal, July 2019
- Yuan, Fenghui; Wu, Jiabing; Wang, Anzhi
- Agroforestry Systems, Vol. 94, Issue 2
Efficient surrogate modeling methods for large-scale Earth system models based on machine-learning techniques
journal, January 2019
- Lu, Dan; Ricciuto, Daniel
- Geoscientific Model Development, Vol. 12, Issue 5
Linking big models to big data: efficient ecosystem model calibration through Bayesian model emulation
journal, January 2018
- Fer, Istem; Kelly, Ryan; Moorcroft, Paul R.
- Biogeosciences, Vol. 15, Issue 19