skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: The multi-assumption architecture and testbed (MAAT v1.0): R code for generating ensembles with dynamic model structure and analysis of epistemic uncertainty from multiple sources

Journal Article · · Geoscientific Model Development (Online)

Abstract. Computer models are ubiquitous tools used to represent systems across many scientific and engineering domains. For any given system, many computer models exist, each built on different assumptions and demonstrating variability in the ways in which these systems can be represented. This variability is known as epistemic uncertainty, i.e. uncertainty in our knowledge of how these systems operate. Two primary sources of epistemic uncertainty are (1) uncertain parameter values and (2) uncertain mathematical representations of the processes that comprise the system. Many formal methods exist to analyse parameter-based epistemic uncertainty, while process-representation-based epistemic uncertainty is often analysed post hoc, incompletely, informally, or is ignored. In this model description paper we present the multi-assumption architecture and testbed (MAAT v1.0) designed to formally and completely analyse process-representation-based epistemic uncertainty. MAAT is a modular modelling code that can simply and efficiently vary model structure (process representation), allowing for the generation and running of large model ensembles that vary in process representation, parameters, parameter values, and environmental conditions during a single execution of the code. MAAT v1.0 approaches epistemic uncertainty through sensitivity analysis, assigning variability in model output to processes (process representation and parameters) or to individual parameters. In this model description paper we describe MAAT and, by using a simple groundwater model example, verify that the sensitivity analysis algorithms have been correctly implemented. The main system model currently coded in MAAT is a unified, leaf-scale enzyme kinetic model of C3 photosynthesis. In the Appendix we describe the photosynthesis model and the unification of multiple representations of photosynthetic processes. The numerical solution to leaf-scale photosynthesis is verified and examples of process variability in temperature response functions are provided. For rapid application to new systems, the MAAT algorithms for efficient variation of model structure and sensitivity analysis are agnostic of the specific system model employed. Therefore MAAT provides a tool for the development of novel or toy models in many domains, i.e. not only photosynthesis, facilitating rapid informal and formal comparison of alternative modelling approaches.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States); Brookhaven National Laboratory (BNL), Upton, NY (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Biological and Environmental Research (BER)
Grant/Contract Number:
AC05-00OR22725; SC0012704
OSTI ID:
1465033
Alternate ID(s):
OSTI ID: 1466608
Report Number(s):
BNL-207962-2018-JAAM
Journal Information:
Geoscientific Model Development (Online), Vol. 11, Issue 8; ISSN 1991-9603
Publisher:
European Geosciences UnionCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 11 works
Citation information provided by
Web of Science

References (84)

A unified approach for process‐based hydrologic modeling: 1. Modeling concept journal April 2015
Forest water use and water use efficiency at elevated CO 2 : a model-data intercomparison at two contrasting temperate forest FACE sites journal March 2013
Climate model genealogy: CLIMATE MODEL GENEALOGY journal April 2011
Using ecosystem experiments to improve vegetation models journal May 2015
A simulation model for the transient effects of climate change on forest landscapes journal January 1993
Impacts of trait variation through observed trait–climate relationships on performance of an Earth system model: a conceptual analysis journal January 2013
Resistances along the CO2 diffusion pathway inside leaves journal April 2009
Tracking the origins of the Kok effect, 70 years after its discovery journal March 2017
Improving canopy processes in the Community Land Model version 4 (CLM4) using global flux fields empirically inferred from FLUXNET data journal January 2011
Variance-based global sensitivity analysis for multiple scenarios and models with implementation using sparse grid collocation journal September 2015
What do we mean by sensitivity analysis? The need for comprehensive characterization of “global” sensitivity in Earth and Environmental systems models: A Critical Look at Sensitivity Analysis journal May 2015
Reliable estimation of biochemical parameters from C3 leaf photosynthesis-intercellular carbon dioxide response curves: Estimating FvCB model parameters journal June 2010
Optimal plant water economy: Optimal plant water economy journal October 2016
Conceptual model uncertainty in groundwater modeling: Combining generalized likelihood uncertainty estimation and Bayesian model averaging: EVALUATING CONCEPTUAL MODEL journal December 2008
A new process sensitivity index to identify important system processes under process model and parametric uncertainty: MULTIMODEL PROCESS SENSITIVITY ANALYSIS journal April 2017
A framework for dealing with uncertainty due to model structure error journal November 2006
Optimum Aerodynamic Design Using the Navier-Stokes Equations journal January 1998
Separating the diffuse and direct component of global radiation and its implications for modeling canopy photosynthesis Part II. Calculation of canopy photosynthesis journal October 1986
Biophysical drivers of seasonal variability in Sphagnum gross primary production in a northern temperate bog journal May 2017
The Influence of Light and Carbon Dioxide on Photosynthesis journal July 1937
Global sensitivity analysis in hydrological modeling: Review of concepts, methods, theoretical framework, and applications journal April 2015
Application of Bayesian Model Averaging in the Reconstruction of Past Climate Change Using PMIP3/CMIP5 Multimodel Ensemble Simulations journal January 2016
Biochemical Limitations to Carbon Assimilation in C 3 Plants—A Retrospective Analysis of the A/C i Curves from 109 Species journal January 1993
Models of soil organic matter decomposition: the SoilR package, version 1.0 journal January 2012
Modelling photosynthesis of cotton grown in elevated CO2 journal April 1992
Photosynthesis and nitrogen relationships in leaves of C3 plants journal January 1989
Reconciling the optimal and empirical approaches to modelling stomatal conductance: RECONCILING OPTIMAL AND EMPIRICAL STOMATAL MODELS journal January 2011
Selecting a climate model subset to optimise key ensemble properties journal January 2018
A Model Predicting Stomatal Conductance and its Contribution to the Control of Photosynthesis under Different Environmental Conditions book January 1987
A roadmap for improving the representation of photosynthesis in Earth system models journal November 2016
A manifesto for the equifinality thesis journal March 2006
Managing complexity in simulations of land surface and near-surface processes journal April 2016
Challenges in Combining Projections from Multiple Climate Models journal May 2010
The use of the multi-model ensemble in probabilistic climate projections
  • Tebaldi, Claudia; Knutti, Reto
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 365, Issue 1857 https://doi.org/10.1098/rsta.2007.2076
journal June 2007
Towards a comprehensive assessment of model structural adequacy: ASSESSMENT OF MODEL STRUCTURAL ADEQUACY journal August 2012
GSSHA: Model To Simulate Diverse Stream Flow Producing Processes journal May 2004
Modelling respiration of vegetation: evidence for a general temperature-dependent Q10 journal February 2001
The relationship of leaf photosynthetic traits - V cmax and J max - to leaf nitrogen, leaf phosphorus, and specific leaf area: a meta-analysis and modeling study journal July 2014
Plant responses to increasing CO 2 reduce estimates of climate impacts on drought severity journal August 2016
Analysis of variance designs for model output journal March 1999
An analytical solution for coupled leaf photosynthesis and stomatal conductance models journal July 1994
Spatiotemporal patterns of terrestrial gross primary production: A review: GPP Spatiotemporal Patterns journal August 2015
Physiological and environmental regulation of stomatal conductance, photosynthesis and transpiration: a model that includes a laminar boundary layer journal April 1991
A simple calibrated model of Amazon rainforest productivity based on leaf biochemical properties journal October 1995
Uncertainties in CMIP5 Climate Projections due to Carbon Cycle Feedbacks journal January 2014
The Coordination of Leaf Photosynthesis Links C and N Fluxes in C3 Plant Species journal June 2012
Optimal stomatal behavior with competition for water and risk of hydraulic impairment journal October 2016
Facets of uncertainty: epistemic uncertainty, non-stationarity, likelihood, hypothesis testing, and communication journal May 2016
Changes in the chloroplastic CO 2 concentration explain much of the observed Kok effect: a model journal March 2017
The ECMWF Ensemble Prediction System: Methodology and validation journal January 1996
Temperature response of parameters of a biochemically based model of photosynthesis. II. A review of experimental data journal September 2002
Temperature responses of mesophyll conductance differ greatly between species: Temperature responses of mesophyll conductance journal October 2014
Effects of parameter uncertainties on the modeling of terrestrial biosphere dynamics: PARAMETER-BASED UNCERTAINTY OF A DGVM journal September 2005
Coupled response of stomatal and mesophyll conductance to light enhances photosynthesis of shade leaves under sunflecks: Mesophyll conductance response to light journal November 2016
The Twentieth Century Reanalysis Project
  • Compo, G. P.; Whitaker, J. S.; Sardeshmukh, P. D.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 137, Issue 654 https://doi.org/10.1002/qj.776
journal January 2011
Modeling for Understanding v. Modeling for Numbers journal November 2016
Global climatic drivers of leaf size journal August 2017
An Empirical Model of Stomatal Conductance journal January 1984
C3 and C4 photosynthesis models: An overview from the perspective of crop modelling journal December 2009
Biochemical Models of Leaf Photosynthesis book January 2000
Reversible jump Markov chain Monte Carlo computation and Bayesian model determination journal January 1995
Equifinality, data assimilation, and uncertainty estimation in mechanistic modelling of complex environmental systems using the GLUE methodology journal August 2001
Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index journal February 2010
Equifinality of formal (DREAM) and informal (GLUE) Bayesian approaches in hydrologic modeling? journal October 2008
Mesophyll conductance in Zea mays responds transiently to CO 2 availability: implications for transpiration efficiency in C 4 crops journal December 2017
The impact of alternative trait-scaling hypotheses for the maximum photosynthetic carboxylation rate ( V cmax ) on global gross primary production journal June 2017
Temperature acclimation in a biochemical model of photosynthesis: a reanalysis of data from 36 species journal September 2007
A global scale mechanistic model of photosynthetic capacity (LUNA V1.0) journal January 2016
A biochemical model of photosynthetic CO2 assimilation in leaves of C3 species journal June 1980
Uncertainty in the environmental modelling process – A framework and guidance journal November 2007
Improved temperature response functions for models of Rubisco-limited photosynthesis journal February 2001
A comparison of three different canopy radiation models commonly used in plant modelling journal January 2003
Inter‐specific variation of the biochemical limitation to photosynthesis and related leaf traits of 30 species from mountain grassland ecosystems under different land use journal October 1999
Long-Term Response of Nutrient-Limited Forests to CO"2 Enrichment; Equilibrium Behavior of Plant-Soil Models journal November 1993
The ECMWF Ensemble Prediction System: Methodology and validation journal January 1996
Effect of temperature on the CO2/O2 specificity of ribulose-1,5-bisphosphate carboxylase/oxygenase and the rate of respiration in the light: Estimates from gas-exchange measurements on spinach journal January 1985
Coordination theory of leaf nitrogen distribution in a canopy journal February 1993
A canopy conductance and photosynthesis model for use in a GCM land surface scheme journal December 1998
Modelling Stomatal Behaviour and and Photosynthesis of Eucalyptus grandis journal January 1990
Reconciling the optimal and empirical approaches to modelling stomatal conductance journal October 2012
The Twentieth Century Reanalysis Project text January 2011
The ECMWF Ensemble Prediction System - methodology and validation text January 1994
Challenges in combining projections from multiple climate models text January 2010
Selecting a climate model subset to optimise key ensemble properties text January 2018

Cited By (3)