DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Gap-filling eddy covariance methane fluxes: Comparison of machine learning model predictions and uncertainties at FLUXNET-CH4 wetlands

Journal Article · · Agricultural and Forest Meteorology
; ; ORCiD logo; ; ORCiD logo; ; ORCiD logo; ; ; ; ; ; ORCiD logo; ; ; ; ; ORCiD logo; ORCiD logo; more »; ; ORCiD logo; ORCiD logo; ; ORCiD logo; ; ; ORCiD logo; ; ; ; ORCiD logo; ORCiD logo; ORCiD logo; ; ORCiD logo; ; ORCiD logo; ; ; ORCiD logo; ; ; ORCiD logo; ; ; ORCiD logo; ORCiD logo; ; ; ; ORCiD logo; ; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ; ; ; ; ; ; ; ; ; ; ORCiD logo; ORCiD logo; ; ; ORCiD logo; ; ORCiD logo; ; ; ; ; ; ; ORCiD logo; ; ; ; ORCiD logo; ORCiD logo; ; ; ORCiD logo; ORCiD logo; ; ; « less

Time series of methane fluxes measured by eddy-covariance require gap-filling to estimate annual emissions. Gap-filling methane fluxes is challenging because of high variability and complex responses to multiple drivers. To date, there is no widely established gap-filling standard for methane, with regards both to the best model algorithms and predictors. In this study, we address the need for standardization by synthesizing results of gap-filling methods applied at 17 wetland sites spanning boreal to tropical regions including all major wetlands classes and two rice paddies. We introduce new procedures for: 1) creating realistic artificial gap scenarios, 2) training and evaluating gap-filling models without overstating performance, and 3) predicting half-hourly methane fluxes and annual emissions with robust uncertainty estimates. We tested a conventional method (marginal distribution sampling) and four machine learning algorithms - penalized linear regression, artificial neural networks, random forests, and boosted decision trees - and four predictor sets, including temporal, meteorological, ecosystem carbon and energy flux, and soil predictors. We find that the conventional method can achieve similar median performance to the machine learning models but is worse than the best machine learning models and relatively insensitive to predictor choices. Of the machine learning models, decision tree algorithms performed the best in cross-validation experiments, even with a baseline predictor set, and artificial neural networks showed comparable performance when using all predictors. Soil temperature was frequently the most important predictor whilst water table depth was important at sites with substantial water table fluctuations, highlighting the value of data on soil conditions. Raw gap-filling uncertainties from the machine learning models were underestimated and we propose a method to calibrate uncertainties to observations. Finally, we gap-fill and provide summary evaluation metrics for all 81 sites in the FLUXNET-CH4 community dataset and publicly release the python code for model development, evaluation, and uncertainty estimation.

Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Basic Energy Sciences (BES); Gordon and Betty Moore Foundation; National Science Foundation (NSF); Natural Sciences and Engineering Research Council of Canada (NSERC); Helmholtz Association of German Research Centres
Contributing Organization:
R Core Team
Grant/Contract Number:
AC02-06CH11357
OSTI ID:
1840759
Alternate ID(s):
OSTI ID: 1902660
Journal Information:
Agricultural and Forest Meteorology, Journal Name: Agricultural and Forest Meteorology Vol. 308-309; ISSN 0168-1923
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (98)

Effects of seasonality, transport pathway, and spatial structure on greenhouse gas fluxes in a restored wetland journal January 2017
Evaluating the Classical Versus an Emerging Conceptual Model of Peatland Methane Dynamics: Peatland Methane Dynamics journal September 2017
Probabilistic forecasts, calibration and sharpness journal April 2007
Random Forests journal January 2001
Filling the gaps in meteorological continuous data measured at FLUXNET sites with ERA-Interim reanalysis journal January 2015
Methane emission from natural wetlands: interplay between emergent macrophytes and soil microbial processes. A mini-review journal August 2009
FLUXNET-CH4 SE-Deg Degero dataset January 2020
Diurnal Patterns of Methane Flux from a Seasonal Wetland: Mechanisms and Methodology journal May 2018
Substantial hysteresis in emergent temperature sensitivity of global wetland CH4 emissions journal April 2021
Assessing the carbon and climate benefit of restoring degraded agricultural peat soils to managed wetlands journal April 2019
Gross ecosystem photosynthesis causes a diurnal pattern in methane emission from rice: GEP CAUSES DIURNAL CH journal March 2012
WorldClim 2: new 1-km spatial resolution climate surfaces for global land areas: NEW CLIMATE SURFACES FOR GLOBAL LAND AREAS journal May 2017
The FLUXNET2015 dataset and the ONEFlux processing pipeline for eddy covariance data journal July 2020
Present state of global wetland extent and wetland methane modelling: methodology of a model inter-comparison project (WETCHIMP) journal January 2013
Biophysical controls on interannual variability in ecosystem-scale CO 2 and CH 4 exchange in a California rice paddy : INTERANNUAL VARIABILITY RICE CH journal March 2016
Carbon dioxide and methane fluxes from an intermittently flooded paddy field journal May 2000
Environmental Controls of Diffusive and Ebullitive Methane Emissions at a Subdaily Time Scale in the Littoral Zone of a Midlatitude Shallow Lake journal September 2020
Gap-filling missing data in eddy covariance measurements using multiple imputation (MI) for annual estimations journal January 2004
Predicting carbon dioxide and energy fluxes across global FLUXNET sites with regression algorithms journal January 2016
Comparing ecosystem and soil respiration: Review and key challenges of tower-based and soil measurements journal February 2018
The Global Methane Budget 2000–2017 journal January 2020
Revisiting the partitioning of net ecosystem exchange of CO2 into photosynthesis and respiration with simultaneous flux measurements of 13CO2 and CO2, soil respiration and a biophysical model, CANVEG journal March 2017
Where old meets new: An ecosystem study of methanogenesis in a reflooded agricultural peatland journal December 2019
Environmental controls on methane fluxes in a cool temperate bog journal February 2020
Influences of observation errors in eddy flux data on inverse model parameter estimation journal January 2008
A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms journal March 2011
FLUXNET-CH4 US-Twt Twitchell Island dataset January 2020
A Multi-Year Record of Methane Flux at the Mer Bleue Bog, Southern Canada journal April 2011
Ideas and perspectives: enhancing the impact of the FLUXNET network of eddy covariance sites journal January 2020
Interpreting eddy covariance data from heterogeneous Siberian tundra: land-cover-specific methane fluxes and spatial representativeness journal January 2019
A synthesis of methane emissions from 71 northern, temperate, and subtropical wetlands journal April 2014
Quantifying the impact of emission outbursts and non-stationary flow on eddy-covariance CH4 flux measurements using wavelet techniques journal January 2019
FLUXNET-CH4 CA-SCB Scotty Creek Bog dataset January 2020
Partitioning net carbon dioxide fluxes into photosynthesis and respiration using neural networks journal July 2020
Environmental drivers of methane fluxes from an urban temperate wetland park journal November 2014
Determining total emissions and environmental drivers of methane flux in a Lake Erie estuarine marsh journal April 2018
Feature Selection: A literature Review journal June 2014
FLUXNET-CH4 US-WPT Winous Point North Marsh dataset January 2020
Summarizing multiple aspects of model performance in a single diagram journal April 2001
XGBoost: A Scalable Tree Boosting System conference January 2016
Identifying scale-emergent, nonlinear, asynchronous processes of wetland methane exchange: IDENTIFYING METHANE EXCHANGE PROCESSES journal January 2016
FLUXNET-CH4 NZ-Kop Kopuatai dataset January 2020
FLUXNET-CH4 US-Tw1 Twitchell Wetland West Pond dataset January 2020
Methane Emission Reductions from the Alternate Wetting and Drying of Rice Fields Detected Using the Eddy Covariance Method journal December 2018
FLUXNET-CH4 US-OWC Old Woman Creek dataset January 2020
Modelling random uncertainty of eddy covariance flux measurements journal March 2019
Carbon biogeochemistry of a flooded Pantanal forest over three annual flood cycles journal May 2018
Nongrowing season methane emissions-a significant component of annual emissions across northern ecosystems journal April 2018
Uncertainty in eddy covariance measurements and its application to physiological models journal July 2005
Testing the applicability of neural networks as a gap-filling method using CH 4 flux data from high latitude wetlands journal January 2013
Separation of net ecosystem exchange into assimilation and respiration using a light response curve approach: critical issues and global evaluation: SEPARATION OF NEE INTO GPP AND RECO journal January 2010
FLUXNET-CH4 JP-BBY Bibai bog dataset January 2020
FLUXNET-CH4 FI-Sii Siikaneva dataset January 2020
Random errors in carbon and water vapor fluxes assessed with Gaussian Processes journal September 2013
Basic and extensible post-processing of eddy covariance flux data with REddyProc journal January 2018
Carbon dioxide and methane fluxes from different surface types in a created urban wetland journal January 2020
Identifying dominant environmental predictors of freshwater wetland methane fluxes across diurnal to seasonal time scales journal May 2021
Gap‐filling approaches for eddy covariance methane fluxes: A comparison of three machine learning algorithms and a traditional method with principal component analysis journal October 2019
Methane emissions from wetlands: biogeochemical, microbial, and modeling perspectives from local to global scales journal February 2013
Comprehensive comparison of gap-filling techniques for eddy covariance net carbon fluxes journal December 2007
FLUXNET-CH4 US-Uaf University of Alaska, Fairbanks dataset January 2020
A perspective on Gaussian processes for Earth observation journal March 2019
Overriding control of methane flux temporal variability by water table dynamics in a Southern Hemisphere, raised bog: Methane fluxes from a S.H. bog journal May 2015
FLUXNET-CH4 US-Myb Mayberry Wetland dataset January 2020
FLUXNET-CH4 FI-Si2 Siikaneva-2 Bog dataset January 2020
Half of global methane emissions come from highly variable aquatic ecosystem sources journal April 2021
Parsing the variability in CH 4 flux at a spatially heterogeneous wetland: Integrating multiple eddy covariance towers with high-resolution flux footprint analysis journal July 2014
Primary production control of methane emission from wetlands journal August 1993
Determination of rice paddy parameters in the global gross primary production capacity estimation algorithm using 6 years of JP-MSE flux observation data journal January 2017
FLUXNET-CH4: a global, multi-ecosystem dataset and analysis of methane seasonality from freshwater wetlands journal January 2021
Advances in the Eddy Covariance Approach to CH 4 Monitoring Over Two and a Half Decades journal March 2019
Hot-Moments of Soil CO2 Efflux in a Water-Limited Grassland journal August 2018
Widespread inhibition of daytime ecosystem respiration journal February 2019
Gap filling strategies for defensible annual sums of net ecosystem exchange journal March 2001
The impact of occasional drought periods on vegetation spread and greenhouse gas exchange in rewetted fens journal September 2020
Methane fluxes show consistent temperature dependence across microbial to ecosystem scales journal March 2014
Moving Beyond Global Warming Potentials to Quantify the Climatic Role of Ecosystems journal May 2015
Comparisons of gap-filling methods for carbon flux dataset: A combination of a genetic algorithm and an artificial neural network journal October 2006
Uncertainty in United States coastal wetland greenhouse gas inventorying journal November 2018
Standardisation of eddy-covariance flux measurements of methane and nitrous oxide journal December 2018
FLUXNET-CH 4 Synthesis Activity: Objectives, Observations, and Future Directions journal July 2019
Combining eddy-covariance and chamber measurements to determine the methane budget from a small, heterogeneous urban floodplain wetland park journal May 2017
FLUXNET-CH4 US-Los Lost Creek dataset January 2020
FLUXNET-CH4 BR-Npw Northern Pantanal Wetland
  • Vourlitis, George; Dalmagro, Higo; De S. Nogueira, Jose
  • FluxNet; California State University, San Marcos; Universidade de Cuiabá; Universidade Federal de Mato Grosso; University of British Columbia https://doi.org/10.18140/flx/1669368
dataset January 2020
Cross-validation strategies for data with temporal, spatial, hierarchical, or phylogenetic structure journal March 2017
Biophysical drivers of net ecosystem and methane exchange across phenological phases in a tidal salt marsh journal April 2021
Monthly gridded data product of northern wetland methane emissions based on upscaling eddy covariance observations journal January 2019
Upscaled diurnal cycles of land–atmosphere fluxes: a new global half-hourly data product journal January 2018
Salinity Influence on Methane Emissions from Tidal Marshes journal July 2011
Interpretation of the Correlation Coefficient: A Basic Review journal January 1990
Probabilistic Forecasting journal January 2014
Prompt rewetting of drained peatlands reduces climate warming despite methane emissions journal April 2020
On the separation of net ecosystem exchange into assimilation and ecosystem respiration: review and improved algorithm journal September 2005
FLUXNET-CH4 JP-Mse Mase rice paddy field dataset January 2020
Transforming classifier scores into accurate multiclass probability estimates conference January 2002
FLUXNET-CH4 FI-Lom Lompolojankka dataset January 2020
A method to estimate the additional uncertainty in gap-filled NEE resulting from long gaps in the CO2 flux record journal December 2007
SciPy 1.0: fundamental algorithms for scientific computing in Python journal February 2020