Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Monitoring leaf phenology in moist tropical forests by applying a superpixel-based deep learning method to time-series images of tree canopies

Journal Article · · ISPRS Journal of Photogrammetry and Remote Sensing
 [1];  [1];  [1];  [2];  [3];  [1];  [2];  [1];  [1];  [1];  [4];  [5];  [2];  [1]
  1. Univ. of Hong Kong (Hong Kong)
  2. Brookhaven National Lab. (BNL), Upton, NY (United States)
  3. Louisiana State Univ., Baton Rouge, LA (United States); Smithsonian Tropical Research Institute, Balboa (Republic of Panama)
  4. Univ. of Arizona, Tucson, AZ (United States)
  5. National Institute for Amazon Research (INPA), Manaus (Brazil)
Tropical leaf phenology-particularly its variability at the tree-crown scale-dominates the seasonality of carbon and water fluxes. However, given enormous species diversity, accurate means of monitoring leaf phenology in tropical forests is still lacking. Time series of the Green Chromatic Coordinate (GCC) metric derived from tower-based red-green-blue (RGB) phenocams have been widely used to monitor leaf phenology in temperate forests, but its application in the tropics remains problematic. To improve monitoring of tropical phenology, we explored the use of a deep learning model (i.e. superpixel-based Residual Networks 50, SP-ResNet50) to automatically differentiate leaves from non-leaves in phenocam images and to derive leaf fraction at the tree-crown scale. To evaluate our model, we used a year of data from six phenocams in two contrasting forests in Panama. Here, we first built a comprehensive library of leaf and non-leaf pixels across various acquisition times, exposure conditions and specific phenocams. We then divided this library into training and testing components. We evaluated the model at three levels: 1) superpixel level with a testing set, 2) crown level by comparing the model-derived leaf fractions with those derived using image-specific supervised classification, and 3) temporally using all daily images to assess the diurnal stability of the model-derived leaf fraction. Finally, we compared the model-derived leaf fraction phenology with leaf phenology derived from GCC. Our results show that: 1) the SP-ResNet50 model accurately differentiates leaves from non-leaves (overall accuracy of 93%) and is robust across all three levels of evaluations; 2) the model accurately quantifies leaf fraction phenology across tree-crowns and forest ecosystems; and 3) the combined use of leaf fraction and GCC helps infer the timing of leaf emergence, maturation and senescence, critical information for modeling photosynthetic seasonality of tropical forests. Collectively, this study offers an improved means for automated tropical phenology monitoring using phenocams.
Research Organization:
Brookhaven National Laboratory (BNL), Upton, NY (United States)
Sponsoring Organization:
Hong Kong Research Grant Council; National Natural Science Foundation of China (NSFC); USDOE; USDOE Office of Science (SC)
Grant/Contract Number:
SC0012704
OSTI ID:
1830191
Alternate ID(s):
OSTI ID: 1829928
Report Number(s):
BNL--222355-2021-JAAM
Journal Information:
ISPRS Journal of Photogrammetry and Remote Sensing, Journal Name: ISPRS Journal of Photogrammetry and Remote Sensing Vol. 183; ISSN 0924-2716
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (72)

Beyond leaf color: Comparing camera-based phenological metrics with leaf biochemical, biophysical, and spectral properties throughout the growing season of a temperate deciduous forest: Seasonality of leaf properties journal March 2014
Using the U‐net convolutional network to map forest types and disturbance in the Atlantic rainforest with very high resolution images journal February 2019
Deciduousness in a seasonal tropical forest in western Thailand: interannual and intraspecific variation in timing, duration and environmental cues journal January 2008
Superpixel based land cover classification of VHR satellite image combining multi-scale CNN and scale parameter estimation journal April 2019
A review of assessing the accuracy of classifications of remotely sensed data journal July 1991
First operational BRDF, albedo nadir reflectance products from MODIS journal November 2002
Monitoring vegetation phenology using MODIS journal March 2003
Digital repeat photography for phenological research in forest ecosystems journal January 2012
What drives the seasonality of photosynthesis across the Amazon basin? A cross-site analysis of eddy flux tower measurements from the Brasil flux network journal December 2013
Using phenological cameras to track the green up in a cerrado savanna and its on-the-ground validation journal January 2014
Usability of time-lapse digital camera images to detect characteristics of tree phenology in a tropical rainforest journal March 2016
Deciduousness in tropical trees and its potential as indicator of climate change: A review journal October 2016
Spectral analysis of amazon canopy phenology during the dry season using a tower hyperspectral camera and modis observations journal September 2017
Algorithms for semantic segmentation of multispectral remote sensing imagery using deep learning journal November 2018
A light and faster regional convolutional neural network for object detection in optical remote sensing images journal July 2018
Deep multi-task learning for a geographically-regularized semantic segmentation of aerial images journal October 2018
Superpixel-enhanced deep neural forest for remote sensing image semantic segmentation journal January 2020
Identifying and mapping individual plants in a highly diverse high-elevation ecosystem using UAV imagery and deep learning journal November 2020
SceneNet: Remote sensing scene classification deep learning network using multi-objective neural evolution architecture search journal February 2021
Review on Convolutional Neural Networks (CNN) in vegetation remote sensing journal March 2021
Remote sensing image segmentation advances: A meta-analysis journal March 2021
Introducing digital cameras to monitor plant phenology in the tropics: applications for conservation journal April 2017
Leaf flush drives dry season green-up of the Central Amazon journal September 2016
A high-performance and in-season classification system of field-level crop types using time-series Landsat data and a machine learning approach journal June 2018
An object-based convolutional neural network (OCNN) for urban land use classification journal October 2018
Assessing spring phenology of a temperate woodland: A multiscale comparison of ground, unmanned aerial vehicle and Landsat satellite observations journal March 2019
Land-cover classification with high-resolution remote sensing images using transferable deep models journal February 2020
Both near-surface and satellite remote sensing confirm drought legacy effect on tropical forest leaf phenology after 2015/2016 ENSO drought journal February 2020
Multi-scale integration of satellite remote sensing improves characterization of dry-season green-up in an Amazon tropical evergreen forest journal September 2020
Mapping large-scale and fine-grained urban functional zones from VHR images using a multi-scale semantic segmentation network and object based approach journal August 2021
Random Forests journal January 2001
Amazon rainforests green-up with sunlight in dry season journal January 2006
Amazon forests did not green-up during the 2005 drought: AMAZON DROUGHT SENSITIVITY journal March 2010
Dry-Season Greening and Water Stress in Amazonia: The Role of Modeling Leaf Phenology journal June 2018
Deep learning journal May 2015
Dry-season greening of Amazon forests journal March 2016
Photosynthetic seasonality of global tropical forests constrained by hydroclimate journal March 2015
Resource acquisition and reproductive strategies of tropical forest in response to the El Niño–Southern Oscillation journal March 2018
Improved NDVI based proxy leaf-fall indicator to assess rainfall sensitivity of deciduousness in the central Indian forests through remote sensing journal October 2020
Tracking vegetation phenology across diverse North American biomes using PhenoCam imagery journal March 2018
Seasonal and interannual variability of climate and vegetation indices across the Amazon journal August 2010
Light-driven growth in Amazon evergreen forests explained by seasonal variations of vertical canopy structure journal February 2017
Very high resolution remote sensing image classification with SEEDS-CNN and scale effect analysis for superpixel CNN classification journal September 2018
Seasonal changes in photosynthesis of eight savanna tree species journal August 1999
Training Deep Convolutional Neural Networks for Land–Cover Classification of High-Resolution Imagery journal April 2017
Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification journal February 2017
Superpixel-Based Difference Representation Learning for Change Detection in Multispectral Remote Sensing Images journal May 2017
Superpixel-Based Multiple Local CNN for Panchromatic and Multispectral Image Classification journal July 2017
Unsupervised-Restricted Deconvolutional Neural Network for Very High Resolution Remote-Sensing Image Classification journal December 2017
SLIC Superpixels Compared to State-of-the-Art Superpixel Methods journal November 2012
Tropical phenology: Recent advances and perspectives journal January 2019
Fourier analysis to detect phenological cycles using long-term tropical field data and simulations journal December 2016
Do dynamic global vegetation models capture the seasonality of carbon fluxes in the Amazon basin? A data-model intercomparison journal August 2016
Amazon drought and forest response: Largely reduced forest photosynthesis but slightly increased canopy greenness during the extreme drought of 2015/2016 journal February 2018
Plant phenology and global climate change: Current progresses and challenges journal April 2019
Cryptic phenology in plants: Case studies, implications, and recommendations journal August 2019
Leaf aging of Amazonian canopy trees as revealed by spectral and physiochemical measurements journal February 2016
Convergence in relationships between leaf traits, spectra and age across diverse canopy environments and two contrasting tropical forests journal July 2016
Biological processes dominate seasonality of remotely sensed canopy greenness in an Amazon evergreen forest journal December 2017
Age-dependent leaf physiology and consequences for crown-scale carbon uptake during the dry season in an Amazon evergreen forest journal March 2018
Tracking seasonal rhythms of plants in diverse ecosystems with digital camera imagery journal December 2018
Leaf reflectance spectroscopy captures variation in carboxylation capacity across species, canopy environment and leaf age in lowland moist tropical forests journal June 2019
Leaf development and demography explain photosynthetic seasonality in Amazon evergreen forests journal February 2016
Phenology of tropical forests: patterns, causes, and consequences journal February 1995
Generative adversarial networks journal October 2020
Panama tropical forest digital camera imagery for vegetation phenology, Dec2016-May2019, PA-SLZ, PA-PNM, PA-BCI dataset January 2021
Near-surface remote sensing of spatial and temporal variation in canopy phenology journal September 2009
Tracking forest phenology and seasonal physiology using digital repeat photography: a critical assessment journal September 2014
Quantifying Leaf Phenology of Individual Trees and Species in a Tropical Forest Using Unmanned Aerial Vehicle (UAV) Images journal June 2019
Automatic Detection of Maize Tassels from UAV Images by Combining Random Forest Classifier and VGG16 journal September 2020
Automated Extraction of Phenotypic Leaf Traits of Individual Intact Herbarium Leaves from Herbarium Specimen Images Using Deep Learning Based Semantic Segmentation journal July 2021
Evaluating remote sensing of deciduous forest phenology at multiple spatial scales using PhenoCam imagery journal January 2014

Similar Records

An ecologically-constrained deep learning model for tropical leaf phenology monitoring using PlanetScope satellites
Journal Article · Thu Jan 05 19:00:00 EST 2023 · Remote Sensing of Environment · OSTI ID:1913816

Multi-scale integration of satellite remote sensing improves characterization of dry-season green-up in an Amazon tropical evergreen forest
Journal Article · Mon Aug 31 20:00:00 EDT 2020 · Remote Sensing of Environment · OSTI ID:1618402

Using the red chromatic coordinate to characterize the phenology of forest canopy photosynthesis
Journal Article · Tue Jan 28 19:00:00 EST 2020 · Agricultural and Forest Meteorology · OSTI ID:1802806