DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Robust High-Throughput Phenotyping with Deep Segmentation Enabled by a Web-Based Annotator

Journal Article · · Plant Phenomics

The abilities of plant biologists and breeders to characterize the genetic basis of physiological traits are limited by their abilities to obtain quantitative data representing precise details of trait variation, and particularly to collect this data at a high-throughput scale with low cost. Although deep learning methods have demonstrated unprecedented potential to automate plant phenotyping, these methods commonly rely on large training sets that can be time-consuming to generate. Intelligent algorithms have therefore been proposed to enhance the productivity of these annotations and reduce human efforts. We propose a high-throughput phenotyping system which features a Graphical User Interface (GUI) and a novel interactive segmentation algorithm: Semantic-Guided Interactive Object Segmentation (SGIOS). By providing a user-friendly interface and intelligent assistance with annotation, this system offers potential to streamline and accelerate the generation of training sets, reducing the effort required by the user. Our evaluation shows that our proposed SGIOS model requires fewer user inputs compared to the state-of-art models for interactive segmentation. As a case study of the use of the GUI applied for genetic discovery in plants, we present an example of results from a preliminary genome-wide association study (GWAS) of in planta regeneration in Populus trichocarpa (poplar). We further demonstrate that the inclusion of a semantic prior map with SGIOS can accelerate the training process for future GWAS, using a sample of a dataset extracted from a poplar GWAS of in vitro regeneration. The capabilities of our phenotyping system surpass those of unassisted humans to rapidly and precisely phenotype our traits of interest. The scalability of this system enables large-scale phenomic screens that would otherwise be time-prohibitive, thereby providing increased power for GWAS, mutant screens, and other studies relying on large sample sizes to characterize the genetic basis of trait variation. Our user-friendly system can be used by researchers lacking a computational background, thus helping to democratize the use of deep segmentation as a tool for plant phenotyping.

Research Organization:
Oregon State University, Corvallis, OR (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Biological and Environmental Research (BER); National Science Foundation (NSF); Defense Advanced Research Projects Agency (DARPA)
Grant/Contract Number:
AC05-00OR22725
OSTI ID:
1903907
Journal Information:
Plant Phenomics, Journal Name: Plant Phenomics Vol. 2022; ISSN 2643-6515
Publisher:
AAASCopyright Statement
Country of Publication:
United States
Language:
English

References (52)

Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation book October 2018
Iterative algorithm for interactive co-segmentation using semantic information propagation journal August 2018
LabelMe: A Database and Web-Based Tool for Image Annotation journal October 2007
Geodesic Matting: A Framework for Fast Interactive Image and Video Segmentation and Matting journal November 2008
The Pascal Visual Object Classes Challenge: A Retrospective journal June 2014
Power and Sample Size Calculations for Studies Involving Linear Regression journal December 1998
A Structured Tumor-Immune Microenvironment in Triple Negative Breast Cancer Revealed by Multiplexed Ion Beam Imaging journal September 2018
A review of computer vision technologies for plant phenotyping journal September 2020
Uncovering the hidden half of plants using new advances in root phenotyping journal February 2019
Image-based plant phenotyping with incremental learning and active contours journal September 2014
To regenerate or not to regenerate: factors that drive plant regeneration journal February 2019
A global reference for human genetic variation journal January 2015
Combining high-throughput phenotyping and genome-wide association studies to reveal natural genetic variation in rice journal October 2014
Genome-wide efficient mixed-model analysis for association studies journal June 2012
Joint analysis is more efficient than replication-based analysis for two-stage genome-wide association studies journal January 2006
Data-mining Techniques for Image-based Plant Phenotypic Traits Identification and Classification journal December 2019
The genetic framework of shoot regeneration in Arabidopsis comprises master regulators and conditional fine-tuning factors journal October 2020
PUCHI regulates very long chain fatty acid biosynthesis during lateral root and callus formation journal June 2019
PLINK: A Tool Set for Whole-Genome Association and Population-Based Linkage Analyses journal September 2007
Structured crowdsourcing enables convolutional segmentation of histology images journal February 2019
Genome-wide association studies of callus differentiation for the desert tree,Populus euphratica journal August 2020
Flavonoids Act as Negative Regulators of Auxin Transport in Vivo in Arabidopsis journal June 2001
SDIR1 Is a RING Finger E3 Ligase That Positively Regulates Stress-Responsive Abscisic Acid Signaling in Arabidopsis journal June 2007
Dense Object Reconstruction with Semantic Priors conference June 2013
Deep Interactive Object Selection conference June 2016
RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation conference July 2017
Pyramid Scene Parsing Network conference July 2017
Deep Extreme Cut: From Extreme Points to Object Segmentation conference June 2018
Content-Aware Multi-Level Guidance for Interactive Instance Segmentation conference June 2019
Semantic contours from inverse detectors conference November 2011
Regional Interactive Image Segmentation Networks conference October 2017
Semantic segmentation priors for object discovery conference December 2016
A Comprehensive Survey on Transfer Learning journal January 2021
Random Walks for Image Segmentation journal November 2006
DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs journal April 2018
A Comprehensive Survey on Transfer Learning journal January 2021
DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs journal April 2018
The shoot regeneration capacity of excised Arabidopsis cotyledons is established during the initial hours after injury and is modulated by a complex genetic network of light signalling journal July 2012
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing journal January 1995
Multitrait genome‐wide association analysis of Populus trichocarpa identifies key polymorphisms controlling morphological and physiological traits journal April 2019
The Genome of Black Cottonwood, Populus trichocarpa (Torr. & Gray) journal September 2006
The VIA Annotation Software for Images, Audio and Video
  • Dutta, Abhishek; Zisserman, Andrew
  • MM '19: The 27th ACM International Conference on Multimedia, Proceedings of the 27th ACM International Conference on Multimedia https://doi.org/10.1145/3343031.3350535
conference October 2019
Development of an in vitro pre-mRNA splicing assay using plant nuclear extract journal January 2018
A survey on Image Data Augmentation for Deep Learning journal July 2019
An automated, high-throughput plant phenotyping system using machine learning-based plant segmentation and image analysis journal April 2018
Defining the genetic components of callus formation: A GWAS approach journal August 2018
Salient Object Detection with Semantic Priors conference August 2017
Advanced phenotyping and phenotype data analysis for the study of plant growth and development journal August 2015
Deep Plant Phenomics: A Deep Learning Platform for Complex Plant Phenotyping Tasks journal July 2017
Global Wheat Head Detection (GWHD) Dataset: A Large and Diverse Dataset of High-Resolution RGB-Labelled Images to Develop and Benchmark Wheat Head Detection Methods journal August 2020
Convolutional Neural Networks for Image-Based High-Throughput Plant Phenotyping: A Review journal April 2020
A short review on Genome-Wide Association Studies journal May 2020