Weakly Supervised Minirhizotron Image Segmentation with MIL-CAM

Yu, Guohao; Zare, Alina; Xu, Weihuang; Matamala, Roser; Reyes-Cabrera, Joel; Fritschi, Felix B.; Juenger, Thomas E.

doi:10.1007/978-3-030-65414-6_30

Weakly Supervised Minirhizotron Image Segmentation with MIL-CAM

Journal Article · Mon Jan 04 23:00:00 EST 2021 · Lecture Notes in Computer Science

DOI:https://doi.org/10.1007/978-3-030-65414-6_30· OSTI ID:2448006

^[1]; ^[2]; ^[2]; ^[3]; ^[4]; ^[4]; ^[5]

University of Florida, Gainesville, FL (United States); University of Texas at Austin
University of Florida, Gainesville, FL (United States)
Argonne National Laboratory (ANL), Argonne, IL (United States)
University of Missouri, Columbia, MO (United States)
University of Texas at Austin, TX (United States)

We present a multiple instance learning class activation map (MIL-CAM) approach for pixel-level minirhizotron image segmentation given weak image-level labels. Minirhizotrons are used to image plant roots in situ. Minirhizotron imagery is often composed of soil containing a few long and thin root objects of small diameter. The roots prove to be challenging for existing semantic image segmentation methods to discriminate. In addition to learning from weak labels, our proposed MILCAM approach re-weights the root versus soil pixels during analysis for improved performance due to the heavy imbalance between soil and root pixels. Furthermore, the proposed approach outperforms other attention map and multiple instance learning methods for localization of root objects in minirhizotron imagery.

View Accepted Manuscript (DOE)

Research Organization:: University of Texas at Austin, TX (United States)

Sponsoring Organization:: USDOE Office of Science (SC), Biological and Environmental Research (BER). Biological Systems Science (BSS); USDOE Advanced Research Projects Agency - Energy (ARPA-E)

Grant/Contract Number:: SC0014156; AR0000820

OSTI ID:: 2448006

Journal Information:: Lecture Notes in Computer Science, Journal Name: Lecture Notes in Computer Science Vol. 12540; ISSN 0302-9743

Publisher:: SpringerCopyright Statement

Country of Publication:: United States

Language:: English

References (33)

PRMI: A dataset of minirhizotron images for diverse plant root study Xu, Weihuang; Yu, Guohao; Cui, Yiming Dryad https://doi.org/10.5061/dryad.2v6wwpzp4	dataset	January 2021
U-Net: Convolutional Networks for Biomedical Image Segmentation Ronneberger, Olaf; Fischer, Philipp; Brox, Thomas Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III https://doi.org/10.1007/978-3-319-24574-4_28	book	November 2015
Detecting and Measuring Fine Roots in Minirhizotron Images Using Matched Filtering and Local Entropy Thresholding Zeng, Guang; Birchfield, Stanley T.; Wells, Christina E. Machine Vision and Applications, Vol. 17, Issue 4 https://doi.org/10.1007/s00138-006-0024-4	journal	July 2006
Rapid automated detection of roots in minirhizotron images Zeng, Guang; Birchfield, Stanley T.; Wells, Christina E. Machine Vision and Applications, Vol. 21, Issue 3 https://doi.org/10.1007/s00138-008-0179-2	journal	December 2008
Root identification in minirhizotron imagery with multiple instance learning Yu, Guohao; Zare, Alina; Sheng, Hudanyun Machine Vision and Applications, Vol. 31, Issue 6 https://doi.org/10.1007/s00138-020-01088-z	journal	June 2020
Advancing fine root research with minirhizotrons Johnson, M. G.; Tingey, D. T.; Phillips, D. L. Environmental and Experimental Botany, Vol. 45, Issue 3 https://doi.org/10.1016/S0098-8472(01)00077-6	journal	June 2001
SegRoot: A high throughput segmentation method for root image analysis Wang, Tao; Rostamza, Mina; Song, Zhihang Computers and Electronics in Agriculture, Vol. 162 https://doi.org/10.1016/j.compag.2019.05.017	journal	July 2019
Overcoming small minirhizotron datasets using transfer learning Xu, Weihuang; Yu, Guohao; Zare, Alina Computers and Electronics in Agriculture, Vol. 175 https://doi.org/10.1016/j.compag.2020.105466	journal	August 2020
A Device for the Observation of Root Growth in the Soil Bates, G. H. Nature, Vol. 139, Issue 3527 https://doi.org/10.1038/139966b0	journal	June 1937
RootNav 2.0: Deep learning for automatic navigation of complex plant root architectures Yasrab, Robail; Atkinson, Jonathan A.; Wells, Darren M. GigaScience, Vol. 8, Issue 11 https://doi.org/10.1093/gigascience/giz123	journal	November 2019
Is object localization for free? - Weakly-supervised learning with convolutional neural networks Oquab, Maxime; Bottou, Leon; Laptev, Ivan 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2015.7298668	conference	June 2015
From image-level to pixel-level labeling with Convolutional Networks Pinheiro, Pedro O.; Collobert, Ronan 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2015.7298780	conference	June 2015
Fully convolutional networks for semantic segmentation Long, Jonathan; Shelhamer, Evan; Darrell, Trevor 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2015.7298965	conference	June 2015
Learning Deep Features for Discriminative Localization Zhou, Bolei; Khosla, Aditya; Lapedriza, Agata 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2016.319	conference	June 2016
Efficient Piecewise Training of Deep Structured Models for Semantic Segmentation Lin, Guosheng; Shen, Chunhua; van den Hengel, Anton 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2016.348	conference	June 2016
WELDON: Weakly Supervised Learning of Deep Convolutional Neural Networks Durand, Thibaut; Thome, Nicolas; Cord, Matthieu 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2016.513	conference	June 2016
WILDCAT: Weakly Supervised Learning of Deep ConvNets for Image Classification, Pointwise Localization and Segmentation Durand, Thibaut; Mordan, Taylor; Thome, Nicolas 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2017.631	conference	July 2017
Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approach Wei, Yunchao; Feng, Jiashi; Liang, Xiaodan 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2017.687	conference	July 2017
Combining Bottom-Up, Top-Down, and Smoothness Cues for Weakly Supervised Image Segmentation Roy, Anirban; Todorovic, Sinisa 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2017.770	conference	July 2017
Normalized Cut Loss for Weakly-Supervised CNN Segmentation Tang, Meng; Djelouah, Abdelaziz; Perazzi, Federico 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition https://doi.org/10.1109/CVPR.2018.00195	conference	June 2018
Weakly-Supervised Semantic Segmentation Network with Deep Seeded Region Growing Huang, Zilong; Wang, Xinggang; Wang, Jiasi 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition https://doi.org/10.1109/CVPR.2018.00733	conference	June 2018
Revisiting Dilated Convolution: A Simple Approach for Weakly- and Semi-Supervised Semantic Segmentation Wei, Yunchao; Xiao, Huaxin; Shi, Honghui 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition https://doi.org/10.1109/CVPR.2018.00759	conference	June 2018
Weakly Supervised Learning of Instance Segmentation With Inter-Pixel Relations Ahn, Jiwoon; Cho, Sunghyun; Kwak, Suha 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2019.00231	conference	June 2019
FickleNet: Weakly and Semi-Supervised Semantic Image Segmentation Using Stochastic Inference Lee, Jungbeom; Kim, Eunji; Lee, Sungmin 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2019.00541	conference	June 2019
Weakly-and Semi-Supervised Learning of a Deep Convolutional Network for Semantic Image Segmentation Papandreou, George; Chen, Liang-Chieh; Murphy, Kevin P. 2015 IEEE International Conference on Computer Vision (ICCV) https://doi.org/10.1109/ICCV.2015.203	conference	December 2015
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization Selvaraju, Ramprasaath R.; Cogswell, Michael; Das, Abhishek 2017 IEEE International Conference on Computer Vision (ICCV) https://doi.org/10.1109/ICCV.2017.74	conference	October 2017
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation Badrinarayanan, Vijay; Kendall, Alex; Cipolla, Roberto IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 39, Issue 12 https://doi.org/10.1109/TPAMI.2016.2644615	journal	December 2017
DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs Chen, Liang-Chieh; Papandreou, George; Kokkinos, Iasonas IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 40, Issue 4 https://doi.org/10.1109/TPAMI.2017.2699184	journal	April 2018
Discriminative Multiple Instance Hyperspectral Target Characterization Zare, Alina; Jiao, Changzhe; Glenn, Taylor IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 40, Issue 10 https://doi.org/10.1109/TPAMI.2017.2756632	journal	October 2018
A Threshold Selection Method from Gray-Level Histograms Otsu, Nobuyuki IEEE Transactions on Systems, Man, and Cybernetics, Vol. 9, Issue 1 https://doi.org/10.1109/TSMC.1979.4310076	journal	January 1979
Grad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks Chattopadhay, Aditya; Sarkar, Anirban; Howlader, Prantik 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) https://doi.org/10.1109/WACV.2018.00097	conference	March 2018
Observation of plant roots in situ Waddington, J. Canadian Journal of Botany, Vol. 49, Issue 10 https://doi.org/10.1139/b71-261	journal	October 1971
Segmentation of roots in soil with U-Net Smith, Abraham George; Petersen, Jens; Selvan, Raghavendra Plant Methods, Vol. 16, Issue 1 https://doi.org/10.1186/s13007-020-0563-0	journal	February 2020

Cited By (1)

PRMI: A dataset of minirhizotron images for diverse plant root study Xu, Weihuang; Yu, Guohao; Cui, Yiming Dryad https://doi.org/10.5061/dryad.2v6wwpzp4	dataset	January 2021

Similar Records

Root identification in minirhizotron imagery with multiple instance learning

Journal Article · Wed Jun 24 00:00:00 EDT 2020 · Machine Vision and Applications · OSTI ID:1773853

Overcoming small minirhizotron datasets using transfer learning

Journal Article · Fri Jun 19 00:00:00 EDT 2020 · Computers and Electronics in Agriculture · OSTI ID:1773850

PRMI: A Dataset of Minirhizotron Images for Diverse Plant Root Study

Conference · Fri Dec 31 23:00:00 EST 2021 · OSTI ID:1887572

Related Subjects

97 MATHEMATICS AND COMPUTING

Weakly Supervised Minirhizotron Image Segmentation with MIL-CAM

Citation Formats

References (33)

Cited By (1)

Similar Records

Related Subjects