DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A mixed-scale dense convolutional neural network for image analysis

Journal Article · · Proceedings of the National Academy of Sciences of the United States of America
 [1];  [2]
  1. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
  2. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States); Univ. of California, Berkeley, CA (United States)

We report that deep convolutional neural networks have been successfully applied to many image-processing problems in recent works. Popular network architectures often add additional operations and connections to the standard architecture to enable training deeper networks. To achieve accurate results in practice, a large number of trainable parameters are often required. Here, we introduce a network architecture based on using dilated convolutions to capture features at different image scales and densely connecting all feature maps with each other. The resulting architecture is able to achieve accurate results with relatively few parameters and consists of a single set of operations, making it easier to implement, train, and apply in practice, and automatically adapts to different problems. Lastly, we compare results of the proposed network architecture with popular existing architectures for several segmentation problems, showing that the proposed architecture is able to achieve accurate results with fewer parameters, with a reduced risk of overfitting the training data.

Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE Office of Science (SC), Basic Energy Sciences (BES); USDOE Office of Science (SC), Biological and Environmental Research (BER); USDOE
Grant/Contract Number:
AC02-05CH11231; AC03-76SF00098
OSTI ID:
1414877
Alternate ID(s):
OSTI ID: 1485062
Journal Information:
Proceedings of the National Academy of Sciences of the United States of America, Vol. 115, Issue 2; ISSN 0027-8424
Publisher:
National Academy of Sciences, Washington, DC (United States)Copyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 146 works
Citation information provided by
Web of Science

References (19)

Superparsing: Scalable Nonparametric Image Parsing with Superpixels journal October 2012
What is the best multi-stage architecture for object recognition? conference September 2009
Deep learning journal May 2015
Valmet: A New Validation Tool for Assessing and Improving 3D Object Segmentation book January 2001
Generalizing the Hough transform to detect arbitrary shapes journal January 1981
ImageNet: A large-scale hierarchical image database
  • Deng, Jia; Dong, Wei; Socher, Richard
  • 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPR Workshops), 2009 IEEE Conference on Computer Vision and Pattern Recognition https://doi.org/10.1109/CVPR.2009.5206848
conference June 2009
Radio frequency interference mitigation using deep convolutional neural networks journal January 2017
Caffe: Convolutional Architecture for Fast Feature Embedding conference January 2014
U-Net: Convolutional Networks for Biomedical Image Segmentation
  • Ronneberger, Olaf; Fischer, Philipp; Brox, Thomas
  • Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III https://doi.org/10.1007/978-3-319-24574-4_28
book November 2015
PyCUDA and PyOpenCL: A scripting-based approach to GPU run-time code generation journal March 2012
Densely Connected Convolutional Networks conference July 2017
Analyzing the Performance of Multilayer Neural Networks for Object Recognition book January 2014
Deep Residual Learning for Image Recognition conference June 2016
Fully Convolutional Networks for Semantic Segmentation journal April 2017
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification conference December 2015
Semantic object classes in video: A high-definition ground truth database journal January 2009
What, Where and How Many? Combining Object Detectors and CRFs book January 2010
Automated detection of pulmonary nodules in helical CT images based on an improved template-matching technique journal July 2001
Image-to-Image Translation with Conditional Adversarial Networks conference July 2017

Cited By (33)

A deep learning reconstruction framework for X-ray computed tomography with incomplete data journal November 2019
Seismic fault detection using an encoder–decoder convolutional neural network with a small training set journal February 2019
A Lightweight Solution of Industrial Computed Tomography with Convolutional Neural Network preprint January 2020
Deep learning for cellular image analysis journal May 2019
Choices for long-term hypertensive control in patients after first-ever hemorrhagic stroke: a nationwide cohort study journal January 2018
Identification of Drug-Disease Associations Using Information of Molecular Structures and Clinical Symptoms via Deep Convolutional Neural Network journal January 2020
Combining Deep Learning and Active Contours Opens The Way to Robust, Automated Analysis of Brain Cytoarchitectonics book January 2018
Machine learning and big scientific data
  • Hey, Tony; Butler, Keith; Jackson, Sam
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 378, Issue 2166 https://doi.org/10.1098/rsta.2019.0054
journal January 2020
A deep learning reconstruction framework for X-ray computed tomography with incomplete data journal November 2019
Solar image denoising with convolutional neural networks journal September 2019
Combining Deep Learning and Active Contours Opens The Way to Robust, Automated Analysis of Brain Cytoarchitectonics posted_content August 2018
Interactive volumetric segmentation for textile micro‐tomography data using wavelets and nonlocal means
  • MacNeil, J. Michael L.; Ushizima, Daniela M.; Panerai, Francesco
  • Statistical Analysis and Data Mining: The ASA Data Science Journal, Vol. 12, Issue 4 https://doi.org/10.1002/sam.11429
journal May 2019
BS-Nets: An End-to-End Framework For Band Selection of Hyperspectral Image text January 2019
Deep learning for cellular image analysis journal May 2019
On-the-Fly Machine Learning for Improving Image Resolution in Tomography journal June 2019
Towards Understanding Residual and Dilated Dense Neural Networks via Convolutional Sparse Coding text January 2019
Single Remote Sensing Image Dehazing Using a Prior-Based Dense Attentive Network journal December 2019
Stem cell motion-tracking by using deep neural networks with multi-output journal November 2017
Deep Learning Based Computed Tomography Whys and Wherefores preprint January 2019
Dense Dilated Convolutions Merging Network for Semantic Mapping of Remote Sensing Images conference May 2019
High-Resolution Boundary Refined Convolutional Neural Network for Automatic Agricultural Greenhouses Extraction from GaoFen-2 Satellite Imageries journal October 2021
Scaling-Translation-Equivariant Networks with Decomposed Convolutional Filters preprint January 2019
A Computationally Efficient Reconstruction Algorithm for Circular Cone-Beam Computed Tomography Using Shallow Neural Networks journal December 2020
Cycloidal CT with CNN-based sinogram completion and in-scan generation of training data journal January 2022
Using machine learning to predict extreme events in complex systems journal December 2019
On-the-Fly Machine Learning for Improving Image Resolution in Tomography journal June 2019
Segmentation of dental cone‐beam CT scans affected by metal artifacts using a mixed‐scale dense convolutional neural network journal September 2019
Choices for long-term hypertensive control in patients after first-ever hemorrhagic stroke: a nationwide cohort study journal January 2018
To Recurse or not to Recurse,a Low Dose CT Study preprint January 2019
Automated segmentation of the knee for age assessment in 3D MR images using convolutional neural networks journal November 2018
Convolutional neural networks for grazing incidence x-ray scattering patterns: thin film structure identification journal March 2019
Using machine learning to predict extreme events in complex systems journal December 2019
Deep Neural Network Assisted Iterative Reconstruction Method for Low Dose CT preprint January 2019

Figures / Tables (9)