Automated correlative segmentation of large Transmission X-ray Microscopy (TXM) tomograms using deep learning
Abstract
A unique correlative approach for automated segmentation of large 3D nanotomography datasets obtained using Transmission X-ray Microscopy (TXM) in an Al-Cu alloy has been introduced. Automated segmentation using a Convolutional Neural Network (CNN) architecture based on a deep learning approach was employed. This extremely versatile technique is capable of emulating the manual segmentation process effectively. Coupling this technique with post-scanning SEM imaging ensured precise estimation of 3D morphological parameters from nanotomography. The segmentation process as well as subsequent analysis was expedited by several orders of magnitude. Quantitative comparison between segmentation performed manually and using the CNN architecture established the accuracy of this automated technique. Its ability to robustly process ultra-large volumes of data in relatively small time frames can exponentially accelerate tomographic data analysis, possibly opening up novel avenues for performing 4D characterization experiments with finer time steps.
- Authors:
-
- Arizona State Univ., Tempe, AZ (United States). Center for 4D Materials Science
- Argonne National Lab. (ANL), Argonne, IL (United States). Advanced Photon Source (APS)
- Argonne National Lab. (ANL), Argonne, IL (United States). Argonne Leadership Computing Facility
- Publication Date:
- Research Org.:
- Argonne National Laboratory (ANL), Argonne, IL (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), Basic Energy Sciences (BES); US Army Research Office (ARO)
- OSTI Identifier:
- 1475563
- Alternate Identifier(s):
- OSTI ID: 1582783
- Grant/Contract Number:
- AC02-06CH11357; W911NF1410550
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Materials Characterization
- Additional Journal Information:
- Journal Volume: 142; Journal Issue: C; Journal ID: ISSN 1044-5803
- Publisher:
- Elsevier
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 36 MATERIALS SCIENCE; Aluminum alloys; Deep learning; Precipitates; Segmentation; Transmission X-ray Microscopy (TXM)
Citation Formats
Shashank Kaira, C., Yang, Xiaogang, De Andrade, Vincent, De Carlo, Francesco, Scullin, William, Gursoy, Doga, and Chawla, Nikhilesh. Automated correlative segmentation of large Transmission X-ray Microscopy (TXM) tomograms using deep learning. United States: N. p., 2018.
Web. doi:10.1016/j.matchar.2018.05.053.
Shashank Kaira, C., Yang, Xiaogang, De Andrade, Vincent, De Carlo, Francesco, Scullin, William, Gursoy, Doga, & Chawla, Nikhilesh. Automated correlative segmentation of large Transmission X-ray Microscopy (TXM) tomograms using deep learning. United States. https://doi.org/10.1016/j.matchar.2018.05.053
Shashank Kaira, C., Yang, Xiaogang, De Andrade, Vincent, De Carlo, Francesco, Scullin, William, Gursoy, Doga, and Chawla, Nikhilesh. Mon .
"Automated correlative segmentation of large Transmission X-ray Microscopy (TXM) tomograms using deep learning". United States. https://doi.org/10.1016/j.matchar.2018.05.053. https://www.osti.gov/servlets/purl/1475563.
@article{osti_1475563,
title = {Automated correlative segmentation of large Transmission X-ray Microscopy (TXM) tomograms using deep learning},
author = {Shashank Kaira, C. and Yang, Xiaogang and De Andrade, Vincent and De Carlo, Francesco and Scullin, William and Gursoy, Doga and Chawla, Nikhilesh},
abstractNote = {A unique correlative approach for automated segmentation of large 3D nanotomography datasets obtained using Transmission X-ray Microscopy (TXM) in an Al-Cu alloy has been introduced. Automated segmentation using a Convolutional Neural Network (CNN) architecture based on a deep learning approach was employed. This extremely versatile technique is capable of emulating the manual segmentation process effectively. Coupling this technique with post-scanning SEM imaging ensured precise estimation of 3D morphological parameters from nanotomography. The segmentation process as well as subsequent analysis was expedited by several orders of magnitude. Quantitative comparison between segmentation performed manually and using the CNN architecture established the accuracy of this automated technique. Its ability to robustly process ultra-large volumes of data in relatively small time frames can exponentially accelerate tomographic data analysis, possibly opening up novel avenues for performing 4D characterization experiments with finer time steps.},
doi = {10.1016/j.matchar.2018.05.053},
journal = {Materials Characterization},
number = C,
volume = 142,
place = {United States},
year = {Mon May 28 00:00:00 EDT 2018},
month = {Mon May 28 00:00:00 EDT 2018}
}
Free Publicly Available Full Text
Publisher's Version of Record
Other availability
Search WorldCat to find libraries that may hold this journal
Cited by: 24 works
Citation information provided by
Web of Science
Web of Science
Figures / Tables:
Fig. 1: Schematic showing workflow of the segmentation process on TXM datasets using a deep learning (Convolutional Neural Network) approach.
All figures and tables
(7 total)
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
Quantitative X-ray tomography
journal, December 2013
- Maire, E.; Withers, P. J.
- International Materials Reviews, Vol. 59, Issue 1
Advances in synchrotron radiation microtomography
journal, July 2006
- Baruchel, José; Buffiere, Jean-Yves; Cloetens, Peter
- Scripta Materialia, Vol. 55, Issue 1
X-ray microscopy with synchrotron radiation
journal, January 1976
- Niemann, B.; Rudolph, D.; Schmahl, G.
- Applied Optics, Vol. 15, Issue 8
Damage evolution in SiC particle reinforced Al alloy matrix composites by X-ray synchrotron tomography
journal, October 2010
- Williams, J. J.; Flom, Z.; Amell, A. A.
- Acta Materialia, Vol. 58, Issue 18
Development of a lab-scale, high-resolution, tube-generated X-ray computed-tomography system for three-dimensional (3D) materials characterization
journal, June 2014
- Mertens, J. C. E.; Williams, J. J.; Chawla, Nikhilesh
- Materials Characterization, Vol. 92
Crack closure and stress intensity factor measurements in nodular graphite cast iron using three-dimensional correlation of laboratory X-ray microtomography images
journal, August 2009
- Limodin, Nathalie; Réthoré, Julien; Buffière, Jean-Yves
- Acta Materialia, Vol. 57, Issue 14
The Ascent of 3D X-ray Microscopy in the Laboratory
journal, March 2013
- Merkle, Arno P.; Gelb, Jeff
- Microscopy Today, Vol. 21, Issue 2
Real-time quantitative imaging of failure events in materials under load at temperatures above 1,600 °C
journal, December 2012
- Bale, Hrishikesh A.; Haboub, Abdel; MacDowell, Alastair A.
- Nature Materials, Vol. 12, Issue 1
In situ and real-time 3-D microtomography investigation of dendritic solidification in an Al–10wt.% Cu alloy
journal, April 2009
- Limodin, N.; Salvo, L.; Boller, E.
- Acta Materialia, Vol. 57, Issue 7
Probing Novel Microstructural Evolution Mechanisms in Aluminum Alloys Using 4D Nanoscale Characterization
journal, September 2017
- Kaira, C. Shashank; De Andrade, V.; Singh, Sudhanshu S.
- Advanced Materials, Vol. 29, Issue 41
Phase-contrast imaging using polychromatic hard X-rays
journal, November 1996
- Wilkins, S. W.; Gureyev, T. E.; Gao, D.
- Nature, Vol. 384, Issue 6607
Beam hardening artifacts in micro-computed tomography scanning can be reduced by X-ray beam filtration and the resulting images can be used to accurately measure BMD
journal, December 2009
- Meganck, Jeffrey A.; Kozloff, Kenneth M.; Thornton, Michael M.
- Bone, Vol. 45, Issue 6
The investigation of morphometric parameters of aluminium foams using micro-computed tomography
journal, May 2002
- Olurin, O. B.; Arnold, M.; Körner, C.
- Materials Science and Engineering: A, Vol. 328, Issue 1-2
Characterization of the morphology of cellular ceramics by 3D image processing of X-ray tomography
journal, January 2007
- Maire, Eric; Colombo, Paolo; Adrien, Jerome
- Journal of the European Ceramic Society, Vol. 27, Issue 4
State of 3-D micro-damage in hydrogen redistributed regions of precharged high strength aluminium alloy
journal, October 2016
- Gupta, C.; Toda, H.; Fujioka, T.
- Corrosion Science, Vol. 111
Quantitative assessment of microstructure and its effects on compression behavior of aluminum foams via high-resolution synchrotron X-ray tomography
journal, April 2006
- Toda, H.; Kobayashi, T.; Niinomi, M.
- Metallurgical and Materials Transactions A, Vol. 37, Issue 4
A 3D measurement procedure for internal local crack driving forces via synchrotron X-ray microtomography
journal, March 2004
- Toda, H.
- Acta Materialia, Vol. 52, Issue 5
Direct measurement procedure for three-dimensional local crack driving force using synchrotron X-ray microtomography
journal, December 2008
- Toda, H.; Yamamoto, S.; Kobayashi, M.
- Acta Materialia, Vol. 56, Issue 20
Interactive Segmentation with Intelligent Scissors
journal, September 1998
- Mortensen, Eric N.; Barrett, William A.
- Graphical Models and Image Processing, Vol. 60, Issue 5
High-efficiency Fresnel zone plates for hard X-rays by 100 keV e-beam lithography and electroplating
journal, March 2011
- Gorelick, Sergey; Vila-Comamala, Joan; Guzenko, Vitaliy A.
- Journal of Synchrotron Radiation, Vol. 18, Issue 3
Three-dimensional observation of nanoscopic precipitates in an aluminum alloy by microtomography with Fresnel zone plate optics
journal, October 2006
- Toda, H.; Uesugi, K.; Takeuchi, A.
- Applied Physics Letters, Vol. 89, Issue 14
Microstructural evolution and deformation behavior of Al-Cu alloys: A Transmission X-ray Microscopy (TXM) and micropillar compression study
journal, February 2018
- Kaira, C. Shashank; Kantzos, Christopher; Williams, Jason J.
- Acta Materialia, Vol. 144
Deep learning
journal, May 2015
- LeCun, Yann; Bengio, Yoshua; Hinton, Geoffrey
- Nature, Vol. 521, Issue 7553
Face recognition: a convolutional neural-network approach
journal, January 1997
- Lawrence, S.; Giles, C. L.
- IEEE Transactions on Neural Networks, Vol. 8, Issue 1
Gradient-based learning applied to document recognition
journal, January 1998
- Lecun, Y.; Bottou, L.; Bengio, Y.
- Proceedings of the IEEE, Vol. 86, Issue 11
Segmentation of Bone Structure in X-ray Images using Convolutional Neural Network
journal, January 2013
- Cernazanu-Glavan, C.; Holban, S.
- Advances in Electrical and Computer Engineering, Vol. 13, Issue 1
A convolutional neural network approach to calibrating the rotation axis for X-ray computed tomography
journal, January 2017
- Yang, Xiaogang; De Carlo, Francesco; Phatak, Charudatta
- Journal of Synchrotron Radiation, Vol. 24, Issue 2
TomoPy: a framework for the analysis of synchrotron tomographic data
journal, August 2014
- Gürsoy, Dogˇa; De Carlo, Francesco; Xiao, Xianghui
- Journal of Synchrotron Radiation, Vol. 21, Issue 5
Scientific data exchange: a schema for HDF5-based storage of raw and analyzed data
journal, October 2014
- De Carlo, Francesco; Gürsoy, Dogˇa; Marone, Federica
- Journal of Synchrotron Radiation, Vol. 21, Issue 6
Mechanisms of formation of θ and dissolution of θ′ precipitates in an Al-4% Cu alloy
journal, February 1966
- Laird, C.; Aaronson, H. I.
- Acta Metallurgica, Vol. 14, Issue 2
The Effect of Precipitate Shape and Orientation on Dispersion Strengthening in High Strength Aluminium Alloys
journal, May 1996
- Nie, Jian Feng; Muddle, Barry C.; Polmear, Ian J.
- Materials Science Forum, Vol. 217-222
Kinetics of growth of platelike precipitates
journal, August 1974
- Sankaran, R.; Laird, C.
- Acta Metallurgica, Vol. 22, Issue 8
Structure of Age-Hardened Aluminium-Copper Alloys
journal, September 1938
- Guinier, AndrÉ
- Nature, Vol. 142, Issue 3595
Age-hardening of copper-aluminium alloys
journal, January 1940
- Preston, G. D.
- Proceedings of the Physical Society, Vol. 52, Issue 1
NIH Image to ImageJ: 25 years of image analysis
journal, June 2012
- Schneider, Caroline A.; Rasband, Wayne S.; Eliceiri, Kevin W.
- Nature Methods, Vol. 9, Issue 7
A Computational Approach to Edge Detection
journal, November 1986
- Canny, John
- IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. PAMI-8, Issue 6
Multiscale modeling of θ′ precipitation in Al–Cu binary alloys
journal, June 2004
- Vaithyanathan, V.; Wolverton, C.; Chen, L. Q.
- Acta Materialia, Vol. 52, Issue 10
Works referencing / citing this record:
Semantic segmentation of synchrotron tomography of multiphase Al-Si alloys using a convolutional neural network with a pixel-wise weighted loss function
journal, December 2019
- Strohmann, Tobias; Bugelnig, Katrin; Breitbarth, Eric
- Scientific Reports, Vol. 9, Issue 1
SWIRL: High-performance many-core CPU code generation for deep neural networks
journal, May 2019
- Venkat, Anand; Rusira, Tharindu; Barik, Raj
- The International Journal of High Performance Computing Applications, Vol. 33, Issue 6
Tomographic reconstruction with a generative adversarial network
text, January 2020
- Yang, Xiaogang; Kahnt, Maik; Brückner, Dennis
- Deutsches Elektronen-Synchrotron, DESY, Hamburg
Tomographic reconstruction with a generative adversarial network
text, January 2020
- Yang, Xiaogang; Kahnt, Maik; Brückner, Dennis
- FID GEO
Semantic segmentation of synchrotron tomography of multiphase Al-Si alloys using a convolutional neural network with a pixel-wise weighted loss function
text, January 2019
- Strohmann, Tobias; Bugelnig, Katrin; Breitbarth, Eric
- RWTH Aachen University
Tomographic reconstruction with a generative adversarial network
text, January 2020
- Yang, Xiaogang; Kahnt, Maik; Brückner, Dennis
- Karlsruhe
Semantic segmentation of synchrotron tomography of multiphase Al-Si alloys using a convolutional neural network with a pixel-wise weighted loss function
text, January 2019
- Strohmann, Tobias; Bugelnig, Katrin; Breitbarth, Eric
- RWTH Aachen University
Figures / Tables found in this record:
Figures/Tables have been extracted from DOE-funded journal article accepted manuscripts.