Three-dimensional super line-localization in low signal-to-noise microscope images via prior-apprised unsupervised learning (PAUL)
Abstract
Biological processes such as processive enzyme turnover and intracellular cargo tracking involve the dynamic motion of a small "article" along a curvilinear biopolymer track. To understand these processes that occur across multiple length and time scales, one must acquire both the trajectory of the particle and the position of the track along which it moves, possibly by combining high-resolution single-particle tracking with conventional microscopy. Yet, usually there is a significant resolution mismatch between these modalities: while the tracked particle is localized with a precision of 10 nm, the image of the surroundings is limited by optical difraction, with 200 nm lateral and 500 nm axial resolutions. Compared to the particle's trajectory, the surrounding curvilinear structure appears as a blurred and noisy image. This disparity in the spatial resolutions of the particle trajectory and the surrounding curvilinear structure image makes data reconstruction, as well as interpretation, particularly challenging. Analysis is further complicated when the curvilinear structures are oriented arbitrarily in 3D space. Here, we present a prior-apprised unsupervised learning (PAUL) approach to extract information from 3D images where the underlying features resemble a curved line such as a filament or microtubule. This three-stage framework starts with a Hessian-based feature enhancement, whichmore »
- Authors:
-
- Princeton Univ., NJ (United States)
- Publication Date:
- Research Org.:
- Princeton Univ., NJ (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1650381
- Grant/Contract Number:
- SC0019364
- Resource Type:
- Accepted Manuscript
- Journal Name:
- SPIE Seminar Proceedings (Online)
- Additional Journal Information:
- Journal Name: SPIE Seminar Proceedings (Online); Journal Volume: 11510; Related Information: Applications of Digital Image Processing XLIII; Journal ID: ISSN 1996-756X
- Publisher:
- SPIE
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 42 ENGINEERING; Principal curves; super resolution; clustering; resolution matching
Citation Formats
Yin, Shuhui, Amin, M. Junaid, Emerson, Nyssa T., and Yang, Haw. Three-dimensional super line-localization in low signal-to-noise microscope images via prior-apprised unsupervised learning (PAUL). United States: N. p., 2020.
Web. doi:10.1117/12.2567752.
Yin, Shuhui, Amin, M. Junaid, Emerson, Nyssa T., & Yang, Haw. Three-dimensional super line-localization in low signal-to-noise microscope images via prior-apprised unsupervised learning (PAUL). United States. https://doi.org/10.1117/12.2567752
Yin, Shuhui, Amin, M. Junaid, Emerson, Nyssa T., and Yang, Haw. Fri .
"Three-dimensional super line-localization in low signal-to-noise microscope images via prior-apprised unsupervised learning (PAUL)". United States. https://doi.org/10.1117/12.2567752. https://www.osti.gov/servlets/purl/1650381.
@article{osti_1650381,
title = {Three-dimensional super line-localization in low signal-to-noise microscope images via prior-apprised unsupervised learning (PAUL)},
author = {Yin, Shuhui and Amin, M. Junaid and Emerson, Nyssa T. and Yang, Haw},
abstractNote = {Biological processes such as processive enzyme turnover and intracellular cargo tracking involve the dynamic motion of a small "article" along a curvilinear biopolymer track. To understand these processes that occur across multiple length and time scales, one must acquire both the trajectory of the particle and the position of the track along which it moves, possibly by combining high-resolution single-particle tracking with conventional microscopy. Yet, usually there is a significant resolution mismatch between these modalities: while the tracked particle is localized with a precision of 10 nm, the image of the surroundings is limited by optical difraction, with 200 nm lateral and 500 nm axial resolutions. Compared to the particle's trajectory, the surrounding curvilinear structure appears as a blurred and noisy image. This disparity in the spatial resolutions of the particle trajectory and the surrounding curvilinear structure image makes data reconstruction, as well as interpretation, particularly challenging. Analysis is further complicated when the curvilinear structures are oriented arbitrarily in 3D space. Here, we present a prior-apprised unsupervised learning (PAUL) approach to extract information from 3D images where the underlying features resemble a curved line such as a filament or microtubule. This three-stage framework starts with a Hessian-based feature enhancement, which is followed by feature registration, where local line segments are detected on repetitively sampled subimage tiles. In the final stage, statistical learning, segments are clustered based on their geometric relationships. Principal curves are then approximated from each segment group via statistical tools including principal component analysis, bootstrap and kernel transformation. This procedure is characterized on simulated images, where sub-voxel medium deviations from true curves have been achieved. The 3D PAUL approach has also been implemented for successful line localization in experimental 3D images of gold nanowires obtained using a multifocal microscope. Lastly, this work not only bridges the resolution gap between two microscopy modalities, but also allows us to conduct 3D super line-localization imaging experiments, without using super-resolution techniques.},
doi = {10.1117/12.2567752},
journal = {SPIE Seminar Proceedings (Online)},
number = ,
volume = 11510,
place = {United States},
year = {Fri Aug 21 00:00:00 EDT 2020},
month = {Fri Aug 21 00:00:00 EDT 2020}
}
Search WorldCat to find libraries that may hold this journal