Flat optics for image differentiation
Abstract
Image processing has become a critical technology in a variety of science and engineering disciplines. Although most image processing is performed digitally, optical analog processing has the advantages of being low-power and high-speed, but it requires a large volume. Here, we demonstrate flat optics for direct image differentiation, allowing us to significantly shrink the required optical system size. We first demonstrate how the differentiator can be combined with traditional imaging systems such as a commercial optical microscope and camera sensor for edge detection with a numerical aperture up to 0.32. We next demonstrate how the entire processing system can be realized as a monolithic compound flat optic by integrating the differentiator with a metalens. The compound nanophotonic system manifests the advantage of thin form factor as well as the ability to implement complex transfer functions, and could open new opportunities in applications such as biological imaging and computer vision.
- Authors:
-
- Vanderbilt Univ., Nashville, TN (United States)
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Center for Nanophase Materials Science (CNMS)
- Publication Date:
- Research Org.:
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), Basic Energy Sciences (BES)
- OSTI Identifier:
- 1619041
- Grant/Contract Number:
- AC05-00OR22725
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Nature Photonics
- Additional Journal Information:
- Journal Volume: 14; Journal Issue: 5; Journal ID: ISSN 1749-4885
- Publisher:
- Nature Publishing Group
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 36 MATERIALS SCIENCE
Citation Formats
Zhou, You, Zheng, Hanyu, Kravchenko, Ivan I., and Valentine, Jason. Flat optics for image differentiation. United States: N. p., 2020.
Web. doi:10.1038/s41566-020-0591-3.
Zhou, You, Zheng, Hanyu, Kravchenko, Ivan I., & Valentine, Jason. Flat optics for image differentiation. United States. https://doi.org/10.1038/s41566-020-0591-3
Zhou, You, Zheng, Hanyu, Kravchenko, Ivan I., and Valentine, Jason. Mon .
"Flat optics for image differentiation". United States. https://doi.org/10.1038/s41566-020-0591-3. https://www.osti.gov/servlets/purl/1619041.
@article{osti_1619041,
title = {Flat optics for image differentiation},
author = {Zhou, You and Zheng, Hanyu and Kravchenko, Ivan I. and Valentine, Jason},
abstractNote = {Image processing has become a critical technology in a variety of science and engineering disciplines. Although most image processing is performed digitally, optical analog processing has the advantages of being low-power and high-speed, but it requires a large volume. Here, we demonstrate flat optics for direct image differentiation, allowing us to significantly shrink the required optical system size. We first demonstrate how the differentiator can be combined with traditional imaging systems such as a commercial optical microscope and camera sensor for edge detection with a numerical aperture up to 0.32. We next demonstrate how the entire processing system can be realized as a monolithic compound flat optic by integrating the differentiator with a metalens. The compound nanophotonic system manifests the advantage of thin form factor as well as the ability to implement complex transfer functions, and could open new opportunities in applications such as biological imaging and computer vision.},
doi = {10.1038/s41566-020-0591-3},
journal = {Nature Photonics},
number = 5,
volume = 14,
place = {United States},
year = {Mon Feb 24 00:00:00 EST 2020},
month = {Mon Feb 24 00:00:00 EST 2020}
}
Web of Science
Works referenced in this record:
Improving quality inspection of food products by computer vision––a review
journal, January 2004
- Brosnan, Tadhg; Sun, Da-Wen
- Journal of Food Engineering, Vol. 61, Issue 1
Multifunctional metaoptics based on bilayer metasurfaces
journal, September 2019
- Zhou, You; Kravchenko, Ivan I.; Wang, Hao
- Light: Science & Applications, Vol. 8, Issue 1
Inverse design in nanophotonics
journal, October 2018
- Molesky, Sean; Lin, Zin; Piggott, Alexander Y.
- Nature Photonics, Vol. 12, Issue 11
Guided modes in photonic crystal fibers
journal, August 2003
- Krivenkov, V. I.
- Doklady Physics, Vol. 48, Issue 8
Progress in 2D photonic crystal Fano resonance photonics
journal, January 2014
- Zhou, Weidong; Zhao, Deyin; Shuai, Yi-Chen
- Progress in Quantum Electronics, Vol. 38, Issue 1
Flat optics with designer metasurfaces
journal, February 2014
- Yu, Nanfang; Capasso, Federico
- Nature Materials, Vol. 13, Issue 2, p. 139-150
High-efficiency guided-mode resonance filter
journal, January 1998
- Liu, Z. S.; Tibuleac, S.; Shin, D.
- Optics Letters, Vol. 23, Issue 19
Nonlocal Metasurfaces for Optical Signal Processing
journal, October 2018
- Kwon, Hoyeong; Sounas, Dimitrios; Cordaro, Andrea
- Physical Review Letters, Vol. 121, Issue 17
Performing Mathematical Operations with Metamaterials
journal, January 2014
- Silva, A.; Monticone, F.; Castaldi, G.
- Science, Vol. 343, Issue 6167
Bound states in the continuum
journal, July 2016
- Hsu, Chia Wei; Zhen, Bo; Stone, A. Douglas
- Nature Reviews Materials, Vol. 1, Issue 9
Omnidirectional reflection from a one-dimensional photonic crystal
journal, January 1998
- Winn, Joshua N.; Fink, Yoel; Fan, Shanhui
- Optics Letters, Vol. 23, Issue 20, p. 1573-1575
Optical computation of the Laplace operator using phase-shifted Bragg grating
journal, January 2014
- Bykov, Dmitry A.; Doskolovich, Leonid L.; Bezus, Evgeni A.
- Optics Express, Vol. 22, Issue 21
Plasmonic computing of spatial differentiation
journal, May 2017
- Zhu, Tengfeng; Zhou, Yihan; Lou, Yijie
- Nature Communications, Vol. 8, Issue 1
A Computational Approach to Edge Detection
journal, November 1986
- Canny, John
- IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. PAMI-8, Issue 6
Moment-preserving edge detection and its application to image data compression
journal, January 1993
- Hsu, Hua-Sheng
- Optical Engineering, Vol. 32, Issue 7
Multilayer Noninteracting Dielectric Metasurfaces for Multiwavelength Metaoptics
journal, November 2018
- Zhou, You; Kravchenko, Ivan I.; Wang, Hao
- Nano Letters, Vol. 18, Issue 12
Subwavelength-thick lenses with high numerical apertures and large efficiency based on high-contrast transmitarrays
journal, May 2015
- Arbabi, Amir; Horie, Yu; Ball, Alexander J.
- Nature Communications, Vol. 6, Article No. 7069
High-Index Dielectric Metasurfaces Performing Mathematical Operations
journal, October 2019
- Cordaro, Andrea; Kwon, Hoyeong; Sounas, Dimitrios
- Nano Letters, Vol. 19, Issue 12
Analog optical computing
journal, October 2015
- Solli, Daniel R.; Jalali, Bahram
- Nature Photonics, Vol. 9, Issue 11
Topology-Optimized Multilayered Metaoptics
journal, April 2018
- Lin, Zin; Groever, Benedikt; Capasso, Federico
- Physical Review Applied, Vol. 9, Issue 4
Optical edge detection based on high-efficiency dielectric metasurface
journal, May 2019
- Zhou, Junxiao; Qian, Haoliang; Chen, Ching-Fu
- Proceedings of the National Academy of Sciences, Vol. 116, Issue 23
Meep: A flexible free-software package for electromagnetic simulations by the FDTD method
journal, March 2010
- Oskooi, Ardavan F.; Roundy, David; Ibanescu, Mihai
- Computer Physics Communications, Vol. 181, Issue 3, p. 687-702
High-efficiency, large-area, topology-optimized metasurfaces
journal, May 2019
- Phan, Thaibao; Sell, David; Wang, Evan W.
- Light: Science & Applications, Vol. 8, Issue 1
Edge detection in microscopy images using curvelets
journal, March 2009
- Gebäck, Tobias; Koumoutsakos, Petros
- BMC Bioinformatics, Vol. 10, Issue 1
Generalized Spatial Differentiation from the Spin Hall Effect of Light and Its Application in Image Processing of Edge Detection
journal, March 2019
- Zhu, Tengfeng; Lou, Yijie; Zhou, Yihan
- Physical Review Applied, Vol. 11, Issue 3
Large-Scale All-Dielectric Metamaterial Perfect Reflectors
journal, May 2015
- Moitra, Parikshit; Slovick, Brian A.; li, Wei
- ACS Photonics, Vol. 2, Issue 6
Metalenses at visible wavelengths: Diffraction-limited focusing and subwavelength resolution imaging
journal, June 2016
- Khorasaninejad, Mohammadreza; Chen, Wei Ting; Devlin, Robert C.
- Science, Vol. 352, Issue 6290
Photonic crystals: putting a new twist on light
journal, March 1997
- Joannopoulos, J. D.; Villeneuve, Pierre R.; Fan, Shanhui
- Nature, Vol. 386, Issue 6621
Photonic crystal slab Laplace operator for image differentiation
journal, January 2018
- Guo, Cheng; Xiao, Meng; Minkov, Momchil
- Optica, Vol. 5, Issue 3
Observation and Differentiation of Unique High- Optical Resonances Near Zero Wave Vector in Macroscopic Photonic Crystal Slabs
journal, August 2012
- Lee, Jeongwon; Zhen, Bo; Chua, Song-Liang
- Physical Review Letters, Vol. 109, Issue 6, Article No. 067401
Spiral phase contrast imaging in microscopy
journal, January 2005
- Fürhapter, Severin; Jesacher, Alexander; Bernet, Stefan
- Optics Express, Vol. 13, Issue 3
Displacement-sensitive photonic crystal structures based on guided resonance in photonic crystal slabs
journal, March 2003
- Suh, Wonjoo; Yanik, M. F.; Solgaard, Olav
- Applied Physics Letters, Vol. 82, Issue 13
Dynamic Nonlinear Image Tuning through Magnetic Dipole Quasi‐BIC Ultrathin Resonators
journal, May 2019
- Xu, Lei; Zangeneh Kamali, Khosro; Huang, Lujun
- Advanced Science
Large-Angle, Multifunctional Metagratings Based on Freeform Multimode Geometries
journal, May 2017
- Sell, David; Yang, Jianji; Doshay, Sage
- Nano Letters, Vol. 17, Issue 6
Analysis of guided resonances in photonic crystal slabs
journal, June 2002
- Fan, Shanhui; Joannopoulos, J. D.
- Physical Review B, Vol. 65, Issue 23, Article No. 235112