DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Flat optics for image differentiation

Abstract

Image processing has become a critical technology in a variety of science and engineering disciplines. Although most image processing is performed digitally, optical analog processing has the advantages of being low-power and high-speed, but it requires a large volume. Here, we demonstrate flat optics for direct image differentiation, allowing us to significantly shrink the required optical system size. We first demonstrate how the differentiator can be combined with traditional imaging systems such as a commercial optical microscope and camera sensor for edge detection with a numerical aperture up to 0.32. We next demonstrate how the entire processing system can be realized as a monolithic compound flat optic by integrating the differentiator with a metalens. The compound nanophotonic system manifests the advantage of thin form factor as well as the ability to implement complex transfer functions, and could open new opportunities in applications such as biological imaging and computer vision.

Authors:
 [1];  [1]; ORCiD logo [2]; ORCiD logo [1]
  1. Vanderbilt Univ., Nashville, TN (United States)
  2. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Center for Nanophase Materials Science (CNMS)
Publication Date:
Research Org.:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Basic Energy Sciences (BES)
OSTI Identifier:
1619041
Grant/Contract Number:  
AC05-00OR22725
Resource Type:
Accepted Manuscript
Journal Name:
Nature Photonics
Additional Journal Information:
Journal Volume: 14; Journal Issue: 5; Journal ID: ISSN 1749-4885
Publisher:
Nature Publishing Group
Country of Publication:
United States
Language:
English
Subject:
36 MATERIALS SCIENCE

Citation Formats

Zhou, You, Zheng, Hanyu, Kravchenko, Ivan I., and Valentine, Jason. Flat optics for image differentiation. United States: N. p., 2020. Web. doi:10.1038/s41566-020-0591-3.
Zhou, You, Zheng, Hanyu, Kravchenko, Ivan I., & Valentine, Jason. Flat optics for image differentiation. United States. https://doi.org/10.1038/s41566-020-0591-3
Zhou, You, Zheng, Hanyu, Kravchenko, Ivan I., and Valentine, Jason. Mon . "Flat optics for image differentiation". United States. https://doi.org/10.1038/s41566-020-0591-3. https://www.osti.gov/servlets/purl/1619041.
@article{osti_1619041,
title = {Flat optics for image differentiation},
author = {Zhou, You and Zheng, Hanyu and Kravchenko, Ivan I. and Valentine, Jason},
abstractNote = {Image processing has become a critical technology in a variety of science and engineering disciplines. Although most image processing is performed digitally, optical analog processing has the advantages of being low-power and high-speed, but it requires a large volume. Here, we demonstrate flat optics for direct image differentiation, allowing us to significantly shrink the required optical system size. We first demonstrate how the differentiator can be combined with traditional imaging systems such as a commercial optical microscope and camera sensor for edge detection with a numerical aperture up to 0.32. We next demonstrate how the entire processing system can be realized as a monolithic compound flat optic by integrating the differentiator with a metalens. The compound nanophotonic system manifests the advantage of thin form factor as well as the ability to implement complex transfer functions, and could open new opportunities in applications such as biological imaging and computer vision.},
doi = {10.1038/s41566-020-0591-3},
journal = {Nature Photonics},
number = 5,
volume = 14,
place = {United States},
year = {Mon Feb 24 00:00:00 EST 2020},
month = {Mon Feb 24 00:00:00 EST 2020}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 169 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Improving quality inspection of food products by computer vision––a review
journal, January 2004


Multifunctional metaoptics based on bilayer metasurfaces
journal, September 2019


Inverse design in nanophotonics
journal, October 2018


Guided modes in photonic crystal fibers
journal, August 2003


Progress in 2D photonic crystal Fano resonance photonics
journal, January 2014


Flat optics with designer metasurfaces
journal, February 2014

  • Yu, Nanfang; Capasso, Federico
  • Nature Materials, Vol. 13, Issue 2, p. 139-150
  • DOI: 10.1038/nmat3839

High-efficiency guided-mode resonance filter
journal, January 1998


Nonlocal Metasurfaces for Optical Signal Processing
journal, October 2018


Performing Mathematical Operations with Metamaterials
journal, January 2014


Bound states in the continuum
journal, July 2016


Omnidirectional reflection from a one-dimensional photonic crystal
journal, January 1998

  • Winn, Joshua N.; Fink, Yoel; Fan, Shanhui
  • Optics Letters, Vol. 23, Issue 20, p. 1573-1575
  • DOI: 10.1364/OL.23.001573

Optical computation of the Laplace operator using phase-shifted Bragg grating
journal, January 2014

  • Bykov, Dmitry A.; Doskolovich, Leonid L.; Bezus, Evgeni A.
  • Optics Express, Vol. 22, Issue 21
  • DOI: 10.1364/OE.22.025084

Plasmonic computing of spatial differentiation
journal, May 2017

  • Zhu, Tengfeng; Zhou, Yihan; Lou, Yijie
  • Nature Communications, Vol. 8, Issue 1
  • DOI: 10.1038/ncomms15391

A Computational Approach to Edge Detection
journal, November 1986

  • Canny, John
  • IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. PAMI-8, Issue 6
  • DOI: 10.1109/TPAMI.1986.4767851

Moment-preserving edge detection and its application to image data compression
journal, January 1993


Multilayer Noninteracting Dielectric Metasurfaces for Multiwavelength Metaoptics
journal, November 2018


Subwavelength-thick lenses with high numerical apertures and large efficiency based on high-contrast transmitarrays
journal, May 2015

  • Arbabi, Amir; Horie, Yu; Ball, Alexander J.
  • Nature Communications, Vol. 6, Article No. 7069
  • DOI: 10.1038/ncomms8069

High-Index Dielectric Metasurfaces Performing Mathematical Operations
journal, October 2019


Analog optical computing
journal, October 2015


Topology-Optimized Multilayered Metaoptics
journal, April 2018


Optical edge detection based on high-efficiency dielectric metasurface
journal, May 2019

  • Zhou, Junxiao; Qian, Haoliang; Chen, Ching-Fu
  • Proceedings of the National Academy of Sciences, Vol. 116, Issue 23
  • DOI: 10.1073/pnas.1820636116

Meep: A flexible free-software package for electromagnetic simulations by the FDTD method
journal, March 2010

  • Oskooi, Ardavan F.; Roundy, David; Ibanescu, Mihai
  • Computer Physics Communications, Vol. 181, Issue 3, p. 687-702
  • DOI: 10.1016/j.cpc.2009.11.008

High-efficiency, large-area, topology-optimized metasurfaces
journal, May 2019


Edge detection in microscopy images using curvelets
journal, March 2009


Generalized Spatial Differentiation from the Spin Hall Effect of Light and Its Application in Image Processing of Edge Detection
journal, March 2019


Large-Scale All-Dielectric Metamaterial Perfect Reflectors
journal, May 2015


Metalenses at visible wavelengths: Diffraction-limited focusing and subwavelength resolution imaging
journal, June 2016

  • Khorasaninejad, Mohammadreza; Chen, Wei Ting; Devlin, Robert C.
  • Science, Vol. 352, Issue 6290
  • DOI: 10.1126/science.aaf6644

Photonic crystals: putting a new twist on light
journal, March 1997

  • Joannopoulos, J. D.; Villeneuve, Pierre R.; Fan, Shanhui
  • Nature, Vol. 386, Issue 6621
  • DOI: 10.1038/386143a0

Photonic crystal slab Laplace operator for image differentiation
journal, January 2018


Observation and Differentiation of Unique High-Q Optical Resonances Near Zero Wave Vector in Macroscopic Photonic Crystal Slabs
journal, August 2012


Spiral phase contrast imaging in microscopy
journal, January 2005

  • Fürhapter, Severin; Jesacher, Alexander; Bernet, Stefan
  • Optics Express, Vol. 13, Issue 3
  • DOI: 10.1364/OPEX.13.000689

Displacement-sensitive photonic crystal structures based on guided resonance in photonic crystal slabs
journal, March 2003

  • Suh, Wonjoo; Yanik, M. F.; Solgaard, Olav
  • Applied Physics Letters, Vol. 82, Issue 13
  • DOI: 10.1063/1.1563739

Dynamic Nonlinear Image Tuning through Magnetic Dipole Quasi‐BIC Ultrathin Resonators
journal, May 2019


Large-Angle, Multifunctional Metagratings Based on Freeform Multimode Geometries
journal, May 2017


Analysis of guided resonances in photonic crystal slabs
journal, June 2002