1
|
Zhang J, Wu H, Huang M, Dai X, Zhang T, Li Y, Yu X. Optical spatial differentiation enabled layer sensing of two-dimensional atomic crystals. OPTICS EXPRESS 2024; 32:16563-16577. [PMID: 38859280 DOI: 10.1364/oe.521257] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/08/2024] [Accepted: 04/02/2024] [Indexed: 06/12/2024]
Abstract
Zero-thickness model and slab model are two important models in the description of optical behaviors in two-dimensional atomic crystals. The predicted difference in optical behaviors between the two models is very small, which is difficult to distinguish by established measurement methods. Here, we present an optical spatial differentiation method to examine the difference in edge images of different graphene layers. The theoretical results show that the edge imaging is significantly different between the two different models. When the beam reflection is at the Brewster angle, different graphene layers are used to adjust the spatial differentiation. It is shown that the slab model is more sensitive to the number of graphene layers. The zero-thickness model is more suitable for one-dimensional optical differential operation. Moreover, the spatial differentiation plays the role of a band-pass filter. The high-frequency edge information components will pass through the filter, thus realizing layer-sensitive edge-enhanced imaging. In addition, we do not focus on the verification of the exact model, but only provide an alternative method to characterize the number of graphene layers based on two models, and also provide possibilities for achieving imaging edge detection by graphene differential operators. This study may provide a possible method for the optical characterization of two-dimensional atomic crystals.
Collapse
|
2
|
Swartz BT, Zheng H, Forcherio GT, Valentine J. Broadband and large-aperture metasurface edge encoders for incoherent infrared radiation. SCIENCE ADVANCES 2024; 10:eadk0024. [PMID: 38324688 PMCID: PMC10849589 DOI: 10.1126/sciadv.adk0024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Accepted: 01/09/2024] [Indexed: 02/09/2024]
Abstract
The prevalence of computer vision systems necessitates hardware-based approaches to relieve the high computational demand of deep neural networks in resource-limited applications. One solution would be to off-load low-level image feature extraction, such as edge detection, from the digital network to the analog imaging system. To that end, this work demonstrates incoherent, broadband, low-noise optical edge detection of real-world scenes by combining the wavefront shaping of a 24-mm aperture metasurface with a refractive lens. An inverse design approach is used to optimize the metasurface for Laplacian-based edge detection across the 7.5- to 13.5-μm LWIR imaging band, allowing for facile integration with uncooled microbolometer-based LWIR imagers to encode edge information. A polarization multiplexed approach leveraging a birefringent metasurface is also demonstrated as a single-aperture implementation. This work could be applied to improve computer vision capabilities of resource-constrained systems by leveraging optical preprocessing to alleviate the computational requirements for high-accuracy image segmentation and classification.
Collapse
Affiliation(s)
- Brandon T. Swartz
- Vanderbilt University, 2301 Vanderbilt Place, Nashville, TN 37235, USA
| | - Hanyu Zheng
- Vanderbilt University, 2301 Vanderbilt Place, Nashville, TN 37235, USA
| | | | - Jason Valentine
- Vanderbilt University, 2301 Vanderbilt Place, Nashville, TN 37235, USA
| |
Collapse
|
3
|
Wang S, Li L, Wen S, Liang R, Liu Y, Zhao F, Yang Y. Metalens for Accelerated Optoelectronic Edge Detection under Ambient Illumination. NANO LETTERS 2024; 24:356-361. [PMID: 38109180 DOI: 10.1021/acs.nanolett.3c04112] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/19/2023]
Abstract
Analog systems may allow image processing, such as edge detection, with low computational power. However, most demonstrated analog systems, based on either conventional 4-f imaging systems or nanophotonic structures, rely on coherent laser sources for illumination, which significantly restricts their use in routine imaging tasks with ambient, incoherent illumination. Here, we demonstrated a metalens-assisted imaging system that can allow optoelectronic edge detection under ambient illumination conditions. The metalens was designed to generate polarization-dependent optical transfer functions (OTFs), resulting in a synthetic OTF with an isotropic high-pass frequency response after digital subtraction. We integrated the polarization-multiplexed metalens with a polarization camera and experimentally demonstrated single-shot edge detection of indoor and outdoor scenes, including a flying airplane, under ambient sunlight illumination. The proposed system showcased the potential of using polarization multiplexing for the construction of complex optical convolution kernels toward accelerated machine vision tasks such as object detection and classification under ambient illumination.
Collapse
Affiliation(s)
- Shuai Wang
- State Key Laboratory for Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
- Qingdao Innovation and Development Center, Harbin Engineering University, Qingdao 26600, China
| | - Liu Li
- State Key Laboratory for Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Shun Wen
- State Key Laboratory for Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Ruiqi Liang
- State Key Laboratory for Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Yaxi Liu
- State Key Laboratory for Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Feng Zhao
- State Key Laboratory for Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Yuanmu Yang
- State Key Laboratory for Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| |
Collapse
|
4
|
Chu CH, Chia YH, Hsu HC, Vyas S, Tsai CM, Yamaguchi T, Tanaka T, Chen HW, Luo Y, Yang PC, Tsai DP. Intelligent Phase Contrast Meta-Microscope System. NANO LETTERS 2023; 23:11630-11637. [PMID: 38038680 DOI: 10.1021/acs.nanolett.3c03484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/02/2023]
Abstract
Phase contrast imaging techniques enable the visualization of disparities in the refractive index among various materials. However, these techniques usually come with a cost: the need for bulky, inflexible, and complicated configurations. Here, we propose and experimentally demonstrate an ultracompact meta-microscope, a novel imaging platform designed to accomplish both optical and digital phase contrast imaging. The optical phase contrast imaging system is composed of a pair of metalenses and an intermediate spiral phase metasurface located at the Fourier plane. The performance of the system in generating edge-enhanced images is validated by imaging a variety of human cells, including lung cell lines BEAS-2B, CLY1, and H1299 and other types. Additionally, we integrate the ResNet deep learning model into the meta-microscope to transform bright-field images into edge-enhanced images with high contrast accuracy. This technology promises to aid in the development of innovative miniature optical systems for biomedical and clinical applications.
Collapse
Affiliation(s)
- Cheng Hung Chu
- YongLin Institute of Health, National Taiwan University, Taipei 10672, Taiwan
| | - Yu-Hsin Chia
- Institute of Medical Device and Imaging, National Taiwan University, Taipei 10051, Taiwan
- Department of Biomedical Engineering, National Taiwan University, Taipei 10051, Taiwan
| | - Hung-Chuan Hsu
- Department of Mechanical Engineering, National Taiwan University, Taipei 10617, Taiwan
| | - Sunil Vyas
- Institute of Medical Device and Imaging, National Taiwan University, Taipei 10051, Taiwan
| | - Chen-Ming Tsai
- Institute of Medical Device and Imaging, National Taiwan University, Taipei 10051, Taiwan
| | - Takeshi Yamaguchi
- Innovative Photon Manipulation Research Team, RIKEN Center for Advanced Photonics, Saitama 351-0198, Japan
| | - Takuo Tanaka
- Innovative Photon Manipulation Research Team, RIKEN Center for Advanced Photonics, Saitama 351-0198, Japan
| | - Huei-Wen Chen
- Graduate Institute of Toxicology, College of Medicine, National Taiwan University, Taipei 100, Taiwan
- Genome and Systems Biology Degree Program, National Taiwan University and Academia Sinica, Taipei 100, Taiwan
| | - Yuan Luo
- YongLin Institute of Health, National Taiwan University, Taipei 10672, Taiwan
- Institute of Medical Device and Imaging, National Taiwan University, Taipei 10051, Taiwan
- Department of Biomedical Engineering, National Taiwan University, Taipei 10051, Taiwan
- Program for Precision Health and Intelligent Medicine, National Taiwan University, Taipei 106319, Taiwan, R.O.C
| | - Pan-Chyr Yang
- YongLin Institute of Health, National Taiwan University, Taipei 10672, Taiwan
- Program for Precision Health and Intelligent Medicine, National Taiwan University, Taipei 106319, Taiwan, R.O.C
- Department of Internal Medicine, National Taiwan University Hospital, National Taiwan University, Taipei 10002, Taiwan
- Institute of Biomedical Sciences, Academia Sinica, Taipei 11529, Taiwan
| | - Din Ping Tsai
- Department of Electrical Engineering, City University of Hong Kong, Kowloon 999077, Hong Kong
- Centre for Biosystems, Neuroscience, and Nanotechnology, City University of Hong Kong, Kowloon 999077, Hong Kong
- The State Key Laboratory of Terahertz and Millimeter Waves, City University of Hong Kong, Kowloon 99907, Hong Kong
| |
Collapse
|
5
|
Zhang J, Zhou S, Dai X, Huang M, Yu X. All-optical image edge detection based on the two-dimensional photonic spin Hall effect in anisotropic metamaterial. OPTICS EXPRESS 2023; 31:6062-6075. [PMID: 36823872 DOI: 10.1364/oe.476492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/26/2022] [Accepted: 01/12/2023] [Indexed: 06/18/2023]
Abstract
Optical image processing based on the photonic spin Hall effect (SHE) has been gaining significant attention as a convenient and an accurate way for image edge detection. However, the recent edge imaging techniques depending on optical differentiation is mainly achieved by modulation of one-dimensional photonic SHE. Here, we theoretically predict the two-dimensional photonic SHE in the anisotropic metamaterial, and find that its longitudinal and transverse displacements exhibit spin-dependent property at filling factors with increasing incidence angle. As the transverse and in-plane displacements induced by the photonic SHE can be controlled by the filling factor of the crystal structure, the optical axis angle, and the incident angle, this intrinsical effect can be used to realize a tunable edge imaging. Interestingly, by changing the optical axis of the anisotropic metamaterial, the in-plane displacements are equal to the transverse displacements for a certain filling factor and the corresponding incident angle. Therefore, we propose a two-dimensional image edge detection method based on the photonic SHE in anisotropic metamaterial. Further numerical results validate the theoretical proposal.
Collapse
|
6
|
Electric-Driven Polarization Meta-Optics for Tunable Edge-Enhanced Images. MICROMACHINES 2022; 13:mi13040541. [PMID: 35457846 PMCID: PMC9024918 DOI: 10.3390/mi13040541] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/27/2022] [Revised: 03/25/2022] [Accepted: 03/28/2022] [Indexed: 11/16/2022]
Abstract
In this study, we demonstrate an electrically driven, polarization-controlled metadevice to achieve tunable edge-enhanced images. The metadevice was elaborately designed by integrating single-layer metalens with a liquid-crystal plate to control the incident polarization. By modulating electric-driven voltages applied on the liquid-crystal plate, the metalens can provide two polarization-dependent phase profiles (hyperbolic phase and focusing spiral phase). Therefore, the metalens can perform two-dimensional focusing and spatial differential operation on an incident optical field, allowing dynamic switching between the bright-field imaging and the edge-enhanced imaging. Capitalizing on the compactness and dynamic tuning of the proposed metadevice, our scheme carves a promising path to image processing and biomedical imaging technology.
Collapse
|
7
|
Liu W, Huang L, Ding J, Xie C, Luo Y, Hong W. High-Performance Asymmetric Optical Transmission Based on a Dielectric-Metal Metasurface. NANOMATERIALS (BASEL, SWITZERLAND) 2021; 11:2410. [PMID: 34578726 PMCID: PMC8468262 DOI: 10.3390/nano11092410] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/22/2021] [Revised: 09/12/2021] [Accepted: 09/14/2021] [Indexed: 01/28/2023]
Abstract
Asymmetric optical transmission plays a key role in many optical systems. In this work, we propose and numerically demonstrate a dielectric-metal metasurface that can achieve high-performance asymmetric transmission for linearly polarized light in the near-infrared region. Most notably, it supports a forward transmittance peak (with a transmittance of 0.70) and a backward transmittance dip (with a transmittance of 0.07) at the same wavelength of 922 nm, which significantly enhances operation bandwidth and the contrast ratio between forward and backward transmittances. Mechanism analyses reveal that the forward transmittance peak is caused by the unidirectional excitation of surface plasmon polaritons and the first Kerker condition, whereas the backward transmittance dip is due to reflection from the metal film and a strong toroidal dipole response. Our work provides an alternative and simple way to obtain high-performance asymmetric transmission devices.
Collapse
Affiliation(s)
| | - Lirong Huang
- Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, 1037 Luoyu Rd, Wuhan 430074, China; (W.L.); (J.D.); (C.X.); (Y.L.)
| | | | | | | | - Wei Hong
- Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, 1037 Luoyu Rd, Wuhan 430074, China; (W.L.); (J.D.); (C.X.); (Y.L.)
| |
Collapse
|
8
|
Xu C, Wang Y, Zhang C, Dagens B, Zhang X. Optical spatiotemporal differentiator using a bilayer plasmonic grating. OPTICS LETTERS 2021; 46:4418-4421. [PMID: 34470030 DOI: 10.1364/ol.436033] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2021] [Accepted: 08/11/2021] [Indexed: 06/13/2023]
Abstract
As a key element in wave-based analog computation, optical differentiators have been implemented to directly perform information processing, such as edge detection and pulse shaping, in both spatial and temporal domains. Here, we propose an optical spatiotemporal differentiator, which simultaneously performs first-order spatial and temporal differentiation in transmission by breaking the mirror symmetry of a subwavelength bilayer metal grating. The spatial and temporal performance of the plasmonic differentiator is evaluated numerically using the output field profiles of an optical beam and pulse envelope, showing resolutions of ∼2µm and ∼50fs, respectively. Moreover, the function of spatiotemporal differentiation is demonstrated with input flat-top pulse fields. The proposed optical differentiator has potential applications in ultra-compact real-time optical multifunctional computing systems and parallel signal processing.
Collapse
|
9
|
Xie C, Huang L, Liu W, Hong W, Ding J, Wu W, Guo M. Bifocal focusing and polarization demultiplexing by a guided wave-driven metasurface. OPTICS EXPRESS 2021; 29:25709-25719. [PMID: 34614894 DOI: 10.1364/oe.431619] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/17/2021] [Accepted: 07/19/2021] [Indexed: 06/13/2023]
Abstract
Metasurfaces have shown extraordinary light-manipulation abilities, however, most of them deal with free-space waves. It is highly desirable to develop a guided wave-driven metasurface which can extract the in-plane guided modes in the waveguide and mold it into the desired out-of-plane free-space modes. In this paper, an all-dielectric guided wave-driven metasurface, composed of an array of silicon meta-atoms on top of a silicon nitride waveguide, is proposed and simulatively demonstrated. When directly driven by fundamental transverse electric (TE00) and fundamental transverse magnetic (TM00) guided modes at operation wavelength 1.55 µm, the guided wave-driven metasurface converts them into y-polarized and x-polarized free-space light, respectively, and focuses them at different focal points, with polarization extinction ratio over 27 dB, thus simultaneously realizing triple functions of coupling guided modes to free-space waves, bifocal metalens and polarization demultiplexing. Our work offers an alternate way to control light across photonic integrated devices and free-space platforms.
Collapse
|
10
|
Zhang C, Tsai DP. Preface to the special issue on "Recent Advances in Optical Metasurfaces". FRONTIERS OF OPTOELECTRONICS 2021; 14:131-133. [PMID: 36637671 PMCID: PMC9743835 DOI: 10.1007/s12200-021-1251-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/21/2021] [Indexed: 06/14/2023]
Affiliation(s)
- Cheng Zhang
- School of Optical and Electronic Information & Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, 430074, China.
| | - Din-Ping Tsai
- Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, Hong Kong, 999077, China.
| |
Collapse
|