Monocular metasurface camera for passive single-shot 4D imaging

Real-time machine learning-enhanced hyperspectro-polarimetric imaging via an encoding metasurface

Light fields carry a wealth of information, including intensity, spectrum, and polarization. However, standard cameras capture only the intensity, disregarding other valuable information. While hyperspectral and polarimetric imaging systems capture spectral and polarization information, respectively, in addition to intensity, they are often bulky, slow, and costly. Here, we have developed an encoding metasurface paired with a neural network enabling a normal camera to acquire hyperspectro-polarimetric images from a single snapshot. Our experimental results demonstrate that this metasurface-enhanced camera can accurately resolve full-Stokes polarization across a broad spectral range (700 to 1150 nanometer) from a single snapshot, achieving a spectral sensitivity as high as 0.23 nanometer. In addition, our system captures full-Stokes hyperspectro-polarimetric video in real time at a rate of 28 frames per second, primarily limited by the camera's readout rate. Our encoding metasurface offers a compact, fast, and cost-effective solution for multidimensional imaging that effectively uses information within light fields.

Aberration-robust monocular passive depth sensing using a meta-imaging camera

Depth sensing plays a crucial role in various applications, including robotics, augmented reality, and autonomous driving. Monocular passive depth sensing techniques have come into their own for the cost-effectiveness and compact design, offering an alternative to the expensive and bulky active depth sensors and stereo vision systems. While the light-field camera can address the defocus ambiguity inherent in 2D cameras and achieve unambiguous depth perception, it compromises the spatial resolution and usually struggles with the effect of optical aberration. In contrast, our previously proposed meta-imaging sensor1 has overcome such hurdles by reconciling the spatial-angular resolution trade-off and achieving the multi-site aberration correction for high-resolution imaging. Here, we present a compact meta-imaging camera and an analytical framework for the quantification of monocular depth sensing precision by calculating the Cramér-Rao lower bound of depth estimation. Quantitative evaluations reveal that the meta-imaging camera exhibits not only higher precision over a broader depth range than the light-field camera but also superior robustness against changes in signal-background ratio. Moreover, both the simulation and experimental results demonstrate that the meta-imaging camera maintains the capability of providing precise depth information even in the presence of aberrations. Showing the promising compatibility with other point-spread-function engineering methods, we anticipate that the meta-imaging camera may facilitate the advancement of monocular passive depth sensing in various applications.

Nanowatt all-optical 3D perception for mobile robotics

Three-dimensional (3D) perception is vital to drive mobile robotics' progress toward intelligence. However, state-of-the-art 3D perception solutions require complicated postprocessing or point-by-point scanning, suffering computational burden, latency of tens of milliseconds, and additional power consumption. Here, we propose a parallel all-optical computational chipset 3D perception architecture (Aop3D) with nanowatt power and light speed. The 3D perception is executed during the light propagation over the passive chipset, and the captured light intensity distribution provides a direct reflection of the depth map, eliminating the need for extensive postprocessing. The prototype system of Aop3D is tested in various scenarios and deployed to a mobile robot, demonstrating unprecedented performance in distance detection and obstacle avoidance. Moreover, Aop3D works at a frame rate of 600 hertz and a power consumption of 33.3 nanowatts per meta-pixel experimentally. Our work is promising toward next-generation direct 3D perception techniques with light speed and high energy efficiency.

Integrated optical rotation detection scheme for chip-scale atomic magnetometer empowered by silicon-rich SiNx metalens

High-performance atomic magnetometers (AMs) rely on the measurement of optical rotation, which requires a set of bulky polarization optics that limit their applications in scenarios where portability and compactness are necessary. In this study, a miniaturized AM is constructed based on a cubic 87Rb vapor cell and monolithic metalens, which provides an integrated scheme to achieve optical rotation detection induced by the circular birefringence of polarized atoms. The designed metalens achieves polarization splitting with deflection angles of ±10∘ and focusing with efficiencies of approximately 30% for orthogonal linear polarizations. The sensitivity of our compact device is ∼30 fT/Hz1/2 with a dynamic range of around ±1.45 nT. We envision that the presented approach paves the way for the chip integration of emerging atomic devices, which are in demand for applications such as biomagnetic imaging and portable atomic gyroscopes.

Ultra-robust informational metasurfaces based on spatial coherence structures engineering

Optical information transmission is vital in modern optics and photonics due to its concurrent and multi-dimensional nature, leading to tremendous applications such as optical microscopy, holography, and optical sensing. Conventional optical information transmission technologies suffer from bulky optical setup and information loss/crosstalk when meeting scatterers or obstacles in the light path. Here, we theoretically propose and experimentally realize the simultaneous manipulation of the coherence lengths and coherence structures of the light beams with the disordered metasurfaces. The ultra-robust optical information transmission and self-reconstruction can be realized by the generated partially coherent beam with modulated coherence structure even 93% of light is recklessly obstructed during light transmission, which brings new light to robust optical information transmission with a single metasurface. Our method provides a generic principle for the generalized coherence manipulation on the photonic platform and displays a variety of functionalities advancing capabilities in optical information transmission such as meta-holography and imaging in disordered and perturbative media.

Broadband achromatic and wide field of view metalens-doublet by inverse design

Metalenses, composed of patterned meta-atoms in various dimensions, offer tailored modulation of phase, amplitude, and polarization for diverse imaging applications across the visible and near-infrared spectra. However, simultaneously achieving achromatic and wide field of view (WFOV) imaging remains a significant challenge. In this paper, we propose a general inverse design framework for metalens-doublets that simultaneously enables broadband achromatic and WFOV imaging. The broadband achromatic and WFOV (BA&WFOV) metalens-doublet comprises a propagation phase metalens and a geometric phase metalens positioned on opposite sides of the substrate. This framework requires only once polarization conversion and mitigates aperture size constraints imposed by the limited group delay (GD) range of meta-atoms. We present a BA&WFOV metalens-doublet with an f-number of 3.9, a full field of view (FOV) of 68°, and a wavelength range from 640nm to 820nm. This metalens-doublet exhibits diffraction-limited focusing with an average absolute focusing efficiency of 16% and an average relative focusing efficiency of 60%. This innovative framework holds significant promise for applications in fields such as phone cameras, VR/AR, and endoscopes.

Metasurface array for single-shot spectroscopic ellipsometry

Spectroscopic ellipsometry is a potent method that is widely adopted for the measurement of thin film thickness and refractive index. Most conventional ellipsometers utilize mechanically rotating polarizers and grating-based spectrometers for spectropolarimetric detection. Here, we demonstrated a compact metasurface array-based spectroscopic ellipsometry system that allows single-shot spectropolarimetric detection and accurate determination of thin film properties without any mechanical movement. The silicon-based metasurface array with a highly anisotropic and diverse spectral response is combined with iterative optimization to reconstruct the full Stokes polarization spectrum of the light reflected by the thin film with high fidelity. Subsequently, the film thickness and refractive index can be determined by fitting the measurement results to a proper material model with high accuracy. Our approach opens up a new pathway towards a compact and robust spectroscopic ellipsometry system for the high throughput measurement of thin film properties.

Multichannel meta-imagers for accelerating machine vision

Rapid developments in machine vision technology have impacted a variety of applications, such as medical devices and autonomous driving systems. These achievements, however, typically necessitate digital neural networks with the downside of heavy computational requirements and consequent high energy consumption. As a result, real-time decision-making is hindered when computational resources are not readily accessible. Here we report a meta-imager designed to work together with a digital back end to offload computationally expensive convolution operations into high-speed, low-power optics. In this architecture, metasurfaces enable both angle and polarization multiplexing to create multiple information channels that perform positively and negatively valued convolution operations in a single shot. We use our meta-imager for object classification, achieving 98.6% accuracy in handwritten digits and 88.8% accuracy in fashion images. Owing to its compactness, high speed and low power consumption, our approach could find a wide range of applications in artificial intelligence and machine vision applications.

Poincaré sphere trajectory encoding metasurfaces based on generalized Malus' law

As a fundamental property of light, polarization serves as an excellent information encoding carrier, playing significant roles in many optical applications, including liquid crystal displays, polarization imaging, optical computation and encryption. However, conventional polarization information encoding schemes based on Malus' law usually consider 1D polarization projections on a linear basis, implying that their encoding flexibility is largely limited. Here, we propose a Poincaré sphere (PS) trajectory encoding approach with metasurfaces that leverages a generalized form of Malus' law governing universal 2D projections between arbitrary elliptical polarization pairs spanning the entire PS. Arbitrary polarization encodings are realized by engineering PS trajectories governed by either arbitrary analytic functions or aligned modulation grids of interest, leading to versatile polarization image transformation functionalities, including histogram stretching, thresholding and image encryption within non-orthogonal PS loci. Our work significantly expands the encoding dimensionality of polarization information, unveiling new opportunities for metasurfaces in polarization optics for both quantum and classical regimes.

Multifunctional metalens optical tweezers for optical information recognition

Traditional optical information recognition (OIR), particle capture and manipulation require many optical devices or mechanical moving system components to achieve a specific function, which is difficult to achieve integration. This paper proposes a new method to realize these functions by using multi-focus metalens combining spectrum and polarization selection. The design incorporates three spectral bands, namely 500 nm, 580 nm, and 660 nm, within the visible light range. Additionally, it utilizes either left-handed or right-handed circularly polarized (LCP/RCP) light, resulting in six distinct focus focusing effects on a single focal plane. By analyzing the normalized light intensity (NLI) at the corresponding focus position, the OIR of any wavelength and polarization detection in the design can be realized, and the particle capture at different focusing positions can be realized. Our work can provide a new idea for the high integration of on-chip light recognition and operation and inspire the design of a highly integrated optical system with a smaller size and more substantial function.

Metalens for Accelerated Optoelectronic Edge Detection under Ambient Illumination

Analog systems may allow image processing, such as edge detection, with low computational power. However, most demonstrated analog systems, based on either conventional 4-f imaging systems or nanophotonic structures, rely on coherent laser sources for illumination, which significantly restricts their use in routine imaging tasks with ambient, incoherent illumination. Here, we demonstrated a metalens-assisted imaging system that can allow optoelectronic edge detection under ambient illumination conditions. The metalens was designed to generate polarization-dependent optical transfer functions (OTFs), resulting in a synthetic OTF with an isotropic high-pass frequency response after digital subtraction. We integrated the polarization-multiplexed metalens with a polarization camera and experimentally demonstrated single-shot edge detection of indoor and outdoor scenes, including a flying airplane, under ambient sunlight illumination. The proposed system showcased the potential of using polarization multiplexing for the construction of complex optical convolution kernels toward accelerated machine vision tasks such as object detection and classification under ambient illumination.

Single-shot deterministic complex amplitude imaging with a single-layer metalens

Conventional imaging systems can only capture light intensity. Meanwhile, the lost phase information may be critical for a variety of applications such as label-free microscopy and optical metrology. Existing phase retrieval techniques typically require a bulky setup, multiframe measurements, or prior information of the target scene. Here, we proposed an extremely compact system for complex amplitude imaging, leveraging the extreme versatility of a single-layer metalens to generate spatially multiplexed and polarization phase-shifted point spread functions. Combining the metalens with a polarization camera, the system can simultaneously record four polarization shearing interference patterns along both in-plane directions, thus allowing the deterministic reconstruction of the complex amplitude light field in a single shot. Using an incoherent light-emitting diode as the illumination, we experimentally demonstrated speckle-noise-free complex amplitude imaging for both static and moving objects with tailored magnification ratio and field of view. The miniaturized and robust system may open the door for complex amplitude imaging in portable devices for point-of-care applications.

Polarization Reversal of Group IV-VI Semiconductors with Pucker-Like Structure: Mechanism Dissecting and Function Demonstration

Polarization imaging presents advantages in capturing spatial, spectral, and polarization information across various spectral bands. It can improve the perceptual ability of image sensors and has garnered more applications. Despite its potential, challenges persist in identifying band information and implementing image enhancement using polarization imaging. These challenges often necessitate integrating spectrometers or other components, resulting in increased complexities within image processing systems and hindering device miniaturization trends. Here, the characteristics of anisotropic absorption reversal are systematically elucidated in pucker-like group IV-VI semiconductors MX (M = Ge, Sn; X = S, Se) through theoretical predictions and experimental validations. Additionally, the fundamental mechanisms behind anisotropy reversal in different bands are also explored. The photodetector is constructed by utilizing MX as a light-absorbing layer, harnessing polarization-sensitive photoresponse for virtual imaging. The results indicate that the utilization of polarization reversal photodetectors holds advantages in achieving further multifunctional integration within the device structure while simplifying its configuration, including band information identification and image enhancement. This study provides a comprehensive analysis of polarization reversal mechanisms and presents a promising and reliable approach for achieving dual-band image band identification and image enhancement without additional auxiliary components.

Characterization of interaction phenomena of electromagnetic waves with metamaterials via microwave near-field visualization technique

A new practical imaging technique was presented for metamaterial characterization and investigation by visualizations of the magnetic microwave near-field (H-MWNF) distributions on a metamaterial's surface using the method of thermo-elastic optical indicator microscopy (TEOIM). ITO-based transparent and ceramic-based opaque metamaterial structures were designed for magnetic near-field visualization. Depending on the incident microwave field polarization, the TEOIM system allows the characterization of the metamaterial properties and microwave interaction behavior. The working principle of the periodic structures was investigated through numerical simulations, and the obtained results exhibited strong agreement when compared with experimental observations. Moreover, the visualization of the H-MWNF revealed the potential to characterize and evaluate the absorption and transmission properties effectively.

Transmission-type photonic doping for high-efficiency epsilon-near-zero supercoupling

Supercoupling effect is an exotic and counterintuitive physical phenomenon of epsilon-near-zero (ENZ) media, in which the light can be "squeezed" and tunneled through flexible channels substantially narrower than its wavelength. Theoretically, ENZ channels with infinitely small widths perform ideal supercoupling with full energy transmission and zero-phase advance. As a feasible solution to demonstrate ENZ supercoupling through a finite-width channel, photonic doping can assist the light in squeezing, but the resonant dopant introduces inevitable losses. Here, we propose an approach of transmission-type photonic doping to achieve proximate ideal ENZ supercoupling. In contrast to the conventional resonance-type photonic doping, our proposed transmission-type doping replaces high-quality-factor two-dimensional resonant doping modes with low-quality-factor one-dimensional modes, such that obviously high transmission efficiency and zero-phase advance in ENZ supercoupling is achieved and observed in experiments. Benefiting from the high-efficiency ENZ supercoupling, waveguides with near-total energy transmission can be engineered with arbitrary dimensions and shapes, serving as flexible power conduits in the paradigm of waveguide integrated circuits for future millimeter-wave and terahertz integrated circuit innovations.

Functionalizing nanophotonic structures with 2D van der Waals materials

The integration of two-dimensional (2D) van der Waals materials with nanostructures has triggered a wide spectrum of optical and optoelectronic applications. Photonic structures of conventional materials typically lack efficient reconfigurability or multifunctionality. Atomically thin 2D materials can thus generate new functionality and reconfigurability for a well-established library of photonic structures such as integrated waveguides, optical fibers, photonic crystals, and metasurfaces, to name a few. Meanwhile, the interaction between light and van der Waals materials can be drastically enhanced as well by leveraging micro-cavities or resonators with high optical confinement. The unique van der Waals surfaces of the 2D materials enable handiness in transfer and mixing with various prefabricated photonic templates with high degrees of freedom, functionalizing as the optical gain, modulation, sensing, or plasmonic media for diverse applications. Here, we review recent advances in synergizing 2D materials to nanophotonic structures for prototyping novel functionality or performance enhancements. Challenges in scalable 2D materials preparations and transfer, as well as emerging opportunities in integrating van der Waals building blocks beyond 2D materials are also discussed.

Polarization- and angle-insensitive broadband long wavelength infrared absorber based on coplanar four-sized resonators

In many potential applications, there is a high demand for long wavelength infrared (LWIR) absorbers characterized by a compact configuration, broad operational bandwidth, high absorption efficiency, and polarization- and angle-insensitive characteristics. In this study, we design and demonstrate a high-performance broadband LWIR absorber based on coplanar four-sized resonators, consisting of arrays of titanium (Ti) disks with different diameters supported by a continuous zinc selenide (ZnSe) layer and by a Ti film acting as a back-reflector. Particle swarm optimization (PSO) is employed to optimize the complicated geometry parameters, and the final optimized device exhibits near-unity absorption (∼96.7%) across the entire operational bandwidth (8 µm∼14 µm) under unpolarized normal incidence, benefiting from the impedance-matching condition and the multiple surface plasmon resonances of this configuration. Furthermore, the proposed absorber is insensitive to the angle of incidence due to the localized surface plasmon resonances supported by these four-sized resonators, and is insensitive to the state of polarization thanks to the highly symmetric feature of the circular pattern. The measured absorption of the fabricated sample exhibits a relatively high coincidence with the simulation, with an average absorption of 88.9% ranging from 8 µm to 14 µm. The proposed absorber, which can be easily integrated into a standardized micro/nano manufacture process for cost-effective large-scale production, provides a feasible solution for improving optical performance in thermal emitter, infrared detection, and imaging applications. Furthermore, the generalized design principle employing the optimized method opens up new avenues for realizing target absorption, reflection, and transmission based on more complicated structure configurations.

Next-Generation Reconfigurable Nanoantennas and Polarization of Light

This study is aimed at the design, calibration, and development of a near-infrared (NIR) liquid crystal multifunctional automated optical polarimeter, which is aimed at the study and characterization of the polarimetric properties of polymer optical nanofilms. The characterization of these novel nanophotonic structures has been achieved, in terms of Mueller matrix and Stokes parameter analyses. The nanophotonic structures of this study consisted of (a) a matrix consisting of two different polymer domains, namely polybutadiene (PB) and polystyrene (PS), functionalized with gold nanoparticles; (b) cast and annealed Poly (styrene-b-methyl methacrylate) (PS-PMMA) diblock copolymers; (c) a matrix of a block copolymer (BCP) domain, PS-b-PMMA or Poly (styrene-block-methy methacrylate), functionalized with gold nanoparticles; and (d) different thicknesses of PS-b-P2VP diblock copolymer functionalized with gold nanoparticles. In all cases, backscattered infrared light was studied and related to the polarization figures-of-merit (FOM). The outcome of this study indicates that functionalized polymer nanomaterials, depending upon their structure and composition, exhibit promising optical characteristics, modulating and manipulating the polarimetric properties of light. The fabrication of technologically useful, tunable, conjugated polymer blends with an optimized refractive index, shape, size, spatial orientation, and arrangement would lead to the development of new nanoantennas and metasurfaces.

Metasurface designed with quantitative field distributions

A new method for designing metasurfaces has been proposed and demonstrated, which allows for the generation of precise quantitative field distributions. This unique approach involves combining a tandem neural network with an iterative algorithm to optimize the metasurface design, enabling accurate control over the intensity and polarization of the resulting field. This strategy is both efficient and robust and has the potential to accelerate the development of metasurface devices with complex functionalities.