Ultra-compact snapshot spectral light-field imaging

Non-Invasive Self-Adaptive Information States' Acquisition inside Dynamic Scattering Spaces

Pushing the information states' acquisition efficiency has been a long-held goal to reach the measurement precision limit inside scattering spaces. Recent studies have indicated that maximal information states can be attained through engineered modes; however, partial intrusion is generally required. While non-invasive designs have been substantially explored across diverse physical scenarios, the non-invasive acquisition of information states inside dynamic scattering spaces remains challenging due to the intractable non-unique mapping problem, particularly in the context of multi-target scenarios. Here, we establish the feasibility of non-invasive information states' acquisition experimentally for the first time by introducing a tandem-generated adversarial network framework inside dynamic scattering spaces. To illustrate the framework's efficacy, we demonstrate that efficient information states' acquisition for multi-target scenarios can achieve the Fisher information limit solely through the utilization of the external scattering matrix of the system. Our work provides insightful perspectives for precise measurements inside dynamic complex systems.

Miniature computational spectrometer with a plasmonic nanoparticles-in-cavity microfilter array

Optical spectrometers are essential tools for analysing light‒matter interactions, but conventional spectrometers can be complicated and bulky. Recently, efforts have been made to develop miniaturized spectrometers. However, it is challenging to overcome the trade-off between miniaturizing size and retaining performance. Here, we present a complementary metal oxide semiconductor image sensor-based miniature computational spectrometer using a plasmonic nanoparticles-in-cavity microfilter array. Size-controlled silver nanoparticles are directly printed into cavity-length-varying Fabry‒Pérot microcavities, which leverage strong coupling between the localized surface plasmon resonance of the silver nanoparticles and the Fabry‒Pérot microcavity to regulate the transmission spectra and realize large-scale arrayed spectrum-disparate microfilters. Supported by a machine learning-based training process, the miniature computational spectrometer uses artificial intelligence and was demonstrated to measure visible-light spectra at subnanometre resolution. The high scalability of the technological approaches shown here may facilitate the development of high-performance miniature optical spectrometers for extensive applications.

Full-Color Imaging System Based on the Joint Integration of a Metalens and Neural Network

Lenses have been a cornerstone of optical systems for centuries; however, they are inherently limited by the laws of physics, particularly in terms of size and weight. Because of their characteristic light weight, small size, and subwavelength modulation, metalenses have the potential to miniaturize and integrate imaging systems. However, metalenses still face the problem that chromatic aberration affects the clarity and accuracy of images. A high-quality image system based on the end-to-end joint optimization of a neural network and an achromatic metalens is demonstrated in this paper. In the multi-scale encoder-decoder network, both the phase characteristics of the metalens and the hyperparameters of the neural network are optimized to obtain high-resolution images. The average peak-signal-to-noise ratio (PSNR) and average structure similarity (SSIM) of the recovered images reach 28.53 and 0.83. This method enables full-color and high-performance imaging in the visible band. Our approach holds promise for a wide range of applications, including medical imaging, remote sensing, and consumer electronics.

Multifunctional metalens optical tweezers for optical information recognition

Traditional optical information recognition (OIR), particle capture and manipulation require many optical devices or mechanical moving system components to achieve a specific function, which is difficult to achieve integration. This paper proposes a new method to realize these functions by using multi-focus metalens combining spectrum and polarization selection. The design incorporates three spectral bands, namely 500 nm, 580 nm, and 660 nm, within the visible light range. Additionally, it utilizes either left-handed or right-handed circularly polarized (LCP/RCP) light, resulting in six distinct focus focusing effects on a single focal plane. By analyzing the normalized light intensity (NLI) at the corresponding focus position, the OIR of any wavelength and polarization detection in the design can be realized, and the particle capture at different focusing positions can be realized. Our work can provide a new idea for the high integration of on-chip light recognition and operation and inspire the design of a highly integrated optical system with a smaller size and more substantial function.

Wide-field mid-infrared hyperspectral imaging beyond video rate

Mid-infrared hyperspectral imaging has become an indispensable tool to spatially resolve chemical information in a wide variety of samples. However, acquiring three-dimensional data cubes is typically time-consuming due to the limited speed of raster scanning or wavelength tuning, which impedes real-time visualization with high spatial definition across broad spectral bands. Here, we devise and implement a high-speed, wide-field mid-infrared hyperspectral imaging system relying on broadband parametric upconversion of high-brightness supercontinuum illumination at the Fourier plane. The upconverted replica is spectrally decomposed by a rapid acousto-optic tunable filter, which records high-definition monochromatic images at a frame rate of 10 kHz based on a megapixel silicon camera. Consequently, the hyperspectral imager allows us to acquire 100 spectral bands over 2600-4085 cm-1 in 10 ms, corresponding to a refreshing rate of 100 Hz. Moreover, the angular dependence of phase matching in the image upconversion is leveraged to realize snapshot operation with spatial multiplexing for multiple spectral channels, which may further boost the spectral imaging rate. The high acquisition rate, wide-field operation, and broadband spectral coverage could open new possibilities for high-throughput characterization of transient processes in material and life sciences.

Tutorial on compressed ultrafast photography

Significance

Compressed ultrafast photography (CUP) is currently the world's fastest single-shot imaging technique. Through the integration of compressed sensing and streak imaging, CUP can capture a transient event in a single camera exposure with imaging speeds from thousands to trillions of frames per second, at micrometer-level spatial resolutions, and in broad sensing spectral ranges.

Aim

This tutorial aims to provide a comprehensive review of CUP in its fundamental methods, system implementations, biomedical applications, and prospect.

Approach

A step-by-step guideline to CUP's forward model and representative image reconstruction algorithms is presented with sample codes and illustrations in Matlab and Python. Then, CUP's hardware implementation is described with a focus on the representative techniques, advantages, and limitations of the three key components-the spatial encoder, the temporal shearing unit, and the two-dimensional sensor. Furthermore, four representative biomedical applications enabled by CUP are discussed, followed by the prospect of CUP's technical advancement.

Conclusions

CUP has emerged as a state-of-the-art ultrafast imaging technology. Its advanced imaging ability and versatility contribute to unprecedented observations and new applications in biomedicine. CUP holds great promise in improving technical specifications and facilitating the investigation of biomedical processes.

Varifocal Metalenses: Harnessing Polarization-Dependent Superposition for Continuous Focal Length Control

Traditional varifocal lenses are bulky and mechanically complex. Emerging active metalenses promise compactness and design flexibility but face issues like mechanical tuning reliability and nonlinear focal length tuning due to additional medium requirements. In this work, we propose a varifocal metalens design based on superimposing light intensity distributions from two orthogonal polarization states. This approach enables continuous and precise focal length control within the visible spectrum, while maintaining relatively high focusing efficiencies (∼41% in simulation and ∼28% in measurement) and quality. In experimental validation, the metalens exhibited flexible tunability, with the focal length continuously adjustable between two spatial positions upon variation of the incident polarization angle. The MTF results showed high contrast reproduction and sharp imaging, with a Strehl ratio of >0.7 for all polarization angles. With compactness, design flexibility, and high focusing quality, the proposed varifocal metalens holds potential for diverse applications, advancing adaptive and versatile optical devices.

Metasurface-empowered snapshot hyperspectral imaging with convex/deep (CODE) small-data learning theory

Hyperspectral imaging is vital for material identification but traditional systems are bulky, hindering the development of compact systems. While previous metasurfaces address volume issues, the requirements of complicated fabrication processes and significant footprint still limit their applications. This work reports a compact snapshot hyperspectral imager by incorporating the meta-optics with a small-data convex/deep (CODE) deep learning theory. Our snapshot hyperspectral imager comprises only one single multi-wavelength metasurface chip working in the visible window (500-650 nm), significantly reducing the device area. To demonstrate the high performance of our hyperspectral imager, a 4-band multispectral imaging dataset is used as the input. Through the CODE-driven imaging system, it efficiently generates an 18-band hyperspectral data cube with high fidelity using only 18 training data points. We expect the elegant integration of multi-resonant metasurfaces with small-data learning theory will enable low-profile advanced instruments for fundamental science studies and real-world applications.

Asymptotic dispersion engineering for ultra-broadband meta-optics

Dispersion decomposes compound light into its monochromatic components, which is detrimental to broadband imaging but advantageous for spectroscopic applications. Metasurfaces provide a unique path to modulate the dispersion by adjusting structural parameters on a two-dimensional plane. However, conventional linear phase compensation does not adequately match the meta-unit's dispersion characteristics with required complex dispersion, hindering at-will dispersion engineering over a very wide bandwidth particularly. Here, we propose an asymptotic phase compensation strategy for ultra-broadband dispersion-controlled metalenses. Metasurfaces with extraordinarily high aspect ratio nanostructures have been fabricated for arbitrary dispersion control in ultra-broad bandwidth, and we experimentally demonstrate the single-layer achromatic metalenses in the visible to infrared spectrum (400 nm~1000 nm, NA = 0.164). Our proposed scheme provides a comprehensive theoretical framework for single-layer meta-optics, allowing for arbitrary dispersion manipulation without bandwidth restrictions. This development is expected to have significant applications in ultra-broadband imaging and chromatography detection, among others.

Compact all-dielectric metasurface for full polarization detection at the long-wavelength infrared region

Metasurfaces have been extensively demonstrated in engineering and detection of polarization of light from the visible to terahertz regions. However, most of the previous metasurfaces for polarization detection are spatially divided into different parts, and each of the parts focuses on different polarization components, resulting in large metasurface size and hindering their integration development. In this paper, a compact all-dielectric metasurface is proposed and numerically demonstrated to achieve full polarization detection at the long-wavelength infrared region (LIR). First, we design the metasurface at a wavelength of 10 µm, which can converge incident beams to specific positions corresponding to different polarization states. In this design, the metasurface is based on an oblique alternant double-phase modulation method, which arranges meta-atoms with the ability to control as many as possible different polarizations in a limited region, ensuring the high efficiency of polarization detection while giving more freedom and flexibility to the metasurface. Second, the intensity distributions of the electric field of different polarization components are simulated at wavelengths of 9.4 µm and 10.5 µm, verifying the broadband performance of the proposed metasurface. The proposed method has potential applications in integrated multifunctional devices and multispectral polarization imaging.

360-degree directional micro prism array for tabletop flat-panel light field displays

Tabletop light field displays are compelling display technologies that offer stereoscopic vision and can present annular viewpoint distributions to multiple viewers around the display device. When employing the lens array to realize the of integral imaging tabletop light field display, there is a critical trade-off between the increase of the angular resolution and the spatial resolution. Moreover, as the viewers are around the device, the central viewing range of the reconstructed 3D images are wasteful. In this paper, we explore what we believe to be a new method for realizing tabletop flat-panel light field displays to improve the efficiency of the pixel utilization and the angular resolution of the tabletop 3D display. A 360-degree directional micro prism array is newly designed to refract the collimated light rays to different viewing positions and form viewpoints, then a uniform 360-degree annular viewpoint distribution can be accurately formed. In the experiment, a micro prism array sample is fabricated to verify the performance of the proposed tabletop flat-panel light field display system. One hundred viewpoints are uniformly distributed in the 360-degree viewing area, providing a full-color, smooth parallax 3D scene.

Learning based compressive snapshot spectral light field imaging with RGB sensors

The application of multidimensional optical sensing technologies, such as the spectral light field (SLF) imager, has become increasingly common in recent years. The SLF sensors provide information in the form of one-dimensional spectral data, two-dimensional spatial data, and two-dimensional angular measurements. Spatial-spectral and angular data are essential in a variety of fields, from computer vision to microscopy. Beam-splitters or expensive camera arrays are required for the usage of SLF sensors. The paper describes a low-cost RGB light field camera-based compressed snapshot SLF imaging method. Inspired by the compressive sensing paradigm, the four dimensional SLF can be reconstructed from a measurement of an RGB light field camera via a network which is proposed by utilizing a U-shaped neural network with multi-head self-attention and unparameterized Fourier transform modules. This method is capable of gathering images with a spectral resolution of 10 nm, angular resolution of 9 × 9, and spatial resolution of 622 × 432 within the spectral range of 400 to 700 nm. It provides us an alternative approach to implement the low cost SLF imaging.

Compact meta-optics infrared camera based on a polarization-insensitive metalens with a large field of view

Metasurfaces have recently emerged as a crucial tool because they achieve spherical-aberration-free focusing when exposed to normal incident light. Nevertheless, these metasurfaces often exhibit considerable coma when subjected to oblique incident light, thereby limiting their imaging field of view. In light of this, our study presents the design and an experimental demonstration of a polarization-insensitive, large-field-of-view metalens that uses a silicon metasurface. The metalens is specifically tailored to the long-wavelength infrared region and possesses a numerical aperture of 0.81, which is capable of focusing light at incident angles up to ±80°. Moreover, we successfully build a meta-optics camera by integrating the large field-of-view metalens on top of an image sensor, thus enabling wide-angle thermal imaging of practical scenes. This research provides new, to the best of our knowledge, insights for designing and realizing large-field-of-view optical systems and holds promise for applications in night vision imaging and security monitoring.

Hybrid SWM-IR narrow bandpass filters with high optical density

Narrow bandpass filters (NBFs), which are designed to accept a narrow wavelength range and simultaneously reject a much wider range, show great potential in applications such as spectral imaging, lidar detection, fluorescence microscopy, and others. In this paper, we propose and numerically simulate NBF technology for infrared (IR) optical applications. The filter is a combination of plasmonic nanostructures and improved induced transmission layers. The operating wavelength range is from 1360 to 5000 nm [short wave mid-infrared radiation(SWM-IR)], with a FWHM of less than 10 nm and maximum optical density of around 10. Therefore, our SWM-IR hybrid filter can distinguish much smaller differences in terms of spectrum information and reduce the background noise level even if using an optical amplifier.

Advances in Meta-Optics and Metasurfaces: Fundamentals and Applications

Meta-optics based on metasurfaces that interact strongly with light has been an active area of research in recent years. The development of meta-optics has always been driven by human's pursuits of the ultimate miniaturization of optical elements, on-demand design and control of light beams, and processing hidden modalities of light. Underpinned by meta-optical physics, meta-optical devices have produced potentially disruptive applications in light manipulation and ultra-light optics. Among them, optical metalens are most fundamental and prominent meta-devices, owing to their powerful abilities in advanced imaging and image processing, and their novel functionalities in light manipulation. This review focuses on recent advances in the fundamentals and applications of the field defined by excavating new optical physics and breaking the limitations of light manipulation. In addition, we have deeply explored the metalenses and metalens-based devices with novel functionalities, and their applications in computational imaging and image processing. We also provide an outlook on this active field in the end.

Photoelectric hybrid neural network based on ZnO nematic liquid crystal microlens array for hyperspectral imaging

The miniaturized imaging spectrometers face bottlenecks in reconstructing the high-resolution spectral image. In this study, we have proposed an optoelectronic hybrid neural network based on zinc oxide (ZnO) nematic liquid crystal (LC) microlens array (MLA). This architecture optimizes the parameters of the neural network by constructing the TV-L1-L2 objective function and using mean square error as a loss function, giving full play to the advantages of ZnO LC MLA. It adopts the ZnO LC-MLA as optical convolution to reduce the volume of the network. Experimental results show that the proposed architecture has reconstructed a 1536 × 1536 pixels resolution enhancement hyperspectral image in the wavelength range of [400 nm, 700 nm] in a relatively short time, and the spectral accuracy of reconstruction has reached just 1 nm.

Broadband Achromatic Metalens in the Visible Light Spectrum Based on Fresnel Zone Spatial Multiplexing

Metalenses composed of a large number of subwavelength nanostructures provide the possibility for the miniaturization and integration of the optical system. Broadband polarization-insensitive achromatic metalenses in the visible light spectrum have attracted researchers because of their wide applications in optical integrated imaging. This paper proposes a polarization-insensitive achromatic metalens operating over a continuous bandwidth from 470 nm to 700 nm. The silicon nitride nanopillars of 488 nm and 632.8 nm are interleaved by Fresnel zone spatial multiplexing method, and the particle swarm algorithm is used to optimize the phase compensation. The maximum time-bandwidth product in the phase library is 17.63. The designed focal length can be maintained in the visible light range from 470 nm to 700 nm. The average focusing efficiency reaches 31.71%. The metalens can achieve broadband achromatization using only one shape of nanopillar, which is simple in design and easy to fabricate. The proposed metalens is expected to play an important role in microscopic imaging, cameras, and other fields.