Super Sub-Nyquist Single-Pixel Imaging by Total Variation Ascending Ordering of the Hadamard Basis

Time-gated single-pixel imaging of Cherenkov emission from a medical linear accelerator

Cherenkov imaging is an ideal tool for real-time in vivo verification of a radiation therapy dose. Given that radiation is pulsed from a medical linear accelerator (LINAC) together with weak Cherenkov emissions, time-gated high-sensitivity imaging is required for robust measurements. Instead of using an expensive camera system with limited efficiency of detection in each pixel, a single-pixel imaging (SPI) approach that maintains promising sensitivity over the entire spectral band could be used to provide a low-cost and viable alternative. A prototype SPI system was developed and demonstrated here in Cherenkov imaging of LINAC dose delivery to a water tank. Validation experiments were performed using four regular fields and an intensity-modulated radiotherapy (IMRT) delivery plan. The Cherenkov image-based projection percent depth dose curves (pPDDs) were compared to pPDDs simulated by the treatment planning system (TPS), with an overall average error of 0.48, 0.42, 0.65, and 1.08% for the 3, 5, 7, and 9 cm square beams, respectively. The composite image of the IMRT plan achieved a 85.9% pass rate using 3%/3 mm gamma index criteria, in comparing Cherenkov intensity and TPS dose. This study validates the feasibility of applying SPI to the Cherenkov imaging of radiotherapy dose for the first time to our knowledge.

Optimizing the ordering of the Hadamard masks of ghost imaging suitable for the efficient face reconstruction using the max-projection method

One crucial component of ghost imaging (GI) is the encoded mask. Higher-quality reconstruction at lower sampling rates is still a major challenge for GI. Inspired by deep learning, max-projection method is proposed in the paper to reorder the Hadamard masks for its efficient and rapid reconstruction. The simulations demonstrated that max-projection ordering with only 20 face training images yielded excellent reconstruction outcomes. In noise-free simulations, at an ultralow sampling rate of 5%, the PSNR of the max-projection ordering was 1.1 dB higher than that of the cake-cutting ordering with the best performance in the reference group. In noisy simulations, at ultralow sampling rates, the retrieved images remained almost identical to their noise-free counterparts. Irrespective of the presence or absence of noise, the max-projection ordering guaranteed the highest fidelity of image reconstruction at ultralow sampling rates. The reconstruction time was reduced to mere milliseconds, thereby enabling swift visualization of dynamic phenomena. Accordingly, the max-projection ordering Hadamard matrix offers a promising solution for real-time GI due to its higher reconstruction quality, stronger noise immunity and millisecond reconstruction time.

Nanoscale chemical imaging with structured X-ray illumination

High-resolution imaging with compositional and chemical sensitivity is crucial for a wide range of scientific and engineering disciplines. Although synchrotron X-ray imaging through spectromicroscopy has been tremendously successful and broadly applied, it encounters challenges in achieving enhanced detection sensitivity, satisfactory spatial resolution, and high experimental throughput simultaneously. In this work, based on structured illumination, we develop a single-pixel X-ray imaging approach coupled with a generative image reconstruction model for mapping the compositional heterogeneity with nanoscale resolvability. This method integrates a full-field transmission X-ray microscope with an X-ray fluorescence detector and eliminates the need for nanoscale X-ray focusing and raster scanning. We experimentally demonstrate the effectiveness of our approach by imaging a battery sample composed of mixed cathode materials and successfully retrieving the compositional variations of the imaged cathode particles. Bridging the gap between structural and chemical characterizations using X-rays, this technique opens up vast opportunities in the fields of biology, environmental, and materials science, especially for radiation-sensitive samples.

Single-Pixel Imaging in Space and Time with Optically Modulated Free Electrons

Single-pixel imaging, originally developed in light optics, facilitates fast three-dimensional sample reconstruction as well as probing with light wavelengths undetectable by conventional multi-pixel detectors. However, the spatial resolution of optics-based single-pixel microscopy is limited by diffraction to hundreds of nanometers. Here, we propose an implementation of single-pixel imaging relying on attainable modifications of currently available ultrafast electron microscopes in which optically modulated electrons are used instead of photons to achieve subnanometer spatially and temporally resolved single-pixel imaging. We simulate electron beam profiles generated by interaction with the optical field produced by an externally programmable spatial light modulator and demonstrate the feasibility of the method by showing that the sample image and its temporal evolution can be reconstructed using realistic imperfect illumination patterns. Electron single-pixel imaging holds strong potential for application in low-dose probing of beam-sensitive biological and molecular samples, including rapid screening during in situ experiments.

Cascaded compressed-sensing single-pixel camera for high-dimensional optical imaging

Single-pixel detectors are popular devices in optical sciences because of their fast temporal response, high sensitivity, and low cost. However, when being used for imaging, they face a fundamental challenge in acquiring high-dimensional information of an optical field because they are essentially zero-dimensional sensors and measure only the light intensity. To address this problem, we developed a cascaded compressed-sensing single-pixel camera, which decomposes the measurement into multiple stages, sequentially reducing the dimensionality of the data from a high-dimensional space to zero dimension. This measurement scheme allows us to exploit the compressibility of a natural scene in multiple domains, leading to highly efficient data acquisition. We demonstrated our method in several demanding applications, including enabling tunable single-pixel full-waveform hyperspectral light detection and ranging (LIDAR) for the first time.

Single-pixel imaging with Gao-Boole patterns

Single-pixel imaging (SPI) can perceive the world using only a single-pixel detector, but long sampling times with a series of patterns are inevitable for SPI, which is the bottleneck for its practical application. Developing new patterns to reduce the sampling times might provide opportunities to address this challenge. Based on the Kronecker product of Hadamard matrix, we here design a complete set of new patterns, called Gao-Boole patterns, for SPI. Compared to orthogonal Hadamard basis patterns with elements valued as +1 or -1, our Gao-Boole patterns are non-orthogonal ones and the element values are designed as +1 or 0. Using our Gao-Boole patterns, the reconstructed quality of a target image (N × N pixels) is as high as the Hadamard one but only with half pattern numbers of the Hadamard ones, for both full sampling (N² for Gao-Boole patterns, 2N² for Hadamard basis patterns) and undersampling cases in experiment. Effectively reducing the patterns numbers and sampling times without sacrificing imaging quality, our designed Gao-Boole patterns provide a superior option for structural patterns in SPI and help to steer SPI toward practical imaging application.

DQN based single-pixel imaging

For an orthogonal transform based single-pixel imaging (OT-SPI), to accelerate its speed while degrading as little as possible of its imaging quality, the normal way is to artificially plan the sampling path for optimizing the sampling strategy based on the characteristic of the orthogonal transform. Here, we propose an optimized sampling method using a Deep Q-learning Network (DQN), which considers the sampling process as decision-making, and the improvement of the reconstructed image as feedback, to obtain a relatively optimal sampling strategy for an OT-SPI. We verify the effectiveness of the method through simulations and experiments. Thanks to the DQN, the proposed single-pixel imaging technique is capable of obtaining an optimal sampling strategy directly, and therefore it requires no artificial planning of the sampling path there, which eliminates the influence of the imperfect sampling path planning on the imaging performance.

Imaging reconstruction comparison of different ghost imaging algorithms

As an indirect and computational imaging approach, imaging reconstruction efficiency is critical for ghost imaging (GI). Here, we compare different GI algorithms, including logarithmic GI and exponential GI we proposed, by numerically analysing their imaging reconstruction efficiency and error tolerance. Simulation results show that compressive GI algorithm has the highest reconstruction efficiency due to its global optimization property. Error tolerance studies further manifest that compressive GI and exponential GI are sensitive to the error ratio. By replacing the bucket input of compressive GI with different bucket object signal functions, we integrate compressive GI with other GI algorithms and discuss their imaging efficiency. With the combination between the differential GI (or normalized GI) and compressive GI, both reconstruction efficiency and error tolerance will present the best performance. Moreover, an optical encryption is proposed by combining logarithmic GI, exponential GI and compressive GI, which can enhance the encryption security based on GI principle.