Towards Reduced CNNs for De-Noising Phase Images Corrupted with Speckle Noise

Quantitative phase imaging based on holography: trends and new perspectives

In 1948, Dennis Gabor proposed the concept of holography, providing a pioneering solution to a quantitative description of the optical wavefront. After 75 years of development, holographic imaging has become a powerful tool for optical wavefront measurement and quantitative phase imaging. The emergence of this technology has given fresh energy to physics, biology, and materials science. Digital holography (DH) possesses the quantitative advantages of wide-field, non-contact, precise, and dynamic measurement capability for complex-waves. DH has unique capabilities for the propagation of optical fields by measuring light scattering with phase information. It offers quantitative visualization of the refractive index and thickness distribution of weak absorption samples, which plays a vital role in the pathophysiology of various diseases and the characterization of various materials. It provides a possibility to bridge the gap between the imaging and scattering disciplines. The propagation of wavefront is described by the complex amplitude. The complex-value in the complex-domain is reconstructed from the intensity-value measurement by camera in the real-domain. Here, we regard the process of holographic recording and reconstruction as a transformation between complex-domain and real-domain, and discuss the mathematics and physical principles of reconstruction. We review the DH in underlying principles, technical approaches, and the breadth of applications. We conclude with emerging challenges and opportunities based on combining holographic imaging with other methodologies that expand the scope and utility of holographic imaging even further. The multidisciplinary nature brings technology and application experts together in label-free cell biology, analytical chemistry, clinical sciences, wavefront sensing, and semiconductor production.

On the use of deep learning for phase recovery

Phase recovery (PR) refers to calculating the phase of the light field from its intensity measurements. As exemplified from quantitative phase imaging and coherent diffraction imaging to adaptive optics, PR is essential for reconstructing the refractive index distribution or topography of an object and correcting the aberration of an imaging system. In recent years, deep learning (DL), often implemented through deep neural networks, has provided unprecedented support for computational imaging, leading to more efficient solutions for various PR problems. In this review, we first briefly introduce conventional methods for PR. Then, we review how DL provides support for PR from the following three stages, namely, pre-processing, in-processing, and post-processing. We also review how DL is used in phase image processing. Finally, we summarize the work in DL for PR and provide an outlook on how to better use DL to improve the reliability and efficiency of PR. Furthermore, we present a live-updating resource ( https://github.com/kqwang/phase-recovery ) for readers to learn more about PR.

Deep learning-based incoherent holographic camera enabling acquisition of real-world holograms for holographic streaming system

While recent research has shown that holographic displays can represent photorealistic 3D holograms in real time, the difficulty in acquiring high-quality real-world holograms has limited the realization of holographic streaming systems. Incoherent holographic cameras, which record holograms under daylight conditions, are suitable candidates for real-world acquisition, as they prevent the safety issues associated with the use of lasers; however, these cameras are hindered by severe noise due to the optical imperfections of such systems. In this work, we develop a deep learning-based incoherent holographic camera system that can deliver visually enhanced holograms in real time. A neural network filters the noise in the captured holograms, maintaining a complex-valued hologram format throughout the whole process. Enabled by the computational efficiency of the proposed filtering strategy, we demonstrate a holographic streaming system integrating a holographic camera and holographic display, with the aim of developing the ultimate holographic ecosystem of the future.

A Review of Fault Diagnosis Methods for Rotating Machinery Using Infrared Thermography

At present, rotating machinery is widely used in all walks of life and has become the key equipment in many production processes. It is of great significance to strengthen the condition monitoring of rotating machinery, timely diagnose and eliminate faults to ensure the safe and efficient operation of rotating machinery and improve the economic benefits of enterprises. When the state of a rotating machine deteriorates, the thermal energy that is much more than its normal operation will be generated due to the increase in the friction between the components or other factors. Therefore, using the infrared thermal camera to collect the infrared thermal images of rotating machinery and judge the health status of rotating machinery by observing the temperature distribution in the thermal images is often more rapid and effective than other technologies. Nevertheless, after decades of development, the research achievements of infrared thermography (IRT) and its application in various industrial fields are numerous and complex, and there is a lack of systematic sorting and summary of the achievements in this field. Accordingly, this paper summarizes the development and application of IRT as a non-contact and non-invasive tool for equipment condition monitoring and fault diagnosis, and introduces the basic theory of IRT, image processing technology and fault diagnosis methods of rotating machinery in detail. Finally, the review is summarized and some future potential topics are proposed, which will make the subject easier for beginners and non-experts to understand.

Deep Learning Network for Speckle De-Noising in Severe Conditions

Digital holography is well adapted to measure any modifications related to any objects. The method refers to digital holographic interferometry where the phase change between two states of the object is of interest. However, the phase images are corrupted by the speckle decorrelation noise. In this paper, we address the question of de-noising in holographic interferometry when phase data are polluted with speckle noise. We present a new database of phase fringe images for the evaluation of de-noising algorithms in digital holography. In this database, the simulated phase maps present characteristics such as the size of the speckle grains and the noise level of the fringes, which can be controlled by the generation process. Deep neural network architectures are trained with sets of phase maps having differentiated parameters according to the features. The performances of the new models are evaluated with a set of test fringe patterns whose characteristics are representative of severe conditions in terms of input SNR and speckle grain size. For this, four metrics are considered, which are the PSNR, the phase error, the perceived quality index and the peak-to-valley ratio. Results demonstrate that the models trained with phase maps with a diversity of noise characteristics lead to improving their efficiency, their robustness and their generality on phase maps with severe noise.

Speckle denoising based on deep learning via a conditional generative adversarial network in digital holographic interferometry

Speckle denoising can improve digital holographic interferometry phase measurements but may affect experimental accuracy. A deep-learning-based speckle denoising algorithm is developed using a conditional generative adversarial network. Two subnetworks, namely discriminator and generator networks, which refer to the U-Net and DenseNet layer structures are used to supervise network learning quality and denoising. Datasets obtained from speckle simulations are shown to provide improved noise feature extraction. The loss function is designed by considering the peak signal-to-noise ratio parameters to improve efficiency and accuracy. The proposed method thus shows better performance than other denoising algorithms for processing experimental strain data from digital holography.

Deep learning speckle de-noising algorithms for coherent metrology: a review and a phase-shifted iterative scheme [Invited]

We present a review of deep learning algorithms dedicated to the processing of speckle noise in coherent imaging. We focus on methods that specifically process de-noising of input images. Four main classes of applications are described in this review: optical coherence tomography, synthetic aperture radar imaging, digital holography amplitude imaging, and fringe pattern analysis. We then present deep learning approaches recently developed in our group that rely on the retraining of residual convolutional neural network structures to process decorrelation phase noise. The paper ends with the presentation of a new approach that uses an iterative scheme controlled by an input SNR estimator associated with a phase-shifting procedure.

Deep learning for digital holography: a review

Recent years have witnessed the unprecedented progress of deep learning applications in digital holography (DH). Nevertheless, there remain huge potentials in how deep learning can further improve performance and enable new functionalities for DH. Here, we survey recent developments in various DH applications powered by deep learning algorithms. This article starts with a brief introduction to digital holographic imaging, then summarizes the most relevant deep learning techniques for DH, with discussions on their benefits and challenges. We then present case studies covering a wide range of problems and applications in order to highlight research achievements to date. We provide an outlook of several promising directions to widen the use of deep learning in various DH applications.

Modeling of speckle decorrelation in digital Fresnel holographic interferometry

This paper presents analytical modeling of the speckle decorrelation noise in digital Fresnel holographic interferometry. The theoretical analysis is carried out by considering the complex coherence factor between two speckled images from two digitally reconstructed holograms at two different instants. The expression giving the modulus of the coherence factor is established and depends on the local surface deformation and parameters from the holographic setup. The analysis is supported by realistic simulations and experiments. Both simulations and experimental results exhibit a very good agreement with the theoretical prediction.