Comparative study of multi-look processing for phase map de-noising in digital Fresnel holographic interferometry

Digital holographic approaches to the detection and characterization of microplastics in water environments

Microplastic (MP) pollution is seriously threatening the environmental health of the world, which has accelerated the development of new identification and characterization methods. Digital holography (DH) is one of the emerging tools to detect MPs in a high-throughput flow. Here, we review advances in MP screening by DH. We examine the problem from both the hardware and software viewpoints. Automatic analysis based on smart DH processing is reported by highlighting the role played by artificial intelligence for classification and regression tasks. In this framework, the continuous development and availability in recent years of field-portable holographic flow cytometers for water monitoring also is discussed.

Beyond conventional microscopy: Observing kidney tissues by means of fourier ptychography

Kidney microscopy is a mainstay in studying the morphological structure, physiology and pathology of kidney tissues, as histology provides important results for a reliable diagnosis. A microscopy modality providing at same time high-resolution images and a wide field of view could be very useful for analyzing the whole architecture and the functioning of the renal tissue. Recently, Fourier Ptychography (FP) has been proofed to yield images of biology samples such as tissues and in vitro cells while providing high resolution and large field of view, thus making it a unique and attractive opportunity for histopathology. Moreover, FP offers tissue imaging with high contrast assuring visualization of small desirable features, although with a stain-free mode that avoids any chemical process in histopathology. Here we report an experimental measuring campaign for creating the first comprehensive and extensive collection of images of kidney tissues captured by this FP microscope. We show that FP microscopy unlocks a new opportunity for the physicians to observe and judge renal tissue slides through the novel FP quantitative phase-contrast microscopy. Phase-contrast images of kidney tissue are analyzed by comparing them with the corresponding renal images taken under a conventional bright-field microscope both for stained and unstained tissue samples of different thicknesses. In depth discussion on the advantages and limitations of this new stain-free microscopy modality is reported, showing its usefulness over the classical light microscopy and opening a potential route for using FP in clinical practice for histopathology of kidney.

Developing a Reliable Holographic Flow Cyto-Tomography Apparatus by Optimizing the Experimental Layout and Computational Processing

Digital Holographic Tomography (DHT) has recently been established as a means of retrieving the 3D refractive index mapping of single cells. To make DHT a viable system, it is necessary to develop a reliable and robust holographic apparatus in order that such technology can be utilized outside of specialized optics laboratories and operated in the in-flow modality. In this paper, we propose a quasi-common-path lateral-shearing holographic optical set-up to be used, for the first time, for DHT in a flow-cytometer modality. The proposed solution is able to withstand environmental vibrations that can severely affect the interference process. Furthermore, we have scaled down the system while ensuring that a full 360° rotation of the cells occurs in the field-of-view, in order to retrieve 3D phase-contrast tomograms of single cells flowing along a microfluidic channel. This was achieved by setting the camera sensor at 45° with respect to the microfluidic direction. Additional optimizations were made to the computational elements to ensure the reliable retrieval of 3D refractive index distributions by demonstrating an effective method of tomographic reconstruction, based on high-order total variation. The results were first demonstrated using realistic 3D numerical phantom cells to assess the performance of the proposed high-order total variation method in comparison with the gold-standard algorithm for tomographic reconstructions: namely, filtered back projection. Then, the proposed DHT system and the processing pipeline were experimentally validated for monocytes and mouse embryonic fibroblast NIH-3T3 cells lines. Moreover, the repeatability of these tomographic measurements was also investigated by recording the same cell multiple times and quantifying the ability to provide reliable and comparable tomographic reconstructions, as confirmed by a correlation coefficient greater than 95%. The reported results represent various steps forward in several key aspects of in-flow DHT, thus paving the way for its use in real-world applications.

Speeding up reconstruction of 3D tomograms in holographic flow cytometry via deep learning

Tomographic flow cytometry by digital holography is an emerging imaging modality capable of collecting multiple views of moving and rotating cells with the aim of recovering their refractive index distribution in 3D. Although this modality allows us to access high-resolution imaging with high-throughput, the huge amount of time-lapse holographic images to be processed (hundreds of digital holograms per cell) constitutes the actual bottleneck. This prevents the system from being suitable for lab-on-a-chip platforms in real-world applications, where fast analysis of measured data is mandatory. Here we demonstrate a significant speeding-up reconstruction of phase-contrast tomograms by introducing in the processing pipeline a multi-scale fully-convolutional context aggregation network. Although it was originally developed in the context of semantic image analysis, we demonstrate for the first time that it can be successfully adapted to a holographic lab-on-chip platform for achieving 3D tomograms through a faster computational process. We trained the network with input-output image pairs to reproduce the end-to-end holographic reconstruction process, i.e. recovering quantitative phase maps (QPMs) of single cells from their digital holograms. Then, the sequence of QPMs of the same rotating cell is used to perform the tomographic reconstruction. The proposed approach significantly reduces the computational time for retrieving tomograms, thus making them available in a few seconds instead of tens of minutes, while essentially preserving the high-content information of tomographic data. Moreover, we have accomplished a compact deep convolutional neural network parameterization that can fit into on-chip SRAM and a small memory footprint, thus demonstrating its possible exploitation to provide onboard computations for lab-on-chip devices with low processing hardware resources.

Kinematic analysis and visualization of Tetraselmis microalgae 3D motility by digital holography

A study on locomotion in a 3D environment of Tetraselmis microalgae by digital holographic microscopy is reported. In particular, a fast and semiautomatic criterion is revealed for tracking and analyzing the swimming path of a microalga (i.e., Tetraselmis species) in a 3D volume. Digital holography (DH) in a microscope off-axis configuration is exploited as a useful method to enable fast autofocusing and recognition of objects in the field of view, thus coupling DH with appropriate numerical algorithms. Through the proposed method we measure, simultaneously, the tri-dimensional paths followed by the flagellate microorganism and the full set of the kinematic parameters that describe the swimming behavior of the analyzed microorganisms by means of a polynomial fitting and segmentation. Furthermore, the method is capable to furnish the accurate morphology of the microorganisms at any instant of time along its 3D trajectory. This work launches a promising trend having as the main objective the combined use of DH and motility microorganism analysis as a label-free and non-invasive environmental monitoring tool, employable also for in situ measurements. Finally, we show that the locomotion can be visualized intriguingly by different modalities to furnish marine biologists with a clear 3D representation of all the parameters of the kinematic set in order to better understand the behavior of the microorganism under investigation.

Elimination of abnormal phase fluctuation in digital holography

In digital holography, the phase is most important, and the quality of the reconstructed phase determines the final reconstructed image effect. However, noise is inevitably introduced in the process of recording the hologram. For regions without object light, the phase has a random distribution, which affects the final phase quality. This kind of noise is called abnormal phase fluctuations in this paper. The correlation between amplitude and phase in digital holography is used to judge whether there is useful phase information. Through structural similarity and the light-dark relationship, a credible probability mask is introduced to extract the phase that needs to be preserved. The simulation and experimental results show that abnormal phase fluctuations are successfully removed, and the useful phase information is retained.

Deep learning speckle de-noising algorithms for coherent metrology: a review and a phase-shifted iterative scheme [Invited]

We present a review of deep learning algorithms dedicated to the processing of speckle noise in coherent imaging. We focus on methods that specifically process de-noising of input images. Four main classes of applications are described in this review: optical coherence tomography, synthetic aperture radar imaging, digital holography amplitude imaging, and fringe pattern analysis. We then present deep learning approaches recently developed in our group that rely on the retraining of residual convolutional neural network structures to process decorrelation phase noise. The paper ends with the presentation of a new approach that uses an iterative scheme controlled by an input SNR estimator associated with a phase-shifting procedure.

Biospeckle Analysis and Biofilm Electrostatic Tests, Two Useful Methods in Microbiology

The development of more sensitive methodologies, capable of quickly detecting and monitoring a microbial population present in a specific biological matrix, as well as performing to allow for the study of all its metabolic changes (e.g., during the formation of biofilm) to occur, is an essential requirement for both well-being and the food industry. Two techniques, in particular, have gained the attention of scientists: The first is “biospeckle”, an optical technique representing an innovative tool for applications in food quality, food safety, and nutraceuticals. With this technique, we can quickly evaluate and monitor the presence of bacteria (or their proliferation) in a solid or liquid biological matrix. In addition, the technique is helpful in quantifying and optimizing the correct storage time of the pro-biotics, if they are entrapped in matrices such as alginate and follow their survival rate in simulated gastro-intestinal conditions. A second technique with great chances is the “biofilm electrostatic test” (BET). BET undoubtedly represents a fast, simple, and highly reproducible tool suitable for admitting the evaluation of the in vitro bacterial capacity in order to adhere through an electrostatic interaction with a pyro-electrified carrier after only 2 h of incubation. BET could represent the way for a quick and standardized evaluation of bacterial resistance among biofilm-producing microorganisms through a fast evaluation of the potential presence of the biofilm.

Quantitative multi-height phase retrieval via a coded image sensor

Multi-height phase retrieval introduces different object-to-detector distances for obtaining phase diversity measurements. In the acquisition process, the slow-varying phase information, however, cannot be converted to intensity variations for detection. Therefore, the low-frequency contents of the phase profile are lost during acquisition and cannot be properly restored via phase retrieval. Here, we demonstrate the use of a coded image sensor for addressing this challenge in multi-height phase retrieval. In our scheme, we add a coded layer on top of the image sensor for encoding the slow-varying complex wavefronts into intensity variations of the modulated patterns. Inspired by the concept of blind ptychography, we report a reconstruction scheme to jointly recover the complex object and the unknown coded layer using multi-height measurements. With both simulation and experimental results, we show that the recovered phase is quantitative and the slow-varying phase profiles can be properly restored using lensless multi-height measurements. We also show that the image quality using the coded sensor is better than that of a regular image sensor. For demonstrations, we validate the reported scheme with various biospecimens and compare the results to those of regular lensless multi-height phase retrieval. The use of a coded image sensor may enable true quantitative phase imaging for the lensless multi-height, multi-wavelength, and transport-of-intensity equation approaches.

Modeling of speckle decorrelation in digital Fresnel holographic interferometry

This paper presents analytical modeling of the speckle decorrelation noise in digital Fresnel holographic interferometry. The theoretical analysis is carried out by considering the complex coherence factor between two speckled images from two digitally reconstructed holograms at two different instants. The expression giving the modulus of the coherence factor is established and depends on the local surface deformation and parameters from the holographic setup. The analysis is supported by realistic simulations and experiments. Both simulations and experimental results exhibit a very good agreement with the theoretical prediction.

Dehydration of plant cells shoves nuclei rotation allowing for 3D phase-contrast tomography

Single-cell phase-contrast tomography promises to become decisive for studying 3D intracellular structures in biology. It involves probing cells with light at wide angles, which unfortunately requires complex systems. Here we show an intriguing concept based on an inherent natural process for plants biology, i.e., dehydration, allowing us to easily obtain 3D-tomography of onion-epidermal cells' nuclei. In fact, the loss of water reduces the turgor pressure and we recognize it induces significant rotation of cells' nuclei. Thanks to the holographic focusing flexibility and an ad-hoc angles' tracking algorithm, we combine different phase-contrast views of the nuclei to retrieve their 3D refractive index distribution. Nucleolus identification capability and a strategy for measuring morphology, dry mass, biovolume, and refractive index statistics are reported and discussed. This new concept could revolutionize the investigation in plant biology by enabling dynamic 3D quantitative and label-free analysis at sub-nuclear level using a conventional holographic setup.

Rapid multi-plane phase-contrast microscopy reveals torsional dynamics in flagellar motion

High speed volumetric optical microscopy is an important tool for observing rapid processes in living cells or for real-time tracking of sub-cellular components. However, the 3D imaging capability often comes at the price of a high technical complexity of the imaging system and/or the requirement of demanding image analysis. Here, we propose a combination of conventional phase-contrast imaging with a customized multi-plane beam-splitter for enabling simultaneous acquisition of images in eight different focal planes. Our method is technically straightforward and does not require complex post-processing image analysis. We apply our multi-plane phase-contrast microscope to the real-time observation of the fast motion of reactivated Chlamydomonas axonemes with sub-µm spatial and 4 ms temporal resolution. Our system allows us to observe not only bending but also the three-dimensional torsional dynamics of these micro-swimmers.

Enhancing laser speckle reduction by decreasing the pitch of a chiral nematic liquid crystal diffuser

The artefact known as speckle can plague numerous imaging applications where the narrow linewidth of laser light is required, which includes laser projection and medical imaging. Here, we report on the use of thin-film chiral nematic liquid crystal (LC) devices that can be used to mitigate the influence of speckle when subjected to an applied electric field. Results are presented which show that the speckle contrast (a quantitative measure of the presence of speckle) can be significantly reduced by decreasing the pitch of the chiral nematic LC from 2700 to 244 nm. Further reduction in the speckle contrast can be observed by operating the diffuser technology at a temperature close to the chiral nematic to isotropic transition. At such temperatures, we observe a simultaneous improvement in the transmission of light through the device and a decrease in the electric field amplitude required for the minimum speckle contrast value. We conclude by presenting a laser projected image of the 1951 USAF target with and without the LC device to demonstrate the visual improvement as a result of the speckle reduction.

Speckle reduction in digital holography with low-dimensional reconstruction

Speckle reduction is a crucial technique since the presence of speckle disturbs the quality of the reconstruction in digital holography. In this paper, we present an easy, fast, and efficient single-shot method to reduce speckle noise in digital holography. The method reconstructs subholograms from a single hologram. Then, sub-reconstruction images are randomly shuffled and divided into several groups and low-dimensional noise-reduced images can be achieved by averaging sub-reconstruction image groups by groups. Next, these low-dimensional noise-reduced images are combined to obtain a noise-reduced image. Finally, the noise-reduced image is processed by a mean filter to obtain a final image, which has substantially less speckle noise while preserving the dimensions of the original image. The experimental results demonstrate the effectiveness of the proposed method and indicate its potential in real-time digital holography.

Quantization of dynamic speckle patterns with spatially varying statistics

Raw data compression is mandatory for monitoring of processes by dynamic speckle analysis when two-dimensional activity maps are built by pointwise statistical processing of correlated speckle patterns formed on the surface of diffusely reflecting objects under laser illumination. Coarse quantization of speckle patterns enables storage and transfer of a huge amount of images, but it may be inefficient at spatially varying speckle statistics, such as for patterns recorded at non-uniform illumination or reflectivity. We prove efficacy of coarse quantization of the raw speckle data with varying statistics for a normalized algorithm by simulation and a polymer drop drying experiment. Both uniform and non-uniform quantization are proposed for treating such data. Decreasing the bit depth from 8 to 3 is possible without worsening the quality of the activity map.

Single-shot speckle reduction by elimination of redundant speckle patterns in digital holography

Speckle reduction is a crucial technique, since the presence of speckle disturbs the quality of the reconstruction in digital holography. In this paper, we present a redundant speckle elimination method to suppress the speckle noise. For the same position in each of the reconstructed sub-images, we consider pixels with the same gray value as information with the same speckle distribution. Therefore, a speckle-suppressed gray value can be obtained by extracting pixels with different gray values and then averaging. Through theoretical analysis and experiments, we demonstrate that speckle contrast can be decreased significantly by using the proposed method. Moreover, we show that the despeckle strength of the proposed method highly depends on the number of binary masks. These results indicate the potential of the proposed method for various applications.

Noise suppression for ballistic-photons based on compressive in-line holographic imaging through an inhomogeneous medium

Noise suppression is one of the most important tasks in imaging through inhomogeneous mediums. Here, we proposed a denoising approach based on compressive in-line holography for imaging through an inhomogeneous medium. A reference-beam-free system with a low-cost continuous-wave laser is presented. The suppression against the noise, which is brought by the scattering photons, is presented in simulations using the proposed algorithm. The noise immunity is demonstrated in lensless imaging behind a random phase mask with an optical depth of 1.42 by single exposure, as well as behind a ground glass with an optical depth of 6.38 by multiple exposures.

Label-Free Tomographic Imaging of Lipid Droplets in Foam Cells for Machine-Learning-Assisted Therapeutic Evaluation of Targeted Nanodrugs

Lipid droplet (LD) accumulation, a key feature of foam cells, constitutes an attractive target for therapeutic intervention in atherosclerosis. However, despite advances in cellular imaging techniques, current noninvasive and quantitative methods have limited application in living foam cells. Here, using optical diffraction tomography (ODT), we performed quantitative morphological and biophysical analysis of living foam cells in a label-free manner. We identified LDs in foam cells by verifying the specific refractive index using correlative imaging comprising ODT integrated with three-dimensional fluorescence imaging. Through time-lapse monitoring of three-dimensional dynamics of label-free living foam cells, we precisely and quantitatively evaluated the therapeutic effects of a nanodrug (mannose-polyethylene glycol-glycol chitosan-fluorescein isothiocyanate-lobeglitazone; MMR-Lobe) designed to affect the targeted delivery of lobeglitazone to foam cells based on high mannose receptor specificity. Furthermore, by exploiting machine-learning-based image analysis, we further demonstrated therapeutic evaluation at the single-cell level. These findings suggest that refractive index measurement is a promising tool to explore new drugs against LD-related metabolic diseases.

Fringe Phase-Shifting Field Based Fuzzy Quotient Space-Oriented Partial Differential Equations Filtering Method for Gaussian Noise-Induced Phase Error

Traditional filtering methods only focused on improving the peak signal-to-noise ratio of the single fringe pattern, which ignore the filtering effect on phase extraction. Fringe phase-shifting field based fuzzy quotient space-oriented partial differential equations filtering method is proposed to reduce the phase error caused by Gaussian noise while filtering. First, the phase error distribution that is caused by Gaussian noise is analyzed. Furthermore, by introducing the fringe phase-shifting field and the theory of fuzzy quotient space, the modified filtering direction can be adaptively obtained, which transforms the traditional single image filtering into multi-image filtering. Finally, the improved fourth-order oriented partial differential equations with fidelity item filtering method is established. Experiments demonstrated that the proposed method achieves a higher signal-to-noise ratio and lower phase error caused by noise, while also retaining more edge details.

Contrast transfer function of de-noising algorithms

This paper presents a comprehensive study on the contrast transfer function of de-noising algorithms. In order to cover a broad variety of methods, 45 de-noising algorithms are chosen considering their recognized efficiency in the different application domains of image processing. Advanced methods are targeted: wavelet transform-based algorithms with Daubechies, symlets, curvelets, contourlets, patch-based methods such as BM3D, NL-means algorithms and deep learning approaches; in addition, classical spatial filtering methods are considered, such as Wiener, median, Gauss filtering, and adaptive filtering approaches such as anisotropic diffusion and synthetic aperture radar filtering. The contrast transfer function is provided for each algorithm. Ranking of the set of de-noising algorithms is established according to proposed metrics. The paper provides practical methodology and novel results dedicated to the evaluation of the contrast transfer function of de-noising approaches from literature.