Quantitative phase imaging with partially coherent illumination

Image reconstruction for low cost spatial light interference microscopy with fixed and arbitrary phase modulation

During the past decade, spatial light interference microscopy (SLIM) has undergone rapid development, evidenced by its broadening applications in biology and medicine. However, the need for an expensive spatial light modulator (SLM) may limit its adoption, and the requirement for multiple images per plane limits its speed in volumetric imaging. Here we propose to address these issues by replacing the SLM with a mask fabricated from a low cost optical density (OD) filter, and recover high contrast images computationally rather than through phase-shifting. This is done using a specially constructed Wiener filter to recover the object scattering potential. A crucial part of the Wiener filter is estimating the arbitrary phase introduced by the OD filter. Our results demonstrate that not only were we able to estimate the OD filter's phase modulation in situ, but also the contrast of the reconstructed images is greatly improved. Comparisons with other related methods are also performed, with the conclusion that the combination of an inexpensive OD mask and modified Wiener filtering leads to results that are closest to the traditional SLIM setup. Thus, we have demonstrated the feasibility of a low cost, high speed SLIM system utilizing computational phase reconstruction, paving the way for wider adoption of high resolution phase microscopy.

White blood cell detection, classification and analysis using phase imaging with computational specificity (PICS)

Treatment of blood smears with Wright's stain is one of the most helpful tools in detecting white blood cell abnormalities. However, to diagnose leukocyte disorders, a clinical pathologist must perform a tedious, manual process of locating and identifying individual cells. Furthermore, the staining procedure requires considerable preparation time and clinical infrastructure, which is incompatible with point-of-care diagnosis. Thus, rapid and automated evaluations of unlabeled blood smears are highly desirable. In this study, we used color spatial light interference microcopy (cSLIM), a highly sensitive quantitative phase imaging (QPI) technique, coupled with deep learning tools, to localize, classify and segment white blood cells (WBCs) in blood smears. The concept of combining QPI label-free data with AI for the purpose of extracting cellular specificity has recently been introduced in the context of fluorescence imaging as phase imaging with computational specificity (PICS). We employed AI models to first translate SLIM images into brightfield micrographs, then ran parallel tasks of locating and labelling cells using EfficientNet, which is an object detection model. Next, WBC binary masks were created using U-net, a convolutional neural network that performs precise segmentation. After training on digitally stained brightfield images of blood smears with WBCs, we achieved a mean average precision of 75% for localizing and classifying neutrophils, eosinophils, lymphocytes, and monocytes, and an average pixel-wise majority-voting F1 score of 80% for determining the cell class from semantic segmentation maps. Therefore, PICS renders and analyzes synthetically stained blood smears rapidly, at a reduced cost of sample preparation, providing quantitative clinical information.

Nonlocal means filter based on cosine similarity applied in speckle reduction of digital holography

In the field of digital holography, the speckle caused by coherent light greatly disturbs the quality of the reconstruction. This paper presents an innovative method to efficiently reduce speckle noise with a nonlocal means filter based on cosine similarity that determines the weight of each traversal pixel to the target pixel by comparing the similarity between the target pixel neighborhood and the traversal pixel neighborhood. Experimental results with qualitative and quantitative analysis indicate that the proposed method significantly improves noise reduction performance while preserving the details of the original image. Compared with other general image-processing methods, this well-directed method is more in line with the characteristics of holographic speckle noise and has obvious advantages in various metrics.

Numerical analysis of the effect of reduced temporal coherence in quantitative phase microscopy and tomography

We present the numerical analysis of the effect of the temporarily partially coherent illumination on the phase measurement accuracy in digital holography microscopy (DHM) and optical diffraction tomography (ODT), as reconstruction algorithms tend to assume purely monochromatic conditions. In the regime of reduced temporal coherence, we simulate the hologram formation in two different optical setups, representing classical off-axis two-beam and grating common-path configurations. We consider two ODT variants: with sample rotation and angle-scanning of illumination. Besides the coherence degree of illumination, our simulation considers the influence of the sample normal dispersion, shape of the light spectrum, and optical parameters of the imaging setup. As reconstruction algorithms we employ Fourier hologram method and first-order Rytov approximation with direct inversion and nonnegativity constraints. Quantitative evaluation of the measurement results deviations introduced by the mentioned error sources is comprehensively analyzed, for the first time to the best of our knowledge. Obtained outcomes indicate low final DHM/ODT reconstruction errors for the grating-assisted common-path configuration. Nevertheless, dispersion and asymmetric spectrum introduce non-negligible overestimated refractive index values and noise, and should be thus carefully considered within experimental frameworks.

Self-calibrated 3D differential phase contrast microscopy with optimized illumination

3D phase imaging recovers an object's volumetric refractive index from intensity and/or holographic measurements. Partially coherent methods, such as illumination-based differential phase contrast (DPC), are particularly simple to implement in a commercial brightfield microscope. 3D DPC acquires images at multiple focus positions and with different illumination source patterns in order to reconstruct 3D refractive index. Here, we present a practical extension of the 3D DPC method that does not require a precise motion stage for scanning the focus and uses optimized illumination patterns for improved performance. The user scans the focus by hand, using the microscope's focus knob, and the algorithm self-calibrates the axial position to solve for the 3D refractive index of the sample through a computational inverse problem. We further show that the illumination patterns can be optimized by an end-to-end learning procedure. Combining these two, we demonstrate improved 3D DPC with a commercial microscope whose only hardware modification is LED array illumination.

Optically computed phase microscopy for quantitative dynamic imaging of label-free cells and nanoparticles

Numerous drug delivery systems based on nanoparticles have been developed, such as those used in BioNTech/Pfizer's and Moderna's Covid vaccines. Knowledge on mechanical interactions between cells and nanoparticles is critical to advance the efficiency and safety of these drug delivery systems. To quantitatively track the motion of cell (transparent) and nanoparticles (nontransparent) with nanometer displacement sensitivity, we investigate a novel imaging technology, optically computed phase microscopy (OCPM) that processes 3D spatial-spectral data through optical computation. We demonstrate that OCPM has the capability to image the motion of cells and magnetic nanoparticles that are mechanically excited by an external magnetic field, quantitatively and in the en face plane.

Label-free screening of brain tissue myelin content using phase imaging with computational specificity (PICS)

Inadequate myelination in the central nervous system is associated with neurodevelopmental complications. Thus, quantitative, high spatial resolution measurements of myelin levels are highly desirable. We used spatial light interference microcopy (SLIM), a highly sensitive quantitative phase imaging (QPI) technique, to correlate the dry mass content of myelin in piglet brain tissue with dietary changes and gestational size. We combined SLIM micrographs with an artificial intelligence (AI) classifying model that allows us to discern subtle disparities in myelin distributions with high accuracy. This concept of combining QPI label-free data with AI for the purpose of extracting molecular specificity has recently been introduced by our laboratory as phase imaging with computational specificity. Training on 8000 SLIM images of piglet brain tissue with the 71-layer transfer learning model Xception, we created a two-parameter classification to differentiate gestational size and diet type with an accuracy of 82% and 80%, respectively. To our knowledge, this type of evaluation is impossible to perform by an expert pathologist or other techniques.

Spatial light interference microscopy: principle and applications to biomedicine

In this paper, we review spatial light interference microscopy (SLIM), a common-path, phase-shifting interferometer, built onto a phase-contrast microscope, with white-light illumination. As one of the most sensitive quantitative phase imaging (QPI) methods, SLIM allows for speckle-free phase reconstruction with sub-nanometer path-length stability. We first review image formation in QPI, scattering, and full-field methods. Then, we outline SLIM imaging from theory and instrumentation to diffraction tomography. Zernike's phase-contrast microscopy, phase retrieval in SLIM, and halo removal algorithms are discussed. Next, we discuss the requirements for operation, with a focus on software developed in-house for SLIM that enables high-throughput acquisition, whole slide scanning, mosaic tile registration, and imaging with a color camera. We introduce two methods for solving the inverse problem using SLIM, white-light tomography, and Wolf phase tomography. Lastly, we review the applications of SLIM in basic science and clinical studies. SLIM can study cell dynamics, cell growth and proliferation, cell migration, mass transport, etc. In clinical settings, SLIM can assist with cancer studies, reproductive technology, blood testing, etc. Finally, we review an emerging trend, where SLIM imaging in conjunction with artificial intelligence brings computational specificity and, in turn, offers new solutions to outstanding challenges in cell biology and pathology.

Heterodyne phase shifting method in scanning probe microscopy

The present paper describes a novel implementation of the continuous phase shifting method (PSM), named heterodyne holography, in a scanning probe microscope configuration, able to retrieve the complex scattered field in on-axis configuration. This can be achieved by acquiring a continuous sequence of holograms at different wavelengths in just a single scan through the combination of scanning interference microscopy and a low-coherent signal acquired in the frequency domain. This method exploits the main advantages of the phase shifting technique and avoids some limits relative to off-axis holography in providing quantitative phase imaging.

Digital holography free of 2π ambiguity, using coherence modulation

In this Letter, a quantitative measurement method with an extended axial range in low-coherence light digital holography is presented. Based on the characteristics of the light source, the degree of coherence and phase values are obtained. Because the degree of coherence is modulated with respect to the optical path difference, it can be used to remove the 2π ambiguity of the phase, without the use of numerical or dual-wavelength methods. The mathematical procedures from three phase-shifting holograms are numerically described. From experimental results, the accurate measurements of a sample with high step are presented to confirm the effectiveness.

Low-coherent optical diffraction tomography by angle-scanning illumination

Temporally low-coherent optical diffraction tomography (ODT) is proposed and demonstrated based on angle-scanning Mach-Zehnder interferometry. Using a digital micromirror device based on diffractive tilting, the full-field interference of incoherent light is successfully maintained during every angle-scanning sequences. Further, current ODT reconstruction principles for temporally incoherent illuminations are thoroughly reviewed and developed. Several limitations of incoherent illumination are also discussed, such as the nondispersive assumption, optical sectioning capacity and illumination angle limitation. Using the proposed setup and reconstruction algorithms, low-coherent ODT imaging of plastic microspheres, human red blood cells and rat pheochromocytoma cells is experimentally demonstrated.

Novel computer-generated hologram encoding method based on partially temporal coherent light

Partially temporal coherent light (PTCL) has been applied to holographic reconstruction to reduce speckle noise in display systems, while the encoding methods of computer-generated hologram (CGH), based on PTCL, have not been reported. We propose a novel method to encoding CGH, in which a PTCL with a broadband continuous spectrum is used to illuminate the object image. The continuous spectrum is discretized into different wavelengths and a weight value associated with PTCL power spectrum is assigned to each wavelength. The diffractive transmission is based on Fresnel diffraction theory. The phase distribution of the encoded CGH is obtained using the sum of multiplying the different CGH phase distributions of corresponding discrete wavelengths by the corresponding weight values. The modulation results without iteration are performed to verify the feasibility of the proposed method and the iterative algorithm is introduced to improve the quality of the modulation. The reconstructed images from the proposed encoding method exhibit high quality as compared with that obtained from the encoding method based on ideal temporal coherent light. Numerical simulations and optical experiments are good consistent with each other. The proposed method can provide a reference for various wave-front modulations.

Accessible quantitative phase imaging in confocal microscopy with sinusoidal-phase synthetic optical holography

We present a technically simple implementation of quantitative phase imaging in confocal microscopy based on synthetic optical holography with sinusoidal-phase reference waves. Using a Mirau interference objective and low-amplitude vertical sample vibration with a piezo-controlled stage, we record synthetic holograms on commercial confocal microscopes (Nikon, model: A1R; Zeiss: model: LSM-880), from which quantitative phase images are reconstructed. We demonstrate our technique by stain-free imaging of cervical (HeLa) and ovarian (ES-2) cancer cells and stem cell (mHAT9a) samples. Our technique has the potential to extend fluorescence imaging applications in confocal microscopy by providing label-free cell finding, monitoring cell morphology, as well as non-perturbing long-time observation of live cells based on quantitative phase contrast.

Strategies for reducing speckle noise in digital holography

Digital holography (DH) has emerged as one of the most effective coherent imaging technologies. The technological developments of digital sensors and optical elements have made DH the primary approach in several research fields, from quantitative phase imaging to optical metrology and 3D display technologies, to name a few. Like many other digital imaging techniques, DH must cope with the issue of speckle artifacts, due to the coherent nature of the required light sources. Despite the complexity of the recently proposed de-speckling methods, many have not yet attained the required level of effectiveness. That is, a universal denoising strategy for completely suppressing holographic noise has not yet been established. Thus the removal of speckle noise from holographic images represents a bottleneck for the entire optics and photonics scientific community. This review article provides a broad discussion about the noise issue in DH, with the aim of covering the best-performing noise reduction approaches that have been proposed so far. Quantitative comparisons among these approaches will be presented.

Real-time halo correction in phase contrast imaging

As a label-free, nondestructive method, phase contrast is by far the most popular microscopy technique for routine inspection of cell cultures. However, features of interest such as extensions near cell bodies are often obscured by a glow, which came to be known as the halo. Advances in modeling image formation have shown that this artifact is due to the limited spatial coherence of the illumination. Nevertheless, the same incoherent illumination is responsible for superior sensitivity to fine details in the phase contrast geometry. Thus, there exists a trade-off between high-detail (incoherent) and low-detail (coherent) imaging systems. In this work, we propose a method to break this dichotomy, by carefully mixing corrected low-frequency and high-frequency data in a way that eliminates the edge effect. Specifically, our technique is able to remove halo artifacts at video rates, requiring no manual interaction or a priori point spread function measurements. To validate our approach, we imaged standard spherical beads, sperm cells, tissue slices, and red blood cells. We demonstrate real-time operation with a time evolution study of adherent neuron cultures whose neurites are revealed by our halo correction. We show that with our novel technique, we can quantify cell growth in large populations, without the need for thresholds and system variant calibration.

Halo-free Phase Contrast Microscopy

We present a new approach for retrieving halo-free phase contrast microscopy (hfPC) images by upgrading the conventional PC microscope with an external interferometric module, which generates sufficient data for reversing the halo artifact. Acquiring four independent intensity images, our approach first measures haloed phase maps of the sample. We solve for the halo-free sample transmission function by using a physical model of the image formation under partial spatial coherence. Using this halo-free sample transmission, we can numerically generate artifact-free PC images. Furthermore, this transmission can be further used to obtain quantitative information about the sample, e.g., the thickness with known refractive indices, dry mass of live cells during their cycles. We tested our hfPC method on various control samples, e.g., beads, pillars and validated its potential for biological investigation by imaging live HeLa cells, red blood cells, and neurons.

Quadriwave lateral shearing interferometric microscopy with wideband sensitivity enhancement for quantitative phase imaging in real time

Real-time quantitative phase imaging has tremendous potential in investigating live biological specimens in vitro. Here we report on a wideband sensitivity-enhanced interferometric microscopy for quantitative phase imaging in real time by employing two quadriwave lateral shearing interferometers based on randomly encoded hybrid gratings with different lateral shears. Theoretical framework to analyze the measurement sensitivity is firstly proposed, from which the optimal lateral shear pair for sensitivity enhancement is also derived. To accelerate the phase retrieval algorithm for real-time visualization, we develop a fully vectorized path-independent differential leveling phase unwrapping algorithm ready for parallel computing, and the framerate for retrieving the phase from each pair of two 4 mega pixel interferograms is able to reach 47.85 frames per second. Experiment results demonstrate that the wideband sensitivity-enhanced interferometric microscopy is capable of eliminating all the periodical error caused by spectral leaking problem and reducing the temporal standard deviation to the half level compared with phase directly retrieved by the interferogram. Due to its high adaptability, the wideband sensitivity-enhanced interferometric microscopy is promising in retrofitting existing microscopes to quantitative phase microscopes with high measurement precision and real-time visualization.

High-speed phase-shifting common-path quantitative phase imaging with a piezoelectric actuator

We present a phase-shifting quantitative phase imaging technique providing high temporal and spatial phase stability and high acquisition speed. A piezoelectric microfabricated phase modulator allows tunable modulation frequencies up to the kHz range. After assessing the quantitative phase accuracy with technical samples, we demonstrate the high acquisition rate while monitoring cellular processes at temporal scales ranging from milliseconds to hours.

Multimodal computational microscopy based on transport of intensity equation

Transport of intensity equation (TIE) is a powerful tool for phase retrieval and quantitative phase imaging, which requires intensity measurements only at axially closely spaced planes without a separate reference beam. It does not require coherent illumination and works well on conventional bright-field microscopes. The quantitative phase reconstructed by TIE gives valuable information that has been encoded in the complex wave field by passage through a sample of interest. Such information may provide tremendous flexibility to emulate various microscopy modalities computationally without requiring specialized hardware components. We develop a requisite theory to describe such a hybrid computational multimodal imaging system, which yields quantitative phase, Zernike phase contrast, differential interference contrast, and light field moment imaging, simultaneously. It makes the various observations for biomedical samples easy. Then we give the experimental demonstration of these ideas by time-lapse imaging of live HeLa cell mitosis. Experimental results verify that a tunable lens-based TIE system, combined with the appropriate postprocessing algorithm, can achieve a variety of promising imaging modalities in parallel with the quantitative phase images for the dynamic study of cellular processes.

Quantitative phase imaging of weakly scattering objects using partially coherent illumination

In this paper, we extend our recent work on partially coherent quantitative phase imaging (pcQPI) from two-dimensional (2D) to three-dimensional (3D) imaging of weakly scattering samples. Due to the mathematical complexity, most theoretical modeling of quantitative phase image formation under partial coherence has focused on thin, well-focused samples. It is unclear how these abberations are affected by defocusing. Also, as 3D QPI techniques continue to develop, a better model needs to be developed to understand and quantify these aberrations when imaging thicker samples. Here, using the first order Born's approximation, we derived a mathematical framework that provides an intuitive model of image formation under varying degrees of coherence. Our description provides a clear connection between the halo effect and phase underestimation, defocusing and the 3D structure of the sample under investigation. Our results agree very well with the experiments and show that the microscope objective defines the sectioning ability of the imaging system while the condenser lens is responsible for the halo effect.

Quantitative phase imaging to improve the diagnostic accuracy of urine cytology

BACKGROUND

A definitive diagnosis of urothelial carcinoma in urine cytology is often challenging and subjective. Many urine cytology samples receive an indeterminate diagnosis. Ancillary techniques such as fluorescence in situ hybridization (FISH) have been used to improve the diagnostic sensitivity, but FISH is not approved as a routine screening test, and the complex fluorescent staining protocol also limits its widespread clinical use. Quantitative phase imaging (QPI) is an emerging technology allowing accurate measurements of the single-cell dry mass. This study was undertaken to explore the ability of QPI to improve the diagnostic accuracy of urine cytology for malignancy.

METHODS

QPI was performed on unstained, ThinPrep-prepared urine cytology slides from 28 patients with 4 categories of cytological diagnoses (negative, atypical, suspicious, and positive for malignancy). The nuclear/cell dry mass, the entropy, and the nucleus-to-cell mass ratio were calculated for several hundred cells for each patient, and they were then correlated with the follow-up diagnoses.

RESULTS

The nuclear mass and nuclear mass entropy of urothelial cells showed significant differences between negative and positive groups. These data showed a progressive increase from patients with negative diagnosis, to patients with atypical/suspicious and positive cytologic diagnosis. Most importantly, among the patients in the atypical and suspicious diagnosis, the nuclear mass and its entropy were significantly higher for those patients with a follow-up diagnosis of malignancy than those patients without a subsequent follow-up diagnosis of malignancy.

CONCLUSIONS

QPI shows potential for improving the diagnostic accuracy of urine cytology, especially for indeterminate cases, and should be further evaluated as an ancillary test for urine cytology. Cancer Cytopathol 2016;124:641-50. © 2016 American Cancer Society.

Quantitative assessment of noise reduction with partial spatial coherence illumination in digital holographic microscopy

Improving image quality in digital holographic microscopy is achievable by using partial spatial coherence (PSC) illumination instead of fully coherent illumination. This Letter presents simple theoretical models to quantitatively assess the reduction of noise as a function of both the spatial coherence of the illumination and the defocus distance of the noise source. The first developed model states that the effect of the PSC can be studied by discretizing the field of view in the plane of the noise source. The second model, following a continuous approach, corroborates the discrete model and extends it. Experimental results confirm theoretical expectations.

Phase retrieval and diffractive imaging based on Babinet's principle and complementary random sampling

We proposed an iterative method for phase retrieval and diffractive imaging based on Babinet's principle and complementary random sampling (CRS). We demonstrated that the whole complex amplitude (not sieved) of an object wave can be accurately retrieved from the diffraction intensities of the object wave sampled by a group of binary CRS masks and the diffractive imaging for the object can be realized through a single digital inverse diffraction. Some experimental results are given for the demonstration. Our experimental results reveal that, using CRS, the influence of a binary random sampling mask on the retrieved field can be well eliminated, and the accuracy and efficiency of the phase retrieval can be greatly improved.

Plane-wave decomposition of spatially random fields

We investigate the uniqueness of the plane-wave decomposition of temporally deterministic, spatially random fields. Specifically, we consider the decomposition of spatially ergodic and, thus, statistically homogeneous fields. We show that when the spatial power spectrum is injective, the plane waves are the only possible coherent modes. Furthermore, the randomness of such fields originates in the spatial spectral phase, i.e., the phase associated with the coefficients of each plane wave in the expansion. By contrast, the spectral amplitude is deterministic and is specified by the spatial power spectrum. We end with a discussion showing how the results can be translated in full to the time domain.

Breast cancer diagnosis using spatial light interference microscopy

The standard practice in histopathology of breast cancers is to examine a hematoxylin and eosin (H&E) stained tissue biopsy under a microscope to diagnose whether a lesion is benign or malignant. This determination is made based on a manual, qualitative inspection, making it subject to investigator bias and resulting in low throughput. Hence, a quantitative, label-free, and high-throughput diagnosis method is highly desirable. We present here preliminary results showing the potential of quantitative phase imaging for breast cancer screening and help with differential diagnosis. We generated phase maps of unstained breast tissue biopsies using spatial light interference microscopy (SLIM). As a first step toward quantitative diagnosis based on SLIM, we carried out a qualitative evaluation of our label-free images. These images were shown to two pathologists who classified each case as either benign or malignant. This diagnosis was then compared against the diagnosis of the two pathologists on corresponding H&E stained tissue images and the number of agreements were counted. The agreement between SLIM and H&E based diagnosis was 88% for the first pathologist and 87% for the second. Our results demonstrate the potential and promise of SLIM for quantitative, label-free, and high-throughput diagnosis.

Epi-illumination diffraction phase microscopy with white light

We demonstrate the first reflection-based epi-illumination diffraction phase microscope with white light (epi-wDPM). The epi-wDPM system combines the off-axis, common-path, and white light approaches, in a reflection geometry enabling sub-nanometer spatial and temporal noise levels, while providing single-shot acquisition for opaque samples. We verified the epi-wDPM results by measuring control samples with known dimensions and comparing them to measurements from other well-established techniques. We imaged gold-coated HeLa cells to illustrate the tradeoffs between epi-wDPM with low and high spatial coherence.