Simplified approach for quantitative digital holographic phase contrast imaging of living cells

Quantitative phase imaging with optical differentiation by spatially variable amplitude filters

We present a non-interferometric technique for quantitative phase imaging (QPI) that is cost-effective, easily integrated into standard microscopes, and capable of wide-field imaging with noncoherent light. Our method measures the phase gradient through optical differentiation using spatially variable amplitude filters, accommodating a range of transmission functions, including commercially available variable neutral-density filters. This flexibility is made possible by a general relationship we derive. The approach is demonstrated by recovering phase information from a microsphere with a phase shift exceeding 2π, without the need for phase unwrapping. Additionally, we image multiple HeLa cells across a large field of view.

Intelligent sensing for the autonomous manipulation of microrobots toward minimally invasive cell surgery

The physiology and pathogenesis of biological cells have drawn enormous research interest. Benefiting from the rapid development of microfabrication and microelectronics, miniaturized robots with a tool size below micrometers have widely been studied for manipulating biological cells in vitro and in vivo. Traditionally, the complex physiological environment and biological fragility require human labor interference to fulfill these tasks, resulting in high risks of irreversible structural or functional damage and even clinical risk. Intelligent sensing devices and approaches have been recently integrated within robotic systems for environment visualization and interaction force control. As a consequence, microrobots can be autonomously manipulated with visual and interaction force feedback, greatly improving accuracy, efficiency, and damage regulation for minimally invasive cell surgery. This review first explores advanced tactile sensing in the aspects of sensing principles, design methodologies, and underlying physics. It also comprehensively discusses recent progress on visual sensing, where the imaging instruments and processing methods are summarized and analyzed. It then introduces autonomous micromanipulation practices utilizing visual and tactile sensing feedback and their corresponding applications in minimally invasive surgery. Finally, this work highlights and discusses the remaining challenges of current robotic micromanipulation and their future directions in clinical trials, providing valuable references about this field.

Imaging the intracellular refractive index distribution (IRID) for dynamic label-free living colon cancer cells via circularly depolarization decay model (CDDM)

Label-free detection of intracellular substances for living cancer cells remains a significant hurdle in cancer pathogenesis research. Although the sensitivity of light polarization to intracellular substances has been validated, current studies are predominantly focused on tissue lesions, thus label-free detection of substances within individual living cancer cells is still a challenge. The main difficulty is to find specific detection methods along with corresponding characteristic parameters. With refractive index as an endogenous marker of substances, this study proposes a detection method of intracellular refractive index distribution (IRID) for label-free living colon cancer (LoVo) cells. Utilizing the circular depolarization decay model (CDDM) to calculate the degree of circular polarization (DOCP) modulated by the cell allows for the derivation of the IRID on the focal plane. Experiments on LoVo cells demonstrated the refractive index of single cell can be accurately and precisely measured, with precision of 10-3 refractive index units (RIU). Additionally, chromatin content during the interphases (G1, S, G2) of cell cycle was recorded at 56.5%, 64.4%, and 71.5%, respectively. A significantly finer IRID can be obtained compared to the phase measurement method. This method is promising in providing a dynamic label-free intracellular substances detection method in cancer pathogenesis studies.

Live Cell Imaging by Single-Shot Common-Path Wide Field-of-View Reflective Digital Holographic Microscope

Quantitative phase imaging by digital holographic microscopy (DHM) is a nondestructive and label-free technique that has been playing an indispensable role in the fields of science, technology, and biomedical imaging. The technique is competent in imaging and analyzing label-free living cells and investigating reflective surfaces. Herein, we introduce a new configuration of a wide field-of-view single-shot common-path off-axis reflective DHM for the quantitative phase imaging of biological cells that leverages several advantages, including being less-vibration sensitive to external perturbations due to its common-path configuration, also being compact in size, simple in optical design, highly stable, and cost-effective. A detailed description of the proposed DHM system, including its optical design, working principle, and capability for phase imaging, is presented. The applications of the proposed system are demonstrated through quantitative phase imaging results obtained from the reflective surface (USAF resolution test target) as well as transparent samples (living plant cells). The proposed system could find its applications in the investigation of several biological specimens and the optical metrology of micro-surfaces.

Digital holographic microscopy of spiropyran-based dynamic materials

Spiropyran (SP)-based dynamic materials undergo structural changes in response to external stimuli. In this paper, we show that digital holographic microscopy (DHM) is an effective candidate for characterisation of SPs (embedded in polymer matrices) and for monitoring of their dynamical changes. The polymer matrices are polylactic acid (PLA) and poly(methyl methacrylate) (PMMA) films, which are decorated with SPs and immobilised on graphene quantum dots (GQDs). GQDs are modified by benzylamines prior to the loading of SP species because of the enhancement of hydrophobic characteristics. UV irradiation is used as the external stimulus and the dynamical changes of the samples before and after UV irradiation are measured. DHM is arranged on a novel self-referencing setup, which substantially reduces the sensitivity of DHM to environmental vibrations. Morphometric information for characterisation of the samples is obtained by analysis of the recorded digital holograms. The experimental results demonstrate the potential of the presented technique to serve as an alternative technique for surface measurement methodologies such as atomic force microscope and stylus profiler for surface characterisation of similar materials.

Single-shot wavelength-multiplexed phase microscopy under Gabor regime in a regular microscope embodiment

Phase imaging microscopy under Gabor regime has been recently reported as an extremely simple, low cost and compact way to update a standard bright-field microscope with coherent sensing capabilities. By inserting coherent illumination in the microscope embodiment and producing a small defocus distance of the sample at the input plane, the digital sensor records an in-line Gabor hologram of the target sample, which is then numerically post-processed to finally achieve the sample's quantitative phase information. However, the retrieved phase distribution is affected by the two well-known drawbacks when dealing with Gabor's regime, that is, coherent noise and twin image disturbances. Here, we present a single-shot technique based on wavelength multiplexing for mitigating these two effects. A multi-illumination laser source (including 3 diode lasers) illuminates the sample and a color digital sensor (conventional RGB color camera) is used to record the wavelength-multiplexed Gabor hologram in a single exposure. The technique is completed by presenting a novel algorithm based on a modified Gerchberg-Saxton kernel to finally retrieve an enhanced quantitative phase image of the sample, enhanced in terms of coherent noise removal and twin image minimization. Experimental validations are performed in a regular Olympus BX-60 upright microscope using a 20X 0.46NA objective lens and considering static (resolution test targets) and dynamic (living spermatozoa) phase samples.

Single capture bright field and off-axis digital holographic microscopy

We report on a single capture approach for simultaneous incoherent bright field (BF) and laser-based quantitative phase imaging (QPI). Common-path digital holographic microscopy (DHM) is implemented in parallel with BF imaging within the optical path of a commercial optical microscope to achieve spatially multiplexed recording of white light images and digital off-axis holograms, which are subsequently numerically demultiplexed. The performance of the proposed multimodal concept is firstly determined by investigations on microspheres. Then, the application for label-free dual-mode QPI and BF imaging of living pancreatic tumor cells is demonstrated.

White blood cell detection, classification and analysis using phase imaging with computational specificity (PICS)

Treatment of blood smears with Wright's stain is one of the most helpful tools in detecting white blood cell abnormalities. However, to diagnose leukocyte disorders, a clinical pathologist must perform a tedious, manual process of locating and identifying individual cells. Furthermore, the staining procedure requires considerable preparation time and clinical infrastructure, which is incompatible with point-of-care diagnosis. Thus, rapid and automated evaluations of unlabeled blood smears are highly desirable. In this study, we used color spatial light interference microcopy (cSLIM), a highly sensitive quantitative phase imaging (QPI) technique, coupled with deep learning tools, to localize, classify and segment white blood cells (WBCs) in blood smears. The concept of combining QPI label-free data with AI for the purpose of extracting cellular specificity has recently been introduced in the context of fluorescence imaging as phase imaging with computational specificity (PICS). We employed AI models to first translate SLIM images into brightfield micrographs, then ran parallel tasks of locating and labelling cells using EfficientNet, which is an object detection model. Next, WBC binary masks were created using U-net, a convolutional neural network that performs precise segmentation. After training on digitally stained brightfield images of blood smears with WBCs, we achieved a mean average precision of 75% for localizing and classifying neutrophils, eosinophils, lymphocytes, and monocytes, and an average pixel-wise majority-voting F1 score of 80% for determining the cell class from semantic segmentation maps. Therefore, PICS renders and analyzes synthetically stained blood smears rapidly, at a reduced cost of sample preparation, providing quantitative clinical information.

Developing a Reliable Holographic Flow Cyto-Tomography Apparatus by Optimizing the Experimental Layout and Computational Processing

Digital Holographic Tomography (DHT) has recently been established as a means of retrieving the 3D refractive index mapping of single cells. To make DHT a viable system, it is necessary to develop a reliable and robust holographic apparatus in order that such technology can be utilized outside of specialized optics laboratories and operated in the in-flow modality. In this paper, we propose a quasi-common-path lateral-shearing holographic optical set-up to be used, for the first time, for DHT in a flow-cytometer modality. The proposed solution is able to withstand environmental vibrations that can severely affect the interference process. Furthermore, we have scaled down the system while ensuring that a full 360° rotation of the cells occurs in the field-of-view, in order to retrieve 3D phase-contrast tomograms of single cells flowing along a microfluidic channel. This was achieved by setting the camera sensor at 45° with respect to the microfluidic direction. Additional optimizations were made to the computational elements to ensure the reliable retrieval of 3D refractive index distributions by demonstrating an effective method of tomographic reconstruction, based on high-order total variation. The results were first demonstrated using realistic 3D numerical phantom cells to assess the performance of the proposed high-order total variation method in comparison with the gold-standard algorithm for tomographic reconstructions: namely, filtered back projection. Then, the proposed DHT system and the processing pipeline were experimentally validated for monocytes and mouse embryonic fibroblast NIH-3T3 cells lines. Moreover, the repeatability of these tomographic measurements was also investigated by recording the same cell multiple times and quantifying the ability to provide reliable and comparable tomographic reconstructions, as confirmed by a correlation coefficient greater than 95%. The reported results represent various steps forward in several key aspects of in-flow DHT, thus paving the way for its use in real-world applications.

Off-axis common-path digital holography using a cube beam splitter

An off-axis common-path digital holography is built up by inserting a 45° tilted cube beam splitter (CBS) into a 4f system that is described in this paper. Two apertures are set as the input of the 4f system, where one supports the object, and the other is vacant. The CBS divides the incoming beam into two copies, which are symmetrical with each other along the semi-reflecting layer. Due to the separation of two beams in a Fourier plane and the flipping of the field of view induced by the CBS, an off-axis hologram can be captured. Moreover, the carrier frequency can be easily modulated by translating the CBS perpendicular to the optical axis. The new proposed scheme has high light utilization, a compact setup, and high temporal stability. The experiments are carried out to demonstrate the validity and stability of the proposed method.

Single-Shot 3D Topography of Transmissive and Reflective Samples with a Dual-Mode Telecentric-Based Digital Holographic Microscope

Common path DHM systems are the most robust DHM systems as they are based on self-interference and are thus less prone to external fluctuations. A common issue amongst these DHM systems is that the two replicas of the sample’s information overlay due to self-interference, making them only suitable for imaging sparse samples. This overlay has restricted the use of common-path DHM systems in material science. The overlay can be overcome by limiting the sample’s field of view to occupy only half of the imaging field of view or by using an optical spatial filter. In this work, we have implemented optical spatial filtering in a common-path DHM system using a Fresnel biprism. We have analyzed the optimal pinhole size by evaluating the frequency content of the reconstructed phase images of a star target. We have also measured the accuracy of the system and the sensitivity to noise for different pinhole sizes. Finally, we have proposed the first dual-mode common-path DHM system using a Fresnel biprism. The performance of the dual-model DHM system has been evaluated experimentally using transmissive and reflective microscopic samples.

Application of quantitative cell imaging using label-free optical diffraction tomography

The cell is three-dimensionally and dynamically organized into cellular compartments, including the endoplasmic reticulum, mitochondria, vesicles, and nucleus, which have high relative molecular density. The structure and functions of these compartments and organelles may be deduced from the diffusion and interaction of related biomolecules. Among these cellular components, various protein molecules can freely access the nucleolus or mitotic chromosome through Brownian diffusion, even though they have a densely packed structure. However, physicochemical properties of the nucleolus and chromosomes, such as molecular density and volume, are not yet fully understood under changing cellular conditions. Many studies have been conducted based on high-resolution imaging and analysis techniques using fluorescence. However, there are limitations in imaging only fluorescently labeled molecules, and cytotoxicity occurs during three-dimensional imaging. Alternatively, the recently developed label-free three-dimensional optical diffraction tomography (ODT) imaging technique can divide various organelles in cells into volumes and analyze them by refractive index, although specific molecules cannot be observed. A previous study established an analytical method that provides comprehensive insights into the physical properties of the nucleolus and mitotic chromosome by utilizing the advantages of ODT and fluorescence techniques, such as fluorescence correlation spectroscopy and confocal laser scanning microscopy. This review article summarizes a recent study and discusses the future aspects of the ODT for cellular compartments.

Label-free quantitative measurement of cardiovascular dynamics in a zebrafish embryo using frequency-comb-referenced-quantitative phase imaging

SIGNIFICANCE

Real-time monitoring of the heart rate and blood flow is crucial for studying cardiovascular dysfunction, which leads to cardiovascular diseases.

AIM

This study aims at in-depth understanding of high-speed cardiovascular dynamics in a zebrafish embryo model for various biomedical applications via frequency-comb-referenced quantitative phase imaging (FCR-QPI).

APPROACH

Quantitative phase imaging (QPI) has emerged as a powerful technique in the field of biomedicine but has not been actively applied to the monitoring of circulatory/cardiovascular parameters, due to dynamic speckles and low frame rates. We demonstrate FCR-QPI to measure heart rate and blood flow in a zebrafish embryo. FCR-QPI utilizes a high-speed photodetector instead of a conventional camera, so it enables real-time monitoring of individual red blood cell (RBC) flow.

RESULTS

The average velocity of zebrafish's RBCs was measured from 192.5 to 608.8  μm  /  s at 24 to 28 hour-post-fertilization (hpf). In addition, the number of RBCs in a pulsatile blood flow was revealed to 16 cells/pulse at 48 hpf. The heart rates corresponded to 94 and 142 beats-per-minute at 24 and 48 hpf.

CONCLUSIONS

This approach will newly enable in-depth understanding of the cardiovascular dynamics in the zebrafish model and possible usage for drug discovery applications in biomedicine.

Quantitative phase imaging in digital holographic microscopy based on image inpainting using a two-stage generative adversarial network

Based on the hologram inpainting via a two-stage Generative Adversarial Network (GAN), we present a precise phase aberration compensation method in digital holographic microscopy (DHM). In the proposed methodology, the interference fringes of the sample area in the hologram are firstly removed by the background segmentation via edge detection and morphological image processing. The vacancy area is then inpainted with the fringes generated by a deep learning algorithm. The image inpainting finally results in a sample-free reference hologram containing the total aberration of the system. The phase aberrations could be deleted by subtracting the unwrapped phase of the sample-free hologram from our inpainting network results, in no need of any complex spectrum centering procedure, prior knowledge of the system, or manual intervention. With a full and proper training of the two-stage GAN, our approach can robustly realize a distinct phase mapping, which overcomes the drawbacks of multiple iterations, noise interference or limited field of view in the recent methods using self-extension, Zernike polynomials fitting (ZPF) or geometrical transformations. The validity of the proposed procedure is confirmed by measuring the surface of preprocessed silicon wafer with a Michelson interferometer digital holographic inspection platform. The results of our experiment indicate the viability and accuracy of the presented method. Additionally, this work can pave the way for the evaluation of new applications of GAN in DHM.

Label-free screening of brain tissue myelin content using phase imaging with computational specificity (PICS)

Inadequate myelination in the central nervous system is associated with neurodevelopmental complications. Thus, quantitative, high spatial resolution measurements of myelin levels are highly desirable. We used spatial light interference microcopy (SLIM), a highly sensitive quantitative phase imaging (QPI) technique, to correlate the dry mass content of myelin in piglet brain tissue with dietary changes and gestational size. We combined SLIM micrographs with an artificial intelligence (AI) classifying model that allows us to discern subtle disparities in myelin distributions with high accuracy. This concept of combining QPI label-free data with AI for the purpose of extracting molecular specificity has recently been introduced by our laboratory as phase imaging with computational specificity. Training on 8000 SLIM images of piglet brain tissue with the 71-layer transfer learning model Xception, we created a two-parameter classification to differentiate gestational size and diet type with an accuracy of 82% and 80%, respectively. To our knowledge, this type of evaluation is impossible to perform by an expert pathologist or other techniques.

Single-shot common-path off-axis digital holography: applications in bioimaging and optical metrology [Invited]

The demand for single-shot and common-path holographic systems has become increasingly important in recent years, as such systems offer various advantages compared to their counterparts. Single-shot holographic systems, for example, reduce computational complexity as only a single hologram with the object information required to process, making them more suitable for the investigation of dynamic events; and common-path holographic systems are less vibration-sensitive, compact, inexpensive, and high in temporal phase stability. We have developed a single-shot common-path off-axis digital holographic setup based on a beam splitter and pinhole. In this paper, we present a concise review of the proposed digital holographic system for several applications, including the quantitative phase imaging to investigate the morphological and quantitative parameters, as a metrological tool for testing of micro-optics, industrial inspection and measurement, and sound field imaging and visualization.

Single-shot common-path off-axis dual-wavelength digital holographic microscopy

A single-shot common-path off-axis self-interference dual-wavelength digital holographic microscopic (DHM) system based on a cube beam splitter is demonstrated to expand the phase range in a stepped microstructure and for simultaneous measurement of the refractive index and physical thickness of a specimen. In the system, two laser beams with wavelengths of 532 nm and 632.8 nm are used. These laser beams are combined to transilluminate the object under study, then the object beam is divided into two beams by using a beam splitter oriented in such a way that both the beams propagate in almost the same direction, with an appropriate lateral separation between them. One of the object beams is spatially filtered at its Fourier plane, using a pinhole to generate a reference spherical beam free from the object information. The reference beam interferes with the object beam to form a digital hologram at the faceplate of the image sensor. The phase information is extracted from a single recorded digital hologram using the phase aberration compensation method that is based on principal component analysis (PCA). Owing to the common-path configuration, the system shows high temporal phase stability and it is less vibration-sensitive compared to counterparts such as a Mach-Zehnder type DHM. The performance of the dual-wavelength DHM system is verified in two different application fields by conducting the experiments using microsphere beads and living plant cells.

Advantages of Fresnel biprism-based digital holographic microscopy in quantitative phase imaging

SIGNIFICANCE

The hallmarks of digital holographic microscopy (DHM) compared with other quantitative phase imaging (QPI) methods are high speed, accuracy, spatial resolution, temporal stability, and polarization-sensitivity (PS) capability. The above features make DHM suitable for real-time quantitative PS phase imaging in a broad number of biological applications aimed at understanding cell growth and dynamic changes occurring during physiological processes and/or in response to pharmaceutical agents.

AIM

The insertion of a Fresnel biprism (FB) in the image space of a light microscope potentially turns any commercial system into a DHM system enabling QPI with the five desired features in QPI simultaneously: high temporal sensitivity, high speed, high accuracy, high spatial resolution, and PS. To the best of our knowledge, this is the first FB-based DHM system providing these five features all together.

APPROACH

The performance of the proposed system was calibrated with a benchmark phase object. The PS capability has been verified by imaging human U87 glioblastoma cells.

RESULTS

The proposed FB-based DHM system provides accurate phase images with high spatial resolution. The temporal stability of our system is in the order of a few nanometers, enabling live-cell studies. Finally, the distinctive behavior of the cells at different polarization angles (e.g., PS capability) can be observed with our system.

CONCLUSIONS

We have presented a method to turn any commercial light microscope with monochromatic illumination into a PS QPI system. The proposed system provides accurate quantitative PS phase images in a new, simple, compact, and cost-effective format, thanks to the low cost (a few hundred dollars) involved in implementing this simple architecture, enabling the use of this QPI technique accessible to most laboratories with standard light microscopes.

Deep learning-based cell identification and disease diagnosis using spatio-temporal cellular dynamics in compact digital holographic microscopy

We demonstrate a successful deep learning strategy for cell identification and disease diagnosis using spatio-temporal cell information recorded by a digital holographic microscopy system. Shearing digital holographic microscopy is employed using a low-cost, compact, field-portable and 3D-printed microscopy system to record video-rate data of live biological cells with nanometer sensitivity in terms of axial membrane fluctuations, then features are extracted from the reconstructed phase profiles of segmented cells at each time instance for classification. The time-varying data of each extracted feature is input into a recurrent bi-directional long short-term memory (Bi-LSTM) network which learns to classify cells based on their time-varying behavior. Our approach is presented for cell identification between the morphologically similar cases of cow and horse red blood cells. Furthermore, the proposed deep learning strategy is demonstrated as having improved performance over conventional machine learning approaches on a clinically relevant dataset of human red blood cells from healthy individuals and those with sickle cell disease. The results are presented at both the cell and patient levels. To the best of our knowledge, this is the first report of deep learning for spatio-temporal-based cell identification and disease detection using a digital holographic microscopy system.

Grating deployed total-shear 3-beam interference microscopy with reduced temporal coherence

Interference microscopy is a powerful optical imaging technique providing quantitative phase distribution information to characterize various type technical and biomedical objects. Static and dynamic objects and processes can be investigated. In this paper we propose very compact, common-path and partially coherent diffraction grating-based interference microscopy system for studying small objects like single cells with low densities being sparsely distributed in the field of view. Simple binary amplitude diffraction grating is the only additional element to be introduced into a conventional microscope optical system. By placing it at a proper distance in front of the microscope image plane the total-shear operation mode is deployed resulting in interferograms of the object-reference beam type. Depending on the grating to image plane separation distance two or three-beam interferograms are generated. The latter ones are advantageous since they contain achromatic second harmonics in the interferogram intensity distributions. This feature enables to use reduced temporal coherence light sources for the microscope to reduce coherent noise and parasitic interference patterns. For this purpose we employ the laser diode with driving current below the threshold one. Results of conducted experiments including automatic computer processing of interferograms fully corroborate analytical description of the proposed method and illustrate its capabilities for studying static and dynamic phase objects.

Quantitative phase imaging by wide-field interferometry with variable shearing distance uncoupled from the off-axis angle

We introduce a new shearing interferometry module for digital holographic microscopy, in which the off-axis angle, which defines the interference fringe frequency, is not coupled to the shearing distance, as is the case in most shearing interferometers. Thus, it enables the selection of shearing distance based on the spatial density of the sample, without losing spatial frequency content due to overlapping of the complex wave fronts in the spatial frequency domain. Our module is based on a 4f imaging unit and a diffraction grating, in which the hologram is generated from two mutually coherent, partially overlapping sample beams, with adjustable shearing distance, as defined by the position of the grating, but with a constant off-axis angle, as defined by the grating period. The module is simple, easy to align, and presents a nearly common-path geometry. By placing this module as an add-on unit at the exit port of an inverted microscope, quantitative phase imaging can easily be performed. The system is characterized by a 2.5 nm temporal stability and a 3.4 nm spatial stability, without using anti-vibration techniques. We provide quantitative phase imaging experiments of silica beads with different shearing distances, red blood cell fluctuations, and cancer cells flowing in a micro-channel, which demonstrate the capability and versatility of our approach in different imaging scenarios.

Mitotic Chromosomes in Live Cells Characterized Using High-Speed and Label-Free Optical Diffraction Tomography

The cell nucleus is a three-dimensional, dynamic organelle organized into subnuclear compartments such as chromatin and nucleoli. The structure and function of these compartments are maintained by diffusion and interactions between related factors as well as by dynamic and structural changes. Recent studies using fluorescent microscopic techniques suggest that protein factors can access and are freely mobile in heterochromatin and in mitotic chromosomes, despite their densely packed structure. However, the physicochemical properties of the chromosome during cell division are not fully understood. In the present study, characteristic properties such as the refractive index (RI), volume of the mitotic chromosomes, and diffusion coefficient (D) of fluorescent probes inside the chromosome were quantified using an approach combining label-free optical diffraction tomography with complementary confocal laser-scanning microscopy and fluorescence correlation spectroscopy. Variations in these parameters correlated with osmotic conditions, suggesting that changes in RI are consistent with those of the diffusion coefficient for mitotic chromosomes and cytosol. Serial RI tomography images of chromosomes in live cells during mitosis were compared with three-dimensional confocal micrographs to demonstrate that compaction and decompaction of chromosomes induced by osmotic change were characterized by linked changes in chromosome RI, volume, and the mobilities of fluorescent proteins.

Quantitative phase imaging of cells in a flow cytometry arrangement utilizing Michelson interferometer-based off-axis digital holographic microscopy

We combined Michelson-interferometer-based off-axis digital holographic microscopy (DHM) with a common flow cytometry (FCM) arrangement. Utilizing object recognition procedures and holographic autofocusing during the numerical reconstruction of the acquired off-axis holograms, sharply focused quantitative phase images of suspended cells in flow were retrieved without labeling, from which biophysical cellular features of distinct cells, such as cell radius, refractive index and dry mass, can be subsequently retrieved in an automated manner. The performance of the proposed concept was first characterized by investigations on microspheres that were utilized as test standards. Then, we analyzed two types of pancreatic tumor cells with different morphology to further verify the applicability of the proposed method for quantitative live cell imaging. The retrieved biophysical datasets from cells in flow are found in good agreement with results from comparative investigations with previously developed DHM methods under static conditions, which demonstrates the effectiveness and reliability of our approach. Our results contribute to the establishment of DHM in imaging FCM and prospect to broaden the application spectrum of FCM by providing complementary quantitative imaging as well as additional biophysical cell parameters which are not accessible in current high-throughput FCM measurements.

Physicochemical Properties of Nucleoli in Live Cells Analyzed by Label-Free Optical Diffraction Tomography

The cell nucleus is three-dimensionally and dynamically organized by nuclear components with high molecular density, such as chromatin and nuclear bodies. The structure and functions of these components are represented by the diffusion and interaction of related factors. Recent studies suggest that the nucleolus can be assessed using various protein probes, as the probes are highly mobile in this organelle, although it is known that they have a densely packed structure. However, physicochemical properties of the nucleolus itself, such as molecular density and volume when cellular conditions are changed, are not yet fully understood. In this study, physical parameters such as the refractive index (RI) and volume of the nucleoli in addition to the diffusion coefficient (D) of fluorescent probe protein inside the nucleolus are quantified and compared by combining label-free optical diffraction tomography (ODT) with confocal laser scanning microscopy (CLSM)-based fluorescence correlation spectroscopy (FCS). 3D evaluation of RI values and corresponding RI images of nucleoli in live HeLa cells successfully demonstrated varying various physiological conditions. Our complimentary method suggests that physical property of the nucleolus in live cell is sensitive to ATP depletion and transcriptional inhibition, while it is insensitive to hyper osmotic pressure when compared with the cytoplasm and nucleoplasm. The result demonstrates that the nucleolus has unique physicochemical properties when compared with other cellular components.

Quantitative phase imaging based on simple Michelson-type lateral shearing interferometry with rotational right-angle prisms

By using a kind of simple Michelson-type lateral shearing interferometry, in this paper, the precise quantitative phase measurement of transparent microscopic objects is realized successfully. For this interferometry, on the basis of the fundamental structure of the traditional Michelson interferometer, the two plane mirrors are replaced with two ordinary right-angle prisms. In the beginning, the ridges of the two right-angle prisms are set to align with the optical axis and be in the vertical direction. Subsequently, to achieve the lateral shear, one of these two right-angle prisms is rotated around its ridge. Furthermore, the goal to obtain more lateral shear can be achieved by introducing a bigger rotating angle or rotating another prism simultaneously. In addition, owing to the simple structure of the Michelson interferometer and the inexpensive optical components used, the system is compact, portable, easy to operate, and low cost. The experimental results show the practicability of this system.

Single-shot slightly off-axis digital holographic microscopy with add-on module based on beamsplitter cube

Slightly off-axis digital holographic microscopy (SO-DHM) has recently emerged as a novel experimental arrangement for quantitative phase imaging (QPI). It offers improved capabilities in conventional on-axis and off-axis interferometric configurations. In this contribution, we report on a single-shot SO-DHM approach based on an add-on module adapted to the exit port of a regular microscope. The module employs a beamsplitter (BS) cube interferometer and includes, in addition, a Stokes lens (SL) for astigmatism compensation. Each recorded frame contains two fields of view (FOVs) of the sample, where each FOV is a hologram which is phase shifted by π rads with respect to the other. These two simultaneously recorded holograms are numerically processed, in order to retrieve complex amplitude distribution with enhanced quality. The tradeoff is done in the FOV which becomes penalized as a consequence of the simultaneous recording of the two holograms in a single snapshot. Experimental validation is presented for a wide variety of samples using a regular Olympus BX-60 upright microscope. The proposed approach provides an optimized use of the imaging system, in terms of the space-bandwidth product, in comparison with off-axis configuration; allows the analysis of fast-dynamic events, owing to its single-shot capability when compared with on-axis arrangement; and becomes easily implementable in conventional white-light microscopes for upgrading them into holographic microscopes for QPI.

Automated quantitative analysis of multiple cardiomyocytes at the single-cell level with three-dimensional holographic imaging informatics

Cardiomyocytes derived from human pluripotent stem cells are a promising tool for disease modeling, drug compound testing, and cardiac toxicity screening. Bio-image segmentation is a prerequisite step in cardiomyocyte image analysis by digital holography (DH) in microscopic configuration and has provided satisfactory results. In this study, we quantified multiple cardiac cells from segmented 3-dimensional DH images at the single-cell level and measured multiple parameters describing the beating profile of each individual cell. The beating profile is extracted by monitoring dry-mass distribution during the mechanical contraction-relaxation activity caused by cardiac action potential. We present a robust two-step segmentation method for cardiomyocyte low-contrast image segmentation based on region and edge information. The segmented single-cell contains mostly the nucleus of the cell since it is the best part of the cardiac cell, which can be perfectly segmented. Clustering accuracy was assessed by a silhouette index evaluation for k-means clustering and the Dice similarity coefficient (DSC) of the final segmented image. 3D representation of single of cardiomyocytes. The cell contains mostly the nucleus section and a small area of cytoplasm.

Wrapping-free numerical refocusing of scalar electromagnetic fields

Numerical refocusing in any plane is one powerful feature granted by measuring both the amplitude and the phase of a coherent light beam. Here, we introduce a method based on the first Rytov approximation of scalar electromagnetic fields that (i) allows numerical propagation without requiring phase unwrapping after propagation and (ii) limits the effect of artificial phase singularities that appear upon numerical defocusing when the measurement noise is mixing with the signal. We demonstrate the feasibility of this method with both scalar electromagnetic field simulations and real acquisitions of microscopic biological samples imaged at high numerical aperture.

Wavefront division digital holographic microscopy

Digital holographic microscopy is the state of the art quantitative phase imaging of micro-objects including living cells. It is an ideal tool to image and quantify cell thickness profiles with nanometer thickness resolution. Digital holographic techniques usually are implemented using a two-beam setup that may be bulky and may not be field portable. Self-referencing techniques provide compact geometry but suffer from a reduction of the field of view. Here, we discuss the development of a wavefront division digital holographic microscope providing the full field of view with a compact system. The proposed approach uses a wavefront division module consisting of two lenses. The developed microscope is tested experimentally by measuring the physical and mechanical properties of red blood cells.

Hilbert-Huang single-shot spatially multiplexed interferometric microscopy

Hilbert-Huang single-shot spatially multiplexed interferometric microscopy (H2S2MIM) is presented as the implementation of a robust, fast, and accurate single-shot phase estimation algorithm with an extremely simple, low-cost, and highly stable way to convert a bright field microscope into a holographic one using partially coherent illumination. Altogether, H2S2MIM adds high-speed (video frame rate) quantitative phase imaging capability to a commercially available nonholographic microscope with improved phase reconstruction (coherence noise reduction). The technique has been validated using a 20×/0.46  NA objective in a regular Olympus BX-60 upright microscope for static, as well as dynamic, samples showing perfect agreement with the results retrieved from a temporal phase-shifting algorithm.

Single-shot, dual-mode, water-immersion microscopy platform for biological applications

A single-shot water-immersion digital holographic microscope combined with broadband (white light) illumination mode is presented. This double imaging platform allows conventional incoherent visualization with phase holographic imaging of inspected samples. The holographic architecture is implemented at the image space (that is, after passing the microscope lens), thus reducing the sensitivity of the system to vibrations and/or thermal changes in comparison to regular interferometers. Because of the off-axis holographic recording principle, quantitative phase images of live biosamples can be recorded in a single camera snapshot at full-field geometry without any moving parts. And, the use of water-immersion imaging lenses maximizes the achievable resolution limit. This dual-mode microscope platform is first calibrated using microbeads, then applied to the characterization of fixed cells (neuroblastoma, breast cancer, and hippocampal neuronal cells) and, finally, validated for visualization of dynamic living cells (hippocampal neurons).

Wide field of view common-path lateral-shearing digital holographic interference microscope

Quantitative three-dimensional (3-D) imaging of living cells provides important information about the cell morphology and its time variation. Off-axis, digital holographic interference microscopy is an ideal tool for 3-D imaging, parameter extraction, and classification of living cells. Two-beam digital holographic microscopes, which are usually employed, provide high-quality 3-D images of micro-objects, albeit with lower temporal stability. Common-path digital holographic geometries, in which the reference beam is derived from the object beam, provide higher temporal stability along with high-quality 3-D images. Self-referencing geometry is the simplest of the common-path techniques, in which a portion of the object beam itself acts as the reference, leading to compact setups using fewer optical elements. However, it has reduced field of view, and the reference may contain object information. Here, we describe the development of a common-path digital holographic microscope, employing a shearing plate and converting one of the beams into a separate reference by employing a pin-hole. The setup is as compact as self-referencing geometry, while providing field of view as wide as that of a two-beam microscope. The microscope is tested by imaging and quantifying the morphology and dynamics of human erythrocytes.

Simultaneous dual-wavelength off-axis flipping digital holography

We develop a two-wavelength off-axis digital holography for quantitative phase imaging using flipping in a single interferogram shot. The interference is performed by flipping the relative position of a sample and reference beam, and the two-wavelength information is spatially multiplexed onto a monochromatic charge-coupled device camera simultaneously using polarization modulation. Due to the interferogram containing two-wavelength information with orthogonal interference fringes, the two-wavelength unwrapped information on the phase and thickness for the sample is extracted from a single shot. Our setup requires no pinholes, gratings, or dichroic mirrors with straightforward alignment. We demonstrate the operation of the setup with a step target and circular pillar.

Compact lensless off-axis transmission digital holographic microscope

Current compact lensless holographic microscopes are based on either multiple angle in-line holograms, multiple wavelength illumination or a combination thereof. Complex computational algorithms are necessary to retrieve the phase image which slows down the visualization of the image. Here we propose a simple compact lensless transmission holographic microscope with an off-axis configuration which simplifies considerably the computational processing to visualize the phase images and opens the possibility of real time phase imaging using off the shelf smart phone processors and less than $3 worth of optics and detectors, suitable for broad educational dissemination. This is achieved using a side illumination and analog hologram gratings to shape the reference and signal illumination beams from one light source. We demonstrate experimentally imaging of cells with a field of view (FOV) of ~12mm², and a resolution of ~3.9μm.

Lateral shearing common-path digital holographic microscopy based on a slightly trapezoid Sagnac interferometer

We propose a compact and easy-to-align lateral shearing common-path digital holographic microscopy, which is based on a slightly trapezoid Sagnac interferometer to create two laterally sheared beams and form off-axis geometry. In this interferometer, the two beams pass through a set of identical optical elements in opposite directions and have nearly the same optical path difference. Without any vibration isolation, the temporal stability of the setup is found to be around 0.011 rad. Compared with highly simple lateral shearing interferometer, the off-axis angle of the setup can be easily adjusted and quantitatively controlled, meanwhile the image quality is not degraded. The experiments for measuring the static and dynamic specimens are performed to demonstrate the capability and applicability.

Quantitative phase imaging for cell culture quality control

The potential of quantitative phase imaging (QPI) with digital holographic microscopy (DHM) for quantification of cell culture quality was explored. Label-free QPI of detached single cells in suspension was performed by Michelson interferometer-based self-interference DHM. Two pancreatic tumor cell lines were chosen as cellular model and analyzed for refractive index, volume, and dry mass under varying culture conditions. Firstly, adequate cell numbers for reliable statistics were identified. Then, to characterize the performance and reproducibility of the method, we compared results from independently repeated measurements and quantified the cellular response to osmolality changes of the cell culture medium. Finally, it was demonstrated that the evaluation of QPI images allows the extraction of absolute cell parameters which are related to cell layer confluence states. In summary, the results show that QPI enables label-free imaging cytometry, which provides novel complementary integral biophysical data sets for sophisticated quantification of cell culture quality with minimized sample preparation. © 2017 International Society for Advancement of Cytometry.

Superresolved spatially multiplexed interferometric microscopy

Superresolution capability by angular and time multiplexing is implemented onto a regular microscope. The technique, named superresolved spatially multiplexed interferometric microscopy (S2MIM), follows our previously reported SMIM technique [Opt. Express22, 14929 (2014)OPEXFF1094-408710.1364/OE.22.014929, J. Biomed. Opt.21, 106007 (2016)JBOPFO1083-366810.1117/1.JBO.21.10.106007] improved with superresolved imaging. All together, S2MIM updates a commercially available non-holographic microscope into a superresolved holographic one. Validation is presented for an Olympus BX-60 upright microscope with resolution test targets.

Reference-free holographic diversity interferometry via iterative measurements for high accuracy phase detection

To obtain a phase distribution without the use of an optical path besides an object beam, a reference-free holographic diversity interferometry (RF-HDI) has been proposed. Although the RF-HDI can generate an internal reference beam from the object beam, the method has a problem of measurement accuracy due to insufficient power of the internal reference beam. To solve the problem, we newly propose a RF-HDI via iterative measurements. Our method improves the measurement accuracy by utilizing iterative measurements and feedback of each obtained phase image to the measurement system. In the experiment, the phase image, which has a random pattern, can be measured as an object beam with a higher accuracy than in the conventional RF-HDI. To support this result, we also evaluated the wavefront accuracy and optical power efficiency of an internal reference beam in this method. As a result, we verified that our method enables us to generate an internal reference beam that has the wavefront of a near single plane wave and a higher power efficiency than the conventional RF-HDI. In addition, our method can be applied to measurement for the modal content in an optical fiber, atmosphere turbulence, etc., where it is difficult to prepare an external reference beam with a high coherency.

Spatially multiplexed interferometric microscopy with partially coherent illumination

We have recently reported on a simple, low cost, and highly stable way to convert a standard microscope into a holographic one [Opt. Express 22, 14929 (2014)]. The method, named spatially multiplexed interferometric microscopy (SMIM), proposes an off-axis holographic architecture implemented onto a regular (nonholographic) microscope with minimum modifications: the use of coherent illumination and a properly placed and selected one-dimensional diffraction grating. In this contribution, we report on the implementation of partially (temporally reduced) coherent illumination in SMIM as a way to improve quantitative phase imaging. The use of low coherence sources forces the application of phase shifting algorithm instead of off-axis holographic recording to recover the sample’s phase information but improves phase reconstruction due to coherence noise reduction. In addition, a less restrictive field of view limitation (1/2) is implemented in comparison with our previously reported scheme (1/3). The proposed modification is experimentally validated in a regular Olympus BX-60 upright microscope considering a wide range of samples (resolution test, microbeads, swine sperm cells, red blood cells, and prostate cancer cells).

Dual-wavelength common-path digital holographic microscopy for quantitative phase imaging based on lateral shearing interferometry

A dual-wavelength common-path digital holographic microscopy based on a single parallel glass plate is presented to achieve quantitative phase imaging, which combines the dual-wavelength technique with lateral shearing interferometry. Two illumination laser beams with different wavelengths (λ₁=532  nm and λ₂=632.8  nm) are reflected by the front and back surfaces of the parallel glass plate to create the lateral shear and form the digital hologram, and then the hologram is reconstructed to obtain the phase distribution with a synthetic wavelength Λ=3339.8  nm. The experimental configuration is very compact, with the advantages of vibration resistance and measurement range extension. The experimental results of the laser-ablated pit, groove, and staircase specimens show the feasibility of the proposed configuration.

Flipping interferometry and its application for quantitative phase microscopy in a micro-channel

We present a portable, off-axis interferometric module for quantitative phase microscopy of live cells, positioned at the exit port of a coherently illuminated inverted microscope. The module creates on the digital camera an interference pattern between the image of the sample and its flipped version. The proposed simplified module is based on a retro-reflector modification in an external Michelson interferometer. The module does not contain any lenses, pinholes, or gratings and its alignment is straightforward. Still, it allows full control of the off-axis angle and does not suffer from ghost images. As experimentally demonstrated, the module is useful for quantitative phase microscopy of live cells rapidly flowing in a micro-channel.

White-light quantitative phase imaging unit

We introduce the white-light quantitative phase imaging unit (WQPIU) as a practical realization of quantitative phase imaging (QPI) on standard microscope platforms. The WQPIU is a compact stand-alone unit which measures sample induced phase delay under white-light illumination. It does not require any modification of the microscope or additional accessories for its use. The principle of the WQPIU based on lateral shearing interferometry and phase shifting interferometry provides a cost-effective and user-friendly use of QPI. The validity and capacity of the presented method are demonstrated by measuring quantitative phase images of polystyrene beads, human red blood cells, HeLa cells and mouse white blood cells. With speckle-free imaging capability due to the use of white-light illumination, the WQPIU is expected to expand the scope of QPI in biological sciences as a powerful but simple imaging tool.

Combined optical micromanipulation and interferometric topography (COMMIT)

Optical tweezers have emerged as a prominent light-based tool for pico-Newton (pN) force microscopy in mechanobiological studies. However, the efficacy of optical tweezers are limited in applications where concurrent metrology of the nano-sized structures under interrogation is essential to the quantitative analysis of its mechanical properties and various mechanotransduction events. We have developed an all-optical platform delivering pN force resolution in parallel with nano-scale structural imaging of the biological sample by combining optical tweezers with interferometric quantitative phase microscopy. These capabilities allow real-time micromanipulation and label-free measurement of sample's nanostructures and nanomechanical responses, opening avenues to a wide range of new research possibilities and applications in biology.

Nanomechanics of a fibroblast suspended using point-like anchors reveal cytoskeleton formation

Cells are suspended and stretched using two microbeads. The formation of inner cytoskeleton structures is reported using displacement, QPM phase change and fluorescent micrographs.

Tile-Based Two-Dimensional Phase Unwrapping for Digital Holography Using a Modular Framework

A variety of physical and biomedical imaging techniques, such as digital holography, interferometric synthetic aperture radar (InSAR), or magnetic resonance imaging (MRI) enable measurement of the phase of a physical quantity additionally to its amplitude. However, the phase can commonly only be measured modulo 2π, as a so called wrapped phase map. Phase unwrapping is the process of obtaining the underlying physical phase map from the wrapped phase. Tile-based phase unwrapping algorithms operate by first tessellating the phase map, then unwrapping individual tiles, and finally merging them to a continuous phase map. They can be implemented computationally efficiently and are robust to noise. However, they are prone to failure in the presence of phase residues or erroneous unwraps of single tiles. We tried to overcome these shortcomings by creating novel tile unwrapping and merging algorithms as well as creating a framework that allows to combine them in modular fashion. To increase the robustness of the tile unwrapping step, we implemented a model-based algorithm that makes efficient use of linear algebra to unwrap individual tiles. Furthermore, we adapted an established pixel-based unwrapping algorithm to create a quality guided tile merger. These original algorithms as well as previously existing ones were implemented in a modular phase unwrapping C++ framework. By examining different combinations of unwrapping and merging algorithms we compared our method to existing approaches. We could show that the appropriate choice of unwrapping and merging algorithms can significantly improve the unwrapped result in the presence of phase residues and noise. Beyond that, our modular framework allows for efficient design and test of new tile-based phase unwrapping algorithms. The software developed in this study is freely available.

Characterization Method for 3D Substructure of Nuclear Cell Based on Orthogonal Phase Images

A set of optical models associated with blood cells are introduced in this paper. All of these models are made up of different parts possessing symmetries. The wrapped phase images as well as the unwrapped ones from two orthogonal directions related to some of these models are obtained by simulation technique. Because the phase mutation occurs on the boundary between nucleus and cytoplasm as well as on the boundary between cytoplasm and environment medium, the equation of inflexion curve is introduced to describe the size, morphology, and substructure of the nuclear cell based on the analysis of the phase features of the model. Furthermore, a mononuclear cell model is discussed as an example to verify this method. The simulation result shows that characterization with inflexion curve based on orthogonal phase images could describe the substructure of the cells availably, which may provide a new way to identify the typical biological cells quickly without scanning.

Detection and controlled depletion of cancer cells using photothermal phase microscopy

We present a dual-modality technique based on wide-field photothermal (PT) interferometric phase imaging and simultaneous PT ablation to selectively deplete specific cell populations labelled by plasmonic nanoparticles. This combined technique utilizes the plasmonic reaction of gold nanoparticles under optical excitation to produce PT imaging contrast by inducing local phase changes when the excitation power is weak, or ablation of selected cells when increasing the excitation power. Controlling the entire process is carried out by dynamic quantitative phase imaging of all cells (labelled and unlabelled). We demonstrate our ability to detect and specifically ablate in vitro cancer cells over-expressing epidermal growth factor receptors (EGFRs), labelled with plasmonic nanoparticles, in the presence of either EGFR under-expressing cancer cells or white blood cells. The latter demonstration establishes an initial model for depletion of circulating tumour cells in blood. The proposed system is able to image in wide field the label-free quantitative phase profile together with the PT phase profile of the sample, and provides the ability of both detection and selective cell ablation in a controlled environment. Quantitative phase imaging with molecular specificity and specific cell depletion. (a) Label-free quantitative phase profiles of mixed population of EGFR(+) /EGFR(-) cancer cells. (b) When weak modulated PT excitation is applied, selective phase contrast is generated in the modulation frequency only for the EGFR(+) cancer cells labelled with plasmonic nanoparticles. (c) When stronger modulated PT excitation is applied, selective ablation of the EGFR(+) cancer cells labelled with plasmonic nanoparticles occurs. White scalebars represent 10 µm upon sample.

Highly stable digital holographic microscope using Sagnac interferometer

Interferometric microscopy has grown into a very potent tool for quantitative phase imaging of biological samples. Among the interfermetric methods, microscopy by digital holography is one of the most effective techniques, especially for studying dynamics of cells. Imaging of cell fluctuations requires digital holographic setups with high temporal stability. Common path setups in which the object and the reference beams encounter the same set of optical elements provide better temporal stability compared to two-beam setups. Here, we present a compact, easy-to-implement, common path digital holographic microscope based on Sagnac interferometer geometry. The microscope is implemented using a diode laser module employing a CCD array or a webcam sensor to record holograms. The system was tested for three-dimensional imaging capability, numerical focusing ability, and temporal stability. Sub-nanometer temporal stability without external vibration isolation components was obtained in both cases. The higher temporal stability makes the microscope compatible to image cell fluctuations, which is demonstrated by imaging the oscillation of the cell membrane of human red blood cells.