Spatially-multiplexed interferometric microscopy (SMIM): converting a standard microscope into a holographic one

Off-axis digital lensless holographic microscopy based on spatially multiplexed interferometry

Significance

Digital holographic microscopy (DHM) is a label-free microscopy technique that provides time-resolved quantitative phase imaging (QPI) by measuring the optical path delay of light induced by transparent biological samples. DHM has been utilized for various biomedical applications, such as cancer research and sperm cell assessment, as well as for in vitro drug or toxicity testing. Its lensless version, digital lensless holographic microscopy (DLHM), is an emerging technology that offers size-reduced, lightweight, and cost-effective imaging systems. These features make DLHM applicable, for example, in limited resource laboratories, remote areas, and point-of-care applications.

Aim

In addition to the abovementioned advantages, in-line arrangements for DLHM also include the limitation of the twin-image presence, which can restrict accurate QPI. We therefore propose a compact lensless common-path interferometric off-axis approach that is capable of quantitative imaging of fast-moving biological specimens, such as living cells in flow.

Approach

We suggest lensless spatially multiplexed interferometric microscopy (LESSMIM) as a lens-free variant of the previously reported spatially multiplexed interferometric microscopy (SMIM) concept. LESSMIM comprises a common-path interferometric architecture that is based on a single diffraction grating to achieve digital off-axis holography. From a series of single-shot off-axis holograms, twin-image free and time-resolved QPI is achieved by commonly used methods for Fourier filtering-based reconstruction, aberration compensation, and numerical propagation.

Results

Initially, the LESSMIM concept is experimentally demonstrated by results from a resolution test chart and investigations on temporal stability. Then, the accuracy of QPI and capabilities for imaging of living adherent cell cultures is characterized. Finally, utilizing a microfluidic channel, the cytometry of suspended cells in flow is evaluated.

Conclusions

LESSMIM overcomes several limitations of in-line DLHM and provides fast time-resolved QPI in a compact optical arrangement. In summary, LESSMIM represents a promising technique with potential biomedical applications for fast imaging such as in imaging flow cytometry or sperm cell analysis.

Multiplexed digital holography for fluid surface profilometry

Digital holography (DH) has been widely used for imaging and characterization of microstructures and nanostructures in materials science and biology and also has the potential to provide high-resolution, nondestructive measurement of fluid surfaces. DH setups capture the complex wavefronts of light scattered by an object or reflected from a surface, allowing the quantitative measurements of their shape and deformation. However, their use in fluid profilometry is scarce and has not been explored in much depth to the best of our knowledge. We present an alternative use for a DH setup that can measure and monitor the surface of fluid samples. Based on DH reflectometry, our modeling shows that multiple reflections from the sample and the reference interfere and generate multiple holograms of the sample, resulting in a multiplexed image of the wavefront. The individual interferograms can be isolated in the spatial frequency domain, and the fluid surface can be digitally reconstructed from them. We further show that this setup can be used to track changes in the surface of a fluid over time, such as during the formation and propagation of waves or the evaporation of surface layers.

Single capture bright field and off-axis digital holographic microscopy

We report on a single capture approach for simultaneous incoherent bright field (BF) and laser-based quantitative phase imaging (QPI). Common-path digital holographic microscopy (DHM) is implemented in parallel with BF imaging within the optical path of a commercial optical microscope to achieve spatially multiplexed recording of white light images and digital off-axis holograms, which are subsequently numerically demultiplexed. The performance of the proposed multimodal concept is firstly determined by investigations on microspheres. Then, the application for label-free dual-mode QPI and BF imaging of living pancreatic tumor cells is demonstrated.

Low-intensity illumination for lensless digital holographic microscopy with minimized sample interaction

Exposure to laser light alters cell culture examination via optical microscopic imaging techniques based on label-free coherent digital holography. To mitigate this detrimental feature, researchers tend to use a broader spectrum and lower intensity of illumination, which can decrease the quality of holographic imaging due to lower resolution and higher noise. We study the lensless digital holographic microscopy (LDHM) ability to operate in the low photon budget (LPB) regime to enable imaging of unimpaired live cells with minimized sample interaction. Low-cost off-the-shelf components are used, promoting the usability of such a straightforward approach. We show that recording data in the LPB regime (down to 7 µW of illumination power) does not limit the contrast or resolution of the hologram phase and amplitude reconstruction compared to regular illumination. The LPB generates hardware camera shot noise, however, to be effectively minimized via numerical denoising. The ability to obtain high-quality, high-resolution optical complex field reconstruction was confirmed using the USAF 1951 amplitude sample, phase resolution test target, and finally, live glial restricted progenitor cells (as a challenging strongly absorbing and scattering biomedical sample). The proposed approach based on severely limiting the photon budget in lensless holographic microscopy method can open new avenues in high-throughout (optimal resolution, large field-of-view, and high signal-to-noise-ratio single-hologram reconstruction) cell culture imaging with minimized sample interaction.

Common-path intrinsically achromatic optical diffraction tomography

In this work we propose an open-top like common-path intrinsically achromatic optical diffraction tomography system. It operates as a total-shear interferometer and employs Ronchi-type amplitude diffraction grating, positioned in between the camera and the tube lens without an additional 4f system, generating three-beam interferograms with achromatic second harmonic. Such configuration makes the proposed system low cost, compact and immune to vibrations. We present the results of the measurements of 3D-printed cell phantom using laser diode (coherent) and superluminescent diode (partially coherent) light sources. Broadband light sources can be naturally employed without the need for any cumbersome compensation because of the intrinsic achromaticity of the interferometric recording (holograms generated by -1st and +1st conjugated diffraction orders are not affected by the illumination wavelength). The results show that the decreased coherence offers much reduced coherent noise and higher fidelity tomographic reconstruction especially when applied nonnegativity constraint regularization procedure.

Variational Hilbert Quantitative Phase Imaging

Utilizing the refractive index as the endogenous contrast agent to noninvasively study transparent cells is a working principle of emerging quantitative phase imaging (QPI). In this contribution, we propose the Variational Hilbert Quantitative Phase Imaging (VHQPI)-end-to-end purely computational add-on module able to improve performance of a QPI-unit without hardware modifications. The VHQPI, deploying unique merger of tailored variational image decomposition and enhanced Hilbert spiral transform, adaptively provides high quality map of sample-induced phase delay, accepting particularly wide range of input single-shot interferograms (from off-axis to quasi on-axis configurations). It especially promotes high space-bandwidth-product QPI configurations alleviating the spectral overlapping problem. The VHQPI is tailored to deal with cumbersome interference patterns related to detailed locally varying biological objects with possibly high dynamic range of phase and relatively low carrier. In post-processing, the slowly varying phase-term associated with the instrumental optical aberrations is eliminated upon variational analysis to further boost the phase-imaging capabilities. The VHQPI is thoroughly studied employing numerical simulations and successfully validated using static and dynamic cells phase-analysis. It compares favorably with other single-shot phase reconstruction techniques based on the Fourier and Hilbert-Huang transforms, both in terms of visual inspection and quantitative evaluation, potentially opening up new possibilities in QPI.

Deep learning-based cell identification and disease diagnosis using spatio-temporal cellular dynamics in compact digital holographic microscopy

We demonstrate a successful deep learning strategy for cell identification and disease diagnosis using spatio-temporal cell information recorded by a digital holographic microscopy system. Shearing digital holographic microscopy is employed using a low-cost, compact, field-portable and 3D-printed microscopy system to record video-rate data of live biological cells with nanometer sensitivity in terms of axial membrane fluctuations, then features are extracted from the reconstructed phase profiles of segmented cells at each time instance for classification. The time-varying data of each extracted feature is input into a recurrent bi-directional long short-term memory (Bi-LSTM) network which learns to classify cells based on their time-varying behavior. Our approach is presented for cell identification between the morphologically similar cases of cow and horse red blood cells. Furthermore, the proposed deep learning strategy is demonstrated as having improved performance over conventional machine learning approaches on a clinically relevant dataset of human red blood cells from healthy individuals and those with sickle cell disease. The results are presented at both the cell and patient levels. To the best of our knowledge, this is the first report of deep learning for spatio-temporal-based cell identification and disease detection using a digital holographic microscopy system.

Polarization holographic microscope slide for birefringence imaging of anisotropic samples in microfluidics

Birefringence is an important optical property of anisotropic materials arising from anisotropies of tissue microstructures. Birefringence parameters have been found to be important to understand optical anisotropic architecture of many materials and polarization imaging has been applied in many researches in the field of biology and medicine. Here, we propose a scheme to miniaturize a double-channel polarization holographic interferometer optics to create a polarization holographic microscope slide (P-HMS) suitable for integrating with microfluidic lab-on-a-chip (LoC) systems. Based on the P-HMS combined with a simple reconstruction algorithm described in the paper, we can not only simultaneously realize holographic imaging of two orthogonal polarization components of dynamic samples in a microfluidic channel but also quantitative measurement of 2D birefringence information, both including the birefringence phase retardation and optic-axis orientation. This chip interferometer allows for off-axis double-channel polarization digital holographic recording using only a single illumination beam without need of any beam splitter or mirror. Its quasi-common path configuration and self-aligned design also make it tolerant to vibrations and misalignment. This work about the P-HMS could play a positive role in promoting the application of birefringence imaging in microfluidic LoC technology.

Grating deployed total-shear 3-beam interference microscopy with reduced temporal coherence

Interference microscopy is a powerful optical imaging technique providing quantitative phase distribution information to characterize various type technical and biomedical objects. Static and dynamic objects and processes can be investigated. In this paper we propose very compact, common-path and partially coherent diffraction grating-based interference microscopy system for studying small objects like single cells with low densities being sparsely distributed in the field of view. Simple binary amplitude diffraction grating is the only additional element to be introduced into a conventional microscope optical system. By placing it at a proper distance in front of the microscope image plane the total-shear operation mode is deployed resulting in interferograms of the object-reference beam type. Depending on the grating to image plane separation distance two or three-beam interferograms are generated. The latter ones are advantageous since they contain achromatic second harmonics in the interferogram intensity distributions. This feature enables to use reduced temporal coherence light sources for the microscope to reduce coherent noise and parasitic interference patterns. For this purpose we employ the laser diode with driving current below the threshold one. Results of conducted experiments including automatic computer processing of interferograms fully corroborate analytical description of the proposed method and illustrate its capabilities for studying static and dynamic phase objects.

Single-shot two-frame π-shifted spatially multiplexed interference phase microscopy

Single-shot, two-frame, π-shifted spatially multiplexed interference microscopy (π-SMIM) is presented as an improvement to previous SMIM implementations, introducing a versatile, robust, fast, and accurate method for cumbersome, noisy, and low-contrast phase object analysis. The proposed π-SMIM equips a commercially available nonholographic microscope with a high-speed (video frame rate) enhanced quantitative phase imaging (QPI) capability by properly placing a beam-splitter in the microscope embodiment to simultaneously (in a single shot) record two holograms mutually phase shifted by π radians at the expense of reducing the field of view. Upon subsequent subtractive superimposition of holograms, a π-hologram is generated with reduced background and improved modulation of interference fringes. These features determine superior phase retrieval quality, obtained by employing the Hilbert spiral transform on the π-hologram, as compared with a single low-quality (low signal-to-noise ratio) hologram analysis. In addition, π-SMIM enables accurate in-vivo analysis of high dynamic range phase objects, otherwise measurable only in static regime using time-consuming phase-shifting. The technique has been validated utilizing a 20  ×    /  0.46 NA objective in a regular Olympus BX-60 upright microscope for QPI of different lines of prostate cancer cells and flowing microbeads.

Single-shot slightly off-axis digital holographic microscopy with add-on module based on beamsplitter cube

Slightly off-axis digital holographic microscopy (SO-DHM) has recently emerged as a novel experimental arrangement for quantitative phase imaging (QPI). It offers improved capabilities in conventional on-axis and off-axis interferometric configurations. In this contribution, we report on a single-shot SO-DHM approach based on an add-on module adapted to the exit port of a regular microscope. The module employs a beamsplitter (BS) cube interferometer and includes, in addition, a Stokes lens (SL) for astigmatism compensation. Each recorded frame contains two fields of view (FOVs) of the sample, where each FOV is a hologram which is phase shifted by π rads with respect to the other. These two simultaneously recorded holograms are numerically processed, in order to retrieve complex amplitude distribution with enhanced quality. The tradeoff is done in the FOV which becomes penalized as a consequence of the simultaneous recording of the two holograms in a single snapshot. Experimental validation is presented for a wide variety of samples using a regular Olympus BX-60 upright microscope. The proposed approach provides an optimized use of the imaging system, in terms of the space-bandwidth product, in comparison with off-axis configuration; allows the analysis of fast-dynamic events, owing to its single-shot capability when compared with on-axis arrangement; and becomes easily implementable in conventional white-light microscopes for upgrading them into holographic microscopes for QPI.

Hilbert-Huang single-shot spatially multiplexed interferometric microscopy

Hilbert-Huang single-shot spatially multiplexed interferometric microscopy (H2S2MIM) is presented as the implementation of a robust, fast, and accurate single-shot phase estimation algorithm with an extremely simple, low-cost, and highly stable way to convert a bright field microscope into a holographic one using partially coherent illumination. Altogether, H2S2MIM adds high-speed (video frame rate) quantitative phase imaging capability to a commercially available nonholographic microscope with improved phase reconstruction (coherence noise reduction). The technique has been validated using a 20×/0.46  NA objective in a regular Olympus BX-60 upright microscope for static, as well as dynamic, samples showing perfect agreement with the results retrieved from a temporal phase-shifting algorithm.

Single-shot, dual-mode, water-immersion microscopy platform for biological applications

A single-shot water-immersion digital holographic microscope combined with broadband (white light) illumination mode is presented. This double imaging platform allows conventional incoherent visualization with phase holographic imaging of inspected samples. The holographic architecture is implemented at the image space (that is, after passing the microscope lens), thus reducing the sensitivity of the system to vibrations and/or thermal changes in comparison to regular interferometers. Because of the off-axis holographic recording principle, quantitative phase images of live biosamples can be recorded in a single camera snapshot at full-field geometry without any moving parts. And, the use of water-immersion imaging lenses maximizes the achievable resolution limit. This dual-mode microscope platform is first calibrated using microbeads, then applied to the characterization of fixed cells (neuroblastoma, breast cancer, and hippocampal neuronal cells) and, finally, validated for visualization of dynamic living cells (hippocampal neurons).

Wide field of view common-path lateral-shearing digital holographic interference microscope

Quantitative three-dimensional (3-D) imaging of living cells provides important information about the cell morphology and its time variation. Off-axis, digital holographic interference microscopy is an ideal tool for 3-D imaging, parameter extraction, and classification of living cells. Two-beam digital holographic microscopes, which are usually employed, provide high-quality 3-D images of micro-objects, albeit with lower temporal stability. Common-path digital holographic geometries, in which the reference beam is derived from the object beam, provide higher temporal stability along with high-quality 3-D images. Self-referencing geometry is the simplest of the common-path techniques, in which a portion of the object beam itself acts as the reference, leading to compact setups using fewer optical elements. However, it has reduced field of view, and the reference may contain object information. Here, we describe the development of a common-path digital holographic microscope, employing a shearing plate and converting one of the beams into a separate reference by employing a pin-hole. The setup is as compact as self-referencing geometry, while providing field of view as wide as that of a two-beam microscope. The microscope is tested by imaging and quantifying the morphology and dynamics of human erythrocytes.

Double-channel angular-multiplexing polarization holography with common-path and off-axis configuration

We propose a double-channel angular-multiplexing polarization holographic imaging system with common-path and off-axis configurations. In the system, its input plane is spatially divided into three windows: an object window and two reference windows, and two orthogonal linear polarizers are attached, respectively, on the two reference windows; a two-dimensional cross grating is inserted between the input and output planes of the system. Thus the object beam passing through the object window and the two orthogonal polarized reference beams passing through the two reference windows can overlap each other at the output plane of the system and form a double-channel angular-multiplexing polarization hologram (DC-AM-PH). Using this system, the complex amplitude distributions of two orthogonal polarized components from an object can be recorded and reconstructed by one single-shot DC-AM-PH at the same time. Theoretical analysis and experimental results demonstrated that the system can be used to measure the Jones matrix parameters of polarization-sensitive or birefringent materials.

Digital micromirror device-based common-path quantitative phase imaging

We propose a novel common-path quantitative phase imaging (QPI) method based on a digital micromirror device (DMD). The DMD is placed in a plane conjugate to the objective back-aperture plane for the purpose of generating two plane waves that illuminate the sample. A pinhole is used in the detection arm to filter one of the beams after sample to create a reference beam. Additionally, a transmission-type liquid crystal device, placed at the objective back-aperture plane, eliminates the specular reflection noise arising from all the "off" state DMD micromirrors, which is common in all DMD-based illuminations. We have demonstrated high sensitivity QPI, which has a measured spatial and temporal noise of 4.92 nm and 2.16 nm, respectively. Experiments with calibrated polystyrene beads illustrate the desired phase measurement accuracy. In addition, we have measured the dynamic height maps of red blood cell membrane fluctuations, showing the efficacy of the proposed system for live cell imaging. Most importantly, the DMD grants the system convenience in varying the interference fringe period on the camera to easily satisfy the pixel sampling conditions. This feature also alleviates the pinhole alignment complexity. We envision that the proposed DMD-based common-path QPI system will allow for system miniaturization and automation for a broader adaption.

Superresolved spatially multiplexed interferometric microscopy

Superresolution capability by angular and time multiplexing is implemented onto a regular microscope. The technique, named superresolved spatially multiplexed interferometric microscopy (S2MIM), follows our previously reported SMIM technique [Opt. Express22, 14929 (2014)OPEXFF1094-408710.1364/OE.22.014929, J. Biomed. Opt.21, 106007 (2016)JBOPFO1083-366810.1117/1.JBO.21.10.106007] improved with superresolved imaging. All together, S2MIM updates a commercially available non-holographic microscope into a superresolved holographic one. Validation is presented for an Olympus BX-60 upright microscope with resolution test targets.

Spatially multiplexed interferometric microscopy with partially coherent illumination

We have recently reported on a simple, low cost, and highly stable way to convert a standard microscope into a holographic one [Opt. Express 22, 14929 (2014)]. The method, named spatially multiplexed interferometric microscopy (SMIM), proposes an off-axis holographic architecture implemented onto a regular (nonholographic) microscope with minimum modifications: the use of coherent illumination and a properly placed and selected one-dimensional diffraction grating. In this contribution, we report on the implementation of partially (temporally reduced) coherent illumination in SMIM as a way to improve quantitative phase imaging. The use of low coherence sources forces the application of phase shifting algorithm instead of off-axis holographic recording to recover the sample’s phase information but improves phase reconstruction due to coherence noise reduction. In addition, a less restrictive field of view limitation (1/2) is implemented in comparison with our previously reported scheme (1/3). The proposed modification is experimentally validated in a regular Olympus BX-60 upright microscope considering a wide range of samples (resolution test, microbeads, swine sperm cells, red blood cells, and prostate cancer cells).

Flipping interferometry and its application for quantitative phase microscopy in a micro-channel

We present a portable, off-axis interferometric module for quantitative phase microscopy of live cells, positioned at the exit port of a coherently illuminated inverted microscope. The module creates on the digital camera an interference pattern between the image of the sample and its flipped version. The proposed simplified module is based on a retro-reflector modification in an external Michelson interferometer. The module does not contain any lenses, pinholes, or gratings and its alignment is straightforward. Still, it allows full control of the off-axis angle and does not suffer from ghost images. As experimentally demonstrated, the module is useful for quantitative phase microscopy of live cells rapidly flowing in a micro-channel.

Improved Tracking and Resolution of Bacteria in Holographic Microscopy Using Dye and Fluorescent Protein Labeling

Digital holographic microscopy (DHM) is an emerging imaging technique that permits instantaneous capture of a relatively large sample volume. However, large volumes usually come at the expense of lower spatial resolution, and the technique has rarely been used with prokaryotic cells due to their small size and low contrast. In this paper we demonstrate the use of a Mach-Zehnder dual-beam instrument for imaging of labeled and unlabeled bacteria and microalgae. Spatial resolution of 0.3 μm is achieved, providing a sampling of several pixels across a typical prokaryotic cell. Both cellular motility and morphology are readily recorded. The use of dyes provides both amplitude and phase contrast improvement and is of use to identify cells in dense samples.

Holographic imaging of unlabelled sperm cells for semen analysis: a review

Male reproductive health in both humans and animals is an important research field in biological study. In order to characterize the morphology, the motility and the concentration of the sperm cells, which are the most important parameters to feature them, digital holography demonstrated to be an attractive technique. Indeed, it is a label-free, non-invasive and high-resolution method that enables the characterization of live specimen. The review is intended both for summarizing the state-of-art on the semen analysis and recent achievement obtained by means of digital holography and for exploring new possible applications of digital holography in this field. Quantitative phase maps of living swimming spermatozoa.