Active illumination using a digital micromirror device for quantitative phase imaging

Calibration-free quantitative phase imaging using data-driven aberration modeling

We present a data-driven approach to compensate for optical aberrations in calibration-free quantitative phase imaging (QPI). Unlike existing methods that require additional measurements or a background region to correct aberrations, we exploit deep learning techniques to model the physics of aberration in an imaging system. We demonstrate the generation of a single-shot aberration-corrected field image by using a U-net-based deep neural network that learns a translation between an optical field with aberrations and an aberration-corrected field. The high fidelity and stability of our method is demonstrated on 2D and 3D QPI measurements of various confluent eukaryotic cells and microbeads, benchmarking against the conventional method using background subtractions.

High spatial and temporal resolution synthetic aperture phase microscopy

A new optical microscopy technique, termed high spatial and temporal resolution synthetic aperture phase microscopy (HISTR-SAPM), is proposed to improve the lateral resolution of wide-field coherent imaging. Under plane wave illumination, the resolution is increased by twofold to around 260 nm, while achieving millisecond-level temporal resolution. In HISTR-SAPM, digital micromirror devices are used to actively change the sample illumination beam angle at high speed with high stability. An off-axis interferometer is used to measure the sample scattered complex fields, which are then processed to reconstruct high-resolution phase images. Using HISTR-SAPM, we are able to map the height profiles of subwavelength photonic structures and resolve the period structures that have 198 nm linewidth and 132 nm gap (i.e., a full pitch of 330 nm). As the reconstruction averages out laser speckle noise while maintaining high temporal resolution, HISTR-SAPM further enables imaging and quantification of nanoscale dynamics of live cells, such as red blood cell membrane fluctuations and subcellular structure dynamics within nucleated cells. We envision that HISTR-SAPM will broadly benefit research in material science and biology.

Quantitative Optical Diffraction Tomography Imaging of Mouse Platelets

Platelets are specialized anucleate cells that play a major role in hemostasis following vessel injury. More recently, platelets have also been implicated in innate immunity and inflammation by directly interacting with immune cells and releasing proinflammatory signals. It is likely therefore that in certain pathologies, such as chronic parasitic infections and myeloid malignancies, platelets can act as mediators for hemostatic and proinflammatory responses. Fortunately, murine platelet function ex vivo is highly analogous to human, providing a robust model for functional comparison. However, traditional methods of studying platelet phenotype, function and activation status often rely on using large numbers of whole isolated platelet populations, which severely limits the number and type of assays that can be performed with mouse blood. Here, using cutting edge 3D quantitative phase imaging, holotomography, that uses optical diffraction tomography (ODT), we were able to identify and quantify differences in single unlabeled, live platelets with minimal experimental interference. We analyzed platelets directly isolated from whole blood of mice with either a JAK2V617F-positive myeloproliferative neoplasm (MPN) or Leishmania donovani infection. Image analysis of the platelets indicates previously uncharacterized differences in platelet morphology, including altered cell volume and sphericity, as well as changes in biophysical parameters such as refractive index (RI) and dry mass. Together, these data indicate that, by using holotomography, we were able to identify clear disparities in activation status and potential functional ability in disease states compared to control at the level of single platelets.

Quantitative phase imaging based on wavefront correction of a digital micromirror device

The strong need in materials and biological science has prompted the development of high-speed quantitative phase imaging. However, for phase retrieval applying digital micromirror devices (DMDs), the accuracy of the retrieved phase will be disturbed by the DMD-induced aberrations. Here, we propose a phase retrieval method based on measuring and correcting errors caused by phase non-uniformity of the device. Using only four binary amplitude masks and corresponding diffraction intensities, the proposed method achieves rapid convergence and high-quality reconstruction. The experiments prove the practical feasibility for general samples and the effective improvement of the retrieved phase accuracy.

3D morphological and biophysical changes in a single tachyzoite and its infected cells using three-dimensional quantitative phase imaging

Toxoplasma gondii is an apicomplexan parasite that causes toxoplasmosis in the human body and commonly infects warm-blooded organisms. Pathophysiology of its diseases is still an interesting issue to be studied since T gondii can infect nearly all nucleated cells. Imaging techniques are crucial for studying its pathophysiology. In T gondii-infected cells structural and biochemical alterations occurred. To study that modification, we use digital holotomography to investigate the structure and biochemical alteration of single tachyzoite and its infected cells in a label-free and quantitative manner. Quantification analysis was done by measuring the refractive index distribution, which provides information about the concentration and dry mass of individual cells. This study showed that holotomography could be effectively used to identify the structural and biochemical alteration in tremendously different cells in supporting pathophysiological research in particular for T gondii-caused diseases.

Intercellular Bioimaging and Biodistribution of Gold Nanoparticle-Loaded Macrophages for Targeted Drug Delivery

In order to effectively apply nanoparticles to clinical use, macrophages have been used as vehicles to deliver genes, drugs or nanomaterials into tumors. In this study, the effectiveness of macrophage as a drug delivery system was validated by biodistribution imaging modalities at intercellular and ex vivo levels. We focused on biodistribution imaging, namely, the characterization of the gold nanoparticle-loaded macrophages using intracellular holotomography and target delivery efficiency analysis using ex vivo fluorescence imaging techniques. In more detail, gold nanoparticles (AuNPs) were prepared with trisodium citrate method and loaded into macrophage cells (RAW 264.7). First, AuNPs loading into macrophages was confirmed using the conventional ultraviolet-visible (UV-VIS) spectroscopy and inductively coupled plasma-mass spectrometry (ICP-MS). Then, the holotomographic imaging was employed to characterize the intracellular biodistribution of the AuNPs-loaded macrophages. The efficacy of target delivery of the well AuNPs uptake macrophages was studied in a mouse model, established via lipopolysaccharide (LPS)-induced inflammation. The fluorescent images and the ex vivo ICP-MS evaluated the delivery efficiency of the AuNPs-loaded macrophages. Results revealed that the holotomographic imaging techniques can be promising modalities to understand intracellular biodistribution and ex vivo fluorescence imaging can be useful to validate the target delivery efficacy of the AuNPs-loaded macrophages.

Enhanced succinic acid production by Mannheimia employing optimal malate dehydrogenase

Succinic acid (SA), a dicarboxylic acid of industrial importance, can be efficiently produced by metabolically engineered Mannheimia succiniciproducens. Malate dehydrogenase (MDH) is one of the key enzymes for SA production, but has not been well characterized. Here we report biochemical and structural analyses of various MDHs and development of hyper-SA producing M. succiniciproducens by introducing the best MDH. Corynebacterium glutamicum MDH (CgMDH) shows the highest specific activity and least substrate inhibition, whereas M. succiniciproducens MDH (MsMDH) shows low specific activity at physiological pH and strong uncompetitive inhibition toward oxaloacetate (ki of 67.4 and 588.9 μM for MsMDH and CgMDH, respectively). Structural comparison of the two MDHs reveals a key residue influencing the specific activity and susceptibility to substrate inhibition. A high-inoculum fed-batch fermentation of the final strain expressing cgmdh produces 134.25 g L-1 of SA with the maximum productivity of 21.3 g L-1 h-1, demonstrating the importance of enzyme optimization in strain development.

Three-dimensional label-free observation of individual bacteria upon antibiotic treatment using optical diffraction tomography

Measuring alterations in bacteria upon antibiotic application is important for basic studies in microbiology, drug discovery, clinical diagnosis, and disease treatment. However, imaging and 3D time-lapse response analysis of individual bacteria upon antibiotic application remain largely unexplored mainly due to limitations in imaging techniques. Here, we present a method to systematically investigate the alterations in individual bacteria in 3D and quantitatively analyze the effects of antibiotics. Using optical diffraction tomography, in-situ responses of Escherichia coli and Bacillus subtilis to various concentrations of ampicillin were investigated in a label-free and quantitative manner. The presented method reconstructs the dynamic changes in the 3D refractive-index distributions of living bacteria in response to antibiotics at sub-micrometer spatial resolution.

Label-Free Tomographic Imaging of Lipid Droplets in Foam Cells for Machine-Learning-Assisted Therapeutic Evaluation of Targeted Nanodrugs

Lipid droplet (LD) accumulation, a key feature of foam cells, constitutes an attractive target for therapeutic intervention in atherosclerosis. However, despite advances in cellular imaging techniques, current noninvasive and quantitative methods have limited application in living foam cells. Here, using optical diffraction tomography (ODT), we performed quantitative morphological and biophysical analysis of living foam cells in a label-free manner. We identified LDs in foam cells by verifying the specific refractive index using correlative imaging comprising ODT integrated with three-dimensional fluorescence imaging. Through time-lapse monitoring of three-dimensional dynamics of label-free living foam cells, we precisely and quantitatively evaluated the therapeutic effects of a nanodrug (mannose-polyethylene glycol-glycol chitosan-fluorescein isothiocyanate-lobeglitazone; MMR-Lobe) designed to affect the targeted delivery of lobeglitazone to foam cells based on high mannose receptor specificity. Furthermore, by exploiting machine-learning-based image analysis, we further demonstrated therapeutic evaluation at the single-cell level. These findings suggest that refractive index measurement is a promising tool to explore new drugs against LD-related metabolic diseases.

Real-time cholesterol sorting in Plasmodium falciparum-erythrocytes as revealed by 3D label-free imaging

Cholesterol, a necessary component of animal cell membranes, is also needed by the lethal human malaria parasite Plasmodium falciparum. Because P. falciparum lacks a cholesterol synthesis pathway and malaria patients have low blood cholesterol, we speculated that it scavenges cholesterol from them in some way. We used time-lapse holotomographic microscopy to observe cholesterol transport in live P. falciparum parasites and structurally investigate erythrocyte membranes, both during and after P. falciparum invasion of human erythrocytes. After P. falciparum initially acquired free cholesterol or inner erythrocytic membrane-derived cholesterol, we observed budding lipid membranes elongating into the cytosol and/or membrane segments migrating there and eventually fusing with the parasite membranes, presumably at the parasitophorous vacuole membrane (PVM). Finally, the cholesterol-containing segments were seen to surround the parasite nucleus. Our imaging data suggest that a novel membrane transport system operates in the cytosol of P. falciparum-infected erythrocytes as a cholesterol import system, likely between the PVM and the erythrocyte membrane, and that this transportation process occurs during the live erythrocyte stages of P. falciparum.

Intensity modulation based optical proximity optimization for the maskless lithography

The undesirable optical proximity effect (OPE) that appeared in the digital micro-mirrors device (DMD) based maskless lithography directly influences the final exposure pattern and decreases the lithography quality. In this manuscript, a convenient method of intensity modulation applied for the maskless lithography is proposed to optimize such an effect. According to the pulse width modulation based image recognition of DMD, we replaced the digital binary mask with a special digital grayscale mask to modulate the UV intensity distribution to be closer to the expectation in a way of point-by-point modification. The exposure result applying the grayscale mask has a better consistency with the design pattern than that for the case in which the original binary mask is used. The effectiveness of this method was analyzed by the image subtraction technique. Experimental data revealed that the matching rate between the exposure pattern and the mask pattern has been improved from 78% to 91%. Besides, more experiments have been conducted to verify the validity of this method for the optical proximity optimization and its potential in the high-fidelity DMD based maskless lithography.

Versatile transmission/reflection tomographic diffractive microscopy approach

Tomographic diffractive microscopy (TDM) has gained interest in recent years due to its ability to deliver high-resolution, three-dimensional images of unlabeled samples. It has been applied to transparent samples in transmission mode, as well as to surface studies in reflection mode. Mudry et al. [Opt. Lett.35, 1857 (2010)OPLEDP0146-959210.1364/OL.35.001857] introduced the concept of mirror-assisted TDM (MA-TDM), an elegant approach for achieving quasi-isotropic-resolution microscopic imaging, but which is still to be experimentally applied. In this work, we show that a simplified version of MA-TDM allows for transforming a reflective TDM setup into a more versatile instrument, also capable of observing transparent samples in transmission mode if using specific sample holders made out of a mirror and coated with a low-thickness transparent spacer.

Deep learning-based optical field screening for robust optical diffraction tomography

In tomographic reconstruction, the image quality of the reconstructed images can be significantly degraded by defects in the measured two-dimensional (2D) raw image data. Despite the importance of screening defective 2D images for robust tomographic reconstruction, manual inspection and rule-based automation suffer from low-throughput and insufficient accuracy, respectively. Here, we present deep learning-enabled quality control for holographic data to produce robust and high-throughput optical diffraction tomography (ODT). The key idea is to distil the knowledge of an expert into a deep convolutional neural network. We built an extensive database of optical field images with clean/noisy annotations, and then trained a binary-classification network based upon the data. The trained network outperformed visual inspection by non-expert users and a widely used rule-based algorithm, with >90% test accuracy. Subsequently, we confirmed that the superior screening performance significantly improved the tomogram quality. To further confirm the trained model's performance and generalisability, we evaluated it on unseen biological cell data obtained with a setup that was not used to generate the training dataset. Lastly, we interpreted the trained model using various visualisation techniques that provided the saliency map underlying each model inference. We envision the proposed network would a powerful lightweight module in the tomographic reconstruction pipeline.

Epi-illumination gradient light interference microscopy for imaging opaque structures

Multiple scattering and absorption limit the depth at which biological tissues can be imaged with light. In thick unlabeled specimens, multiple scattering randomizes the phase of the field and absorption attenuates light that travels long optical paths. These obstacles limit the performance of transmission imaging. To mitigate these challenges, we developed an epi-illumination gradient light interference microscope (epi-GLIM) as a label-free phase imaging modality applicable to bulk or opaque samples. Epi-GLIM enables studying turbid structures that are hundreds of microns thick and otherwise opaque to transmitted light. We demonstrate this approach with a variety of man-made and biological samples that are incompatible with imaging in a transmission geometry: semiconductors wafers, specimens on opaque and birefringent substrates, cells in microplates, and bulk tissues. We demonstrate that the epi-GLIM data can be used to solve the inverse scattering problem and reconstruct the tomography of single cells and model organisms.

Low-coherent optical diffraction tomography by angle-scanning illumination

Temporally low-coherent optical diffraction tomography (ODT) is proposed and demonstrated based on angle-scanning Mach-Zehnder interferometry. Using a digital micromirror device based on diffractive tilting, the full-field interference of incoherent light is successfully maintained during every angle-scanning sequences. Further, current ODT reconstruction principles for temporally incoherent illuminations are thoroughly reviewed and developed. Several limitations of incoherent illumination are also discussed, such as the nondispersive assumption, optical sectioning capacity and illumination angle limitation. Using the proposed setup and reconstruction algorithms, low-coherent ODT imaging of plastic microspheres, human red blood cells and rat pheochromocytoma cells is experimentally demonstrated.

Enhancement of optical resolution in three-dimensional refractive-index tomograms of biological samples by employing micromirror-embedded coverslips

Optical diffraction tomography (ODT) enables the reconstruction of the three-dimensional (3D) refractive-index (RI) distribution of a biological cell, which provides invaluable information for cellular and subcellular structures in a non-invasive manner. However, ODT suffers from an inferior axial resolution, due to the limited accessible angles imposed by the numerical aperture of the objective lens. In this study, we propose and experimentally demonstrate an approach to enhance the 3D reconstruction performance in ODT. By employing trapezoidal micromirrors, side scattered signals from the sample are measured for various side plane-wave-illumination angles. By combining the side scattered fields with the forward scattered fields, the axial resolution and 3D image quality of ODT are improved, without changing optical instruments. The feasibility and applicability of the proposed method are demonstrated by reconstructing the 3D RI distribution of a red blood cell and HeLa cells in hydrogel. We also present systematic analyses of the improved 3D imaging performance using numerical simulations and experimental measurements for the 3D transfer function, a point object, and a microsphere. The analyses demonstrate an improved axial resolution of 0.31 μm, 4.8 times smaller than that of the conventional method. The proposed method enables the non-invasive and accurate 3D imaging of 3D cultured cells, which is crucial for cell biology studies.

Generalized quantification of three-dimensional resolution in optical diffraction tomography using the projection of maximal spatial bandwidths

Optical diffraction tomography (ODT) is a three-dimensional (3D) quantitative phase imaging technique, which enables the reconstruction of the 3D refractive index (RI) distribution of a transparent sample. Due to its fast, non-invasive, and quantitative imaging capability, ODT has emerged as a powerful tool for various applications. However, the spatial resolution of ODT has only been quantified along the lateral and axial directions for limited conditions; it has not been investigated for arbitrary-oblique directions. In this paper, we systematically quantify the 3D spatial resolution of ODT by exploiting the spatial bandwidth of the reconstructed scattering potential. The 3D spatial resolution is calculated for various types of systems, including the illumination-scanning, sample-rotation, and hybrid scanning-rotation methods. In particular, using the calculated 3D spatial resolution, we provide the spatial resolution as well as the arbitrary sliced angle. Furthermore, to validate the present method, the point spread function of an ODT system is experimentally obtained using the deconvolution of a 3D RI distribution of a microsphere and is compared with the calculated resolution.

Measurements of three-dimensional refractive index tomography and membrane deformability of live erythrocytes from Pelophylax nigromaculatus

Unlike mammalian erythrocytes, amphibian erythrocytes have distinct morphological features including large cell sizes and the presence of nuclei. The sizes of the cytoplasm and nuclei of erythrocytes vary significantly over different species, their environments, or pathophysiology, which makes hematological studies important for investigating amphibian species. Here, we present a label-free three-dimensional optical quantification of individual amphibian erythrocytes from frogs Pelophylax nigromaculatus (Rana nigromaculata). Using optical diffraction tomography, we measured three-dimensional refractive index (RI) tomograms of the cells, which clearly distinguished the cytoplasm and nuclei of the erythrocytes. From the measured RI tomograms, we extracted the relevant biochemical parameters of the cells, including hemoglobin contents and hemoglobin concentrations. Furthermore, we measured dynamic membrane fluctuations and investigated the mechanical properties of the cell membrane. From the statistical and correlative analysis of these retrieved parameters, we investigated interspecific differences between frogs and previously studied mammals.

Super-resolution three-dimensional fluorescence and optical diffraction tomography of live cells using structured illumination generated by a digital micromirror device

We present a multimodal approach for measuring the three-dimensional (3D) refractive index (RI) and fluorescence distributions of live cells by combining optical diffraction tomography (ODT) and 3D structured illumination microscopy (SIM). A digital micromirror device is utilized to generate structured illumination patterns for both ODT and SIM, which enables fast and stable measurements. To verify its feasibility and applicability, the proposed method is used to measure the 3D RI distribution and 3D fluorescence image of various samples, including a cluster of fluorescent beads, and the time-lapse 3D RI dynamics of fluorescent beads inside a HeLa cell, from which the trajectory of the beads in the HeLa cell is analyzed using spatiotemporal correlations.

GPU-based deep convolutional neural network for tomographic phase microscopy with ℓ1 fitting and regularization

Tomographic phase microscopy (TPM) is a unique imaging modality to measure the three-dimensional refractive index distribution of transparent and semitransparent samples. However, the requirement of the dense sampling in a large range of incident angles restricts its temporal resolution and prevents its application in dynamic scenes. Here, we propose a graphics processing unit-based implementation of a deep convolutional neural network to improve the performance of phase tomography, especially with much fewer incident angles. As a loss function for the regularized TPM, the ℓ1-norm sparsity constraint is introduced for both data-fidelity term and gradient-domain regularizer in the multislice beam propagation model. We compare our method with several state-of-the-art algorithms and obtain at least 14 dB improvement in signal-to-noise ratio. Experimental results on HeLa cells are also shown with different levels of data reduction.

Three-dimensional tomographic microscopy technique with multi-frequency combination with partially coherent illuminations

We demonstrate a three-dimensional (3D) optical diffraction tomographic technique with multi-frequency combination (MFC-ODT) for the 3D quantitative phase imaging of unlabeled specimens. Three sets of through-focus intensity images are captured under an annular aperture and two circular apertures with different coherence parameters. The 3D phase optical transfer functions (POTF) corresponding to different illumination apertures are combined to obtain a synthesized frequency response, achieving high-quality, low-noise 3D reconstructions with imaging resolution up to the incoherent diffraction limit. Besides, the expression of 3D POTF for arbitrary illumination pupils is derived and analyzed, and the 3D imaging performance of annular illumination is explored. It is shown that the phase-contrast washout effect in high-NA circular apertures can be effectively addressed by introducing a complementary annular aperture, which strongly boosts the phase contrast and improves the imaging resolution. By incorporating high-NA illumination as well as high-NA detection, MFC-ODT can achieve a theoretical transverse resolution up to 200 nm and an axial resolution of 645 nm. To test the feasibility of the proposed MFC-ODT technique, the 3D refractive index reconstruction results are based on a simulated 3D resolution target and experimental investigations of micro polystyrene bead and unstained biological samples are presented. Due to its capability for high-resolution 3D phase imaging as well as the compatibility with a widely available commercial microscope, the MFC-ODT is expected to find versatile applications in biological and biomedical research.

High-throughput intensity diffraction tomography with a computational microscope

We demonstrate a motion-free intensity diffraction tomography technique that enables the direct inversion of 3D phase and absorption from intensity-only measurements for weakly scattering samples. We derive a novel linear forward model featuring slice-wise phase and absorption transfer functions using angled illumination. This new framework facilitates flexible and efficient data acquisition, enabling arbitrary sampling of the illumination angles. The reconstruction algorithm performs 3D synthetic aperture using a robust computation and memory efficient slice-wise deconvolution to achieve resolution up to the incoherent limit. We demonstrate our technique with thick biological samples having both sparse 3D structures and dense cell clusters. We further investigate the limitation of our technique when imaging strongly scattering samples. Imaging performance and the influence of multiple scattering is evaluated using a 3D sample consisting of stacked phase and absorption resolution targets. This computational microscopy system is directly built on a standard commercial microscope with a simple LED array source add-on, and promises broad applications by leveraging the ubiquitous microscopy platforms with minimal hardware modifications.

Doubling the pixel count limitation of single-pixel imaging via sinusoidal amplitude modulation

We demonstrate a single-pixel imaging (SPI) method that can achieve pixel resolution beyond the physical limitation of the spatial light modulator (SLM), by adopting sinusoidal amplitude modulation and frequency filtering. Through light field analysis, we observe that the induced intensity with a squared value of the amplitude contains higher frequency components. By filtering out the zero frequency of the sinusoidal amplitude in the Fourier domain, we can separate out the higher frequency components, which enables SPI with higher resolving ability and thus beyond the limitation of the SLM. Further, to address the speed issue in grayscale spatial light modulation, we propose a fast implementation scheme with tens-of-kilohertz refresh rate. Specifically, we use a digital micromirror device (DMD) working at the full frame rate to conduct binarized sinusoidal patterning in the spatial domain and pinhole filtering eliminating the binarization error in the Fourier domain. For experimental validation, we build a single-pixel microscope to retrieve 1200 × 1200-pixel images via a sub-megapixel DMD, and the setup achieves comparable performance to array sensor microscopy and provides additional sectioning ability.

Confocal Retinal Imaging Using a Digital Light Projector with a Near Infrared VCSEL Source

A custom near infrared VCSEL source has been implemented in a confocal non-mydriatic retinal camera, the Digital Light Ophthalmoscope (DLO). The use of near infrared light improves patient comfort, avoids pupil constriction, penetrates the deeper retina, and does not mask visual stimuli. The DLO performs confocal imaging by synchronizing a sequence of lines displayed with a digital micromirror device to the rolling shutter exposure of a 2D CMOS camera. Real-time software adjustments enable multiply scattered light imaging, which rapidly and cost-effectively emphasizes drusen and other scattering disruptions in the deeper retina. A separate 5.1″ LCD display provides customizable visible stimuli for vision experiments with simultaneous near infrared imaging.

Tomographic phase microscopy: principles and applications in bioimaging [Invited]

Tomographic phase microscopy (TPM) is an emerging optical microscopic technique for bioimaging. TPM uses digital holographic measurements of complex scattered fields to reconstruct three-dimensional refractive index (RI) maps of cells with diffraction-limited resolution by solving inverse scattering problems. In this paper, we review the developments of TPM from the fundamental physics to its applications in bioimaging. We first provide a comprehensive description of the tomographic reconstruction physical models used in TPM. The RI map reconstruction algorithms and various regularization methods are discussed. Selected TPM applications for cellular imaging, particularly in hematology, are reviewed. Finally, we examine the limitations of current TPM systems, propose future solutions, and envision promising directions in biomedical research.

Three-dimensional label-free imaging and analysis of Pinus pollen grains using optical diffraction tomography

The structure of pollen grains is related to the reproductive function of the plants. Here, three-dimensional (3D) refractive index maps were obtained for individual conifer pollen grains using optical diffraction tomography (ODT). The 3D morphological features of pollen grains from pine trees were investigated using measured refractive index maps, in which distinct substructures were clearly distinguished and analyzed. Morphological and physiochemical parameters of the pollen grains were quantified from the obtained refractive index (RI) maps and used to quantitatively study the interspecific differences of pollen grains from different strains. Our results demonstrate that ODT can assess the structure of pollen grains. This label-free and rapid 3D imaging approach may provide a new platform for understanding the physiology of pollen grains.

Dynamic spatial filtering using a digital micromirror device for high-speed optical diffraction tomography

Optical diffraction tomography (ODT) is an emerging microscopy technique for three-dimensional (3D) refractive index (RI) mapping of transparent specimens. Recently, the digital micromirror device (DMD) based scheme for angle-controlled plane wave illumination has been proposed to improve the imaging speed and stability of ODT. However, undesired diffraction noise always exists in the reported DMD-based illumination scheme, which leads to a limited contrast ratio of the measurement fringe and hence inaccurate RI mapping. Here we present a novel spatial filtering method, based on a second DMD, to dynamically remove the diffraction noise. The reported results illustrate significantly enhanced image quality of the obtained interferograms and the subsequently derived phase maps. And moreover, with this method, we demonstrate mapping of 3D RI distribution of polystyrene beads as well as biological cells with high accuracy. Importantly, with the proper hardware configuration, our method does not compromise the 3D imaging speed advantage promised by the DMD-based illumination scheme. Specifically, we have been able to successfully obtain interferograms at over 1 kHz speed, which is critical for potential high-throughput label-free 3D image cytometry applications.

Correlative three-dimensional fluorescence and refractive index tomography: bridging the gap between molecular specificity and quantitative bioimaging

Optical diffraction tomography (ODT) provides label-free three-dimensional (3D) refractive index (RI) measurement of biological samples. However, due to the nature of the RI values of biological specimens, ODT has limited access to molecular specific information. Here, we present an optical setup combining ODT with three-channel 3D fluorescence microscopy, to enhance the molecular specificity of the 3D RI measurement. The 3D RI distribution and 3D deconvoluted fluorescence images of HeLa cells and NIH-3T3 cells are measured, and the cross-correlative analysis between RI and fluorescence of live cells are presented.

Illumination-related errors in limited-angle optical diffraction tomography

In the paper, the design and tolerances of optical systems and scanning components used in limited-angle optical diffraction tomography are analyzed in order to improve the performance of the measurement systems and to encourage the application of tomography as a standard method for quantitative analysis of 3D refractive index distribution in biological microstructures. The first part of the presented analysis consists of component selection for the scanning device and optical system in the illumination part of the setup and the influence of the illumination wavefront on reconstruction quality. In the second part, the sensitivity of the tomographic reconstruction quality to three representative measurement-related errors based on synthetic data is demonstrated. Finally, a configuration of the system, selected to minimize reconstruction errors, is proposed and alignment tolerances simulated using the Monte Carlo method are provided.

Reconstructions of refractive index tomograms via a discrete algebraic reconstruction technique

Optical diffraction tomography (ODT) provides three-dimensional refractive index (RI) tomograms of a transparent microscopic object. However, because of the finite numerical aperture of objective lenses, ODT has a limited access to diffracted light and suffers from poor spatial resolution, particularly along the axial direction. To overcome the limitation of the quality of RI tomography, we present an algorithm that accurately reconstructs RI tomography of a specimen with discrete and uniform RI, using prior information about the RI levels. Through simulations and experiments on various samples, including microspheres, red blood cells, and water droplets, we show that the proposed method can precisely reconstruct RI tomograms of samples which have discrete and homogenous RI distributions in the presence of the missing information and noise.

Generalized image deconvolution by exploiting the transmission matrix of an optical imaging system

Intact optical information of an object delivered through an imaging system is deteriorated by imperfect optical elements and unwanted defects. Image deconvolution has been widely exploited as a recovery technique due to its practical feasibility, and operates by assuming linear shift-invariant property of the imaging system. However, shift invariance does not rigorously hold in all imaging situations and is not a necessary condition for solving an inverse problem of light propagation. Several improved deconvolution techniques exploiting spatially variant point spread functions have been proposed in previous studies. However, the full characterization of an optical imaging system for compensating aberrations has not been considered. Here, we present a generalized method to solve the linear inverse problem of coherent light propagations without any regularization method or constraint on shift invariance by fully measuring the transmission matrix of the imaging system. Our results show that severe aberrations produced by a tilted lens or an inserted disordered layer can be corrected properly only by the proposed generalized image deconvolution. This work generalizes the theory of image deconvolution, and enables distortion-free imaging under general imaging condition.

Visualization and label-free quantification of microfluidic mixing using quantitative phase imaging

Microfluidic mixing plays a key role in various fields, including biomedicine and chemical engineering. To date, although various approaches for imaging microfluidic mixing have been proposed, they provide only quantitative imaging capability and require exogenous labeling agents. Quantitative phase imaging techniques, however, circumvent these problems and offer label-free quantitative information about concentration maps of microfluidic mixing. We present the quantitative phase imaging of microfluidic mixing in various types of polydimethylsiloxane microfluidic channels with different geometries; the feasibility of the present method was validated by comparing it with the results obtained by theoretical calculation based on Fick's law.

Identification of non-activated lymphocytes using three-dimensional refractive index tomography and machine learning

Identification of lymphocyte cell types are crucial for understanding their pathophysiological roles in human diseases. Current methods for discriminating lymphocyte cell types primarily rely on labelling techniques with magnetic beads or fluorescence agents, which take time and have costs for sample preparation and may also have a potential risk of altering cellular functions. Here, we present the identification of non-activated lymphocyte cell types at the single-cell level using refractive index (RI) tomography and machine learning. From the measurements of three-dimensional RI maps of individual lymphocytes, the morphological and biochemical properties of the cells are quantitatively retrieved. To construct cell type classification models, various statistical classification algorithms are compared, and the k-NN (k = 4) algorithm was selected. The algorithm combines multiple quantitative characteristics of the lymphocyte to construct the cell type classifiers. After optimizing the feature sets via cross-validation, the trained classifiers enable identification of three lymphocyte cell types (B, CD4+ T, and CD8+ T cells) with high sensitivity and specificity. The present method, which combines RI tomography and machine learning for the first time to our knowledge, could be a versatile tool for investigating the pathophysiological roles of lymphocytes in various diseases including cancers, autoimmune diseases, and virus infections.

Label-free high-resolution 3-D imaging of gold nanoparticles inside live cells using optical diffraction tomography

Delivery of gold nanoparticles (GNPs) into live cells has high potentials, ranging from molecular-specific imaging, photodiagnostics, to photothermal therapy. However, studying the long-term dynamics of cells with GNPs using conventional fluorescence techniques suffers from phototoxicity and photobleaching. Here, we present a method for 3-D imaging of GNPs inside live cells exploiting refractive index (RI) as imaging contrast. Employing optical diffraction tomography, 3-D RI tomograms of live cells with GNPs are precisely measured for an extended period with sub-micrometer resolution. The locations and contents of GNPs in live cells are precisely addressed and quantified due to their distinctly high RI values, which was validated by confocal fluorescence imaging of fluorescent dye conjugated GNPs. In addition, we perform quantitative imaging analysis including the segmentations of GNPs in the cytosol, the volume distributions of aggregated GNPs, and the temporal evolution of GNPs contents in HeLa and 4T1 cells.

Ultra-high speed digital micro-mirror device based ptychographic iterative engine method

To reduce the long data acquisition time of the common mechanical scanning based Ptychographic Iterative Engine (PIE) technique, the digital micro-mirror device (DMD) is used to form the fast scanning illumination on the sample. Since the transverse mechanical scanning in the common PIE is replaced by the on/off switching of the micro-mirrors, the data acquisition time can be reduced from more than 15 minutes to less than 20 seconds for recording 12 × 10 diffraction patterns to cover the same field of 147.08 mm2. Furthermore, since the precision of DMD fabricated with the optical lithography is always higher than 10 nm (1 μm for the mechanical translation stage), the time consuming position-error-correction procedure is not required in the iterative reconstruction. These two improvements fundamentally speed up both the data acquisition and the reconstruction procedures in PIE, and relax its requirements on the stability of the imaging system, therefore remarkably improve its applicability for many practices. It is demonstrated experimentally with both USAF resolution target and biological sample that, the spatial resolution of 5.52 μm and the field of view of 147.08 mm2 can be reached with the DMD based PIE method. In a word, by using the DMD to replace the translation stage, we can effectively overcome the main shortcomings of common PIE related to the mechanical scanning, while keeping its advantages on both the high resolution and large field of view.

Measurements of morphological and biophysical alterations in individual neuron cells associated with early neurotoxic effects in Parkinson's disease

Parkinson's disease (PD) is a common neurodegenerative disease. However, therapeutic methods of PD are still limited due to complex pathophysiology in PD. Here, optical measurements of individual neurons from in vitro PD model using optical diffraction tomography (ODT) are presented. By measuring 3D refractive index distribution of neurons, morphological and biophysical alterations in in-vitro PD model are quantitatively investigated. It was found that neurons show apoptotic features in early PD progression. The present approach will open up new opportunities for quantitative investigation of the pathophysiology of various neurodegenerative diseases. © 2017 International Society for Advancement of Cytometry.

Refractive index tomograms and dynamic membrane fluctuations of red blood cells from patients with diabetes mellitus

In this paper, we present the optical characterisations of diabetic red blood cells (RBCs) in a non-invasive manner employing three-dimensional (3-D) quantitative phase imaging. By measuring 3-D refractive index tomograms and 2-D time-series phase images, the morphological (volume, surface area and sphericity), biochemical (haemoglobin concentration and content) and mechanical (membrane fluctuation) parameters were quantitatively retrieved at the individual cell level. With simultaneous measurements of individual cell properties, systematic correlative analyses on retrieved RBC parameters were also performed. Our measurements show there exist no statistically significant alterations in morphological and biochemical parameters of diabetic RBCs, compared to those of healthy (non-diabetic) RBCs. In contrast, membrane deformability of diabetic RBCs is significantly lower than that of healthy, non-diabetic RBCs. Interestingly, non-diabetic RBCs exhibit strong correlations between the elevated glycated haemoglobin in RBC cytoplasm and decreased cell deformability, whereas diabetic RBCs do not show correlations. Our observations strongly support the idea that slow and irreversible glycation of haemoglobin and membrane proteins of RBCs by hyperglycaemia significantly compromises RBC deformability in diabetic patients.

Digital micromirror device-based common-path quantitative phase imaging

We propose a novel common-path quantitative phase imaging (QPI) method based on a digital micromirror device (DMD). The DMD is placed in a plane conjugate to the objective back-aperture plane for the purpose of generating two plane waves that illuminate the sample. A pinhole is used in the detection arm to filter one of the beams after sample to create a reference beam. Additionally, a transmission-type liquid crystal device, placed at the objective back-aperture plane, eliminates the specular reflection noise arising from all the "off" state DMD micromirrors, which is common in all DMD-based illuminations. We have demonstrated high sensitivity QPI, which has a measured spatial and temporal noise of 4.92 nm and 2.16 nm, respectively. Experiments with calibrated polystyrene beads illustrate the desired phase measurement accuracy. In addition, we have measured the dynamic height maps of red blood cell membrane fluctuations, showing the efficacy of the proposed system for live cell imaging. Most importantly, the DMD grants the system convenience in varying the interference fringe period on the camera to easily satisfy the pixel sampling conditions. This feature also alleviates the pinhole alignment complexity. We envision that the proposed DMD-based common-path QPI system will allow for system miniaturization and automation for a broader adaption.

Antibacterial Activities of Graphene Oxide-Molybdenum Disulfide Nanocomposite Films

Two-dimensional (2D) nanomaterials, such as graphene-based materials and transition metal dichalcogenide (TMD) nanosheets, are promising materials for biomedical applications owing to their remarkable cytocompatibility and physicochemical properties. On the basis of their potent antibacterial properties, 2D materials have potential as antibacterial films, wherein the 2D nanosheets are immobilized on the surface and the bacteria may contact with the basal planes of 2D nanosheets dominantly rather than contact with the sharp edges of nanosheets. To address these points, in this study, we prepared an effective antibacterial surface consisting of representative 2D materials, i.e., graphene oxide (GO) and molybdenum disulfide (MoS₂), formed into nanosheets on a transparent substrate for real device applications. The antimicrobial properties of the GO-MoS₂ nanocomposite surface toward the Gram-negative bacteria Escherichia coli were investigated, and the GO-MoS₂ nanocomposite exhibited enhanced antimicrobial effects with increased glutathione oxidation capacity and partial conductivity. Furthermore, direct imaging of continuous morphological destruction in the individual bacterial cells having contacts with the GO-MoS₂ nanocomposite surface was characterized by holotomographic (HT) microscopy, which could be used to detect the refractive index (RI) distribution of each voxel in bacterial cell and reconstruct the three-dimensional (3D) mapping images of bacteria. In this regard, the decreases in both the volume (67.2%) and the dry mass (78.8%) of bacterial cells that came in contact with the surface for 80 min were quantitatively measured, and releasing of intracellular components mediated by membrane and oxidative stress was observed. Our findings provided new insights into the antibacterial properties of 2D nanocomposite film with label-free tracing of bacterial cell which improve our understanding of antimicrobial activities and opened a window for the 2D nanocomposite as a practical antibacterial film in biomedical applications.

Time-multiplexed structured illumination using a DMD for optical diffraction tomography

We present a time-multiplexing structured illumination control technique for optical diffraction tomography (ODT). Instead of tilting the angle of illumination, time-multiplexed sinusoidal illumination is exploited using a digital micromirror device (DMD). The present method effectively eliminates unwanted diffracted beams from binary DMD patterns, which deteriorates the image quality of the ODT in the previous binary Lee hologram method. We experimentally show the feasibility and advantage of the present method by reconstructing three-dimensional refractive index distributions of various samples and comparing with a conventional Lee hologram method.

Measuring cell surface area and deformability of individual human red blood cells over blood storage using quantitative phase imaging

The functionality and viability of stored human red blood cells (RBCs) is an important clinical issue in transfusions. To systematically investigate changes in stored whole blood, the hematological properties of individual RBCs were quantified in blood samples stored for various periods with and without a preservation solution called citrate phosphate dextrose adenine-1 (CPDA-1). With 3-D quantitative phase imaging techniques, the optical measurements for 3-D refractive index (RI) distributions and membrane fluctuations were done at the individual cell level. From the optical measurements, the morphological (volume, surface area and sphericity), biochemical (hemoglobin content and concentration), and mechanical parameters (dynamic membrane fluctuation) were simultaneously quantified to investigate the functionalities and progressive alterations of stored RBCs. Our results show that stored RBCs without CPDA-1 had a dramatic morphological transformation from discocytes to spherocytes within two weeks which was accompanied by significant decreases in cell deformability and cell surface area, and increases in sphericity. However, the stored RBCs with CPDA-1 maintained their morphology and deformability for up to 6 weeks.

Following Optogenetic Dimerizers and Quantitative Prospects

Optogenetics describes the use of genetically encoded photosensitive proteins to direct intended biological processes with light in recombinant and native systems. While most of these light-responsive proteins were originally discovered in photosynthetic organisms, the past few decades have been punctuated by experiments that not only commandeer but also engineer and enhance these natural tools to explore a wide variety of physiological questions. In addition, the ability to tune dynamic range and kinetic rates of optogenetic actuators is a challenging question that is heavily explored with computational methods devised to facilitate optimization of these systems. Here, we explain the basic mechanisms of a few popular photodimerizing optogenetic systems, discuss applications, compare optogenetic tools against more traditional chemical methods, and propose a simple quantitative understanding of how actuators exert their influence on targeted processes.

Label-free optical quantification of structural alterations in Alzheimer's disease

We present a wide-field quantitative label-free imaging of mouse brain tissue slices with sub-micrometre resolution, employing holographic microscopy and an automated scanning platform. From the measured light field images, scattering coefficients and anisotropies are quantitatively retrieved by using the modified the scattering-phase theorem, which enables access to structural information about brain tissues. As a proof of principle, we demonstrate that these scattering parameters enable us to quantitatively address structural alteration in the brain tissues of mice with Alzheimer’s disease.

Differential interference contrast tomography

We present a new approach to optical tomography of phase objects that is referred to as differential interference contrast tomography (DICT). The main feature of DICT is that the result of tomographic reconstruction is a 3D DIC image. This image is described by partial derivative of 3D refractive index distribution in one direction. The DICT setup consists of a lateral shearing phase-shifting interference microscope with low-coherent LED illumination. To create projections of the sample at various illumination angles, an angular scanning beam was used. 3D DIC tomograms of a white blood cell are presented. The comparison between the reconstructed DIC tomogram slices and the conventional DIC images of the same sample at the same depths are also represented.

The Effects of Ethanol on the Morphological and Biochemical Properties of Individual Human Red Blood Cells

Here, we report the results of a study on the effects of ethanol exposure on human red blood cells (RBCs) using quantitative phase imaging techniques at the level of individual cells. Three-dimensional refractive index tomograms and dynamic membrane fluctuations of RBCs were measured using common-path diffraction optical tomography, from which morphological (volume, surface area, and sphericity); biochemical (hemoglobin (Hb) concentration and Hb content); and biomechanical (membrane fluctuation) parameters were retrieved at various concentrations of ethanol. RBCs exposed to the ethanol concentration of 0.1 and 0.3% v/v exhibited cell sphericities higher than those of normal cells. However, mean surface area and sphericity of RBCs in a lethal alcoholic condition (0.5% v/v) are not statistically different with those of healthy RBCs. Meanwhile, significant decreases of Hb content and concentration in RBC cytoplasm at the lethal condition were observed. Furthermore, dynamic fluctuation of RBC membranes increased significantly upon ethanol treatments, indicating ethanol-induced membrane fluidization.

Deciphering the internal complexity of living cells with quantitative phase microscopy: a multiscale approach

The distribution of refractive indices (RIs) of a living cell contributes in a nonintuitive manner to its optical phase image and quite rarely can be inverted to recover its internal structure. The interpretation of the quantitative phase images of living cells remains a difficult task because (1) we still have very little knowledge on the impact of its internal macromolecular complexes on the local RI and (2) phase changes produced by light propagation through the sample are mixed with diffraction effects by the internal cell bodies. We propose to implement a two-dimensional wavelet-based contour chain detection method to distinguish internal boundaries based on their greatest optical path difference gradients. These contour chains correspond to the highest image phase contrast and follow the local RI inhomogeneities linked to the intracellular structural intricacy. Their statistics and spatial distribution are the morphological indicators suited for comparing cells of different origins and/or to follow their transformation in pathologic situations. We use this method to compare nonadherent blood cells from primary and laboratory culture origins and to assess the internal transformation of hematopoietic stem cells by the transduction of the BCR-ABL oncogene responsible for the chronic myelogenous leukemia.