Sickle cell disease diagnosis based on spatio-temporal cell dynamics analysis using 3D printed shearing digital holographic microscopy

Automated fast label-free quantification of cardiomyocyte dynamics with raw holograms for cardiotoxicity screening

Traditional cell analysis approaches based on quantitative phase imaging (QPI) necessitate a reconstruction stage, which utilizes digital holography. However, phase retrieval processing can be complicated and time-consuming since it needs numerical reconstruction and then phase unwrapping. For analysis of cardiomyocyte (CM) dynamics, it was reported that by estimating the spatial variance of the optical path difference from QPI, the spatial displacement of CMs can be quantified, thereby enabling monitoring of the excitation-contraction activity of CMs. Also, it was reported that the Farnebäck optical flow method could be combined with the holographic imaging information from QPI to characterize the contractile motion of single CMs, enabling monitoring of the mechanical beating activity of CMs for cardiotoxicity screening. However, no studies have analyzed the contractile dynamics of CMs based on raw holograms. In this paper, we present a fast, label-free, and high throughput method for contractile dynamic analysis of human-induced pluripotent stem cell-derived CMs using raw holograms or the filtered holograms, which are obtained by filtering only The proposed approach obviates the need for time-consuming numerical reconstruction and phase unwrapping for CM's dynamic analysis while still having performance comparable to that of the previous methods. Accordingly, we developed a computational algorithm to characterize the CM's functional behaviors from contractile motion waveform obtained from raw or filtered holograms, which allows the calculation of various temporal metrics related to beating activity from contraction-relaxation motion-speed profile. To the best of our knowledge, this approach is the first to analyze drug-treated CM's dynamics from raw or filtered holograms without the need for numerical phase image reconstruction. For one hologram, the reconstruction process itself in the existing methods takes at least three times longer than the process of tracking the contraction-relaxation motion-speed profile using optical flow in the proposed method. Furthermore, our proposed methodology was validated in the toxicity screening of two drugs (E-4031 and isoprenaline) with various concentrations. The findings provide information on CM contractile motion and kinetics for cardiotoxicity screening.

A novel approach in cancer diagnosis: integrating holography microscopic medical imaging and deep learning techniques-challenges and future trends

Medical imaging is pivotal in early disease diagnosis, providing essential insights that enable timely and accurate detection of health anomalies. Traditional imaging techniques, such as Magnetic Resonance Imaging (MRI), Computer Tomography (CT), ultrasound, and Positron Emission Tomography (PET), offer vital insights into three-dimensional structures but frequently fall short of delivering a comprehensive and detailed anatomical analysis, capturing only amplitude details. Three-dimensional holography microscopic medical imaging provides a promising solution by capturing the amplitude (brightness) and phase (structural information) details of biological structures. In this study, we investigate the novel collaborative potential of Deep Learning (DL) and holography microscopic phase imaging for cancer diagnosis. The study comprehensively examines existing literature, analyzes advancements, identifies research gaps, and proposes future research directions in cancer diagnosis through the integrated Quantitative Phase Imaging (QPI) and DL methodology. This novel approach addresses a critical limitation of traditional imaging by capturing detailed structural information, paving the way for more accurate diagnostics. The proposed approach comprises tissue sample collection, holographic image scanning, preprocessing in case of imbalanced datasets, and training on annotated datasets using DL architectures like U-Net and Vision Transformer(ViT's). Furthermore, sophisticated concepts in DL, like the incorporation of Explainable AI (XAI) techniques, are suggested for comprehensive disease diagnosis and identification. The study thoroughly investigates the advantages of integrating holography imaging and DL for precise cancer diagnosis. Additionally, meticulous insights are presented by identifying the challenges associated with this integration methodology.

Differential sensitivity to hypoxia enables shape-based classification of sickle cell disease and trait blood samples at point of care

Red blood cells (RBCs) become sickle-shaped and stiff under hypoxia as a consequence of hemoglobin (Hb) polymerization in sickle cell anemia. Distinguishing between sickle cell disease and trait is crucial during the diagnosis of sickle cell disease. While genetic analysis or high-performance liquid chromatography (HPLC) can accurately differentiate between these two genotypes, these tests are unsuitable for field use. Here, we report a novel microscopy-based diagnostic test called ShapeDx™ to distinguish between disease and trait blood in less than 1 h. This is achieved by mixing an unknown blood sample with low and high concentrations of a chemical oxygen scavenger and thereby subjecting the blood to slow and fast hypoxia, respectively. The different rates of Hb polymerization resulting from slow and fast hypoxia lead to two distinct RBC shape distributions in the same blood sample, which allows us to identify it as healthy, trait, or disease. The controlled hypoxic environment necessary for differential Hb polymerization is generated using an imaging microchamber, which also reduces the sickling time of trait blood from several hours to just 30 min. In a single-blinded proof-of-concept study conducted on a small cohort of clinical samples, the results of the ShapeDx™ test were 100% concordant with HPLC results. Additionally, our field studies have demonstrated that ShapeDx™ is the first reported microscopy test capable of distinguishing between sickle cell disease and trait samples in resource-limited settings with the same accuracy as a gold standard test.

Characterization of Optical, Thermal, and Viscoelastic Properties of Pollenkitt in Angiosperm Pollen Using In-Line Digital Holographic Microscopy

Pollen grains are remarkable material composites, with various organelles in their fragile interior protected by a strong shell made of sporopollenin. The outermost layer of angiosperm pollen grains contains a lipid-rich substance called pollenkitt, which is a natural bioadhesive that helps preserve structural integrity when the pollen grain is exposed to external environmental stresses. In addition, its viscous nature enables it to adhere to various floral and insect surfaces, facilitating the pollination process. To examine the physicochemical properties of aqueous pollenkitt droplets, we used in-line digital holographic microscopy to capture light scattering from individual pollenkitt particles. Comparison of pollenkitt holograms to those modeled using the Lorenz-Mie theory enables investigations into the minute variations in the refractive index and size resulting from changes in local temperature and pollen aging.

Computing Sickle Erythrocyte Health Index on quantitative phase imaging and machine learning

Sickle cell disease (SCD) is a genetic disorder characterized by abnormal hemoglobin and deformation of red blood cells (RBCs), leading to complications and reduced life expectancy. This study developed an in vitro assessment, the Sickle Erythrocyte Health Index, using quantitative phase imaging (QPI) and machine learning to model the health of RBCs in people with SCD. The health index combines assessment of cell deformation, sickle-shaped classification, and membrane flexibility to evaluate erythrocyte health. Using QPI and image processing, the percentage of sickle-shaped cells and membrane flexibility were quantified. Statistically significant differences were observed between individuals with and without SCD, indicating the impact of underlying pathophysiology on erythrocyte health. Additionally, sodium metabisulfite led to an increase in sickle-shaped cells and a decrease in flexibility in the sickle cell blood samples. Based on these findings, two approaches were used to calculate the Sickle Erythrocyte Health Index: one using hand-crafted features and one using learned features from deep learning models. Both indices showed significant differences between non-SCD and SCD groups and sensitivity to changes induced by sodium metabisulfite. The Sickle Erythrocyte Health Index has important clinical implications for SCD management and could be used by providers when making treatment decisions. Further research is warranted to evaluate the clinical utility and applicability of the Sickle Erythrocyte Health Index in diverse patient populations.

Common-path digital holographic microscopy based on a volume holographic grating for quantitative phase imaging

Digital holographic microscopy (DHM) is a powerful quantitative phase imaging (QPI) technique that is capable of recording sample's phase information to enhance image contrast. In off-axis DHM, high-quality QPI images can be generated within a single recorded hologram, and the system stability can be enhanced by common-path configuration. Diffraction gratings are widely used components in common-path DHM systems; however, the presence of multiple diffraction beams leads to system power loss. Here, we propose and demonstrate implementation of a volume holographic grating (VHG) in common-path DHM, which provides single diffraction order. VHG in common-path DHM (i.e., VHG-DHM) helps in improving signal-to-noise ratio as compared to the conventional DHM. In addition, VHG, with inherently high angular selectivity, reduces image noise caused by stray light. With a simple fabrication process, it is convenient to utilize VHG to control the beam separation angle of DHM. Further, by using Bragg-matched wavelength degeneracy to avoid potential cell damaging effect in blue light, the VHG is designed for recording at a maximum sensitive wavelength of ∼488 nm, while our VHG-DHM is operated at the longer wavelength of red 632.8 nm for cell observation. Experimental results, measured by the VHG-DHM, show the measurement of target thickness ranging from 100 nm to 350 nm. In addition, stability of the system is quantitatively measured. High-contrast QPI images of human lung cancer cells are demonstrated.

Diagnosis and screening of abnormal hemoglobins

Hemoglobin (Hb) abnormalities, such as thalassemia and structural Hb variants, are among the most prevalent inherited diseases and are associated with significant mortality and morbidity worldwide. However, there were not comprehensive reviews focusing on different clinical analytical techniques, research methods and artificial intelligence (AI) used in clinical screening and research on hemoglobinopathies. Hence the review offers a comprehensive summary of recent advancements and breakthroughs in the detection of aberrant Hbs, research methods and AI uses as well as the present restrictions anddifficulties in hemoglobinopathies. Recent advances in cation exchange high performance liquid chromatography (HPLC), capillary zone electrophoresis (CZE), isoelectric focusing (IEF), flow cytometry, mass spectrometry (MS) and polymerase chain reaction (PCR) etc have allowed for the definitive detection by using advanced AIand portable point of care tests (POCT) integrating with smartphone microscopic classification, machine learning (ML) model, complete blood counts (CBC), imaging-based method, speedy immunoassay, and electrochemical-, microfluidic- and sensing-related platforms. In addition, to confirm and validate unidentified and novel Hbs, highly specialized genetic based techniques like PCR, reverse transcribed (RT)-PCR, DNA microarray, sequencing of genomic DNA, and sequencing of RT-PCR amplified globin cDNA of the gene of interest have been used. Hence, adequate utilization and improvement of available diagnostic and screening technologies are important for the control and management of hemoglobinopathies.

On the use of deep learning for phase recovery

Phase recovery (PR) refers to calculating the phase of the light field from its intensity measurements. As exemplified from quantitative phase imaging and coherent diffraction imaging to adaptive optics, PR is essential for reconstructing the refractive index distribution or topography of an object and correcting the aberration of an imaging system. In recent years, deep learning (DL), often implemented through deep neural networks, has provided unprecedented support for computational imaging, leading to more efficient solutions for various PR problems. In this review, we first briefly introduce conventional methods for PR. Then, we review how DL provides support for PR from the following three stages, namely, pre-processing, in-processing, and post-processing. We also review how DL is used in phase image processing. Finally, we summarize the work in DL for PR and provide an outlook on how to better use DL to improve the reliability and efficiency of PR. Furthermore, we present a live-updating resource ( https://github.com/kqwang/phase-recovery ) for readers to learn more about PR.

A Novel Image Processing Method for Obtaining an Accurate Three-Dimensional Profile of Red Blood Cells in Digital Holographic Microscopy

Recently, research on disease diagnosis using red blood cells (RBCs) has been active due to the advantage that it is possible to diagnose many diseases with a drop of blood in a short time. Representatively, there are disease diagnosis technologies that utilize deep learning techniques and digital holographic microscope (DHM) techniques. However, three-dimensional (3D) profile obtained by DHM has a problem of random noise caused by the overlapping DC spectrum and sideband in the Fourier domain, which has the probability of misjudging diseases in deep learning technology. To reduce random noise and obtain a more accurate 3D profile, in this paper, we propose a novel image processing method which randomly selects the center of the high-frequency sideband (RaCoHS) in the Fourier domain. This proposed algorithm has the advantage of filtering while using only recorded hologram information to maintain high-frequency information. We compared and analyzed the conventional filtering method and the general image processing method to verify the effectiveness of the proposed method. In addition, the proposed image processing algorithm can be applied to all digital holography technologies including DHM, and in particular, it is expected to have a great effect on the accuracy of disease diagnosis technologies using DHM.

Artificial intelligence-enabled quantitative phase imaging methods for life sciences

Quantitative phase imaging, integrated with artificial intelligence, allows for the rapid and label-free investigation of the physiology and pathology of biological systems. This review presents the principles of various two-dimensional and three-dimensional label-free phase imaging techniques that exploit refractive index as an intrinsic optical imaging contrast. In particular, we discuss artificial intelligence-based analysis methodologies for biomedical studies including image enhancement, segmentation of cellular or subcellular structures, classification of types of biological samples and image translation to furnish subcellular and histochemical information from label-free phase images. We also discuss the advantages and challenges of artificial intelligence-enabled quantitative phase imaging analyses, summarize recent notable applications in the life sciences, and cover the potential of this field for basic and industrial research in the life sciences.

Photolithographic patterning on multi-wavelength quantum dot film of the improved conversion efficiency for digital holography

A triple-wavelength patterned quantum dot film was fabricated for the light source of digital holography to improve both the axial measurement range and noise reduction. The patterned quantum dot film was fabricated after optimizing the photolithography process condition based on the UV-curable quantum dot solution, which was capable of multiple patterning processes. In addition, an optimized pattern structure was developed by adding TiO2 nanoparticles to both the quantum dot and bank layers to increase the scattering effect for the improved photoluminescence intensity. Finally, the newly developed light source with the balanced spectral distribution was applied to the digital holography, rendering it applicable as an improved light source.

Rapid and stain-free quantification of viral plaque via lens-free holography and deep learning

A plaque assay-the gold-standard method for measuring the concentration of replication-competent lytic virions-requires staining and usually more than 48 h of runtime. Here we show that lens-free holographic imaging and deep learning can be combined to expedite and automate the assay. The compact imaging device captures phase information label-free at a rate of approximately 0.32 gigapixels per hour per well, covers an area of about 30 × 30 mm2 and a 10-fold larger dynamic range of virus concentration than standard assays, and quantifies the infected area and the number of plaque-forming units. For the vesicular stomatitis virus, the automated plaque assay detected the first cell-lysing events caused by viral replication as early as 5 h after incubation, and in less than 20 h it detected plaque-forming units at rates higher than 90% at 100% specificity. Furthermore, it reduced the incubation time of the herpes simplex virus type 1 by about 48 h and that of the encephalomyocarditis virus by about 20 h. The stain-free assay should be amenable for use in virology research, vaccine development and clinical diagnosis.

pyDHM: A Python library for applications in digital holographic microscopy

pyDHM is an open-source Python library aimed at Digital Holographic Microscopy (DHM) applications. The pyDHM is a user-friendly library written in the robust programming language of Python that provides a set of numerical processing algorithms for reconstructing amplitude and phase images for a broad range of optical DHM configurations. The pyDHM implements phase-shifting approaches for in-line and slightly off-axis systems and enables phase compensation for telecentric and non-telecentric systems. In addition, pyDHM includes three propagation algorithms for numerical focusing complex amplitude distributions in DHM and digital holography (DH) setups. We have validated the library using numerical and experimental holograms.

COVID-19 screening with digital holographic microscopy using intra-patient probability functions of spatio-temporal bio-optical attributes

We present an automated method for COVID-19 screening using the intra-patient population distributions of bio-optical attributes extracted from digital holographic microscopy reconstructed red blood cells. Whereas previous approaches have aimed to identify infection by classifying individual cells, here, we propose an approach to incorporate the attribute distribution information from the population of a given human subjects' cells into our classification scheme and directly classify subjects at the patient level. To capture the intra-patient distribution information in a generalized way, we propose an approach based on the Bag-of-Features (BoF) methodology to transform histograms of bio-optical attribute distributions into feature vectors for classification via a linear support vector machine. We compare our approach with simpler classifiers directly using summary statistics such as mean, standard deviation, skewness, and kurtosis of the distributions. We also compare to a k-nearest neighbor classifier using the Kolmogorov-Smirnov distance as a distance metric between the attribute distributions of each subject. We lastly compare our approach to previously published methods for classification of individual red blood cells. In each case, the methodology proposed in this paper provides the highest patient classification performance, correctly classifying 22 out of 24 individuals and achieving 91.67% classification accuracy with 90.00% sensitivity and 92.86% specificity. The incorporation of distribution information for classification additionally led to the identification of a singular temporal-based bio-optical attribute capable of highly accurate patient classification. To the best of our knowledge, this is the first report of a machine learning approach using the intra-patient probability distribution information of bio-optical attributes obtained from digital holographic microscopy for disease screening.

Automated sickle cell disease identification in human red blood cells using a lensless single random phase encoding biosensor and convolutional neural networks

We present a compact, field portable, lensless, single random phase encoding biosensor for automated classification between healthy and sickle cell disease human red blood cells. Microscope slides containing 3 µl wet mounts of whole blood samples from healthy and sickle cell disease afflicted human donors are input into a lensless single random phase encoding (SRPE) system for disease identification. A partially coherent laser source (laser diode) illuminates the cells under inspection wherein the object complex amplitude propagates to and is pseudorandomly encoded by a diffuser, then the intensity of the diffracted complex waveform is captured by a CMOS image sensor. The recorded opto-biological signatures are transformed using local binary pattern map generation during preprocessing then input into a pretrained convolutional neural network for classification between healthy and disease-states. We further provide analysis that compares the performance of several neural network architectures to optimize our classification strategy. Additionally, we assess the performance and computational savings of classifying on subsets of the opto-biological signatures with substantially reduced dimensionality, including one dimensional cropping of the recorded signatures. To the best of our knowledge, this is the first report of a lensless SRPE biosensor for human disease identification. As such, the presented approach and results can be significant for low-cost disease identification both in the field and for healthcare systems in developing countries which suffer from constrained resources.

Label-free hematology analysis method based on defocusing phase-contrast imaging under illumination of 415 nm light

Label-free imaging technology is a trending way to simplify and improve conventional hematology analysis by bypassing lengthy and laborious staining procedures. However, the existing methods do not well balance system complexity, data acquisition efficiency, and data analysis accuracy, which severely impedes their clinical translation. Here, we propose defocusing phase-contrast imaging under the illumination of 415 nm light to realize label-free hematology analysis. We have verified that the subcellular morphology of blood components can be visualized without complex staining due to the factor that defocusing can convert the second-order derivative distribution of samples' optical phase into intensity and the illumination of 415 nm light can significantly enhance the contrast. It is demonstrated that the defocusing phase-contrast images for the five leucocyte subtypes can be automatically discriminated by a trained deep-learning program with high accuracy (the mean F1 score: 0.986 and mean average precision: 0.980). Since this technique is based on a regular microscope, it simultaneously realizes low system complexity and high data acquisition efficiency with remarkable quantitative analysis ability. It supplies a label-free, reliable, easy-to-use, fast approach to simplifying and reforming the conventional way of hematology analysis.

Quantitative Phase Imaging: Recent Advances and Expanding Potential in Biomedicine

Quantitative phase imaging (QPI) is a label-free, wide-field microscopy approach with significant opportunities for biomedical applications. QPI uses the natural phase shift of light as it passes through a transparent object, such as a mammalian cell, to quantify biomass distribution and spatial and temporal changes in biomass. Reported in cell studies more than 60 years ago, ongoing advances in QPI hardware and software are leading to numerous applications in biology, with a dramatic expansion in utility over the past two decades. Today, investigations of cell size, morphology, behavior, cellular viscoelasticity, drug efficacy, biomass accumulation and turnover, and transport mechanics are supporting studies of development, physiology, neural activity, cancer, and additional physiological processes and diseases. Here, we review the field of QPI in biology starting with underlying principles, followed by a discussion of technical approaches currently available or being developed, and end with an examination of the breadth of applications in use or under development. We comment on strengths and shortcomings for the deployment of QPI in key biomedical contexts and conclude with emerging challenges and opportunities based on combining QPI with other methodologies that expand the scope and utility of QPI even further.

LED based large field of view off-axis quantitative phase contrast microscopy by hologram multiplexing

In this manuscript, we describe the development of a single shot, self-referencing wavefront division, multiplexing digital holographic microscope employing LED sources for large field of view quantitative phase imaging of biological samples. To address the difficulties arising while performing interferometry with low temporally coherent sources, an optical arrangement utilizing multiple Fresnel Biprisms is used for hologram multiplexing, enhancing the field of view and increasing the signal to noise ratio. Biprisms offers the ease of obtaining interference patterns by automatically matching the path length between the two off-axis beams. The use of low temporally coherent sources reduces the speckle noise and the cost, and the form factor of the setup. The developed technique was implemented using both visible and UV LEDs and tested on polystyrene microspheres and human erythrocytes.

Automated wide-field malaria parasite infection detection using Fourier ptychography on stain-free thin-smears

Diagnosis of malaria in endemic areas is hampered by the lack of a rapid, stain-free and sensitive method to directly identify parasites in peripheral blood. Herein, we report the use of Fourier ptychography to generate wide-field high-resolution quantitative phase images of erythrocytes infected with malaria parasites, from a whole blood sample. We are able to image thousands of erythrocytes (red blood cells) in a single field of view and make a determination of infection status of the quantitative phase image of each segmented cell based on machine learning (random forest) and deep learning (VGG16) models. Our random forest model makes use of morphology and texture based features of the quantitative phase images. In order to label the quantitative images of the cells as either infected or uninfected before training the models, we make use of a Plasmodium berghei strain expressing GFP (green fluorescent protein) in all life cycle stages. By overlaying the fluorescence image with the quantitative phase image we could identify the infected subpopulation of erythrocytes for labelling purposes. Our machine learning model (random forest) achieved 91% specificity and 72% sensitivity while our deep learning model (VGG16) achieved 98% specificity and 57% sensitivity. These results highlight the potential for quantitative phase imaging coupled with artificial intelligence to develop an easy to use platform for the rapid and sensitive diagnosis of malaria.

Label-free single-shot imaging with on-axis phase-shifting holographic reflectance quantitative phase microscopy

Quantitative phase microscopy (QPM) has been emerged as an indispensable diagnostic and characterization tool in biomedical imaging with its characteristic nature of label-free, noninvasive, and real time imaging modality. The integration of holography to the conventional microscopy opens new advancements in QPM featuring high-resolution and quantitative three-dimensional image reconstruction. However, the holography schemes suffer in space-bandwidth and time-bandwidth issues in the off-axis and phase-shifting configuration, respectively. Here, we introduce an on-axis phase-shifting holography based QPM system with single-shot imaging capability. The technique utilizes the Fizeau interferometry scheme in combination with polarization phase-shifting and space-division multiplexing to achieve the single-shot recording of the multiple phase-shifted holograms. Moreover, the high-speed imaging capability with instantaneous recording of spatially phase shifted holograms offers the flexible utilization of the approach in dynamic quantitative phase imaging with robust phase stability. We experimentally demonstrated the validity of the approach by quantitative phase imaging and depth-resolved imaging of paramecium cells. Furthermore, the technique is applied to the phase imaging and quantitative parameter estimation of red blood cells. This integration of a Fizeau-based phase-shifting scheme to the optical microscopy enables a simple and robust tool for the investigations of engineered and biological specimen with real-time quantitative analysis.

Single-Shot 3D Topography of Transmissive and Reflective Samples with a Dual-Mode Telecentric-Based Digital Holographic Microscope

Common path DHM systems are the most robust DHM systems as they are based on self-interference and are thus less prone to external fluctuations. A common issue amongst these DHM systems is that the two replicas of the sample’s information overlay due to self-interference, making them only suitable for imaging sparse samples. This overlay has restricted the use of common-path DHM systems in material science. The overlay can be overcome by limiting the sample’s field of view to occupy only half of the imaging field of view or by using an optical spatial filter. In this work, we have implemented optical spatial filtering in a common-path DHM system using a Fresnel biprism. We have analyzed the optimal pinhole size by evaluating the frequency content of the reconstructed phase images of a star target. We have also measured the accuracy of the system and the sensitivity to noise for different pinhole sizes. Finally, we have proposed the first dual-mode common-path DHM system using a Fresnel biprism. The performance of the dual-model DHM system has been evaluated experimentally using transmissive and reflective microscopic samples.

Investigating Morphological Changes of T-lymphocytes after Exposure with Bacterial Determinants for Early Detection of Septic Conditions

Sepsis is a leading cause of morbidity and mortality, annually affecting millions of people worldwide. Immediate treatment initiation is crucial to improve the outcome but despite great progress, early identification of septic patients remains a challenge. Recently, white blood cell morphology was proposed as a new biomarker for sepsis diagnosis. In this proof-of-concept study, we aimed to investigate the effect of different bacteria and their determinants on T-lymphocytes by digital holographic microscopy (DHM). We hypothesize that species- and strain-specific morphological changes occur, which may offer a new approach for early sepsis diagnosis and identification of the causative agent. Jurkat cells as a model system were exposed to different S. aureus or E. coli strains either using sterile determinants or living bacteria. Time-lapse DHM was applied to analyze cellular morphological changes. There were not only living bacteria but also membrane vesicles and sterile culture supernatant-induced changes of cell area, circularity, and mean phase contrast. Interestingly, different cellular responses occurred depending on both the species and strain of the causative bacteria. Our findings suggest that investigation of T-lymphocyte morphology might provide a promising tool for the early identification of bacterial infections and possibly discrimination between different causative agents. Distinguishing gram-positive from gram-negative infection would already offer a great benefit for the proper administration of antibiotics.

COVID-19 detection from red blood cells using highly comparative time-series analysis (HCTSA) in digital holographic microscopy

We present an automated method for COVID-19 screening based on reconstructed phase profiles of red blood cells (RBCs) and a highly comparative time-series analysis (HCTSA). Video digital holographic data -was obtained using a compact, field-portable shearing microscope to capture the temporal fluctuations and spatio-temporal dynamics of live RBCs. After numerical reconstruction of the digital holographic data, the optical volume is calculated at each timeframe of the reconstructed data to produce a time-series signal for each cell in our dataset. Over 6000 features are extracted on the time-varying optical volume sequences using the HCTSA to quantify the spatio-temporal behavior of the RBCs, then a linear support vector machine is used for classification of individual RBCs. Human subjects are then classified for COVID-19 based on the consensus of their cells' classifications. The proposed method is tested on a dataset of 1472 RBCs from 24 human subjects (10 COVID-19 positive, 14 healthy) collected at UConn Health Center. Following a cross-validation procedure, our system achieves 82.13% accuracy, with 92.72% sensitivity, and 73.21% specificity (area under the receiver operating characteristic curve: 0.8357). Furthermore, the proposed system resulted in 21 out of 24 human subjects correctly labeled. To the best of our knowledge this is the first report of a highly comparative time-series analysis using digital holographic microscopy data.

Automated analysis of human cardiomyocytes dynamics with holographic image-based tracking for cardiotoxicity screening

This paper proposes a new non-invasive, low-cost, and fully automated platform to quantitatively analyze dynamics of human-induced pluripotent stem cell-derived cardiomyocytes (hiPS-CMs) at the single-cell level by holographic image-based tracking for cardiotoxicity screening. A dense Farneback optical flow method and holographic imaging informatics were combined to characterize the contractile motion of a single CM, which obviates the need for costly equipment to monitor a CM's mechanical beat activity. The reliability of the proposed platform was tested by single-cell motion characterization, synchronization analysis, motion speed measurement of fixed CMs versus live CMs, and noise sensitivity. The applicability of the motion characterization method was tested to determine the pharmacological effects of two cardiovascular drugs, isoprenaline (166 nM) and E-4031 (500 μM). The experiments were done using single CMs and multiple cells, and the results were compared to control conditions. Cardiomyocytes responded to isoprenaline by increasing the action potential (AP) speed and shortening the resting period, thus increasing the beat frequency. In the presence of E-4031, the AP speed was decreased, and the resting period was prolonged, thus decreasing the beat frequency. The findings offer insights into single hiPS-CMs' contractile motion and a deep understanding of their kinetics at the single-cell level for cardiotoxicity screening.

Ultrasound Mediated Cellular Deflection Results in Cellular Depolarization

Ultrasound has been used to manipulate cells in both humans and animal models. While intramembrane cavitation and lipid clustering have been suggested as likely mechanisms, they lack experimental evidence. Here, high-speed digital holographic microscopy (kiloHertz order) is used to visualize the cellular membrane dynamics. It is shown that neuronal and fibroblast membranes deflect about 150 nm upon ultrasound stimulation. Next, a biomechanical model that predicts changes in membrane voltage after ultrasound exposure is developed. Finally, the model predictions are validated using whole-cell patch clamp electrophysiology on primary neurons. Collectively, it is shown that ultrasound stimulation directly defects the neuronal membrane leading to a change in membrane voltage and subsequent depolarization. The model is consistent with existing data and provides a mechanism for both ultrasound-evoked neurostimulation and sonogenetic control.

Video-Rate Quantitative Phase Imaging Using a Digital Holographic Microscope and a Generative Adversarial Network

The conventional reconstruction method of off-axis digital holographic microscopy (DHM) relies on computational processing that involves spatial filtering of the sample spectrum and tilt compensation between the interfering waves to accurately reconstruct the phase of a biological sample. Additional computational procedures such as numerical focusing may be needed to reconstruct free-of-distortion quantitative phase images based on the optical configuration of the DHM system. Regardless of the implementation, any DHM computational processing leads to long processing times, hampering the use of DHM for video-rate renderings of dynamic biological processes. In this study, we report on a conditional generative adversarial network (cGAN) for robust and fast quantitative phase imaging in DHM. The reconstructed phase images provided by the GAN model present stable background levels, enhancing the visualization of the specimens for different experimental conditions in which the conventional approach often fails. The proposed learning-based method was trained and validated using human red blood cells recorded on an off-axis Mach–Zehnder DHM system. After proper training, the proposed GAN yields a computationally efficient method, reconstructing DHM images seven times faster than conventional computational approaches.

Roadmap on digital holography [Invited]

This Roadmap article on digital holography provides an overview of a vast array of research activities in the field of digital holography. The paper consists of a series of 25 sections from the prominent experts in digital holography presenting various aspects of the field on sensing, 3D imaging and displays, virtual and augmented reality, microscopy, cell identification, tomography, label-free live cell imaging, and other applications. Each section represents the vision of its author to describe the significant progress, potential impact, important developments, and challenging issues in the field of digital holography.

PhaseRMiC: phase real-time microscope camera for live cell imaging

We design a novel phase real-time microscope camera (PhaseRMiC) for live cell phase imaging. PhaseRMiC has a simple and cost-effective configuration only consisting of a beam splitter and a board-level camera with two CMOS imaging chips. Moreover, integrated with 3-D printed structures, PhaseRMiC has a compact size of 136×91×60 mm³, comparable to many commercial microscope cameras, and can be directly connected to the microscope side port. Additionally, PhaseRMiC can be well adopted in real-time phase imaging proved with satisfied accuracy, good stability and large field of view. Considering its compact and cost-effective device design as well as real-time phase imaging capability, PhaseRMiC is a preferred solution for live cell imaging.

Label-Free White Blood Cell Classification Using Refractive Index Tomography and Deep Learning

Objective and Impact Statement. We propose a rapid and accurate blood cell identification method exploiting deep learning and label-free refractive index (RI) tomography. Our computational approach that fully utilizes tomographic information of bone marrow (BM) white blood cell (WBC) enables us to not only classify the blood cells with deep learning but also quantitatively study their morphological and biochemical properties for hematology research. Introduction. Conventional methods for examining blood cells, such as blood smear analysis by medical professionals and fluorescence-activated cell sorting, require significant time, costs, and domain knowledge that could affect test results. While label-free imaging techniques that use a specimen's intrinsic contrast (e.g., multiphoton and Raman microscopy) have been used to characterize blood cells, their imaging procedures and instrumentations are relatively time-consuming and complex. Methods. The RI tomograms of the BM WBCs are acquired via Mach-Zehnder interferometer-based tomographic microscope and classified by a 3D convolutional neural network. We test our deep learning classifier for the four types of bone marrow WBC collected from healthy donors (n = 10 ): monocyte, myelocyte, B lymphocyte, and T lymphocyte. The quantitative parameters of WBC are directly obtained from the tomograms. Results. Our results show >99% accuracy for the binary classification of myeloids and lymphoids and >96% accuracy for the four-type classification of B and T lymphocytes, monocyte, and myelocytes. The feature learning capability of our approach is visualized via an unsupervised dimension reduction technique. Conclusion. We envision that the proposed cell classification framework can be easily integrated into existing blood cell investigation workflows, providing cost-effective and rapid diagnosis for hematologic malignancy.

Single-plane and multiplane quantitative phase imaging by self-reference on-axis holography with a phase-shifting method

A new quantitative phase imaging approach is proposed based on self-reference holography. Three on-axis interferograms with different values of the phase filter are superposed. The superposition yields a more accurate phase map of the wavefront emerging from the object, compared with standard off-axis interferometry. Reduced temporal noise levels in the measured phase map and efficient phase recovery process for optically thin and thick transmissive phase objects highlight the applicability of the suggested framework for various fields ranging from metrology to bio-imaging. Qualitative phase imaging is also done online without altering the optical configuration. Qualitative phase detections of multiple planes of interest are converted to quantitative phase maps of the multiplane scene by a rapid phase contrast-based phase retrieval algorithm, from a single camera exposure and with no moving parts in the system.

Characterization of Monochromatic Aberrated Metalenses in Terms of Intensity-Based Moments

Consistent with wave-optics simulations of metasurfaces, aberrations of metalenses should also be described in terms of wave optics and not ray tracing. In this respect, we have shown, through extensive numerical simulations, that intensity-based moments and the associated parameters defined in terms of them (average position, spatial extent, skewness and kurtosis) adequately capture changes in beam shapes induced by aberrations of a metalens with a hyperbolic phase profile. We have studied axial illumination, in which phase-discretization induced aberrations exist, as well as non-axial illumination, when coma could also appear. Our results allow the identification of the parameters most prone to induce changes in the beam shape for metalenses that impart on an incident electromagnetic field a step-like approximation of an ideal phase profile.

Digital holographic deep learning of red blood cells for field-portable, rapid COVID-19 screening

Rapid screening of red blood cells for active infection of COVID-19 is presented using a compact and field-portable, 3D-printed shearing digital holographic microscope. Video holograms of thin blood smears are recorded, individual red blood cells are segmented for feature extraction, then a bi-directional long short-term memory network is used to classify between healthy and COVID positive red blood cells based on their spatiotemporal behavior. Individuals are then classified based on the simple majority of their cells' classifications. The proposed system may be beneficial for under-resourced healthcare systems. To the best of our knowledge, this is the first report of digital holographic microscopy for rapid screening of COVID-19.

Techniques for the Detection of Sickle Cell Disease: A Review

Sickle cell disease (SCD) is a widespread disease caused by a mutation in the beta-globin gene that leads to the production of abnormal hemoglobin called hemoglobin S. The inheritance of the mutation could be homozygous or heterozygous combined with another hemoglobin mutation. SCD can be characterized by the presence of dense, sickled cells that causes hemolysis of blood cells, anemia, painful episodes, organ damage, and in some cases death. Early detection of SCD can help to reduce the mortality and manage the disease effectively. Therefore, different techniques have been developed to detect the sickle cell disease and the carrier states with high sensitivity and specificity. These techniques can be screening tests such as complete blood count, peripheral blood smears, and sickling test; confirmatory tests such as hemoglobin separation techniques; and genetic tests, which are more expensive and need to be done in centralized labs by highly skilled personnel. However, advanced portable point of care techniques have been developed to provide a low-cost, simple, and user-friendly device for detecting SCD, for instance coupling solubility tests with portable devices, using smartphone microscopic classifications, image processing techniques, rapid immunoassays, and sensor-based platforms. This review provides an overview of the current and emerging techniques for sickle cell disease detection and highlights the different potential methods that could be applied to help the early diagnosis of SCD.

A review of microscopic analysis of blood cells for disease detection with AI perspective

BACKGROUND

Any contamination in the human body can prompt changes in blood cell morphology and various parameters of cells. The minuscule images of blood cells are examined for recognizing the contamination inside the body with an expectation of maladies and variations from the norm. Appropriate segmentation of these cells makes the detection of a disease progressively exact and vigorous. Microscopic blood cell analysis is a critical activity in the pathological analysis. It highlights the investigation of appropriate malady after exact location followed by an order of abnormalities, which assumes an essential job in the analysis of various disorders, treatment arranging, and assessment of results of treatment.

METHODOLOGY

A survey of different areas where microscopic imaging of blood cells is used for disease detection is done in this paper. Research papers from this area are obtained from a popular search engine, Google Scholar. The articles are searched considering the basics of blood such as its composition followed by staining of blood, that is most important and mandatory before microscopic analysis. Different methods for classification, segmentation of blood cells are reviewed. Microscopic analysis using image processing, computer vision and machine learning are the main focus of the analysis and the review here. Methodologies employed by different researchers for blood cells analysis in terms of these mentioned algorithms is the key point of review considered in the study.

RESULTS

Different methodologies used for microscopic analysis of blood cells are analyzed and are compared according to different performance measures. From the extensive review the conclusion is made.

CONCLUSION

There are different machine learning and deep learning algorithms employed by researchers for segmentation of blood cell components and disease detection considering microscopic analysis. There is a scope of improvement in terms of different performance evaluation parameters. Different bio-inspired optimization algorithms can be used for improvement. Explainable AI can analyze the features of AI implemented system and will make the system more trusted and commercially suitable.

High-throughput label-free cell detection and counting from diffraction patterns with deep fully convolutional neural networks

SIGNIFICANCE

Digital holographic microscopy (DHM) is a promising technique for the study of semitransparent biological specimen such as red blood cells (RBCs). It is important and meaningful to detect and count biological cells at the single cell level in biomedical images for biomarker discovery and disease diagnostics. However, the biological cell analysis based on phase information of images is inefficient due to the complexity of numerical phase reconstruction algorithm applied to raw hologram images. New cell study methods based on diffraction pattern directly are desirable.

AIM

Deep fully convolutional networks (FCNs) were developed on raw hologram images directly for high-throughput label-free cell detection and counting to assist the biological cell analysis in the future.

APPROACH

The raw diffraction patterns of RBCs were recorded by use of DHM. Ground-truth mask images were labeled based on phase images reconstructed from RBC holograms using numerical reconstruction algorithm. A deep FCN, which is UNet, was trained on the diffraction pattern images to achieve the label-free cell detection and counting.

RESULTS

The implemented deep FCNs provide a promising way to high-throughput and label-free counting of RBCs with a counting accuracy of 99% at a throughput rate of greater than 288 cells per second and 200  μm  ×  200  μm field of view at the single cell level. Compared to convolutional neural networks, the FCNs can get much better results in terms of accuracy and throughput rate.

CONCLUSIONS

High-throughput label-free cell detection and counting were successfully achieved from diffraction patterns with deep FCNs. It is a promising approach for biological specimen analysis based on raw hologram directly.

Automatic detection and characterization of quantitative phase images of thalassemic red blood cells using a mask region-based convolutional neural network

SIGNIFICANCE

Label-free quantitative phase imaging is a promising technique for the automatic detection of abnormal red blood cells (RBCs) in real time. Although deep-learning techniques can accurately detect abnormal RBCs from quantitative phase images efficiently, their applications in diagnostic testing are limited by the lack of transparency. More interpretable results such as morphological and biochemical characteristics of individual RBCs are highly desirable.

AIM

An end-to-end deep-learning model was developed to efficiently discriminate thalassemic RBCs (tRBCs) from healthy RBCs (hRBCs) in quantitative phase images and segment RBCs for single-cell characterization.

APPROACH

Two-dimensional quantitative phase images of hRBCs and tRBCs were acquired using digital holographic microscopy. A mask region-based convolutional neural network (Mask R-CNN) model was trained to discriminate tRBCs and segment individual RBCs. Characterization of tRBCs was achieved utilizing SHapley Additive exPlanation analysis and canonical correlation analysis on automatically segmented RBC phase images.

RESULTS

The implemented model achieved 97.8% accuracy in detecting tRBCs. Phase-shift statistics showed the highest influence on the correct classification of tRBCs. Associations between the phase-shift features and three-dimensional morphological features were revealed.

CONCLUSIONS

The implemented Mask R-CNN model accurately identified tRBCs and segmented RBCs to provide single-RBC characterization, which has the potential to aid clinical decision-making.

Red blood cell classification in lensless single random phase encoding using convolutional neural networks

Rapid cell identification is achieved in a compact and field-portable system employing single random phase encoding to record opto-biological signatures of living biological cells of interest. The lensless, 3D-printed system uses a diffuser to encode the complex amplitude of the sample, then the encoded signal is recorded by a CMOS image sensor for classification. Removal of lenses in this 3D sensing system removes restrictions on the field of view, numerical aperture, and depth of field normally imposed by objective lenses in comparable microscopy systems to enable robust 3D capture of biological volumes. Opto-biological signatures for two classes of animal red blood cells, situated in a microfluidic device, are captured then input into a convolutional neural network for classification, wherein the AlexNet architecture, pretrained on the ImageNet database is used as the deep learning model. Video data was recorded of the opto-biological signatures for multiple samples, then each frame was treated as an input image to the network. The pre-trained network was fine-tuned and evaluated using a dataset of over 36,000 images. The results show improved performance in comparison to a previously studied Random Forest classification model using extracted statistical features from the opto-biological signatures. The system is further compared to and outperforms a similar shearing-based 3D digital holographic microscopy system for cell classification. In addition to improvements in classification performance, the use of convolutional neural networks in this work is further demonstrated to provide improved performance in the presence of noise. Red blood cell identification as presented here, may serve as a key step toward lensless pseudorandom phase encoding applications in rapid disease screening. To the best of our knowledge this is the first report of lensless cell identification in single random phase encoding using convolutional neural networks.

Quantitative absorption imaging of red blood cells to determine physical and mechanical properties

Red blood cells or erythrocytes, constituting 40 to 45 percent of the total volume of human blood are vesicles filled with hemoglobin with a fluid-like lipid bilayer membrane connected to a 2D spectrin network. The shape, volume, hemoglobin mass, and membrane stiffness of RBCs are important characteristics that influence their ability to circulate through the body and transport oxygen to tissues. In this study, we show that a simple two-LED set up in conjunction with standard microscope imaging can accurately determine the physical and mechanical properties of single RBCs. The Beer-Lambert law and undulatory motion dynamics of the membrane have been used to measure the total volume, hemoglobin mass, membrane tension coefficient, and bending modulus of RBCs. We also show that this method is sensitive enough to distinguish between the mechanical properties of RBCs during morphological changes from a typical discocyte to echinocytes and spherocytes. Measured values of the tension coefficient and bending modulus are 1.27 × 10-6 J m-2 and 7.09 × 10-2 J for discocytes, 4.80 × 10-6 J m-2 and 7.70 × 10-20 J for echinocytes, and 9.85 × 10-6 J m-2 and 9.69 × 10-20 J for spherocytes, respectively. This quantitative light absorption imaging reduces the complexity related to the quantitative imaging of the biophysical and mechanical properties of a single RBC that may lead to enhanced yet simplified point of care devices for analyzing blood cells.

Advantages of Fresnel biprism-based digital holographic microscopy in quantitative phase imaging

SIGNIFICANCE

The hallmarks of digital holographic microscopy (DHM) compared with other quantitative phase imaging (QPI) methods are high speed, accuracy, spatial resolution, temporal stability, and polarization-sensitivity (PS) capability. The above features make DHM suitable for real-time quantitative PS phase imaging in a broad number of biological applications aimed at understanding cell growth and dynamic changes occurring during physiological processes and/or in response to pharmaceutical agents.

AIM

The insertion of a Fresnel biprism (FB) in the image space of a light microscope potentially turns any commercial system into a DHM system enabling QPI with the five desired features in QPI simultaneously: high temporal sensitivity, high speed, high accuracy, high spatial resolution, and PS. To the best of our knowledge, this is the first FB-based DHM system providing these five features all together.

APPROACH

The performance of the proposed system was calibrated with a benchmark phase object. The PS capability has been verified by imaging human U87 glioblastoma cells.

RESULTS

The proposed FB-based DHM system provides accurate phase images with high spatial resolution. The temporal stability of our system is in the order of a few nanometers, enabling live-cell studies. Finally, the distinctive behavior of the cells at different polarization angles (e.g., PS capability) can be observed with our system.

CONCLUSIONS

We have presented a method to turn any commercial light microscope with monochromatic illumination into a PS QPI system. The proposed system provides accurate quantitative PS phase images in a new, simple, compact, and cost-effective format, thanks to the low cost (a few hundred dollars) involved in implementing this simple architecture, enabling the use of this QPI technique accessible to most laboratories with standard light microscopes.

Deep learning-based cell identification and disease diagnosis using spatio-temporal cellular dynamics in compact digital holographic microscopy

We demonstrate a successful deep learning strategy for cell identification and disease diagnosis using spatio-temporal cell information recorded by a digital holographic microscopy system. Shearing digital holographic microscopy is employed using a low-cost, compact, field-portable and 3D-printed microscopy system to record video-rate data of live biological cells with nanometer sensitivity in terms of axial membrane fluctuations, then features are extracted from the reconstructed phase profiles of segmented cells at each time instance for classification. The time-varying data of each extracted feature is input into a recurrent bi-directional long short-term memory (Bi-LSTM) network which learns to classify cells based on their time-varying behavior. Our approach is presented for cell identification between the morphologically similar cases of cow and horse red blood cells. Furthermore, the proposed deep learning strategy is demonstrated as having improved performance over conventional machine learning approaches on a clinically relevant dataset of human red blood cells from healthy individuals and those with sickle cell disease. The results are presented at both the cell and patient levels. To the best of our knowledge, this is the first report of deep learning for spatio-temporal-based cell identification and disease detection using a digital holographic microscopy system.

Common-path phase-shift microscope based on measurement of Stokes parameters S2 and S3 for 3D phase extraction

In this paper, we report a common-path, phase-shift optical microscope based on measurement of Stokes parameters S₂ and S₃ to extract the three-dimensional (3D) phase map of transparent objects with high precision. The microscope employs three polarizers and two identical quarter-wave plates to extract S₂ and S₃. The reference phase in the absence of the object is subtracted from the total phase in the presence of the object to extract the 3D phase of the object. The microscope is tested on imaging a USAF resolution test target and a reticle test pattern with excellent results. To the best of our knowledge, this is the first report of a common-path phase-shift optical microscope for 3D phase extraction based on measurement of Stokes parameters S₂ and S₃.

Quantitative phase imaging by wide-field interferometry with variable shearing distance uncoupled from the off-axis angle

We introduce a new shearing interferometry module for digital holographic microscopy, in which the off-axis angle, which defines the interference fringe frequency, is not coupled to the shearing distance, as is the case in most shearing interferometers. Thus, it enables the selection of shearing distance based on the spatial density of the sample, without losing spatial frequency content due to overlapping of the complex wave fronts in the spatial frequency domain. Our module is based on a 4f imaging unit and a diffraction grating, in which the hologram is generated from two mutually coherent, partially overlapping sample beams, with adjustable shearing distance, as defined by the position of the grating, but with a constant off-axis angle, as defined by the grating period. The module is simple, easy to align, and presents a nearly common-path geometry. By placing this module as an add-on unit at the exit port of an inverted microscope, quantitative phase imaging can easily be performed. The system is characterized by a 2.5 nm temporal stability and a 3.4 nm spatial stability, without using anti-vibration techniques. We provide quantitative phase imaging experiments of silica beads with different shearing distances, red blood cell fluctuations, and cancer cells flowing in a micro-channel, which demonstrate the capability and versatility of our approach in different imaging scenarios.

Emerging point-of-care technologies for sickle cell disease diagnostics

Sickle cell disease (SCD) is a serious and life-threatening disorder. SCD is considered a public health issue affecting 25% of the population in Central and West Africa. Some countries in this region lack the necessary resources to treat and diagnose many diseases including SCD. Current methods for screening SCD are time-consuming and require expensive laboratory equipment and facilities. This leads to an inability to diagnose the disease early. Lack of early diagnosis and treatment can lead to childhood death. The number of childhood deaths is significantly higher in developing countries. There is unmet need to develop novel methods for diagnosing and monitoring SCD that are both cost effective and portable. The point-of-care (POC) platforms provide the cost effectiveness and portability that allows for the potential diagnosis of millions of people in countries with few resources. In this review, we summarized the important features, benefits, limitations and potential of POC devices. We conducted a comprehensive literature analysis to compare the sensitivity and specificity of several POC diagnostics developed for SCD with a focus on their usages in resource limited settings.

Quantitative analysis of three-dimensional morphology and membrane dynamics of red blood cells during temperature elevation

The optimal functionality of red blood cells is closely associated with the surrounding environment. This study was undertaken to analyze the changes in membrane profile, mean corpuscular hemoglobin (MCH), and cell membrane fluctuations (CMF) of healthy red blood cells (RBC) at varying temperatures. The temperature was elevated from 17 °C to 41 °C within a duration of less than one hour, and the holograms were recorded by an off-axis configuration. After hologram reconstruction, we extracted single RBCs and evaluated their morphologically related features (projected surface area and sphericity coefficient), MCH, and CMF. We observed that elevating the temperature results in changes in the three-dimensional (3D) profile. Since CMF amplitude is highly correlated to the bending curvature of RBC membrane, temperature-induced shape changes can alter CMF’s map and amplitude; mainly larger fluctuations appear on dimple area at a higher temperature. Regardless of the shape changes, no alterations in MCH were seen with temperature variation.

An optical study of drug resistance detection in endometrial cancer cells by dynamic and quantitative phase imaging

Platinum chemosensitivity detection plays a vital role during endometrial cancer treatment because chemotherapy responses have profound influences on patient's prognosis. Although several methods can be used to detect drug resistance characteristics, studies on detecting drug sensitivity based on dynamic and quantitative phase imaging of cancer cells are rare. In this study, digital holographic microscopy was applied to distinguish drug-resistant and nondrug-resistant endometrial cancer cells. Based on the reconstructed phase images, temporal evolutions of cell height (CH), cell projected area (CPA) and cell volume were quantitatively measured. The results show that change rates of CH and CPA were significantly different between drug-resistant and nondrug-resistant endometrial cancer cells. Furthermore, the results demonstrate that morphological characteristics have the potential to be utilized to distinguish the drug sensitivity of endometrial cancer cells, and it may provide new perspectives to establish optical methods to detect drug sensitivity and guide chemotherapy in endometrial cancer.

Structured illumination in compact and field-portable 3D-printed shearing digital holographic microscopy for resolution enhancement

A compact and field-portable three-dimensional (3D)-printed structured illumination (SI) digital holographic microscope based on shearing geometry is presented. By illuminating the sample using a SI pattern, the lateral resolution in both reconstructed phase and amplitude images can be improved up to twice the resolution provided by conventional illumination. The use of a 3D-printed system and shearing geometry reduces the complexity of the system, while providing high temporal stability. The experimental results for the USAF resolution target show a resolution improvement of a factor of two which corroborates the theoretical prediction. Resolution enhancement in phase imaging is also demonstrated by imaging a biological sample. To the best of our knowledge, this is the first report of a compact and field-portable SI digital holographic system based on shearing geometry.

PhaseStain: the digital staining of label-free quantitative phase microscopy images using deep learning

Using a deep neural network, we demonstrate a digital staining technique, which we term PhaseStain, to transform the quantitative phase images (QPI) of label-free tissue sections into images that are equivalent to the brightfield microscopy images of the same samples that are histologically stained. Through pairs of image data (QPI and the corresponding brightfield images, acquired after staining), we train a generative adversarial network and demonstrate the effectiveness of this virtual-staining approach using sections of human skin, kidney, and liver tissue, matching the brightfield microscopy images of the same samples stained with Hematoxylin and Eosin, Jones' stain, and Masson's trichrome stain, respectively. This digital-staining framework may further strengthen various uses of label-free QPI techniques in pathology applications and biomedical research in general, by eliminating the need for histological staining, reducing sample preparation related costs and saving time. Our results provide a powerful example of some of the unique opportunities created by data-driven image transformations enabled by deep learning.

Advances in Optical Sensing and Bioanalysis Enabled by 3D Printing

The recent explosion of 3D printing applications in scientific literature has expanded the speed and effectiveness of analytical technological development. 3D printing allows for manufacture that is simply designed in software and printed in-house with nearly no constraints on geometry, and analytical methodologies can thus be prototyped and optimized with little difficulty. The versatility of methods and materials available allows the analytical chemist or biologist to fine-tune both the structural and functional portions of their apparatus. This flexibility has more recently been extended to optical-based bioanalysis, with higher resolution techniques and new printing materials opening the door for a wider variety of optical components, plasmonic surfaces, optical interfaces, and biomimetic systems that can be made in the laboratory. There have been discussions and reviews of various aspects of 3D printing technologies in analytical chemistry; this Review highlights recent literature and trends in their applications to optical sensing and bioanalysis.

Label-Free Digital Holo-tomographic Microscopy Reveals Virus-Induced Cytopathic Effects in Live Cells

This study introduces label-free digital holo-tomographic microscopy (DHTM) and refractive index gradient (RIG) measurements of live, virus-infected cells. We use DHTM to describe virus type-specific cytopathic effects, including cyclic volume changes of vaccinia virus infections, and cytoplasmic condensations in herpesvirus and rhinovirus infections, distinct from apoptotic cells. This work shows for the first time that DHTM is suitable to observe virus-infected cells and distinguishes virus type-specific signatures under noninvasive conditions. It provides a basis for future studies, where correlative fluorescence microscopy of cell and virus structures annotate distinct RIG values derived from DHTM.

Cytopathic effects (CPEs) are a hallmark of infections. CPEs are difficult to observe due to phototoxicity from classical light microscopy. We report distinct patterns of virus infections in live cells using digital holo-tomographic microscopy (DHTM). DHTM is label-free and records the phase shift of low-energy light passing through the specimen on a transparent surface with minimal perturbation. DHTM measures the refractive index (RI) and computes the refractive index gradient (RIG), unveiling optical heterogeneity in cells. We find that vaccinia virus (VACV), herpes simplex virus (HSV), and rhinovirus (RV) infections progressively and distinctly increased RIG. VACV infection, but not HSV and RV infections, induced oscillations of cell volume, while all three viruses altered cytoplasmic membrane dynamics and induced apoptotic features akin to those caused by the chemical compound staurosporine. In sum, we introduce DHTM for quantitative label-free microscopy in infection research and uncover virus type-specific changes and CPE in living cells with minimal interference.

IMPORTANCE This study introduces label-free digital holo-tomographic microscopy (DHTM) and refractive index gradient (RIG) measurements of live, virus-infected cells. We use DHTM to describe virus type-specific cytopathic effects, including cyclic volume changes of vaccinia virus infections, and cytoplasmic condensations in herpesvirus and rhinovirus infections, distinct from apoptotic cells. This work shows for the first time that DHTM is suitable to observe virus-infected cells and distinguishes virus type-specific signatures under noninvasive conditions. It provides a basis for future studies, where correlative fluorescence microscopy of cell and virus structures annotate distinct RIG values derived from DHTM.