Deep learning-based cell identification and disease diagnosis using spatio-temporal cellular dynamics in compact digital holographic microscopy

Uncovering Astrocyte Morphological Dynamics Using Optical Diffraction Tomography and Shape-Based Trajectory Inference

Astrocytes, integral components of the central nervous system, are increasingly recognized for their multifaceted roles beyond support cells. Despite their acknowledged importance, understanding the intricacies of astrocyte morphological dynamics remains limited. Our study marks the first exploration of astrocytes using optical diffraction tomography (ODT), establishing a label-free, quantitative method to observe morphological changes in astrocytes over a 7-day in-vitro period. ODT offers quantitative insights into cell volume, dry mass, and area through label-free, real-time measurements-capabilities that are challenging to achieve with conventional imaging techniques. Through comprehensive analysis of 3D refractive index maps and shape characterization techniques, we capture the developmental trajectory and dynamic morphological transformations of astrocytes. Specifically, our observations reveal increased area and a transition to larger, flattened shapes, with alterations in cell volume and density, indicating shifts in cellular composition. By employing unsupervised clustering and pseudotime trajectory analysis, we introduce a novel morphological trajectory inference for neural cells, tracking the morphological evolution of astrocytes from elongated to evenly spread shapes. This analysis marks the first use of trajectory inference based solely on morphology for neural cell types, laying a foundation for future studies employing ODT to examine astrocyte dynamics and neural cell interactions across diverse substrates.

Automated fast label-free quantification of cardiomyocyte dynamics with raw holograms for cardiotoxicity screening

Traditional cell analysis approaches based on quantitative phase imaging (QPI) necessitate a reconstruction stage, which utilizes digital holography. However, phase retrieval processing can be complicated and time-consuming since it needs numerical reconstruction and then phase unwrapping. For analysis of cardiomyocyte (CM) dynamics, it was reported that by estimating the spatial variance of the optical path difference from QPI, the spatial displacement of CMs can be quantified, thereby enabling monitoring of the excitation-contraction activity of CMs. Also, it was reported that the Farnebäck optical flow method could be combined with the holographic imaging information from QPI to characterize the contractile motion of single CMs, enabling monitoring of the mechanical beating activity of CMs for cardiotoxicity screening. However, no studies have analyzed the contractile dynamics of CMs based on raw holograms. In this paper, we present a fast, label-free, and high throughput method for contractile dynamic analysis of human-induced pluripotent stem cell-derived CMs using raw holograms or the filtered holograms, which are obtained by filtering only The proposed approach obviates the need for time-consuming numerical reconstruction and phase unwrapping for CM's dynamic analysis while still having performance comparable to that of the previous methods. Accordingly, we developed a computational algorithm to characterize the CM's functional behaviors from contractile motion waveform obtained from raw or filtered holograms, which allows the calculation of various temporal metrics related to beating activity from contraction-relaxation motion-speed profile. To the best of our knowledge, this approach is the first to analyze drug-treated CM's dynamics from raw or filtered holograms without the need for numerical phase image reconstruction. For one hologram, the reconstruction process itself in the existing methods takes at least three times longer than the process of tracking the contraction-relaxation motion-speed profile using optical flow in the proposed method. Furthermore, our proposed methodology was validated in the toxicity screening of two drugs (E-4031 and isoprenaline) with various concentrations. The findings provide information on CM contractile motion and kinetics for cardiotoxicity screening.

A novel approach in cancer diagnosis: integrating holography microscopic medical imaging and deep learning techniques-challenges and future trends

Medical imaging is pivotal in early disease diagnosis, providing essential insights that enable timely and accurate detection of health anomalies. Traditional imaging techniques, such as Magnetic Resonance Imaging (MRI), Computer Tomography (CT), ultrasound, and Positron Emission Tomography (PET), offer vital insights into three-dimensional structures but frequently fall short of delivering a comprehensive and detailed anatomical analysis, capturing only amplitude details. Three-dimensional holography microscopic medical imaging provides a promising solution by capturing the amplitude (brightness) and phase (structural information) details of biological structures. In this study, we investigate the novel collaborative potential of Deep Learning (DL) and holography microscopic phase imaging for cancer diagnosis. The study comprehensively examines existing literature, analyzes advancements, identifies research gaps, and proposes future research directions in cancer diagnosis through the integrated Quantitative Phase Imaging (QPI) and DL methodology. This novel approach addresses a critical limitation of traditional imaging by capturing detailed structural information, paving the way for more accurate diagnostics. The proposed approach comprises tissue sample collection, holographic image scanning, preprocessing in case of imbalanced datasets, and training on annotated datasets using DL architectures like U-Net and Vision Transformer(ViT's). Furthermore, sophisticated concepts in DL, like the incorporation of Explainable AI (XAI) techniques, are suggested for comprehensive disease diagnosis and identification. The study thoroughly investigates the advantages of integrating holography imaging and DL for precise cancer diagnosis. Additionally, meticulous insights are presented by identifying the challenges associated with this integration methodology.

Quantitative phase image stitching guided by reconstructed intensity images in one-shot double field of view multiplexed digital holographic microscopy

In digital holographic microscopy (DHM), achieving large field of view (FOV) imaging while maintaining high resolution is critical for quantitative phase measurements of biological cell tissues and micro-nano structures. We present a quantitative phase image stitching guided by reconstructed intensity images in one-shot double FOV multiplexed DHM. Double FOVs are recorded simultaneously through frequency division multiplexing; intensity feature pairs are accurately extracted by multi-algorithm fusion; aberrations and non-common baselines are effectively corrected by preprocessing. Experimental results show that even if phase images have coherent noise, complex aberrations, low overlap rate and large size, this method can achieve high-quality phase stitching.

Quantitative phase imaging techniques for measuring scattering properties of cells and tissues: a review-part I

Significance

Quantitative phase imaging (QPI) techniques offer intrinsic information about the sample of interest in a label-free, noninvasive manner and have an enormous potential for wide biomedical applications with negligible perturbations to the natural state of the sample in vitro.

Aim

We aim to present an in-depth review of the scattering formulation of light-matter interactions as applied to biological samples such as cells and tissues, discuss the relevant quantitative phase measurement techniques, and present a summary of various reported applications.

Approach

We start with scattering theory and scattering properties of biological samples followed by an exploration of various microscopy configurations for 2D QPI for measurement of structure and dynamics.

Results

We reviewed 157 publications and presented a range of QPI techniques and discussed suitable applications for each. We also presented the theoretical frameworks for phase reconstruction associated with the discussed techniques and highlighted their domains of validity.

Conclusions

We provide detailed theoretical as well as system-level information for a wide range of QPI techniques. Our study can serve as a guideline for new researchers looking for an exhaustive literature review of QPI methods and relevant applications.

Grading of glioma tumors using digital holographic microscopy

Gliomas are the most common type of cerebral tumors; they occur with increasing incidence in the last decade and have a high rate of mortality. For efficient treatment, fast accurate diagnostic and grading of tumors are imperative. Presently, the grading of tumors is established by histopathological evaluation, which is a time-consuming procedure and relies on the pathologists' experience. Here we propose a supervised machine learning procedure for tumor grading which uses quantitative phase images of unstained tissue samples acquired by digital holographic microscopy. The algorithm is using an extensive set of statistical and texture parameters computed from these images. The procedure has been able to classify six classes of images (normal tissue and five glioma subtypes) and to distinguish between gliomas types from grades II to IV (with the highest sensitivity and specificity for grade II astrocytoma and grade III oligodendroglioma and very good scores in recognizing grade III anaplastic astrocytoma and grade IV glioblastoma). The procedure bolsters clinical diagnostic accuracy, offering a swift and reliable means of tumor characterization and grading, ultimately the enhancing treatment decision-making process.

Deep learning-assisted smartphone-based quantitative microscopy for label-free peripheral blood smear analysis

Hematologists evaluate alterations in blood cell enumeration and morphology to confirm peripheral blood smear findings through manual microscopic examination. However, routine peripheral blood smear analysis is both time-consuming and labor-intensive. Here, we propose using smartphone-based autofluorescence microscopy (Smart-AM) for imaging label-free blood smears at subcellular resolution with automatic hematological analysis. Smart-AM enables rapid and label-free visualization of morphological features of normal and abnormal blood cells (including leukocytes, erythrocytes, and thrombocytes). Moreover, assisted with deep-learning algorithms, this technique can automatically detect and classify different leukocytes with high accuracy, and transform the autofluorescence images into virtual Giemsa-stained images which show clear cellular features. The proposed technique is portable, cost-effective, and user-friendly, making it significant for broad point-of-care applications.

Classification of chemically modified red blood cells in microflow using machine learning video analysis

We classify native and chemically modified red blood cells with an AI based video classifier. Using TensorFlow video analysis enables us to capture not only the morphology of the cell but also the trajectories of motion of individual red blood cells and their dynamics. We chemically modify cells in three different ways to model different pathological conditions and obtain classification accuracies for all three classification tasks of more than 90% between native and modified cells. Unlike standard cytometers that are based on immunophenotyping our microfluidic cytometer allows to rapidly categorize cells without any fluorescence labels simply by analysing the shape and flow of red blood cells.

A dataset of digital holograms of normal and thalassemic cells

Digital holographic microscopy (DHM) is an intriguing medical diagnostic tool due to its label-free and quantitative nature, providing high-contrast images of phase samples. By capturing both intensity and phase information, DHM enables the numerical reconstruction of quantitative phase images. However, the lateral resolution is limited by the diffraction limit, which prompted the recent suggestion of microsphere-assisted DHM to enhance the DHM resolution straightforwardly. The use of such a technique as a medical diagnostic tool requires testing and validation of the proposed assays to prove their feasibility and viability. This paper publishes 760 and 609 microsphere-assisted DHM images of normal and thalassemic red blood cells obtained from a normal and thalassemic male individual, respectively.

On the use of deep learning for phase recovery

Phase recovery (PR) refers to calculating the phase of the light field from its intensity measurements. As exemplified from quantitative phase imaging and coherent diffraction imaging to adaptive optics, PR is essential for reconstructing the refractive index distribution or topography of an object and correcting the aberration of an imaging system. In recent years, deep learning (DL), often implemented through deep neural networks, has provided unprecedented support for computational imaging, leading to more efficient solutions for various PR problems. In this review, we first briefly introduce conventional methods for PR. Then, we review how DL provides support for PR from the following three stages, namely, pre-processing, in-processing, and post-processing. We also review how DL is used in phase image processing. Finally, we summarize the work in DL for PR and provide an outlook on how to better use DL to improve the reliability and efficiency of PR. Furthermore, we present a live-updating resource ( https://github.com/kqwang/phase-recovery ) for readers to learn more about PR.

Artificial intelligence-enabled quantitative phase imaging methods for life sciences

Quantitative phase imaging, integrated with artificial intelligence, allows for the rapid and label-free investigation of the physiology and pathology of biological systems. This review presents the principles of various two-dimensional and three-dimensional label-free phase imaging techniques that exploit refractive index as an intrinsic optical imaging contrast. In particular, we discuss artificial intelligence-based analysis methodologies for biomedical studies including image enhancement, segmentation of cellular or subcellular structures, classification of types of biological samples and image translation to furnish subcellular and histochemical information from label-free phase images. We also discuss the advantages and challenges of artificial intelligence-enabled quantitative phase imaging analyses, summarize recent notable applications in the life sciences, and cover the potential of this field for basic and industrial research in the life sciences.

Photolithographic patterning on multi-wavelength quantum dot film of the improved conversion efficiency for digital holography

A triple-wavelength patterned quantum dot film was fabricated for the light source of digital holography to improve both the axial measurement range and noise reduction. The patterned quantum dot film was fabricated after optimizing the photolithography process condition based on the UV-curable quantum dot solution, which was capable of multiple patterning processes. In addition, an optimized pattern structure was developed by adding TiO2 nanoparticles to both the quantum dot and bank layers to increase the scattering effect for the improved photoluminescence intensity. Finally, the newly developed light source with the balanced spectral distribution was applied to the digital holography, rendering it applicable as an improved light source.

Rapid and stain-free quantification of viral plaque via lens-free holography and deep learning

A plaque assay-the gold-standard method for measuring the concentration of replication-competent lytic virions-requires staining and usually more than 48 h of runtime. Here we show that lens-free holographic imaging and deep learning can be combined to expedite and automate the assay. The compact imaging device captures phase information label-free at a rate of approximately 0.32 gigapixels per hour per well, covers an area of about 30 × 30 mm2 and a 10-fold larger dynamic range of virus concentration than standard assays, and quantifies the infected area and the number of plaque-forming units. For the vesicular stomatitis virus, the automated plaque assay detected the first cell-lysing events caused by viral replication as early as 5 h after incubation, and in less than 20 h it detected plaque-forming units at rates higher than 90% at 100% specificity. Furthermore, it reduced the incubation time of the herpes simplex virus type 1 by about 48 h and that of the encephalomyocarditis virus by about 20 h. The stain-free assay should be amenable for use in virology research, vaccine development and clinical diagnosis.

Synchronous Phase-Shifting Interference for High Precision Phase Imaging of Objects Using Common Optics

Quantitative phase imaging and measurement of surface topography and fluid dynamics for objects, especially for moving objects, is critical in various fields. Although effective, existing synchronous phase-shifting methods may introduce additional phase changes in the light field due to differences in optical paths or need specific optics to implement synchronous phase-shifting, such as the beamsplitter with additional anti-reflective coating and a micro-polarizer array. Therefore, we propose a synchronous phase-shifting method based on the Mach-Zehnder interferometer to tackle these issues in existing methods. The proposed method uses common optics to simultaneously acquire four phase-shifted digital holograms with equal optical paths for object and reference waves. Therefore, it can be used to reconstruct the phase distribution of static and dynamic objects with high precision and high resolution. In the experiment, the theoretical resolution of the proposed system was 1.064 µm while the actual resolution could achieve 1.381 µm, which was confirmed by measuring a phase-only resolution chart. Besides, the dynamic phase imaging of a moving standard object was completed to verify the proposed system's effectiveness. The experimental results show that our proposed method is suitable and promising in dynamic phase imaging and measurement of moving objects using phase-shifting digital holography.

Algal cell viability assessment: The role of environmental factors in phytoplankton population dynamics

The viability of algal cells is one of the most fundamental issues in marine ecological research. In this work, a method was designed to identify algal cell viability based on digital holography and deep learning, which divided algal cells into three categories: active, weak, and dead cells. This method was applied to measure algal cells in surface waters of the East China Sea in spring, revealing about 4.34 %-23.29 % weak cells and 3.98 %-19.47 % dead cells. Levels of nitrate and chlorophyll a were the main factors affecting the viability of algal cells. Furthermore, algal viability changes during the heating and cooling were observed in laboratory experiments: high temperatures led to an increase in weak algal cells. This may provide an explanation for why most harmful algal blooms occur in warming months. This study provided a novel insight into how to identify the viability of algal cells and understand their significance in the ocean.

Semi-Supervised Deep Learning for Cell Type Identification From Single-Cell Transcriptomic Data

Cell type identification from single-cell transcriptomic data is a common goal of single-cell RNA sequencing (scRNAseq) data analysis. Deep neural networks have been employed to identify cell types from scRNAseq data with high performance. However, it requires a large mount of individual cells with accurate and unbiased annotated types to train the identification models. Unfortunately, labeling the scRNAseq data is cumbersome and time-consuming as it involves manual inspection of marker genes. To overcome this challenge, we propose a semi-supervised learning model "SemiRNet" to use unlabeled scRNAseq cells and a limited amount of labeled scRNAseq cells to implement cell identification. The proposed model is based on recurrent convolutional neural networks (RCNN), which includes a shared network, a supervised network and an unsupervised network. The proposed model is evaluated on two large scale single-cell transcriptomic datasets. It is observed that the proposed model is able to achieve encouraging performance by learning on the very limited amount of labeled scRNAseq cells together with a large number of unlabeled scRNAseq cells.

Multi-Illumination Single-Holographic-Exposure Lensless Fresnel (MISHELF) Microscopy: Principles and Biomedical Applications

Lensless holographic microscopy (LHM) comes out as a promising label-free technique since it supplies high-quality imaging and adaptive magnification in a lens-free, compact and cost-effective way. Compact sizes and reduced prices of LHMs make them a perfect instrument for point-of-care diagnosis and increase their usability in limited-resource laboratories, remote areas, and poor countries. LHM can provide excellent intensity and phase imaging when the twin image is removed. In that sense, multi-illumination single-holographic-exposure lensless Fresnel (MISHELF) microscopy appears as a single-shot and phase-retrieved imaging technique employing multiple illumination/detection channels and a fast-iterative phase-retrieval algorithm. In this contribution, we review MISHELF microscopy through the description of the principles, the analysis of the performance, the presentation of the microscope prototypes and the inclusion of the main biomedical applications reported so far.

SHAPR predicts 3D cell shapes from 2D microscopic images

Reconstruction of shapes and sizes of three-dimensional (3D) objects from two- dimensional (2D) information is an intensely studied subject in computer vision. We here consider the level of single cells and nuclei and present a neural network-based SHApe PRediction autoencoder. For proof-of-concept, SHAPR reconstructs 3D shapes of red blood cells from single view 2D confocal microscopy images more accurately than naïve stereological models and significantly increases the feature-based prediction of red blood cell types from F1 = 79% to F1 = 87.4%. Applied to 2D images containing spheroidal aggregates of densely grown human induced pluripotent stem cells, we find that SHAPR learns fundamental shape properties of cell nuclei and allows for prediction-based morphometry. Reducing imaging time and data storage, SHAPR will help to optimize and up-scale image-based high-throughput applications for biomedicine.

White blood cell classification via a discriminative region detection assisted feature aggregation network

White blood cell (WBC) classification plays an important role in human pathological diagnosis since WBCs will show different appearance when they fight with various disease pathogens. Although many previous white blood cell classification have been proposed and earned great success, their classification accuracy is still significantly affected by some practical issues such as uneven staining, boundary blur and nuclear intra-class variability. In this paper, we propose a deep neural network for WBC classification via discriminative region detection assisted feature aggregation (DRFA-Net), which can accurately locate the WBC area to boost final classification performance. Specifically, DRFA-Net uses an adaptive feature enhancement module to refine multi-level deep features in a bilateral manner for efficiently capturing both high-level semantic information and low-level details of WBC images. Considering the fact that background areas could inevitably produce interference, we design a network branch to detect the WBC area with the supervision of segmented ground truth. The bilaterally refined features obtained from two directions are finally aggregated for final classification, and the detected WBC area is utilized to highlight the features of discriminative regions by an attention mechanism. Extensive experiments on several public datasets are conducted to validate that our proposed DRFA-Net can obtain higher accuracies when compared with other state-of-the-art WBC classification methods.

COVID-19 screening with digital holographic microscopy using intra-patient probability functions of spatio-temporal bio-optical attributes

We present an automated method for COVID-19 screening using the intra-patient population distributions of bio-optical attributes extracted from digital holographic microscopy reconstructed red blood cells. Whereas previous approaches have aimed to identify infection by classifying individual cells, here, we propose an approach to incorporate the attribute distribution information from the population of a given human subjects' cells into our classification scheme and directly classify subjects at the patient level. To capture the intra-patient distribution information in a generalized way, we propose an approach based on the Bag-of-Features (BoF) methodology to transform histograms of bio-optical attribute distributions into feature vectors for classification via a linear support vector machine. We compare our approach with simpler classifiers directly using summary statistics such as mean, standard deviation, skewness, and kurtosis of the distributions. We also compare to a k-nearest neighbor classifier using the Kolmogorov-Smirnov distance as a distance metric between the attribute distributions of each subject. We lastly compare our approach to previously published methods for classification of individual red blood cells. In each case, the methodology proposed in this paper provides the highest patient classification performance, correctly classifying 22 out of 24 individuals and achieving 91.67% classification accuracy with 90.00% sensitivity and 92.86% specificity. The incorporation of distribution information for classification additionally led to the identification of a singular temporal-based bio-optical attribute capable of highly accurate patient classification. To the best of our knowledge, this is the first report of a machine learning approach using the intra-patient probability distribution information of bio-optical attributes obtained from digital holographic microscopy for disease screening.

Developing a Reliable Holographic Flow Cyto-Tomography Apparatus by Optimizing the Experimental Layout and Computational Processing

Digital Holographic Tomography (DHT) has recently been established as a means of retrieving the 3D refractive index mapping of single cells. To make DHT a viable system, it is necessary to develop a reliable and robust holographic apparatus in order that such technology can be utilized outside of specialized optics laboratories and operated in the in-flow modality. In this paper, we propose a quasi-common-path lateral-shearing holographic optical set-up to be used, for the first time, for DHT in a flow-cytometer modality. The proposed solution is able to withstand environmental vibrations that can severely affect the interference process. Furthermore, we have scaled down the system while ensuring that a full 360° rotation of the cells occurs in the field-of-view, in order to retrieve 3D phase-contrast tomograms of single cells flowing along a microfluidic channel. This was achieved by setting the camera sensor at 45° with respect to the microfluidic direction. Additional optimizations were made to the computational elements to ensure the reliable retrieval of 3D refractive index distributions by demonstrating an effective method of tomographic reconstruction, based on high-order total variation. The results were first demonstrated using realistic 3D numerical phantom cells to assess the performance of the proposed high-order total variation method in comparison with the gold-standard algorithm for tomographic reconstructions: namely, filtered back projection. Then, the proposed DHT system and the processing pipeline were experimentally validated for monocytes and mouse embryonic fibroblast NIH-3T3 cells lines. Moreover, the repeatability of these tomographic measurements was also investigated by recording the same cell multiple times and quantifying the ability to provide reliable and comparable tomographic reconstructions, as confirmed by a correlation coefficient greater than 95%. The reported results represent various steps forward in several key aspects of in-flow DHT, thus paving the way for its use in real-world applications.

Detection of intralayer alignment in multicomponent lipids by dynamic speckle pattern analysis

Multicomponent mixtures of bilayer lipids, thanks to the coexistence of liquid-crystalline phases in their structures, may be used in the development of functional membranes. In such membranes interlayer ordering distributes across membrane lamellae, resulting in long-range alignment of phase-separated domains. In this paper, we explore the dynamics of this phenomenon by laser speckle pattern analysis. We show that cholesterol content decreases the activity, and the rate of the domains size development is related to the change of physical roughness of the multicomponent lipid mixture. Our results are in agreement with the previous experimental reports. However, our experimental procedure is an easy-to-implement and effective methodology.

Automated wide-field malaria parasite infection detection using Fourier ptychography on stain-free thin-smears

Diagnosis of malaria in endemic areas is hampered by the lack of a rapid, stain-free and sensitive method to directly identify parasites in peripheral blood. Herein, we report the use of Fourier ptychography to generate wide-field high-resolution quantitative phase images of erythrocytes infected with malaria parasites, from a whole blood sample. We are able to image thousands of erythrocytes (red blood cells) in a single field of view and make a determination of infection status of the quantitative phase image of each segmented cell based on machine learning (random forest) and deep learning (VGG16) models. Our random forest model makes use of morphology and texture based features of the quantitative phase images. In order to label the quantitative images of the cells as either infected or uninfected before training the models, we make use of a Plasmodium berghei strain expressing GFP (green fluorescent protein) in all life cycle stages. By overlaying the fluorescence image with the quantitative phase image we could identify the infected subpopulation of erythrocytes for labelling purposes. Our machine learning model (random forest) achieved 91% specificity and 72% sensitivity while our deep learning model (VGG16) achieved 98% specificity and 57% sensitivity. These results highlight the potential for quantitative phase imaging coupled with artificial intelligence to develop an easy to use platform for the rapid and sensitive diagnosis of malaria.

Differentiation and classification of bacterial endotoxins based on surface enhanced Raman scattering and advanced machine learning

Bacterial endotoxin, a major component of the Gram-negative bacterial outer membrane leaflet, is a lipopolysaccharide shed from bacteria during their growth and infection and can be utilized as a biomarker for bacterial detection. Here, the surface enhanced Raman scattering (SERS) spectra of eleven bacterial endotoxins with an average detection amount of 8.75 pg per measurement have been obtained based on silver nanorod array substrates, and the characteristic SERS peaks have been identified. With appropriate spectral pre-processing procedures, different classical machine learning algorithms, including support vector machine, k-nearest neighbor, random forest, etc., and a modified deep learning algorithm, RamanNet, have been applied to differentiate and classify these endotoxins. It has been found that most conventional machine learning algorithms can attain a differentiation accuracy of >99%, while RamanNet can achieve 100% accuracy. Such an approach has the potential for precise classification of endotoxins and could be used for rapid medical diagnoses and therapeutic decisions for pathogenic infections.

Single-Shot 3D Topography of Transmissive and Reflective Samples with a Dual-Mode Telecentric-Based Digital Holographic Microscope

Common path DHM systems are the most robust DHM systems as they are based on self-interference and are thus less prone to external fluctuations. A common issue amongst these DHM systems is that the two replicas of the sample’s information overlay due to self-interference, making them only suitable for imaging sparse samples. This overlay has restricted the use of common-path DHM systems in material science. The overlay can be overcome by limiting the sample’s field of view to occupy only half of the imaging field of view or by using an optical spatial filter. In this work, we have implemented optical spatial filtering in a common-path DHM system using a Fresnel biprism. We have analyzed the optimal pinhole size by evaluating the frequency content of the reconstructed phase images of a star target. We have also measured the accuracy of the system and the sensitivity to noise for different pinhole sizes. Finally, we have proposed the first dual-mode common-path DHM system using a Fresnel biprism. The performance of the dual-model DHM system has been evaluated experimentally using transmissive and reflective microscopic samples.

Deep learning-based image processing in optical microscopy

Optical microscopy has emerged as a key driver of fundamental research since it provides the ability to probe into imperceptible structures in the biomedical world. For the detailed investigation of samples, a high-resolution image with enhanced contrast and minimal damage is preferred. To achieve this, an automated image analysis method is preferable over manual analysis in terms of both speed of acquisition and reduced error accumulation. In this regard, deep learning (DL)-based image processing can be highly beneficial. The review summarises and critiques the use of DL in image processing for the data collected using various optical microscopic techniques. In tandem with optical microscopy, DL has already found applications in various problems related to image classification and segmentation. It has also performed well in enhancing image resolution in smartphone-based microscopy, which in turn enablse crucial medical assistance in remote places.

Graphical abstract

Method to analyze effects of low-level laser therapy on biological cells with a digital holographic microscope

Low-level laser therapy (LLLT) is a therapeutic tool that uses the photobiochemical interaction between light and tissue. Its effectiveness is controversial due to a strong dependence on dosimetric parameters. In this work, we demonstrate that digital holographic microscopy is an effective label-free imaging technique to analyze the effects of LLLT on biological cells, and we propose the full methodology to create correct synthetic aperture phase maps for further extensive, highly accurate statistical analysis. The proposed methodology has been designed to provide a basis for many other biological experiments using quantitative phase imaging. We use SHSY-5Y and HaCaT cells irradiated with different doses of red light for the experiment. The analysis shows quantitative changes in cell dry mass density and the projected cell surface in response to different radiation doses.

COVID-19 detection from red blood cells using highly comparative time-series analysis (HCTSA) in digital holographic microscopy

We present an automated method for COVID-19 screening based on reconstructed phase profiles of red blood cells (RBCs) and a highly comparative time-series analysis (HCTSA). Video digital holographic data -was obtained using a compact, field-portable shearing microscope to capture the temporal fluctuations and spatio-temporal dynamics of live RBCs. After numerical reconstruction of the digital holographic data, the optical volume is calculated at each timeframe of the reconstructed data to produce a time-series signal for each cell in our dataset. Over 6000 features are extracted on the time-varying optical volume sequences using the HCTSA to quantify the spatio-temporal behavior of the RBCs, then a linear support vector machine is used for classification of individual RBCs. Human subjects are then classified for COVID-19 based on the consensus of their cells' classifications. The proposed method is tested on a dataset of 1472 RBCs from 24 human subjects (10 COVID-19 positive, 14 healthy) collected at UConn Health Center. Following a cross-validation procedure, our system achieves 82.13% accuracy, with 92.72% sensitivity, and 73.21% specificity (area under the receiver operating characteristic curve: 0.8357). Furthermore, the proposed system resulted in 21 out of 24 human subjects correctly labeled. To the best of our knowledge this is the first report of a highly comparative time-series analysis using digital holographic microscopy data.

Automated analysis of human cardiomyocytes dynamics with holographic image-based tracking for cardiotoxicity screening

This paper proposes a new non-invasive, low-cost, and fully automated platform to quantitatively analyze dynamics of human-induced pluripotent stem cell-derived cardiomyocytes (hiPS-CMs) at the single-cell level by holographic image-based tracking for cardiotoxicity screening. A dense Farneback optical flow method and holographic imaging informatics were combined to characterize the contractile motion of a single CM, which obviates the need for costly equipment to monitor a CM's mechanical beat activity. The reliability of the proposed platform was tested by single-cell motion characterization, synchronization analysis, motion speed measurement of fixed CMs versus live CMs, and noise sensitivity. The applicability of the motion characterization method was tested to determine the pharmacological effects of two cardiovascular drugs, isoprenaline (166 nM) and E-4031 (500 μM). The experiments were done using single CMs and multiple cells, and the results were compared to control conditions. Cardiomyocytes responded to isoprenaline by increasing the action potential (AP) speed and shortening the resting period, thus increasing the beat frequency. In the presence of E-4031, the AP speed was decreased, and the resting period was prolonged, thus decreasing the beat frequency. The findings offer insights into single hiPS-CMs' contractile motion and a deep understanding of their kinetics at the single-cell level for cardiotoxicity screening.

Cancer-Cell Deep-Learning Classification by Integrating Quantitative-Phase Spatial and Temporal Fluctuations

We present a new classification approach for live cells, integrating together the spatial and temporal fluctuation maps and the quantitative optical thickness map of the cell, as acquired by common-path quantitative-phase dynamic imaging and processed with a deep-learning framework. We demonstrate this approach by classifying between two types of cancer cell lines of different metastatic potential originating from the same patient. It is based on the fact that both the cancer-cell morphology and its mechanical properties, as indicated by the cell temporal and spatial fluctuations, change over the disease progression. We tested different fusion methods for inputting both the morphological optical thickness maps and the coinciding spatio-temporal fluctuation maps of the cells to the classifying network framework. We show that the proposed integrated triple-path deep-learning architecture improves over deep-learning classification that is based only on the cell morphological evaluation via its quantitative optical thickness map, demonstrating the benefit in the acquisition of the cells over time and in extracting their spatio-temporal fluctuation maps, to be used as an input to the classifying deep neural network.

Deep learning for digital holography: a review

Recent years have witnessed the unprecedented progress of deep learning applications in digital holography (DH). Nevertheless, there remain huge potentials in how deep learning can further improve performance and enable new functionalities for DH. Here, we survey recent developments in various DH applications powered by deep learning algorithms. This article starts with a brief introduction to digital holographic imaging, then summarizes the most relevant deep learning techniques for DH, with discussions on their benefits and challenges. We then present case studies covering a wide range of problems and applications in order to highlight research achievements to date. We provide an outlook of several promising directions to widen the use of deep learning in various DH applications.

Roadmap on digital holography [Invited]

This Roadmap article on digital holography provides an overview of a vast array of research activities in the field of digital holography. The paper consists of a series of 25 sections from the prominent experts in digital holography presenting various aspects of the field on sensing, 3D imaging and displays, virtual and augmented reality, microscopy, cell identification, tomography, label-free live cell imaging, and other applications. Each section represents the vision of its author to describe the significant progress, potential impact, important developments, and challenging issues in the field of digital holography.

Digital holographic deep learning of red blood cells for field-portable, rapid COVID-19 screening

Rapid screening of red blood cells for active infection of COVID-19 is presented using a compact and field-portable, 3D-printed shearing digital holographic microscope. Video holograms of thin blood smears are recorded, individual red blood cells are segmented for feature extraction, then a bi-directional long short-term memory network is used to classify between healthy and COVID positive red blood cells based on their spatiotemporal behavior. Individuals are then classified based on the simple majority of their cells' classifications. The proposed system may be beneficial for under-resourced healthcare systems. To the best of our knowledge, this is the first report of digital holographic microscopy for rapid screening of COVID-19.

Role of pH level on the morphology and growth rate of myelin figures

The myelin figure (MF) is one of the basic structures of lipids, and the study of their formation and the effect of various parameters on their growth is useful in understanding several biological processes. In this paper, we address the influence of the pH degree of the surrounding medium on MF dynamics. We introduce a tunable shearing digital holographic microscopy arrangement to obtain quantitative and volumetric information about the complex growth of MFs. Our results show that (1) the time evolution of relative length and volume changes of MFs follows a power-law, (2) the acidity facilitates the growth rate, and (3) the acidic environment causes the formation of thicker MFs.