Shape tolerant three-dimensional recognition of biological microorganisms using digital holography

Red blood cell classification in lensless single random phase encoding using convolutional neural networks

Rapid cell identification is achieved in a compact and field-portable system employing single random phase encoding to record opto-biological signatures of living biological cells of interest. The lensless, 3D-printed system uses a diffuser to encode the complex amplitude of the sample, then the encoded signal is recorded by a CMOS image sensor for classification. Removal of lenses in this 3D sensing system removes restrictions on the field of view, numerical aperture, and depth of field normally imposed by objective lenses in comparable microscopy systems to enable robust 3D capture of biological volumes. Opto-biological signatures for two classes of animal red blood cells, situated in a microfluidic device, are captured then input into a convolutional neural network for classification, wherein the AlexNet architecture, pretrained on the ImageNet database is used as the deep learning model. Video data was recorded of the opto-biological signatures for multiple samples, then each frame was treated as an input image to the network. The pre-trained network was fine-tuned and evaluated using a dataset of over 36,000 images. The results show improved performance in comparison to a previously studied Random Forest classification model using extracted statistical features from the opto-biological signatures. The system is further compared to and outperforms a similar shearing-based 3D digital holographic microscopy system for cell classification. In addition to improvements in classification performance, the use of convolutional neural networks in this work is further demonstrated to provide improved performance in the presence of noise. Red blood cell identification as presented here, may serve as a key step toward lensless pseudorandom phase encoding applications in rapid disease screening. To the best of our knowledge this is the first report of lensless cell identification in single random phase encoding using convolutional neural networks.

Deep learning-based cell identification and disease diagnosis using spatio-temporal cellular dynamics in compact digital holographic microscopy

We demonstrate a successful deep learning strategy for cell identification and disease diagnosis using spatio-temporal cell information recorded by a digital holographic microscopy system. Shearing digital holographic microscopy is employed using a low-cost, compact, field-portable and 3D-printed microscopy system to record video-rate data of live biological cells with nanometer sensitivity in terms of axial membrane fluctuations, then features are extracted from the reconstructed phase profiles of segmented cells at each time instance for classification. The time-varying data of each extracted feature is input into a recurrent bi-directional long short-term memory (Bi-LSTM) network which learns to classify cells based on their time-varying behavior. Our approach is presented for cell identification between the morphologically similar cases of cow and horse red blood cells. Furthermore, the proposed deep learning strategy is demonstrated as having improved performance over conventional machine learning approaches on a clinically relevant dataset of human red blood cells from healthy individuals and those with sickle cell disease. The results are presented at both the cell and patient levels. To the best of our knowledge, this is the first report of deep learning for spatio-temporal-based cell identification and disease detection using a digital holographic microscopy system.

Sickle cell disease diagnosis based on spatio-temporal cell dynamics analysis using 3D printed shearing digital holographic microscopy

We present a spatio-temporal analysis of cell membrane fluctuations to distinguish healthy patients from patients with sickle cell disease. A video hologram containing either healthy red blood cells (h-RBCs) or sickle cell disease red blood cells (SCD-RBCs) was recorded using a low-cost, compact, 3D printed shearing interferometer. Reconstructions were created for each hologram frame (time steps), forming a spatio-temporal data cube. Features were extracted by computing the standard deviations and the mean of the height fluctuations over time and for every location on the cell membrane, resulting in two-dimensional standard deviation and mean maps, followed by taking the standard deviations of these maps. The optical flow algorithm was used to estimate the apparent motion fields between subsequent frames (reconstructions). The standard deviation of the magnitude of the optical flow vectors across all frames was then computed. In addition, seven morphological cell (spatial) features based on optical path length were extracted from the cells to further improve the classification accuracy. A random forest classifier was trained to perform cell identification to distinguish between SCD-RBCs and h-RBCs. To the best of our knowledge, this is the first report of machine learning assisted cell identification and diagnosis of sickle cell disease based on cell membrane fluctuations and morphology using both spatio-temporal and spatial analysis.

Compact and field-portable 3D printed shearing digital holographic microscope for automated cell identification

We propose a low-cost, compact, and field-portable 3D printed holographic microscope for automated cell identification based on a common path shearing interferometer setup. Once a hologram is captured from the portable setup, a 3D reconstructed height profile of the cell is created. We extract several morphological cell features from the reconstructed 3D height profiles, including mean physical cell thickness, coefficient of variation, optical volume (OV) of the cell, projected area of the cell (PA), ratio of PA to OV, cell thickness kurtosis, cell thickness skewness, and the dry mass of the cell for identification using the random forest (RF) classifier. The 3D printed prototype can serve as a low-cost alternative for the developing world, where access to laboratory facilities for disease diagnosis are limited. Additionally, a cell phone sensor is used to capture the digital holograms. This enables the user to send the acquired holograms over the internet to a computational device located remotely for cellular identification and classification (analysis). The 3D printed system presented in this paper can be used as a low-cost, stable, and field-portable digital holographic microscope as well as an automated cell identification system. To the best of our knowledge, this is the first research paper presenting automatic cell identification using a low-cost 3D printed digital holographic microscopy setup based on common path shearing interferometry.

Cell morphology-based classification of red blood cells using holographic imaging informatics

We present methods that automatically select a linear or nonlinear classifier for red blood cell (RBC) classification by analyzing the equality of the covariance matrices in Gabor-filtered holographic images. First, the phase images of the RBCs are numerically reconstructed from their holograms, which are recorded using off-axis digital holographic microscopy (DHM). Second, each RBC is segmented using a marker-controlled watershed transform algorithm and the inner part of the RBC is identified and analyzed. Third, the Gabor wavelet transform is applied to the segmented cells to extract a series of features, which then undergo a multivariate statistical test to evaluate the equality of the covariance matrices of the different shapes of the RBCs using selected features. When these covariance matrices are not equal, a nonlinear classification scheme based on quadratic functions is applied; otherwise, a linear classification is applied. We used the stomatocyte, discocyte, and echinocyte RBC for classifier training and testing. Simulation results demonstrated that 10 of the 14 RBC features are useful in RBC classification. Experimental results also revealed that the covariance matrices of the three main RBC groups are not equal and that a nonlinear classification method has a much lower misclassification rate. The proposed automated RBC classification method has the potential for use in drug testing and the diagnosis of RBC-related diseases.

Label-free identification of individual bacteria using Fourier transform light scattering

Rapid identification of bacterial species is crucial in medicine and food hygiene. In order to achieve rapid and label-free identification of bacterial species at the single bacterium level, we propose and experimentally demonstrate an optical method based on Fourier transform light scattering (FTLS) measurements and statistical classification. For individual rod-shaped bacteria belonging to four bacterial species (Listeria monocytogenes, Escherichia coli, Lactobacillus casei, and Bacillus subtilis), two-dimensional angle-resolved light scattering maps are precisely measured using FTLS technique. The scattering maps are then systematically analyzed, employing statistical classification in order to extract the unique fingerprint patterns for each species, so that a new unidentified bacterium can be identified by a single light scattering measurement. The single-bacterial and label-free nature of our method suggests wide applicability for rapid point-of-care bacterial diagnosis.

Automated three-dimensional detection and classification of living organisms using digital holographic microscopy with partial spatial coherent source: application to the monitoring of drinking water resources

In this paper, we investigate the use of a digital holographic microscope working with partially coherent spatial illumination for an automated detection and classification of living organisms. A robust automatic method based on the computation of propagating matrices is proposed to detect the 3D position of organisms. We apply this procedure to the evaluation of drinking water resources by developing a classification process to identify parasitic protozoan Giardia lamblia cysts among two other similar organisms. By selecting textural features from the quantitative optical phase instead of morphological ones, a robust classifier is built to propose a new method for the unambiguous detection of Giardia lamblia cyst that present a critical contamination risk.

Fast source optimization involving quadratic line-contour objectives for the resist image

In Abbe's formulation, source optimization (SO) is often formulated into a linear or quadratic problem, depending on the choice of objective functions. However, the conventional approach for the resist image, involving a sigmoid transformation of the aerial image, results in an objective with a functional form. The applicability of the resist-image objective to SO or simultaneous source and mask optimization (SMO) is therefore limited. In this paper, we present a linear combination of two quadratic line-contour objectives to approximate the resist image effect for fast convergence. The line-contour objectives are based on the aerial image on drawn edges using a constant threshold resist model and that of pixels associated with an intensity minimum for side-lobe suppression. A conjugate gradient method is employed to assure the convergence to the global minimum within the number of iterations less than that of source variables. We further compare the optimized illumination with the proposed line-contour objectives to that with a sigmoid resist-image using a steepest decent method. The results show a 100x speedup with comparable image fidelity and a slightly improved process window for the two cases studied.

Automated three-dimensional microbial sensing and recognition using digital holography and statistical sampling

We overview an approach to providing automated three-dimensional (3D) sensing and recognition of biological micro/nanoorganisms integrating Gabor digital holographic microscopy and statistical sampling methods. For 3D data acquisition of biological specimens, a coherent beam propagates through the specimen and its transversely and longitudinally magnified diffraction pattern observed by the microscope objective is optically recorded with an image sensor array interfaced with a computer. 3D visualization of the biological specimen from the magnified diffraction pattern is accomplished by using the computational Fresnel propagation algorithm. For 3D recognition of the biological specimen, a watershed image segmentation algorithm is applied to automatically remove the unnecessary background parts in the reconstructed holographic image. Statistical estimation and inference algorithms are developed to the automatically segmented holographic image. Overviews of preliminary experimental results illustrate how the holographic image reconstructed from the Gabor digital hologram of biological specimen contains important information for microbial recognition.

Three-dimensional identification of stem cells by computational holographic imaging

We present an optical imaging system and mathematical algorithms for three-dimensional sensing and identification of stem cells. Data acquisition of stem cells is based on holographic microscopy in the Fresnel domain by illuminating the cells with a laser. In this technique, the holograms of stem cells are optically recorded with an image sensor array interfaced with a computer and three-dimensional images of the stem cells are reconstructed from the Gabor-filtered digital holograms. The Gabor wavelet transformation for feature extraction of the digital hologram is performed to improve the process of identification. The inverse Fresnel transformation of the Gabor-filtered digital hologram is performed to reconstruct the multi-scale three-dimensional images of the stem cells at different depths along the longitudinal direction. For recognition and classification of stem cells, a statistical approach using an empirical cumulative density function is introduced. The experiments indicate that the proposed system can be potentially useful for recognizing and classifying stem cells. To the best of our knowledge, this is the first report on using three-dimensional holographic microscopy for automated identification of stem cells.

Volumetric three-dimensional recognition of biological microorganisms using multivariate statistical method and digital holography

We present a new statistical approach to real-time sensing and recognition of microorganisms using digital holographic microscopy. We numerically produce many section images at different depths along a longitudinal direction from the single digital hologram of three-dimensional (3D) microorganisms in the Fresnel domain. For volumetric 3D recognition, the test pixel points are randomly selected from the section image; this procedure can be repeated with different specimens of the same microorganism. The multivariate joint density functions are calculated from the pixel values of each section image at the same random pixel points. The parameters of the statistical distributions are compared using maximum likelihood estimation and statistical inference algorithms. The performance of the proposed system is illustrated with preliminary experimental results.

Segmentation of 3D holographic images using bivariate jointly distributed region snake

In this paper, we describe the bivariate jointly distributed region snake method in segmentation of microorganisms in Single Exposure On- Line (SEOL) holographic microscopy images. 3D images of the microorganisms are digitally reconstructed and numerically focused from any arbitrary depth from a single recorded digital hologram without mechanical scanning. Living organisms are non-rigid and they vary in shape and size. Moreover, they often do not exhibit clear edges in digitally reconstructed SEOL holographic images. Thus, conventional segmentation techniques based on the edge map may fail to segment these images. However, SEOL holographic microscopy provides both magnitude and phase information of the sample specimen, which could be helpful in the segmentation process. In this paper, we present a statistical framework based on the joint probability distribution of magnitude and phase information of SEOL holographic microscopy images and maximum likelihood estimation of image probability density function parameters. An optimization criterion is computed by maximizing the likelihood function of the target support hypothesis. In addition, a simple stochastic algorithm has been adapted for carrying out the optimization, while several boosting techniques have been employed to enhance its performance. Finally, the proposed method is applied for segmentation of biological microorganisms in SEOL holographic images and the experimental results are presented.