CELL SEGMENTATION USING HESSIAN-BASED DETECTION AND CONTOUR EVOLUTION WITH DIRECTIONAL DERIVATIVES

A Novel Method for Effective Cell Segmentation and Tracking in Phase Contrast Microscopic Images

Cell migration plays an important role in the identification of various diseases and physiological phenomena in living organisms, such as cancer metastasis, nerve development, immune function, wound healing, and embryo formulation and development. The study of cell migration with a real-time microscope generally takes several hours and involves analysis of the movement characteristics by tracking the positions of cells at each time interval in the images of the observed cells. Morphological analysis considers the shapes of the cells, and a phase contrast microscope is used to observe the shape clearly. Therefore, we developed a segmentation and tracking method to perform a kinetic analysis by considering the morphological transformation of cells. The main features of the algorithm are noise reduction using a block-matching 3D filtering method, k-means clustering to mitigate the halo signal that interferes with cell segmentation, and the detection of cell boundaries via active contours, which is an excellent way to detect boundaries. The reliability of the algorithm developed in this study was verified using a comparison with the manual tracking results. In addition, the segmentation results were compared to our method with unsupervised state-of-the-art methods to verify the proposed segmentation process. As a result of the study, the proposed method had a lower error of less than 40% compared to the conventional active contour method.

Displacement fields using correlation methods as a tool to investigate cell migration in 3D collagen gels

Living cells embedded in a complex extra-cellular matrix migrate in a sophisticated way thanks to adhesions to matrix fibres and contractility. It is important to know what kind of forces are exerted by the cells. Here, we use reflectance confocal microscopy to locate fibres accurately and determine displacement fields. Correlation techniques are used to this aim, coupled with proper digital image processing. Benchmark tests validate the method in the case of shear and stretching motions. Finally, the method is tested successfully for studying cancer cells migrating in collagen gels of different concentration.

Multicell migration tracking within angiogenic networks by deep learning-based segmentation and augmented Bayesian filtering

Cell migration is a key feature for living organisms. Image analysis tools are useful in studying cell migration in three-dimensional (3-D) in vitro environments. We consider angiogenic vessels formed in 3-D microfluidic devices (MFDs) and develop an image analysis system to extract cell behaviors from experimental phase-contrast microscopy image sequences. The proposed system initializes tracks with the end-point confocal nuclei coordinates. We apply convolutional neural networks to detect cell candidates and combine backward Kalman filtering with multiple hypothesis tracking to link the cell candidates at each time step. These hypotheses incorporate prior knowledge on vessel formation and cell proliferation rates. The association accuracy reaches 86.4% for the proposed algorithm, indicating that the proposed system is able to associate cells more accurately than existing approaches. Cell culture experiments in 3-D MFDs have shown considerable promise for improving biology research. The proposed system is expected to be a useful quantitative tool for potential microscopy problems of MFDs.

Real-time halo correction in phase contrast imaging

As a label-free, nondestructive method, phase contrast is by far the most popular microscopy technique for routine inspection of cell cultures. However, features of interest such as extensions near cell bodies are often obscured by a glow, which came to be known as the halo. Advances in modeling image formation have shown that this artifact is due to the limited spatial coherence of the illumination. Nevertheless, the same incoherent illumination is responsible for superior sensitivity to fine details in the phase contrast geometry. Thus, there exists a trade-off between high-detail (incoherent) and low-detail (coherent) imaging systems. In this work, we propose a method to break this dichotomy, by carefully mixing corrected low-frequency and high-frequency data in a way that eliminates the edge effect. Specifically, our technique is able to remove halo artifacts at video rates, requiring no manual interaction or a priori point spread function measurements. To validate our approach, we imaged standard spherical beads, sperm cells, tissue slices, and red blood cells. We demonstrate real-time operation with a time evolution study of adherent neuron cultures whose neurites are revealed by our halo correction. We show that with our novel technique, we can quantify cell growth in large populations, without the need for thresholds and system variant calibration.

Phase contrast cell detection using multilevel classification

In this paper, we propose a fully automated learning-based approach for detecting cells in time-lapse phase contrast images. The proposed system combines 2 machine learning approaches to achieve bottom-up image segmentation. We apply pixel-wise classification using random forests (RF) classifiers to determine the potential location of the cells. Each pixel is classified into 4 categories (cell, mitotic cell, halo effect, and background noise). Various image features are extracted at different scales to train the RF classifier. The resulting probability map is partitioned using the k-means algorithm to form potential cell regions. These regions are expanded into the neighboring areas to recover some missing or broken cell regions. To validate the cell regions, another machine learning method based on the bag-of-features and spatial pyramid encoding is proposed. The result of the second classifier can be a validated cell, a merged cell, or a noncell. In the case that the cell region is classified as a merged cell, it is split by using the seeded watershed method. The proposed method is demonstrated on several phase contrast image datasets, ie, U2OS, HeLa, and NIH 3T3. In comparison to state-of-the-art cell detection techniques, the proposed method shows improved performance, particularly in dealing with noise interference and drastic shape variations.

ImaEdge: a platform for the quantitative analysis of cortical proteins spatiotemporal dynamics during cell polarization

Cell polarity involves the compartmentalization of the cell cortex. The establishment of cortical compartments arises from the spatial bias in the activity and concentration of cortical proteins. The mechanistic dissection of cell polarity requires the accurate detection of dynamic changes in cortical proteins, but the fluctuations of cell shape and the inhomogeneous distributions of cortical proteins greatly complicate the quantitative extraction of their global and local changes during cell polarization. To address these problems, we introduce an open-source software package, ImaEdge, which automates the segmentation of the cortex from time-lapse movies, and enables quantitative extraction of cortical protein intensities. We demonstrate that ImaEdge enables efficient and rigorous analysis of the dynamic evolution of cortical PAR proteins during C. elegans embryogenesis. It is also capable of accurate tracking of varying levels of transgene expression and discontinuous signals of the actomyosin cytoskeleton during multiple rounds of cell division. ImaEdge provides a unique resource for the quantitative studies of cortical polarization, with the potential for application to many types of polarized cells.

Algorithm for the precise detection of single and cluster cells in microfluidic applications

Recent advances in imaging flow cytometry and microfluidic applications have led to the development of suitable mathematical algorithms capable of detecting and identifying targeted cells in images. In contrast to currently existing algorithms, we herein proposed the identification and reconstruction of cell edges based on original approaches that overcome frequent detection limitations such as halos, noise, and droplet boundaries in microfluidic applications. Reconstructed cells are then discriminated between single cells and clusters of round-shaped cells, and cell information such as the area and location of a cell in an image is output. Using this method, 76% of cells detected in an image had an error <5% of the cell area size and 41% of the image had an error <1% of the cell area size (n = 1,000). The method developed in the present study is the first image processing algorithm designed to be flexible in use (i.e. independent of the size of an image, using a microfluidic droplet system or not, and able to recognize cell clusters in an image) and provides the scientific community with a very accurate imaging algorithm in the field of microfluidic applications. © 2016 International Society for Advancement of Cytometry.

Segmentation of the Clustered Cells with Optimized Boundary Detection in Negative Phase Contrast Images

Cell image segmentation plays a central role in numerous biology studies and clinical applications. As a result, the development of cell image segmentation algorithms with high robustness and accuracy is attracting more and more attention. In this study, an automated cell image segmentation algorithm is developed to get improved cell image segmentation with respect to cell boundary detection and segmentation of the clustered cells for all cells in the field of view in negative phase contrast images. A new method which combines the thresholding method and edge based active contour method was proposed to optimize cell boundary detection. In order to segment clustered cells, the geographic peaks of cell light intensity were utilized to detect numbers and locations of the clustered cells. In this paper, the working principles of the algorithms are described. The influence of parameters in cell boundary detection and the selection of the threshold value on the final segmentation results are investigated. At last, the proposed algorithm is applied to the negative phase contrast images from different experiments. The performance of the proposed method is evaluated. Results show that the proposed method can achieve optimized cell boundary detection and highly accurate segmentation for clustered cells.

A method for automatic segmentation of nuclei in phase-contrast images based on intensity, convexity and texture

This paper presents a method for automatic segmentation of nuclei in phase-contrast images using the intensity, convexity and texture of the nuclei. The proposed method consists of three main stages: preprocessing, h-maxima transformation-based marker controlled watershed segmentation ( h-TMC), and texture analysis. In the preprocessing stage, a top-hat filter is used to increase the contrast and suppress the non-uniform illumination, shading, and other imaging artifacts in the input image. The nuclei segmentation stage consists of a distance transformation, h-maxima transformation and watershed segmentation. These transformations utilize the intensity information and the convexity property of the nucleus for the purpose of detecting a single marker in every nucleus; these markers are then used in the h-TMC watershed algorithm to obtain segments of the nuclei. However, dust particles, imaging artifacts, or prolonged cell cytoplasm may falsely be segmented as nuclei at this stage, and thus may lead to an inaccurate analysis of the cell image. In order to identify and remove these non-nuclei segments, in the third stage a texture analysis is performed, that uses six of the Haralick measures along with the AdaBoost algorithm. The novelty of the proposed method is that it introduces a systematic framework that utilizes intensity, convexity, and texture information to achieve a high accuracy for automatic segmentation of nuclei in the phase-contrast images. Extensive experiments are performed demonstrating the superior performance ( precision = 0.948; recall = 0.924; F1-measure = 0.936; validation based on  ∼ 4850 manually-labeled nuclei) of the proposed method.

Quantitative analysis of lymphocytes morphology and motion in intravital microscopic images

Studying the morphology and interior movement of lymphocytes in intravital microscopic images is essential to understanding and treating various biological processes and pathological situations. A method combing features of shape, deformation, and intracellular motion for quantitatively characterizing the dynamic behavior of a single lymphocyte is proposed in this paper. The method is tested on a set of image sequences of lymphocytes obtained from the peripheral blood of mice undergoing skin transplantation using a phase contrast microscope. Experimental results coincide with the clinical observation and pathological analysis, demonstrating that the extracted cell morphology and motion features can provide new insights into the relationship between the dynamic behavior of lymphocytes and the occurrence of graft rejection.

Influence of membrane cholesterol and substrate elasticity on endothelial cell spreading behavior

Interactions between implanted materials and the surrounding host cells critically affect the fate of bioengineered materials. In this study, the biomechanical response of bovine aortic endothelial cells (BAECs) with different membrane cholesterol levels to polyacrylamide (PA) gels was investigated by measuring cell adhesion and spreading behaviors at varying PA elasticity. The elasticity of gel substrates was manipulated by cross-linker content. Type I collagen (COL1) was coated on PA gel to provide a biologically functional environment for cell spreading. Precise quantitative characterization of changes in cell area and perimeter of cells across two treatments and three bioengineered substrates were determined using a customized software developed for computational image analysis. We found that the initial response of endothelial cells to changes in substrate elasticity was determined by membrane cholesterol levels, and that the extent of endothelial cell spreading increases with membrane cholesterol content. All of the BAECs with different cholesterol levels showed little growth on substrates with elasticity below 20 kPa, but increased spreading at higher substrate elasticity. Cholesterol-depleted cells were consistently smaller than control and cholesterol-enriched cells regardless of substrate elasticity. These observations indicate that membrane cholesterol plays an important role in cell spreading on soft biomimetic materials constructed with appropriate elasticity.

Detection of unstained living neurospheres from phase contrast images with very large illumination variations

Live imaging of neural stem cells and progenitors is important to follow the biology of these cells. Non-invasive imaging techniques, such as phase contrast microscopy, are preferred as neural stem cells are very sensitive to photoxic damage cause by excitation of fluorescent molecules. However, large illumination variations and weak foreground/background contrast make phase contrast images challenging for image processing. In the current work, we propose a new method to segment neurospheres imaged under phase contrast microscopy by employing high dynamic range imaging and advanced level-set method. The use of high dynamic range imaging enhances the fused image by expressing cell signatures from various exposure captures. We apply advanced level-set method in cell segmentation to improve the detection rate over simple methods such as thresholding. Validation experiments in the analysis of 21 images containing over 400 cells have demonstrated accuracy improvements over existing techniques.

Learning cellular texture features in microscopic cancer cell images for automated cell-detection

In this paper we present a new approach for automated cell detection in single frames of 2D microscopic phase contrast images of cancer cells which is based on learning cellular texture features. The main challenge addressed in this paper is to deal with clusters of cells where each cell has a rather complex appearance composed of sub-regions with different texture features. Our approach works on two different levels of abstraction. First, we apply statistical learning to learn 6 different types of different local cellular texture features, classify each pixel according to them and we obtain an image partition composed of 6 different pixel categories. Based on this partitioned image we decide in a second step if pre-selected seeds belong to the same cell or not. Experimental results show the high accuracy of the proposed method and especially average precision above 95%.

ECM-Aware Cell-Graph Mining for Bone Tissue Modeling and Classification

Pathological examination of a biopsy is the most reliable and widely used technique to diagnose bone cancer. However, it suffers from both inter- and intra- observer subjectivity. Techniques for automated tissue modeling and classification can reduce this subjectivity and increases the accuracy of bone cancer diagnosis. This paper presents a graph theoretical method, called extracellular matrix (ECM)-aware cell-graph mining, that combines the ECM formation with the distribution of cells in hematoxylin and eosin (H&E) stained histopathological images of bone tissues samples. This method can identify different types of cells that coexist in the same tissue as a result of its functional state. Thus, it models the structure-function relationships more precisely and classifies bone tissue samples accurately for cancer diagnosis. The tissue images are segmented, using the eigenvalues of the Hessian matrix, to compute spatial coordinates of cell nuclei as the nodes of corresponding cell-graph. Upon segmentation a color code is assigned to each node based on the composition of its surrounding ECM. An edge is hypothesized (and established) between a pair of nodes if the corresponding cell membranes are in physical contact and if they share the same color. Hence, multiple colored-cell-graphs coexist in a tissue each modeling a different cell-type organization. Both topological and spectral features of ECM-aware cell-graphs are computed to quantify the structural properties of tissue samples and classify their different functional states as healthy, fractured, or cancerous using support vector machines. Classification accuracy comparison to related work shows that ECM-aware cell-graph approach yields 90.0% whereas Delaunay triangulation and simple cell-graph approach achieves 75.0% and 81.1% accuracy, respectively.

Tracking cells in Life Cell Imaging videos using topological alignments

Background

With the increasing availability of live cell imaging technology, tracking cells and other moving objects in live cell videos has become a major challenge for bioimage informatics. An inherent problem for most cell tracking algorithms is over- or under-segmentation of cells – many algorithms tend to recognize one cell as several cells or vice versa.

Results

We propose to approach this problem through so-called topological alignments, which we apply to address the problem of linking segmentations of two consecutive frames in the video sequence. Starting from the output of a conventional segmentation procedure, we align pairs of consecutive frames through assigning sets of segments in one frame to sets of segments in the next frame. We achieve this through finding maximum weighted solutions to a generalized "bipartite matching" between two hierarchies of segments, where we derive weights from relative overlap scores of convex hulls of sets of segments. For solving the matching task, we rely on an integer linear program.

Conclusion

Practical experiments demonstrate that the matching task can be solved efficiently in practice, and that our method is both effective and useful for tracking cells in data sets derived from a so-called Large Scale Digital Cell Analysis System (LSDCAS).

Availability

The source code of the implementation is available for download from http://www.picb.ac.cn/patterns/Software/topaln.