Lung segmentation in chest radiographs using anatomical atlases with nonrigid registration

The National Library of Medicine (NLM) is developing a digital chest X-ray (CXR) screening system for deployment in resource constrained communities and developing countries worldwide with a focus on early detection of tuberculosis. A critical component in the computer-aided diagnosis of digital CXRs is the automatic detection of the lung regions. In this paper, we present a nonrigid registration-driven robust lung segmentation method using image retrieval-based patient specific adaptive lung models that detects lung boundaries, surpassing state-of-the-art performance. The method consists of three main stages: 1) a content-based image retrieval approach for identifying training images (with masks) most similar to the patient CXR using a partial Radon transform and Bhattacharyya shape similarity measure, 2) creating the initial patient-specific anatomical model of lung shape using SIFT-flow for deformable registration of training masks to the patient CXR, and 3) extracting refined lung boundaries using a graph cuts optimization approach with a customized energy function. Our average accuracy of 95.4% on the public JSRT database is the highest among published results. A similar degree of accuracy of 94.1% and 91.7% on two new CXR datasets from Montgomery County, MD, USA, and India, respectively, demonstrates the robustness of our lung segmentation approach.

Automatic tuberculosis screening using chest radiographs

Tuberculosis is a major health threat in many regions of the world. Opportunistic infections in immunocompromised HIV/AIDS patients and multi-drug-resistant bacterial strains have exacerbated the problem, while diagnosing tuberculosis still remains a challenge. When left undiagnosed and thus untreated, mortality rates of patients with tuberculosis are high. Standard diagnostics still rely on methods developed in the last century. They are slow and often unreliable. In an effort to reduce the burden of the disease, this paper presents our automated approach for detecting tuberculosis in conventional posteroanterior chest radiographs. We first extract the lung region using a graph cut segmentation method. For this lung region, we compute a set of texture and shape features, which enable the X-rays to be classified as normal or abnormal using a binary classifier. We measure the performance of our system on two datasets: a set collected by the tuberculosis control program of our local county's health department in the United States, and a set collected by Shenzhen Hospital, China. The proposed computer-aided diagnostic system for TB screening, which is ready for field deployment, achieves a performance that approaches the performance of human experts. We achieve an area under the ROC curve (AUC) of 87% (78.3% accuracy) for the first set, and an AUC of 90% (84% accuracy) for the second set. For the first set, we compare our system performance with the performance of radiologists. When trying not to miss any positive cases, radiologists achieve an accuracy of about 82% on this set, and their false positive rate is about half of our system's rate.

Cell segmentation using coupled level sets and graph-vertex coloring

Current level-set based approaches for segmenting a large number of objects are computationally expensive since they require a unique level set per object (the N-level set paradigm), or [log2N] level sets when using a multiphase interface tracking formulation. Incorporating energy-based coupling constraints to control the topological interactions between level sets further increases the computational cost to O(N2). We propose a new approach, with dramatic computational savings, that requires only four, or fewer, level sets for an arbitrary number of similar objects (like cells) using the Delaunay graph to capture spatial relationships. Even more significantly, the coupling constraints (energy-based and topological) are incorporated using just constant O(1) complexity. The explicit topological coupling constraint, based on predicting contour collisions between adjacent level sets, is developed to further prevent false merging or absorption of neighboring cells, and also reduce fragmentation during level set evolution. The proposed four-color level set algorithm is used to efficiently and accurately segment hundreds of individual epithelial cells within a moving monolayer sheet from time-lapse images of in vitro wound healing without any false merging of cells.

Flux Tensor Constrained Geodesic Active Contours with Sensor Fusion for Persistent Object Tracking

This paper makes new contributions in motion detection, object segmentation and trajectory estimation to create a successful object tracking system. A new efficient motion detection algorithm referred to as the flux tensor is used to detect moving objects in infrared video without requiring background modeling or contour extraction. The flux tensor-based motion detector when applied to infrared video is more accurate than thresholding "hot-spots", and is insensitive to shadows as well as illumination changes in the visible channel. In real world monitoring tasks fusing scene information from multiple sensors and sources is a useful core mechanism to deal with complex scenes, lighting conditions and environmental variables. The object segmentation algorithm uses level set-based geodesic active contour evolution that incorporates the fusion of visible color and infrared edge informations in a novel manner. Touching or overlapping objects are further refined during the segmentation process using an appropriate shape-based model. Multiple object tracking using correspondence graphs is extended to handle groups of objects and occlusion events by Kalman filter-based cluster trajectory analysis and watershed segmentation. The proposed object tracking algorithm was successfully tested on several difficult outdoor multispectral videos from stationary sensors and is not confounded by shadows or illumination variations.

Directional reversals enable Myxococcus xanthus cells to produce collective one-dimensional streams during fruiting-body formation

The formation of a collectively moving group benefits individuals within a population in a variety of ways. The surface-dwelling bacterium Myxococcus xanthus forms dynamic collective groups both to feed on prey and to aggregate during times of starvation. The latter behaviour, termed fruiting-body formation, involves a complex, coordinated series of density changes that ultimately lead to three-dimensional aggregates comprising hundreds of thousands of cells and spores. How a loose, two-dimensional sheet of motile cells produces a fixed aggregate has remained a mystery as current models of aggregation are either inconsistent with experimental data or ultimately predict unstable structures that do not remain fixed in space. Here, we use high-resolution microscopy and computer vision software to spatio-temporally track the motion of thousands of individuals during the initial stages of fruiting-body formation. We find that cells undergo a phase transition from exploratory flocking, in which unstable cell groups move rapidly and coherently over long distances, to a reversal-mediated localization into one-dimensional growing streams that are inherently stable in space. These observations identify a new phase of active collective behaviour and answer a long-standing open question in Myxococcus development by describing how motile cell groups can remain statistically fixed in a spatial location.

Vasoactive agonists exert dynamic and coordinated effects on vascular smooth muscle cell elasticity, cytoskeletal remodelling and adhesion

In this study, we examined the ability of vasoactive agonists to induce dynamic changes in vascular smooth muscle cell (VSMC) elasticity and adhesion, and tested the hypothesis that these events are coordinated with rapid remodelling of the cortical cytoskeleton. Real-time measurement of cell elasticity was performed with atomic force microscopy (AFM) and adhesion was assessed with AFM probes coated with fibronectin (FN). Temporal data were analysed using an Eigen-decomposition method. Elasticity in VSMCs displayed temporal oscillations with three components at approximately 0.001, 0.004 and 0.07 Hz, respectively. Similarly, adhesion displayed a similar oscillatory pattern. Angiotensin II (ANG II, 10(-6) M) increased (+100%) the amplitude of the oscillations, whereas the vasodilator adenosine (ADO, 10(-4) M) reduced oscillation amplitude (-30%). To test whether the oscillatory changes were related to the architectural alterations in cortical cytoskeleton, the topography of the submembranous actin cytoskeleton (100-300 nm depth) was acquired with AFM. These data were analysed to compare cortical actin fibre distribution and orientation before and after treatment with vasoactive agonists. The results showed that ANG II increased the density of stress fibres by 23%, while ADO decreased the density of the stress fibres by 45%. AFM data were supported by Western blot and confocal microscopy. Collectively, these observations indicate that VSMC cytoskeletal structure and adhesion to the extracellular matrix are dynamically altered in response to agonist stimulation. Thus, vasoactive agonists probably invoke unique mechanisms that dynamically alter the behaviour and structure of both the VSMC cytoskeleton and focal adhesions to efficiently support the normal contractile behaviour of VSMCs.

Peroxiredoxin 6 (Prdx6) supports NADPH oxidase1 (Nox1)-based superoxide generation and cell migration

Nox1 is an abundant source of reactive oxygen species (ROS) in colon epithelium recently shown to function in wound healing and epithelial homeostasis. We identified Peroxiredoxin 6 (Prdx6) as a novel binding partner of Nox activator 1 (Noxa1) in yeast two-hybrid screening experiments using the Noxa1 SH3 domain as bait. Prdx6 is a unique member of the Prdx antioxidant enzyme family exhibiting both glutathione peroxidase and phospholipase A2 activities. We confirmed this interaction in cells overexpressing both proteins, showing Prdx6 binds to and stabilizes wild type Noxa1, but not the SH3 domain mutant form, Noxa1 W436R. We demonstrated in several cell models that Prdx6 knockdown suppresses Nox1 activity, whereas enhanced Prdx6 expression supports higher Nox1-derived superoxide production. Both peroxidase- and lipase-deficient mutant forms of Prdx6 (Prdx6 C47S and S32A, respectively) failed to bind to or stabilize Nox1 components or support Nox1-mediated superoxide generation. Furthermore, the transition-state substrate analogue inhibitor of Prdx6 phospholipase A2 activity (MJ-33) was shown to suppress Nox1 activity, suggesting Nox1 activity is regulated by the phospholipase activity of Prdx6. Finally, wild type Prdx6, but not lipase or peroxidase mutant forms, supports Nox1-mediated cell migration in the HCT-116 colon epithelial cell model of wound closure. These findings highlight a novel pathway in which this antioxidant enzyme positively regulates an oxidant-generating system to support cell migration and wound healing.

Temperature-compensated cell production rate and elongation zone length in the root of Arabidopsis thaliana

To understand how root growth responds to temperature, we used kinematic analysis to quantify division and expansion parameters in the root of Arabidopsis thaliana. Plants were grown at temperatures from 15 to 30 °C, given continuously from germination. Over these temperatures, root length varies more than threefold in the wild type but by only twofold in a double mutant for phytochrome-interacting factor 4 and 5. For kinematics, the spatial profile of velocity was obtained with new software, Stripflow. We find that 30 °C truncates the elongation zone and curtails cell production, responses that probably reflect the elicitation of a common pathway for handling severe stresses. Curiously, rates of cell division at all temperatures are closely correlated with rates of radial expansion. Between 15 to 25 °C, root growth rate, maximal elemental elongation rate, and final cell length scale positively with temperature whereas the length of the meristem scales negatively. Non-linear temperature scaling characterizes meristem cell number, time to transit through either meristem or elongation zone, and average cell division rate. Surprisingly, the length of the elongation zone and the total rate of cell production are temperature invariant, constancies that have implications for our understanding of how the underlying cellular processes are integrated.

The Cell Tracking Challenge: 10 years of objective benchmarking

The Cell Tracking Challenge is an ongoing benchmarking initiative that has become a reference in cell segmentation and tracking algorithm development. Here, we present a significant number of improvements introduced in the challenge since our 2017 report. These include the creation of a new segmentation-only benchmark, the enrichment of the dataset repository with new datasets that increase its diversity and complexity, and the creation of a silver standard reference corpus based on the most competitive results, which will be of particular interest for data-hungry deep learning-based strategies. Furthermore, we present the up-to-date cell segmentation and tracking leaderboards, an in-depth analysis of the relationship between the performance of the state-of-the-art methods and the properties of the datasets and annotations, and two novel, insightful studies about the generalizability and the reusability of top-performing methods. These studies provide critical practical conclusions for both developers and users of traditional and machine learning-based cell segmentation and tracking algorithms.

QUANTITATIVE CELL MOTILITY FOR IN VITRO WOUND HEALING USING LEVEL SET-BASED ACTIVE CONTOUR TRACKING

Quantifying the behavior of cells individually, and in clusters as part of a population, under a range of experimental conditions, is a challenging computational task with many biological applications. We propose a versatile algorithm for segmentation and tracking of multiple motile epithelial cells during wound healing using time-lapse video. The segmentation part of the proposed method relies on a level set-based active contour algorithm that robustly handles a large number of cells. The tracking part relies on a detection-based multiple-object tracking method with delayed decision enabled by multi-hypothesis testing. The combined method is robust to complex cell behavior including division and apoptosis, and to imaging artifacts such as illumination changes.

Clustering-Based Dual Deep Learning Architecture for Detecting Red Blood Cells in Malaria Diagnostic Smears

Computer-assisted algorithms have become a mainstay of biomedical applications to improve accuracy and reproducibility of repetitive tasks like manual segmentation and annotation. We propose a novel pipeline for red blood cell detection and counting in thin blood smear microscopy images, named RBCNet, using a dual deep learning architecture. RBCNet consists of a U-Net first stage for cell-cluster or superpixel segmentation, followed by a second refinement stage Faster R-CNN for detecting small cell objects within the connected component clusters. RBCNet uses cell clustering instead of region proposals, which is robust to cell fragmentation, is highly scalable for detecting small objects or fine scale morphological structures in very large images, can be trained using non-overlapping tiles, and during inference is adaptive to the scale of cell-clusters with a low memory footprint. We tested our method on an archived collection of human malaria smears with nearly 200,000 labeled cells across 965 images from 193 patients, acquired in Bangladesh, with each patient contributing five images. Cell detection accuracy using RBCNet was higher than 97 %. The novel dual cascade RBCNet architecture provides more accurate cell detections because the foreground cell-cluster masks from U-Net adaptively guide the detection stage, resulting in a notably higher true positive and lower false alarm rates, compared to traditional and other deep learning methods. The RBCNet pipeline implements a crucial step towards automated malaria diagnosis.

Gaussian mixture density modeling, decomposition, and applications

We present a new approach to the modeling and decomposition of Gaussian mixtures by using robust statistical methods. The mixture distribution is viewed as a contaminated Gaussian density. Using this model and the model-fitting (MF) estimator, we propose a recursive algorithm called the Gaussian mixture density decomposition (GMDD) algorithm for successively identifying each Gaussian component in the mixture. The proposed decomposition scheme has advantages that are desirable but lacking in most existing techniques. In the GMDD algorithm the number of components does not need to be specified a priori, the proportion of noisy data in the mixture can be large, the parameter estimation of each component is virtually initial independent, and the variability in the shape and size of the component densities in the mixture is taken into account. Gaussian mixture density modeling and decomposition has been widely applied in a variety of disciplines that require signal or waveform characterization for classification and recognition. We apply the proposed GMDD algorithm to the identification and extraction of clusters, and the estimation of unknown probability densities. Probability density estimation by identifying a decomposition using the GMDD algorithm, that is, a superposition of normal distributions, is successfully applied to automated cell classification. Computer experiments using both real data and simulated data demonstrate the validity and power of the GMDD algorithm for various models and different noise assumptions.

GeoIRIS: Geospatial Information Retrieval and Indexing System-Content Mining, Semantics Modeling, and Complex Queries

Searching for relevant knowledge across heterogeneous geospatial databases requires an extensive knowledge of the semantic meaning of images, a keen eye for visual patterns, and efficient strategies for collecting and analyzing data with minimal human intervention. In this paper, we present our recently developed content-based multimodal Geospatial Information Retrieval and Indexing System (GeoIRIS) which includes automatic feature extraction, visual content mining from large-scale image databases, and high-dimensional database indexing for fast retrieval. Using these underpinnings, we have developed techniques for complex queries that merge information from heterogeneous geospatial databases, retrievals of objects based on shape and visual characteristics, analysis of multiobject relationships for the retrieval of objects in specific spatial configurations, and semantic models to link low-level image features with high-level visual descriptors. GeoIRIS brings this diverse set of technologies together into a coherent system with an aim of allowing image analysts to more rapidly identify relevant imagery. GeoIRIS is able to answer analysts' questions in seconds, such as "given a query image, show me database satellite images that have similar objects and spatial relationship that are within a certain radius of a landmark."

Malaria Screener: a smartphone application for automated malaria screening

Background

Light microscopy is often used for malaria diagnosis in the field. However, it is time-consuming and quality of the results depends heavily on the skill of microscopists. Automating malaria light microscopy is a promising solution, but it still remains a challenge and an active area of research. Current tools are often expensive and involve sophisticated hardware components, which makes it hard to deploy them in resource-limited areas.

Results

We designed an Android mobile application called Malaria Screener, which makes smartphones an affordable yet effective solution for automated malaria light microscopy. The mobile app utilizes high-resolution cameras and computing power of modern smartphones to screen both thin and thick blood smear images for P. falciparum parasites. Malaria Screener combines image acquisition, smear image analysis, and result visualization in its slide screening process, and is equipped with a database to provide easy access to the acquired data.

Conclusion

Malaria Screener makes the screening process faster, more consistent, and less dependent on human expertise. The app is modular, allowing other research groups to integrate their methods and models for image processing and machine learning, while acquiring and analyzing their data.

CELL SEGMENTATION USING HESSIAN-BASED DETECTION AND CONTOUR EVOLUTION WITH DIRECTIONAL DERIVATIVES

The large amount of data produced by biological live cell imaging studies of cell behavior requires accurate automated cell segmentation algorithms for rapid, unbiased and reproducible scientific analysis. This paper presents a new approach to obtain precise boundaries of cells with complex shapes using ridge measures for initial detection and a modified geodesic active contour for curve evolution that exploits the halo effect present in phase-contrast microscopy. The level set contour evolution is controlled by a novel spatially adaptive stopping function based on the intensity profile perpendicular to the evolving front. The proposed approach is tested on human cancer cell images from LSDCAS and achieves high accuracy even in complex environments.

Facial expression recognition for monitoring neurological disorders based on convolutional neural network

Facial expressions are a significant part of non-verbal communication. Recognizing facial expressions of people with neurological disorders is essential because these people may have lost a significant amount of their verbal communication ability. Such an assessment requires time consuming examination involving medical personnel, which can be quite challenging and expensive. Automated facial expression recognition systems that are low-cost and noninvasive can help experts detect neurological disorders. In this study, an automated facial expression recognition system is developed using a novel deep learning approach. The architecture consists of four-stage networks. The first, second and third networks segment the facial components which are essential for facial expression recognition. Owing to the three networks, an iconize facial image is obtained. The fourth network classifies facial expressions using raw facial images and iconize facial images. This four-stage method combines holistic facial information with local part-based features to achieve more robust facial expression recognition. Preliminary experimental results achieved 94.44% accuracy for facial expression recognition on RaFD database. The proposed system produced 5% improvement than the facial expression recognition system by using raw images. This study presents a quantitative, objective and non-invasive facial expression recognition system to help in the monitoring and diagnosis of neurological disorders influencing facial expressions.

Malaria parasite detection and cell counting for human and mouse using thin blood smear microscopy

Despite the remarkable progress that has been made to reduce global malaria mortality by 29% in the past 5 years, malaria is still a serious global health problem. Inadequate diagnostics is one of the major obstacles in fighting the disease. An automated system for malaria diagnosis can help to make malaria screening faster and more reliable. We present an automated system to detect and segment red blood cells (RBCs) and identify infected cells in Wright-Giemsa stained thin blood smears. Specifically, using image analysis and machine learning techniques, we process digital images of thin blood smears to determine the parasitemia in each smear. We use a cell extraction method to segment RBCs, in particular overlapping cells. We show that a combination of RGB color and texture features outperforms other features. We evaluate our method on microscopic blood smear images from human and mouse and show that it outperforms other techniques. For human cells, we measure an absolute error of 1.18% between the true and the automatic parasite counts. For mouse cells, our automatic counts correlate well with expert and flow cytometry counts. This makes our system the first one to work for both human and mouse.

Epifluorescence-based quantitative microvasculature remodeling using geodesic level-sets and shape-based evolution

Accurate vessel segmentation is the first step in analysis of microvascular networks for reliable feature extraction and quantitative characterization. Segmentation of epifluorescent imagery of microvasculature presents a unique set of challenges and opportunities compared to traditional angiogram-based vessel imagery. This paper presents a novel system that combines methods from mathematical morphology, differential geometry, and active contours to reliably detect and segment microvasculature under varying background fluorescence conditions. The system consists of three main modules: vessel enhancement, shape-based initialization, and level-set based segmentation. Vessel enhancement deals with image noise and uneven background fluorescence using anisotropic diffusion and mathematical morphology techniques. Shape-based initialization uses features from the second-order derivatives of the enhanced vessel image and produces a coarse ridge (vessel) mask. Geodesic level-set based active contours refine the coarse ridge map and fix possible discontinuities or leakage of the level set contours that may arise from complex topology or high background fluorescence. The proposed system is tested on epifluorescence-based high resolution images of porcine dura mater microvasculature. Preliminary experiments show promising results.

Multi-focus image fusion using epifluorescence microscopy for robust vascular segmentation

Automatic segmentation of three-dimensional mi-crovascular structures is needed for quantifying morphological changes to blood vessels during development, disease and treatment processes. Single focus two-dimensional epifluorescent imagery lead to unsatisfactory segmentations due to multiple out of focus vessel regions that have blurred edge structures and lack of detail. Additional segmentation challenges include varying contrast levels due to diffusivity of the lectin stain, leakage out of vessels and fine morphological vessel structure. We propose an approach for vessel segmentation that combines multi-focus image fusion with robust adaptive filtering. The robust adaptive filtering scheme handles noise without destroying small structures, while multi-focus image fusion considerably improves segmentation quality by deblurring out-of-focus regions through incorporating 3D structure information from multiple focus steps. Experiments using epifluorescence images of mice dura mater show an average of 30.4% improvement compared to single focus microvasculature segmentation.

Multiview Boosting With Information Propagation for Classification

Multiview learning has shown promising potential in many applications. However, most techniques are focused on either view consistency, or view diversity. In this paper, we introduce a novel multiview boosting algorithm, called Boost.SH, that computes weak classifiers independently of each view but uses a shared weight distribution to propagate information among the multiple views to ensure consistency. To encourage diversity, we introduce randomized Boost.SH and show its convergence to the greedy Boost.SH solution in the sense of minimizing regret using the framework of adversarial multiarmed bandits. We also introduce a variant of Boost.SH that combines decisions from multiple experts for recommending views for classification. We propose an expert strategy for multiview learning based on inverse variance, which explores both consistency and diversity. Experiments on biometric recognition, document categorization, multilingual text, and yeast genomic multiview data sets demonstrate the advantage of Boost.SH (85%) compared with other boosting algorithms like AdaBoost (82%) using concatenated views and substantially better than a multiview kernel learning algorithm (74%).