Combining intensity, edge and shape information for 2D and 3D segmentation of cell nuclei in tissue sections

Proteome-scale movements and compartment connectivity during the eukaryotic cell cycle

Cell cycle progression relies on coordinated changes in the composition and subcellular localization of the proteome. By applying two distinct convolutional neural networks on images of millions of live yeast cells, we resolved proteome-level dynamics in both concentration and localization during the cell cycle, with resolution of ∼20 subcellular localization classes. We show that a quarter of the proteome displays cell cycle periodicity, with proteins tending to be controlled either at the level of localization or concentration, but not both. Distinct levels of protein regulation are preferentially utilized for different aspects of the cell cycle, with changes in protein concentration being mostly involved in cell cycle control and changes in protein localization in the biophysical implementation of the cell cycle program. We present a resource for exploring global proteome dynamics during the cell cycle, which will aid in understanding a fundamental biological process at a systems level.

Automatic detection of cell-cycle stages using recurrent neural networks

Mitosis is the process by which eukaryotic cells divide to produce two similar daughter cells with identical genetic material. Research into the process of mitosis is therefore of critical importance both for the basic understanding of cell biology and for the clinical approach to manifold pathologies resulting from its malfunctioning, including cancer. In this paper, we propose an approach to study mitotic progression automatically using deep learning. We used neural networks to predict different mitosis stages. We extracted video sequences of cells undergoing division and trained a Recurrent Neural Network (RNN) to extract image features. The use of RNN enabled better extraction of features. The RNN-based approach gave better performance compared to classifier based feature extraction methods which do not use time information. Evaluation of precision, recall, and F-score indicates the superiority of the proposed model compared to the baseline. To study the loss in performance due to confusion between adjacent classes, we plotted the confusion matrix as well. In addition, we visualized the feature space to understand why RNNs are better at classifying the mitosis stages than other classifier models, which indicated the formation of strong clusters for the different classes, clearly confirming the advantage of the proposed RNN-based approach.

Deep learning framework for automated goblet cell density analysis in in-vivo rabbit conjunctiva

Goblet cells (GCs) in the conjunctiva are specialized epithelial cells secreting mucins for the mucus layer of protective tear film and playing immune tolerance functions for ocular surface health. Because GC loss is observed in various ocular surface diseases, GC examination is important for precision diagnosis. Moxifloxacin-based fluorescence microscopy (MBFM) was recently developed for non-invasive high-contrast GC visualization. MBFM showed promise for GC examination by high-speed large-area imaging and a robust analysis method is needed to provide GC information. In this study, we developed a deep learning framework for GC image analysis, named dual-channel attention U-Net (DCAU-Net). Dual-channel convolution was used both to extract the overall image texture and to acquire the GC morphological characteristics. A global channel attention module was adopted by combining attention algorithms and channel-wise pooling. DCAU-Net showed 93.1% GC segmentation accuracy and 94.3% GC density estimation accuracy. Further application to both normal and ocular surface damage rabbit models revealed the spatial variations of both GC density and size in normal rabbits and the decreases of both GC density and size in damage rabbit models during recovery after acute damage. The GC analysis results were consistent with histology. Together with the non-invasive high-contrast imaging method, DCAU-Net would provide GC information for the diagnosis of ocular surface diseases.

Machine learning on large scale perturbation screens for SARS-CoV-2 host factors identifies β-catenin/CBP inhibitor PRI-724 as a potent antiviral

Expanding antiviral treatment options against SARS-CoV-2 remains crucial as the virus evolves under selection pressure which already led to the emergence of several drug resistant strains. Broad spectrum host-directed antivirals (HDA) are promising therapeutic options, however the robust identification of relevant host factors by CRISPR/Cas9 or RNA interference screens remains challenging due to low consistency in the resulting hits. To address this issue, we employed machine learning, based on experimental data from several knockout screens and a drug screen. We trained classifiers using genes essential for virus life cycle obtained from the knockout screens. The machines based their predictions on features describing cellular localization, protein domains, annotated gene sets from Gene Ontology, gene and protein sequences, and experimental data from proteomics, phospho-proteomics, protein interaction and transcriptomic profiles of SARS-CoV-2 infected cells. The models reached a remarkable performance suggesting patterns of intrinsic data consistency. The predicted HDF were enriched in sets of genes particularly encoding development, morphogenesis, and neural processes. Focusing on development and morphogenesis-associated gene sets, we found β-catenin to be central and selected PRI-724, a canonical β-catenin/CBP disruptor, as a potential HDA. PRI-724 limited infection with SARS-CoV-2 variants, SARS-CoV-1, MERS-CoV and IAV in different cell line models. We detected a concentration-dependent reduction in cytopathic effects, viral RNA replication, and infectious virus production in SARS-CoV-2 and SARS-CoV-1-infected cells. Independent of virus infection, PRI-724 treatment caused cell cycle deregulation which substantiates its potential as a broad spectrum antiviral. Our proposed machine learning concept supports focusing and accelerating the discovery of host dependency factors and identification of potential host-directed antivirals.

Large-scale time-lapse scanning electron microscopy image mosaic using a smooth stitching strategy

Due to the trade-off between the field of view and resolution of various microscopes, obtaining a wide-view panoramic image through high-resolution image tiles is frequently encountered and demanded in numerous applications. Here, we propose an automatic image mosaic strategy for sequential 2D time-lapse scanning electron microscopy (SEM) images. This method can accurately compute pairwise translations among serial image tiles with indeterminate overlapping areas. The detection and matching of feature points are limited by geographical coordinates, thus avoiding accidental mismatching. Moreover, the nonlinear deformation of the mosaic part is also taken into account. A smooth stitching field is utilized to gradually transform the perspective transformation in overlapping regions into the linear transformation in non-overlapping regions. Experimental results demonstrate that better image stitching accuracy can be achieved compared with some other image mosaic algorithms. Such a method has potential applications in high-resolution large-area analysis using serial microscopy images. RESEARCH HIGHLIGHTS: An automatic image mosaic strategy for processing sequential scanning electron microscopy images is proposed. A smooth stitching field is applied in the image mosaic. Improved stitching accuracy is achieved compared with other conventional mosaic methods.

Detection and Spatiotemporal Analysis of In-vitro 3D Migratory Triple-Negative Breast Cancer Cells

The invasion of cancer cells into the surrounding tissues is one of the hallmarks of cancer. However, a precise quantitative understanding of the spatiotemporal patterns of cancer cell migration and invasion still remains elusive. A promising approach to investigate these patterns are 3D cell cultures, which provide more realistic models of cancer growth compared to conventional 2D monolayers. Quantifying the spatial distribution of cells in these 3D cultures yields great promise for understanding the spatiotemporal progression of cancer. In the present study, we present an image processing and segmentation pipeline for the detection of 3D GFP-fluorescent triple-negative breast cancer cell nuclei, and we perform quantitative analysis of the formed spatial patterns and their temporal evolution. The performance of the proposed pipeline was evaluated using experimental 3D cell culture data, and was found to be comparable to manual segmentation, outperforming four alternative automated methods. The spatiotemporal statistical analysis of the detected distributions of nuclei revealed transient, non-random spatial distributions that consisted of clustered patterns across a wide range of neighbourhood distances, as well as dispersion for larger distances. Overall, the implementation of the proposed framework revealed the spatial organization of cellular nuclei with improved accuracy, providing insights into the 3 dimensional inter-cellular organization and its progression through time.

Spatial statistics is a comprehensive tool for quantifying cell neighbor relationships and biological processes via tissue image analysis

Automated microscopy and computational image analysis has transformed cell biology, providing quantitative, spatially resolved information on cells and their constituent molecules from the sub-micron to the whole-organ scale. Here we explore the application of spatial statistics to the cellular relationships within tissue microscopy data and discuss how spatial statistics offers cytometry a powerful yet underused mathematical tool set for which the required data are readily captured using standard protocols and microscopy equipment. We also highlight the often-overlooked need to carefully consider the structural heterogeneity of tissues in terms of the applicability of different statistical measures and their accuracy and demonstrate how spatial analyses offer a great deal more than just basic quantification of biological variance. Ultimately, we highlight how statistical modeling can help reveal the hierarchical spatial processes that connect the properties of individual cells to the establishment of biological function.

Marker-controlled watershed with deep edge emphasis and optimized H-minima transform for automatic segmentation of densely cultivated 3D cell nuclei

BACKGROUND

The segmentation of 3D cell nuclei is essential in many tasks, such as targeted molecular radiotherapies (MRT) for metastatic tumours, toxicity screening, and the observation of proliferating cells. In recent years, one popular method for automatic segmentation of nuclei has been deep learning enhanced marker-controlled watershed transform. In this method, convolutional neural networks (CNNs) have been used to create nuclei masks and markers, and the watershed algorithm for the instance segmentation. We studied whether this method could be improved for the segmentation of densely cultivated 3D nuclei via developing multiple system configurations in which we studied the effect of edge emphasizing CNNs, and optimized H-minima transform for mask and marker generation, respectively.

RESULTS

The dataset used for training and evaluation consisted of twelve in vitro cultivated densely packed 3D human carcinoma cell spheroids imaged using a confocal microscope. With this dataset, the evaluation was performed using a cross-validation scheme. In addition, four independent datasets were used for evaluation. The datasets were resampled near isotropic for our experiments. The baseline deep learning enhanced marker-controlled watershed obtained an average of 0.69 Panoptic Quality (PQ) and 0.66 Aggregated Jaccard Index (AJI) over the twelve spheroids. Using a system configuration, which was otherwise the same but used 3D-based edge emphasizing CNNs and optimized H-minima transform, the scores increased to 0.76 and 0.77, respectively. When using the independent datasets for evaluation, the best performing system configuration was shown to outperform or equal the baseline and a set of well-known cell segmentation approaches.

CONCLUSIONS

The use of edge emphasizing U-Nets and optimized H-minima transform can improve the marker-controlled watershed transform for segmentation of densely cultivated 3D cell nuclei. A novel dataset of twelve spheroids was introduced to the public.

Live cell microscopy: From image to insight

Live-cell microscopy is a powerful tool that can reveal cellular behavior as well as the underlying molecular processes. A key advantage of microscopy is that by visualizing biological processes, it can provide direct insights. Nevertheless, live-cell imaging can be technically challenging and prone to artifacts. For a successful experiment, many careful decisions are required at all steps from hardware selection to downstream image analysis. Facing these questions can be particularly intimidating due to the requirement for expertise in multiple disciplines, ranging from optics, biophysics, and programming to cell biology. In this review, we aim to summarize the key points that need to be considered when setting up and analyzing a live-cell imaging experiment. While we put a particular focus on yeast, many of the concepts discussed are applicable also to other organisms. In addition, we discuss reporting and data sharing strategies that we think are critical to improve reproducibility in the field.

Efficient automatic 3D segmentation of cell nuclei for high-content screening

BACKGROUND

High-content screening (HCS) is a pre-clinical approach for the assessment of drug efficacy. On modern platforms, it involves fluorescent image capture using three-dimensional (3D) scanning microscopy. Segmentation of cell nuclei in 3D images is an essential prerequisite to quantify captured fluorescence in cells for screening. However, this segmentation is challenging due to variabilities in cell confluency, drug-induced alterations in cell morphology, and gradual degradation of fluorescence with the depth of scanning. Despite advances in algorithms for segmenting nuclei for HCS, robust 3D methods that are insensitive to these conditions are still lacking.

RESULTS

We have developed an algorithm which first generates a 3D nuclear mask in the original images. Next, an iterative 3D marker-controlled watershed segmentation is applied to downsized images to segment adjacent nuclei under the mask. In the last step, borders of segmented nuclei are adjusted in the original images based on local nucleus and background intensities. The method was developed using a set of 10 3D images. Extensive tests on a separate set of 27 3D images containing 2,367 nuclei demonstrated that our method, in comparison with 6 reference methods, achieved the highest precision (PR = 0.97), recall (RE = 0.88) and F1-score (F1 = 0.93) of nuclei detection. The Jaccard index (JI = 0.83), which reflects the accuracy of nuclei delineation, was similar to that yielded by all reference approaches. Our method was on average more than twice as fast as the reference method that produced the best results. Additional tests carried out on three stacked 3D images comprising heterogenous nuclei yielded average PR = 0.96, RE = 0.84, F1 = 0.89, and JI = 0.80.

CONCLUSIONS

The high-performance metrics yielded by the proposed approach suggest that it can be used to reliably delineate nuclei in 3D images of monolayered and stacked cells exposed to cytotoxic drugs.

HIV RGB: Automated Single-Cell Analysis of HIV-1 Rev-Dependent RNA Nuclear Export and Translation Using Image Processing in KNIME

Single-cell imaging has emerged as a powerful means to study viral replication dynamics and identify sites of virus−host interactions. Multivariate aspects of viral replication cycles yield challenges inherent to handling large, complex imaging datasets. Herein, we describe the design and implementation of an automated, imaging-based strategy, “Human Immunodeficiency Virus Red-Green-Blue” (HIV RGB), for deriving comprehensive single-cell measurements of HIV-1 unspliced (US) RNA nuclear export, translation, and bulk changes to viral RNA and protein (HIV-1 Rev and Gag) subcellular distribution over time. Differentially tagged fluorescent viral RNA and protein species are recorded using multicolor long-term (>24 h) time-lapse video microscopy, followed by image processing using a new open-source computational imaging workflow dubbed “Nuclear Ring Segmentation Analysis and Tracking” (NR-SAT) based on ImageJ plugins that have been integrated into the Konstanz Information Miner (KNIME) analytics platform. We describe a typical HIV RGB experimental setup, detail the image acquisition and NR-SAT workflow accompanied by a step-by-step tutorial, and demonstrate a use case wherein we test the effects of perturbing subcellular localization of the Rev protein, which is essential for viral US RNA nuclear export, on the kinetics of HIV-1 late-stage gene regulation. Collectively, HIV RGB represents a powerful platform for single-cell studies of HIV-1 post-transcriptional RNA regulation. Moreover, we discuss how similar NR-SAT-based design principles and open-source tools might be readily adapted to study a broad range of dynamic viral or cellular processes.

Dual-Task ConvLSTM-UNet for Instance Segmentation of Weakly Annotated Microscopy Videos

Convolutional Neural Networks (CNNs) are considered state of the art segmentation methods for biomedical images in general and microscopy sequences of living cells, in particular. The success of the CNNs is attributed to their ability to capture the structural properties of the data, which enables accommodating complex spatial structures of the cells, low contrast, and unclear boundaries. However, in their standard form CNNs do not exploit the temporal information available in time-lapse sequences, which can be crucial to separating touching and partially overlapping cell instances. In this work, we exploit cell dynamics using a novel CNN architecture which allows multi-scale spatio-temporal feature extraction. Specifically, a novel recurrent neural network (RNN) architecture is proposed based on the integration of a Convolutional Long Short Term Memory (ConvLSTM) network with the U-Net. The proposed ConvLSTM-UNet network is constructed as a dual-task network to enable training with weakly annotated data, in the form of approximate cell centers, termed markers, when the complete cells' outlines are not available. We further use the fast marching method to facilitate the partitioning of clustered cells into individual connected components. Finally, we suggest an adaptation of the method for 3D microscopy sequences without drastically increasing the computational load. The method was evaluated on the Cell Segmentation Benchmark and was ranked among the top three methods on six submitted datasets. Exploiting the proposed built-in marker estimator we also present state-of-the-art cell detection results for an additional, publicly available, weekly annotated dataset. The source code is available at https://gitlab.com/shaked0/lstmUnet.

Probabilistic spatial analysis in quantitative microscopy with uncertainty-aware cell detection using deep Bayesian regression

The investigation of biological systems with three-dimensional microscopy demands automatic cell identification methods that not only are accurate but also can imply the uncertainty in their predictions. The use of deep learning to regress density maps is a popular successful approach for extracting cell coordinates from local peaks in a postprocessing step, which then, however, hinders any meaningful probabilistic output. We propose a framework that can operate on large microscopy images and output probabilistic predictions (i) by integrating deep Bayesian learning for the regression of uncertainty-aware density maps, where peak detection algorithms generate cell proposals, and (ii) by learning a mapping from prediction proposals to a probabilistic space that accurately represents the chances of a successful prediction. Using these calibrated predictions, we propose a probabilistic spatial analysis with Monte Carlo sampling. We demonstrate this in a bone marrow dataset, where our proposed methods reveal spatial patterns that are otherwise undetectable.

An RNA Interference/Adeno-Associated Virus Vector-Based Combinatorial Gene Therapy Approach Against Hepatitis E Virus

Hepatitis E virus (HEV) is a major public health problem with limited therapeutic options. Here, we engineered adeno-associated viral vectors of serotype 6 (AAV6) to express short hairpin RNAs (shRNAs) against HEV transcripts with the prospect of down-regulating HEV replication in vivo. We designed 20 different shRNAs, targeting the genome of the HEV genotype 3 (GT3) Kernow-C1 p6 strain, for delivery upon AAV6 transduction. Using an original selectable HEV GT3 reporter replicon, we identified three shRNAs that efficiently down-regulated HEV replication. We further confirmed their inhibitory potency with full-length HEV infection. Seventy-two hours following transduction, HEV replication in both systems decreased by up to 95%. The three most potent inhibitory shRNAs identified were directed against the methyltransferase domain, the junction region between the open reading frames (ORFs), and the 3´ end of ORF2. Targeting all three regions by multiplexing the shRNAs further enhanced their inhibitory potency over a prolonged period of up to 21 days following transduction. Conclusion: Combining RNA interference and AAV vector-based gene therapy has great potential for suppressing HEV replication. Our strategy to target the viral RNA with multiplexed shRNAs should help to counteract viral escape through mutations. Considering the widely documented safety of AAV vector-based gene therapies, our approach is, in principle, amenable to clinical translation.

Morphometric quantification of a pseudohyphae forming Saccharomyces cerevisiae strain using in situ microscopy and image analysis

Yeast morphology and counting are highly important in fermentation as they are often associated with productivity and can be influenced by process conditions. At present, time-consuming and offline methods are utilized for routine analysis of yeast morphology and cell counting using a haemocytometer. In this study, we demonstrate the application of an in situ microscope to obtain a fast stream of pseudohyphae images from agitated sample suspensions of a Saccharomyces cerevisiae strain, whose morphology in cell clusters is frequently found in the bioethanol fermentation industry. The large statistics of microscopic images allow for online determination of the principal morphological characteristics of the pseudohyphae, including the number of constituent cells, cell-size, number of branches, and length of branches. The distributions of these feature values are calculated online, constituting morphometric monitoring of the pseudohyphae population. By providing representative data, the proposed system can improve the effectiveness of morphological characterization, which in turn can help to improve the understanding and control of bioprocesses in which pseudohyphal-like morphologies are found.

DMNet: Dual-Stream Marker Guided Deep Network for Dense Cell Segmentation and Lineage Tracking

Accurate segmentation and tracking of cells in microscopy image sequences is extremely beneficial in clinical diagnostic applications and biomedical research. A continuing challenge is the segmentation of dense touching cells and deforming cells with indistinct boundaries, in low signal-to-noise-ratio images. In this paper, we present a dual-stream marker-guided network (DMNet) for segmentation of touching cells in microscopy videos of many cell types. DMNet uses an explicit cell marker-detection stream, with a separate mask-prediction stream using a distance map penalty function, which enables supervised training to focus attention on touching and nearby cells. For multi-object cell tracking we use M2Track tracking-by-detection approach with multi-step data association. Our M2Track with mask overlap includes short term track-to-cell association followed by track-to-track association to re-link tracklets with missing segmentation masks over a short sequence of frames. Our combined detection, segmentation and tracking algorithm has proven its potential on the IEEE ISBI 2021 6th Cell Tracking Challenge (CTC-6) where we achieved multiple top three rankings for diverse cell types. Our team name is MU-Ba-US, and the implementation of DMNet is available at, http://celltrackingchallenge.net/participants/MU-Ba-US/.

Automated measurement of the spontaneous tail coiling of zebrafish embryos as a sensitive behavior endpoint using a workflow in KNIME

Neuroactive substances are the largest group of chemicals detected in European surface waters. Mixtures of neuroactive substances occurring at low concentrations can induce adverse neurological effects in humans and organisms in the environment. Therefore, there is a need to develop new screening tools to detect these chemicals. Measurement of behavior or motor effects in rodents and fish are usually performed to assess potential neurotoxicity for risk assessment. However, due to pain and stress inflicted on these animals, the scientific community is advocating for new alternative methods based on the 3R principle (reduce, replace and refine). As a result, the behavior measurement of early stages of zebrafish embryos such as locomotor response, photomotor response and spontaneous tail coiling are considered as a valid alternative to adult animal testing. In this study, we developed a workflow to investigate the spontaneous tail coiling (STC) of zebrafish embryos and to accurately measure the STC effect in the KNIME software. We validated the STC protocol with 3 substances (abamectin, chlorpyrifos-oxon and pyracostrobin) which have different mechanisms of action. The KNIME workflow combined with easy and cost-effective method of video acquisition makes this STC protocol a valuable method for neurotoxicity testing.•

Video acquisition duration of 60 s at 25 ± 1 hpf was used

•

20 embryos exposed per dish and acclimatized for 30 min before video acquisition

•

Capability to inspect and correct errors for high accuracy

LLAMA: a robust and scalable machine learning pipeline for analysis of large scale 4D microscopy data: analysis of cell ruffles and filopodia

Background

With recent advances in microscopy, recordings of cell behaviour can result in terabyte-size datasets. The lattice light sheet microscope (LLSM) images cells at high speed and high 3D resolution, accumulating data at 100 frames/second over hours, presenting a major challenge for interrogating these datasets. The surfaces of vertebrate cells can rapidly deform to create projections that interact with the microenvironment. Such surface projections include spike-like filopodia and wave-like ruffles on the surface of macrophages as they engage in immune surveillance. LLSM imaging has provided new insights into the complex surface behaviours of immune cells, including revealing new types of ruffles. However, full use of these data requires systematic and quantitative analysis of thousands of projections over hundreds of time steps, and an effective system for analysis of individual structures at this scale requires efficient and robust methods with minimal user intervention.

Results

We present LLAMA, a platform to enable systematic analysis of terabyte-scale 4D microscopy datasets. We use a machine learning method for semantic segmentation, followed by a robust and configurable object separation and tracking algorithm, generating detailed object level statistics. Our system is designed to run on high-performance computing to achieve high throughput, with outputs suitable for visualisation and statistical analysis. Advanced visualisation is a key element of LLAMA: we provide a specialised tool which supports interactive quality control, optimisation, and output visualisation processes to complement the processing pipeline. LLAMA is demonstrated in an analysis of macrophage surface projections, in which it is used to i) discriminate ruffles induced by lipopolysaccharide (LPS) and macrophage colony stimulating factor (CSF-1) and ii) determine the autonomy of ruffle morphologies.

Conclusions

LLAMA provides an effective open source tool for running a cell microscopy analysis pipeline based on semantic segmentation, object analysis and tracking. Detailed numerical and visual outputs enable effective statistical analysis, identifying distinct patterns of increased activity under the two interventions considered in our example analysis. Our system provides the capacity to screen large datasets for specific structural configurations. LLAMA identified distinct features of LPS and CSF-1 induced ruffles and it identified a continuity of behaviour between tent pole ruffling, wave-like ruffling and filopodia deployment.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12859-021-04324-z.

How the variability between computer-assisted analysis procedures evaluating immune markers can influence patients' outcome prediction

Differences between computer-assisted image analysis (CAI) algorithms may cause discrepancies in the identification of immunohistochemically stained immune biomarkers in biopsies of breast cancer patients. These discrepancies have implications for their association with disease outcome. This study aims to compare three CAI procedures (A, B and C) to measure positive marker areas in post-neoadjuvant chemotherapy biopsies of patients with triple-negative breast cancer (TNBC) and to explore the differences in their performance in determining the potential association with relapse in these patients. A total of 3304 digital images of biopsy tissue obtained from 118 TNBC patients were stained for seven immune markers using immunohistochemistry (CD4, CD8, FOXP3, CD21, CD1a, CD83, HLA-DR) and were analyzed with procedures A, B and C. The three methods measure the positive pixel markers in the total tissue areas. The extent of agreement between paired CAI procedures, a principal component analysis (PCA) and Cox multivariate analysis was assessed. Comparisons of paired procedures showed close agreement for most of the immune markers at low concentration. The probability of differences between the paired procedures B/C and B/A was generally higher than those observed in C/A. The principal component analysis, largely based on data from CD8, CD1a and HLA-DR, identified two groups of patients with a significantly lower probability of relapse than the others. The multivariate regression models showed similarities in the factors associated with relapse for procedures A and C, as opposed to those obtained with procedure B. General agreement among the results of CAI procedures would not guarantee that the same predictive breast cancer markers were consistently identified. These results highlight the importance of developing additional strategies to improve the sensitivity of CAI procedures.

Weakly supervised cell instance segmentation under various conditions

Cell instance segmentation is important in biomedical research. For living cell analysis, microscopy images are captured under various conditions (e.g., the type of microscopy and type of cell). Deep-learning-based methods can be used to perform instance segmentation if sufficient annotations of individual cell boundaries are prepared as training data. Generally, annotations are required for each condition, which is very time-consuming and labor-intensive. To reduce the annotation cost, we propose a weakly supervised cell instance segmentation method that can segment individual cell regions under various conditions by only using rough cell centroid positions as training data. This method dramatically reduces the annotation cost compared with the standard annotation method of supervised segmentation. We demonstrated the efficacy of our method on various cell images; it outperformed several of the conventional weakly-supervised methods on average. In addition, we demonstrated that our method can perform instance cell segmentation without any manual annotation by using pairs of phase contrast and fluorescence images in which cell nuclei are stained as training data.

A generalized deep learning framework for whole-slide image segmentation and analysis

Histopathology tissue analysis is considered the gold standard in cancer diagnosis and prognosis. Whole-slide imaging (WSI), i.e., the scanning and digitization of entire histology slides, are now being adopted across the world in pathology labs. Trained histopathologists can provide an accurate diagnosis of biopsy specimens based on WSI data. Given the dimensionality of WSIs and the increase in the number of potential cancer cases, analyzing these images is a time-consuming process. Automated segmentation of tumorous tissue helps in elevating the precision, speed, and reproducibility of research. In the recent past, deep learning-based techniques have provided state-of-the-art results in a wide variety of image analysis tasks, including the analysis of digitized slides. However, deep learning-based solutions pose many technical challenges, including the large size of WSI data, heterogeneity in images, and complexity of features. In this study, we propose a generalized deep learning-based framework for histopathology tissue analysis to address these challenges. Our framework is, in essence, a sequence of individual techniques in the preprocessing-training-inference pipeline which, in conjunction, improve the efficiency and the generalizability of the analysis. The combination of techniques we have introduced includes an ensemble segmentation model, division of the WSI into smaller overlapping patches while addressing class imbalances, efficient techniques for inference, and an efficient, patch-based uncertainty estimation framework. Our ensemble consists of DenseNet-121, Inception-ResNet-V2, and DeeplabV3Plus, where all the networks were trained end to end for every task. We demonstrate the efficacy and improved generalizability of our framework by evaluating it on a variety of histopathology tasks including breast cancer metastases (CAMELYON), colon cancer (DigestPath), and liver cancer (PAIP). Our proposed framework has state-of-the-art performance across all these tasks and is ranked within the top 5 currently for the challenges based on these datasets. The entire framework along with the trained models and the related documentation are made freely available at GitHub and PyPi. Our framework is expected to aid histopathologists in accurate and efficient initial diagnosis. Moreover, the estimated uncertainty maps will help clinicians to make informed decisions and further treatment planning or analysis.

Objective Diagnosis for Histopathological Images Based on Machine Learning Techniques: Classical Approaches and New Trends

Histopathology refers to the examination by a pathologist of biopsy samples. Histopathology images are captured by a microscope to locate, examine, and classify many diseases, such as different cancer types. They provide a detailed view of different types of diseases and their tissue status. These images are an essential resource with which to define biological compositions or analyze cell and tissue structures. This imaging modality is very important for diagnostic applications. The analysis of histopathology images is a prolific and relevant research area supporting disease diagnosis. In this paper, the challenges of histopathology image analysis are evaluated. An extensive review of conventional and deep learning techniques which have been applied in histological image analyses is presented. This review summarizes many current datasets and highlights important challenges and constraints with recent deep learning techniques, alongside possible future research avenues. Despite the progress made in this research area so far, it is still a significant area of open research because of the variety of imaging techniques and disease-specific characteristics.

Automatic Human Dendritic Cells Segmentation Using K-Means Clustering and Chan-Vese Active Contour Model

BACKGROUND AND OBJECTIVE

Nowadays, the number of pathologies related to food are multiplied. Mycotoxins are one of the most severe food contaminants that cause serious effects on the human health. Therefore, it is necessary to develop an assessment tool for evaluating their impact on the immune response. Recently, a new investigational method using human dendritic cells was endorsed by biologists. Nevertheless, analysis of the morphological features and the behavior of these cells remains merely visual. In addition, this manual analysis is difficult and time-consuming. Here, we focus mainly on automating the evaluation process by using advanced image processing technology.

METHODS

An automatic segmentation approach of microscopic dendritic cell images is developed to provide a fast and objective evaluation. First, a combination of K-means clustering and mathematical morphology is used to detect dendritic cells. Second, a region-based Chan-Vese active contour model is used to segment the detected cells more precisely. Finally, dendritic cells are extracted by a filtering based on eccentricity measure.

RESULTS

The proposed scheme is tested on an actual dataset containing 421 microscopic dendritic cell images. The experimental results show high conformity between the results of the proposed scheme and ground-truth elaborated by biological expert. Moreover, a comparative study with other state-of-art segmentation schemes demonstrates the efficiency of the proposed method. It gives the highest average accuracy rate (99.42 %) compared to recent studied approaches.

CONCLUSIONS

The proposed image segmentation method for morphological analysis of dendrite inhibition can consistently be used as an assessment tool for biologists to facilitate the evaluation of serious health impacts of mycotoxins.

ACDC: Automated Cell Detection and Counting for Time-Lapse Fluorescence Microscopy

Advances in microscopy imaging technologies have enabled the visualization of live-cell dynamic processes using time-lapse microscopy imaging. However, modern methods exhibit several limitations related to the training phases and to time constraints, hindering their application in the laboratory practice. In this work, we present a novel method, named Automated Cell Detection and Counting (ACDC), designed for activity detection of fluorescent labeled cell nuclei in time-lapse microscopy. ACDC overcomes the limitations of the literature methods, by first applying bilateral filtering on the original image to smooth the input cell images while preserving edge sharpness, and then by exploiting the watershed transform and morphological filtering. Moreover, ACDC represents a feasible solution for the laboratory practice, as it can leverage multi-core architectures in computer clusters to efficiently handle large-scale imaging datasets. Indeed, our Parent-Workers implementation of ACDC allows to obtain up to a 3.7× speed-up compared to the sequential counterpart. ACDC was tested on two distinct cell imaging datasets to assess its accuracy and effectiveness on images with different characteristics. We achieved an accurate cell-count and nuclei segmentation without relying on large-scale annotated datasets, a result confirmed by the average Dice Similarity Coefficients of 76.84 and 88.64 and the Pearson coefficients of 0.99 and 0.96, calculated against the manual cell counting, on the two tested datasets.

Automated image analysis of stained cytospins to quantify Schwann cell purity and proliferation

In response to injury, adult Schwann cells (SCs) re-enter the cell cycle, change their expression profile, and exert repair functions important for wound healing and the re-growth of axons. While this phenotypical instability of SCs is essential for nerve regeneration, it has also been implicated in cancer progression and de-myelinating neuropathies. Thus, SCs became an important research tool to study the molecular mechanisms involved in repair and disease and to identify targets for therapeutic intervention. A high purity of isolated SC cultures used for experimentation must be demonstrated to exclude that novel findings are derived from a contaminating fibroblasts population. In addition, information about the SC proliferation status is an important parameter to be determined in response to different treatments. The evaluation of SC purity and proliferation, however, usually depends on the time consuming, manual assessment of immunofluorescence stainings or comes with the sacrifice of a large amount of SCs for flow cytometry analysis. We here show that rat SC culture derived cytospins stained for SC marker SOX10, proliferation marker EdU, intermediate filament vimentin and DAPI allowed the determination of SC identity and proliferation by requiring only a small number of cells. Furthermore, the CellProfiler software was used to develop an automated image analysis pipeline that quantified SCs and proliferating SCs from the obtained immunofluorescence images. By comparing the results of total cell count, SC purity and SC proliferation rate between manual counting and the CellProfiler output, we demonstrated applicability and reliability of the established pipeline. In conclusion, we here combined the cytospin technique, a multi-colour immunofluorescence staining panel, and an automated image analysis pipeline to enable the quantification of SC purity and SC proliferation from small cell aliquots. This procedure represents a solid read-out to simplify and standardize the quantification of primary SC culture purity and proliferation.

Automated Cell Tracking Using Motion Prediction-Based Matching and Event Handling

Automated cell segmentation and tracking enables the quantification of static and dynamic cell characteristics and is significant for disease diagnosis, treatment, drug development, and other biomedical applications. This paper introduces a method for fully automated cell tracking, lineage construction, and quantification. Cell detection is performed in the joint spatio-temporal domain by a motion diffusion-based Partial Differential Equation (PDE) combined with energy minimizing active contours. In the tracking stage, we adopt a variational joint local-global optical flow technique to determine the motion vector field. We utilize the predicted cell motion jointly with spatial cell features to define a maximum likelihood criterion to find inter-frame cell correspondences assuming Markov dependency. We formulate cell tracking and cell event detection as a graph partitioning problem. We propose a solution obtained by minimization of a global cost function defined over the set of all cell tracks. We construct a cell lineage tree that represents the cell tracks and cell events. Finally, we compute morphological, motility, and diffusivity measures and validate cell tracking against manually generated reference standards. The automated tracking method applied to reference segmentation maps produces an average tracking accuracy score ( TRA) of 99 percent, and the fully automated segmentation and tracking system produces an average TRA of 89 percent.

Prediction of Sequential Organelles Localization under Imbalance using A Balanced Deep U-Net

Assessing the structure and function of organelles in living organisms of the primitive unicellular red algae Cyanidioschyzon merolae on three-dimensional sequential images demands a reliable automated technique in the class imbalance among various cellular structures during mitosis. Existing classification networks with commonly used loss functions were focused on larger numbers of cellular structures that lead to the unreliability of the system. Hence, we proposed a balanced deep regularized weighted compound dice loss (RWCDL) network for better localization of cell organelles. Specifically, we introduced two new loss functions, namely compound dice (CD) and RWCD by implementing multi-class variant dice and weighting mechanism, respectively for maximizing weights of peroxisome and nucleus among five classes as the main contribution of this study. We extended the Unet-like convolution neural network (CNN) architecture for evaluating the ability of our proposed loss functions for improved segmentation. The feasibility of the proposed approach is confirmed with three different large scale mitotic cycle data set with different number of occurrences of cell organelles. In addition, we compared the training behavior of our designed architectures with the ground truth segmentation using various performance measures. The proposed balanced RWCDL network generated the highest area under the curve (AUC) value in elevating the small and obscure peroxisome and nucleus, which is 30% higher than the network with commonly used mean square error (MSE) and dice loss (DL) functions. The experimental results indicated that the proposed approach can efficiently identify the cellular structures, even when the contour between the cells is obscure and thus convinced that the balanced deep RWCDL approach is reliable and can be helpful for biologist to accurately identify the relationship between the cell behavior and structures of cell organelles during mitosis.

DeepSynth: Three-dimensional nuclear segmentation of biological images using neural networks trained with synthetic data

The scale of biological microscopy has increased dramatically over the past ten years, with the development of new modalities supporting collection of high-resolution fluorescence image volumes spanning hundreds of microns if not millimeters. The size and complexity of these volumes is such that quantitative analysis requires automated methods of image processing to identify and characterize individual cells. For many workflows, this process starts with segmentation of nuclei that, due to their ubiquity, ease-of-labeling and relatively simple structure, make them appealing targets for automated detection of individual cells. However, in the context of large, three-dimensional image volumes, nuclei present many challenges to automated segmentation, such that conventional approaches are seldom effective and/or robust. Techniques based upon deep-learning have shown great promise, but enthusiasm for applying these techniques is tempered by the need to generate training data, an arduous task, particularly in three dimensions. Here we present results of a new technique of nuclear segmentation using neural networks trained on synthetic data. Comparisons with results obtained using commonly-used image processing packages demonstrate that DeepSynth provides the superior results associated with deep-learning techniques without the need for manual annotation.

Nucleus segmentation across imaging experiments: the 2018 Data Science Bowl

Segmenting the nuclei of cells in microscopy images is often the first step in the quantitative analysis of imaging data for biological and biomedical applications. Many bioimage analysis tools can segment nuclei in images but need to be selected and configured for every experiment. The 2018 Data Science Bowl attracted 3,891 teams worldwide to make the first attempt to build a segmentation method that could be applied to any two-dimensional light microscopy image of stained nuclei across experiments, with no human interaction. Top participants in the challenge succeeded in this task, developing deep-learning-based models that identified cell nuclei across many image types and experimental conditions without the need to manually adjust segmentation parameters. This represents an important step toward configuration-free bioimage analysis software tools.

Assessing the Impact of Color Normalization in Convolutional Neural Network-Based Nuclei Segmentation Frameworks

Image analysis tools for cancer, such as automatic nuclei segmentation, are impacted by the inherent variation contained in pathology image data. Convolutional neural networks (CNN), demonstrate success in generalizing to variable data, illustrating great potential as a solution to the problem of data variability. In some CNN-based segmentation works for digital pathology, authors apply color normalization (CN) to reduce color variability of data as a preprocessing step prior to prediction, while others do not. Both approaches achieve reasonable performance and yet, the reasoning for utilizing this step has not been justified. It is therefore important to evaluate the necessity and impact of CN for deep learning frameworks, and its effect on downstream processes. In this paper, we evaluate the effect of popular CN methods on CNN-based nuclei segmentation frameworks.

Evaluation of Deep Learning Strategies for Nucleus Segmentation in Fluorescence Images

Identifying nuclei is often a critical first step in analyzing microscopy images of cells and classical image processing algorithms are most commonly used for this task. Recent developments in deep learning can yield superior accuracy, but typical evaluation metrics for nucleus segmentation do not satisfactorily capture error modes that are relevant in cellular images. We present an evaluation framework to measure accuracy, types of errors, and computational efficiency; and use it to compare deep learning strategies and classical approaches. We publicly release a set of 23,165 manually annotated nuclei and source code to reproduce experiments and run the proposed evaluation methodology. Our evaluation framework shows that deep learning improves accuracy and can reduce the number of biologically relevant errors by half. © 2019 The Authors. Cytometry Part A published by Wiley Periodicals, Inc. on behalf of International Society for Advancement of Cytometry.

Phasetime: Deep Learning Approach to Detect Nuclei in Time Lapse Phase Images

Time lapse microscopy is essential for quantifying the dynamics of cells, subcellular organelles and biomolecules. Biologists use different fluorescent tags to label and track the subcellular structures and biomolecules within cells. However, not all of them are compatible with time lapse imaging, and the labeling itself can perturb the cells in undesirable ways. We hypothesized that phase image has the requisite information to identify and track nuclei within cells. By utilizing both traditional blob detection to generate binary mask labels from the stained channel images and the deep learning Mask RCNN model to train a detection and segmentation model, we managed to segment nuclei based only on phase images. The detection average precision is 0.82 when the IoU threshold is to be set 0.5. And the mean IoU for masks generated from phase images and ground truth masks from experts is 0.735. Without any ground truth mask labels during the training time, this is good enough to prove our hypothesis. This result enables the ability to detect nuclei without the need for exogenous labeling.

Imaging, Visualization, and Computation in Developmental Biology

Embryonic development is highly complex and dynamic, requiring the coordination of numerous molecular and cellular events at precise times and places. Advances in imaging technology have made it possible to follow developmental processes at cellular, tissue, and organ levels over time as they take place in the intact embryo. Parallel innovations of in vivo probes permit imaging to report on molecular, physiological, and anatomical events of embryogenesis, but the resulting multidimensional data sets pose significant challenges for extracting knowledge. In this review, we discuss recent and emerging advances in imaging technologies, in vivo labeling, and data processing that offer the greatest potential for jointly deciphering the intricate cellular dynamics and the underlying molecular mechanisms. Our discussion of the emerging area of “image-omics” highlights both the challenges of data analysis and the promise of more fully embracing computation and data science for rapidly advancing our understanding of biology.

Segmenting and tracking cell instances with cosine embeddings and recurrent hourglass networks

Differently to semantic segmentation, instance segmentation assigns unique labels to each individual instance of the same object class. In this work, we propose a novel recurrent fully convolutional network architecture for tracking such instance segmentations over time, which is highly relevant, e.g., in biomedical applications involving cell growth and migration. Our network architecture incorporates convolutional gated recurrent units (ConvGRU) into a stacked hourglass network to utilize temporal information, e.g., from microscopy videos. Moreover, we train our network with a novel embedding loss based on cosine similarities, such that the network predicts unique embeddings for every instance throughout videos, even in the presence of dynamic structural changes due to mitosis of cells. To create the final tracked instance segmentations, the pixel-wise embeddings are clustered among subsequent video frames by using the mean shift algorithm. After showing the performance of the instance segmentation on a static in-house dataset of muscle fibers from H&E-stained microscopy images, we also evaluate our proposed recurrent stacked hourglass network regarding instance segmentation and tracking performance on six datasets from the ISBI celltracking challenge, where it delivers state-of-the-art results.

Three-dimensional GPU-accelerated active contours for automated localization of cells in large images

Cell segmentation in microscopy is a challenging problem, since cells are often asymmetric and densely packed. Successful cell segmentation algorithms rely identifying seed points, and are highly sensitive to variablility in cell size. In this paper, we present an efficient and highly parallel formulation for symmetric three-dimensional contour evolution that extends previous work on fast two-dimensional snakes. We provide a formulation for optimization on 3D images, as well as a strategy for accelerating computation on consumer graphics hardware. The proposed software takes advantage of Monte-Carlo sampling schemes in order to speed up convergence and reduce thread divergence. Experimental results show that this method provides superior performance for large 2D and 3D cell localization tasks when compared to existing methods on large 3D brain images.

A novel generic dictionary-based denoising method for improving noisy and densely packed nuclei segmentation in 3D time-lapse fluorescence microscopy images

Time-lapse fluorescence microscopy is an essential technique for quantifying various characteristics of cellular processes, i.e. cell survival, migration, and differentiation. To perform high-throughput quantification of cellular processes, nuclei segmentation and tracking should be performed in an automated manner. Nevertheless, nuclei segmentation and tracking are challenging tasks due to embedded noise, intensity inhomogeneity, shape variation as well as a weak boundary of nuclei. Although several nuclei segmentation approaches have been reported in the literature, dealing with embedded noise remains the most challenging part of any segmentation algorithm. We propose a novel denoising algorithm, based on sparse coding, that can both enhance very faint and noisy nuclei signal but simultaneously detect nuclei position accurately. Furthermore our method is based on a limited number of parameters, with only one being critical, which is the approximate size of the objects of interest. We also show that our denoising method coupled with classical segmentation method works properly in the context of the most challenging cases. To evaluate the performance of the proposed method, we tested our method on two datasets from the cell tracking challenge. Across all datasets, the proposed method achieved satisfactory results with 96:96% recall for the C. elegans dataset. Besides, in the Drosophila dataset, our method achieved very high recall (99:3%).

Quality assessment of Ki67 staining using cell line proliferation index and stain intensity features

Breast cancer is the most frequent cancer among women worldwide. Ki67 can be used as an immunohistochemical pseudo marker for cell proliferation to determine how aggressive the cancer is and thereby the treatment of the patient. No standard Ki67 staining protocol exists, resulting in inter-laboratory stain variability. Therefore, it is important to determine the quality control of a staining protocol to ensure correct diagnosis and treatment of patients. Currently, quality control is performed by the organization NordiQC that use an expert panel-based qualitative assessment system. However, no objective method exists to determine the quality of a staining protocol. In this study, we propose an algorithm, to objectively assess staining quality from segmented cell nuclei structures extracted from cell lines. The cell nuclei were classified into either Ki67 positive or negative to determine the Ki67 proliferation index within the cell lines. A Ki67 stain quality model based on ordinal logistic regression was developed to determine the quality of a staining protocol from features extracted from the segmented cell nuclei in the cell lines. The algorithm was able to segment and classify Ki67 positive cell nuclei with a sensitivity and positive predictive value (PPV) of 0.90 and 0.94 and Ki67 negative cell nuclei with a sensitivity and PPV of 0.78 and 0.78. The mean difference between a manual and automatic Ki67 proliferation index was -0.003 with a standard deviation of 0.056. The ordinal logistic regression model found that the stain intensity for both the Ki67 positive and Ki67 negative cell nuclei were statistically significant as parameters determining the stain quality from the cell line cores. The framework shows great promise for using cell nuclei information from cell lines to predict the staining quality of staining protocols. © 2018 International Society for Advancement of Cytometry.

Reticular adhesions are a distinct class of cell-matrix adhesions that mediate attachment during mitosis

Adhesion to the extracellular matrix persists during mitosis in most cell types. However, while classical adhesion complexes, such as focal adhesions, do and must disassemble to enable mitotic rounding, the mechanisms of residual mitotic cell-extracellular matrix adhesion remain undefined. Here, we identify 'reticular adhesions', a class of adhesion complex that is mediated by integrin αvβ5, formed during interphase, and preserved at cell-extracellular matrix attachment sites throughout cell division. Consistent with this role, integrin β5 depletion perturbs mitosis and disrupts spatial memory transmission between cell generations. Reticular adhesions are morphologically and dynamically distinct from classical focal adhesions. Mass spectrometry defines their unique composition, enriched in phosphatidylinositol-4,5-bisphosphate (PtdIns(4,5)P2)-binding proteins but lacking virtually all consensus adhesome components. Indeed, reticular adhesions are promoted by PtdIns(4,5)P2, and form independently of talin and F-actin. The distinct characteristics of reticular adhesions provide a solution to the problem of maintaining cell-extracellular matrix attachment during mitotic rounding and division.

A novel computational method for automatic segmentation, quantification and comparative analysis of immunohistochemically labeled tissue sections

Background

In the clinical practice, the objective quantification of histological results is essential not only to define objective and well-established protocols for diagnosis, treatment, and assessment, but also to ameliorate disease comprehension.

Software

The software MIAQuant_Learn presented in this work segments, quantifies and analyzes markers in histochemical and immunohistochemical images obtained by different biological procedures and imaging tools. MIAQuant_Learn employs supervised learning techniques to customize the marker segmentation process with respect to any marker color appearance. Our software expresses the location of the segmented markers with respect to regions of interest by mean-distance histograms, which are numerically compared by measuring their intersection. When contiguous tissue sections stained by different markers are available, MIAQuant_Learn aligns them and overlaps the segmented markers in a unique image enabling a visual comparative analysis of the spatial distribution of each marker (markers’ relative location). Additionally, it computes novel measures of markers’ co-existence in tissue volumes depending on their density.

Conclusions

Applications of MIAQuant_Learn in clinical research studies have proven its effectiveness as a fast and efficient tool for the automatic extraction, quantification and analysis of histological sections. It is robust with respect to several deficits caused by image acquisition systems and produces objective and reproducible results. Thanks to its flexibility, MIAQuant_Learn represents an important tool to be exploited in basic research where needs are constantly changing.

Fusion of encoder-decoder deep networks improves delineation of multiple nuclear phenotypes

BACKGROUND

Nuclear segmentation is an important step for profiling aberrant regions of histology sections. If nuclear segmentation can be resolved, then new biomarkers of nuclear phenotypes and their organization can be predicted for the application of precision medicine. However, segmentation is a complex problem as a result of variations in nuclear geometry (e.g., size, shape), nuclear type (e.g., epithelial, fibroblast), nuclear phenotypes (e.g., vesicular, aneuploidy), and overlapping nuclei. The problem is further complicated as a result of variations in sample preparation (e.g., fixation, staining). Our hypothesis is that (i) deep learning techniques can learn complex phenotypic signatures that rise in tumor sections, and (ii) fusion of different representations (e.g., regions, boundaries) contributes to improved nuclear segmentation.

RESULTS

We have demonstrated that training of deep encoder-decoder convolutional networks overcomes complexities associated with multiple nuclear phenotypes, where we evaluate alternative architecture of deep learning for an improved performance against the simplicity of the design. In addition, improved nuclear segmentation is achieved by color decomposition and combining region- and boundary-based features through a fusion network. The trained models have been evaluated against approximately 19,000 manually annotated nuclei, and object-level Precision, Recall, F1-score and Standard Error are reported with the best F1-score being 0.91. Raw training images, annotated images, processed images, and source codes are released as a part of the Additional file 1.

CONCLUSIONS

There are two intrinsic barriers in nuclear segmentation to H&E stained images, which correspond to the diversity of nuclear phenotypes and perceptual boundaries between adjacent cells. We demonstrate that (i) the encoder-decoder architecture can learn complex phenotypes that include the vesicular type; (ii) delineation of overlapping nuclei is enhanced by fusion of region- and edge-based networks; (iii) fusion of ENets produces an improved result over the fusion of UNets; and (iv) fusion of networks is better than multitask learning. We suggest that our protocol enables processing a large cohort of whole slide images for applications in precision medicine.

A probabilistic approach to joint cell tracking and segmentation in high-throughput microscopy videos

We present a novel computational framework for the analysis of high-throughput microscopy videos of living cells. The proposed framework is generally useful and can be applied to different datasets acquired in a variety of laboratory settings. This is accomplished by tying together two fundamental aspects of cell lineage construction, namely cell segmentation and tracking, via a Bayesian inference of dynamic models. In contrast to most existing approaches, which aim to be general, no assumption of cell shape is made. Spatial, temporal, and cross-sectional variation of the analysed data are accommodated by two key contributions. First, time series analysis is exploited to estimate the temporal cell shape uncertainty in addition to cell trajectory. Second, a fast marching (FM) algorithm is used to integrate the inferred cell properties with the observed image measurements in order to obtain image likelihood for cell segmentation, and association. The proposed approach has been tested on eight different time-lapse microscopy data sets, some of which are high-throughput, demonstrating promising results for the detection, segmentation and association of planar cells. Our results surpass the state of the art for the Fluo-C2DL-MSC data set of the Cell Tracking Challenge (Maška et al., 2014).

Enteroid Monolayers Reveal an Autonomous WNT and BMP Circuit Controlling Intestinal Epithelial Growth and Organization

The intestinal epithelium maintains a remarkable balance between proliferation and differentiation despite rapid cellular turnover. A central challenge is to elucidate mechanisms required for robust control of tissue renewal. Opposing WNT and BMP signaling is essential in establishing epithelial homeostasis. However, it has been difficult to disentangle contributions from multiple sources of morphogen signals in the tissue. Here, to dissect epithelial-autonomous morphogenic signaling circuits, we developed an enteroid monolayer culture system that recapitulates four key properties of the intestinal epithelium, namely the ability to maintain proliferative and differentiated zones, self-renew, polarize, and generate major intestinal cell types. We systematically perturb intrinsic and extrinsic sources of WNT and BMP signals to reveal a core morphogenic circuit that controls proliferation, tissue organization, and cell fate. Our work demonstrates the ability of intestinal epithelium, even in the absence of 3D tissue architecture, to control its own growth and organization through morphogen-mediated feedback.

Image analysis of neural stem cell division patterns in the zebrafish brain

Proliferating stem cells in the adult body are the source of constant regeneration. In the brain, neural stem cells (NSCs) divide to maintain the stem cell population and generate neural progenitor cells that eventually replenish mature neurons and glial cells. How much spatial coordination of NSC division and differentiation is present in a functional brain is an open question. To quantify the patterns of stem cell divisions, one has to (i) identify the pool of NSCs that have the ability to divide, (ii) determine NSCs that divide within a given time window, and (iii) analyze the degree of spatial coordination. Here, we present a bioimage informatics pipeline that automatically identifies GFP expressing NSCs in three-dimensional image stacks of zebrafish brain from whole-mount preparations. We exploit the fact that NSCs in the zebrafish hemispheres are located on a two-dimensional surface and identify between 1,500 and 2,500 NSCs in six brain hemispheres. We then determine the position of dividing NSCs in the hemisphere by EdU incorporation into cells undergoing S-phase and calculate all pairwise NSC distances with three alternative metrics. Finally, we fit a probabilistic model to the observed spatial patterns that accounts for the non-homogeneous distribution of NSCs. We find a weak positive coordination between dividing NSCs irrespective of the metric and conclude that neither strong inhibitory nor strong attractive signals drive NSC divisions in the adult zebrafish brain. © 2017 International Society for Advancement of Cytometry.

Modified histogram-based segmentation and adaptive distance tracking of sperm cells image sequences

Proper recognition and tracking of microscopic sperm cells in video images are vital steps of male infertility diagnosis and treatment. The segmentation and detection of sperms in microscopic image analysis is a complicate process as a result of their small sizes, fast movements, and considerable collisions. Histogram-based thresholding schemes are very popular for this purpose, since they are quite fast and provide almost acceptable results. This paper proposes a combined method for sperm cells detection, which consists of a non-linear pre-processing stage, a histogram-based thresholding algorithm, and a tracking method based on an adaptive distance scheme. The results of conducted experiments verify the superiority of the proposed scheme with incorporated Kittler algorithm compared to the other competitive methods in the majority of cases.