Comparison of parameter-adapted segmentation methods for fluorescence micrographs

Unbiased image segmentation assessment toolkit for quantitative differentiation of state-of-the-art algorithms and pipelines

BACKGROUND

Image segmentation pipelines are commonly used in microscopy to identify cellular compartments like nucleus and cytoplasm, but there are few standards for comparing segmentation accuracy across pipelines. The process of selecting a segmentation assessment pipeline can seem daunting to researchers due to the number and variety of metrics available for evaluating segmentation quality.

RESULTS

Here we present automated pipelines to obtain a comprehensive set of 69 metrics to evaluate segmented data and propose a selection methodology for models based on quantitative analysis, dimension reduction or unsupervised classification techniques and informed selection criteria.

CONCLUSION

We show that the metrics used here can often be reduced to a small number of metrics that give a more complete understanding of segmentation accuracy, with different groups of metrics providing sensitivity to different types of segmentation error. These tools are delivered as easy to use python libraries, command line tools, Common Workflow Language Tools, and as Web Image Processing Pipeline interactive plugins to ensure a wide range of users can access and use them. We also present how our evaluation methods can be used to observe the changes in segmentations across modern machine learning/deep learning workflows and use cases.

A review of open-source image analysis tools for mammalian cell culture: algorithms, features and implementations

Cell culture is undeniably important for multiple scientific applications, including pharmaceuticals, transplants, and cosmetics. However, cell culture involves multiple manual steps, such as regularly analyzing cell images for their health and morphology. Computer scientists have developed algorithms to automate cell imaging analysis, but they are not widely adopted by biologists, especially those lacking an interactive platform. To address the issue, we compile and review existing open-source cell image processing tools that provide interactive interfaces for management and prediction tasks. We highlight the prediction tools that can detect, segment, and track different mammalian cell morphologies across various image modalities and present a comparison of algorithms and unique features of these tools, whether they work locally or in the cloud. This would guide non-experts to determine which is best suited for their purposes and, developers to acknowledge what is worth further expansion. In addition, we provide a general discussion on potential implementations of the tools for a more extensive scope, which guides the reader to not restrict them to prediction tasks only. Finally, we conclude the article by stating new considerations for the development of interactive cell imaging tools and suggesting new directions for future research.

Junction Mapper is a novel computer vision tool to decipher cell-cell contact phenotypes

Stable cell–cell contacts underpin tissue architecture and organization. Quantification of junctions of mammalian epithelia requires laborious manual measurements that are a major roadblock for mechanistic studies. We designed Junction Mapper as an open access, semi-automated software that defines the status of adhesiveness via the simultaneous measurement of pre-defined parameters at cell–cell contacts. It identifies contacting interfaces and corners with minimal user input and quantifies length, area and intensity of junction markers. Its ability to measure fragmented junctions is unique. Importantly, junctions that considerably deviate from the contiguous staining and straight contact phenotype seen in epithelia are also successfully quantified (i.e. cardiomyocytes or endothelia). Distinct phenotypes of junction disruption can be clearly differentiated among various oncogenes, depletion of actin regulators or stimulation with other agents. Junction Mapper is thus a powerful, unbiased and highly applicable software for profiling cell–cell adhesion phenotypes and facilitate studies on junction dynamics in health and disease.

Segmenting Microscopy Images of Multi-Well Plates Based on Image Contrast

Image segmentation is a key process in analyzing biological images. However, it is difficult to detect the differences between foreground and background when the image is unevenly illuminated. The unambiguous segmenting of multi-well plate microscopy images with various uneven illuminations is a challenging problem. Currently, no publicly available method adequately solves these various problems in bright-field multi-well plate images. Here, we propose a new method based on contrast values which removes the need for illumination correction. The presented method is effective enough to distinguish foreground and therefore a model organism (Caenorhabditis elegans) from an unevenly illuminated microscope image. In addition, the method also can solve a variety of problems caused by different uneven illumination scenarios. By applying this methodology across a wide range of multi-well plate microscopy images, we show that our approach can consistently analyze images with uneven illuminations with unparalleled accuracy and successfully solve various problems associated with uneven illumination. It can be used to process the microscopy images captured from multi-well plates and detect experimental subjects from an unevenly illuminated background.

A benchmark for comparison of cell tracking algorithms

Motivation: Automatic tracking of cells in multidimensional time-lapse fluorescence microscopy is an important task in many biomedical applications. A novel framework for objective evaluation of cell tracking algorithms has been established under the auspices of the IEEE International Symposium on Biomedical Imaging 2013 Cell Tracking Challenge. In this article, we present the logistics, datasets, methods and results of the challenge and lay down the principles for future uses of this benchmark.

Results: The main contributions of the challenge include the creation of a comprehensive video dataset repository and the definition of objective measures for comparison and ranking of the algorithms. With this benchmark, six algorithms covering a variety of segmentation and tracking paradigms have been compared and ranked based on their performance on both synthetic and real datasets. Given the diversity of the datasets, we do not declare a single winner of the challenge. Instead, we present and discuss the results for each individual dataset separately.

Availability and implementation: The challenge Web site (http://www.codesolorzano.com/celltrackingchallenge) provides access to the training and competition datasets, along with the ground truth of the training videos. It also provides access to Windows and Linux executable files of the evaluation software and most of the algorithms that competed in the challenge.

Contact:codesolorzano@unav.es

Supplementary information:Supplementary data are available at Bioinformatics online.

Using multi-channel level sets to measure the cytoplasmic localization of HCMV pUL97 in GFP-B-gal fusion constructs

Human cytomegalovirus UL97-encoded protein kinase (pUL97) phosphorylates cellular and viral proteins and is critical for viral replication. To quantify the efficiency of nuclear translocation and to elucidate the role of putative nuclear localization signal (NLS) elements, immunofluorescence analysis of different pUL97 expression constructs was performed. Since manual quantitation of respective expression levels lacks objectivity and reproducibility, and is time-consuming as well, a computer-based model is established. This model enables objective quantitation of the degree of cytoplasmic localization λ. To determine the degree of cytoplasmic localization of different pUL97-GFP-β-gal fusion proteins automatically, a multi-channel segmentation of the nucleus and cytoplasm of transfected HeLa cells is performed in DAPI and GFP micrographs. A watershed transform-based segmentation scheme is used for the segmentation of the cell nuclei. Subsequently, the cytoplasm is segmented using a fast marching level set method. Based on the segmentation of cell nuclei and cytoplasm, λ can be determined for each HeLa cell by quantitation of the ratio of average signal intensity outside and inside the nucleus. The degree of cytoplasmic localization of an individual construct is then determined by evaluating the average and standard deviation of λ for the corresponding HeLa cells. Evaluation demonstrates that nuclear transport of pUL97 is a multilayered mechanism resulting in different efficiencies of nuclear translocation between a small and a large isoform and objective quantitation of the cytoplasmic localization is possible with a high accuracy (96.7% and 94.3%).

Multi-scale Gaussian representation and outline-learning based cell image segmentation

Background

High-throughput genome-wide screening to study gene-specific functions, e.g. for drug discovery, demands fast automated image analysis methods to assist in unraveling the full potential of such studies. Image segmentation is typically at the forefront of such analysis as the performance of the subsequent steps, for example, cell classification, cell tracking etc., often relies on the results of segmentation.

Methods

We present a cell cytoplasm segmentation framework which first separates cell cytoplasm from image background using novel approach of image enhancement and coefficient of variation of multi-scale Gaussian scale-space representation. A novel outline-learning based classification method is developed using regularized logistic regression with embedded feature selection which classifies image pixels as outline/non-outline to give cytoplasm outlines. Refinement of the detected outlines to separate cells from each other is performed in a post-processing step where the nuclei segmentation is used as contextual information.

Results and conclusions

We evaluate the proposed segmentation methodology using two challenging test cases, presenting images with completely different characteristics, with cells of varying size, shape, texture and degrees of overlap. The feature selection and classification framework for outline detection produces very simple sparse models which use only a small subset of the large, generic feature set, that is, only 7 and 5 features for the two cases. Quantitative comparison of the results for the two test cases against state-of-the-art methods show that our methodology outperforms them with an increase of 4-9% in segmentation accuracy with maximum accuracy of 93%. Finally, the results obtained for diverse datasets demonstrate that our framework not only produces accurate segmentation but also generalizes well to different segmentation tasks.

Enhancing automated micrograph-based evaluation of LPS-stimulated macrophage spreading

To evaluate macrophage spreading in immunofluorescence images of macrophages for surface protein CD11b and nuclear counterstaining with DAPI, it is necessary to measure the size of the macrophages at different time points after stimulation. Manual evaluation of fluorescent micrographs is usually a time-consuming and error-prone task, with poor reproducibility. Automatic image analysis methods can be used to improve the results. The quality of the analysis with these methods mainly depends on the quality of the image segmentation. A segmentation and quantification scheme based on shading correction, k-means clustering, and fast marching level sets has been developed for the purpose. An initial application of this approach showed that separating touching and overlapping cells in particular suffers severely in the inevitably blurred conditions, leading to partly erroneous measurements of macrophage spreading. An alternative method of segmentation in fluorescent micrographs was therefore investigated and evaluated in this study. The proposed approach uses a methodology that separates foreground objects from background objects on the basis of Boykov's graph cuts. In this process, a rough estimation of background pixels is used for background seeds. To identify foreground seeds, a difference of Gaussian band pass filter based workflow is developed. Information on foreground and background seeds is then used for a gradient magnitude based graph cut resulting in a robust figure-ground separation method. In addition, a fast marching level set approach is used in the post-processing step, which makes it possible to split touching cells by incorporating information about the cell nuclei. An evaluation based on a total of 553 manually labeled macrophages depicted in 21 micrographs showed that the proposed method significantly improves segmentation and splitting performance for fluorescent micrographs of LPS-stimulated macrophages and reduces the rate of error in automated analysis of macrophage spreading in comparison with alternative methods.