Combining intensity, edge and shape information for 2D and 3D segmentation of cell nuclei in tissue sections

Alterations in the properties of the cell membrane due to glycosphingolipid accumulation in a model of Gaucher disease

Gaucher disease is a lysosomal storage disease characterized by the malfunction of glucocerebrosidase resulting in the accumulation of glucosylceramide and other sphingolipids in certain cells. Although the disease symptoms are usually attributed to the storage of undigested substrate in lysosomes, here we show that glycosphingolipids accumulating in the plasma membrane cause profound changes in the properties of the membrane. The fluidity of the sphingolipid-enriched membrane decreased accompanied by the enlargement of raft-like ordered membrane domains. The mobility of non-raft proteins and lipids was severely restricted, while raft-resident components were only mildly affected. The rate of endocytosis of transferrin receptor, a non-raft protein, was significantly retarded in Gaucher cells, while the endocytosis of the raft-associated GM1 ganglioside was unaffected. Interferon-γ-induced STAT1 phosphorylation was also significantly inhibited in Gaucher cells. Atomic force microscopy revealed that sphingolipid accumulation was associated with a more compliant membrane capable of producing an increased number of nanotubes. The results imply that glycosphingolipid accumulation in the plasma membrane has significant effects on membrane properties, which may be important in the pathogenesis of Gaucher disease.

Segmentation of clustered cells in negative phase contrast images with integrated light intensity and cell shape information

Automated cell segmentation plays a key role in characterisations of cell behaviours for both biology research and clinical practices. Currently, the segmentation of clustered cells still remains as a challenge and is the main reason for false segmentation. In this study, the emphasis was put on the segmentation of clustered cells in negative phase contrast images. A new method was proposed to combine both light intensity and cell shape information through the construction of grey-weighted distance transform (GWDT) within preliminarily segmented areas. With the constructed GWDT, the clustered cells can be detected and then separated with a modified region skeleton-based method. Moreover, a contour expansion operation was applied to get optimised detection of cell boundaries. In this paper, the working principle and detailed procedure of the proposed method are described, followed by the evaluation of the method on clustered cell segmentation. Results show that the proposed method achieves an improved performance in clustered cell segmentation compared with other methods, with 85.8% and 97.16% accuracy rate for clustered cells and all cells, respectively.

Quantitative Multiplex Immunohistochemistry Reveals Myeloid-Inflamed Tumor-Immune Complexity Associated with Poor Prognosis

Here, we describe a multiplexed immunohistochemical platform with computational image processing workflows, including image cytometry, enabling simultaneous evaluation of 12 biomarkers in one formalin-fixed paraffin-embedded tissue section. To validate this platform, we used tissue microarrays containing 38 archival head and neck squamous cell carcinomas and revealed differential immune profiles based on lymphoid and myeloid cell densities, correlating with human papilloma virus status and prognosis. Based on these results, we investigated 24 pancreatic ductal adenocarcinomas from patients who received neoadjuvant GVAX vaccination and revealed that response to therapy correlated with degree of mono-myelocytic cell density and percentages of CD8⁺ T cells expressing T cell exhaustion markers. These data highlight the utility of in situ immune monitoring for patient stratification and provide digital image processing pipelines to the community for examining immune complexity in precious tissue sections, where phenotype and tissue architecture are preserved to improve biomarker discovery and assessment.

An objective comparison of cell-tracking algorithms

We present a combined report on the results of three editions of the Cell Tracking Challenge, an ongoing initiative aimed at promoting the development and objective evaluation of cell segmentation and tracking algorithms. With 21 participating algorithms and a data repository consisting of 13 data sets from various microscopy modalities, the challenge displays today's state-of-the-art methodology in the field. We analyzed the challenge results using performance measures for segmentation and tracking that rank all participating methods. We also analyzed the performance of all of the algorithms in terms of biological measures and practical usability. Although some methods scored high in all technical aspects, none obtained fully correct solutions. We found that methods that either take prior information into account using learning strategies or analyze cells in a global spatiotemporal video context performed better than other methods under the segmentation and tracking scenarios included in the challenge.

Distance constraints on activation of TRPV4 channels by AKAP150-bound PKCα in arterial myocytes

Vascular smooth muscle tone can be regulated by angiotensin II, which enhances TRPV4 channel activity via AKAP150-bound protein kinase C. Tajada et al. show that the effect of AKAP150 on TRPV4 channels is inversely proportional to the distance between them, which varies with sex and arterial bed.

TRPV4 (transient receptor potential vanilloid 4) channels are Ca²⁺-permeable channels that play a key role in regulating vascular tone. In arterial myocytes, opening of TRPV4 channels creates local increases in Ca²⁺ influx, detectable optically as “TRPV4 sparklets.” TRPV4 sparklet activity can be enhanced by the action of the vasoconstrictor angiotensin II (AngII). This modulation depends on the activation of subcellular signaling domains that comprise protein kinase C α (PKCα) bound to the anchoring protein AKAP150. Here, we used super-resolution nanoscopy, patch-clamp electrophysiology, Ca²⁺ imaging, and mathematical modeling approaches to test the hypothesis that AKAP150-dependent modulation of TRPV4 channels is critically dependent on the distance between these two proteins in the sarcolemma of arterial myocytes. Our data show that the distance between AKAP150 and TRPV4 channel clusters varies with sex and arterial bed. Consistent with our hypothesis, we further find that basal and AngII-induced TRPV4 channel activity decays exponentially as the distance between TRPV4 and AKAP150 increases. Our data suggest a maximum radius of action of ∼200 nm for local modulation of TRPV4 channels by AKAP150-associated PKCα.

Automatic extraction of cell nuclei from H&E-stained histopathological images

Extraction of cell nuclei from hematoxylin and eosin (H&E)-stained histopathological images is an essential preprocessing step in computerized image analysis for disease detection, diagnosis, and prognosis. We present an automated cell nuclei segmentation approach that works with H&E-stained images. A color deconvolution algorithm was first applied to the image to get the hematoxylin channel. Using a morphological operation and thresholding technique on the hematoxylin channel image, candidate target nuclei and background regions were detected, which were then used as markers for a marker-controlled watershed transform segmentation algorithm. Moreover, postprocessing was conducted to split the touching nuclei. For each segmented region from the previous steps, the regional maximum value positions were identified as potential nuclei centers. These maximum values were further grouped into [Formula: see text]-clusters, and the locations within each cluster were connected with the minimum spanning tree technique. Then, these connected positions were utilized as new markers for a watershed segmentation approach. The final number of nuclei at each region was determined by minimizing an objective function that iterated all of the possible [Formula: see text]-values. The proposed method was applied to the pathological images of the tumor tissues from The Cancer Genome Atlas study. Experimental results show that the proposed method can lead to promising results in terms of segmentation accuracy and separation of touching nuclei.

A novel toolbox to investigate tissue spatial organization applied to the study of the islets of Langerhans

Thanks to the development of new 3D Imaging techniques, volumetric data of thick samples, especially tissues, are commonly available. Several algorithms were proposed to analyze cells or nuclei in tissues, however these tools are limited to two dimensions. Within any given tissue, cells are not likely to be organized randomly and as such have specific patterns of cell-cell interaction forming complex communication networks. In this paper, we propose a new set of tools as an approach to segment and analyze tissues in 3D with single cell resolution. This new tool box can identify and compute the geographical location of single cells and analyze the potential physical interactions between different cell types and in 3D. As a proof-of-principle, we applied our methodology to investigation of the cyto-architecture of the islets of Langerhans in mice and monkeys. The results obtained here are a significant improvement in current methodologies and provides new insight into the organization of alpha cells and their cellular interactions within the islet’s cellular framework.

Robust detection and segmentation of cell nuclei in biomedical images based on a computational topology framework

The segmentation of cell nuclei is an important step towards the automated analysis of histological images. The presence of a large number of nuclei in whole-slide images necessitates methods that are computationally tractable in addition to being effective. In this work, a method is developed for the robust segmentation of cell nuclei in histological images based on the principles of persistent homology. More specifically, an abstract simplicial homology approach for image segmentation is established. Essentially, the approach deals with the persistence of disconnected sets in the image, thus identifying salient regions that express patterns of persistence. By introducing an image representation based on topological features, the task of segmentation is less dependent on variations of color or texture. This results in a novel approach that generalizes well and provides stable performance. The method conceptualizes regions of interest (cell nuclei) pertinent to their topological features in a successful manner. The time cost of the proposed approach is lower-bounded by an almost linear behavior and upper-bounded by O(n²) in a worst-case scenario. Time complexity matches a quasilinear behavior which is O(n^1+ɛ) for ε < 1. Images acquired from histological sections of liver tissue are used as a case study to demonstrate the effectiveness of the approach. The histological landscape consists of hepatocytes and non-parenchymal cells. The accuracy of the proposed methodology is verified against an automated workflow created by the output of a conventional filter bank (validated by experts) and the supervised training of a random forest classifier. The results are obtained on a per-object basis. The proposed workflow successfully detected both hepatocyte and non-parenchymal cell nuclei with an accuracy of 84.6%, and hepatocyte cell nuclei only with an accuracy of 86.2%. A public histological dataset with supplied ground-truth data is also used for evaluating the performance of the proposed approach (accuracy: 94.5%). Further validations are carried out with a publicly available dataset and ground-truth data from the Gland Segmentation in Colon Histology Images Challenge (GlaS) contest. The proposed method is useful for obtaining unsupervised robust initial segmentations that can be further integrated in image/data processing and management pipelines. The development of a fully automated system supporting a human expert provides tangible benefits in the context of clinical decision-making.

Evaluation of nucleus segmentation in digital pathology images through large scale image synthesis

Digital histopathology images with more than 1 Gigapixel are drawing more and more attention in clinical, biomedical research, and computer vision fields. Among the multiple observable features spanning multiple scales in the pathology images, the nuclear morphology is one of the central criteria for diagnosis and grading. As a result it is also the mostly studied target in image computing. Large amount of research papers have devoted to the problem of extracting nuclei from digital pathology images, which is the foundation of any further correlation study. However, the validation and evaluation of nucleus extraction have yet been formulated rigorously and systematically. Some researches report a human verified segmentation with thousands of nuclei, whereas a single whole slide image may contain up to million. The main obstacle lies in the difficulty of obtaining such a large number of validated nuclei, which is essentially an impossible task for pathologist. We propose a systematic validation and evaluation approach based on large scale image synthesis. This could facilitate a more quantitatively validated study for current and future histopathology image analysis field.

Automated cell tracking identifies mechanically oriented cell divisions during Drosophila axis elongation

Embryos extend their anterior-posterior (AP) axis in a conserved process known as axis elongation. Drosophila axis elongation occurs in an epithelial monolayer, the germband, and is driven by cell intercalation, cell shape changes, and oriented cell divisions at the posterior germband. Anterior germband cells also divide during axis elongation. We developed image analysis and pattern-recognition methods to track dividing cells from confocal microscopy movies in a generally applicable approach. Mesectoderm cells, forming the ventral midline, divided parallel to the AP axis, while lateral cells displayed a uniform distribution of division orientations. Mesectoderm cells did not intercalate and sustained increased AP strain before cell division. After division, mesectoderm cell density increased along the AP axis, thus relieving strain. We used laser ablation to isolate mesectoderm cells from the influence of other tissues. Uncoupling the mesectoderm from intercalating cells did not affect cell division orientation. Conversely, separating the mesectoderm from the anterior and posterior poles of the embryo resulted in uniformly oriented divisions. Our data suggest that mesectoderm cells align their division angle to reduce strain caused by mechanical forces along the AP axis of the embryo.

Machine learning and computer vision approaches for phenotypic profiling

Grys et al. review computer vision and machine-learning methods that have been applied to phenotypic profiling of image-based data. Descriptions are provided for segmentation, feature extraction, selection, and dimensionality reduction, as well as clustering, outlier detection, and classification of data.

With recent advances in high-throughput, automated microscopy, there has been an increased demand for effective computational strategies to analyze large-scale, image-based data. To this end, computer vision approaches have been applied to cell segmentation and feature extraction, whereas machine-learning approaches have been developed to aid in phenotypic classification and clustering of data acquired from biological images. Here, we provide an overview of the commonly used computer vision and machine-learning methods for generating and categorizing phenotypic profiles, highlighting the general biological utility of each approach.

Large-scale localization of touching somas from 3D images using density-peak clustering

Background

Soma localization is an important step in computational neuroscience to map neuronal circuits. However, locating somas from large-scale and complicated datasets is challenging. The challenges primarily originate from the dense distribution of somas, the diversity of soma sizes and the inhomogeneity of image contrast.

Results

We proposed a novel localization method based on density-peak clustering. In this method, we introduced two quantities (the local density ρ of each voxel and its minimum distance δ from voxels of higher density) to describe the soma imaging signal, and developed an automatic algorithm to identify the soma positions from the feature space (ρ, δ). Compared with other methods focused on high local density, our method allowed the soma center to be characterized by high local density and large minimum distance. The simulation results indicated that our method had a strong ability to locate the densely positioned somas and strong robustness of the key parameter for the localization. From the analysis of the experimental datasets, we demonstrated that our method was effective at locating somas from large-scale and complicated datasets, and was superior to current state-of-the-art methods for the localization of densely positioned somas.

Conclusions

Our method effectively located somas from large-scale and complicated datasets. Furthermore, we demonstrated the strong robustness of the key parameter for the localization and its effectiveness at a low signal-to-noise ratio (SNR) level. Thus, the method provides an effective tool for the neuroscience community to quantify the spatial distribution of neurons and the morphologies of somas.

Electronic supplementary material

The online version of this article (doi:10.1186/s12859-016-1252-x) contains supplementary material, which is available to authorized users.

Algorithms for differentiating between images of heterogeneous tissue across fluorescence microscopes

Fluorescence microscopy can be used to acquire real-time images of tissue morphology and with appropriate algorithms can rapidly quantify features associated with disease. The objective of this study was to assess the ability of various segmentation algorithms to isolate fluorescent positive features (FPFs) in heterogeneous images and identify an approach that can be used across multiple fluorescence microscopes with minimal tuning between systems. Specifically, we show a variety of image segmentation algorithms applied to images of stained tumor and muscle tissue acquired with 3 different fluorescence microscopes. Results indicate that a technique called maximally stable extremal regions followed by thresholding (MSER + Binary) yielded the greatest contrast in FPF density between tumor and muscle images across multiple microscopy systems.

High-Content Microscopy Analysis of Subcellular Structures: Assay Development and Application to Focal Adhesion Quantification

High-content analysis (HCA) converts raw light microscopy images to quantitative data through the automated extraction, multiparametric analysis, and classification of the relevant information content. Combined with automated high-throughput image acquisition, HCA applied to the screening of chemicals or RNAi-reagents is termed high-content screening (HCS). Its power in quantifying cell phenotypes makes HCA applicable also to routine microscopy. However, developing effective HCA and bioinformatic analysis pipelines for acquisition of biologically meaningful data in HCS is challenging. Here, the step-by-step development of an HCA assay protocol and an HCS bioinformatics analysis pipeline are described. The protocol's power is demonstrated by application to focal adhesion (FA) detection, quantitative analysis of multiple FA features, and functional annotation of signaling pathways regulating FA size, using primary data of a published RNAi screen. The assay and the underlying strategy are aimed at researchers performing microscopy-based quantitative analysis of subcellular features, on a small scale or in large HCS experiments. © 2016 by John Wiley & Sons, Inc.

Morphology and Phenotype of Peripheral Erythrocytes of Fish: A Rapid Screening of Images by Using Software

Many information of biological study as stained cells analysis under microscope cannot be obtained rich information like detail morphology, shape, size, proper intensity etc. but image analysis software can easily be detected all these parameters within short duration. The cells types can be yeast cells to mammalian cells. An attempt has been made to detect cellular abnormalities from an image of metronidazole (MTZ) treated compared to control images of peripheral erythrocytes of fish by using non-commercial, open-source, CellProfiler (CP) image analysis software (Ver. 2.1.0). The comparative results were obtained after analysis the software. In conclusion, this image based screening of Giemsa stained fish erythrocytes can be a suitable tool in biological research for primary toxicity prediction at DNA level alongwith cellular phenotypes. Moreover, still suggestions are needed in relation to accuracy of present analysis for Giemsa stained fish erythrocytes because previous works have been carried out images of cells with fluorescence dye.

Effects of Noninhibitory Serpin Maspin on the Actin Cytoskeleton: A Quantitative Image Modeling Approach

Recent developments in quantitative image analysis allow us to interrogate confocal microscopy images to answer biological questions. Clumped and layered cell nuclei and cytoplasm in confocal images challenges the ability to identify subcellular compartments. To date, there is no perfect image analysis method to identify cytoskeletal changes in confocal images. Here, we present a multidisciplinary study where an image analysis model was developed to allow quantitative measurements of changes in the cytoskeleton of cells with different maspin exposure. Maspin, a noninhibitory serpin influences cell migration, adhesion, invasion, proliferation, and apoptosis in ways that are consistent with its identification as a tumor metastasis suppressor. Using different cell types, we tested the hypothesis that reduction in cell migration by maspin would be reflected in the architecture of the actin cytoskeleton. A hybrid marker-controlled watershed segmentation technique was used to segment the nuclei, cytoplasm, and ruffling regions before measuring cytoskeletal changes. This was informed by immunohistochemical staining of cells transfected stably or transiently with maspin proteins, or with added bioactive peptides or protein. Image analysis results showed that the effects of maspin were mirrored by effects on cell architecture, in a way that could be described quantitatively.

Nuquantus: Machine learning software for the characterization and quantification of cell nuclei in complex immunofluorescent tissue images

Determination of fundamental mechanisms of disease often hinges on histopathology visualization and quantitative image analysis. Currently, the analysis of multi-channel fluorescence tissue images is primarily achieved by manual measurements of tissue cellular content and sub-cellular compartments. Since the current manual methodology for image analysis is a tedious and subjective approach, there is clearly a need for an automated analytical technique to process large-scale image datasets. Here, we introduce Nuquantus (Nuclei quantification utility software) - a novel machine learning-based analytical method, which identifies, quantifies and classifies nuclei based on cells of interest in composite fluorescent tissue images, in which cell borders are not visible. Nuquantus is an adaptive framework that learns the morphological attributes of intact tissue in the presence of anatomical variability and pathological processes. Nuquantus allowed us to robustly perform quantitative image analysis on remodeling cardiac tissue after myocardial infarction. Nuquantus reliably classifies cardiomyocyte versus non-cardiomyocyte nuclei and detects cell proliferation, as well as cell death in different cell classes. Broadly, Nuquantus provides innovative computerized methodology to analyze complex tissue images that significantly facilitates image analysis and minimizes human bias.

Iterative h-minima-based marker-controlled watershed for cell nucleus segmentation

Automated microscopy imaging systems facilitate high-throughput screening in molecular cellular biology research. The first step of these systems is cell nucleus segmentation, which has a great impact on the success of the overall system. The marker-controlled watershed is a technique commonly used by the previous studies for nucleus segmentation. These studies define their markers finding regional minima on the intensity/gradient and/or distance transform maps. They typically use the h-minima transform beforehand to suppress noise on these maps. The selection of the h value is critical; unnecessarily small values do not sufficiently suppress the noise, resulting in false and oversegmented markers, and unnecessarily large ones suppress too many pixels, causing missing and undersegmented markers. Because cell nuclei show different characteristics within an image, the same h value may not work to define correct markers for all the nuclei. To address this issue, in this work, we propose a new watershed algorithm that iteratively identifies its markers, considering a set of different h values. In each iteration, the proposed algorithm defines a set of candidates using a particular h value and selects the markers from those candidates provided that they fulfill the size requirement. Working with widefield fluorescence microscopy images, our experiments reveal that the use of multiple h values in our iterative algorithm leads to better segmentation results, compared to its counterparts. © 2016 International Society for Advancement of Cytometry.

Robust Nucleus/Cell Detection and Segmentation in Digital Pathology and Microscopy Images: A Comprehensive Review

Digital pathology and microscopy image analysis is widely used for comprehensive studies of cell morphology or tissue structure. Manual assessment is labor intensive and prone to interobserver variations. Computer-aided methods, which can significantly improve the objectivity and reproducibility, have attracted a great deal of interest in recent literature. Among the pipeline of building a computer-aided diagnosis system, nucleus or cell detection and segmentation play a very important role to describe the molecular morphological information. In the past few decades, many efforts have been devoted to automated nucleus/cell detection and segmentation. In this review, we provide a comprehensive summary of the recent state-of-the-art nucleus/cell segmentation approaches on different types of microscopy images including bright-field, phase-contrast, differential interference contrast, fluorescence, and electron microscopies. In addition, we discuss the challenges for the current methods and the potential future work of nucleus/cell detection and segmentation.

Survey statistics of automated segmentations applied to optical imaging of mammalian cells

BACKGROUND

The goal of this survey paper is to overview cellular measurements using optical microscopy imaging followed by automated image segmentation. The cellular measurements of primary interest are taken from mammalian cells and their components. They are denoted as two- or three-dimensional (2D or 3D) image objects of biological interest. In our applications, such cellular measurements are important for understanding cell phenomena, such as cell counts, cell-scaffold interactions, cell colony growth rates, or cell pluripotency stability, as well as for establishing quality metrics for stem cell therapies. In this context, this survey paper is focused on automated segmentation as a software-based measurement leading to quantitative cellular measurements.

METHODS

We define the scope of this survey and a classification schema first. Next, all found and manually filteredpublications are classified according to the main categories: (1) objects of interests (or objects to be segmented), (2) imaging modalities, (3) digital data axes, (4) segmentation algorithms, (5) segmentation evaluations, (6) computational hardware platforms used for segmentation acceleration, and (7) object (cellular) measurements. Finally, all classified papers are converted programmatically into a set of hyperlinked web pages with occurrence and co-occurrence statistics of assigned categories.

RESULTS

The survey paper presents to a reader: (a) the state-of-the-art overview of published papers about automated segmentation applied to optical microscopy imaging of mammalian cells, (b) a classification of segmentation aspects in the context of cell optical imaging, (c) histogram and co-occurrence summary statistics about cellular measurements, segmentations, segmented objects, segmentation evaluations, and the use of computational platforms for accelerating segmentation execution, and (d) open research problems to pursue.

CONCLUSIONS

The novel contributions of this survey paper are: (1) a new type of classification of cellular measurements and automated segmentation, (2) statistics about the published literature, and (3) a web hyperlinked interface to classification statistics of the surveyed papers at https://isg.nist.gov/deepzoomweb/resources/survey/index.html.

Digital Topology and Geometry in Medical Imaging: A Survey

Digital topology and geometry refers to the use of topologic and geometric properties and features for images defined in digital grids. Such methods have been widely used in many medical imaging applications, including image segmentation, visualization, manipulation, interpolation, registration, surface-tracking, object representation, correction, quantitative morphometry etc. Digital topology and geometry play important roles in medical imaging research by enriching the scope of target outcomes and by adding strong theoretical foundations with enhanced stability, fidelity, and efficiency. This paper presents a comprehensive yet compact survey on results, principles, and insights of methods related to digital topology and geometry with strong emphasis on understanding their roles in various medical imaging applications. Specifically, this paper reviews methods related to distance analysis and path propagation, connectivity, surface-tracking, image segmentation, boundary and centerline detection, topology preservation and local topological properties, skeletonization, and object representation, correction, and quantitative morphometry. A common thread among the topics reviewed in this paper is that their theory and algorithms use the principle of digital path connectivity, path propagation, and neighborhood analysis.

CellProfiler: Novel Automated Image Segmentation Procedure for Super-Resolution Microscopy

BACKGROUND

Super resolution (SR) microscopy enabled cell biologists to visualize subcellular details up to 20 nm in resolution. This breakthrough in spatial resolution made image analysis a challenging procedure. Direct and automated segmentation of SR images remains largely unsolved, especially when it comes to providing meaningful biological interpretations.

RESULTS

Here, we introduce a novel automated imaging analysis routine, based on Gaussian, followed by a segmentation procedure using CellProfiler software (www.cellprofiler.org). We tested this method and succeeded to segment individual nuclear pore complexes stained with gp210 and pan-FG proteins and captured by two-color STED microscopy. Test results confirmed accuracy and robustness of the method even in noisy STED images of gp210.

CONCLUSIONS

Our pipeline and novel segmentation procedure may benefit end-users of SR microscopy to analyze their images and extract biologically significant quantitative data about them in user-friendly and fully-automated settings.

TEMPy: a Python library for assessment of three-dimensional electron microscopy density fits

TEMPy is an object-oriented Python library that provides the means to validate density fits in electron microscopy reconstructions. This article highlights several features of particular interest for this purpose and includes some customized examples.

Three-dimensional electron microscopy is currently one of the most promising techniques used to study macromolecular assemblies. Rigid and flexible fitting of atomic models into density maps is often essential to gain further insights into the assemblies they represent. Currently, tools that facilitate the assessment of fitted atomic models and maps are needed. TEMPy (template and electron microscopy comparison using Python) is a toolkit designed for this purpose. The library includes a set of methods to assess density fits in intermediate-to-low resolution maps, both globally and locally. It also provides procedures for single-fit assessment, ensemble generation of fits, clustering, and multiple and consensus scoring, as well as plots and output files for visualization purposes to help the user in analysing rigid and flexible fits. The modular nature of TEMPy helps the integration of scoring and assessment of fits into large pipelines, making it a tool suitable for both novice and expert structural biologists.

In vivo cell-cycle profiling in xenograft tumors by quantitative intravital microscopy

Quantification of cell-cycle state at a single-cell level is essential to understand fundamental three-dimensional (3D) biological processes such as tissue development and cancer. Analysis of 3D in vivo images, however, is very challenging. Today's best practice, manual annotation of select image events, generates arbitrarily sampled data distributions, which are unsuitable for reliable mechanistic inferences. Here, we present an integrated workflow for quantitative in vivo cell-cycle profiling. It combines image analysis and machine learning methods for automated 3D segmentation and cell-cycle state identification of individual cell-nuclei with widely varying morphologies embedded in complex tumor environments. We applied our workflow to quantify cell-cycle effects of three antimitotic cancer drugs over 8 d in HT-1080 fibrosarcoma xenografts in living mice using a data set of 38,000 cells and compared the induced phenotypes. In contrast to results with 2D culture, observed mitotic arrest was relatively low, suggesting involvement of additional mechanisms in their antitumor effect in vivo.

Learning-guided automatic three dimensional synapse quantification for drosophila neurons

BACKGROUND

The subcellular distribution of synapses is fundamentally important for the assembly, function, and plasticity of the nervous system. Automated and effective quantification tools are a prerequisite to large-scale studies of the molecular mechanisms of subcellular synapse distribution. Common practices for synapse quantification in neuroscience labs remain largely manual or semi-manual. This is mainly due to computational challenges in automatic quantification of synapses, including large volume, high dimensions and staining artifacts. In the case of confocal imaging, optical limit and xy-z resolution disparity also require special considerations to achieve the necessary robustness.

RESULTS

A novel algorithm is presented in the paper for learning-guided automatic recognition and quantification of synaptic markers in 3D confocal images. The method developed a discriminative model based on 3D feature descriptors that detected the centers of synaptic markers. It made use of adaptive thresholding and multi-channel co-localization to improve the robustness. The detected markers then guided the splitting of synapse clumps, which further improved the precision and recall of the detected synapses. Algorithms were tested on lobula plate tangential cells (LPTCs) in the brain of Drosophila melanogaster, for GABAergic synaptic markers on axon terminals as well as dendrites.

CONCLUSIONS

The presented method was able to overcome the staining artifacts and the fuzzy boundaries of synapse clumps in 3D confocal image, and automatically quantify synaptic markers in a complex neuron such as LPTC. Comparison with some existing tools used in automatic 3D synapse quantification also proved the effectiveness of the proposed method.

Rapid 3-D delineation of cell nuclei for high-content screening platforms

High-resolution three-dimensional (3-D) microscopy combined with multiplexing of fluorescent labels allows high-content analysis of large numbers of cell nuclei. The full automation of 3-D screening platforms necessitates image processing algorithms that can accurately and robustly delineate nuclei in images with little to no human intervention. Imaging-based high-content screening was originally developed as a powerful tool for drug discovery. However, cell confluency, complexity of nuclear staining as well as poor contrast between nuclei and background result in slow and unreliable 3-D image processing and therefore negatively affect the performance of studying a drug response. Here, we propose a new method, 3D-RSD, to delineate nuclei by means of 3-D radial symmetries and test it on high-resolution image data of human cancer cells treated by drugs. The nuclei detection performance was evaluated by means of manually generated ground truth from 2351 nuclei (27 confocal stacks). When compared to three other nuclei segmentation methods, 3D-RSD possessed a better true positive rate of 83.3% and F-score of 0.895±0.045 (p-value=0.047). Altogether, 3D-RSD is a method with a very good overall segmentation performance. Furthermore, implementation of radial symmetries offers good processing speed, and makes 3D-RSD less sensitive to staining patterns. In particular, the 3D-RSD method performs well in cell lines, which are often used in imaging-based HCS platforms and are afflicted by nuclear crowding and overlaps that hinder feature extraction.

A computational approach to detect and segment cytoplasm in muscle fiber images

We developed a computational approach to detect and segment cytoplasm in microscopic images of skeletal muscle fibers. The computational approach provides computer-aided analysis of cytoplasm objects in muscle fiber images to facilitate biomedical research. Cytoplasm in muscle fibers plays an important role in maintaining the functioning and health of muscular tissues. Therefore, cytoplasm is often used as a marker in broad applications of musculoskeletal research, including our search on treatment of muscular disorders such as Duchenne muscular dystrophy, a disease that has no available treatment. However, it is often challenging to analyze cytoplasm and quantify it given the large number of images typically generated in experiments and the large number of muscle fibers contained in each image. Manual analysis is not only time consuming but also prone to human errors. In this work we developed a computational approach to detect and segment the longitudinal sections of cytoplasm based on a modified graph cuts technique and iterative splitting method to extract cytoplasm objects from the background. First, cytoplasm objects are extracted from the background using the modified graph cuts technique which is designed to optimize an energy function. Second, an iterative splitting method is designed to separate the touching or adjacent cytoplasm objects from the results of graph cuts. We tested the computational approach on real data from in vitro experiments and found that it can achieve satisfactory performance in terms of precision and recall rates.

High-throughput in vivo genotoxicity testing: an automated readout system for the somatic mutation and recombination test (SMART)

Genotoxicity testing is an important component of toxicity assessment. As illustrated by the European registration, evaluation, authorization, and restriction of chemicals (REACH) directive, it concerns all the chemicals used in industry. The commonly used in vivo mammalian tests appear to be ill adapted to tackle the large compound sets involved, due to throughput, cost, and ethical issues. The somatic mutation and recombination test (SMART) represents a more scalable alternative, since it uses Drosophila, which develops faster and requires less infrastructure. Despite these advantages, the manual scoring of the hairs on Drosophila wings required for the SMART limits its usage. To overcome this limitation, we have developed an automated SMART readout. It consists of automated imaging, followed by an image analysis pipeline that measures individual wing genotoxicity scores. Finally, we have developed a wing score-based dose-dependency approach that can provide genotoxicity profiles. We have validated our method using 6 compounds, obtaining profiles almost identical to those obtained from manual measures, even for low-genotoxicity compounds such as urethane. The automated SMART, with its faster and more reliable readout, fulfills the need for a high-throughput in vivo test. The flexible imaging strategy we describe and the analysis tools we provide should facilitate the optimization and dissemination of our methods.

Breast cancer histopathology image analysis: a review

This paper presents an overview of methods that have been proposed for the analysis of breast cancer histopathology images. This research area has become particularly relevant with the advent of whole slide imaging (WSI) scanners, which can perform cost-effective and high-throughput histopathology slide digitization, and which aim at replacing the optical microscope as the primary tool used by pathologist. Breast cancer is the most prevalent form of cancers among women, and image analysis methods that target this disease have a huge potential to reduce the workload in a typical pathology lab and to improve the quality of the interpretation. This paper is meant as an introduction for nonexperts. It starts with an overview of the tissue preparation, staining and slide digitization processes followed by a discussion of the different image processing techniques and applications, ranging from analysis of tissue staining to computer-aided diagnosis, and prognosis of breast cancer patients.

A direction-selective local-thresholding method, DSLT, in combination with a dye-based method for automated three-dimensional segmentation of cells and airspaces in developing leaves

Quantifying the anatomical data acquired from three-dimensional (3D) images has become increasingly important in recent years. Visualization and image segmentation are essential for acquiring accurate and detailed anatomical data from images; however, plant tissues such as leaves are difficult to image by confocal or multi-photon laser scanning microscopy because their airspaces generate optical aberrations. To overcome this problem, we established a staining method based on Nile Red in silicone-oil solution. Our staining method enables color differentiation between lipid bilayer membranes and airspaces, while minimizing any damage to leaf development. By repeated applications of our staining method we performed time-lapse imaging of a leaf over 5 days. To counteract the drastic decline in signal-to-noise ratio at greater tissue depths, we also developed a local thresholding method (direction-selective local thresholding, DSLT) and an automated iterative segmentation algorithm. The segmentation algorithm uses the DSLT to extract the anatomical structures. Using the proposed methods, we accurately segmented 3D images of intact leaves to single-cell resolution, and measured the airspace volumes in intact leaves.

Methods for nuclei detection, segmentation, and classification in digital histopathology: a review-current status and future potential

Digital pathology represents one of the major evolutions in modern medicine. Pathological examinations constitute the gold standard in many medical protocols, and also play a critical and legal role in the diagnosis process. In the conventional cancer diagnosis, pathologists analyze biopsies to make diagnostic and prognostic assessments, mainly based on the cell morphology and architecture distribution. Recently, computerized methods have been rapidly evolving in the area of digital pathology, with growing applications related to nuclei detection, segmentation, and classification. In cancer research, these approaches have played, and will continue to play a key (often bottleneck) role in minimizing human intervention, consolidating pertinent second opinions, and providing traceable clinical information. Pathological studies have been conducted for numerous cancer detection and grading applications, including brain, breast, cervix, lung, and prostate cancer grading. Our study presents, discusses, and extracts the major trends from an exhaustive overview of various nuclei detection, segmentation, feature computation, and classification techniques used in histopathology imagery, specifically in hematoxylin-eosin and immunohistochemical staining protocols. This study also enables us to measure the challenges that remain, in order to reach robust analysis of whole slide images, essential high content imaging with diagnostic biomarkers and prognosis support in digital pathology.

Fourier-ring descriptor to characterize rare circulating cells from images generated using immunofluorescence microscopy

We address the problem of subclassification of rare circulating cells using data driven feature selection from images of candidate circulating tumor cells from patients diagnosed with breast, prostate, or lung cancer. We determine a set of low level features which can differentiate among candidate cell types. We have implemented an image representation based on concentric Fourier rings (FRDs) which allow us to exploit size variations and morphological differences among cells while being rotationally invariant. We discuss potential clinical use in the context of treatment monitoring for cancer patients with metastatic disease.

An automated three-dimensional detection and segmentation method for touching cells by integrating concave points clustering and random walker algorithm

Characterizing cytoarchitecture is crucial for understanding brain functions and neural diseases. In neuroanatomy, it is an important task to accurately extract cell populations' centroids and contours. Recent advances have permitted imaging at single cell resolution for an entire mouse brain using the Nissl staining method. However, it is difficult to precisely segment numerous cells, especially those cells touching each other. As presented herein, we have developed an automated three-dimensional detection and segmentation method applied to the Nissl staining data, with the following two key steps: 1) concave points clustering to determine the seed points of touching cells; and 2) random walker segmentation to obtain cell contours. Also, we have evaluated the performance of our proposed method with several mouse brain datasets, which were captured with the micro-optical sectioning tomography imaging system, and the datasets include closely touching cells. Comparing with traditional detection and segmentation methods, our approach shows promising detection accuracy and high robustness.

Cellular quantitative analysis of neuroblastoma tumor and splitting overlapping cells

BACKGROUND

Neuroblastoma Tumor (NT) is one of the most aggressive types of infant cancer. Essential to accurate diagnosis and prognosis is cellular quantitative analysis of the tumor. Counting enormous numbers of cells under an optical microscope is error-prone. There is therefore an urgent demand from pathologists for robust and automated cell counting systems. However, the main challenge in developing these systems is the inability of them to distinguish between overlapping cells and single cells, and to split the overlapping cells. We address this challenge in two stages by: 1) distinguishing overlapping cells from single cells using the morphological differences between them such as area, uniformity of diameters and cell concavity; and 2) splitting overlapping cells into single cells. We propose a novel approach by using the dominant concave regions of cells as markers to identify the overlap region. We then find the initial splitting points at the critical points of the concave regions by decomposing the concave regions into their components such as arcs, chords and edges, and the distance between the components is analyzed using the developed seed growing technique. Lastly, a shortest path determination approach is developed to determine the optimum splitting route between two candidate initial splitting points.

RESULTS

We compare the cell counting results of our system with those of a pathologist as the ground-truth. We also compare the system with three state-of-the-art methods, and the results of statistical tests show a significant improvement in the performance of our system compared to state-of-the-art methods. The F-measure obtained by our system is 88.70%. To evaluate the generalizability of our algorithm, we apply it to images of follicular lymphoma, which has similar histological regions to NT. Of the algorithms tested, our algorithm obtains the highest F-measure of 92.79%.

CONCLUSION

We develop a novel overlapping cell splitting algorithm to enhance the cellular quantitative analysis of infant neuroblastoma. The performance of the proposed algorithm promises a reliable automated cell counting system for pathology laboratories. Moreover, the high performance obtained by our algorithm for images of follicular lymphoma demonstrates the generalization of the proposed algorithm for cancers with similar histological regions and histological structures.

Lineage-specific regulation of epigenetic modifier genes in human liver and brain

Despite an abundance of studies on chromatin states and dynamics, there is an astonishing dearth of information on the expression of genes responsible for regulating histone and DNA modifications. We used here a set of 156 defined epigenetic modifier genes (EMG) and profiled their expression pattern in cells of different lineages. As reference value, expression data from human embryonic stem cells (hESC) were used. Hepatocyte-like cells were generated from hESC, and their EMG expression was compared to primary human liver cells. In parallel, we generated postmitotic human neurons (Lu d6), and compared their relative EMG expression to human cortex (Ctx). Clustering analysis of all cell types showed that neuronal lineage samples grouped together (94 similarly regulated EMG), as did liver cells (61 similarly-regulated), while the two lineages were clearly distinct. The general classification was followed by detailed comparison of the major EMG groups; genes that were higher expressed in differentiated cells than in hESC included the acetyltransferase KAT2B and the methyltransferase SETD7. Neuro-specific EMGs were the histone deacetylases HDAC5 and HDAC7, and the arginine-methyltransferase PRMT8. Comparison of young (Lu d6) and more aged (Ctx) neuronal samples suggested a maturation-dependent switch in the expression of functionally homologous proteins. For instance, the ratio of the histone H3 K27 methyltransfereases, EZH1 to EZH2, was high in Ctx and low in Lu d6. The same was observed for the polycomb repressive complex 1 (PRC1) subunits CBX7 and CBX8. A large proportion of EMGs in differentiated cells was very differently expressed than in hESC, and absolute levels were significantly higher in neuronal samples than in hepatic cells. Thus, there seem to be distinct qualitative and quantitative differences in EMG expression between cell lineages.

Efficient processing of fluorescence images using directional multiscale representations

Recent advances in high-resolution fluorescence microscopy have enabled the systematic study of morphological changes in large populations of cells induced by chemical and genetic perturbations, facilitating the discovery of signaling pathways underlying diseases and the development of new pharmacological treatments. In these studies, though, due to the complexity of the data, quantification and analysis of morphological features are for the vast majority handled manually, slowing significantly data processing and limiting often the information gained to a descriptive level. Thus, there is an urgent need for developing highly efficient automated analysis and processing tools for fluorescent images. In this paper, we present the application of a method based on the shearlet representation for confocal image analysis of neurons. The shearlet representation is a newly emerged method designed to combine multiscale data analysis with superior directional sensitivity, making this approach particularly effective for the representation of objects defined over a wide range of scales and with highly anisotropic features. Here, we apply the shearlet representation to problems of soma detection of neurons in culture and extraction of geometrical features of neuronal processes in brain tissue, and propose it as a new framework for large-scale fluorescent image analysis of biomedical data.

Digital reconstruction of the cell body in dense neural circuits using a spherical-coordinated variational model

Mapping the neuronal circuits is essential to understand brain function. Recent technological advancements have made it possible to acquire the brain atlas at single cell resolution. Digital reconstruction of the neural circuits down to this level across the whole brain would significantly facilitate brain studies. However, automatic reconstruction of the dense neural connections from microscopic image still remains a challenge. Here we developed a spherical-coordinate based variational model to reconstruct the shape of the cell body i.e. soma, as one of the procedures for this purpose. When intuitively processing the volumetric images in the spherical coordinate system, the reconstruction of somas with variational model is no longer sensitive to the interference of the complicated neuronal morphology, and could automatically and robustly achieve accurate soma shape regardless of the dense spatial distribution, and diversity in cell size, and morphology. We believe this method would speed drawing the neural circuits and boost brain studies.

Current automated 3D cell detection methods are not a suitable replacement for manual stereologic cell counting

Stereologic cell counting has had a major impact on the field of neuroscience. A major bottleneck in stereologic cell counting is that the user must manually decide whether or not each cell is counted according to three-dimensional (3D) stereologic counting rules by visual inspection within hundreds of microscopic fields-of-view per investigated brain or brain region. Reliance on visual inspection forces stereologic cell counting to be very labor-intensive and time-consuming, and is the main reason why biased, non-stereologic two-dimensional (2D) “cell counting” approaches have remained in widespread use. We present an evaluation of the performance of modern automated cell detection and segmentation algorithms as a potential alternative to the manual approach in stereologic cell counting. The image data used in this study were 3D microscopic images of thick brain tissue sections prepared with a variety of commonly used nuclear and cytoplasmic stains. The evaluation compared the numbers and locations of cells identified unambiguously and counted exhaustively by an expert observer with those found by three automated 3D cell detection algorithms: nuclei segmentation from the FARSIGHT toolkit, nuclei segmentation by 3D multiple level set methods, and the 3D object counter plug-in for ImageJ. Of these methods, FARSIGHT performed best, with true-positive detection rates between 38 and 99% and false-positive rates from 3.6 to 82%. The results demonstrate that the current automated methods suffer from lower detection rates and higher false-positive rates than are acceptable for obtaining valid estimates of cell numbers. Thus, at present, stereologic cell counting with manual decision for object inclusion according to unbiased stereologic counting rules remains the only adequate method for unbiased cell quantification in histologic tissue sections.

An image processing pipeline to detect and segment nuclei in muscle fiber microscopic images

Muscle fiber images play an important role in the medical diagnosis and treatment of many muscular diseases. The number of nuclei in skeletal muscle fiber images is a key bio-marker of the diagnosis of muscular dystrophy. In nuclei segmentation one primary challenge is to correctly separate the clustered nuclei. In this article, we developed an image processing pipeline to automatically detect, segment, and analyze nuclei in microscopic image of muscle fibers. The pipeline consists of image pre-processing, identification of isolated nuclei, identification and segmentation of clustered nuclei, and quantitative analysis. Nuclei are initially extracted from background by using local Otsu's threshold. Based on analysis of morphological features of the isolated nuclei, including their areas, compactness, and major axis lengths, a Bayesian network is trained and applied to identify isolated nuclei from clustered nuclei and artifacts in all the images. Then a two-step refined watershed algorithm is applied to segment clustered nuclei. After segmentation, the nuclei can be quantified for statistical analysis. Comparing the segmented results with those of manual analysis and an existing technique, we find that our proposed image processing pipeline achieves good performance with high accuracy and precision. The presented image processing pipeline can therefore help biologists increase their throughput and objectivity in analyzing large numbers of nuclei in muscle fiber images.