Detection of Glands and Villi by Collaboration of Domain Knowledge and Deep Learning. In: Navab N, Hornegger J, Wells WM, Frangi A, editors. Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2015. Cham: Springer International Publishing; 2015. pp. 20-7. [DOI: 10.1007/978-3-319-24571-3_3]

Efficient Liver Segmentation from Computed Tomography Images Using Deep Learning

Segmentation of a liver in computed tomography (CT) images is an important step toward quantitative biomarkers for a computer-aided decision support system and precise medical diagnosis. To overcome the difficulties that come across the liver segmentation that are affected by fuzzy boundaries, stacked autoencoder (SAE) is applied to learn the most discriminative features of the liver among other tissues in abdominal images. In this paper, we propose a patch-based deep learning method for the segmentation of a liver from CT images using SAE. Unlike the traditional machine learning methods, instead of anticipating pixel by pixel learning, our algorithm utilizes the patches to learn the representations and identify the liver area. We preprocessed the whole dataset to get the enhanced images and converted each image into many overlapping patches. These patches are given as input to SAE for unsupervised feature learning. Finally, the learned features with labels of the images are fine tuned, and the classification is performed to develop the probability map in a supervised way. Experimental results demonstrate that our proposed algorithm shows satisfactory results on test images. Our method achieved a 96.47% dice similarity coefficient (DSC), which is better than other methods in the same domain.

A computer-aided diagnosis system for differentiation and delineation of malignant regions on whole-slide prostate histopathology image using spatial statistics and multidimensional DenseNet

PURPOSE

Prostate cancer (PCa) is a major health concern in aging males, and proper management of the disease depends on accurately interpreting pathology specimens. However, reading prostatectomy histopathology slides, which is basically for staging, is usually time consuming and differs from reading small biopsy specimens, which is mainly used for diagnosis. Generally, each prostatectomy specimen generates tens of large tissue sections and for each section, the malignant region needs to be delineated to assess the amount of tumor and its burden. With the aim of reducing the workload of pathologists, in this study, we focus on developing a computer-aided diagnosis (CAD) system based on a densely connected convolutional neural network (DenseNet) for whole-slide histopathology images to outline the malignant regions.

METHODS

We use an efficient color normalization process based on ranklet transformation to automatically correct the intensity of the images. Additionally, we use spatial probability to segment the tissue structure regions for different tissue recognition patterns. Based on the segmentation, we incorporate a multidimensional structure into DenseNet to determine if a particular prostatic region is benign or malignant.

RESULTS

As demonstrated by the experimental results with a test set of 2,663 images from 32 whole-slide prostate histopathology images, our proposed system achieved 0.726, 0.6306, and 0.5209 in the average of the Dice coefficient, Jaccard similarity coefficient, and Boundary F1 score measures, respectively. Then, the accuracy, sensitivity, specificity, and the area under the ROC curve (AUC) of the proposed classification method were observed to be 95.0% (2544/2663), 96.7% (1210/1251), 93.9% (1334/1412), and 0.9831, respectively.

DISCUSSIONS

We provide a detailed discussion on how our proposed system demonstrates considerable improvement compared with similar methods considered in previous researches as well as how it can be used for delineating malignant regions.

Boosting-based Cascaded Convolutional Neural Networks for the Segmentation of CT Organs-at-risk in Nasopharyngeal Carcinoma

PURPOSE

Accurately segmenting organs-at-risk (OARs) is a key step in the effective planning of radiation therapy for nasopharyngeal carcinoma (NPC) treatment. In OAR segmentation of the head and neck CT, the low contrast and surrounding adhesion tissues of the parotids, thyroids, and optic nerves result in the difficulty in segmentation and lower accuracy of automatic segmentation for these organs than the other organs. In this paper, we propose a cascaded network structure to delineate these three OARs for NPC radiotherapy by combining deep learning and Boosting algorithm.

MATERIALS AND METHODS

The CT images of 140 NPC patients treated with radiotherapy were collected, and each of the three OAR annotations was respectively delineated by an experienced rater and reviewed by a professional radiologist (with 10 years of experience). The datasets (140 patients) were divided into a training set (100 patients), a validation set (20 patients), and a test set (20 patients). From the Boosting method for combining multiple classifiers, three cascaded CNNs for segmentation were combined. The first network was trained with the traditional approach. The second one was trained on patterns (pixels) filtered by the first net. That is, the second machine recognized a mix of patterns (pixels), 50% of which was accurately identified by the first net. Finally, the third net was trained on the new patterns (pixels) screened jointly by the first and second networks. During the test, the outputs of the three nets were considered to obtain the final output. Dice similarity coefficient (DSC), 95th percentile of the Hausdorff distance (95% HD), and volume overlap error (VOE) were used to assess the method performance.

RESULTS

The mean DSC (%) values were above 92.26 for the parotids, above 92.29 for the thyroids, and above 89.37 for the optic nerves. The mean 95% HDs (mm) were approximately 3.08 for the parotids, 2.64 for the thyroids, and 2.03 for the optic nerves. The mean VOE (%) values were approximately 14.16 for the parotids, 14.94 for the thyroids, and 19.07 for the optic nerves.

CONCLUSION

The proposed cascaded deep learning structure could achieve high performance compared with existing single-network or other segmentation algorithms.

Spatial Statistics for Segmenting Histological Structures in H&E Stained Tissue Images

Segmenting a broad class of histological structures in transmitted light and/or fluorescence-based images is a prerequisite for determining the pathological basis of cancer, elucidating spatial interactions between histological structures in tumor microenvironments (e.g., tumor infiltrating lymphocytes), facilitating precision medicine studies with deep molecular profiling, and providing an exploratory tool for pathologists. This paper focuses on segmenting histological structures in hematoxylin- and eosin-stained images of breast tissues, e.g., invasive carcinoma, carcinoma in situ, atypical and normal ducts, adipose tissue, and lymphocytes. We propose two graph-theoretic segmentation methods based on local spatial color and nuclei neighborhood statistics. For benchmarking, we curated a data set of 232 high-power field breast tissue images together with expertly annotated ground truth. To accurately model the preference for histological structures (ducts, vessels, tumor nets, adipose, etc.) over the remaining connective tissue and non-tissue areas in ground truth annotations, we propose a new region-based score for evaluating segmentation algorithms. We demonstrate the improvement of our proposed methods over the state-of-the-art algorithms in both region- and boundary-based performance measures.

A seeding-searching-ensemble method for gland segmentation in H&E-stained images

Background

Glands are vital structures found throughout the human body and their structure and function are affected by many diseases. The ability to segment and detect glands among other types of tissues is important for the study of normal and disease processes and helps their analysis and visualization by pathologists in microscopic detail.

Methods

In this paper, we develop a new approach for segmenting and detecting intestinal glands in H&E-stained histology images, which utilizes a set of advanced image processing techniques: graph search, ensemble, feature extraction, and classification. Our method is computationally fast, preserves gland boundaries robustly and detects glands accurately.

Results

We tested the performance of our gland detection and segmentation method by analyzing a dataset of over 1700 glands in digitized high resolution clinical histology images obtained from normal and diseased human intestines. The experimental results show that our method outperforms considerably the state-of-the-art methods for gland segmentation and detection.

Conclusions

Our method can produce high-quality segmentation and detection of non-overlapped glands that obey the natural property of glands in histology tissue images. With accurately detected and segmented glands, quantitative measurement and analysis can be developed for further studies of glands and computer-aided diagnosis.