Accurate HEp-2 cell classification based on Sparse Coding of Superpixels

Deep Active Learning for Automatic Mitotic Cell Detection on HEp-2 Specimen Medical Images

Identifying Human Epithelial Type 2 (HEp-2) mitotic cells is a crucial procedure in anti-nuclear antibodies (ANAs) testing, which is the standard protocol for detecting connective tissue diseases (CTD). Due to the low throughput and labor-subjectivity of the ANAs' manual screening test, there is a need to develop a reliable HEp-2 computer-aided diagnosis (CAD) system. The automatic detection of mitotic cells from the microscopic HEp-2 specimen images is an essential step to support the diagnosis process and enhance the throughput of this test. This work proposes a deep active learning (DAL) approach to overcoming the cell labeling challenge. Moreover, deep learning detectors are tailored to automatically identify the mitotic cells directly in the entire microscopic HEp-2 specimen images, avoiding the segmentation step. The proposed framework is validated using the I3A Task-2 dataset over 5-fold cross-validation trials. Using the YOLO predictor, promising mitotic cell prediction results are achieved with an average of 90.011% recall, 88.307% precision, and 81.531% mAP. Whereas, average scores of 86.986% recall, 85.282% precision, and 78.506% mAP are obtained using the Faster R-CNN predictor. Employing the DAL method over four labeling rounds effectively enhances the accuracy of the data annotation, and hence, improves the prediction performance. The proposed framework could be practically applicable to support medical personnel in making rapid and accurate decisions about the mitotic cells' existence.

Classification of HEp-2 Staining Pattern Images Using Adapted Multilayer Perceptron Neural Network-Based Intra-Class Variation of Cell Shape

There exists a growing interest from the clinical practice research communities in the development of methods to automate HEp-2 stained cells classification procedure from histopathological images. Challenges faced by these methods include variations in cell densities and cell patterns, overfitting of features, large-scale data volume and stained cells. In this paper, a multi-class multilayer perceptron technique is adapted by adding a new hidden layer to calculate the variation in the mean, scale, kurtosis and skewness of higher order spectra features of the cell shape information. The adapted technique is then jointly trained and the probability of classification calculated using a Softmax activation function. This method is proposed to address overfitting, stained and large-scale data volume problems, and classify HEp-2 staining cells into six classes. An extensive experimental analysis is studied to verify the results of the proposed method. The technique has been trained and tested on the dataset from ICPR-2014 and ICPR-2016 competitions using the Task-1. The experimental results have shown that the proposed model achieved higher accuracy of 90.3% (with data augmentation) than of 87.5% (with no data augmentation). In addition, the proposed framework is compared with existing methods, as well as, the results of methods using in ICPR2014 and ICPR2016 competitions.The results demonstrate that our proposed method effectively outperforms recent methods.

Heterogeneous ensemble with information theoretic diversity measure for human epithelial cell image classification

In this work, we propose a heterogeneous committee (ensemble) of diverse members (classification approaches) to solve the problem of human epithelial (HEp-2) cell image classification using indirect Immunofluorescence (IIF) imaging. We hypothesize that an ensemble involving different feature representations can enable higher performance if individual members in the ensemble are sufficiently varied. These members are of two types: (1) CNN-based members, (2) traditional members. For the CNN members, we have employed the well-established ResNet, DenseNet, and Inception models, which have distinctive salient aspects. For the traditional members, we incorporate class-specific features which are characterized depending on visual morphological attributes, and some standard texture features. To select the members which are discriminating and not redundant, we use an information theoretic measure which considers the trade-off between individual accuracies and diversity among the members. For all selected members, a compelling fusion required to combine their outputs to reach a final decision. Thus, we also investigate various fusion methods that combine the opinion of the committee at different levels: maximum voting, product, decision template, Bayes, Dempster-Shafer, etc. The proposed method is evaluated using ICPR-2014 data which consists of more images than some previous datasets ICPR-2012 and demonstrate state-of-the-art performance. To check the effectiveness of the proposed methodology for other related datasets, we test our methodology with newly compiled large-scale HEp-2 dataset with 63K cell images and demonstrate comparable performance even with less number of training samples. The proposed method produces 99.80% and 86.03% accuracy respectively when tested on ICPR-2014 and a new large-scale data containing 63K samples. Graphical Abstract Overview of the proposed methodology.

Binary Grey Wolf Optimizer based Feature Selection for Nucleolar and Centromere Staining Pattern Classification in Indirect Immunofluorescence Images

In this work, an attempt is made to distinguish nucleolar and centromere staining patterns using Bag-of-Keypoint Features (BoKF) model and Binary Grey Wolf Optimization (BGWO) based feature selection. Fluorescent staining patterns are produced by Indirect Immunofluorescence (IIF) Imaging and the patterns considered for this study are taken from a publicly available online database. The IIF images are pre-processed using edge-aware local contrast enhancement method. The contrast enhanced images are subjected to BoKF framework and Speeded up Robust Feature keypoints are extracted. Further, the most significant features are identified using BGWO and are fed to k-Nearest Neighbor (kNN) for classification. The results show that the BGWO features are able to classify the nucleolar and centromere patterns with an average accuracy of 91.6%. Results also indicate that the prominent features obtained using BGWO can improve the discrimination performance of IIF staining patterns. Hence it appears that the BGWO based feature selection could enable the computer aided diagnosis of autoimmune diseases.

Deep CNN for IIF Images Classification in Autoimmune Diagnostics

The diagnosis and monitoring of autoimmune diseases are very important problem in medicine. The most used test for this purpose is the antinuclear antibody (ANA) test. An indirect immunofluorescence (IIF) test performed by Human Epithelial type 2 (HEp-2) cells as substrate antigen is the most common methods to determine ANA. In this paper we present an automatic HEp-2 specimen system based on a convolutional neural network method able to classify IIF images. The system consists of a module for features extraction based on a pre-trained AlexNet network and a classification phase for the cell-pattern association using six support vector machines and a k-nearest neighbors classifier. The classification at the image-level was obtained by analyzing the pattern prevalence at cell-level. The layers of the pre-trained network and various system parameters were evaluated in order to optimize the process. This system has been developed and tested on the HEp-2 images indirect immunofluorescence images analysis (I3A) public database. To test the generalisation performance of the method, the leave-one-specimen-out procedure was used in this work. The performance analysis showed an accuracy of 96.4% and a mean class accuracy equal to 93.8%. The results have been evaluated comparing them with some of the most representative works using the same database.

An Automatic HEp-2 Specimen Analysis System Based on an Active Contours Model and an SVM Classification

The antinuclear antibody (ANA) test is widely used for screening, diagnosing, and monitoring of autoimmune diseases. The most common methods to determine ANA are indirect immunofluorescence (IIF), performed by human epithelial type 2 (HEp-2) cells, as substrate antigen. The evaluation of ANA consist an analysis of fluorescence intensity and staining patterns. This paper presents a complete and fully automatic system able to characterize IIF images. The fluorescence intensity classification was obtained by performing an image preprocessing phase and implementing a Support Vector Machines (SVM) classifier. The cells identification problem has been addressed by developing a flexible segmentation methods, based on the Hough transform for ellipses, and on an active contours model. In order to classify the HEp-2 cells, six SVM and one k-nearest neighbors (KNN)classifiers were developed. The system was tested on a public database consisting of 2080 IIF images. Unlike almost all work presented on this topic, the proposed system automatically addresses all phases of the HEp-2 image analysis process. All results have been evaluated by comparing them with some of the most representative state-of-the-art work, demonstrating the goodness of the system in the characterization of HEp-2 images.

HEp-2 Specimen Image Segmentation and Classification Using Very Deep Fully Convolutional Network

Reliable identification of Human Epithelial-2 (HEp-2) cell patterns can facilitate the diagnosis of systemic autoimmune diseases. However, traditional approach requires experienced experts to manually recognize the cell patterns, which suffers from the inter-observer variability. In this paper, an automatic pattern recognition system using fully convolutional network (FCN) was proposed to simultaneously address the segmentation and classification problem of HEp-2 specimen images. The proposed system transforms the residual network (ResNet) to fully convolutional ResNet (FCRN) enabling the network to perform semantic segmentation task. A sand-clock shape residual module is proposed to effectively and economically improve the performance of FCRN. The publicly available I3A-2014 data set was used to train the FCRN model to classify HEp-2 specimen images into seven catalogs: homogeneous, speckled, nucleolar, centromere, golgi, nuclear membrane, and mitotic spindle. The proposed system achieves a mean class accuracy of 94.94% for leave-one-out tests, which outperforms the winner of ICPR 2014, i.e., 89.93%. At the same time, our model also achieves a segmentation accuracy of 89.03%, which is 19.05% higher than that of the benchmark approach, i.e., 69.98%.