Improving accuracy in astrocytomas grading by integrating a robust least squares mapping driven support vector machine classifier into a two level grade classification scheme

ASI-DBNet: An Adaptive Sparse Interactive ResNet-Vision Transformer Dual-Branch Network for the Grading of Brain Cancer Histopathological Images

Brain cancer is the deadliest cancer that occurs in the brain and central nervous system, and rapid and precise grading is essential to reduce patient suffering and improve survival. Traditional convolutional neural network (CNN)-based computer-aided diagnosis algorithms cannot fully utilize the global information of pathology images, and the recently popular vision transformer (ViT) model does not focus enough on the local details of pathology images, both of which lead to a lack of precision in the focus of the model and a lack of accuracy in the grading of brain cancer. To solve this problem, we propose an adaptive sparse interaction ResNet-ViT dual-branch network (ASI-DBNet). First, we design the ResNet-ViT parallel structure to simultaneously capture and retain the local and global information of pathology images. Second, we design the adaptive sparse interaction block (ASIB) to interact the ResNet branch with the ViT branch. Furthermore, we introduce the attention mechanism in ASIB to adaptively filter the redundant information from the dual branches during the interaction so that the feature maps delivered during the interaction are more beneficial. Intensive experiments have shown that ASI-DBNet performs best in various baseline and SOTA models, with 95.24% accuracy in four grades. In particular, for brain tumors with a high degree of deterioration (Grade III and Grade IV), the highest diagnostic accuracies achieved by ASI-DBNet are 97.93% and 96.28%, respectively, which is of great clinical significance. Meanwhile, the gradient-weighted class activation map (Grad_cam) and attention rollout visualization mechanisms are utilized to visualize the working logic behind the model, and the resulting feature maps highlight the important distinguishing features related to the diagnosis. Therefore, the interpretability and confidence of the model are improved, which is of great value for the clinical diagnosis of brain cancer.

A ViT-AMC Network With Adaptive Model Fusion and Multiobjective Optimization for Interpretable Laryngeal Tumor Grading From Histopathological Images

The tumor grading of laryngeal cancer pathological images needs to be accurate and interpretable. The deep learning model based on the attention mechanism-integrated convolution (AMC) block has good inductive bias capability but poor interpretability, whereas the deep learning model based on the vision transformer (ViT) block has good interpretability but weak inductive bias ability. Therefore, we propose an end-to-end ViT-AMC network (ViT-AMCNet) with adaptive model fusion and multiobjective optimization that integrates and fuses the ViT and AMC blocks. However, existing model fusion methods often have negative fusion: 1). There is no guarantee that the ViT and AMC blocks will simultaneously have good feature representation capability. 2). The difference in feature representations learning between the ViT and AMC blocks is not obvious, so there is much redundant information in the two feature representations. Accordingly, we first prove the feasibility of fusing the ViT and AMC blocks based on Hoeffding's inequality. Then, we propose a multiobjective optimization method to solve the problem that ViT and AMC blocks cannot simultaneously have good feature representation. Finally, an adaptive model fusion method integrating the metrics block and the fusion block is proposed to increase the differences between feature representations and improve the deredundancy capability. Our methods improve the fusion ability of ViT-AMCNet, and experimental results demonstrate that ViT-AMCNet significantly outperforms state-of-the-art methods. Importantly, the visualized interpretive maps are closer to the region of interest of concern by pathologists, and the generalization ability is also excellent. Our code is publicly available at https://github.com/Baron-Huang/ViT-AMCNet.

FABNet: Fusion Attention Block and Transfer Learning for Laryngeal cancer Tumor Grading in P63 IHC Histopathology Images

Laryngeal cancer tumor (LCT) grading is a challenging task in P63 Immunohistochemical (IHC) histopathology images due to small differences between LCT levels in pathology images, the lack of precision in lesion regions of interest (LROIs) and the paucity of LCT pathology image samples. The key to solving the LCT grading problem is to transfer knowledge from other images and to identify more accurate LROIs, but the following problems occur: 1) transferring knowledge without a priori experience often causes negative transfer and creates a heavy workload due to the abundance of image types, and 2) convolutional neural networks (CNNs) constructing deep models by stacking cannot sufficiently identify LROIs, often deviate significantly from the LROIs focused on by experienced pathologists, and are prone to providing misleading second opinions. So we propose a novel fusion attention block network (FABNet) to address these problems. First, we propose a model transfer method based on clinical a priori experience and sample analysis (CPESA) that analyzes the transfer ability by integrating clinical a priori experience using indicators such as the relationship between the cancer onset location and morphology and the texture and staining degree of cell nuclei in histopathology images; our method further validates these indicators by the probability distribution of cancer image samples. Then, we propose a fusion attention block (FAB) structure, which can both provide an advanced non-uniform sparse representation of images and extract spatial relationship information between nuclei; consequently, the LROI can be more accurate and more relevant to pathologists. We conducted extensive experiments, compared with the best Baseline model, the classification accuracy is improved 25%, and It is demonstrated that FABNet performs better on different cancer pathology image datasets and outperforms other state of the art (SOTA) models.

Generative Adversarial Networks in Medical Image Processing

BACKGROUND

The emergence of generative adversarial networks (GANs) has provided new technology and framework for the application of medical images. Specifically, a GAN requires little to no labeled data to obtain high-quality data that can be generated through competition between the generator and discriminator networks. Therefore, GANs are rapidly proving to be a state-of-the-art foundation, achieving enhanced performances in various medical applications.

METHODS

In this article, we introduce the principles of GANs and their various variants, deep convolutional GAN, conditional GAN, Wasserstein GAN, Info-GAN, boundary equilibrium GAN, and cycle-GAN.

RESULTS

All various GANs have found success in medical imaging tasks, including medical image enhancement, segmentation, classification, reconstruction, and synthesis. Furthermore, we summarize the data processing methods and evaluation indicators. Finally, we note the limitations of existing methods and the existing challenges that need to be addressed in this field.

CONCLUSION

Although GANs are in the initial stage of development in medical image processing, it will have a great prospect in the future.

Multistage Segmentation of Prostate Cancer Tissues Using Sample Entropy Texture Analysis

In this study, a multistage segmentation technique is proposed that identifies cancerous cells in prostate tissue samples. The benign areas of the tissue are distinguished from the cancerous regions using the texture of glands. The texture is modeled based on wavelet packet features along with sample entropy values. In a multistage segmentation process, the mean-shift algorithm is applied on the pre-processed images to perform a coarse segmentation of the tissue. Wavelet packets are employed in the second stage to obtain fine details of the structured shape of glands. Finally, the texture of the gland is modeled by the sample entropy values, which identifies epithelial regions from stroma patches. Although there are three stages of the proposed algorithm, the computation is fast as wavelet packet features and sample entropy values perform robust modeling for the required regions of interest. A comparative analysis with other state-of-the-art texture segmentation techniques is presented and dice ratios are computed for the comparison. It has been observed that our algorithm not only outperforms other techniques, but, by introducing sample entropy features, identification of cancerous regions of tissues is achieved with 90% classification accuracy, which shows the robustness of the proposed algorithm.

GPU-enabled design of an adaptable pattern recognition system for discriminating squamous intraepithelial lesions of the cervix

The aim of the present study was to design an adaptable pattern recognition (PR) system to discriminate low- from high-grade squamous intraepithelial lesions (LSIL and HSIL, respectively) of the cervix using microscopy images of hematoxylin and eosin (H&E)-stained biopsy material from two different medical centers. Clinical material comprised H&E-stained biopsies of 66 patients diagnosed with LSIL (34 cases) or HSIL (32 cases). Regions of interest were selected from each patient's digitized microscopy images. Seventy-seven features were generated, regarding the texture, morphology and spatial distribution of nuclei. The probabilistic neural network (PNN) classifier, the exhaustive search feature selection method, the leave-one-out (LOO) and the bootstrap validation methods were used to design the PR system and to assess its precision. Optimal PR system design and evaluation were made feasible by the employment of graphics processing unit (GPU) and Compute Unified Device Architecture (CUDA) technologies. The accuracy of the PR-system was 93% and 88.6% when using the LOO and bootstrap validation methods, respectively. The proposed PR system for discriminating LSIL from HSIL of the cervix was designed to operate in a clinical environment, having the capability of being redesigned when new verified cases are added to its repository and when data from other medical centers are included, following similar biopsy material preparation procedures.

Host Cell Prediction of Exosomes Using Morphological Features on Solid Surfaces Analyzed by Machine Learning

Exosomes are extracellular nanovesicles released from any cells and found in any body fluid. Because exosomes exhibit information of their host cells (secreting cells), their analysis is expected to be a powerful tool for early diagnosis of cancers. To predict the host cells, we extracted multidimensional feature data about size, shape, and deformation of exosomes immobilized on solid surfaces by atomic force microscopy (AFM). The key idea is combination of support vector machine (SVM) learning for individual exosome particles and their interpretation by principal component analysis (PCA). We observed exosomes derived from three different cancer cells on SiO₂/Si, 3-aminopropyltriethoxysilane-modified-SiO₂/Si, and TiO₂ substrates by AFM. Then, 14-dimensional feature vectors were extracted from AFM particle data, and classifiers were trained in 14-dimensional space. The prediction accuracy for host cells of test AFM particles was examined by the cross-validation test. As a result, we obtained prediction of exosome host cells with the best accuracy of 85.2% for two-class SVM learning and 82.6% for three-class one. By PCA of the particle classifiers, we concluded that the main factors for prediction accuracy and its strong dependence on substrates are incremental decrease in the PCA-defined aspect ratio of the particles with their volume.

Automated classification of brain tumor type in whole-slide digital pathology images using local representative tiles

Computerized analysis of digital pathology images offers the potential of improving clinical care (e.g. automated diagnosis) and catalyzing research (e.g. discovering disease subtypes). There are two key challenges thwarting computerized analysis of digital pathology images: first, whole slide pathology images are massive, making computerized analysis inefficient, and second, diverse tissue regions in whole slide images that are not directly relevant to the disease may mislead computerized diagnosis algorithms. We propose a method to overcome both of these challenges that utilizes a coarse-to-fine analysis of the localized characteristics in pathology images. An initial surveying stage analyzes the diversity of coarse regions in the whole slide image. This includes extraction of spatially localized features of shape, color and texture from tiled regions covering the slide. Dimensionality reduction of the features assesses the image diversity in the tiled regions and clustering creates representative groups. A second stage provides a detailed analysis of a single representative tile from each group. An Elastic Net classifier produces a diagnostic decision value for each representative tile. A weighted voting scheme aggregates the decision values from these tiles to obtain a diagnosis at the whole slide level. We evaluated our method by automatically classifying 302 brain cancer cases into two possible diagnoses (glioblastoma multiforme (N = 182) versus lower grade glioma (N = 120)) with an accuracy of 93.1% (p << 0.001). We also evaluated our method in the dataset provided for the 2014 MICCAI Pathology Classification Challenge, in which our method, trained and tested using 5-fold cross validation, produced a classification accuracy of 100% (p << 0.001). Our method showed high stability and robustness to parameter variation, with accuracy varying between 95.5% and 100% when evaluated for a wide range of parameters. Our approach may be useful to automatically differentiate between the two cancer subtypes.

Brain tumor classification using AFM in combination with data mining techniques

Although classification of astrocytic tumors is standardized by the WHO grading system, which is mainly based on microscopy-derived, histomorphological features, there is great interobserver variability. The main causes are thought to be the complexity of morphological details varying from tumor to tumor and from patient to patient, variations in the technical histopathological procedures like staining protocols, and finally the individual experience of the diagnosing pathologist. Thus, to raise astrocytoma grading to a more objective standard, this paper proposes a methodology based on atomic force microscopy (AFM) derived images made from histopathological samples in combination with data mining techniques. By comparing AFM images with corresponding light microscopy images of the same area, the progressive formation of cavities due to cell necrosis was identified as a typical morphological marker for a computer-assisted analysis. Using genetic programming as a tool for feature analysis, a best model was created that achieved 94.74% classification accuracy in distinguishing grade II tumors from grade IV ones. While utilizing modern image analysis techniques, AFM may become an important tool in astrocytic tumor diagnosis. By this way patients suffering from grade II tumors are identified unambiguously, having a less risk for malignant transformation. They would benefit from early adjuvant therapies.

Calculation of melatonin and resveratrol effects on steatosis hepatis using soft computing methods

In this work, beneficial effects of melatonin and resveratrol drugs on liver damage in rats, induced by application of acute and chronic carbon tetrachloride (CCl4) have been examined. The study consists of three main stages: (1) DATA ACQUISITION: light microscopic images were obtained from 60 rats separated into 10 groups after the preparation of liver tissue samples for histological examination. Rats in first five experimental groups for the four-day and the other five groups for twenty-day were examined. (2) Data processing: by the help of histograms of oriented gradient (HOG) method, obtaining low-dimensional image features (color, shape and texture) and classifying five different group characteristics by using these features with artificial neural networks (ANNs), and support vector machines (SVMs) have been provided. (3) Calculation of drug effectiveness: firstly to determine the differences between group characteristics of rats, a pilot group has been selected (diseased group-CCl4), and the responses of ANN and SVM trained by HOG features have been calculated. As a result of ANN, it has been seen that melatonin and resveratrol drugs have %65.62-%75.12 positive effects at the end of the fourth day, %84.12-%98.89 positive effects on healing steatosis hepatis at the end of the twentieth day respectively and as a result of SVM, it has been seen that melatonin and resveratrol drugs have %62.5-%68.75 positive effects at the end of the fourth day, %45.12-%60.89 positive effects on healing steatosis hepatis at the end of the twentieth day respectively.

Cascaded discrimination of normal, abnormal, and confounder classes in histopathology: Gleason grading of prostate cancer

BACKGROUND

Automated classification of histopathology involves identification of multiple classes, including benign, cancerous, and confounder categories. The confounder tissue classes can often mimic and share attributes with both the diseased and normal tissue classes, and can be particularly difficult to identify, both manually and by automated classifiers. In the case of prostate cancer, they may be several confounding tissue types present in a biopsy sample, posing as major sources of diagnostic error for pathologists. Two common multi-class approaches are one-shot classification (OSC), where all classes are identified simultaneously, and one-versus-all (OVA), where a "target" class is distinguished from all "non-target" classes. OSC is typically unable to handle discrimination of classes of varying similarity (e.g. with images of prostate atrophy and high grade cancer), while OVA forces several heterogeneous classes into a single "non-target" class. In this work, we present a cascaded (CAS) approach to classifying prostate biopsy tissue samples, where images from different classes are grouped to maximize intra-group homogeneity while maximizing inter-group heterogeneity.

RESULTS

We apply the CAS approach to categorize 2000 tissue samples taken from 214 patient studies into seven classes: epithelium, stroma, atrophy, prostatic intraepithelial neoplasia (PIN), and prostate cancer Gleason grades 3, 4, and 5. A series of increasingly granular binary classifiers are used to split the different tissue classes until the images have been categorized into a single unique class. Our automatically-extracted image feature set includes architectural features based on location of the nuclei within the tissue sample as well as texture features extracted on a per-pixel level. The CAS strategy yields a positive predictive value (PPV) of 0.86 in classifying the 2000 tissue images into one of 7 classes, compared with the OVA (0.77 PPV) and OSC approaches (0.76 PPV).

CONCLUSIONS

Use of the CAS strategy increases the PPV for a multi-category classification system over two common alternative strategies. In classification problems such as histopathology, where multiple class groups exist with varying degrees of heterogeneity, the CAS system can intelligently assign class labels to objects by performing multiple binary classifications according to domain knowledge.

An intelligent diagnosis method for rotating machinery using least squares mapping and a fuzzy neural network

This study proposes a new condition diagnosis method for rotating machinery developed using least squares mapping (LSM) and a fuzzy neural network. The non-dimensional symptom parameters (NSPs) in the time domain are defined to reflect the features of the vibration signals measured in each state. A sensitive evaluation method for selecting good symptom parameters using detection index (DI) is also proposed for detecting and distinguishing faults in rotating machinery. In order to raise the diagnosis sensitivity of the symptom parameters the synthetic symptom parameters (SSPs) are obtained by LSM. Moreover, possibility theory and the Dempster & Shafer theory (DST) are used to process the ambiguous relationship between symptoms and fault types. Finally, a sequential diagnosis method, using sequential inference and a fuzzy neural network realized by the partially-linearized neural network (PLNN), is also proposed, by which the conditions of rotating machinery can be identified sequentially. Practical examples of fault diagnosis for a roller bearing are shown to verify that the method is effective.

Support vector machines in DSC-based glioma imaging: suggestions for optimal characterization

Dynamic susceptibility contrast magnetic resonance perfusion imaging (DSC-MRI) is a useful method to characterize gliomas. Recently, support vector machines (SVMs) have been introduced as means to prospectively characterize new patients based on information from previous patients. Based on features derived from automatically segmented tumor volumes from 101 DSC-MR examinations, four different SVM models were compared. All SVM models achieved high prediction accuracies (>82%) after rebalancing the training data sets to equal amounts of samples per class. Best discrimination was obtained using a SVM model with a radial basis function kernel. A correct prediction of low-grade glioma was obtained at 83% (true positive rate) and for high-grade glioma at 91% (true negative rate) on the independent test data set. In conclusion, the combination of automated tumor segmentation followed by SVM classification is feasible. Thereby, a powerful tool is available to characterize glioma presurgically in patients.

A boosted Bayesian multiresolution classifier for prostate cancer detection from digitized needle biopsies

Diagnosis of prostate cancer (CaP) currently involves examining tissue samples for CaP presence and extent via a microscope, a time-consuming and subjective process. With the advent of digital pathology, computer-aided algorithms can now be applied to disease detection on digitized glass slides. The size of these digitized histology images (hundreds of millions of pixels) presents a formidable challenge for any computerized image analysis program. In this paper, we present a boosted Bayesian multiresolution (BBMR) system to identify regions of CaP on digital biopsy slides. Such a system would serve as an important preceding step to a Gleason grading algorithm, where the objective would be to score the invasiveness and severity of the disease. In the first step, our algorithm decomposes the whole-slide image into an image pyramid comprising multiple resolution levels. Regions identified as cancer via a Bayesian classifier at lower resolution levels are subsequently examined in greater detail at higher resolution levels, thereby allowing for rapid and efficient analysis of large images. At each resolution level, ten image features are chosen from a pool of over 900 first-order statistical, second-order co-occurrence, and Gabor filter features using an AdaBoost ensemble method. The BBMR scheme, operating on 100 images obtained from 58 patients, yielded: 1) areas under the receiver operating characteristic curve (AUC) of 0.84, 0.83, and 0.76, respectively, at the lowest, intermediate, and highest resolution levels and 2) an eightfold savings in terms of computational time compared to running the algorithm directly at full (highest) resolution. The BBMR model outperformed (in terms of AUC): 1) individual features (no ensemble) and 2) a random forest classifier ensemble obtained by bagging multiple decision tree classifiers. The apparent drop-off in AUC at higher image resolutions is due to lack of fine detail in the expert annotation of CaP and is not an artifact of the classifier. The implicit feature selection done via the AdaBoost component of the BBMR classifier reveals that different classes and types of image features become more relevant for discriminating between CaP and benign areas at different image resolutions.

Digital pathology: a tool for 21st century neuropathology

Digital pathology represents an electronic environment for performing pathologic analysis and managing the information associated with this activity. The technology to create and support digital pathology has largely developed over the last decade. The use of digital pathology tools is essential to adapt and lead in the rapidly changing environment of 21st century neuropathology. The utility of digital pathology has already been demonstrated by pathologists in several areas including consensus reviews, quality assurance (Q/A), tissue microarrays (TMAs), education and proficiency testing. These utilities notwithstanding, interface issues, storage and image formatting all present challenges to the integration of digital pathology into the neuropathology work environment. With continued technologic improvements, as well as the introduction of fluorescent side scanning and multispectral detection, future developments in digital pathology offer the promise of adding powerful analytic tools to the pathology work environment. The integration of digital pathology with biorepositories offers particular promise for neuropathologists engaged in tissue banking. The utilization of these tools will be essential for neuropathologists to continue as leaders in diagnostics, translational research and basic science in the 21st century.