MRI based medical image analysis: Survey on brain tumor grade classification

A computer-aided grading of glioma tumor using deep residual networks fusion

BACKGROUND AND OBJECTIVES

Among different cancer types, glioma is considered as a potentially fatal brain cancer that arises from glial cells. Early diagnosis of glioma helps the physician in offering effective treatment to the patients. Magnetic Resonance Imaging (MRI)-based Computer-Aided Diagnosis for the brain tumors has attracted a lot of attention in the literature in recent years. In this paper, we propose a novel deep learning-based computer-aided diagnosis for glioma tumors.

METHODS

The proposed method incorporates a two-level classification of gliomas. Firstly, the tumor is classified into low-or high-grade and secondly, the low-grade tumors are classified into two types based on the presence of chromosome arms 1p/19q. The feature representations of four residual networks have been used to solve the problem by utilizing transfer learning approach. Furthermore, we have fused these trained models using a novel Dempster-shafer Theory (DST)-based fusion scheme in order to enhance the classification performance. Extensive data augmentation strategies are also utilized to avoid over-fitting of the discrimination models.

RESULTS

Extensive experiments have been performed on an MRI dataset to show the effectiveness of the method. It has been found that our method achieves 95.87% accuracy for glioma classification. The results obtained by our method have also been compared with different existing methods. The comparative study reveals that our method not only outperforms traditional machine learning-based methods, but it also produces better results to state-of-the-art deep learning-based methods.

CONCLUSION

The fusion of different residual networks enhances the tumor classification performance. The experimental findings indicates that Dempster-shafer Theory (DST)-based fusion technique produces superior performance in comparison to other fusion schemes.

Cross-institutional outcome prediction for head and neck cancer patients using self-attention neural networks

In radiation oncology, predicting patient risk stratification allows specialization of therapy intensification as well as selecting between systemic and regional treatments, all of which helps to improve patient outcome and quality of life. Deep learning offers an advantage over traditional radiomics for medical image processing by learning salient features from training data originating from multiple datasets. However, while their large capacity allows to combine high-level medical imaging data for outcome prediction, they lack generalization to be used across institutions. In this work, a pseudo-volumetric convolutional neural network with a deep preprocessor module and self-attention (PreSANet) is proposed for the prediction of distant metastasis, locoregional recurrence, and overall survival occurrence probabilities within the 10 year follow-up time frame for head and neck cancer patients with squamous cell carcinoma. The model is capable of processing multi-modal inputs of variable scan length, as well as integrating patient data in the prediction model. These proposed architectural features and additional modalities all serve to extract additional information from the available data when availability to additional samples is limited. This model was trained on the public Cancer Imaging Archive Head–Neck-PET–CT dataset consisting of 298 patients undergoing curative radio/chemo-radiotherapy and acquired from 4 different institutions. The model was further validated on an internal retrospective dataset with 371 patients acquired from one of the institutions in the training dataset. An extensive set of ablation experiments were performed to test the utility of the proposed model characteristics, achieving an AUROC of \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$80\%$$\end{document}80%, \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$80\%$$\end{document}80% and \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$82\%$$\end{document}82% for DM, LR and OS respectively on the public TCIA Head–Neck-PET–CT dataset. External validation was performed on a retrospective dataset with 371 patients, achieving \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$69\%$$\end{document}69% AUROC in all outcomes. To test for model generalization across sites, a validation scheme consisting of single site-holdout and cross-validation combining both datasets was used. The mean accuracy across 4 institutions obtained was \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$72\%$$\end{document}72%, \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$70\%$$\end{document}70% and \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$71\%$$\end{document}71% for DM, LR and OS respectively. The proposed model demonstrates an effective method for tumor outcome prediction for multi-site, multi-modal combining both volumetric data and structured patient clinical data.

Intelligent Model for Brain Tumor Identification Using Deep Learning

Brain tumors can be a major cause of psychiatric complications such as depression and panic attacks. Quick and timely recognition of a brain tumor is more effective in tumor healing. The processing of medical images plays a crucial role in assisting humans in identifying different diseases. The classification of brain tumors is a significant part that depends on the expertise and knowledge of the physician. An intelligent system for detecting and classifying brain tumors is essential to help physicians. The novel feature of the study is the division of brain tumors into glioma, meningioma, and pituitary using a hierarchical deep learning method. The diagnosis and tumor classification are significant for the quick and productive cure, and medical image processing using a convolutional neural network (CNN) is giving excellent outcomes in this capacity. CNN uses the image fragments to train the data and classify them into tumor types. Hierarchical Deep Learning-Based Brain Tumor (HDL2BT) classification is proposed with the help of CNN for the detection and classification of brain tumors. The proposed system categorizes the tumor into four types: glioma, meningioma, pituitary, and no-tumor. The suggested model achieves 92.13% precision and a miss rate of 7.87%, being superior to earlier methods for detecting and segmentation brain tumors. The proposed system will provide clinical assistance in the area of medicine.

Classification of Brain MRI Tumor Images Based on Deep Learning PGGAN Augmentation

The wide prevalence of brain tumors in all age groups necessitates having the ability to make an early and accurate identification of the tumor type and thus select the most appropriate treatment plans. The application of convolutional neural networks (CNNs) has helped radiologists to more accurately classify the type of brain tumor from magnetic resonance images (MRIs). The learning of CNN suffers from overfitting if a suboptimal number of MRIs are introduced to the system. Recognized as the current best solution to this problem, the augmentation method allows for the optimization of the learning stage and thus maximizes the overall efficiency. The main objective of this study is to examine the efficacy of a new approach to the classification of brain tumor MRIs through the use of a VGG19 features extractor coupled with one of three types of classifiers. A progressive growing generative adversarial network (PGGAN) augmentation model is used to produce ‘realistic’ MRIs of brain tumors and help overcome the shortage of images needed for deep learning. Results indicated the ability of our framework to classify gliomas, meningiomas, and pituitary tumors more accurately than in previous studies with an accuracy of 98.54%. Other performance metrics were also examined.

Brain tumor detection and classification using machine learning: a comprehensive survey

Brain tumor occurs owing to uncontrolled and rapid growth of cells. If not treated at an initial phase, it may lead to death. Despite many significant efforts and promising outcomes in this domain, accurate segmentation and classification remain a challenging task. A major challenge for brain tumor detection arises from the variations in tumor location, shape, and size. The objective of this survey is to deliver a comprehensive literature on brain tumor detection through magnetic resonance imaging to help the researchers. This survey covered the anatomy of brain tumors, publicly available datasets, enhancement techniques, segmentation, feature extraction, classification, and deep learning, transfer learning and quantum machine learning for brain tumors analysis. Finally, this survey provides all important literature for the detection of brain tumors with their advantages, limitations, developments, and future trends.

Automatic brain tumour diagnostic method based on a back propagation neural network and an extended set-membership filter

BACKGROUND

Diagnosing brain tumours remains a challenging task in clinical practice. Despite their questionable accuracy, magnetic resonance image (MRI) scans are presently considered the optimal facility for assessing the growth of tumours. However, the efficiency of manual diagnosis is low, and high computational cost and poor convergence restrict the application of machine learning methods. This study aims to design a method that can reliably diagnose brain tumours from MRI scans.

METHODS

First, image pre-processing (which includes background removal, size standardization, noise removal, and contrast enhancement) is utilized to normalize the images. Then, grey level co-occurrence matrix features are selected as texture features of the brain MRI scans. Finally, a method combining a back propagation neural network (BPNN) and an extended set-membership filter (ESMF) is proposed to classify features and perform image classification.

RESULTS

A total of 304 patient MRI series (247 images of brains with tumours and 57 images of normal brains) were included and assessed in this study. The results revealed that our proposed method can achieve an accuracy of 95.40% and has classification accuracies of 97.14% and 88.24% for brain tumour and normal brain, respectively.

CONCLUSION

This study proposes an automatic brain tumour detection model constructed using a combination of BPNN and ESMF. The model is found to be able to accurately classify brain MRI scans as normal or tumour images.

What is the current clinico-radiological diagnostic accuracy for intracranial tumours?

OBJECTIVE

To determine the diagnostic accuracy of routine clinico-radiological workup for a population-based selection of intracranial tumours.

METHODS

In this prospective cohort study, we included consecutive adult patients who underwent a primary surgical intervention for a suspected intracranial tumour between 2015 and 2019 at a single-neurosurgical centre. The treating team estimated the expected diagnosis prior to surgery using predefined groups. The expected diagnosis was compared to final histopathology and the accuracy of preoperative clinico-radiological diagnosis (sensitivity, specificity, positive and negative predictive values) was calculated.

RESULTS

392 patients were included in the data analysis, of whom 319 underwent a primary surgical resection and 73 were operated with a diagnostic biopsy only. The diagnostic accuracy varied between different tumour types. The overall sensitivity, specificity and diagnostic mismatch rate of clinico-radiological diagnosis was 85.8%, 97.7% and 4.0%, respectively. For gliomas (including differentiation between low-grade and high-grade gliomas), the same diagnostic accuracy measures were found to be 82.2%, 97.2% and 5.6%, respectively. The most common diagnostic mismatch was between low-grade gliomas, high-grade gliomas and metastases. Accuracy of 90.2% was achieved for differentiation between diffuse low-grade gliomas and high-grade gliomas.

CONCLUSIONS

The current accuracy of a preoperative clinico-radiological diagnosis of brain tumours is high. Future non-invasive diagnostic methods need to outperform our results in order to add much value in a routine clinical setting in unselected patients.

Multimodal Disentangled Variational Autoencoder with Game Theoretic Interpretability for Glioma grading

Effective fusion of multimodal magnetic resonance imaging (MRI) is of great significance to boost the accuracy of glioma grading thanks to the complementary information provided by different imaging modalities. However, how to extract the common and distinctive information from MRI to achieve complementarity is still an open problem in information fusion research. In this study, we propose a deep neural network model termed as multimodal disentangled variational autoencoder (MMD-VAE) for glioma grading based on radiomics features extracted from preoperative multimodal MRI images. Specifically, the radiomics features are quantized and extracted from the region of interest for each modality. Then, the latent representations of variational autoencoder for these features are disentangled into common and distinctive representations to obtain the shared and complementary data among modalities. Afterward, cross-modality reconstruction loss and common-distinctive loss are designed to ensure the effectiveness of the disentangled representations. Finally, the disentangled common and distinctive representations are fused to predict the glioma grades, and SHapley Additive exPlanations (SHAP) is adopted to quantitatively interpret and analyze the contribution of the important features to grading. Experimental results on two benchmark datasets demonstrate that the proposed MMD-VAE model achieves encouraging predictive performance (AUC:0.9939) on a public dataset, and good generalization performance (AUC:0.9611) on a cross-institutional private dataset. These quantitative results and interpretations may help radiologists understand gliomas better and make better treatment decisions for improving clinical outcomes.

3D brain glioma segmentation in MRI through integrating multiple densely connected 2D convolutional neural networks

To overcome the computational burden of processing three-dimensional (3D) medical scans and the lack of spatial information in two-dimensional (2D) medical scans, a novel segmentation method was proposed that integrates the segmentation results of three densely connected 2D convolutional neural networks (2D-CNNs). In order to combine the low-level features and high-level features, we added densely connected blocks in the network structure design so that the low-level features will not be missed as the network layer increases during the learning process. Further, in order to resolve the problems of the blurred boundary of the glioma edema area, we superimposed and fused the T2-weighted fluid-attenuated inversion recovery (FLAIR) modal image and the T2-weighted (T2) modal image to enhance the edema section. For the loss function of network training, we improved the cross-entropy loss function to effectively avoid network over-fitting. On the Multimodal Brain Tumor Image Segmentation Challenge (BraTS) datasets, our method achieves dice similarity coefficient values of 0.84, 0.82, and 0.83 on the BraTS2018 training; 0.82, 0.85, and 0.83 on the BraTS2018 validation; and 0.81, 0.78, and 0.83 on the BraTS2013 testing in terms of whole tumors, tumor cores, and enhancing cores, respectively. Experimental results showed that the proposed method achieved promising accuracy and fast processing, demonstrating good potential for clinical medicine.

Brain Tumor MR Image Classification Using Convolutional Dictionary Learning With Local Constraint

Brain tumor image classification is an important part of medical image processing. It assists doctors to make accurate diagnosis and treatment plans. Magnetic resonance (MR) imaging is one of the main imaging tools to study brain tissue. In this article, we propose a brain tumor MR image classification method using convolutional dictionary learning with local constraint (CDLLC). Our method integrates the multi-layer dictionary learning into a convolutional neural network (CNN) structure to explore the discriminative information. Encoding a vector on a dictionary can be considered as multiple projections into new spaces, and the obtained coding vector is sparse. Meanwhile, in order to preserve the geometric structure of data and utilize the supervised information, we construct the local constraint of atoms through a supervised k-nearest neighbor graph, so that the discrimination of the obtained dictionary is strong. To solve the proposed problem, an efficient iterative optimization scheme is designed. In the experiment, two clinically relevant multi-class classification tasks on the Cheng and REMBRANDT datasets are designed. The evaluation results demonstrate that our method is effective for brain tumor MR image classification, and it could outperform other comparisons.

Role of deep learning in brain tumor detection and classification (2015 to 2020): A review

During the last decade, computer vision and machine learning have revolutionized the world in every way possible. Deep Learning is a sub field of machine learning that has shown remarkable results in every field especially biomedical field due to its ability of handling huge amount of data. Its potential and ability have also been applied and tested in the detection of brain tumor using MRI images for effective prognosis and has shown remarkable performance. The main objective of this research work is to present a detailed critical analysis of the research and findings already done to detect and classify brain tumor through MRI images in the recent past. This analysis is specifically beneficial for the researchers who are experts of deep learning and are interested to apply their expertise for brain tumor detection and classification. As a first step, a brief review of the past research papers using Deep Learning for brain tumor classification and detection is carried out. Afterwards, a critical analysis of Deep Learning techniques proposed in these research papers (2015-2020) is being carried out in the form of a Table. Finally, the conclusion highlights the merits and demerits of deep neural networks. The results formulated in this paper will provide a thorough comparison of recent studies to the future researchers, along with the idea of the effectiveness of various deep learning approaches. We are confident that this study would greatly assist in advancement of brain tumor research.

Data mining and XBRL integration in management accounting information based on artificial intelligence

In today’s society, the application of information technology is becoming more and more extensive. At the same time, management accounting, as an important branch of modern accounting, also ushered in new development opportunities, and the research of data mining also pays more attention to the combination of theory and practice. Therefore, data mining can provide some technical support for the implementation of strategic management accounting. Because the most important thing of management accounting informatization is to process, calculate and transmit the business information of the enterprise through the corresponding information processing platform through the use of computer technology, and provide the corresponding data to the management of the major companies in order to better analyze and make decisions and perfect the future development strategy of the enterprise, so the screening of the corresponding technology is more important in the process of management accounting informatization. Based on the development of artificial intelligence technology and the combination of data mining and XBRL technology, this paper discusses the new strategies of contemporary management accounting development.

A hybrid approach based on multiple Eigenvalues selection (MES) for the automated grading of a brain tumor using MRI

BACKGROUND AND OBJECTIVE

The manual segmentation, identification, and classification of brain tumor using magnetic resonance (MR) images are essential for making a correct diagnosis. It is, however, an exhausting and time consuming task performed by clinical experts and the accuracy of the results is subject to their point of view. Computer aided technology has therefore been developed to computerize these procedures.

METHODS

In order to improve the outcomes and decrease the complications involved in the process of analysing medical images, this study has investigated several methods. These include: a Local Difference in Intensity - Means (LDI-Means) based brain tumor segmentation, Mutual Information (MI) based feature selection, Singular Value Decomposition (SVD) based dimensionality reduction, and both Support Vector Machine (SVM) and Multi-Layer Perceptron (MLP) based brain tumor classification. Also, this study has presented a new method named Multiple Eigenvalues Selection (MES) to choose the most meaningful features as inputs to the classifiers. This combination between unsupervised and supervised techniques formed an effective system for the grading of brain glioma.

RESULTS

The experimental results of the proposed method showed an excellent performance in terms of accuracy, recall, specificity, precision, and error rate. They are 91.02%,86.52%, 94.26%, 87.07%, and 0.0897 respectively.

CONCLUSION

The obtained results prove the significance and effectiveness of the proposed method in comparison to other state-of-the-art techniques and it can have in the contribution to an early diagnosis of brain glioma.

Application research of automobile modeling optimization design based on virtual reality technology

Automobile styling design is an important part of the design chain. In the traditional automobile modeling evaluation, the process of project evaluation is more in-depth, and designers exchange ideas. Different designers have different evaluations of automobile styling. The evaluation process lasts a long time, which leads to the design cycle being too long and the efficiency of automobile modeling evaluation is greatly reduced. The introduction of virtual reality in automobile modeling evaluation can effectively optimize the evaluation process and promote the rapid adjustment of the model on the basis of development. From the virtual reality system based on mechanical engineering, we only need the parameters of the car model to observe the actual situation through VR technology, and use the measurement tools to directly and accurately evaluate the driver’s field of vision. Through the application of virtual reality technology in the automobile design stage, the interactive and network-based remote research on automobile modeling will also make the automobile design process more convenient, easier to communicate with designers, and reduce the development cycle and cost of automobile design.

A novel extended Kalman filter with support vector machine based method for the automatic diagnosis and segmentation of brain tumors

BACKGROUND

Brain tumors are life-threatening, and their early detection is crucial for improving survival rates. Conventionally, brain tumors are detected by radiologists based on their clinical experience. However, this process is inefficient. This paper proposes a machine learning-based method to 1) determine the presence of a tumor, 2) automatically segment the tumor, and 3) classify it as benign or malignant.

METHODS

We implemented an Extended Kalman Filter with Support Vector Machine (EKF-SVM), an image analysis platform based on an SVM for automated brain tumor detection. A development dataset of 120 patients which supported by Tiantan Hospital was used for algorithm training. Our machine learning algorithm has 5 components as follows. Firstly, image standardization is applied to all the images. This is followed by noise removal with a non-local means filter, and contrast enhancement with improved dynamic histogram equalization. Secondly, a gray-level co-occurrence matrix is utilized for feature extraction to get the image features. Thirdly, the extracted features are fed into a SVM for classify the MRI initially, and an EKF is used to classify brain tumors in the brain MRIs. Fourthly, cross-validation is used to verify the accuracy of the classifier. Finally, an automatic segmentation method based on the combination of k-means clustering and region growth is used for detecting brain tumors.

RESULTS

With regard to the diagnostic performance, the EKF-SVM had a 96.05% accuracy for automatically classifying brain tumors. Segmentation based on k-means clustering was capable of identifying the tumor boundaries and extracting the whole tumor.

CONCLUSION

The proposed EKF-SVM based method has better classification performance for positive brain tumor images, which was mainly due to the dearth of negative examples in our dataset. Therefore, future work should obtain more negative examples and investigate the performance of deep learning algorithms such as the convolutional neural networks for automatic diagnosis and segmentation of brain tumors.

A Deep Learning Approach for Brain Tumor Classification and Segmentation Using a Multiscale Convolutional Neural Network

In this paper, we present a fully automatic brain tumor segmentation and classification model using a Deep Convolutional Neural Network that includes a multiscale approach. One of the differences of our proposal with respect to previous works is that input images are processed in three spatial scales along different processing pathways. This mechanism is inspired in the inherent operation of the Human Visual System. The proposed neural model can analyze MRI images containing three types of tumors: meningioma, glioma, and pituitary tumor, over sagittal, coronal, and axial views and does not need preprocessing of input images to remove skull or vertebral column parts in advance. The performance of our method on a publicly available MRI image dataset of 3064 slices from 233 patients is compared with previously classical machine learning and deep learning published methods. In the comparison, our method remarkably obtained a tumor classification accuracy of 0.973, higher than the other approaches using the same database.

Deep Learning for Multigrade Brain Tumor Classification in Smart Healthcare Systems: A Prospective Survey

Brain tumor is one of the most dangerous cancers in people of all ages, and its grade recognition is a challenging problem for radiologists in health monitoring and automated diagnosis. Recently, numerous methods based on deep learning have been presented in the literature for brain tumor classification (BTC) in order to assist radiologists for a better diagnostic analysis. In this overview, we present an in-depth review of the surveys published so far and recent deep learning-based methods for BTC. Our survey covers the main steps of deep learning-based BTC methods, including preprocessing, features extraction, and classification, along with their achievements and limitations. We also investigate the state-of-the-art convolutional neural network models for BTC by performing extensive experiments using transfer learning with and without data augmentation. Furthermore, this overview describes available benchmark data sets used for the evaluation of BTC. Finally, this survey does not only look into the past literature on the topic but also steps on it to delve into the future of this area and enumerates some research directions that should be followed in the future, especially for personalized and smart healthcare.

A Fully Automatic Procedure for Brain Tumor Segmentation from Multi-Spectral MRI Records Using Ensemble Learning and Atlas-Based Data Enhancement

The accurate and reliable segmentation of gliomas from magnetic resonance image (MRI) data has an important role in diagnosis, intervention planning, and monitoring the tumor’s evolution during and after therapy. Segmentation has serious anatomical obstacles like the great variety of the tumor’s location, size, shape, and appearance and the modified position of normal tissues. Other phenomena like intensity inhomogeneity and the lack of standard intensity scale in MRI data represent further difficulties. This paper proposes a fully automatic brain tumor segmentation procedure that attempts to handle all the above problems. Having its foundations on the MRI data provided by the MICCAI Brain Tumor Segmentation (BraTS) Challenges, the procedure consists of three main phases. The first pre-processing phase prepares the MRI data to be suitable for supervised classification, by attempting to fix missing data, suppressing the intensity inhomogeneity, normalizing the histogram of observed data channels, generating additional morphological, gradient-based, and Gabor-wavelet features, and optionally applying atlas-based data enhancement. The second phase accomplishes the main classification process using ensembles of binary decision trees and provides an initial, intermediary labeling for each pixel of test records. The last phase reevaluates these intermediary labels using a random forest classifier, then deploys a spatial region growing-based structural validation of suspected tumors, thus achieving a high-quality final segmentation result. The accuracy of the procedure is evaluated using the multi-spectral MRI records of the BraTS 2015 and BraTS 2019 training data sets. The procedure achieves high-quality segmentation results, characterized by average Dice similarity scores of up to 86%.

Brain Tumor Classification & Segmentation by Using Advanced DNN, CNN & ResNet-50 Neural Networks

In the medical domain, brain image classification is an extremely challenging field. Medical images play a vital role in making the doctor's precise diagnosis and in the surgery process. Adopting intelligent algorithms makes it feasible to detect the lesions of medical images quickly, and it is especially necessary to extract features from medical images. Several studies have integrated multiple algorithms toward medical images domain. Concerning feature extraction from the medical image, a vast amount of data is analyzed to achieve processing results, helping physicians deliver more precise case diagnoses. Image processing mechanism becomes extensive usage in medical science to advance the early detection and treatment aspects. In this aspect, this paper takes tumor, and healthy images as the research object and primarily performs image processing and data augmentation process to feed the dataset to the neural networks. Deep neural networks (DNN), to date, have shown outstanding achievement in classification and segmentation tasks. Carrying this concept into consideration, in this study, we adopted a pre-trained model Resnet_50 for image analysis. The paper proposed three diverse neural networks, particularly DNN, CNN, and ResNet-50. Finally, the splitting dataset is individually assigned to each simplified neural network. Once the image is classified as a tumor accurately, the OTSU segmentation is employed to extract the tumor alone. It can be examined from the experimental outcomes that the ResNet-50 algorithm shows high accuracy 0.996, precision 1.00 with best F1 score 1.0, and minimum test losses of 0.0269 in terms of Brain tumor classification. Extensive experiments prove our offered tumor detection segmentation efficiency and accuracy. To this end, our approach is comprehensive sufficient and only requires minimum pre-and post-processing, which allows its adoption in various medical image classification & segmentation tasks.

Importance and Evidence of Extent of Resection in Glioblastoma

Maximal safe resection is an essential part of the multidisciplinary care of patients with glioblastoma. A growing body of data shows that gross total resection is an independent prognostic factor associated with improved clinical outcome. The relationship between extent of glioblastoma (GB) resection and clinical benefit depends critically on the balance between cytoreduction and avoiding neurologic morbidity. The definition of the extent of tumor resection, how this is best measured pre- and postoperatively, and its relation to volume of residual tumor is still discussed. We review the literature supporting extent of resection in GB, highlighting the importance of a standardized definition and measurement of extent of resection to allow greater collaboration in research projects and trials. Recent developments in neurosurgical techniques and technologies focused on maximizing extent of resection and safety are discussed.

A new COVID-19 Patients Detection Strategy (CPDS) based on hybrid feature selection and enhanced KNN classifier

COVID-19 infection is growing in a rapid rate. Due to unavailability of specific drugs, early detection of (COVID-19) patients is essential for disease cure and control. There is a vital need to detect the disease at early stage and instantly quarantine the infected people. Many research have been going on, however, none of them introduces satisfactory results yet. In spite of its simplicity, K-Nearest Neighbor (KNN) classifier has proven high flexibility in complex classification problems. However, it can be easily trapped. In this paper, a new COVID-19 diagnose strategy is introduced, which is called COVID-19 Patients Detection Strategy (CPDS). The novelty of CPDS is concentrated in two contributions. The first is a new hybrid feature selection Methodology (HFSM), which elects the most informative features from those extracted from chest Computed Tomography (CT) images for COVID-19 patients and non COVID-19 peoples. HFSM is a hybrid methodology as it combines evidence from both wrapper and filter feature selection methods. It consists of two stages, namely; Fast Selection Stage (FS2) and Accurate Selection Stage (AS2). FS2relies on filter, while AS2 uses Genetic Algorithm (GA) as a wrapper method. As a hybrid methodology, HFSM elects the significant features for the next detection phase. The second contribution is an enhanced K-Nearest Neighbor (EKNN) classifier, which avoids the trapping problem of the traditional KNN by adding solid heuristics in choosing the neighbors of the tested item. EKNN depends on measuring the degree of both closeness and strength of each neighbor of the tested item, then elects only the qualified neighbors for classification. Accordingly, EKNN can accurately detect infected patients with the minimum time penalty based on those significant features selected by HFSM technique. Extensive experiments have been done considering the proposed detection strategy as well as recent competitive techniques on the chest CT images. Experimental results have shown that the proposed detection strategy outperforms recent techniques as it introduces the maximum accuracy rate.

Prediction of Glioma Grades Using Deep Learning with Wavelet Radiomic Features

Gliomas are the most common primary brain tumors. They are classified into 4 grades (Grade I–II-III–IV) according to the guidelines of the World Health Organization (WHO). The accurate grading of gliomas has clinical significance for planning prognostic treatments, pre-diagnosis, monitoring and administration of chemotherapy. The purpose of this study is to develop a deep learning-based classification method using radiomic features of brain tumor glioma grades with deep neural network (DNN). The classifier was combined with the discrete wavelet transform (DWT) the powerful feature extraction tool. This study primarily focuses on the four main aspects of the radiomic workflow, namely tumor segmentation, feature extraction, analysis, and classification. We evaluated data from 121 patients with brain tumors (Grade II, n = 77; Grade III, n = 44) from The Cancer Imaging Archive, and 744 radiomic features were obtained by applying low sub-band and high sub-band 3D wavelet transform filters to the 3D tumor images. Quantitative values were statistically analyzed with MannWhitney U tests and 126 radiomic features with significant statistical properties were selected in eight different wavelet filters. Classification performances of 3D wavelet transform filter groups were measured using accuracy, sensitivity, F1 score, and specificity values using the deep learning classifier model. The proposed model was highly effective in grading gliomas with 96.15% accuracy, 94.12% precision, 100% recall, 96.97% F1 score, and 98.75% Area under the ROC curve. As a result, deep learning and feature selection techniques with wavelet transform filters can be accurately applied using the proposed method in glioma grade classification.

A Robust Algorithm for Classification and Diagnosis of Brain Disease Using Local Linear Approximation and Generalized Autoregressive Conditional Heteroscedasticity Model

Regions detection has an influence on the better treatment of brain tumors. Existing algorithms in the early detection of tumors are difficult to diagnose reliably. In this paper, we introduced a new robust algorithm using three methods for the classification of brain disease. The first method is Wavelet-Generalized Autoregressive Conditional Heteroscedasticity-K-Nearest Neighbor (W-GARCH-KNN). The Two-Dimensional Discrete Wavelet (2D-DWT) is utilized as the input images. The sub-banded wavelet coefficients are modeled using the GARCH model. The features of the GARCH model are considered as the main property vector. The second method is the Developed Wavelet-GARCH-KNN (D-WGK), which solves the incompatibility of the WGK method for the use of a low pass sub-band. The third method is the Wavelet Local Linear Approximation (LLA)-KNN, which we used for modeling the wavelet sub-bands. The extracted features were applied separately to determine the normal image or brain tumor based on classification methods. The classification was performed for the diagnosis of tumor types. The empirical results showed that the proposed algorithm obtained a high rate of classification and better practices than recently introduced algorithms while requiring a smaller number of classification features. According to the results, the Low-Low sub-bands are not adopted with the GARCH model; therefore, with the use of homomorphic filtering, this limitation is overcome. The results showed that the presented Local Linear (LL) method was better than the GARCH model for modeling wavelet sub-bands.

A Novel Intelligent System for Brain Tumor Diagnosis Based on a Composite Neutrosophic-Slantlet Transform Domain for Statistical Texture Feature Extraction

Discrete wavelet transform (DWT) is often implemented by an iterative filter bank; hence, a lake of optimization of a discrete time basis is observed with respect to time localization for a constant number of zero moments. This paper discusses and presents an improved form of DWT for feature extraction, called Slantlet transform (SLT) along with neutrosophy, a generalization of fuzzy logic, which is a relatively new logic. Thus, a novel composite NS-SLT model has been suggested as a source to derive statistical texture features that used to identify the malignancy of brain tumor. The MR images in the neutrosophic domain are defined using three membership sets, true (T), false (F), and indeterminate (I); then, SLT was applied to each membership set. Three statistical measurement-based methods are used to extract texture features from images of brain MRI. One-way ANOVA has been applied as a method of reducing the number of extracted features for the classifiers; then, the extracted features are subsequently provided to the four neural network classification techniques, Support Vector Machine Neural Network (SVM-NN), Decision Tree Neural Network (DT-NN), K-Nearest Neighbor Neural Network (KNN-NN), and Naive Bayes Neural Networks (NB-NN), to predict the type of the brain tumor. Meanwhile, the performance of the proposed model is assessed by calculating average accuracy, precision, sensitivity, specificity, and Area Under the Curve (AUC) of the Receiver Operating Characteristic (ROC) curve. The experimental results demonstrate that the proposed approach is quite accurate and efficient for diagnosing brain tumors when the Gray Level Run Length Matrix (GLRLM) features derived from the composite NS-SLT technique is used.

Automated glioma grading on conventional MRI images using deep convolutional neural networks

PURPOSE

Gliomas are the most common primary tumor of the brain and are classified into grades I-IV of the World Health Organization (WHO), based on their invasively histological appearance. Gliomas grading plays an important role to determine the treatment plan and prognosis prediction. In this study we propose two novel methods for automatic, non-invasively distinguishing low-grade (Grades II and III) glioma (LGG) and high-grade (grade IV) glioma (HGG) on conventional MRI images by using deep convolutional neural networks (CNNs).

METHODS

All MRI images have been preprocessed first by rigid image registration and intensity inhomogeneity correction. Both proposed methods consist of two steps: (a) three-dimensional (3D) brain tumor segmentation based on a modification of the popular U-Net model; (b) tumor classification on segmented brain tumor. In the first method, the slice with largest area of tumor is determined and the state-of-the-art mask R-CNN model is employed for tumor grading. To improve the performance of the grading model, a two-dimensional (2D) data augmentation has been implemented to increase both the amount and the diversity of the training images. In the second method, denoted as 3DConvNet, a 3D volumetric CNNs is applied directly on bounding image regions of segmented tumor for classification, which can fully leverage the 3D spatial contextual information of volumetric image data.

RESULTS

The proposed schemes were evaluated on The Cancer Imaging Archive (TCIA) low grade glioma (LGG) data, and the Multimodal Brain Tumor Image Segmentation (BraTS) Benchmark 2018 training datasets with fivefold cross validation. All data are divided into training, validation, and test sets. Based on biopsy-proven ground truth, the performance metrics of sensitivity, specificity, and accuracy are measured on the test sets. The results are 0.935 (sensitivity), 0.972 (specificity), and 0.963 (accuracy) for the 2D Mask R-CNN based method, and 0.947 (sensitivity), 0.968 (specificity), and 0.971 (accuracy) for the 3DConvNet method, respectively. In regard to efficiency, for 3D brain tumor segmentation, the program takes around ten and a half hours for training with 300 epochs on BraTS 2018 dataset and takes only around 50 s for testing of a typical image with a size of 160 × 216 × 176. For 2D Mask R-CNN based tumor grading, the program takes around 4 h for training with around 60 000 iterations, and around 1 s for testing of a 2D slice image with size of 128 × 128. For 3DConvNet based tumor grading, the program takes around 2 h for training with 10 000 iterations, and 0.25 s for testing of a 3D cropped image with size of 64 × 64 × 64, using a DELL PRECISION Tower T7910, with two NVIDIA Titan Xp GPUs.

CONCLUSIONS

Two effective glioma grading methods on conventional MRI images using deep convolutional neural networks have been developed. Our methods are fully automated without manual specification of region-of-interests and selection of slices for model training, which are common in traditional machine learning based brain tumor grading methods. This methodology may play a crucial role in selecting effective treatment options and survival predictions without the need for surgical biopsy.

A simple model for glioma grading based on texture analysis applied to conventional brain MRI

Accuracy of glioma grading is fundamental for the diagnosis, treatment planning and prognosis of patients. The purpose of this work was to develop a low-cost and easy-to-implement classification model which distinguishes low-grade gliomas (LGGs) from high-grade gliomas (HGGs), through texture analysis applied to conventional brain MRI. Different combinations of MRI contrasts (T1Gd and T2) and one segmented glioma region (necrotic and non-enhancing tumor core, NCR/NET) were studied. Texture features obtained from the gray level size zone matrix (GLSZM) were calculated. An under-sampling method was proposed to divide the data into different training subsets and subsequently extract complementary information for the creation of distinct classification models. The sensitivity, specificity and accuracy of the models were calculated, and the best model explicitly reported. The best model included only three texture features and reached a sensitivity, specificity and accuracy of 94.12%, 88.24% and 91.18%, respectively. According to the features of the model, when the NCR/NET region was studied, HGGs had a more heterogeneous texture than LGGs in the T1Gd images, and LGGs had a more heterogeneous texture than HGGs in the T2 images. These novel results partially contrast with results from the literature. The best model proved to be useful for the classification of gliomas. Complementary results showed that the heterogeneity of gliomas depended on the MRI contrast studied. The chosen model stands out as a simple, low-cost, easy-to-implement, reproducible and highly accurate glioma classifier. Importantly, it should be accessible to populations with reduced economic and scientific resources.

3D dense connectivity network with atrous convolutional feature pyramid for brain tumor segmentation in magnetic resonance imaging of human heads

The existing deep convolutional neural networks (DCNNs) based methods have achieved significant progress regarding automatic glioma segmentation in magnetic resonance imaging (MRI) data. However, there are two main problems affecting the performance of traditional DCNNs constructed by simply stacking convolutional layers, namely, exploding/vanishing gradients and limitations to the feature computations. To address these challenges, we propose a novel framework to automatically segment brain tumors. First, a three-dimensional (3D) dense connectivity architecture is used to build the backbone for feature reuse. Second, we design a new feature pyramid module using 3D atrous convolutional layers and add this module to the end of the backbone to fuse multiscale contexts. Finally, a 3D deep supervision mechanism is equipped with the network to promote training. On the multimodal brain tumor image segmentation benchmark (BRATS) datasets, our method achieves Dice similarity coefficient values of 0.87, 0.72, and 0.70 on the BRATS 2013 Challenge, 0.84, 0.70, and 0.61 on the BRATS 2013 LeaderBoard, 0.83, 0.70, and 0.62 on the BRATS 2015 Testing, 0.8642, 0.7738, and 0.7525 on the BRATS 2018 Validation in terms of whole tumors, tumor cores, and enhancing cores, respectively. Compared to the published state-of-the-art methods, the proposed method achieves promising accuracy and fast processing, demonstrating good potential for clinical medicine.

Automatic segmentation of brain tumors in magnetic resonance imaging

Objective

To develop a computational algorithm applied to magnetic resonance imaging for automatic segmentation of brain tumors.

Methods

A total of 130 magnetic resonance images were used in the T1c, T2 and FSPRG T1C sequences and in the axial, sagittal and coronal planes of patients with brain cancer. The algorithms employed contrast correction, histogram normalization and binarization techniques to disconnect adjacent structures from the brain and enhance the region of interest. Automatic segmentation was performed through detection by coordinates and arithmetic mean of the area. Morphological operators were used to eliminate undesirable elements and reconstruct the shape and texture of the tumor. The results were compared with manual segmentations by two radiologists to determine the efficacy of the algorithms implemented.

Results

The correlated correspondence between the segmentation obtained and the gold standard was 89.23%.

Conclusion

It is possible to locate and define the tumor region automatically with no the need for user interaction, based on two innovative methods to detect brain extreme sites and exclude non-tumor tissues on magnetic resonance images.

Brain tumor classification using modified local binary patterns (LBP) feature extraction methods

Automatic classification of brain tumor types is very important for accelerating the treatment process, planning and increasing the patient's survival rate. Today, MR images are used to determine the type of brain tumor. Manual diagnosis of brain tumor type depends on the experience and sensitivity of radiologists. Therefore, researchers have developed many brain tumor classification models to minimize the human factor. In this study, two different feature extraction (nLBP and αLBP) approaches were used to classify the most common brain tumor types; Glioma, Meningioma, and Pituitary brain tumors. nLBP is formed based on the relationship for each pixel around the neighbors. The nLBP method has a d parameter that specifies the distance between consecutive neighbors for comparison. Different patterns are obtained for different d parameter values. The αLBP operator calculates the value of each pixel based on an angle value. The angle values used for calculation are 0, 45, 90 and 135. To test the proposed methods, it was applied to images obtained from the brain tumor database collected from Nanfang Hospital, Guangzhou, China, and Tianjin Medical University General Hospital between the years of 2005 and 2010. The classification process was performed by using K-Nearest Neighbor (Knn) and Artificial Neural Networks (ANN), Random Forest (RF), A1DE, Linear Discriminant Analysis (LDA) classification methods, with the feature matrices obtained with nLBP, αLBP and classical LBP from the images in the data set. The highest success rate in brain tumor classification was 95.56% with the nLBPd = 1 feature extraction method and Knn model.

A Clinical Decision-Support System Based on Three-Stage Integrated Image Analysis for Diagnosing Lung Disease

Thoracic computed tomography (CT) technology has been used for lung cancer screening in high-risk populations, and this technique is highly effective in the identification of early lung cancer. With the rapid development of intelligent image analysis in the field of medical science and technology, many researchers have proposed computer-aided automatic diagnosis methods for facilitating medical experts in detecting lung nodules. This paper proposes an advanced clinical decision-support system for analyzing chest CT images of lung disease. Three advanced methods are utilized in the proposed system: the three-stage automated segmentation method (TSASM), the discrete wavelet packets transform (DWPT) with singular value decomposition (SVD), and the algorithms of the rough set theory, which comprise a classification-based method. Two collected medical CT image datasets were prepared to evaluate the proposed system. The CT image datasets were labeled (nodule, non-nodule, or inflammation) by experienced radiologists from a regional teaching hospital. According to the results, the proposed system outperforms other classification methods (trees, naïve Bayes, multilayer perception, and sequential minimal optimization) in terms of classification accuracy and can be employed as a clinical decision-support system for diagnosing lung disease.

A Feature Ranking and Selection Algorithm for Brain Tumor Segmentation in Multi-Spectral Magnetic Resonance Image Data

Accuracy is the most important quality marker in medical image segmentation. However, when the task is to handle large volumes of data, the relevance of processing speed rises. In machine learning solutions the optimization of the feature set can significantly reduce the computational load. This paper presents a method for feature selection and applies it in the context of a brain tumor detection and segmentation problem in multi-spectral magnetic resonance image data. Starting from an initial set of 104 features involved in an existing ensemble learning solution that employs binary decision trees, a reduced set of features is obtained using a iterative algorithm based on a composite criterion. In each iteration, features are ranked according to the frequency of usage and the correctness of the decisions to which they contribute. Lowest ranked features are iteratively eliminated as long as the segmentation accuracy is not damaged. The final reduced set of 13 features provide the same accuracy in the whole tumor segmentation process as the initial one, but three times faster.

Skin cancer diagnosis based on optimized convolutional neural network

Early detection of skin cancer is very important and can prevent some skin cancers, such as focal cell carcinoma and melanoma. Although there are several reasons that have bad impacts on the detection precision. Recently, the utilization of image processing and machine vision in medical applications is increasing. In this paper, a new image processing based method has been proposed for the early detection of skin cancer. The method utilizes an optimal Convolutional neural network (CNN) for this purpose. In this paper, improved whale optimization algorithm is utilized for optimizing the CNN. For evaluation of the proposed method, it is compared with some different methods on two different datasets. Simulation results show that the proposed method has superiority toward the other compared methods.

An expert system for brain tumor detection: Fuzzy C-means with super resolution and convolutional neural network with extreme learning machine

Super-resolution, which is one of the trend issues of recent times, increases the resolution of the images to higher levels. Increasing the resolution of a vital image in terms of the information it contains such as brain magnetic resonance image (MRI), makes the important information in the MRI image more visible and clearer. Thus, it is provided that the borders of the tumors in the related image are found more successfully. In this study, brain tumor detection based on fuzzy C-means with super-resolution and convolutional neural networks with extreme learning machine algorithms (SR-FCM-CNN) approach has been proposed. The aim of this study has been segmented the tumors in high performance by using Super Resolution Fuzzy-C-Means (SR-FCM) approach for tumor detection from brain MR images. Afterward, feature extraction and pretrained SqueezeNet architecture from convolutional neural network (CNN) architectures and classification process with extreme learning machine (ELM) were performed. In the experimental studies, it has been determined that brain tumors have been better segmented and removed using SR-FCM method. Using the SquezeeNet architecture, features were extracted from a smaller neural network model with fewer parameters. In the proposed method, 98.33% accuracy rate has been detected in the diagnosis of segmented brain tumors using SR-FCM. This rate is greater 10% than the rate of recognition of brain tumors segmented with fuzzy C-means (FCM) without SR.