A Hybrid CNN-GLCM Classifier For Detection And Grade Classification Of Brain Tumor

End-to-End Multi-task Learning Architecture for Brain Tumor Analysis with Uncertainty Estimation in MRI Images

Brain tumors are a threat to life for every other human being, be it adults or children. Gliomas are one of the deadliest brain tumors with an extremely difficult diagnosis. The reason is their complex and heterogenous structure which gives rise to subjective as well as objective errors. Their manual segmentation is a laborious task due to their complex structure and irregular appearance. To cater to all these issues, a lot of research has been done and is going on to develop AI-based solutions that can help doctors and radiologists in the effective diagnosis of gliomas with the least subjective and objective errors, but an end-to-end system is still missing. An all-in-one framework has been proposed in this research. The developed end-to-end multi-task learning (MTL) architecture with a feature attention module can classify, segment, and predict the overall survival of gliomas by leveraging task relationships between similar tasks. Uncertainty estimation has also been incorporated into the framework to enhance the confidence level of healthcare practitioners. Extensive experimentation was performed by using combinations of MRI sequences. Brain tumor segmentation (BraTS) challenge datasets of 2019 and 2020 were used for experimental purposes. Results of the best model with four sequences show 95.1% accuracy for classification, 86.3% dice score for segmentation, and a mean absolute error (MAE) of 456.59 for survival prediction on the test data. It is evident from the results that deep learning-based MTL models have the potential to automate the whole brain tumor analysis process and give efficient results with least inference time without human intervention. Uncertainty quantification confirms the idea that more data can improve the generalization ability and in turn can produce more accurate results with less uncertainty. The proposed model has the potential to be utilized in a clinical setup for the initial screening of glioma patients.

Advances in the Use of Deep Learning for the Analysis of Magnetic Resonance Image in Neuro-Oncology

Machine Learning is entering a phase of maturity, but its medical applications still lag behind in terms of practical use. The field of oncological radiology (and neuro-oncology in particular) is at the forefront of these developments, now boosted by the success of Deep-Learning methods for the analysis of medical images. This paper reviews in detail some of the most recent advances in the use of Deep Learning in this field, from the broader topic of the development of Machine-Learning-based analytical pipelines to specific instantiations of the use of Deep Learning in neuro-oncology; the latter including its use in the groundbreaking field of ultra-low field magnetic resonance imaging.

Deep convolutional neural network based hyperspectral brain tissue classification

BACKGROUND

Hyperspectral brain tissue imaging has been recently utilized in medical research aiming to study brain science and obtain various biological phenomena of the different tissue types. However, processing high-dimensional data of hyperspectral images (HSI) is challenging due to the minimum availability of training samples.

OBJECTIVE

To overcome this challenge, this study proposes applying a 3D-CNN (convolution neural network) model to process spatial and temporal features and thus improve performance of tumor image classification.

METHODS

A 3D-CNN model is implemented as a testing method for dealing with high-dimensional problems. The HSI pre-processing is accomplished using distinct approaches such as hyperspectral cube creation, calibration, spectral correction, and normalization. Both spectral and spatial features are extracted from HSI. The Benchmark Vivo human brain HSI dataset is used to validate the performance of the proposed classification model.

RESULTS

The proposed 3D-CNN model achieves a higher accuracy of 97% for brain tissue classification, whereas the existing linear conventional support vector machine (SVM) and 2D-CNN model yield 95% and 96% classification accuracy, respectively. Moreover, the maximum F1-score obtained by the proposed 3D-CNN model is 97.3%, which is 2.5% and 11.0% higher than the F1-scores obtained by 2D-CNN model and SVM model, respectively.

CONCLUSION

A 3D-CNN model is developed for brain tissue classification by using HIS dataset. The study results demonstrate the advantages of using the new 3D-CNN model, which can achieve higher brain tissue classification accuracy than conventional 2D-CNN model and SVM model.

Role of Ensemble Deep Learning for Brain Tumor Classification in Multiple Magnetic Resonance Imaging Sequence Data

The biopsy is a gold standard method for tumor grading. However, due to its invasive nature, it has sometimes proved fatal for brain tumor patients. As a result, a non-invasive computer-aided diagnosis (CAD) tool is required. Recently, many magnetic resonance imaging (MRI)-based CAD tools have been proposed for brain tumor grading. The MRI has several sequences, which can express tumor structure in different ways. However, a suitable MRI sequence for brain tumor classification is not yet known. The most common brain tumor is 'glioma', which is the most fatal form. Therefore, in the proposed study, to maximize the classification ability between low-grade versus high-grade glioma, three datasets were designed comprising three MRI sequences: T1-Weighted (T1W), T2-weighted (T2W), and fluid-attenuated inversion recovery (FLAIR). Further, five well-established convolutional neural networks, AlexNet, VGG16, ResNet18, GoogleNet, and ResNet50 were adopted for tumor classification. An ensemble algorithm was proposed using the majority vote of above five deep learning (DL) models to produce more consistent and improved results than any individual model. Five-fold cross validation (K5-CV) protocol was adopted for training and testing. For the proposed ensembled classifier with K5-CV, the highest test accuracies of 98.88 ± 0.63%, 97.98 ± 0.86%, and 94.75 ± 0.61% were achieved for FLAIR, T2W, and T1W-MRI data, respectively. FLAIR-MRI data was found to be most significant for brain tumor classification, where it showed a 4.17% and 0.91% improvement in accuracy against the T1W-MRI and T2W-MRI sequence data, respectively. The proposed ensembled algorithm (MajVot) showed significant improvements in the average accuracy of three datasets of 3.60%, 2.84%, 1.64%, 4.27%, and 1.14%, respectively, against AlexNet, VGG16, ResNet18, GoogleNet, and ResNet50.

Extraction of Broad-Leaved Tree Crown Based on UAV Visible Images and OBIA-RF Model: A Case Study for Chinese Olive Trees

Chinese olive trees (Canarium album L.) are broad-leaved species that are widely planted in China. Accurately obtaining tree crown information provides important data for evaluating Chinese olive tree growth status, water and fertilizer management, and yield estimation. To this end, this study first used unmanned aerial vehicle (UAV) images in the visible band as the source of remote sensing (RS) data. Second, based on spectral features of the image object, the vegetation index, shape, texture, and terrain features were introduced. Finally, the extraction effect of different feature dimensions was analyzed based on the random forest (RF) algorithm, and the performance of different classifiers was compared based on the features after dimensionality reduction. The results showed that the difference in feature dimensionality and importance was the main factor that led to a change in extraction accuracy. RF has the best extraction effect among the current mainstream machine learning (ML) algorithms. In comparison with the pixel-based (PB) classification method, the object-based image analysis (OBIA) method can extract features of each element of RS images, which has certain advantages. Therefore, the combination of OBIA and RF algorithms is a good solution for Chinese olive tree crown (COTC) extraction based on UAV visible band images.