Neural networks analysis of astrocytic gliomas from MRI appearances

Machine Learning Tools for Image-Based Glioma Grading and the Quality of Their Reporting: Challenges and Opportunities

Technological innovation has enabled the development of machine learning (ML) tools that aim to improve the practice of radiologists. In the last decade, ML applications to neuro-oncology have expanded significantly, with the pre-operative prediction of glioma grade using medical imaging as a specific area of interest. We introduce the subject of ML models for glioma grade prediction by remarking upon the models reported in the literature as well as by describing their characteristic developmental workflow and widely used classifier algorithms. The challenges facing these models-including data sources, external validation, and glioma grade classification methods -are highlighted. We also discuss the quality of how these models are reported, explore the present and future of reporting guidelines and risk of bias tools, and provide suggestions for the reporting of prospective works. Finally, this review offers insights into next steps that the field of ML glioma grade prediction can take to facilitate clinical implementation.

A New Deep Hybrid Boosted and Ensemble Learning-Based Brain Tumor Analysis Using MRI

Brain tumor analysis is essential to the timely diagnosis and effective treatment of patients. Tumor analysis is challenging because of tumor morphology factors like size, location, texture, and heteromorphic appearance in medical images. In this regard, a novel two-phase deep learning-based framework is proposed to detect and categorize brain tumors in magnetic resonance images (MRIs). In the first phase, a novel deep-boosted features space and ensemble classifiers (DBFS-EC) scheme is proposed to effectively detect tumor MRI images from healthy individuals. The deep-boosted feature space is achieved through customized and well-performing deep convolutional neural networks (CNNs), and consequently, fed into the ensemble of machine learning (ML) classifiers. While in the second phase, a new hybrid features fusion-based brain-tumor classification approach is proposed, comprised of both static and dynamic features with an ML classifier to categorize different tumor types. The dynamic features are extracted from the proposed brain region-edge net (BRAIN-RENet) CNN, which is able to learn the heteromorphic and inconsistent behavior of various tumors. In contrast, the static features are extracted by using a histogram of gradients (HOG) feature descriptor. The effectiveness of the proposed two-phase brain tumor analysis framework is validated on two standard benchmark datasets, which were collected from Kaggle and Figshare and contain different types of tumors, including glioma, meningioma, pituitary, and normal images. Experimental results suggest that the proposed DBFS-EC detection scheme outperforms the standard and achieved accuracy (99.56%), precision (0.9991), recall (0.9899), F1-Score (0.9945), MCC (0.9892), and AUC-PR (0.9990). The classification scheme, based on the fusion of feature spaces of proposed BRAIN-RENet and HOG, outperform state-of-the-art methods significantly in terms of recall (0.9913), precision (0.9906), accuracy (99.20%), and F1-Score (0.9909) in the CE-MRI dataset.

A Brief History of Machine Learning in Neurosurgery

The history of machine learning in neurosurgery spans three decades and continues to develop at a rapid pace. The earliest applications of machine learning within neurosurgery were first published in the 1990s as researchers began developing artificial neural networks to analyze structured datasets and supervised tasks. By the turn of the millennium, machine learning had evolved beyond proof-of-concept; algorithms had success detecting tumors in unstructured clinical imaging, and unsupervised learning showed promise for tumor segmentation. Throughout the 2000s, the role of machine learning in neurosurgery was further refined. Well-trained models began to consistently best expert clinicians at brain tumor diagnosis. Additionally, the digitization of the healthcare industry provided ample data for analysis, both structured and unstructured. By the 2010s, the use of machine learning within neurosurgery had exploded. The rapid deployment of an exciting new toolset also led to the growing realization that it may offer marginal benefit at best over conventional logistical regression models for analyzing tabular datasets. Additionally, the widespread adoption of machine learning in neurosurgical clinical practice continues to lag until additional validation can ensure generalizability. Many exciting contemporary applications nonetheless continue to demonstrate the unprecedented potential of machine learning to revolutionize neurosurgery when applied to appropriate clinical challenges.

Neurosurgery and artificial intelligence

Neurosurgeons receive extensive and lengthy training to equip themselves with various technical skills, and neurosurgery require a great deal of pre-, intra- and postoperative clinical data collection, decision making, care and recovery. The last decade has seen a significant increase in the importance of artificial intelligence (AI) in neurosurgery. AI can provide a great promise in neurosurgery by complementing neurosurgeons' skills to provide the best possible interventional and noninterventional care for patients by enhancing diagnostic and prognostic outcomes in clinical treatment and help neurosurgeons with decision making during surgical interventions to improve patient outcomes. Furthermore, AI is playing a pivotal role in the production, processing and storage of clinical and experimental data. AI usage in neurosurgery can also reduce the costs associated with surgical care and provide high-quality healthcare to a broader population. Additionally, AI and neurosurgery can build a symbiotic relationship where AI helps to push the boundaries of neurosurgery, and neurosurgery can help AI to develop better and more robust algorithms. This review explores the role of AI in interventional and noninterventional aspects of neurosurgery during pre-, intra- and postoperative care, such as diagnosis, clinical decision making, surgical operation, prognosis, data acquisition, and research within the neurosurgical arena.

A narrative review of machine learning as promising revolution in clinical practice of scoliosis

Machine learning (ML), as an advanced domain of artificial intelligence (AI), is progressively changing our view of the world. By implementing its algorithms, our ability to detect previously undiscoverable patterns in data has the potential to revolutionize predictive analytics. Scoliosis, as a relatively specialized branch in the spine field, mainly covers the pediatric, adult and the elderly populations, and its diagnosis and treatment remain difficult. With recent efforts and interdisciplinary cooperation, ML has been widely applied to investigate issues related to scoliosis, and surprisingly augment a surgeon's ability in clinical practice related to scoliosis. Meanwhile, ML models penetrate in every stage of the clinical practice procedure of scoliosis. In this review, we first present a brief description of the application of ML in the clinical practice procedures regarding scoliosis, including screening, diagnosis and classification, surgical decision making, intraoperative manipulation, complication prediction, prognosis prediction and rehabilitation. Meanwhile, the ML models and specific applications adopted are presented. Additionally, current limitations and future directions are briefly discussed regarding its use in the field of scoliosis. We believe that the implementation of ML is a promising revolution to assist surgeons in all aspects of clinical practice related to scoliosis in the near future.

Incremental Dilations Using CNN for Brain Tumor Classification

Brain tumor classification is a challenging task in the field of medical image processing. Technology has now enabled medical doctors to have additional aid for diagnosis. We aim to classify brain tumors using MRI images, which were collected from anonymous patients and artificial brain simulators. In this article, we carry out a comparative study between Simple Artificial Neural Networks with dropout, Basic Convolutional Neural Networks (CNN), and Dilated Convolutional Neural Networks. The experimental results shed light on the high classification performance (accuracy 97%) of Dilated CNN. On the other hand, Dilated CNN suffers from the gridding phenomenon. An incremental, even number dilation rate takes advantage of the reduced computational overhead and also overcomes the adverse effects of gridding. Comparative analysis between different combinations of dilation rates for the different convolution layers, help validate the results. The computational overhead in terms of efficiency for training the model to reach an acceptable threshold accuracy of 90% is another parameter to compare the model performance.

Machine learning and glioma imaging biomarkers

AIM

To review how machine learning (ML) is applied to imaging biomarkers in neuro-oncology, in particular for diagnosis, prognosis, and treatment response monitoring.

MATERIALS AND METHODS

The PubMed and MEDLINE databases were searched for articles published before September 2018 using relevant search terms. The search strategy focused on articles applying ML to high-grade glioma biomarkers for treatment response monitoring, prognosis, and prediction.

RESULTS

Magnetic resonance imaging (MRI) is typically used throughout the patient pathway because routine structural imaging provides detailed anatomical and pathological information and advanced techniques provide additional physiological detail. Using carefully chosen image features, ML is frequently used to allow accurate classification in a variety of scenarios. Rather than being chosen by human selection, ML also enables image features to be identified by an algorithm. Much research is applied to determining molecular profiles, histological tumour grade, and prognosis using MRI images acquired at the time that patients first present with a brain tumour. Differentiating a treatment response from a post-treatment-related effect using imaging is clinically important and also an area of active study (described here in one of two Special Issue publications dedicated to the application of ML in glioma imaging).

CONCLUSION

Although pioneering, most of the evidence is of a low level, having been obtained retrospectively and in single centres. Studies applying ML to build neuro-oncology monitoring biomarker models have yet to show an overall advantage over those using traditional statistical methods. Development and validation of ML models applied to neuro-oncology require large, well-annotated datasets, and therefore multidisciplinary and multi-centre collaborations are necessary.

Natural and Artificial Intelligence in Neurosurgery: A Systematic Review

BACKGROUND

Machine learning (ML) is a domain of artificial intelligence that allows computer algorithms to learn from experience without being explicitly programmed.

OBJECTIVE

To summarize neurosurgical applications of ML where it has been compared to clinical expertise, here referred to as "natural intelligence."

METHODS

A systematic search was performed in the PubMed and Embase databases as of August 2016 to review all studies comparing the performance of various ML approaches with that of clinical experts in neurosurgical literature.

RESULTS

Twenty-three studies were identified that used ML algorithms for diagnosis, presurgical planning, or outcome prediction in neurosurgical patients. Compared to clinical experts, ML models demonstrated a median absolute improvement in accuracy and area under the receiver operating curve of 13% (interquartile range 4-21%) and 0.14 (interquartile range 0.07-0.21), respectively. In 29 (58%) of the 50 outcome measures for which a P-value was provided or calculated, ML models outperformed clinical experts (P < .05). In 18 of 50 (36%), no difference was seen between ML and expert performance (P > .05), while in 3 of 50 (6%) clinical experts outperformed ML models (P < .05). All 4 studies that compared clinicians assisted by ML models vs clinicians alone demonstrated a better performance in the first group.

CONCLUSION

We conclude that ML models have the potential to augment the decision-making capacity of clinicians in neurosurgical applications; however, significant hurdles remain associated with creating, validating, and deploying ML models in the clinical setting. Shifting from the preconceptions of a human-vs-machine to a human-and-machine paradigm could be essential to overcome these hurdles.

Machine-learning in grading of gliomas based on multi-parametric magnetic resonance imaging at 3T

OBJECTIVE

The objective of this study was to assess the contribution of multi-parametric (mp) magnetic resonance imaging (MRI) quantitative features in the machine learning-based grading of gliomas with a multi-region-of-interests approach.

MATERIALS AND METHODS

Forty-three patients who were newly diagnosed as having a glioma were included in this study. The patients were scanned prior to any therapy using a standard brain tumor magnetic resonance (MR) imaging protocol that included T1 and T2-weighted, diffusion-weighted, diffusion tensor, MR perfusion and MR spectroscopic imaging. Three different regions-of-interest were drawn for each subject to encompass tumor, immediate tumor periphery, and distant peritumoral edema/normal. The normalized mp-MRI features were used to build machine-learning models for differentiating low-grade gliomas (WHO grades I and II) from high grades (WHO grades III and IV). In order to assess the contribution of regional mp-MRI quantitative features to the classification models, a support vector machine-based recursive feature elimination method was applied prior to classification.

RESULTS

A machine-learning model based on support vector machine algorithm with linear kernel achieved an accuracy of 93.0%, a specificity of 86.7%, and a sensitivity of 96.4% for the grading of gliomas using ten-fold cross validation based on the proposed subset of the mp-MRI features.

CONCLUSION

In this study, machine-learning based on multiregional and multi-parametric MRI data has proven to be an important tool in grading glial tumors accurately even in this limited patient population. Future studies are needed to investigate the use of machine learning algorithms for brain tumor classification in a larger patient cohort.

Performance evaluation of radiologists with artificial neural network for differential diagnosis of intra-axial cerebral tumors on MR images

BACKGROUND AND PURPOSE

Previous studies have suggested that use of an artificial neural network (ANN) system is beneficial for radiological diagnosis. Our purposes in this study were to construct an ANN for the differential diagnosis of intra-axial cerebral tumors on MR images and to evaluate the effect of ANN outputs on radiologists' diagnostic performance.

MATERIALS AND METHODS

We collected MR images of 126 patients with intra-axial cerebral tumors (58 high-grade gliomas, 37 low-grade gliomas, 19 metastatic tumors, and 12 malignant lymphomas). We constructed a single 3-layer feed-forward ANN with a Levenberg-Marquardt algorithm. The ANN was designed to differentiate among 4 categories of tumors (high-grade gliomas, low-grade gliomas, metastases, and malignant lymphomas) with use of 2 clinical parameters and 13 radiologic findings in MR images. Subjective ratings for the 13 radiologic findings were provided independently by 2 attending radiologists. All 126 cases were used for training and testing of the ANN based on a leave-one-out-by-case method. In the observer test, MR images were viewed by 9 radiologists, first without and then with ANN outputs. Each radiologist's performance was evaluated through a receiver operating characteristic (ROC) analysis on a continuous rating scale.

RESULTS

The averaged area under the ROC curve for ANN alone was 0.949. The diagnostic performance of the 9 radiologists increased from 0.899 to 0.946 (P < .001) when they used ANN outputs.

CONCLUSIONS

The ANN can provide useful output as a second opinion to improve radiologists' diagnostic performance in the differential diagnosis of intra-axial cerebral tumors seen on MR imaging.

Texture analysis of MR image for predicting the firmness of Huanghua pears (Pyrus pyrifolia Nakai, cv. Huanghua) during storage using an artificial neural network

Firmness, a main index of quality changes, is important for the quality evaluation of fruits. In the present study, texture analysis (TA) of magnetic resonance images was applied to predict the firmness of Huanghua pears (Pyrus pyrifolia Nakai, cv. Huanghua) during storage using an artificial neural network (ANN). Seven co-occurrence matrix-derived TA parameters and one run-length matrix TA parameter significantly correlated with firmness were considered as inputs to the ANN. Several ANN models were evaluated when developing the optimal topology. The optimal ANN model consisted of one hidden layer with 17 neurons in the hidden layer. This model was able to predict the firmness of the pears with a mean absolute error (MAE) of 0.539 N and R=0.969. Our data showed the potential of TA parameters of MR images combined with ANN for investigating the internal quality characteristics of fruits during storage.

Noninvasive diagnostic assessment of brain tumors using combined in vivo MR imaging and spectroscopy

To determine the potential value of multimodal MRI for the presurgical management of patients with brain tumors, we performed combined magnetic resonance imaging (MRI) and proton MR spectroscopy (MRS) in 164 patients who presented with tumors of various histological subtypes confirmed by surgical biopsy. Univariate statistical analysis of metabolic ratios carried out on the first 121 patients demonstrated significant differences in between-group comparisons, but failed to provide sufficiently robust classification of individual cases. However, a multivariate statistical approach correctly classified the tumors using linear discriminant analysis (LDA) of combined MRI and MRS data. After initial separation of contrast-enhancing and non-contrast-enhancing lesions, 91% of the former and 87% of the latter were correctly classified. The results were stable when this diagnostic strategy was tested on the additional 43 patients included for validation after the initial statistical analysis, with over 90% of correct classification. Combined MRI and MRS had superior diagnostic value compared to MRS alone, especially in the contrast-enhancing group. This study shows the clinical value of a multivariate statistical analysis based on multimodal MRI and MRS for the noninvasive evaluation of intracranial tumors.