Current Status and Quality of Machine Learning-Based Radiomics Studies for Glioma Grading: A Systematic Review

Systematic reviews of machine learning in healthcare: a literature review

INTRODUCTION

The increasing availability of data and computing power has made machine learning (ML) a viable approach to faster, more efficient healthcare delivery.

METHODS

A systematic literature review (SLR) of published SLRs evaluating ML applications in healthcare settings published between1 January 2010 and 27 March 2023 was conducted.

RESULTS

In total 220 SLRs covering 10,462 ML algorithms were reviewed. The main application of AI in medicine related to the clinical prediction and disease prognosis in oncology and neurology with the use of imaging data. Accuracy, specificity, and sensitivity were provided in 56%, 28%, and 25% SLRs respectively. Internal and external validation was reported in 53% and less than 1% of the cases respectively. The most common modeling approach was neural networks (2,454 ML algorithms), followed by support vector machine and random forest/decision trees (1,578 and 1,522 ML algorithms, respectively).

EXPERT OPINION

The review indicated considerable reporting gaps in terms of the ML's performance, both internal and external validation. Greater accessibility to healthcare data for developers can ensure the faster adoption of ML algorithms into clinical practice.

The use of artificial intelligence tools in cancer detection compared to the traditional diagnostic imaging methods: An overview of the systematic reviews

BACKGROUND AND PURPOSE

In comparison to conventional medical imaging diagnostic modalities, the aim of this overview article is to analyze the accuracy of the application of Artificial Intelligence (AI) techniques in the identification and diagnosis of malignant tumors in adult patients.

DATA SOURCES

The acronym PIRDs was used and a comprehensive literature search was conducted on PubMed, Cochrane, Scopus, Web of Science, LILACS, Embase, Scielo, EBSCOhost, and grey literature through Proquest, Google Scholar, and JSTOR for systematic reviews of AI as a diagnostic model and/or detection tool for any cancer type in adult patients, compared to the traditional diagnostic radiographic imaging model. There were no limits on publishing status, publication time, or language. For study selection and risk of bias evaluation, pairs of reviewers worked separately.

RESULTS

In total, 382 records were retrieved in the databases, 364 after removing duplicates, 32 satisfied the full-text reading criterion, and 09 papers were considered for qualitative synthesis. Although there was heterogeneity in terms of methodological aspects, patient differences, and techniques used, the studies found that several AI approaches are promising in terms of specificity, sensitivity, and diagnostic accuracy in the detection and diagnosis of malignant tumors. When compared to other machine learning algorithms, the Super Vector Machine method performed better in cancer detection and diagnosis. Computer-assisted detection (CAD) has shown promising in terms of aiding cancer detection, when compared to the traditional method of diagnosis.

CONCLUSIONS

The detection and diagnosis of malignant tumors with the help of AI seems to be feasible and accurate with the use of different technologies, such as CAD systems, deep and machine learning algorithms and radiomic analysis when compared with the traditional model, although these technologies are not capable of to replace the professional radiologist in the analysis of medical images. Although there are limitations regarding the generalization for all types of cancer, these AI tools might aid professionals, serving as an auxiliary and teaching tool, especially for less trained professionals. Therefore, further longitudinal studies with a longer follow-up duration are required for a better understanding of the clinical application of these artificial intelligence systems.

TRIAL REGISTRATION

Systematic review registration. Prospero registration number: CRD42022307403.

Radiomics Outperforms Clinical and Radiologic Signs in Predicting Spontaneous Basal Ganglia Hematoma Expansion: A Pilot Study

Prediction of the hematoma expansion (HE) of spontaneous basal ganglia hematoma (SBH) from the first non-contrast CT can result in better management, which has the potential of improving outcomes. This study has been designed to compare the performance of "Radiomics analysis," "radiology signs," and "clinical-laboratory data" for this task. We retrospectively reviewed the electronic medical records for clinical, demographic, and laboratory data in patients with SBH. CT images were reviewed for the presence of radiologic signs, including black-hole, blend, swirl, satellite, and island signs. Radiomic features from the SBH on the first brain CT were extracted, and the most predictive features were selected. Different machine learning models were developed based on clinical, laboratory, and radiology signs and selected Radiomic features to predict hematoma expansion (HE). The dataset used for this analysis included 116 patients with SBH. Among different models and different thresholds to define hematoma expansion (10%, 20%, 25%, 33%, 40%, and 50% volume enlargement thresholds), the Random Forest based on 10 selected Radiomic features achieved the best performance (for 25% hematoma enlargement) with an area under the curve (AUC) of 0.9 on the training dataset and 0.89 on the test dataset. The models based on clinical-laboratory and radiology signs had low performance (AUCs about 0.5-0.6).

Recapitulating the Key Advances in the Diagnosis and Prognosis of High-Grade Gliomas: Second Half of 2021 Update

High-grade gliomas (World Health Organization grades III and IV) are the most frequent and fatal brain tumors, with median overall survivals of 24–72 and 14–16 months, respectively. We reviewed the progress in the diagnosis and prognosis of high-grade gliomas published in the second half of 2021. A literature search was performed in PubMed using the general terms “radio* and gliom*” and a time limit from 1 July 2021 to 31 December 2021. Important advances were provided in both imaging and non-imaging diagnoses of these hard-to-treat cancers. Our prognostic capacity also increased during the second half of 2021. This review article demonstrates slow, but steady improvements, both scientifically and technically, which express an increased chance that patients with high-grade gliomas may be correctly diagnosed without invasive procedures. The prognosis of those patients strictly depends on the final results of that complex diagnostic process, with widely varying survival rates.

Systematic review of the radiomics quality score applications: an EuSoMII Radiomics Auditing Group Initiative

OBJECTIVE

The main aim of the present systematic review was a comprehensive overview of the Radiomics Quality Score (RQS)-based systematic reviews to highlight common issues and challenges of radiomics research application and evaluate the relationship between RQS and review features.

METHODS

The literature search was performed on multiple medical literature archives according to PRISMA guidelines for systematic reviews that reported radiomic quality assessment through the RQS. Reported scores were converted to a 0-100% scale. The Mann-Whitney and Kruskal-Wallis tests were used to compare RQS scores and review features.

RESULTS

The literature research yielded 345 articles, from which 44 systematic reviews were finally included in the analysis. Overall, the median of RQS was 21.00% (IQR = 11.50). No significant differences of RQS were observed in subgroup analyses according to targets (oncological/not oncological target, neuroradiology/body imaging focus and one imaging technique/more than one imaging technique, characterization/prognosis/detection/other).

CONCLUSIONS

Our review did not reveal a significant difference of quality of radiomic articles reported in systematic reviews, divided in different subgroups. Furthermore, low overall methodological quality of radiomics research was found independent of specific application domains. While the RQS can serve as a reference tool to improve future study designs, future research should also be aimed at improving its reliability and developing new tools to meet an ever-evolving research space.

KEY POINTS

• Radiomics is a promising high-throughput method that may generate novel imaging biomarkers to improve clinical decision-making process, but it is an inherently complex analysis and often lacks reproducibility and generalizability. • The Radiomics Quality Score serves a necessary role as the de facto reference tool for assessing radiomics studies. • External auditing of radiomics studies, in addition to the standard peer-review process, is valuable to highlight common limitations and provide insights to improve future study designs and practical applicability of the radiomics models.

Gaps and Opportunities of Artificial Intelligence Applications for Pediatric Oncology in European Research: A Systematic Review of Reviews and a Bibliometric Analysis

The application of artificial intelligence (AI) systems is emerging in many fields in recent years, due to the increased computing power available at lower cost. Although its applications in various branches of medicine, such as pediatric oncology, are many and promising, its use is still in an embryonic stage. The aim of this paper is to provide an overview of the state of the art regarding the AI application in pediatric oncology, through a systematic review of systematic reviews, and to analyze current trends in Europe, through a bibliometric analysis of publications written by European authors. Among 330 records found, 25 were included in the systematic review. All papers have been published since 2017, demonstrating only recent attention to this field. The total number of studies included in the selected reviews was 674, with a third including an author with a European affiliation. In bibliometric analysis, 304 out of the 978 records found were included. Similarly, the number of publications began to dramatically increase from 2017. Most explored AI applications regard the use of diagnostic images, particularly radiomics, as well as the group of neoplasms most involved are the central nervous system tumors. No evidence was found regarding the use of AI for process mining, clinical pathway modeling, or computer interpreted guidelines to improve the healthcare process. No robust evidence is yet available in any of the domains investigated by systematic reviews. However, the scientific production in Europe is significant and consistent with the topics covered in systematic reviews at the global level. The use of AI in pediatric oncology is developing rapidly with promising results, but numerous gaps and challenges persist to validate its utilization in clinical practice. An important limitation is the need for large datasets for training algorithms, calling for international collaborative studies.

Machine Learning Tools for Image-Based Glioma Grading and the Quality of Their Reporting: Challenges and Opportunities

Technological innovation has enabled the development of machine learning (ML) tools that aim to improve the practice of radiologists. In the last decade, ML applications to neuro-oncology have expanded significantly, with the pre-operative prediction of glioma grade using medical imaging as a specific area of interest. We introduce the subject of ML models for glioma grade prediction by remarking upon the models reported in the literature as well as by describing their characteristic developmental workflow and widely used classifier algorithms. The challenges facing these models-including data sources, external validation, and glioma grade classification methods -are highlighted. We also discuss the quality of how these models are reported, explore the present and future of reporting guidelines and risk of bias tools, and provide suggestions for the reporting of prospective works. Finally, this review offers insights into next steps that the field of ML glioma grade prediction can take to facilitate clinical implementation.

Machine Learning Models for Classifying High- and Low-Grade Gliomas: A Systematic Review and Quality of Reporting Analysis

Objectives

To systematically review, assess the reporting quality of, and discuss improvement opportunities for studies describing machine learning (ML) models for glioma grade prediction.

Methods

This study followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses of Diagnostic Test Accuracy (PRISMA-DTA) statement. A systematic search was performed in September 2020, and repeated in January 2021, on four databases: Embase, Medline, CENTRAL, and Web of Science Core Collection. Publications were screened in Covidence, and reporting quality was measured against the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) Statement. Descriptive statistics were calculated using GraphPad Prism 9.

Results

The search identified 11,727 candidate articles with 1,135 articles undergoing full text review and 85 included in analysis. 67 (79%) articles were published between 2018-2021. The mean prediction accuracy of the best performing model in each study was 0.89 ± 0.09. The most common algorithm for conventional machine learning studies was Support Vector Machine (mean accuracy: 0.90 ± 0.07) and for deep learning studies was Convolutional Neural Network (mean accuracy: 0.91 ± 0.10). Only one study used both a large training dataset (n>200) and external validation (accuracy: 0.72) for their model. The mean adherence rate to TRIPOD was 44.5% ± 11.1%, with poor reporting adherence for model performance (0%), abstracts (0%), and titles (0%).

Conclusions

The application of ML to glioma grade prediction has grown substantially, with ML model studies reporting high predictive accuracies but lacking essential metrics and characteristics for assessing model performance. Several domains, including generalizability and reproducibility, warrant further attention to enable translation into clinical practice.

Systematic Review Registration

PROSPERO, identifier CRD42020209938.

Developing an Artificial Intelligence Model for Tumor Grading and Classification, Based on MRI Sequences of Human Brain Gliomas

Background: Artificial intelligence (AI) models have provided advanced applications to many scientific areas, including the prediction of the pathologic grade of tumors, utilizing radiology techniques. Gliomas are among the malignant brain tumors in human adults, and their efficient diagnosis is of high clinical significance. Objectives: Given the contribution of AI to medical diagnoses, we investigated the role of deep learning in the differential diagnosis and grading of human brain gliomas. Methods: This study developed a new AI diagnostic model, i.e., EfficientNetB0, to grade and classify human brain gliomas, using sequences from magnetic resonance imaging (MRI). Results: We validated the new AI model, using a standard dataset (BraTS-2019) and demonstrated that the AI components, i.e., convolutional neural networks and transfer learning, provided excellent performance for classifying and grading glioma images at 98.8% accuracy. Conclusions: The proposed model, EfficientNetB0, is capable to classify and grade glioma from MRI sequences at high accuracy, validity, and specificity. It can provide better performance and diagnostic results for human glioma images than models developed by previous studies.

[Artificial intelligence technologies in clinical neurooncology]

Neurooncology in the 21st century is a complex discipline integrating achievements of fundamental and applied neurosciences. Complex processes and data in clinical neurooncology determine the necessity for advanced methods of mathematical modeling and predictive analytics to obtain new scientific knowledge. Such methods are currently being developed in computer science (artificial intelligence). This review is devoted to potential and range of possible applications of artificial intelligence technologies in neurooncology with a special emphasis on glial tumors. Our conclusions may be valid for other areas of clinical medicine.

The Role of Machine Learning and Radiomics for Treatment Response Prediction in Idiopathic Normal Pressure Hydrocephalus

Introduction Ventricular shunting remains the standard of care for patients with idiopathic normal pressure hydrocephalus (iNPH); however, not all patients benefit from the shunting. Prediction of response in advance can result in improved patient selection for ventricular shunting. This study aims to develop a machine learning predictive model for treatment response after shunt placement using the clinical and radiomics features. Methods In this retrospective pilot study, the medical records of iNPH patients who underwent ventricular shunting were evaluated. In each patient, the "idiopathic normal pressure hydrocephalus grading scale" (iNPHGS) and a "Modified Rankin Scale" were calculated before and after surgery. The subsequent treatment response was calculated as the difference between the iNPHGS scores before and after surgery. iNPHGS score reduction of two or more than two were considered as treatment response. The presurgical MRI scans were evaluated by radiologists, the ventricular systems were segmented on the T2-weighted images, and the radiomics features were extracted from the segmented ventricular system. Using Orange data mining open-source platform, different machine learning models were then developed based on the presurgical clinical features and the selected radiomics features to predict treatment response after shunt placement. Results After the implementation of the inclusion criteria, 78 patients were included in this study. One hundred twenty radiomics features were extracted, and the 12 best predictive radiomics features were selected. Using only clinical data (iNPHGS and Modified Rankin Scale), the random forest model achieved the best performance in treatment prediction with an area under the curve (AUC) of 0.71. Adding the Radiomics analysis to the clinical data improved the prediction performance, with the support vector machine (SVM) achieving the highest rank in treatment prediction with an AUC of 0.8. Adding age and sex to the analysis did not improve the prediction. Conclusion Using machine learning models for treatment response prediction in patients with iNPH is feasible with acceptable accuracy. Adding the Radiomics analysis to the clinical features can further improve the predictive performance. SVM is likely the best model for this task.

Radiomics as a New Frontier of Imaging for Cancer Prognosis: A Narrative Review

The evaluation of the efficacy of different therapies is of paramount importance for the patients and the clinicians in oncology, and it is usually possible by performing imaging investigations that are interpreted, taking in consideration different response evaluation criteria. In the last decade, texture analysis (TA) has been developed in order to help the radiologist to quantify and identify parameters related to tumor heterogeneity, which cannot be appreciated by the naked eye, that can be correlated with different endpoints, including cancer prognosis. The aim of this work is to analyze the impact of texture in the prediction of response and in prognosis stratification in oncology, taking into consideration different pathologies (lung cancer, breast cancer, gastric cancer, hepatic cancer, rectal cancer). Key references were derived from a PubMed query. Hand searching and clinicaltrials.gov were also used. This paper contains a narrative report and a critical discussion of radiomics approaches related to cancer prognosis in different fields of diseases.