Accuracy of Machine Learning Algorithms for the Classification of Molecular Features of Gliomas on MRI: A Systematic Literature Review and Meta-Analysis

Amide proton transfer weighted and diffusion weighted imaging based radiomics classification algorithm for predicting 1p/19q co-deletion status in low grade gliomas

BACKGROUND

1p/19q co-deletion in low-grade gliomas (LGG, World Health Organization grade II and III) is of great significance in clinical decision making. We aim to use radiomics analysis to predict 1p/19q co-deletion in LGG based on amide proton transfer weighted (APTw), diffusion weighted imaging (DWI), and conventional MRI.

METHODS

This retrospective study included 90 patients histopathologically diagnosed with LGG. We performed a radiomics analysis by extracting 8454 MRI-based features form APTw, DWI and conventional MR images and applied a least absolute shrinkage and selection operator (LASSO) algorithm to select radiomics signature. A radiomics score (Rad-score) was generated using a linear combination of the values of the selected features weighted for each of the patients. Three neuroradiologists, including one experienced neuroradiologist and two resident physicians, independently evaluated the MR features of LGG and provided predictions on whether the tumor had 1p/19q co-deletion or 1p/19q intact status. A clinical model was then constructed based on the significant variables identified in this analysis. A combined model incorporating both the Rad-score and clinical factors was also constructed. The predictive performance was validated by receiver operating characteristic curve analysis, DeLong analysis and decision curve analysis. P < 0.05 was statistically significant.

RESULTS

The radiomics model and the combined model both exhibited excellent performance on both the training and test sets, achieving areas under the curve (AUCs) of 0.948 and 0.966, as well as 0.909 and 0.896, respectively. These results surpassed the performance of the clinical model, which achieved AUCs of 0.760 and 0.766 on the training and test sets, respectively. After performing Delong analysis, the clinical model did not significantly differ in predictive performance from three neuroradiologists. In the training set, both the radiomic and combined models performed better than all neuroradiologists. In the test set, the models exhibited higher AUCs than the neuroradiologists, with the radiomics model significantly outperforming resident physicians B and C, but not differing significantly from experienced neuroradiologist.

CONCLUSIONS

Our results suggest that our algorithm can noninvasively predict the 1p/19q co-deletion status of LGG. The predictive performance of radiomics model was comparable to that of experienced neuroradiologist, significantly outperforming the diagnostic accuracy of resident physicians, thereby offering the potential to facilitate non-invasive 1p/19q co-deletion prediction of LGG.

AI-driven estimation of O6 methylguanine-DNA-methyltransferase (MGMT) promoter methylation in glioblastoma patients: a systematic review with bias analysis

BACKGROUND

Accurate and non-invasive estimation of MGMT promoter methylation status in glioblastoma (GBM) patients is of paramount clinical importance, as it is a predictive biomarker associated with improved overall survival (OS). In response to the clinical need, recent studies have focused on the development of non-invasive artificial intelligence (AI)-based methods for MGMT estimation. In this systematic review, we not only delve into the technical aspects of these AI-driven MGMT estimation methods but also emphasize their profound clinical implications. Specifically, we explore the potential impact of accurate non-invasive MGMT estimation on GBM patient care and treatment decisions.

METHODS

Employing a PRISMA search strategy, we identified 33 relevant studies from reputable databases, including PubMed, ScienceDirect, Google Scholar, and IEEE Explore. These studies were comprehensively assessed using 21 diverse attributes, encompassing factors such as types of imaging modalities, machine learning (ML) methods, and cohort sizes, with clear rationales for attribute scoring. Subsequently, we ranked these studies and established a cutoff value to categorize them into low-bias and high-bias groups.

RESULTS

By analyzing the 'cumulative plot of mean score' and the 'frequency plot curve' of the studies, we determined a cutoff value of 6.00. A higher mean score indicated a lower risk of bias, with studies scoring above the cutoff mark categorized as low-bias (73%), while 27% fell into the high-bias category.

CONCLUSION

Our findings underscore the immense potential of AI-based machine learning (ML) and deep learning (DL) methods in non-invasively determining MGMT promoter methylation status. Importantly, the clinical significance of these AI-driven advancements lies in their capacity to transform GBM patient care by providing accurate and timely information for treatment decisions. However, the translation of these technical advancements into clinical practice presents challenges, including the need for large multi-institutional cohorts and the integration of diverse data types. Addressing these challenges will be critical in realizing the full potential of AI in improving the reliability and accessibility of MGMT estimation while lowering the risk of bias in clinical decision-making.

Systematic reviews of machine learning in healthcare: a literature review

INTRODUCTION

The increasing availability of data and computing power has made machine learning (ML) a viable approach to faster, more efficient healthcare delivery.

METHODS

A systematic literature review (SLR) of published SLRs evaluating ML applications in healthcare settings published between1 January 2010 and 27 March 2023 was conducted.

RESULTS

In total 220 SLRs covering 10,462 ML algorithms were reviewed. The main application of AI in medicine related to the clinical prediction and disease prognosis in oncology and neurology with the use of imaging data. Accuracy, specificity, and sensitivity were provided in 56%, 28%, and 25% SLRs respectively. Internal and external validation was reported in 53% and less than 1% of the cases respectively. The most common modeling approach was neural networks (2,454 ML algorithms), followed by support vector machine and random forest/decision trees (1,578 and 1,522 ML algorithms, respectively).

EXPERT OPINION

The review indicated considerable reporting gaps in terms of the ML's performance, both internal and external validation. Greater accessibility to healthcare data for developers can ensure the faster adoption of ML algorithms into clinical practice.

Noninvasive grading of glioma brain tumors using magnetic resonance imaging and deep learning methods

PURPOSE

Convolutional Neural Networks (ConvNets) have quickly become popular machine learning techniques in recent years, particularly in the classification and segmentation of medical images. One of the most prevalent types of brain cancers is glioma, and early, accurate diagnosis is essential for both treatment and survival. In this study, MRI scans were examined utilizing deep learning techniques to examine glioma diagnosis studies.

METHODS

In this systematic review, keywords were used to obtain English-language studies from the Arxiv, IEEE, Springer, ScienceDirect, and PubMed databases for the years 2010-2022. The material needed for review was then collected from the articles once they had been chosen based on the entry and exit criteria and in accordance with the research's goal.

RESULTS

Finally, 77 different academic articles were chosen. According to a study of published articles, glioma brain tumors were discovered, categorized, and segmented utilizing a coordinated approach that included image collecting, pre-processing, model design and execution, and model output evaluation. The majority of investigations have used publicly accessible photo databases and already-trained algorithms. The bulk of studies have employed Dice's classification accuracy and similarity coefficient metrics to assess model performance.

CONCLUSION

The results of this study indicate that glioma segmentation has received more attention from researchers than glioma detection and classification. It is advised that more research be done in the areas of glioma detection and, particularly, grading in order to be included in systems that support medical diagnosis.

Advances in diffuse glial tumors diagnosis

In recent decades, there have been significant advances in the diagnosis of diffuse gliomas, driven by the integration of novel technologies. These advancements have deepened our understanding of tumor oncogenesis, enabling a more refined stratification of the biological behavior of these neoplasms. This progress culminated in the fifth edition of the WHO classification of central nervous system (CNS) tumors in 2021. This comprehensive review article aims to elucidate these advances within a multidisciplinary framework, contextualized within the backdrop of the new classification. This article will explore morphologic pathology and molecular/genetics techniques (immunohistochemistry, genetic sequencing, and methylation profiling), which are pivotal in diagnosis, besides the correlation of structural neuroimaging radiophenotypes to pathology and genetics. It briefly reviews the usefulness of tractography and functional neuroimaging in surgical planning. Additionally, the article addresses the value of other functional imaging techniques such as perfusion MRI, spectroscopy, and nuclear medicine in distinguishing tumor progression from treatment-related changes. Furthermore, it discusses the advantages of evolving diagnostic techniques in classifying these tumors, as well as their limitations in terms of availability and utilization. Moreover, the expanding domains of data processing, artificial intelligence, radiomics, and radiogenomics hold great promise and may soon exert a substantial influence on glioma diagnosis. These innovative technologies have the potential to revolutionize our approach to these tumors. Ultimately, this review underscores the fundamental importance of multidisciplinary collaboration in employing recent diagnostic advancements, thereby hoping to translate them into improved quality of life and extended survival for glioma patients.

Performance of deep learning algorithms to distinguish high-grade glioma from low-grade glioma: A systematic review and meta-analysis

This study aims to evaluate deep learning (DL) performance in differentiating low- and high-grade glioma. Search online database for studies continuously published from 1st January 2015 until 16th August 2022. The random-effects model was used for synthesis, based on pooled sensitivity (SE), specificity (SP), and area under the curve (AUC). Heterogeneity was estimated using the Higgins inconsistency index (I²). 33 were ultimately included in the meta-analysis. The overall pooled SE and SP were 94% and 93%, with an AUC of 0.98. There was great heterogeneity in this field. Our evidence-based study shows DL achieves high accuracy in glioma grading. Subgroup analysis reveals several limitations in this field: 1) Diagnostic trials require standard method for data merging for AI; 2) small sample size; 3) poor-quality image preprocessing; 4) not standard algorithm development; 5) not standard data report; 6) different definition of HGG and LGG; and 7) poor extrapolation.

Diagnostic performance of magnetic resonance imaging-based machine learning in Alzheimer's disease detection: a meta-analysis

PURPOSE

Advanced machine learning (ML) algorithms can assist rapid medical image recognition and realize automatic, efficient, noninvasive, and convenient diagnosis. We aim to further evaluate the diagnostic performance of ML to distinguish patients with probable Alzheimer's disease (AD) from normal older adults based on structural magnetic resonance imaging (MRI).

METHODS

The Medline, Embase, and Cochrane Library databases were searched for relevant literature published up until July 2021. We used the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool and Checklist for Artificial Intelligence in Medical Imaging (CLAIM) to evaluate all included studies' quality and potential bias. Random-effects models were used to calculate pooled sensitivity and specificity, and the Deeks' test was used to assess publication bias.

RESULTS

We included 24 models based on different brain features extracted by ML algorithms in 19 papers. The pooled sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, diagnostic odds ratio, and area under the summary receiver operating characteristic curve for ML in detecting AD were 0.85 (95%CI 0.81-0.89), 0.88 (95%CI 0.84-0.91), 7.15 (95%CI 5.40-9.47), 0.17 (95%CI 0.12-0.22), 43.34 (95%CI 26.89-69.84), and 0.93 (95%CI 0.91-0.95).

CONCLUSION

ML using structural MRI data performed well in diagnosing probable AD patients and normal elderly. However, more high-quality, large-scale prospective studies are needed to further enhance the reliability and generalizability of ML for clinical applications before it can be introduced into clinical practice.

Challenges and opportunities for advanced neuroimaging of glioblastoma

Glioblastoma is the most aggressive of glial tumours in adults. On conventional magnetic resonance (MR) imaging, these tumours are observed as irregular enhancing lesions with areas of infiltrating tumour and cortical expansion. More advanced imaging techniques including diffusion-weighted MRI, perfusion-weighted MRI, MR spectroscopy and positron emission tomography (PET) imaging have found widespread application to diagnostic challenges in the setting of first diagnosis, treatment planning and follow-up. This review aims to educate readers with regard to the strengths and weaknesses of the clinical application of these imaging techniques. For example, this review shows that the (semi)quantitative analysis of the mentioned advanced imaging tools was found useful for assessing tumour aggressiveness and tumour extent, and aids in the differentiation of tumour progression from treatment-related effects. Although these techniques may aid in the diagnostic work-up and (post-)treatment phase of glioblastoma, so far no unequivocal imaging strategy is available. Furthermore, the use and further development of artificial intelligence (AI)-based tools could greatly enhance neuroradiological practice by automating labour-intensive tasks such as tumour measurements, and by providing additional diagnostic information such as prediction of tumour genotype. Nevertheless, due to the fact that advanced imaging and AI-diagnostics is not part of response assessment criteria, there is no harmonised guidance on their use, while at the same time the lack of standardisation severely hampers the definition of uniform guidelines.

Deep learning for prediction of isocitrate dehydrogenase mutation in gliomas: a critical approach, systematic review and meta-analysis of the diagnostic test performance using a Bayesian approach

Background

Conventionally, identifying isocitrate dehydrogenase (IDH) mutation in gliomas is based on histopathological analysis of tissue specimens acquired via stereotactic biopsy or definitive resection. Accurate pre-treatment prediction of IDH mutation status using magnetic resonance imaging (MRI) can guide clinical decision-making. We aim to evaluate the diagnostic performance of deep learning (DL) to determine IDH mutation status in gliomas.

Methods

A systematic search of Cochrane Library, Web of Science, Medline, and Scopus was conducted to identify relevant publications until August 1, 2021. Articles were included if all the following criteria were met: (I) patients with histopathologically confirmed World Health Organization (WHO) grade II, III, or IV gliomas; (II) histopathological examination with the IDH mutation; (III) DL was used to predict the IDH mutation status; (IV) sufficient data for reconstruction of confusion matrices in terms of the diagnostic performance of the DL algorithms; and (V) original research articles. Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) and Checklist for Artificial Intelligence in Medical Imaging (CLAIM) was used to assess the studies' quality. Bayes theorem was utilized to calculate the posttest probability.

Results

Four studies with a total of 1,295 patients were included. In the training set, the pooled sensitivity, specificity, and area under the summary receiver operating characteristic (SROC) curve were 93.9%, 90.9% and 0.958, respectively. In the validation set, the pooled sensitivity, specificity, and area under the SROC curve were 90.8%, 85.5% and 0.939, respectively. With a known pretest probability of 80.2%, the Bayes theorem yielded a posttest probability of 97.6% and 96.0% for a positive test and 27.0% and 30.6% for a negative test for training sets and validation sets, respectively.

Discussion

This is the first meta-analysis that summarizes the diagnostic performance of DL in predicting IDH mutation status in gliomas via the Bayes theorem. DL algorithms demonstrate excellent diagnostic performance in predicting IDH mutation in gliomas. Radiomic features associated with IDH mutation, and its underlying pathophysiology extracted from advanced MRI may improve prediction probability. However, more studies are required to optimize and increase its reliability. Limitations include obtaining some data via email and lack of training and test sets statistics.

Diagnostic Accuracy of Machine Learning Models on Mammography in Breast Cancer Classification: A Meta-Analysis

In this meta-analysis, we aimed to estimate the diagnostic accuracy of machine learning models on digital mammograms and tomosynthesis in breast cancer classification and to assess the factors affecting its diagnostic accuracy. We searched for related studies in Web of Science, Scopus, PubMed, Google Scholar and Embase. The studies were screened in two stages to exclude the unrelated studies and duplicates. Finally, 36 studies containing 68 machine learning models were included in this meta-analysis. The area under the curve (AUC), hierarchical summary receiver operating characteristics (HSROC) curve, pooled sensitivity and pooled specificity were estimated using a bivariate Reitsma model. Overall AUC, pooled sensitivity and pooled specificity were 0.90 (95% CI: 0.85-0.90), 0.83 (95% CI: 0.78-0.87) and 0.84 (95% CI: 0.81-0.87), respectively. Additionally, the three significant covariates identified in this study were country (p = 0.003), source (p = 0.002) and classifier (p = 0.016). The type of data covariate was not statistically significant (p = 0.121). Additionally, Deeks' linear regression test indicated that there exists a publication bias in the included studies (p = 0.002). Thus, the results should be interpreted with caution.

Reliability of dynamic susceptibility contrast perfusion metrics in pre- and post-treatment glioma

Background

In neuro-oncology, dynamic susceptibility contrast magnetic resonance (DSC-MR) perfusion imaging emerged as a tool to aid in the diagnostic work-up and to surveil effectiveness of treatment. However, it is believed that a significant variability exists with regard to the measured in DSC-MR perfusion parameters. The aim of this study was to assess the observer variability in measured DSC-MR perfusion parameters in patients before and after treatment. In addition, we investigated whether region-of-interest (ROI) shape impacted the observer variability.

Materials and methods

Twenty non-treated patients and a matched group of twenty patients post-treatment (neurosurgical resection and post-chemoradiotherapy) were included. Six ROIs were independently placed by three readers: circular ROIs and polygonal ROIs covering 1) the tumor hotspot; 2) the peritumoral region (T2/FLAIR-hyperintense region) and 3) the whole tumor region. A two-way random Intra-class coefficient (ICC) model was used to assess variability in measured DSC-MRI perfusion parameters. The perfusion metrics as assessed by the circular and the polygonal ROI were compared by use of the dependent T-test.

Results

In the non-treated group, circular ROIs showed good–excellent overlap (ICC-values ranging from 0.741–0.963) with the exception of those representing the tumor hotspot. Polygonal ROIs showed lower ICC-values, ranging from 0.113 till 0.856. ROI-placement in the posttreatment group showed to be highly variable with a significant deterioration of ICC-values. Furthermore, perfusion metric assessment in similar tumor regions was not impacted by ROI shape.

Discussion

This study shows that posttreatment quantitative interpretation of DSC-MR perfusion imaging is highly variable and should be carried out with precaution. Pretreatment assessment of DSC-MR images, however, could be carried out be a single reader in order to provide valid data for further analyses.

• DSC-MR perfusion imaging measurements in non-treated glioma is highly reliable between readers, even readers with little experience.

• DSC-MR perfusion imaging measurements in treated glioma is show to be inconsistent between readers.

• When using DSC-MR perfusion imaging as a quantitative surveillance tool for the recurrence of glioma after treatment, double-reading should be preferred.

A systematic review and meta-analysis on the differentiation of glioma grade and mutational status by use of perfusion-based magnetic resonance imaging

Background

Molecular characterization plays a crucial role in glioma classification which impacts treatment strategy and patient outcome. Dynamic susceptibility contrast (DSC) and dynamic contrast enhanced (DCE) perfusion imaging have been suggested as methods to help characterize glioma in a non-invasive fashion. This study set out to review and meta-analyze the evidence on the accuracy of DSC and/or DCE perfusion MRI in predicting IDH genotype and 1p/19q integrity status.

Methods

After systematic literature search on Medline, EMBASE, Web of Science and the Cochrane Library, a qualitative meta-synthesis and quantitative meta-analysis were conducted. Meta-analysis was carried out on aggregated AUC data for different perfusion metrics.

Results

Of 680 papers, twelve were included for the qualitative meta-synthesis, totaling 1384 patients. It was observed that CBV, ktrans, Ve and Vp values were, in general, significantly higher in IDH wildtype compared to IDH mutated glioma. Meta-analysis comprising of five papers (totaling 316 patients) showed that the AUC of CBV, ktrans, Ve and Vp were 0.85 (95%-CI 0.75–0.93), 0.81 (95%-CI 0.74–0.89), 0.84 (95%-CI 0.71–0.97) and 0.76 (95%-CI 0.61–0.90), respectively. No conclusive data on the prediction of 1p/19q integrity was available from these studies.

Conclusions

Future research should aim to predict 1p/19q integrity based on perfusion MRI data. Additionally, correlations with other clinically relevant outcomes should be further investigated, including patient stratification for treatment and overall survival.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13244-022-01230-7.

Gaps and Opportunities of Artificial Intelligence Applications for Pediatric Oncology in European Research: A Systematic Review of Reviews and a Bibliometric Analysis

The application of artificial intelligence (AI) systems is emerging in many fields in recent years, due to the increased computing power available at lower cost. Although its applications in various branches of medicine, such as pediatric oncology, are many and promising, its use is still in an embryonic stage. The aim of this paper is to provide an overview of the state of the art regarding the AI application in pediatric oncology, through a systematic review of systematic reviews, and to analyze current trends in Europe, through a bibliometric analysis of publications written by European authors. Among 330 records found, 25 were included in the systematic review. All papers have been published since 2017, demonstrating only recent attention to this field. The total number of studies included in the selected reviews was 674, with a third including an author with a European affiliation. In bibliometric analysis, 304 out of the 978 records found were included. Similarly, the number of publications began to dramatically increase from 2017. Most explored AI applications regard the use of diagnostic images, particularly radiomics, as well as the group of neoplasms most involved are the central nervous system tumors. No evidence was found regarding the use of AI for process mining, clinical pathway modeling, or computer interpreted guidelines to improve the healthcare process. No robust evidence is yet available in any of the domains investigated by systematic reviews. However, the scientific production in Europe is significant and consistent with the topics covered in systematic reviews at the global level. The use of AI in pediatric oncology is developing rapidly with promising results, but numerous gaps and challenges persist to validate its utilization in clinical practice. An important limitation is the need for large datasets for training algorithms, calling for international collaborative studies.

Artificial Intelligence in Brain Tumour Surgery-An Emerging Paradigm

Artificial intelligence (AI) platforms have the potential to cause a paradigm shift in brain tumour surgery. Brain tumour surgery augmented with AI can result in safer and more effective treatment. In this review article, we explore the current and future role of AI in patients undergoing brain tumour surgery, including aiding diagnosis, optimising the surgical plan, providing support during the operation, and better predicting the prognosis. Finally, we discuss barriers to the successful clinical implementation, the ethical concerns, and we provide our perspective on how the field could be advanced.