Deep Learning for Pediatric Posterior Fossa Tumor Detection and Classification: A Multi-Institutional Study

Role of artificial intelligence in brain tumour imaging

Artificial intelligence (AI) is a rapidly evolving field with many neuro-oncology applications. In this review, we discuss how AI can assist in brain tumour imaging, focusing on machine learning (ML) and deep learning (DL) techniques. We describe how AI can help in lesion detection, differential diagnosis, anatomic segmentation, molecular marker identification, prognostication, and pseudo-progression evaluation. We also cover AI applications in non-glioma brain tumours, such as brain metastasis, posterior fossa, and pituitary tumours. We highlight the challenges and limitations of AI implementation in radiology, such as data quality, standardization, and integration. Based on the findings in the aforementioned areas, we conclude that AI can potentially improve the diagnosis and treatment of brain tumours and provide a path towards personalized medicine and better patient outcomes.

Applications of artificial intelligence in magnetic resonance imaging of primary pediatric cancers: a scoping review and CLAIM score assessment

PURPOSES

To review the uses of AI for magnetic resonance (MR) imaging assessment of primary pediatric cancer and identify common literature topics and knowledge gaps. To assess the adherence of the existing literature to the Checklist for Artificial Intelligence in Medical Imaging (CLAIM) guidelines.

MATERIALS AND METHODS

A scoping literature search using MEDLINE, EMBASE and Cochrane databases was performed, including studies of > 10 subjects with a mean age of < 21 years. Relevant data were summarized into three categories based on AI application: detection, characterization, treatment and monitoring. Readers independently scored each study using CLAIM guidelines, and inter-rater reproducibility was assessed using intraclass correlation coefficients.

RESULTS

Twenty-one studies were included. The most common AI application for pediatric cancer MR imaging was pediatric tumor diagnosis and detection (13/21 [62%] studies). The most commonly studied tumor was posterior fossa tumors (14 [67%] studies). Knowledge gaps included a lack of research in AI-driven tumor staging (0/21 [0%] studies), imaging genomics (1/21 [5%] studies), and tumor segmentation (2/21 [10%] studies). Adherence to CLAIM guidelines was moderate in primary studies, with an average (range) of 55% (34%-73%) CLAIM items reported. Adherence has improved over time based on publication year.

CONCLUSION

The literature surrounding AI applications of MR imaging in pediatric cancers is limited. The existing literature shows moderate adherence to CLAIM guidelines, suggesting that better adherence is required for future studies.

Deep learning based clinico-radiological model for paediatric brain tumor detection and subtype prediction

Aim

Early diagnosis of paediatric brain tumors significantly improves the outcome. The aim is to study magnetic resonance imaging (MRI) features of paediatric brain tumors and to develop an automated segmentation (AS) tool which could segment and classify tumors using deep learning methods and compare with radiologist assessment.

Methods

This study included 94 cases, of which 75 were diagnosed cases of ependymoma, medulloblastoma, brainstem glioma, and pilocytic astrocytoma and 19 were normal MRI brain cases. The data was randomized into training data, 64 cases; test data, 21 cases and validation data, 9 cases to devise a deep learning algorithm to segment the paediatric brain tumor. The sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and accuracy of the deep learning model were compared with radiologist's findings. Performance evaluation of AS was done based on Dice score and Hausdorff95 distance.

Results

Analysis of MRI semantic features was done with necrosis and haemorrhage as predicting features for ependymoma, diffusion restriction and cystic changes were predictors for medulloblastoma. The accuracy of detecting abnormalities was 90%, with a specificity of 100%. Further segmentation of the tumor into enhancing and non-enhancing components was done. The segmentation results for whole tumor (WT), enhancing tumor (ET), and non-enhancing tumor (NET) have been analyzed by Dice score and Hausdorff95 distance. The accuracy of prediction of all MRI features was compared with experienced radiologist's findings. Substantial agreement observed between the classification by model and the radiologist's given classification [K-0.695 (K is Cohen's kappa score for interrater reliability)].

Conclusions

The deep learning model had very high accuracy and specificity for predicting the magnetic resonance (MR) characteristics and close to 80% accuracy in predicting tumor type. This model can serve as a potential tool to make a timely and accurate diagnosis for radiologists not trained in neuroradiology.

Artificial intelligence applications in pediatric oncology diagnosis

Artificial intelligence (AI) algorithms have been applied in abundant medical tasks with high accuracy and efficiency. Physicians can improve their diagnostic efficiency with the assistance of AI techniques for improving the subsequent personalized treatment and surveillance. AI algorithms fundamentally capture data, identify underlying patterns, achieve preset endpoints, and provide decisions and predictions about real-world events with working principles of machine learning and deep learning. AI algorithms with sufficient graphic processing unit power have been demonstrated to provide timely diagnostic references based on preliminary training of large amounts of clinical and imaging data. The sample size issue is an inevitable challenge for pediatric oncology considering its low morbidity and individual heterogeneity. However, this problem may be solved in the near future considering the exponential advancements of AI algorithms technically to decrease the dependence of AI operation on the amount of data sets and the efficiency of computing power. For instance, it could be a feasible solution by shifting convolutional neural networks (CNNs) from adults and sharing CNN algorithms across multiple institutions besides original data. The present review provides important insights into emerging AI applications for the diagnosis of pediatric oncology by systematically overviewing of up-to-date literature.

Machine Learning in the Classification of Pediatric Posterior Fossa Tumors: A Systematic Review

Background: Posterior fossa tumors (PFTs) are a morbid group of central nervous system tumors that most often present in childhood. While early diagnosis is critical to drive appropriate treatment, definitive diagnosis is currently only achievable through invasive tissue collection and histopathological analyses. Machine learning has been investigated as an alternative means of diagnosis. In this systematic review and meta-analysis, we evaluated the primary literature to identify all machine learning algorithms developed to classify and diagnose pediatric PFTs using imaging or molecular data. Methods: Of the 433 primary papers identified in PubMed, EMBASE, and Web of Science, 25 ultimately met the inclusion criteria. The included papers were extracted for algorithm architecture, study parameters, performance, strengths, and limitations. Results: The algorithms exhibited variable performance based on sample size, classifier(s) used, and individual tumor types being investigated. Ependymoma, medulloblastoma, and pilocytic astrocytoma were the most studied tumors with algorithm accuracies ranging from 37.5% to 94.5%. A minority of studies compared the developed algorithm to a trained neuroradiologist, with three imaging-based algorithms yielding superior performance. Common algorithm and study limitations included small sample sizes, uneven representation of individual tumor types, inconsistent performance reporting, and a lack of application in the clinical environment. Conclusions: Artificial intelligence has the potential to improve the speed and accuracy of diagnosis in this field if the right algorithm is applied to the right scenario. Work is needed to standardize outcome reporting and facilitate additional trials to allow for clinical uptake.

Artificial intelligence reporting guidelines: what the pediatric radiologist needs to know

There has been an exponential rise in artificial intelligence (AI) research in imaging in recent years. While the dissemination of study data that has the potential to improve clinical practice is welcomed, the level of detail included in early AI research reporting has been highly variable and inconsistent, particularly when compared to more traditional clinical research. However, inclusion checklists are now commonly available and accessible to those writing or reviewing clinical research papers. AI-specific reporting guidelines also exist and include distinct requirements, but these can be daunting for radiologists new to the field. Given that pediatric radiology is a specialty faced with workforce shortages and an ever-increasing workload, AI could help by offering solutions to time-consuming tasks, thereby improving workflow efficiency and democratizing access to specialist opinion. As a result, pediatric radiologists are expected to be increasingly leading and contributing to AI imaging research, and researchers and clinicians alike should feel confident that the findings reported are presented in a transparent way, with sufficient detail to understand how they apply to wider clinical practice. In this review, we describe two of the most clinically relevant and available reporting guidelines to help increase awareness and engage the pediatric radiologist in conducting AI imaging research. This guide should also be useful for those reading and reviewing AI imaging research and as a checklist with examples of what to expect.

Applications of Artificial Intelligence Based on Medical Imaging in Glioma: Current State and Future Challenges

Glioma is one of the most fatal primary brain tumors, and it is well-known for its difficulty in diagnosis and management. Medical imaging techniques such as magnetic resonance imaging (MRI), positron emission tomography (PET), and spectral imaging can efficiently aid physicians in diagnosing, treating, and evaluating patients with gliomas. With the increasing clinical records and digital images, the application of artificial intelligence (AI) based on medical imaging has reduced the burden on physicians treating gliomas even further. This review will classify AI technologies and procedures used in medical imaging analysis. Additionally, we will discuss the applications of AI in glioma, including tumor segmentation and classification, prediction of genetic markers, and prediction of treatment response and prognosis, using MRI, PET, and spectral imaging. Despite the benefits of AI in clinical applications, several issues such as data management, incomprehension, safety, clinical efficacy evaluation, and ethical or legal considerations, remain to be solved. In the future, doctors and researchers should collaborate to solve these issues, with a particular emphasis on interdisciplinary teamwork.

Radiomics signature for the prediction of progression-free survival and radiotherapeutic benefits in pediatric medulloblastoma

PURPOSE

To develop and validate a radiomics signature for progression-free survival (PFS) and radiotherapeutic benefits in pediatric medulloblastoma.

MATERIALS AND METHODS

We retrospectively enrolled 253 consecutive children with medulloblastoma from two hospitals. A total of 1294 radiomic features were extracted from the region of tumor on the T1-weighted and contrast-enhanced T1-weighted (CE-T1w) MRI. Radiomic feature selection and machine learning modelling were performed to build radiomics signature for the prediction of PFS on the training set. Moreover, the prognostic performance of the clinical parameters was investigated for PFS. The Concordance index (a value of 0.5 indicates no predictive discrimination, and a value of 1 indicates perfect predictive discrimination) was used to measure and compare the prognostic performance of these models.

RESULTS

The radiomics signature for the prediction of the PFS yielded Concordance indices of 0.711, 0.707, and 0.717 on the training and held-out test sets 1 and 2, respectively. The radiomics nomogram integrating the radiomics signature, age, and metastasis performed better than the nomogram incorporating only clinicopathological factors (C-index, 0.723 vs. 0.665 and 0.722 vs. 0.677 on the held-out test sets 1 and 2, respectively), which was also validated by the good calibration and decision curve analysis. Further analysis demonstrated that patients with lower value of radiomics signature were associated with better clinical outcomes after postoperative radiotherapy (p < 0.001).

CONCLUSION

The radiomics signature and nomogram performed well for the prediction of PFS and could stratify patients underwent postoperative radiotherapy into the high- and low-risk groups with significantly different clinical outcomes.

Radiomics Can Distinguish Pediatric Supratentorial Embryonal Tumors, High-Grade Gliomas, and Ependymomas

BACKGROUND AND PURPOSE

Pediatric supratentorial tumors such as embryonal tumors, high-grade gliomas, and ependymomas are difficult to distinguish by histopathology and imaging because of overlapping features. We applied machine learning to uncover MR imaging-based radiomics phenotypes that can differentiate these tumor types.

MATERIALS AND METHODS

Our retrospective cohort of 231 patients from 7 participating institutions had 50 embryonal tumors, 127 high-grade gliomas, and 54 ependymomas. For each tumor volume, we extracted 900 Image Biomarker Standardization Initiative-based PyRadiomics features from T2-weighted and gadolinium-enhanced T1-weighted images. A reduced feature set was obtained by sparse regression analysis and was used as input for 6 candidate classifier models. Training and test sets were randomly allocated from the total cohort in a 75:25 ratio.

RESULTS

The final classifier model for embryonal tumor-versus-high-grade gliomas identified 23 features with an area under the curve of 0.98; the sensitivity, specificity, positive predictive value, negative predictive value, and accuracy were 0.85, 0.91, 0.79, 0.94, and 0.89, respectively. The classifier for embryonal tumor-versus-ependymomas identified 4 features with an area under the curve of 0.82; the sensitivity, specificity, positive predictive value, negative predictive value, and accuracy were 0.93, 0.69, 0.76, 0.90, and 0.81, respectively. The classifier for high-grade gliomas-versus-ependymomas identified 35 features with an area under the curve of 0.96; the sensitivity, specificity, positive predictive value, negative predictive value, and accuracy were 0.82, 0.94, 0.82, 0.94, and 0.91, respectively.

CONCLUSIONS

In this multi-institutional study, we identified distinct radiomic phenotypes that distinguish pediatric supratentorial tumors, high-grade gliomas, and ependymomas with high accuracy. Incorporation of this technique in diagnostic algorithms can improve diagnosis, risk stratification, and treatment planning.

Deep Learning Model for Intracranial Hemangiopericytoma and Meningioma Classification

Background

Intracranial hemangiopericytoma/solitary fibrous tumor (SFT/HPC) is a rare type of neoplasm containing malignancies of infiltration, peritumoral edema, bleeding, or bone destruction. However, SFT/HPC has similar radiological characteristics as meningioma, which had different clinical managements and outcomes. This study aims to discriminate SFT/HPC and meningioma via deep learning approaches based on routine preoperative MRI.

Methods

We enrolled 236 patients with histopathological diagnosis of SFT/HPC (n = 144) and meningioma (n = 122) from 2010 to 2020 in Xiangya Hospital. Radiological features were extracted manually, and a radiological diagnostic model was applied for classification. And a deep learning pretrained model ResNet-50 was adapted to train T1-contrast images for predicting tumor class. Deep learning model attention mechanism was visualized by class activation maps.

Results

Our study reports that SFT/HPC was found to have more invasion to venous sinus (p = 0.001), more cystic components (p < 0.001), and more heterogeneous enhancement patterns (p < 0.001). Deep learning model achieved a high classification accuracy of 0.889 with receiver-operating characteristic curve area under the curve (AUC) of 0.91 in the validation set. Feature maps showed distinct clustering of SFT/HPC and meningioma in the training and test cohorts, respectively. And the attention of the deep learning model mainly focused on the tumor bulks that represented the solid texture features of both tumors for discrimination.

Predicting EGFR mutation status by a deep learning approach in patients with non-small cell lung cancer brain metastases

PURPOSE

Non-small cell lung cancer (NSCLC) tends to metastasize to the brain. Between 10 and 60% of NSCLCs harbor an activating mutation in the epidermal growth-factor receptor (EGFR), which may be targeted with selective EGFR inhibitors. However, due to a high discordance rate between the molecular profile of the primary tumor and the brain metastases (BMs), identifying an individual patient's EGFR status of the BMs necessitates tissue diagnosis via an invasive surgical procedure. We employed a deep learning (DL) method with the aim of noninvasive detection of the EGFR mutation status in NSCLC BM.

METHODS

We retrospectively collected clinical, radiological, and pathological-molecular data of all the NSCLC patients who had been diagnosed with BMs and underwent resection of their BM during 2009-2019. The study population was then divided into two groups based upon EGFR mutational status. We further employed a DL technique to classify the two groups according to their preoperative magnetic resonance imaging features. Augmentation techniques, transfer learning approach, and post-processing of the predicted results were applied to overcome the relatively small cohort. Finally, we established the accuracy of our model in predicting EGFR mutation status of BM of NSCLC.

RESULTS

Fifty-nine patients were included in the study, 16 patients harbored EGFR mutations. Our model predicted mutational status with mean accuracy of 89.8%, sensitivity of 68.7%, specificity of 97.7%, and a receiver operating characteristic curve value of 0.91 across the 5 validation datasets.

CONCLUSION

DL-based noninvasive molecular characterization is feasible, has high accuracy and should be further validated in large prospective cohorts.

The role of artificial intelligence in paediatric neuroradiology

Imaging plays a fundamental role in the managing childhood neurologic, neurosurgical and neuro-oncological disease. Employing multi-parametric MRI techniques, such as spectroscopy and diffusion- and perfusion-weighted imaging, to the radiophenotyping of neuroradiologic conditions is becoming increasingly prevalent, particularly with radiogenomic analyses correlating imaging characteristics with molecular biomarkers of disease. However, integration into routine clinical practice remains elusive. With modern multi-parametric MRI now providing additional data beyond anatomy, informing on histology, biology and physiology, such metric-rich information can present as information overload to the treating radiologist and, as such, information relevant to an individual case can become lost. Artificial intelligence techniques are capable of modelling the vast radiologic, biological and clinical datasets that accompany childhood neurologic disease, such that this information can become incorporated in upfront prognostic modelling systems, with artificial intelligence techniques providing a plausible approach to this solution. This review examines machine learning approaches than can be used to underpin such artificial intelligence applications, with exemplars for each machine learning approach from the world literature. Then, within the specific use case of paediatric neuro-oncology, we examine the potential future contribution for such artificial intelligence machine learning techniques to offer solutions for patient care in the form of decision support systems, potentially enabling personalised medicine within this domain of paediatric radiologic practice.

Diagnostic accuracy of qualitative MRI in 550 paediatric brain tumours: evaluating current practice in the computational era

BACKGROUND

To investigate the accuracy of qualitative reporting of conventional magnetic resonance imaging (MRI) in the classification of paediatric brain tumours.

METHODS

Preoperative MRI reports of 608 children prior to resection or biopsy of an intracranial lesion were retrospectively reviewed. A total of 550 children had complete radiological and histopathological notes, thereby reaching our inclusion criteria. Concordance between MRI report and final histopathological diagnosis was assessed using an established lexicon derived from the WHO 2016 classification of CNS tumours. Levels of agreement based on cellular origin, tumour type, and tumour grade were evaluated. Diagnostic accuracy, sensitivity, specificity, confidence intervals, and positive and negative predictive values were calculated.

RESULTS

Diagnostic accuracy differed significantly between tumour types and tumour grades. Sensitivities were highest for ependymomas and sellar, pituitary, pineal, and cranial and/or paraspinal nerve tumours (range 80.65-100%). Sensitivity was slightly lower for astrocytic gliomas, oligodendrogliomas, and choroid plexus, neuronal, mixed neuronal-glial, embryonal, and histiocytic tumours (range 63.33-79.59%). Low sensitivities were noted for meningiomas and mesenchymal non-meningothelial, melanocytic, and germ cell tumours (range 0-56.25%). The most correct tumour type predictions were made in the posterior fossa whilst the most incorrect predictions were made in the lobar regions, pineal/tectal plate area, and the supratentorial ventricles.

CONCLUSIONS

This is the largest published series investigating the predictive accuracy of MRI in paediatric brain tumours. We show that diagnostic accuracy varies greatly by tumour type and location. Looking forward, we should develop and leverage computational methods to improve accuracy in the tumour types and anatomical locations where qualitative diagnostic accuracy is lower.

Clinical Artificial Intelligence Applications in Radiology: Neuro

Radiologists have been at the forefront of the digitization process in medicine. Artificial intelligence (AI) is a promising area of innovation, particularly in medical imaging. The number of applications of AI in neuroradiology has also grown. This article illustrates some of these applications. This article reviews machine learning challenges related to neuroradiology. The first approval of reimbursement for an AI algorithm by the Centers for Medicare and Medicaid Services, covering a stroke software for early detection of large vessel occlusion, is also discussed.

Clinical applications of artificial intelligence and radiomics in neuro-oncology imaging

This article is a comprehensive review of the basic background, technique, and clinical applications of artificial intelligence (AI) and radiomics in the field of neuro-oncology. A variety of AI and radiomics utilized conventional and advanced techniques to differentiate brain tumors from non-neoplastic lesions such as inflammatory and demyelinating brain lesions. It is used in the diagnosis of gliomas and discrimination of gliomas from lymphomas and metastasis. Also, semiautomated and automated tumor segmentation has been developed for radiotherapy planning and follow-up. It has a role in the grading, prediction of treatment response, and prognosis of gliomas. Radiogenomics allowed the connection of the imaging phenotype of the tumor to its molecular environment. In addition, AI is applied for the assessment of extra-axial brain tumors and pediatric tumors with high performance in tumor detection, classification, and stratification of patient's prognoses.

A Survey of Brain Tumor Segmentation and Classification Algorithms

A brain Magnetic resonance imaging (MRI) scan of a single individual consists of several slices across the 3D anatomical view. Therefore, manual segmentation of brain tumors from magnetic resonance (MR) images is a challenging and time-consuming task. In addition, an automated brain tumor classification from an MRI scan is non-invasive so that it avoids biopsy and make the diagnosis process safer. Since the beginning of this millennia and late nineties, the effort of the research community to come-up with automatic brain tumor segmentation and classification method has been tremendous. As a result, there are ample literature on the area focusing on segmentation using region growing, traditional machine learning and deep learning methods. Similarly, a number of tasks have been performed in the area of brain tumor classification into their respective histological type, and an impressive performance results have been obtained. Considering state of-the-art methods and their performance, the purpose of this paper is to provide a comprehensive survey of three, recently proposed, major brain tumor segmentation and classification model techniques, namely, region growing, shallow machine learning and deep learning. The established works included in this survey also covers technical aspects such as the strengths and weaknesses of different approaches, pre- and post-processing techniques, feature extraction, datasets, and models' performance evaluation metrics.

Deep Learning-Based Studies on Pediatric Brain Tumors Imaging: Narrative Review of Techniques and Challenges

Brain tumors diagnosis in children is a scientific concern due to rapid anatomical, metabolic, and functional changes arising in the brain and non-specific or conflicting imaging results. Pediatric brain tumors diagnosis is typically centralized in clinical practice on the basis of diagnostic clues such as, child age, tumor location and incidence, clinical history, and imaging (Magnetic resonance imaging MRI / computed tomography CT) findings. The implementation of deep learning has rapidly propagated in almost every field in recent years, particularly in the medical images’ evaluation. This review would only address critical deep learning issues specific to pediatric brain tumor imaging research in view of the vast spectrum of other applications of deep learning. The purpose of this review paper is to include a detailed summary by first providing a succinct guide to the types of pediatric brain tumors and pediatric brain tumor imaging techniques. Then, we will present the research carried out by summarizing the scientific contributions to the field of pediatric brain tumor imaging processing and analysis. Finally, to establish open research issues and guidance for potential study in this emerging area, the medical and technical limitations of the deep learning-based approach were included.

Can Deep Learning Hit a Moving Target? A Scoping Review of Its Role to Study Neurological Disorders in Children

Neurological disorders dramatically impact patients of any age population, their families, and societies. Pediatrics are among vulnerable age populations who differently experience the devastating consequences of neurological conditions, such as attention-deficit hyperactivity disorders (ADHD), autism spectrum disorders (ASD), cerebral palsy, concussion, and epilepsy. System-level understanding of these neurological disorders, particularly from the brain networks' dynamic perspective, has led to the significant trend of recent scientific investigations. While a dramatic maturation in the network science application domain is evident, leading to a better understanding of neurological disorders, such rapid utilization for studying pediatric neurological disorders falls behind that of the adult population. Aside from the specific technological needs and constraints in studying neurological disorders in children, the concept of development introduces uncertainty and further complexity topping the existing neurologically driven processes caused by disorders. To unravel these complexities, indebted to the availability of high-dimensional data and computing capabilities, approaches based on machine learning have rapidly emerged a new trend to understand pathways better, accurately diagnose, and better manage the disorders. Deep learning has recently gained an ever-increasing role in the era of health and medical investigations. Thanks to its relatively more minor dependency on feature exploration and engineering, deep learning may overcome the challenges mentioned earlier in studying neurological disorders in children. The current scoping review aims to explore challenges concerning pediatric brain development studies under the constraints of neurological disorders and offer an insight into the potential role of deep learning methodology on such a task with varying and uncertain nature. Along with pinpointing recent advancements, possible research directions are highlighted where deep learning approaches can assist in computationally targeting neurological disorder-related processes and translating them into windows of opportunities for interventions in diagnosis, treatment, and management of neurological disorders in children.