Automatic multiclass intramedullary spinal cord tumor segmentation on MRI with deep learning

Machine Learning in Spine Oncology: A Narrative Review

STUDY DESIGN

Narrative Review.

OBJECTIVE

Machine learning (ML) is one of the latest advancements in artificial intelligence used in medicine and surgery with the potential to significantly impact the way physicians diagnose, prognose, and treat spine tumors. In the realm of spine oncology, ML is utilized to analyze and interpret medical imaging and classify tumors with incredible accuracy. The authors present a narrative review that specifically addresses the use of machine learning in spine oncology.

METHODS

This study was conducted in accordance with the Preferred Reporting Items of Systematic Reviews and Meta-Analysis (PRISMA) methodology. A systematic review of the literature in the PubMed, EMBASE, Web of Science, Scopus, and Cochrane Library databases since inception was performed to present all clinical studies with the search terms '[[Machine Learning] OR [Artificial Intelligence]] AND [[Spine Oncology] OR [Spine Cancer]]'. Data included studies that were extracted and included algorithms, training and test size, outcomes reported. Studies were separated based on the type of tumor investigated using the machine learning algorithms into primary, metastatic, both, and intradural. A minimum of 2 independent reviewers conducted the study appraisal, data abstraction, and quality assessments of the studies.

RESULTS

Forty-five studies met inclusion criteria out of 480 references screened from the initial search results. Studies were grouped by metastatic, primary, and intradural tumors. The majority of ML studies relevant to spine oncology focused on utilizing a mixture of clinical and imaging features to risk stratify mortality and frailty. Overall, these studies showed that ML is a helpful tool in tumor detection, differentiation, segmentation, predicting survival, predicting readmission rates of patients with either primary, metastatic, or intradural spine tumors.

CONCLUSION

Specialized neural networks and deep learning algorithms have shown to be highly effective at predicting malignant probability and aid in diagnosis. ML algorithms can predict the risk of tumor recurrence or progression based on imaging and clinical features. Additionally, ML can optimize treatment planning, such as predicting radiotherapy dose distribution to the tumor and surrounding normal tissue or in surgical resection planning. It has the potential to significantly enhance the accuracy and efficiency of health care delivery, leading to improved patient outcomes.

Evaluation of Pedicle Screw Position on Computerized Tomography Using Three-Dimensional Reconstruction Software

Background and Objectives: Recent advances in intraoperative navigation systems have improved the accuracy of pedicle screw placement in spine surgery. However, many hospitals have limited access to these advanced technologies due to resource constraints. In such settings, postoperative computed tomography (CT) evaluation remains crucial for assessing screw placement and related potential complications. Metal artifacts in CT scans often compromise the diagnostic accuracy. This study aimed to develop and validate three-dimensional (3-D) reconstruction software to enhance screw localization accuracy and facilitate its practical clinical application. Materials and Methods: This study included two phases: 3-D software development utilizing specific threshold values of Hounsfield units for titanium screws followed by internal validation. For validation, fifty pedicle screws were inserted into porcine lumbar vertebrae with random violation (superior, inferior, medial, or lateral). Three fellowship-trained surgeons evaluated screw positions using both conventional CT bone window settings and the developed software. Additional clinical validation involving 386 pedicle screws from cervical to lumbar spine was performed by two surgeons. Results: The software demonstrated significantly higher specificity (83% vs. 63%) and positive predictive value (96% vs. 91%) compared to conventional CT bone window settings, while maintaining 100% sensitivity and negative predictive value. Interobserver reliability was excellent for both methods (0.961 for bone window vs. 0.990 for software). In clinical validation, the software showed superior intraobserver (0.83 vs. 0.74) and interobserver reliability (0.855 vs. 0.513) compared to picture archiving and communication system (PACS) workstation evaluation. Conclusions: The developed software provides improved accuracy and reliability in pedicle screw position evaluation through distinct screw outline visualization and metal artifact reduction. Its equipment-independent nature and cost-effectiveness make it particularly valuable for clinical implementation.

Astrocytomas of the spinal cord

Tumors of astrocytic origin represent one of the most frequent entities among the overall rare group of spinal cord gliomas. Initial clinical symptoms are often unspecific, and sensorimotor signs localizing to the spinal cord occur with progressing tumor growth. On MRI, a hyperintense intrinsic spinal cord signal on T2-weighted sequences with varying degrees of contrast enhancement raises suspicion for an infiltrative neoplasm. Blood and CSF analysis serves to exclude an infectious process, nutritional deficits, or metabolic disorders. When such other differential diagnoses have been ruled out, a neuropathological tissue-based analysis is warranted to confirm the diagnosis of a spinal cord astrocytoma and guide further patient management. As such, maximal safe resection forms the basis of any treatment. Meticulous preoperative planning is necessary to weigh the potential improvement in survival against the risk of functional deterioration. Intraoperative neuromonitoring and ultrasound may aid in achieving a more extensive resection. Depending on the assigned WHO tumor grade spanning from grade 1 to grade 4, the use of radiotherapy and chemotherapy might be indicated but also wait-and-scan approaches appear reasonable in tumors of lower grade. Close imaging follow-up is necessary given that recurrence inevitably occurs in astrocytomas of grades 2-4. Prognosis is so far dictated by tumor grade and histopathological findings, but also by age and clinical performance of the patient. Targeted therapies resting upon an in-depth tissue analysis are emerging in recurrent tumors, but no prospective study is available so far given the rarity of spinal cord astrocytomas.

Advances in imaging modalities for spinal tumors

The spinal cord occupies a narrow region and is tightly surrounded by osseous and ligamentous structures; spinal tumors can damage this structure and deprive patients of their ability to independently perform activities of daily living. Hence, imaging is vital for the prompt detection and accurate diagnosis of spinal tumors, as well as determining the optimal treatment and follow-up plan. However, many clinicians may not be familiar with the imaging characteristics of spinal tumors due to their rarity. In addition, spinal surgeons might not fully utilize imaging for the surgical planning and management of spinal tumors because of the complex heterogeneity of these lesions. In the present review, we focus on conventional and advanced spinal tumor imaging techniques. These imaging modalities include computed tomography, positron emission tomography, digital subtraction angiography, conventional and microstructural magnetic resonance imaging, and high-resolution ultrasound. We discuss the advantages and disadvantages of conventional and emerging imaging modalities, followed by an examination of cutting-edge medical technology to complement current needs in the field of spinal tumors. Moreover, machine learning and artificial intelligence are anticipated to impact the application of spinal imaging techniques. Through this review, we discuss the importance of conventional and advanced spinal tumor imaging, and the opportunity to combine advanced technologies with conventional modalities to better manage patients with these lesions.

Applications of Artificial Intelligence and Machine Learning in Spine MRI

Diagnostic imaging, particularly MRI, plays a key role in the evaluation of many spine pathologies. Recent progress in artificial intelligence and its subset, machine learning, has led to many applications within spine MRI, which we sought to examine in this review. A literature search of the major databases (PubMed, MEDLINE, Web of Science, ClinicalTrials.gov) was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The search yielded 1226 results, of which 50 studies were selected for inclusion. Key data from these studies were extracted. Studies were categorized thematically into the following: Image Acquisition and Processing, Segmentation, Diagnosis and Treatment Planning, and Patient Selection and Prognostication. Gaps in the literature and the proposed areas of future research are discussed. Current research demonstrates the ability of artificial intelligence to improve various aspects of this field, from image acquisition to analysis and clinical care. We also acknowledge the limitations of current technology. Future work will require collaborative efforts in order to fully exploit new technologies while addressing the practical challenges of generalizability and implementation. In particular, the use of foundation models and large-language models in spine MRI is a promising area, warranting further research. Studies assessing model performance in real-world clinical settings will also help uncover unintended consequences and maximize the benefits for patient care.

Reproducible Spinal Cord Quantitative MRI Analysis with the Spinal Cord Toolbox

The spinal cord plays a pivotal role in the central nervous system, providing communication between the brain and the body and containing critical motor and sensory networks. Recent advancements in spinal cord MRI data acquisition and image analysis have shown a potential to improve the diagnostics, prognosis, and management of a variety of pathological conditions. In this review, we first discuss the significance of standardized spinal cord MRI acquisition protocol in multi-center and multi-manufacturer studies. Then, we cover open-access spinal cord MRI datasets, which are important for reproducible science and validation of new methods. Finally, we elaborate on the recent advances in spinal cord MRI data analysis techniques implemented in the open-source software package Spinal Cord Toolbox (SCT).

Automated detection, labelling and radiological grading of clinical spinal MRIs

Spinal magnetic resonance (MR) scans are a vital tool for diagnosing the cause of back pain for many diseases and conditions. However, interpreting clinically useful information from these scans can be challenging, time-consuming and hard to reproduce across different radiologists. In this paper, we alleviate these problems by introducing a multi-stage automated pipeline for analysing spinal MR scans. This pipeline first detects and labels vertebral bodies across several commonly used sequences (e.g. T1w, T2w and STIR) and fields of view (e.g. lumbar, cervical, whole spine). Using these detections it then performs automated diagnosis for several spinal disorders, including intervertebral disc degenerative changes in T1w and T2w lumbar scans, and spinal metastases, cord compression and vertebral fractures. To achieve this, we propose a new method of vertebrae detection and labelling, using vector fields to group together detected vertebral landmarks and a language-modelling inspired beam search to determine the corresponding levels of the detections. We also employ a new transformer-based architecture to perform radiological grading which incorporates context from multiple vertebrae and sequences, as a real radiologist would. The performance of each stage of the pipeline is tested in isolation on several clinical datasets, each consisting of 66 to 421 scans. The outputs are compared to manual annotations of expert radiologists, demonstrating accurate vertebrae detection across a range of scan parameters. Similarly, the model's grading predictions for various types of disc degeneration and detection of spinal metastases closely match those of an expert radiologist. To aid future research, our code and trained models are made publicly available.

Quantification of cervical spinal stenosis by automated 3D MRI segmentation of spinal cord and cerebrospinal fluid space

DESIGN

Prospective diagnostic study.

OBJECTIVES

Anatomical evaluation and graduation of the severity of spinal stenosis is essential in degenerative cervical spine disease. In clinical practice, this is subjectively categorized on cervical MRI lacking an objective and reliable classification. We implemented a fully-automated quantification of spinal canal compromise through 3D T2-weighted MRI segmentation.

SETTING

Medical Center - University of Freiburg, Germany.

METHODS

Evaluation of 202 participants receiving 3D T2-weighted MRI of the cervical spine. Segments C2/3 to C6/7 were analyzed for spinal cord and cerebrospinal fluid space volume through a fully-automated segmentation based on a trained deep convolutional neural network. Spinal canal narrowing was characterized by relative values, across sever segments as adapted Maximal Canal Compromise (aMCC), and within the index segment as adapted Spinal Cord Occupation Ratio (aSCOR). Additionally, all segments were subjectively categorized by three observers as "no", "relative" or "absolute" stenosis. Computed scores were applied on the subjective categorization.

RESULTS

798 (79.0%) segments were subjectively categorized as "no" stenosis, 85 (8.4%) as "relative" stenosis, and 127 (12.6%) as "absolute" stenosis. The calculated scores revealed significant differences between each category (p ≤ 0.001). Youden's Index analysis of ROC curves revealed optimal cut-offs to distinguish between "no" and "relative" stenosis for aMCC = 1.18 and aSCOR = 36.9%, and between "relative" and "absolute" stenosis for aMCC = 1.54 and aSCOR = 49.3%.

CONCLUSION

The presented fully-automated segmentation algorithm provides high diagnostic accuracy and objective classification of cervical spinal stenosis. The calculated cut-offs can be used for convenient radiological quantification of the severity of spinal canal compromise in clinical routine.

State-of-the-Art and New Treatment Approaches for Spinal Cord Tumors

Spinal cord tumors, though rare, present formidable challenges in clinical management due to their intricate nature. Traditional treatment modalities like surgery, radiation therapy, and chemotherapy have been the mainstay for managing these tumors. However, despite significant advancements, challenges persist, including the limitations of surgical resection and the potential side effects associated with radiation therapy. In response to these limitations, a wave of innovative approaches is reshaping the treatment landscape for spinal cord tumors. Advancements in gene therapy, immunotherapy, and targeted therapy are offering groundbreaking possibilities. Gene therapy holds the potential to modify the genes responsible for tumor growth, while immunotherapy harnesses the body's own immune system to fight cancer cells. Targeted therapy aims to strike a specific vulnerability within the tumor cells, offering a more precise and potentially less toxic approach. Additionally, novel surgical adjuncts are being explored to improve visualization and minimize damage to surrounding healthy tissue during tumor removal. These developments pave the way for a future of personalized medicine for spinal cord tumors. By delving deeper into the molecular makeup of individual tumors, doctors can tailor treatment strategies to target specific mutations and vulnerabilities. This personalized approach offers the potential for more effective interventions with fewer side effects, ultimately leading to improved patient outcomes and a better quality of life. This evolving landscape of spinal cord tumor management signifies the crucial integration of established and innovative strategies to create a brighter future for patients battling this complex condition.

Differentiating spinal pathologies by deep learning approach

BACKGROUND CONTEXT

Spinal pathologies are diverse in nature and, excluding trauma and degenerative diseases, includes infectious, neoplastic (either extradural or intradural), and inflammatory conditions. The preoperative diagnosis is made with clinical judgment incorporating lab findings and radiological studies. When the diagnosis is uncertain, a biopsy is almost always mandatory since the treatment is dictated by the type of pathology. This is an invasive, timely, and costly process.

PURPOSE

The aim of this study was to develop a deep learning (DL) algorithm, based on preoperative MRI and post-operative pathological results, to differentiate between leading spinal pathologies.

STUDY DESIGN

We retrospectively collected and analyzed clinical, radiological, and pathological data of patients who underwent spinal surgery or biopsy for various spinal pathologies between 2008 and 2022 at a tertiary center. The patients were stratified according to their pathological reports (the threshold for inclusion was set to 25 patients per diagnosis).

METHODS

Preoperative MRI, clinical data, and pathological results were processed by a deep learning model built on the Fast.ai framework on top of the PyTorch environment.

RESULTS

A total of 231 patients diagnosed with carcinoma (80), infection (57), meningioma (52), or schwannoma (42), were included in our model. The mean overall accuracy was 0.78±0.06 for the validation, and 0.93±0.03 for the test dataset.

CONCLUSION

Deep learning algorithm for differentiation between the aforementioned spinal pathologies, based solely on clinical MRI, proves as a feasible primary diagnostic modality. Larger studies should be performed to validate and improve this algorithm for clinical use.

CLINICAL SIGNIFICANCE

This study provides a proof-of-concept for predicting spinal pathologies solely by MRI based DL technology, allowing for a rapid, targeted, and cost-effective work-up and subsequent treatment.

Deep Learning for Delineation of the Spinal Canal in Whole-Body Diffusion-Weighted Imaging: Normalising Inter- and Intra-Patient Intensity Signal in Multi-Centre Datasets

BACKGROUND

Whole-Body Diffusion-Weighted Imaging (WBDWI) is an established technique for staging and evaluating treatment response in patients with multiple myeloma (MM) and advanced prostate cancer (APC). However, WBDWI scans show inter- and intra-patient intensity signal variability. This variability poses challenges in accurately quantifying bone disease, tracking changes over follow-up scans, and developing automated tools for bone lesion delineation. Here, we propose a novel automated pipeline for inter-station, inter-scan image signal standardisation on WBDWI that utilizes robust segmentation of the spinal canal through deep learning.

METHODS

We trained and validated a supervised 2D U-Net model to automatically delineate the spinal canal (both the spinal cord and surrounding cerebrospinal fluid, CSF) in an initial cohort of 40 patients who underwent WBDWI for treatment response evaluation (80 scans in total). Expert-validated contours were used as the target standard. The algorithm was further semi-quantitatively validated on four additional datasets (three internal, one external, 207 scans total) by comparing the distributions of average apparent diffusion coefficient (ADC) and volume of the spinal cord derived from a two-component Gaussian mixture model of segmented regions. Our pipeline subsequently standardises WBDWI signal intensity through two stages: (i) normalisation of signal between imaging stations within each patient through histogram equalisation of slices acquired on either side of the station gap, and (ii) inter-scan normalisation through histogram equalisation of the signal derived within segmented spinal canal regions. This approach was semi-quantitatively validated in all scans available to the study (N = 287).

RESULTS

The test dice score, precision, and recall of the spinal canal segmentation model were all above 0.87 when compared to manual delineation. The average ADC for the spinal cord (1.7 × 10-3 mm2/s) showed no significant difference from the manual contours. Furthermore, no significant differences were found between the average ADC values of the spinal cord across the additional four datasets. The signal-normalised, high-b-value images were visualised using a fixed contrast window level and demonstrated qualitatively better signal homogeneity across scans than scans that were not signal-normalised.

CONCLUSION

Our proposed intensity signal WBDWI normalisation pipeline successfully harmonises intensity values across multi-centre cohorts. The computational time required is less than 10 s, preserving contrast-to-noise and signal-to-noise ratios in axial diffusion-weighted images. Importantly, no changes to the clinical MRI protocol are expected, and there is no need for additional reference MRI data or follow-up scans.

Automated Determination of the H3 K27-Altered Status in Spinal Cord Diffuse Midline Glioma by Radiomics Based on T2-Weighted MR Images

BACKGROUND AND PURPOSE

Conventional MR imaging is not sufficient to discern the H3 K27-altered status of spinal cord diffuse midline glioma. This study aimed to develop a radiomics-based model based on preoperative T2WI to determine the H3 K27-altered status of spinal cord diffuse midline glioma.

MATERIALS AND METHODS

Ninety-seven patients with confirmed spinal cord diffuse midline gliomas were retrospectively recruited and randomly assigned to the training (n = 67) and test (n = 30) sets. One hundred seven radiomics features were initially extracted from automatically-segmented tumors on T2WI, then 11 features selected by the Pearson correlation coefficient and the Kruskal-Wallis test were used to train and test a logistic regression model for predicting the H3 K27-altered status. Sensitivity analysis was performed using additional random splits of the training and test sets, as well as applying other classifiers for comparison. The performance of the model was evaluated through its accuracy, sensitivity, specificity, and area under the curve. Finally, a prospective set including 28 patients with spinal cord diffuse midline gliomas was used to validate the logistic regression model independently.

RESULTS

The logistic regression model accurately predicted the H3 K27-altered status with accuracies of 0.833 and 0.786, sensitivities of 0.813 and 0.750, specificities of 0.857 and 0.833, and areas under the curve of 0.839 and 0.818 in the test and prospective sets, respectively. Sensitivity analysis confirmed the robustness of the model, with predictive accuracies of 0.767-0.833.

CONCLUSIONS

Radiomics signatures based on preoperative T2WI could accurately predict the H3 K27-altered status of spinal cord diffuse midline glioma, providing potential benefits for clinical management.

Bimodal artificial intelligence using TabNet for differentiating spinal cord tumors-Integration of patient background information and images

We proposed a bimodal artificial intelligence that integrates patient information with images to diagnose spinal cord tumors. Our model combines TabNet, a state-of-the-art deep learning model for tabular data for patient information, and a convolutional neural network for images. As training data, we collected 259 spinal tumor patients (158 for schwannoma and 101 for meningioma). We compared the performance of the image-only unimodal model, table-only unimodal model, bimodal model using a gradient-boosting decision tree, and bimodal model using TabNet. Our proposed bimodal model using TabNet performed best (area under the receiver-operating characteristic curve [AUROC]: 0.91) in the training data and significantly outperformed the physicians' performance. In the external validation using 62 cases from the other two facilities, our bimodal model showed an AUROC of 0.92, proving the robustness of the model. The bimodal analysis using TabNet was effective for differentiating spinal tumors.

Attention-gated U-Net networks for simultaneous axial/sagittal planes segmentation of injured spinal cords

Magnetic resonance imaging is currently the gold standard for the evaluation of spinal cord injuries. Automatic analysis of these injuries is however challenging, as MRI resolutions vary for different planes of analysis and physiological features are often distorted around these injuries. This study proposes a new CNN-based segmentation method in which information is exchanged between two networks analyzing the scans from different planes. Our aim was to develop a robust method for automatic segmentation of the spinal cord in patients having suffered traumatic injuries. The database consisted of 106 sagittal MRI scans from 94 patients with traumatic spinal cord injuries. Our method used an innovative approach where the scans were analyzed in series under the axial and sagittal plane by two different convolutional networks. The results were compared with those of Deepseg 2D from the Spinal Cord Toolbox (SCT), which was taken as state-of-the-art. Comparisons were evaluated using K-Fold cross-validation combined with statistical t-test results on separate test data. Our method achieved significantly better results than Deepseg 2D, with an average Dice coefficient of 0.95 against 0.88 for Deepseg 2D (p <0.001). Other metrics were also used to compare the segmentations, all of which showed significantly better results for our approach. In this study, we introduce a robust method for spinal cord segmentation which is capable of adequately segmenting spinal cords affected by traumatic injuries, improving upon the methods contained in SCT.

The use of deep learning in medical imaging to improve spine care: A scoping review of current literature and clinical applications

Background

Artificial intelligence is a revolutionary technology that promises to assist clinicians in improving patient care. In radiology, deep learning (DL) is widely used in clinical decision aids due to its ability to analyze complex patterns and images. It allows for rapid, enhanced data, and imaging analysis, from diagnosis to outcome prediction. The purpose of this study was to evaluate the current literature and clinical utilization of DL in spine imaging.

Methods

This study is a scoping review and utilized the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology to review the scientific literature from 2012 to 2021. A search in PubMed, Web of Science, Embased, and IEEE Xplore databases with syntax specific for DL and medical imaging in spine care applications was conducted to collect all original publications on the subject. Specific data was extracted from the available literature, including algorithm application, algorithms tested, database type and size, algorithm training method, and outcome of interest.

Results

A total of 365 studies (total sample of 232,394 patients) were included and grouped into 4 general applications: diagnostic tools, clinical decision support tools, automated clinical/instrumentation assessment, and clinical outcome prediction. Notable disparities exist in the selected algorithms and the training across multiple disparate databases. The most frequently used algorithms were U-Net and ResNet. A DL model was developed and validated in 92% of included studies, while a pre-existing DL model was investigated in 8%. Of all developed models, only 15% of them have been externally validated.

Conclusions

Based on this scoping review, DL in spine imaging is used in a broad range of clinical applications, particularly for diagnosing spinal conditions. There is a wide variety of DL algorithms, database characteristics, and training methods. Future studies should focus on external validation of existing models before bringing them into clinical use.

Deep Learning for Noninvasive Assessment of H3 K27M Mutation Status in Diffuse Midline Gliomas Using MR Imaging

BACKGROUND

Determination of H3 K27M mutation in diffuse midline glioma (DMG) is key for prognostic assessment and stratifying patient subgroups for clinical trials. MRI can noninvasively depict morphological and metabolic characteristics of H3 K27M mutant DMG.

PURPOSE

This study aimed to develop a deep learning (DL) approach to noninvasively predict H3 K27M mutation in DMG using T2-weighted images.

STUDY TYPE

Retrospective and prospective.

POPULATION

For diffuse midline brain gliomas, 341 patients from Center-1 (27 ± 19 years, 184 males), 42 patients from Center-2 (33 ± 19 years, 27 males) and 35 patients (37 ± 18 years, 24 males). For diffuse spinal cord gliomas, 133 patients from Center-1 (30 ± 15 years, 80 males).

FIELD STRENGTH/SEQUENCE

5T and 3T, T2-weighted turbo spin echo imaging.

ASSESSMENT

Conventional radiological features were independently reviewed by two neuroradiologists. H3 K27M status was determined by histopathological examination. The Dice coefficient was used to evaluate segmentation performance. Classification performance was evaluated using accuracy, sensitivity, specificity, and area under the curve.

STATISTICAL TESTS

Pearson's Chi-squared test, Fisher's exact test, two-sample Student's t-test and Mann-Whitney U test. A two-sided P value <0.05 was considered statistically significant.

RESULTS

In the testing cohort, Dice coefficients of tumor segmentation using DL were 0.87 for diffuse midline brain and 0.81 for spinal cord gliomas. In the internal prospective testing dataset, the predictive accuracies, sensitivities, and specificities of H3 K27M mutation status were 92.1%, 98.2%, 82.9% in diffuse midline brain gliomas and 85.4%, 88.9%, 82.6% in spinal cord gliomas. Furthermore, this study showed that the performance generalizes to external institutions, with predictive accuracies of 85.7%-90.5%, sensitivities of 90.9%-96.0%, and specificities of 82.4%-83.3%.

DATA CONCLUSION

In this study, an automatic DL framework was developed and validated for accurately predicting H3 K27M mutation using T2-weighted images, which could contribute to the noninvasive determination of H3 K27M status for clinical decision-making.

EVIDENCE LEVEL

2 Technical Efficacy: Stage 2.

Identification of Origin for Spinal Metastases from MR Images: Comparison Between Radiomics and Deep Learning Methods

OBJECTIVE

To determine whether spinal metastatic lesions originated from lung cancer or from other cancers based on spinal contrast-enhanced T1 (CET1) magnetic resonance (MR) images analyzed using radiomics (RAD) and deep learning (DL) methods.

METHODS

We recruited and retrospectively reviewed 173 patients diagnosed with spinal metastases at two different centers between July 2018 and June 2021. Of these, 68 involved lung cancer and 105 were other types of cancer. They were assigned to an internal cohort of 149 patients, randomly divided into a training set and a validation set, and to an external cohort of 24 patients. All patients underwent CET1-MR imaging before surgery or biopsy. We developed two predictive algorithms: a DL model and a RAD model. We compared performance between models, and against human radiological assessment, via accuracy (ACC) and receiver operating characteristic (ROC) analyses. Furthermore, we analyzed the correlation between RAD and DL features.

RESULTS

The DL model outperformed RAD model across the board, with ACC/ area under the receiver operating characteristic curve (AUC) values of 0.93/0.94 (DL) versus 0.84/0.93 (RAD) when applied to the training set from the internal cohort, 0.74/0.76 versus 0.72/0.75 when applied to the validation set, and 0.72/0.76 versus 0.69/0.72 when applied to the external test cohort. For the validation set, it also outperformed expert radiological assessment (ACC: 0.65, AUC: 0.68). We only found weak correlations between DL and RAD features.

CONCLUSION

The DL algorithm successfully identified the origin of spinal metastases from pre-operative CET1-MR images, outperforming both RAD models and expert assessment by trained radiologists.

Deep learning based on preoperative magnetic resonance (MR) images improves the predictive power of survival models in primary spinal cord astrocytomas

BACKGROUND

Prognostic models for spinal cord astrocytoma patients are lacking due to the low incidence of the disease. Here, we aim to develop a fully automated deep learning (DL) pipeline for stratified overall survival (OS) prediction based on preoperative MR images.

METHODS

A total of 587 patients diagnosed with intramedullary tumors were retrospectively enrolled in our hospital to develop an automated pipeline for tumor segmentation and OS prediction. The automated pipeline included a T2WI-based tumor segmentation model and 3 cascaded binary OS prediction models (1-year, 3-year, and 5-year models). For the tumor segmentation model, 439 cases of intramedullary tumors were used to model training and testing using a transfer learning strategy. A total of 138 patients diagnosed with astrocytomas were included to train and test the OS prediction models via 10 × 10-fold cross-validation using CNNs.

RESULTS

The dice of the tumor segmentation model with the test set was 0.852. The results indicated that the best input of OS prediction models was a combination of T2W and T1C images and the tumor mask. The 1-year, 3-year, and 5-year automated OS prediction models achieved accuracies of 86.0%, 84.0%, and 88.0% and AUCs of 0.881 (95% CI 0.839-0.918), 0.862 (95% CI 0.827-0.901), and 0.905 (95% CI 0.867-0.942), respectively. The automated DL pipeline achieved 4-class OS prediction (<1 year, 1-3 years, 3-5 years, and >5 years) with 75.3% accuracy.

CONCLUSIONS

We proposed an automated DL pipeline for segmenting spinal cord astrocytomas and stratifying OS based on preoperative MR images.

Multimodal-based machine learning strategy for accurate and non-invasive prediction of intramedullary glioma grade and mutation status of molecular markers: a retrospective study

BACKGROUND

Determining the grade and molecular marker status of intramedullary gliomas is important for assessing treatment outcomes and prognosis. Invasive biopsy for pathology usually carries a high risk of tissue damage, especially to the spinal cord, and there are currently no non-invasive strategies to identify the pathological type of intramedullary gliomas. Therefore, this study aimed to develop a non-invasive machine learning model to assist doctors in identifying the intramedullary glioma grade and mutation status of molecular markers.

METHODS

A total of 461 patients from two institutions were included, and their sagittal (SAG) and transverse (TRA) T2-weighted magnetic resonance imaging scans and clinical data were acquired preoperatively. We employed a transformer-based deep learning model to automatically segment lesions in the SAG and TRA phases and extract their radiomics features. Different feature representations were fed into the proposed neural networks and compared with those of other mainstream models.

RESULTS

The dice similarity coefficients of the Swin transformer in the SAG and TRA phases were 0.8697 and 0.8738, respectively. The results demonstrated that the best performance was obtained in our proposed neural networks based on multimodal fusion (SAG-TRA-clinical) features. In the external validation cohort, the areas under the receiver operating characteristic curve for graded (WHO I-II or WHO III-IV), alpha thalassemia/mental retardation syndrome X-linked (ATRX) status, and tumor protein p53 (P53) status prediction tasks were 0.8431, 0.7622, and 0.7954, respectively.

CONCLUSIONS

This study reports a novel machine learning strategy that, for the first time, is based on multimodal features to predict the ATRX and P53 mutation status and grades of intramedullary gliomas. The generalized application of these models could non-invasively provide more tumor-specific pathological information for determining the treatment and prognosis of intramedullary gliomas.

Emerging trends and research foci of deep learning in spine: bibliometric and visualization study

As the cognition of spine develops, deep learning (DL) emerges as a powerful tool with tremendous potential for advancing research in this field. To provide a comprehensive overview of DL-spine research, our study utilized bibliometric and visual methods to retrieve relevant articles from the Web of Science database. VOSviewer and CiteSpace were primarily used for literature measurement and knowledge graph analysis. A total of 273 studies focusing on deep learning in the spine, with a combined total of 2302 citations, were retrieved. Additionally, the overall number of articles published on this topic demonstrated a continuous upward trend. China was the country with the highest number of publications, whereas the USA had the most citations. The two most prominent journals were "European Spine Journal" and "Medical Image Analysis," and the most involved research area was Radiology Nuclear Medicine Medical Imaging. VOSviewer identified three visually distinct clusters: "segmentation," "area," and "neural network." Meanwhile, CiteSpace highlighted "magnetic resonance image" and "lumbar" as the keywords with the longest usage, and "agreement" and "automated detection" as the most commonly used keywords. Although the application of DL in spine is still in its infancy, its future is promising. Intercontinental cooperation, extensive application, and more interpretable algorithms will invigorate DL in the field of spine.

Current Applications of Machine Learning for Spinal Cord Tumors

Spinal cord tumors constitute a diverse group of rare neoplasms associated with significant mortality and morbidity that pose unique clinical and surgical challenges. Diagnostic accuracy and outcome prediction are critical for informed decision making and can promote personalized medicine and facilitate optimal patient management. Machine learning has the ability to analyze and combine vast amounts of data, allowing the identification of patterns and the establishment of clinical associations, which can ultimately enhance patient care. Although artificial intelligence techniques have been explored in other areas of spine surgery, such as spinal deformity surgery, precise machine learning models for spinal tumors are lagging behind. Current applications of machine learning in spinal cord tumors include algorithms that improve diagnostic precision by predicting genetic, molecular, and histopathological profiles. Furthermore, artificial intelligence-based systems can assist surgeons with preoperative planning and surgical resection, potentially reducing the risk of recurrence and consequently improving clinical outcomes. Machine learning algorithms promote personalized medicine by enabling prognostication and risk stratification based on accurate predictions of treatment response, survival, and postoperative complications. Despite their promising potential, machine learning models require extensive validation processes and quality assessments to ensure safe and effective translation to clinical practice.

Automated Classification of Intramedullary Spinal Cord Tumors and Inflammatory Demyelinating Lesions Using Deep Learning

Accurate differentiation of intramedullary spinal cord tumors and inflammatory demyelinating lesions and their subtypes are warranted because of their overlapping characteristics at MRI but with different treatments and prognosis. The authors aimed to develop a pipeline for spinal cord lesion segmentation and classification using two-dimensional MultiResUNet and DenseNet121 networks based on T2-weighted images. A retrospective cohort of 490 patients (118 patients with astrocytoma, 130 with ependymoma, 101 with multiple sclerosis [MS], and 141 with neuromyelitis optica spectrum disorders [NMOSD]) was used for model development, and a prospective cohort of 157 patients (34 patients with astrocytoma, 45 with ependymoma, 33 with MS, and 45 with NMOSD) was used for model testing. In the test cohort, the model achieved Dice scores of 0.77, 0.80, 0.50, and 0.58 for segmentation of astrocytoma, ependymoma, MS, and NMOSD, respectively, against manual labeling. Accuracies of 96% (area under the receiver operating characteristic curve [AUC], 0.99), 82% (AUC, 0.90), and 79% (AUC, 0.85) were achieved for the classifications of tumor versus demyelinating lesion, astrocytoma versus ependymoma, and MS versus NMOSD, respectively. In a subset of radiologically difficult cases, the classifier showed an accuracy of 79%-95% (AUC, 0.78-0.97). The established deep learning pipeline for segmentation and classification of spinal cord lesions can support an accurate radiologic diagnosis. Supplemental material is available for this article. © RSNA, 2022 Keywords: Spinal Cord MRI, Astrocytoma, Ependymoma, Multiple Sclerosis, Neuromyelitis Optica Spectrum Disorder, Deep Learning.

Surgical approaches to intramedullary spinal cord astrocytomas in the age of genomics

Intramedullary astrocytomas represent approximately 30%–40% of all intramedullary tumors and are the most common intramedullary tumor in children. Surgical resection is considered the mainstay of treatment in symptomatic patients with neurological deficits. Gross total resection (GTR) can be difficult to achieve as astrocytomas frequently present as diffuse lesions that infiltrate the cord. Therefore, GTR carries a substantial risk of new post-operative deficits. Consequently, subtotal resection and biopsy are often the only surgical options attempted. A midline or paramedian sulcal myelotomy is frequently used for surgical resection, although a dorsal root entry zone myelotomy can be used for lateral tumors. Intra-operative neuromonitoring using D-wave integrity, somatosensory, and motor evoked potentials is critical to facilitating a safe resection. Adjuvant radiation and chemotherapy, such as temozolomide, are often administered for high-grade recurrent or progressive lesions; however, consensus is lacking on their efficacy. Biopsied tumors can be analyzed for molecular markers that inform clinicians about the tumor’s prognosis and response to conventional as well as targeted therapeutic treatments. Stratification of intramedullary tumors is increasingly based on molecular features and mutational status. The landscape of genetic and epigenetic mutations in intramedullary astrocytomas is not equivalent to their intracranial counterparts, with important difference in frequency and type of mutations. Therefore, dedicated attention is needed to cohorts of patients with intramedullary tumors. Targeted therapeutic agents can be designed and administered to patients based on their mutational status, which may be used in coordination with traditional surgical resection to improve overall survival and functional status.

The value of quantitative magnetic resonance imaging signal intensity in distinguishing between spinal meningiomas and schwannomas

Background: Prior studies have suggested a number of the subjective visual characteristics that help distinguish between spinal meningiomas and schwannomas on magnetic resonance imaging and computed tomography; however, objective quantification of the signal intensity can be useful information. This study assessed whether quantitative magnetic resonance imaging (MRI) signal intensity (SI) measurements could distinguish intradural-extramedullary schwannomas from meningiomas. Methods: From July 2019 to September 2021, 54 patients with intradural-extramedullary tumors (37 meningiomas and 17 schwannomas) underwent surgery, and tumors were verified pathologically. Defined regions of interest were used to quantify SI values on T1- (T1W) and T2-weighted images (T2W). Receiver operating characteristic curve analysis was used to obtain cutoff values and calculate the area under the curve (AUC), sensitivity (SE), specificity (SP), positive predictive value (PPV), and negative predictive value (NPV). Results: Both Maximum (T2max) and mean (T2mean) T2W SI values demonstrated outstanding (AUC: 0.91) abilities to differentiate meningiomas from schwannomas with Se, Sp, PPV, and NPV values of 94.6%, 70.6%, 87.5%, and 85.7%, respectively, for T2max and 81.1%, 88.2%, 93.8%, and 68.2% for T2mean. The maximum SI value on contrast-enhanced T1W (T1CEmax) and the T2W tumor: fat SI ratio (rTF) demonstrated acceptable abilities (AUC: 0.73 and 0.79, respectively) to differentiate meningiomas from schwannomas with Se, Sp, PPV, and NPV values of 94.6%, 70.6%, 87.5%, and 85.7%, respectively, for T1CEmax and 81.1%, 88.2%, 93.8%, and 68.2% for rTF. Conclusions: Quantitative SI values (T2max, T2mean, T2min, T1CEmax, rTF) can be used to differentiate intradural-extramedullary schwannomas from meningiomas.

Current development and prospects of deep learning in spine image analysis: a literature review

BACKGROUND AND OBJECTIVE

As the spine is pivotal in the support and protection of human bodies, much attention is given to the understanding of spinal diseases. Quick, accurate, and automatic analysis of a spine image greatly enhances the efficiency with which spine conditions can be diagnosed. Deep learning (DL) is a representative artificial intelligence technology that has made encouraging progress in the last 6 years. However, it is still difficult for clinicians and technicians to fully understand this rapidly evolving field due to the diversity of applications, network structures, and evaluation criteria. This study aimed to provide clinicians and technicians with a comprehensive understanding of the development and prospects of DL spine image analysis by reviewing published literature.

METHODS

A systematic literature search was conducted in the PubMed and Web of Science databases using the keywords "deep learning" and "spine". Date ranges used to conduct the search were from 1 January, 2015 to 20 March, 2021. A total of 79 English articles were reviewed.

KEY CONTENT AND FINDINGS

The DL technology has been applied extensively to the segmentation, detection, diagnosis, and quantitative evaluation of spine images. It uses static or dynamic image information, as well as local or non-local information. The high accuracy of analysis is comparable to that achieved manually by doctors. However, further exploration is needed in terms of data sharing, functional information, and network interpretability.

CONCLUSIONS

The DL technique is a powerful method for spine image analysis. We believe that, with the joint efforts of researchers and clinicians, intelligent, interpretable, and reliable DL spine analysis methods will be widely applied in clinical practice in the future.

Clinical Prediction Modeling in Intramedullary Spinal Tumor Surgery

Artificial intelligence is poised to influence various aspects of patient care, and neurosurgery is one of the most uprising fields where machine learning is being applied to provide surgeons with greater insight about the pathophysiology and prognosis of neurological conditions. This chapter provides a guide for clinicians on relevant aspects of machine learning and reviews selected application of these methods in intramedullary spinal cord tumors. The potential areas of application of machine learning extend far beyond the analyses of clinical data to include several areas of artificial intelligence, such as genomics and computer vision. Integration of various sources of data and application of advanced analytical approaches could improve risk assessment for intramedullary tumors.