Deep learning with diffusion basis spectrum imaging for classification of multiple sclerosis lesions

Clinical applications of deep learning in neuroinflammatory diseases: A scoping review

BACKGROUND

Deep learning (DL) is an artificial intelligence technology that has aroused much excitement for predictive medicine due to its ability to process raw data modalities such as images, text, and time series of signals.

OBJECTIVES

Here, we intend to give the clinical reader elements to understand this technology, taking neuroinflammatory diseases as an illustrative use case of clinical translation efforts. We reviewed the scope of this rapidly evolving field to get quantitative insights about which clinical applications concentrate the efforts and which data modalities are most commonly used.

METHODS

We queried the PubMed database for articles reporting DL algorithms for clinical applications in neuroinflammatory diseases and the radiology.healthairegister.com website for commercial algorithms.

RESULTS

The review included 148 articles published between 2018 and 2024 and five commercial algorithms. The clinical applications could be grouped as computer-aided diagnosis, individual prognosis, functional assessment, the segmentation of radiological structures, and the optimization of data acquisition. Our review highlighted important discrepancies in efforts. The segmentation of radiological structures and computer-aided diagnosis currently concentrate most efforts with an overrepresentation of imaging. Various model architectures have addressed different applications, relatively low volume of data, and diverse data modalities. We report the high-level technical characteristics of the algorithms and synthesize narratively the clinical applications. Predictive performances and some common a priori on this topic are finally discussed.

CONCLUSION

The currently reported efforts position DL as an information processing technology, enhancing existing modalities of paraclinical investigations and bringing perspectives to make innovative ones actionable for healthcare.

Associations between COVID-19 and putative markers of neuroinflammation: A diffusion basis spectrum imaging study

COVID-19 remains a significant international public health concern. Yet, the mechanisms through which symptomatology emerges remain poorly understood. While SARS-CoV-2 infection may induce prolonged inflammation within the central nervous system, the evidence primarily stems from limited small-scale case investigations. To address this gap, our study capitalized on longitudinal UK Biobank neuroimaging data acquired prior to and following COVID-19 testing (N = 416 including n = 224 COVID-19 cases; Mage = 58.6). Putative neuroinflammation was assessed in gray matter structures and white matter tracts using non-invasive Diffusion Basis Spectrum Imaging (DBSI), which estimates inflammation-related cellularity (DBSI-restricted fraction; DBSI-RF) and vasogenic edema (DBSI-hindered fraction; DBSI-HF). We hypothesized that COVID-19 case status would be associated with increases in DBSI markers after accounting for potential confound (age, sex, race, body mass index, smoking frequency, and data acquisition interval) and multiple testing. COVID-19 case status was not significantly associated with DBSI-RF (|β|'s < 0.28, pFDR >0.05), but with greater DBSI-HF in left pre- and post-central gyri and right middle frontal gyrus (β's > 0.3, all pFDR = 0.03). Intriguingly, the brain areas exhibiting increased putative vasogenic edema had previously been linked to COVID-19-related functional and structural alterations, whereas brain regions displaying subtle differences in cellularity between COVID-19 cases and controls included regions within or functionally connected to the olfactory network, which has been implicated in COVID-19 psychopathology. Nevertheless, our study might not have captured acute and transitory neuroinflammatory effects linked to SARS-CoV-2 infection, possibly due to symptom resolution before the imaging scan. Future research is warranted to explore the potential time- and symptom-dependent neuroinflammatory relationship with COVID-19.

Associations between COVID-19 and putative markers of neuroinflammation: A diffusion basis spectrum imaging study

COVID-19 remains a significant international public health concern. Yet, the mechanisms through which symptomatology emerges remain poorly understood. While SARS-CoV-2 infection may induce prolonged inflammation within the central nervous system, the evidence primarily stems from limited small-scale case investigations. To address this gap, our study capitalized on longitudinal UK Biobank neuroimaging data acquired prior to and following COVID-19 testing (N=416 including n=224 COVID-19 cases; Mage=58.6). Putative neuroinflammation was assessed in gray matter structures and white matter tracts using non-invasive Diffusion Basis Spectrum Imaging (DBSI), which estimates inflammation-related cellularity (DBSI-restricted fraction; DBSI-RF) and vasogenic edema (DBSI-hindered fraction; DBSI-HF).We hypothesized that COVID-19 case status would be associated with increases in DBSI markers after accounting for potential confound (age, sex, race, body mass index, smoking frequency, and data acquisition interval) and multiple testing. COVID-19 case status was not significantly associated with DBSI-RF (|β|'s<0.28, pFDR >0.05), but with greater DBSI-HF in left pre- and post-central gyri and right middle frontal gyrus (β's>0.3, all pFDR=0.03). Intriguingly, the brain areas exhibiting increased putative vasogenic edema had previously been linked to COVID-19-related functional and structural alterations, whereas brain regions displaying subtle differences in cellularity between COVID-19 cases and controls included regions within or functionally connected to the olfactory network, which has been implicated in COVID-19 psychopathology. Nevertheless, our study might not have captured acute and transitory neuroinflammatory effects linked to SARS-CoV-2 infection, possibly due to symptom resolution before the imaging scan. Future research is warranted to explore the potential time- and symptom-dependent neuroinflammatory relationship with COVID-19.

Diffusion basis spectrum imaging detects pathological alterations in substantia nigra and white matter tracts with early-stage Parkinson's disease

OBJECTIVES

Using diffusion basis spectrum imaging (DBSI) to examine the microstructural changes in the substantia nigra (SN) and global white matter (WM) tracts of patients with early-stage PD.

METHODS

Thirty-seven age- and sex-matched patients with early-stage PD and 22 healthy controls (HCs) were enrolled in this study. All participants underwent clinical assessments and diffusion-weighted MRI scans, analyzed by diffusion tensor imaging (DTI) and DBSI to assess the pathologies of PD in SN and global WM tracts.

RESULTS

The lower DTI fraction anisotropy (FA) was seen in SN of PD patients (PD: 0.316 ± 0.034 vs HCs: 0.331 ± 0.019, p = 0.015). The putative cells marker-DBSI-restricted fraction (PD: 0.132 ± 0.051 vs HCs: 0.105 ± 0.039, p = 0.031) and the edema/extracellular space marker-DBSI non-restricted-fraction (PD: 0.150 ± 0.052 vs HCs: 0.122 ± 0.052, p = 0.020) were both significantly higher and the density of axons/dendrites marker-DBSI fiber-fraction (PD: 0.718 ± 0.073 vs HCs: 0.773 ± 0.071, p = 0.003) was significantly lower in SN of PD patients. DBSI-restricted fraction in SN was negatively correlated with HAMA scores (r = - 0.501, p = 0.005), whereas DTI-FA was not correlated with any clinical scales. In WM tracts, only higher DTI axial diffusivity (AD) among DTI metrics was found in multiple WM regions in PD, while lower DBSI fiber-fraction and higher DBSI non-restricted-fraction were detected in multiple WM regions. DBSI non-restricted-fraction in both left fornix (cres)/stria terminalis (r = -0.472, p = 0.004) and right posterior thalamic radiation (r = - 0.467, p = 0.005) was negatively correlated with MMSE scores.

CONCLUSION

DBSI could potentially detect and quantify the extent of inflammatory cell infiltration, fiber/dendrite loss, and edema in both SN and WM tracts in patients with early-stage PD, a finding remains to be further investigated through more extensive longitudinal DBSI analysis.

CLINICAL RELEVANCE STATEMENT

Our study shows that DBSI indexes can potentially detect early-stage PD's pathological changes, with a notable ability to distinguish between inflammation and edema. This implies that DBSI has the potential to be an imaging biomarker for early PD diagnosis.

KEY POINTS

• Diffusion basis spectrum imaging detected higher restricted-fraction in Parkinson's disease, potentially reflecting inflammatory cell infiltration. • Diffusion basis spectrum imaging detected higher non-restricted-fraction and lower fiber-fraction in Parkinson's disease, indicating the presence of edema and/or dopaminergic neuronal/dendritic loss. • Diffusion basis spectrum imaging metrics correlated with non-motor symptoms, suggesting its potential diagnostic role to detect early-stage PD dysfunctions.

How far MS lesion detection and segmentation are integrated into the clinical workflow? A systematic review

INTRODUCTION

Over the past few years, the deep learning community has developed and validated a plethora of tools for lesion detection and segmentation in Multiple Sclerosis (MS). However, there is an important gap between validating models technically and clinically. To this end, a six-step framework necessary for the development, validation, and integration of quantitative tools in the clinic was recently proposed under the name of the Quantitative Neuroradiology Initiative (QNI).

AIMS

Investigate to what extent automatic tools in MS fulfill the QNI framework necessary to integrate automated detection and segmentation into the clinical neuroradiology workflow.

METHODS

Adopting the systematic Cochrane literature review methodology, we screened and summarised published scientific articles that perform automatic MS lesions detection and segmentation. We categorised the retrieved studies based on their degree of fulfillment of QNI's six-steps, which include a tool's technical assessment, clinical validation, and integration.

RESULTS

We found 156 studies; 146/156 (94%) fullfilled the first QNI step, 155/156 (99%) the second, 8/156 (5%) the third, 3/156 (2%) the fourth, 5/156 (3%) the fifth and only one the sixth.

CONCLUSIONS

To date, little has been done to evaluate the clinical performance and the integration in the clinical workflow of available methods for MS lesion detection/segmentation. In addition, the socio-economic effects and the impact on patients' management of such tools remain almost unexplored.

Fully-automated sarcopenia assessment in head and neck cancer: development and external validation of a deep learning pipeline

Purpose

Sarcopenia is an established prognostic factor in patients diagnosed with head and neck squamous cell carcinoma (HNSCC). The quantification of sarcopenia assessed by imaging is typically achieved through the skeletal muscle index (SMI), which can be derived from cervical neck skeletal muscle (SM) segmentation and cross-sectional area. However, manual SM segmentation is labor-intensive, prone to inter-observer variability, and impractical for large-scale clinical use. To overcome this challenge, we have developed and externally validated a fully-automated image-based deep learning (DL) platform for cervical vertebral SM segmentation and SMI calculation, and evaluated the relevance of this with survival and toxicity outcomes.

Materials and Methods

899 patients diagnosed as having HNSCC with CT scans from multiple institutes were included, with 335 cases utilized for training, 96 for validation, 48 for internal testing and 393 for external testing. Ground truth single-slice segmentations of SM at the C3 vertebra level were manually generated by experienced radiation oncologists. To develop an efficient method of segmenting the SM, a multi-stage DL pipeline was implemented, consisting of a 2D convolutional neural network (CNN) to select the middle slice of C3 section and a 2D U-Net to segment SM areas. The model performance was evaluated using the Dice Similarity Coefficient (DSC) as the primary metric for the internal test set, and for the external test set the quality of automated segmentation was assessed manually by two experienced radiation oncologists. The L3 skeletal muscle area (SMA) and SMI were then calculated from the C3 cross sectional area (CSA) of the auto-segmented SM. Finally, established SMI cut-offs were used to perform further analyses to assess the correlation with survival and toxicity endpoints in the external institution with univariable and multivariable Cox regression.

Results

DSCs for validation set (n = 96) and internal test set (n = 48) were 0.90 (95% CI: 0.90 - 0.91) and 0.90 (95% CI: 0.89 - 0.91), respectively. The predicted CSA is highly correlated with the ground-truth CSA in both validation (r = 0.99, p < 0.0001) and test sets (r = 0.96, p < 0.0001). In the external test set (n = 377), 96.2% of the SM segmentations were deemed acceptable by consensus expert review. Predicted SMA and SMI values were highly correlated with the ground-truth values, with Pearson r β 0.99 (p < 0.0001) for both the female and male patients in all datasets. Sarcopenia was associated with worse OS (HR 2.05 [95% CI 1.04 - 4.04], p = 0.04) and longer PEG tube duration (median 162 days vs. 134 days, HR 1.51 [95% CI 1.12 - 2.08], p = 0.006 in multivariate analysis.

Conclusion

We developed and externally validated a fully-automated platform that strongly correlates with imaging-assessed sarcopenia in patients with H&N cancer that correlates with survival and toxicity outcomes. This study constitutes a significant stride towards the integration of sarcopenia assessment into decision-making for individuals diagnosed with HNSCC.

SUMMARY STATEMENT

In this study, we developed and externally validated a deep learning model to investigate the impact of sarcopenia, defined as the loss of skeletal muscle mass, on patients with head and neck squamous cell carcinoma (HNSCC) undergoing radiotherapy. We demonstrated an efficient, fullyautomated deep learning pipeline that can accurately segment C3 skeletal muscle area, calculate cross-sectional area, and derive a skeletal muscle index to diagnose sarcopenia from a standard of care CT scan. In multi-institutional data, we found that pre-treatment sarcopenia was associated with significantly reduced overall survival and an increased risk of adverse events. Given the increased vulnerability of patients with HNSCC, the assessment of sarcopenia prior to radiotherapy may aid in informed treatment decision-making and serve as a predictive marker for the necessity of early supportive measures.

Automatic Intelligent System Using Medical of Things for Multiple Sclerosis Detection

Malfunctions in the immune system cause multiple sclerosis (MS), which initiates mild to severe nerve damage. MS will disturb the signal communication between the brain and other body parts, and early diagnosis will help reduce the harshness of MS in humankind. Magnetic resonance imaging (MRI) supported MS detection is a standard clinical procedure in which the bio-image recorded with a chosen modality is considered to assess the severity of the disease. The proposed research aims to implement a convolutional neural network (CNN) supported scheme to detect MS lesions in the chosen brain MRI slices. The stages of this framework include (i) image collection and resizing, (ii) deep feature mining, (iii) hand-crafted feature mining, (iii) feature optimization with firefly algorithm, and (iv) serial feature integration and classification. In this work, five-fold cross-validation is executed, and the final result is considered for the assessment. The brain MRI slices with/without the skull section are examined separately, presenting the attained results. The experimental outcome of this study confirms that the VGG16 with random forest (RF) classifier offered a classification accuracy of >98% MRI with skull, and VGG16 with K-nearest neighbor (KNN) provided an accuracy of >98% without the skull.

Graph-Based Analysis of Brain Connectivity in Multiple Sclerosis Using Functional MRI: A Systematic Review

(1) Background: Multiple sclerosis (MS) is an immune system disease in which myelin in the nervous system is affected. This abnormal immune system mechanism causes physical disabilities and cognitive impairment. Functional magnetic resonance imaging (fMRI) is a common neuroimaging technique used in studying MS. Computational methods have recently been applied for disease detection, notably graph theory, which helps researchers understand the entire brain network and functional connectivity. (2) Methods: Relevant databases were searched to identify articles published since 2000 that applied graph theory to study functional brain connectivity in patients with MS based on fMRI. (3) Results: A total of 24 articles were included in the review. In recent years, the application of graph theory in the MS field received increased attention from computational scientists. The graph-theoretical approach was frequently combined with fMRI in studies of functional brain connectivity in MS. Lower EDSSs of MS stage were the criteria for most of the studies (4) Conclusions: This review provides insights into the role of graph theory as a computational method for studying functional brain connectivity in MS. Graph theory is useful in the detection and prediction of MS and can play a significant role in identifying cognitive impairment associated with MS.

Diffusion basis spectrum imaging as an adjunct to conventional MRI leads to earlier diagnosis of high-grade glioma tumor progression versus treatment effect

Background

Following chemoradiotherapy for high-grade glioma (HGG), it is often challenging to distinguish treatment changes from true tumor progression using conventional MRI. The diffusion basis spectrum imaging (DBSI) hindered fraction is associated with tissue edema or necrosis, which are common treatment-related changes. We hypothesized that DBSI hindered fraction may augment conventional imaging for earlier diagnosis of progression versus treatment effect.

Methods

Adult patients were prospectively recruited if they had a known histologic diagnosis of HGG and completed standard-of-care chemoradiotherapy. DBSI and conventional MRI data were acquired longitudinally beginning 4 weeks post-radiation. Conventional MRI and DBSI metrics were compared with respect to their ability to diagnose progression versus treatment effect.

Results

Twelve HGG patients were enrolled between August 2019 and February 2020, and 9 were ultimately analyzed (5 progression, 4 treatment effect). Within new or enlarging contrast-enhancing regions, DBSI hindered fraction was significantly higher in the treatment effect group compared to progression group (P = .0004). Compared to serial conventional MRI alone, inclusion of DBSI would have led to earlier diagnosis of either progression or treatment effect in 6 (66.7%) patients by a median of 7.7 (interquartile range = 0-20.1) weeks.

Conclusions

In the first longitudinal prospective study of DBSI in adult HGG patients, we found that in new or enlarging contrast-enhancing regions following therapy, DBSI hindered fraction is elevated in cases of treatment effect compared to those with progression. Hindered fraction map may be a valuable adjunct to conventional MRI to distinguish tumor progression from treatment effect.

Automatic detection of active and inactive multiple sclerosis plaques using the Bayesian approach in susceptibility-weighted imaging

BACKGROUND

Susceptibility-weighted imaging (SWI) is efficient in detecting multiple sclerosis (MS) plaques and evaluating the level of disease activity.

PURPOSE

To automatically detect active and inactive MS plaques in SWI images using a Bayesian approach.

MATERIAL AND METHODS

A 1.5-T scanner was used to evaluate 147 patients with MS. The area of the plaques along with their active or inactive status were automatically identified using a Bayesian approach. Plaques were given an orange color if they were active and a blue color if they were inactive, based on the preset signal intensity.

RESULTS

Experimental findings show that the proposed method has a high accuracy rate of 91% and a sensitivity rate of 76% for identifying the type and area of plaques. Inactive plaques were properly identified in 87% of cases, and active plaques in 76% of cases. The Kappa analysis revealed an 80% agreement between expert diagnoses based on contrast-enhanced and FLAIR images and Bayesian inferences in SWI.

CONCLUSION

The results of our study demonstrated that the proposed method has good accuracy for identifying the MS plaque area as well as for identifying the types of active or inactive plaques in SWI. Therefore, it might be helpful to use the proposed method as a supplemental tool to accelerate the specialist's diagnosis.

Automated Classification of Intramedullary Spinal Cord Tumors and Inflammatory Demyelinating Lesions Using Deep Learning

Accurate differentiation of intramedullary spinal cord tumors and inflammatory demyelinating lesions and their subtypes are warranted because of their overlapping characteristics at MRI but with different treatments and prognosis. The authors aimed to develop a pipeline for spinal cord lesion segmentation and classification using two-dimensional MultiResUNet and DenseNet121 networks based on T2-weighted images. A retrospective cohort of 490 patients (118 patients with astrocytoma, 130 with ependymoma, 101 with multiple sclerosis [MS], and 141 with neuromyelitis optica spectrum disorders [NMOSD]) was used for model development, and a prospective cohort of 157 patients (34 patients with astrocytoma, 45 with ependymoma, 33 with MS, and 45 with NMOSD) was used for model testing. In the test cohort, the model achieved Dice scores of 0.77, 0.80, 0.50, and 0.58 for segmentation of astrocytoma, ependymoma, MS, and NMOSD, respectively, against manual labeling. Accuracies of 96% (area under the receiver operating characteristic curve [AUC], 0.99), 82% (AUC, 0.90), and 79% (AUC, 0.85) were achieved for the classifications of tumor versus demyelinating lesion, astrocytoma versus ependymoma, and MS versus NMOSD, respectively. In a subset of radiologically difficult cases, the classifier showed an accuracy of 79%-95% (AUC, 0.78-0.97). The established deep learning pipeline for segmentation and classification of spinal cord lesions can support an accurate radiologic diagnosis. Supplemental material is available for this article. © RSNA, 2022 Keywords: Spinal Cord MRI, Astrocytoma, Ependymoma, Multiple Sclerosis, Neuromyelitis Optica Spectrum Disorder, Deep Learning.

Multiple Sclerosis Diagnosis Using Machine Learning and Deep Learning: Challenges and Opportunities

Multiple Sclerosis (MS) is a disease that impacts the central nervous system (CNS), which can lead to brain, spinal cord, and optic nerve problems. A total of 2.8 million are estimated to suffer from MS. Globally, a new case of MS is reported every five minutes. In this review, we discuss the proposed approaches to diagnosing MS using machine learning (ML) published between 2011 and 2022. Numerous models have been developed using different types of data, including magnetic resonance imaging (MRI) and clinical data. We identified the methods that achieved the best results in diagnosing MS. The most implemented approaches are SVM, RF, and CNN. Moreover, we discussed the challenges and opportunities in MS diagnosis to improve AI systems to enable researchers and practitioners to enhance their approaches and improve the automated diagnosis of MS. The challenges faced by automated MS diagnosis include difficulty distinguishing the disease from other diseases showing similar symptoms, protecting the confidentiality of the patients' data, achieving reliable ML models that are also easily understood by non-experts, and the difficulty of collecting a large reliable dataset. Moreover, we discussed several opportunities in the field such as the implementation of secure platforms, employing better AI solutions, developing better disease prognosis systems, combining more than one data type for better MS prediction and using OCT data for diagnosis, utilizing larger, multi-center datasets to improve the reliability of the developed models, and commercialization.

Classification of multiple sclerosis clinical profiles using machine learning and grey matter connectome

Purpose: The main goal of this study is to investigate the discrimination power of Grey Matter (GM) thickness connectome data between Multiple Sclerosis (MS) clinical profiles using statistical and Machine Learning (ML) methods.

Materials and Methods: A dataset composed of 90 MS patients acquired at the MS clinic of Lyon Neurological Hospital was used for the analysis. Four MS profiles were considered, corresponding to Clinical Isolated Syndrome (CIS), Relapsing-Remitting MS (RRMS), Secondary Progressive MS (SPMS), and Primary Progressive MS (PPMS). Each patient was classified in one of these profiles by our neurologist and underwent longitudinal MRI examinations including T1-weighted image acquisition at each examination, from which the GM tissue was segmented and the cortical GM thickness measured. Following the GM parcellation using two different atlases (FSAverage and Glasser 2016), the morphological connectome was built and six global metrics (Betweenness Centrality (BC), Assortativity (r), Transitivity (T), Efficiency (E_g), Modularity (Q) and Density (D)) were extracted. Based on their connectivity metrics, MS profiles were first statistically compared and second, classified using four different learning machines (Logistic Regression, Random Forest, Support Vector Machine and AdaBoost), combined in a higher level ensemble model by majority voting. Finally, the impact of the GM spatial resolution on the MS clinical profiles classification was analyzed.

Results: Using binary comparisons between the four MS clinical profiles, statistical differences and classification performances higher than 0.7 were observed. Good performances were obtained when comparing the two early clinical forms, RRMS and PPMS (F1 score of 0.86), and the two neurodegenerative profiles, PPMS and SPMS (F1 score of 0.72). When comparing the two atlases, slightly better performances were obtained with the Glasser 2016 atlas, especially between RRMS with PPMS (F1 score of 0.83), compared to the FSAverage atlas (F1 score of 0.69). Also, the thresholding value for graph binarization was investigated suggesting more informative graph properties in the percentile range between 0.6 and 0.8.

Conclusion: An automated pipeline was proposed for the classification of MS clinical profiles using six global graph metrics extracted from the GM morphological connectome of MS patients. This work demonstrated that GM morphological connectivity data could provide good classification performances by combining four simple ML models, without the cost of long and complex MR techniques, such as MR diffusion, and/or deep learning architectures.

Cortical lesions, central vein sign, and paramagnetic rim lesions in multiple sclerosis: Emerging machine learning techniques and future avenues

The current diagnostic criteria for multiple sclerosis (MS) lack specificity, and this may lead to misdiagnosis, which remains an issue in present-day clinical practice. In addition, conventional biomarkers only moderately correlate with MS disease progression. Recently, some MS lesional imaging biomarkers such as cortical lesions (CL), the central vein sign (CVS), and paramagnetic rim lesions (PRL), visible in specialized magnetic resonance imaging (MRI) sequences, have shown higher specificity in differential diagnosis. Moreover, studies have shown that CL and PRL are potential prognostic biomarkers, the former correlating with cognitive impairments and the latter with early disability progression. As machine learning-based methods have achieved extraordinary performance in the assessment of conventional imaging biomarkers, such as white matter lesion segmentation, several automated or semi-automated methods have been proposed as well for CL, PRL, and CVS. In the present review, we first introduce these MS biomarkers and their imaging methods. Subsequently, we describe the corresponding machine learning-based methods that were proposed to tackle these clinical questions, putting them into context with respect to the challenges they are facing, including non-standardized MRI protocols, limited datasets, and moderate inter-rater variability. We conclude by presenting the current limitations that prevent their broader deployment and suggesting future research directions.

An Accurate Multiple Sclerosis Detection Model Based on Exemplar Multiple Parameters Local Phase Quantization: ExMPLPQ

Multiple sclerosis (MS) is a chronic demyelinating condition characterized by plaques in the white matter of the central nervous system that can be detected using magnetic resonance imaging (MRI). Many deep learning models for automated MS detection based on MRI have been presented in the literature. We developed a computationally lightweight machine learning model for MS diagnosis using a novel handcrafted feature engineering approach. The study dataset comprised axial and sagittal brain MRI images that were prospectively acquired from 72 MS and 59 healthy subjects who attended the Ozal University Medical Faculty in 2021. The dataset was divided into three study subsets: axial images only (n = 1652), sagittal images only (n = 1775), and combined axial and sagittal images (n = 3427) of both MS and healthy classes. All images were resized to 224 × 224. Subsequently, the features were generated with a fixed-size patch-based (exemplar) feature extraction model based on local phase quantization (LPQ) with three-parameter settings. The resulting exemplar multiple parameters LPQ (ExMPLPQ) features were concatenated to form a large final feature vector. The top discriminative features were selected using iterative neighborhood component analysis (INCA). Finally, a k-nearest neighbor (kNN) algorithm, Fine kNN, was deployed to perform binary classification of the brain images into MS vs. healthy classes. The ExMPLPQ-based model attained 98.37%, 97.75%, and 98.22% binary classification accuracy rates for axial, sagittal, and hybrid datasets, respectively, using Fine kNN with 10-fold cross-validation. Furthermore, our model outperformed 19 established pre-trained deep learning models that were trained and tested with the same data. Unlike deep models, the ExMPLPQ-based model is computationally lightweight yet highly accurate. It has the potential to be implemented as an automated diagnostic tool to screen brain MRIs for white matter lesions in suspected MS patients.

A Comprehensive Survey on the Detection, Classification, and Challenges of Neurological Disorders

Simple Summary

This study represents a resourceful review article that can deliver resources on neurological diseases and their implemented classification algorithms to reveal the future direction of researchers. Researchers interested in studying neurological diseases and previously implemented techniques in this field can follow this article. Various challenges occur in detecting different stages of the disorders. A limited amount of labeled and unlabeled datasets and other limitations is represented in this article to assist them in finding out the directions. The authors’ purpose for composing this article is to make a straightforward and concrete path for researchers to quickly find the way and the scope in this field for implementing future research on neurological disease detection.

Abstract

Neurological disorders (NDs) are becoming more common, posing a concern to pregnant women, parents, healthy infants, and children. Neurological disorders arise in a wide variety of forms, each with its own set of origins, complications, and results. In recent years, the intricacy of brain functionalities has received a better understanding due to neuroimaging modalities, such as magnetic resonance imaging (MRI), magnetoencephalography (MEG), and positron emission tomography (PET), etc. With high-performance computational tools and various machine learning (ML) and deep learning (DL) methods, these modalities have discovered exciting possibilities for identifying and diagnosing neurological disorders. This study follows a computer-aided diagnosis methodology, leading to an overview of pre-processing and feature extraction techniques. The performance of existing ML and DL approaches for detecting NDs is critically reviewed and compared in this article. A comprehensive portion of this study also shows various modalities and disease-specified datasets that detect and records images, signals, and speeches, etc. Limited related works are also summarized on NDs, as this domain has significantly fewer works focused on disease and detection criteria. Some of the standard evaluation metrics are also presented in this study for better result analysis and comparison. This research has also been outlined in a consistent workflow. At the conclusion, a mandatory discussion section has been included to elaborate on open research challenges and directions for future work in this emerging field.

The Application of Diffusion Kurtosis Imaging on the Heterogeneous White Matter in Relapsing-Remitting Multiple Sclerosis

Objectives

To evaluate the microstructural damage in the heterogeneity of different white matter areas in relapsing-remitting multiple sclerosis (RRMS) patients by using diffusion kurtosis imaging (DKI) and its correlation with clinical and cognitive status.

Materials and Methods

Kurtosis fractional anisotropy (KFA), fractional anisotropy (FA), mean kurtosis (MK), and mean diffusivity (MD) in T1-hypointense lesions (T1Ls), pure T2-hyperintense lesions (pure-T2Ls), normal-appearing white matter (NAWM), and white matter in healthy controls (WM in HCs) were measured in 48 RRMS patients and 26 sex- and age-matched HCs. All the participants were assessed with the Mini-Mental State Examination (MMSE), the Montreal Cognitive Assessment (MoCA), and the Symbol Digit Modalities Test (SDMT) scores as the cognitive status. The Kurtzke Expanded Disability Status Scale (EDSS) scores were used to evaluate the clinical status in RRMS patients.

Results

The lowest KFA, FA, and MK values and the highest MD values were found in T1Ls, followed by pure-T2Ls, NAWM, and WM in HCs. The T1Ls and pure-T2Ls were significantly different in FA (p = 0.002) and MK (p = 0.013), while the NAWM and WM in HCs were significantly different in KFA, FA, and MK (p < 0.001; p < 0.001; p = 0.001). The KFA, FA, MK, and MD values in NAWM (r = 0.360, p = 0.014; r = 0.415, p = 0.004; r = 0.369, p = 0.012; r = −0.531, p < 0.001) were correlated with the MMSE scores and the FA, MK, and MD values in NAWM (r = 0.423, p = 0.003; r = 0.427, p = 0.003; r = −0.359, p = 0.014) were correlated with the SDMT scores.

Conclusion

Applying DKI to the imaging-based white matter classification has the potential to reflect the white matter damage and is correlated with cognitive impairment.

Opportunities for Understanding MS Mechanisms and Progression With MRI Using Large-Scale Data Sharing and Artificial Intelligence

Patients with multiple sclerosis (MS) have heterogeneous clinical presentations, symptoms, and progression over time, making MS difficult to assess and comprehend in vivo. The combination of large-scale data sharing and artificial intelligence creates new opportunities for monitoring and understanding MS using MRI. First, development of validated MS-specific image analysis methods can be boosted by verified reference, test, and benchmark imaging data. Using detailed expert annotations, artificial intelligence algorithms can be trained on such MS-specific data. Second, understanding disease processes could be greatly advanced through shared data of large MS cohorts with clinical, demographic, and treatment information. Relevant patterns in such data that may be imperceptible to a human observer could be detected through artificial intelligence techniques. This applies from image analysis (lesions, atrophy, or functional network changes) to large multidomain datasets (imaging, cognition, clinical disability, genetics). After reviewing data sharing and artificial intelligence, we highlight 3 areas that offer strong opportunities for making advances in the next few years: crowdsourcing, personal data protection, and organized analysis challenges. Difficulties as well as specific recommendations to overcome them are discussed, in order to best leverage data sharing and artificial intelligence to improve image analysis, imaging, and the understanding of MS.

Applications of deep learning techniques for automated multiple sclerosis detection using magnetic resonance imaging: A review

Multiple Sclerosis (MS) is a type of brain disease which causes visual, sensory, and motor problems for people with a detrimental effect on the functioning of the nervous system. In order to diagnose MS, multiple screening methods have been proposed so far; among them, magnetic resonance imaging (MRI) has received considerable attention among physicians. MRI modalities provide physicians with fundamental information about the structure and function of the brain, which is crucial for the rapid diagnosis of MS lesions. Diagnosing MS using MRI is time-consuming, tedious, and prone to manual errors. Research on the implementation of computer aided diagnosis system (CADS) based on artificial intelligence (AI) to diagnose MS involves conventional machine learning and deep learning (DL) methods. In conventional machine learning, feature extraction, feature selection, and classification steps are carried out by using trial and error; on the contrary, these steps in DL are based on deep layers whose values are automatically learn. In this paper, a complete review of automated MS diagnosis methods performed using DL techniques with MRI neuroimaging modalities is provided. Initially, the steps involved in various CADS proposed using MRI modalities and DL techniques for MS diagnosis are investigated. The important preprocessing techniques employed in various works are analyzed. Most of the published papers on MS diagnosis using MRI modalities and DL are presented. The most significant challenges facing and future direction of automated diagnosis of MS using MRI modalities and DL techniques are also provided.

Diffusion basis spectrum imaging measures anti-inflammatory and neuroprotective effects of fingolimod on murine optic neuritis

OBJECTIVE

To prospectively determine whether diffusion basis spectrum imaging (DBSI) detects, differentiates and quantitates coexisting inflammation, demyelination, axonal injury and axon loss in mice with optic neuritis (ON) due to experimental autoimmune encephalomyelitis (EAE), and to determine if DBSI accurately measures effects of fingolimod on underlying pathology.

METHODS

EAE was induced in 7-week-old C57BL/6 female mice. Visual acuity (VA) was assessed daily to detect onset of ON after which daily oral-treatment with either fingolimod (1 mg/kg) or saline was given for ten weeks. In vivo DBSI scans of optic nerves were performed at baseline, 2-, 6- and 10-weeks post treatment. DBSI-derived metrics including restricted isotropic diffusion tensor fraction (putatively reflecting cellularity), non-restricted isotropic diffusion tensor fraction (putatively reflecting vasogenic edema), DBSI-derived axonal volume, axial diffusivity, λ_∥ (putatively reflecting axonal integrity), and increased radial diffusivity, λ_⊥ (putatively reflecting demyelination). Mice were killed immediately after the last DBSI scan for immunohistochemical assessment.

RESULTS

Optic nerves of fingolimod-treated mice exhibited significantly better (p < 0.05) VA than saline-treated group at each time point. During ten-week of treatment, DBSI-derived non-restricted and restricted-isotropic-diffusion-tensor fractions, and axonal volumes were not significantly different (p > 0.05) from the baseline values in fingolimod-treated mice. Transient DBSI-λ_∥ decrease and DBSI-λ_⊥ increase were detected during Fingolimod treatment. DBSI-derived metrics assessed in vivo significantly correlated (p < 0.05) with the corresponding histological markers.

CONCLUSION

DBSI was used to assess changes of the underlying optic nerve pathologies in EAE mice with ON, exhibiting great potential as a noninvasive outcome measure for monitoring disease progression and therapeutic efficacy for MS.

Characterization of multiple sclerosis neuroinflammation and neurodegeneration with relaxation and diffusion basis spectrum imaging

BACKGROUND

Advanced magnetic resonance imaging (MRI) methods can provide more specific information about various microstructural tissue changes in multiple sclerosis (MS) brain. Quantitative measurement of T₁ and T₂ relaxation, and diffusion basis spectrum imaging (DBSI) yield metrics related to the pathology of neuroinflammation and neurodegeneration that occurs across the spectrum of MS.

OBJECTIVE

To use relaxation and DBSI MRI metrics to describe measures of neuroinflammation, myelin and axons in different MS subtypes.

METHODS

103 participants (20 clinically isolated syndrome (CIS), 33 relapsing-remitting MS (RRMS), 30 secondary progressive MS and 20 primary progressive MS) underwent quantitative T₁, T₂, DBSI and conventional 3T MRI. Whole brain, normal-appearing white matter, lesion and corpus callosum MRI metrics were compared across MS subtypes.

RESULTS

A gradation of MRI metric values was seen from CIS to RRMS to progressive MS. RRMS demonstrated large oedema-related differences, while progressive MS had the most extensive abnormalities in myelin and axonal measures.

CONCLUSION

Relaxation and DBSI-derived MRI measures show differences between MS subtypes related to the severity and composition of underlying tissue damage. RRMS showed oedema, demyelination and axonal loss compared with CIS. Progressive MS had even more evidence of increased oedema, demyelination and axonal loss compared with CIS and RRMS.

Update on brain MRI for the diagnosis and follow-up of MS patients

Over the past decades, MRI has become a major tool in the diagnosis and the follow-up of patients with multiple sclerosis (MS), especially for monitoring the effectiveness of therapy. The recent international recommendations issued for the standardization of neurological and radiological clinical practices converge on many points. In this setting, recommendations made by the "Observatoire français de la sclérose en plaques", the French MS registry, can be distinguished by its interdisciplinary complementarity, its longevity, its size, and its positions in direct connection with the clinic. Hence, after suspicions of gadolinium deposition in the brain, with multiple warning from the American and European health authorities, a national consultation took place and resulted in limitation to useful injections. The precautionary principle prevailing, the patient receives a limited quantity of contrast product even if no clinically harmful manifestation has been detected to date. The result of this round table bringing together neurologists and neuroradiologists from specialized centers was published in the form of a recommendation in early 2020. The interest of this project also lies in the constant improvement of the management of patients with MS and the possibility of developing advanced techniques to assist the clinician. The aim of this review is to explain to the neurologist, the interest of following this imaging protocol both in his/her clinical practice and in the possibilities that this opens up.

Non-invasive quantification of inflammation, axonal and myelin injury in multiple sclerosis

The aim of this study was to determine the feasibility of diffusion basis spectrum imaging in multiple sclerosis at 7 T and to investigate the pathological substrates of tissue damage in lesions and normal-appearing white matter. To this end, 43 patients with multiple sclerosis (24 relapsing-remitting, 19 progressive), and 21 healthy control subjects were enrolled. White matter lesions were classified in T1-isointense, T1-hypointense and black holes. Mean values of diffusion basis spectrum imaging metrics (fibres, restricted and non-restricted fractions, axial and radial diffusivities and fractional anisotropy) were measured from whole brain white matter lesions and from both lesions and normal appearing white matter of the corpus callosum. Significant differences were found between T1-isointense and black holes (P ranging from 0.005 to <0.001) and between lesions' centre and rim (P < 0.001) for all the metrics. When comparing the three subject groups in terms of metrics derived from corpus callosum normal appearing white matter and T2-hyperintense lesions, a significant difference was found between healthy controls and relapsing-remitting patients for all metrics except restricted fraction and fractional anisotropy; between healthy controls and progressive patients for all metrics except restricted fraction and between relapsing-remitting and progressive multiple sclerosis patients for all metrics except fibres and restricted fractions (P ranging from 0.05 to <0.001 for all). Significant associations were found between corpus callosum normal-appearing white matter fibres fraction/non-restricted fraction and the Symbol Digit Modality Test (respectively, r = 0.35, P = 0.043; r = -0.35, P = 0.046), and between black holes radial diffusivity and Expanded Disability Status Score (r = 0.59, P = 0.002). We showed the feasibility of diffusion basis spectrum imaging metrics at 7 T, confirmed the role of the derived metrics in the characterization of lesions and normal appearing white matter tissue in different stages of the disease and demonstrated their clinical relevance. Thus, suggesting that diffusion basis spectrum imaging is a promising tool to investigate multiple sclerosis pathophysiology, monitor disease progression and treatment response.

Artificial Intelligence in Diagnosis and Prediction of the Multiple Sclerosis Progression: A Scoping Review (Preprint).. [DOI: 10.2196/preprints.29720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0]

BACKGROUND

Multiple Sclerosis (MS) is an autoimmune disease that results from the demyelination of the nerves in the Central Nervous System. The diagnosis depends on clinical history, neurological examination, and radiological images. Artificial Intelligence proved to be an effective tool in enhancing the diagnostic tools of MS.

OBJECTIVE

To explore how AI assisted in diagnosis and predicting the progression of MS.

METHODS

We used three bibliographic databases in our search: PubMed IEEE Xplore and Cochrane in our search. The study selection process included: removal of duplicated articles, screening titles and abstracts, and reading the full text. This process was performed by two reviewers. The data extracted from the included studies have been filled in an Excel sheet. This step had been done by each reviewer accordingly to the assigned articles. The extracted data sheet was checked by two reviewers to have accuracy ensured. The narrative approach is applied in data synthesis.

RESULTS

The search conducted resulted in 320 articles Removing duplicates and excluding the ineligible articles due to irrelevancy to the population, intervention, and outcomes resulted in excluding 299 articles. Thus, our review will include 21 articles for data extraction and data synthesis.

CONCLUSIONS

Artificial Intelligence is becoming a trend in the medical field. Its contribution in enhancing the diagnostic tools of many diseases, as in MS, is prominent and can be built on in further development plans. However, the implementation of Artificial Intelligence in Multiple Sclerosis is not widespread to confirm the benefits gained, and the datasets involved in the current practice are relatively small. It is recommended to have more studies that focus on the relationship between the employment of AI in diagnosis and monitoring progression and the accuracy gained by this employment.

GAMER-MRI in Multiple Sclerosis Identifies the Diffusion-Based Microstructural Measures That Are Most Sensitive to Focal Damage: A Deep-Learning-Based Analysis and Clinico-Biological Validation

Conventional magnetic resonance imaging (cMRI) in multiple sclerosis (MS) patients provides measures of focal brain damage and activity, which are fundamental for disease diagnosis, prognosis, and the evaluation of response to therapy. However, cMRI is insensitive to the damage to the microenvironment of the brain tissue and the heterogeneity of MS lesions. In contrast, the damaged tissue can be characterized by mathematical models on multishell diffusion imaging data, which measure different compartmental water diffusion. In this work, we obtained 12 diffusion measures from eight diffusion models, and we applied a deep-learning attention-based convolutional neural network (CNN) (GAMER-MRI) to select the most discriminating measures in the classification of MS lesions and the perilesional tissue by attention weights. Furthermore, we provided clinical and biological validation of the chosen metrics-and of their most discriminative combinations-by correlating their respective mean values in MS patients with the corresponding Expanded Disability Status Scale (EDSS) and the serum level of neurofilament light chain (sNfL), which are measures of disability and neuroaxonal damage. Our results show that the neurite density index from neurite orientation and dispersion density imaging (NODDI), the measures of the intra-axonal and isotropic compartments from microstructural Bayesian approach, and the measure of the intra-axonal compartment from the spherical mean technique NODDI were the most discriminating (respective attention weights were 0.12, 0.12, 0.15, and 0.13). In addition, the combination of the neurite density index from NODDI and the measures for the intra-axonal and isotropic compartments from the microstructural Bayesian approach exhibited a stronger correlation with EDSS and sNfL than the individual measures. This work demonstrates that the proposed method might be useful to select the microstructural measures that are most discriminative of focal tissue damage and that may also be combined to a unique contrast to achieve stronger correlations to clinical disability and neuroaxonal damage.

Diffusion histology imaging differentiates distinct pediatric brain tumor histology

High-grade pediatric brain tumors exhibit the highest cancer mortality rates in children. While conventional MRI has been widely adopted for examining pediatric high-grade brain tumors clinically, accurate neuroimaging detection and differentiation of tumor histopathology for improved diagnosis, surgical planning, and treatment evaluation, remains an unmet need in their clinical management. We employed a novel Diffusion Histology Imaging (DHI) approach employing diffusion basis spectrum imaging (DBSI) derived metrics as the input classifiers for deep neural network analysis. DHI aims to detect, differentiate, and quantify heterogeneous areas in pediatric high-grade brain tumors, which include normal white matter (WM), densely cellular tumor, less densely cellular tumor, infiltrating edge, necrosis, and hemorrhage. Distinct diffusion metric combination would thus indicate the unique distributions of each distinct tumor histology features. DHI, by incorporating DBSI metrics and the deep neural network algorithm, classified pediatric tumor histology with an overall accuracy of 85.8%. Receiver operating analysis (ROC) analysis suggested DHI’s great capability in distinguishing individual tumor histology with AUC values (95% CI) of 0.984 (0.982–0.986), 0.960 (0.956–0.963), 0.991 (0.990–0.993), 0.950 (0.944–0.956), 0.977 (0.973–0.981) and 0.976 (0.972–0.979) for normal WM, densely cellular tumor, less densely cellular tumor, infiltrating edge, necrosis and hemorrhage, respectively. Our results suggest that DBSI-DNN, or DHI, accurately characterized and classified multiple tumor histologic features in pediatric high-grade brain tumors. If these results could be further validated in patients, the novel DHI might emerge as a favorable alternative to the current neuroimaging techniques to better guide biopsy and resection as well as monitor therapeutic response in patients with high-grade brain tumors.

The impact of edema and fiber crossing on diffusion MRI metrics assessed in an ex vivo nerve phantom: Multi-tensor model vs. diffusion orientation distribution function

Diffusion tensor imaging (DTI) has been employed for over 2 decades to noninvasively quantify central nervous system diseases/injuries. However, DTI is an inadequate simplification of diffusion modeling in the presence of coexisting inflammation, edema and crossing nerve fibers. We employed a tissue phantom using fixed mouse trigeminal nerves coated with various amounts of agarose gel to mimic crossing fibers in the presence of vasogenic edema. Diffusivity measures derived by DTI and diffusion basis spectrum imaging (DBSI) were compared at increasing levels of simulated edema and degrees of fiber crossing. Furthermore, we assessed the ability of DBSI, diffusion kurtosis imaging (DKI), generalized q-sampling imaging (GQI), q-ball imaging (QBI) and neurite orientation dispersion and density imaging to resolve fiber crossing, in reference to the gold standard angles measured from structural images. DTI-computed diffusivities and fractional anisotropy were significantly confounded by gel-mimicked edema and crossing fibers. Conversely, DBSI calculated accurate diffusivities of individual fibers regardless of the extent of simulated edema and degrees of fiber crossing angles. Additionally, DBSI accurately and consistently estimated crossing angles in various conditions of gel-mimicked edema when compared with the gold standard (r2 = 0.92, P = 1.9 × 10-9 , bias = 3.9°). Small crossing angles and edema significantly impact the diffusion orientation distribution function, making DKI, GQI and QBI less accurate in detecting and estimating fiber crossing angles. Lastly, we used diffusion tensor ellipsoids to demonstrate that DBSI resolves the confounds of edema and crossing fibers in the peritumoral edema region from a patient with lung cancer metastasis, while DTI failed. In summary, DBSI is able to separate two crossing fibers and accurately recover their diffusivities in a complex environment characterized by increasing crossing angles and amounts of gel-mimicked edema. DBSI also indicated better angular resolution compared with DKI, QBI and GQI.

Diffusion Histology Imaging Combining Diffusion Basis Spectrum Imaging (DBSI) and Machine Learning Improves Detection and Classification of Glioblastoma Pathology

PURPOSE

Glioblastoma (GBM) is one of the deadliest cancers with no cure. While conventional MRI has been widely adopted to examine GBM clinically, accurate neuroimaging assessment of tumor histopathology for improved diagnosis, surgical planning, and treatment evaluation remains an unmet need in the clinical management of GBMs.

EXPERIMENTAL DESIGN

We employ a novel diffusion histology imaging (DHI) approach, combining diffusion basis spectrum imaging (DBSI) and machine learning, to detect, differentiate, and quantify areas of high cellularity, tumor necrosis, and tumor infiltration in GBM.

RESULTS

Gadolinium-enhanced T1-weighted or hyperintense fluid-attenuated inversion recovery failed to reflect the morphologic complexity underlying tumor in patients with GBM. Contrary to the conventional wisdom that apparent diffusion coefficient (ADC) negatively correlates with increased tumor cellularity, we demonstrate disagreement between ADC and histologically confirmed tumor cellularity in GBM specimens, whereas DBSI-derived restricted isotropic diffusion fraction positively correlated with tumor cellularity in the same specimens. By incorporating DBSI metrics as classifiers for a supervised machine learning algorithm, we accurately predicted high tumor cellularity, tumor necrosis, and tumor infiltration with 87.5%, 89.0%, and 93.4% accuracy, respectively.

CONCLUSIONS

Our results suggest that DHI could serve as a favorable alternative to current neuroimaging techniques in guiding biopsy or surgery as well as monitoring therapeutic response in the treatment of GBM.