Classification of Multiple Sclerosis Clinical Profiles via Graph Convolutional Neural Networks

The macular retinal ganglion cell layer as a biomarker for diagnosis and prognosis in multiple sclerosis: A deep learning approach

PURPOSE

The macular ganglion cell layer (mGCL) is a strong potential biomarker of axonal degeneration in multiple sclerosis (MS). For this reason, this study aims to develop a computer-aided method to facilitate diagnosis and prognosis in MS.

METHODS

This paper combines a cross-sectional study of 72 MS patients and 30 healthy control subjects for diagnosis and a 10-year longitudinal study of the same MS patients for the prediction of disability progression, during which the mGCL was measured using optical coherence tomography (OCT). Deep neural networks were used as an automatic classifier.

RESULTS

For MS diagnosis, greatest accuracy (90.3%) was achieved using 17 features as inputs. The neural network architecture comprised the input layer, two hidden layers and the output layer with softmax activation. For the prediction of disability progression 8 years later, accuracy of 81.9% was achieved with a neural network comprising two hidden layers and 400 epochs.

CONCLUSION

We present evidence that by applying deep learning techniques to clinical and mGCL thickness data it is possible to identify MS and predict the course of the disease. This approach potentially constitutes a non-invasive, low-cost, easy-to-implement and effective method.

Electroacupuncture modulates abnormal brain connectivity after ischemia reperfusion injury in rats: A graph theory-based approach

BACKGROUND

Electroacupuncture (EA) has been shown to facilitate brain plasticity-related functional recovery following ischemic stroke. The functional magnetic resonance imaging technique can be used to determine the range and mode of brain activation. After stroke, EA has been shown to alter brain connectivity, whereas EA's effect on brain network topology properties remains unclear. An evaluation of EA's effects on global and nodal topological properties in rats with ischemia reperfusion was conducted in this study.

METHODS AND RESULTS

There were three groups of adult male Sprague-Dawley rats: sham-operated group (sham group), middle cerebral artery occlusion/reperfusion (MCAO/R) group, and MCAO/R plus EA (MCAO/R + EA) group. The differences in global and nodal topological properties, including shortest path length, global efficiency, local efficiency, small-worldness index, betweenness centrality (BC), and degree centrality (DC) were estimated. Graphical network analyses revealed that, as compared with the sham group, the MCAO/R group demonstrated a decrease in BC value in the right ventral hippocampus and increased BC in the right substantia nigra, accompanied by increased DC in the left nucleus accumbens shell (AcbSh). The BC was increased in the right hippocampus ventral and decreased in the right substantia nigra after EA intervention, and MCAO/R + EA resulted in a decreased DC in left AcbSh compared to MCAO/R.

CONCLUSION

The results of this study provide a potential basis for EA to promote cognitive and motor function recovery after ischemic stroke.

Medical image identification methods: A review

The identification of medical images is an essential task in computer-aided diagnosis, medical image retrieval and mining. Medical image data mainly include electronic health record data and gene information data, etc. Although intelligent imaging provided a good scheme for medical image analysis over traditional methods that rely on the handcrafted features, it remains challenging due to the diversity of imaging modalities and clinical pathologies. Many medical image identification methods provide a good scheme for medical image analysis. The concepts pertinent of methods, such as the machine learning, deep learning, convolutional neural networks, transfer learning, and other image processing technologies for medical image are analyzed and summarized in this paper. We reviewed these recent studies to provide a comprehensive overview of applying these methods in various medical image analysis tasks, such as object detection, image classification, image registration, segmentation, and other tasks. Especially, we emphasized the latest progress and contributions of different methods in medical image analysis, which are summarized base on different application scenarios, including classification, segmentation, detection, and image registration. In addition, the applications of different methods are summarized in different application area, such as pulmonary, brain, digital pathology, brain, skin, lung, renal, breast, neuromyelitis, vertebrae, and musculoskeletal, etc. Critical discussion of open challenges and directions for future research are finally summarized. Especially, excellent algorithms in computer vision, natural language processing, and unmanned driving will be applied to medical image recognition in the future.

Multiple sclerosis clinical forms classification with graph convolutional networks based on brain morphological connectivity

Multiple Sclerosis (MS) is an autoimmune disease that combines chronic inflammatory and neurodegenerative processes underlying different clinical forms of evolution, such as relapsing-remitting, secondary progressive, or primary progressive MS. This identification is usually performed by clinical evaluation at the diagnosis or during the course of the disease for the secondary progressive phase. In parallel, magnetic resonance imaging (MRI) analysis is a mandatory diagnostic complement. Identifying the clinical form from MR images is therefore a helpful and challenging task. Here, we propose a new approach for the automatic classification of MS forms based on conventional MRI (i.e., T1-weighted images) that are commonly used in clinical context. For this purpose, we investigated the morphological connectome features using graph based convolutional neural network. Our results obtained from the longitudinal study of 91 MS patients highlight the performance (F1-score) of this approach that is better than state-of-the-art as 3D convolutional neural networks. These results open the way for clinical applications such as disability correlation only using T1-weighted images.

Choosing the Best Instrument for Measuring Health Spillover Effect in Caregivers of Patients With Multiple Sclerosis

OBJECTIVES

To measure the health spillover effect in caregivers of patients with multiple sclerosis (MS), we aimed to select the best instrument from 2 common health-related quality of life (QoL) instruments, the 3-level EQ-5D (EQ-5D-3L) and the Health Utilities Index Mark 3 (HUI-3), by assessing them.

METHODS

Using consecutive sampling, 452 primary caregivers of patients with MS were asked to fill out a Care-related QoL instrument (CarerQol-7D), EQ-5D-3L, HUI-3, and the Center for Epidemiologic Studies Depression Scale between October 2019 and May 2020. Convergent and clinical validity were assessed to measure spillover effect in caregivers of patients with MS.

RESULTS

A strong correlation of health-utility scores between EQ-5D-3L and HUI-3 (r = 0.914, P < .01) was observed. The 95% limit of agreement (LoA) for CarerQol-7D and HUI-3 (-10.6 to 8.2) was narrower than the LoA for CarerQol-7D and EQ-5D-3L (-15.1 to 17.1). Both EQ-5D-3L and HUI-3 proved clinical validity for the QoL of caregivers. The CarerQoL-7D score was significantly lower in female (P < .001), single (P < .014), lower-educated (P < .001), parent's relatives (P < .001), and unemployed (P < .001) caregivers.

CONCLUSIONS

We found that both, EQ-5D-3L and HUI-3, were appropriate for measuring caregivers' QoL, although HUI-3 was a better choice because of its narrower LoA. Our findings suggest researchers should use HUI-3 to measure the quality-adjusted life-year of caregivers to aggregate with the QoL of patients in the denominator of an economic evaluation equation, such as the cost-effective ratio.

Diffusion-based structural connectivity patterns of multiple sclerosis phenotypes

BACKGROUND

We aimed to describe the severity of the changes in brain diffusion-based connectivity as multiple sclerosis (MS) progresses and the microstructural characteristics of these networks that are associated with distinct MS phenotypes.

METHODS

Clinical information and brain MRIs were collected from 221 healthy individuals and 823 people with MS at 8 MAGNIMS centres. The patients were divided into four clinical phenotypes: clinically isolated syndrome, relapsing-remitting, secondary progressive and primary progressive. Advanced tractography methods were used to obtain connectivity matrices. Then, differences in whole-brain and nodal graph-derived measures, and in the fractional anisotropy of connections between groups were analysed. Support vector machine algorithms were used to classify groups.

RESULTS

Clinically isolated syndrome and relapsing-remitting patients shared similar network changes relative to controls. However, most global and local network properties differed in secondary progressive patients compared with the other groups, with lower fractional anisotropy in most connections. Primary progressive participants had fewer differences in global and local graph measures compared with clinically isolated syndrome and relapsing-remitting patients, and reductions in fractional anisotropy were only evident for a few connections. The accuracy of support vector machine to discriminate patients from healthy controls based on connection was 81%, and ranged between 64% and 74% in distinguishing among the clinical phenotypes.

CONCLUSIONS

In conclusion, brain connectivity is disrupted in MS and has differential patterns according to the phenotype. Secondary progressive is associated with more widespread changes in connectivity. Additionally, classification tasks can distinguish between MS types, with subcortical connections being the most important factor.

What's your cup of tea? The role of herbal compounds in the management of multiple sclerosis

Multiple Sclerosis (MS) is a chronic, inflammatory, neurodegenerative disease that is characterized by a complex etiology. Efforts towards the management of MS have long been directed towards symptomatic relief, as well as the use of immune-modulatory, disease modifying therapies; however, inconsistent treatment responses still prevail, increasing the risk for disease progression. While a great deal of research attempted to unravel the complexity of treatment responses in light of epigenetic variability, parallel efforts in the direction of alternative medicine may be as paramount. Herbal compounds have long been regarded as safe and versatile options for aiding in various disorders, including neurodegenerative conditions like MS. Numerous studies have taken interest in a myriad of herbal plants for their potential benefit in alleviating some of the most common MS symptoms such as spasticity and fatigue, delaying the progression of the disease, as well as influencing the overall quality of life for MS patients. This review aims to provide a comprehensive overview of recent clinical studies examining the effects of various herbal plants on different aspects of MS, in an attempt to shed light on an important tool for aiding in the management of this complex and multifactorial disease.

Diagnostic performance of artificial intelligence in multiple sclerosis: a systematic review and meta-analysis

BACKGROUND

The expansion of the availability of advanced imaging methods needs more time, expertise, and resources which is in contrast to the primary goal of the imaging techniques. To overcome most of these difficulties, artificial intelligence (AI) can be used. A number of studies used AI models for multiple sclerosis (MS) diagnosis and reported diverse results. Therefore, we aim to perform a comprehensive systematic review and meta-analysis study on the role of AI in the diagnosis of MS.

METHODS

We performed a systematic search using four databases including PubMed, Scopus, Web of Science, and IEEE. Studies that applied deep learning or AI to the diagnosis of MS based on any modalities were considered eligible in our study. The accuracy, sensitivity, specificity, precision, and area under curve (AUC) were pooled with a random-effects model and 95% confidence interval (CI).

RESULTS

After the screening, 41 articles with 5989 individuals met the inclusion criteria and were included in our qualitative and quantitative synthesis. Our analysis showed that the overall accuracy among studies was 94% (95%CI: 93%, 96%). The pooled sensitivity and specificity were 92% (95%CI: 90%, 95%) and 93% (95%CI: 90%, 96%), respectively. Furthermore, our analysis showed 92% precision in MS diagnosis for AI studies (95%CI: 88%, 97%). Also, the overall pooled AUC was 93% (95%CI: 89%, 96%).

CONCLUSION

Overall, AI models can further improve our diagnostic practice in MS patients. Our results indicate that the use of AI can aid the clinicians in accurate diagnosis of MS and improve current diagnostic approaches as most of the parameters including accuracy, sensitivity, specificity, precision, and AUC were considerably high, especially when using MRI data.

Multimodal-neuroimaging machine-learning analysis of motor disability in multiple sclerosis

Motor disability is a dominant and restricting symptom in multiple sclerosis, yet its neuroimaging correlates are not fully understood. We apply statistical and machine learning techniques on multimodal neuroimaging data to discriminate between multiple sclerosis patients and healthy controls and to predict motor disability scores in the patients. We examine the data of sixty-four multiple sclerosis patients and sixty-five controls, who underwent the MRI examination and the evaluation of motor disability scales. The modalities used comprised regional fractional anisotropy, regional grey matter volumes, and functional connectivity. For analysis, we employ two approaches: high-dimensional support vector machines run on features selected by Fisher Score (aiming for maximal classification accuracy), and low-dimensional logistic regression on the principal components of data (aiming for increased interpretability). We apply analogous regression methods to predict symptom severity. While fractional anisotropy provides the classification accuracy of 96.1% and 89.9% with both approaches respectively, including other modalities did not bring further improvement. Concerning the prediction of motor impairment, the low-dimensional approach performed more reliably. The first grey matter volume component was significantly correlated (R = 0.28-0.46, p < 0.05) with most clinical scales. In summary, we identified the relationship between both white and grey matter changes and motor impairment in multiple sclerosis. Furthermore, we were able to achieve the highest classification accuracy based on quantitative MRI measures of tissue integrity between patients and controls yet reported, while also providing a low-dimensional classification approach with comparable results, paving the way to interpretable machine learning models of brain changes in multiple sclerosis.

Graph-Based Analysis of Brain Connectivity in Multiple Sclerosis Using Functional MRI: A Systematic Review

(1) Background: Multiple sclerosis (MS) is an immune system disease in which myelin in the nervous system is affected. This abnormal immune system mechanism causes physical disabilities and cognitive impairment. Functional magnetic resonance imaging (fMRI) is a common neuroimaging technique used in studying MS. Computational methods have recently been applied for disease detection, notably graph theory, which helps researchers understand the entire brain network and functional connectivity. (2) Methods: Relevant databases were searched to identify articles published since 2000 that applied graph theory to study functional brain connectivity in patients with MS based on fMRI. (3) Results: A total of 24 articles were included in the review. In recent years, the application of graph theory in the MS field received increased attention from computational scientists. The graph-theoretical approach was frequently combined with fMRI in studies of functional brain connectivity in MS. Lower EDSSs of MS stage were the criteria for most of the studies (4) Conclusions: This review provides insights into the role of graph theory as a computational method for studying functional brain connectivity in MS. Graph theory is useful in the detection and prediction of MS and can play a significant role in identifying cognitive impairment associated with MS.

NSCGCN: A novel deep GCN model to diagnosis COVID-19

AIM

Corona Virus Disease 2019 (COVID-19) was a lung disease with high mortality and was highly contagious. Early diagnosis of COVID-19 and distinguishing it from pneumonia was beneficial for subsequent treatment.

OBJECTIVES

Recently, Graph Convolutional Network (GCN) has driven a significant contribution to disease diagnosis. However, limited by the nature of the graph convolution algorithm, deep GCN has an over-smoothing problem. Most of the current GCN models are shallow neural networks, which do not exceed five layers. Furthermore, the objective of this study is to develop a novel deep GCN model based on the DenseGCN and the pre-trained model of deep Convolutional Neural Network (CNN) to complete the diagnosis of chest X-ray (CXR) images.

METHODS

We apply the pre-trained model of deep CNN to perform feature extraction on the data to complete the extraction of pixel-level features in the image. And then, to extract the potential relationship between the obtained features, we propose Neighbourhood Feature Reconstruction Algorithm to reconstruct them into graph-structured data. Finally, we design a deep GCN model that exploits the graph-structured data to diagnose COVID-19 effectively. In the deep GCN model, we propose a Node-Self Convolution Algorithm (NSC) based on feature fusion to construct a deep GCN model called NSCGCN (Node-Self Convolution Graph Convolutional Network).

RESULTS

Experiments were carried out on the Computed Tomography (CT) and CXR datasets. The results on the CT dataset confirmed that: compared with the six state-of-the-art (SOTA) shallow GCN models, the accuracy and sensitivity of the proposed NSCGCN had improve 8% as sensitivity (Sen.) = 87.50%, F1 score = 97.37%, precision (Pre.) = 89.10%, accuracy (Acc.) = 97.50%, area under the ROC curve (AUC) = 97.09%. Moreover, the results on the CXR dataset confirmed that: compared with the fourteen SOTA GCN models, sixteen SOTA CNN transfer learning models and eight SOTA COVID-19 diagnosis methods on the COVID-19 dataset. Our proposed method had best performances as Sen. = 96.45%, F1 score = 96.45%, Pre. = 96.61%, Acc. = 96.45%, AUC = 99.22%.

CONCLUSION

Our proposed NSCGCN model is effective and performed better than the thirty-eight SOTA methods. Thus, the proposed NSC could help build deep GCN models. Our proposed COVID-19 diagnosis method based on the NSCGCN model could help radiologists detect pneumonia from CXR images and distinguish COVID-19 from Ordinary Pneumonia (OPN). The source code of this work will be publicly available at https://github.com/TangChaosheng/NSCGCN.

Multiple Sclerosis Diagnosis Using Machine Learning and Deep Learning: Challenges and Opportunities

Multiple Sclerosis (MS) is a disease that impacts the central nervous system (CNS), which can lead to brain, spinal cord, and optic nerve problems. A total of 2.8 million are estimated to suffer from MS. Globally, a new case of MS is reported every five minutes. In this review, we discuss the proposed approaches to diagnosing MS using machine learning (ML) published between 2011 and 2022. Numerous models have been developed using different types of data, including magnetic resonance imaging (MRI) and clinical data. We identified the methods that achieved the best results in diagnosing MS. The most implemented approaches are SVM, RF, and CNN. Moreover, we discussed the challenges and opportunities in MS diagnosis to improve AI systems to enable researchers and practitioners to enhance their approaches and improve the automated diagnosis of MS. The challenges faced by automated MS diagnosis include difficulty distinguishing the disease from other diseases showing similar symptoms, protecting the confidentiality of the patients' data, achieving reliable ML models that are also easily understood by non-experts, and the difficulty of collecting a large reliable dataset. Moreover, we discussed several opportunities in the field such as the implementation of secure platforms, employing better AI solutions, developing better disease prognosis systems, combining more than one data type for better MS prediction and using OCT data for diagnosis, utilizing larger, multi-center datasets to improve the reliability of the developed models, and commercialization.

Classification of multiple sclerosis clinical profiles using machine learning and grey matter connectome

Purpose: The main goal of this study is to investigate the discrimination power of Grey Matter (GM) thickness connectome data between Multiple Sclerosis (MS) clinical profiles using statistical and Machine Learning (ML) methods.

Materials and Methods: A dataset composed of 90 MS patients acquired at the MS clinic of Lyon Neurological Hospital was used for the analysis. Four MS profiles were considered, corresponding to Clinical Isolated Syndrome (CIS), Relapsing-Remitting MS (RRMS), Secondary Progressive MS (SPMS), and Primary Progressive MS (PPMS). Each patient was classified in one of these profiles by our neurologist and underwent longitudinal MRI examinations including T1-weighted image acquisition at each examination, from which the GM tissue was segmented and the cortical GM thickness measured. Following the GM parcellation using two different atlases (FSAverage and Glasser 2016), the morphological connectome was built and six global metrics (Betweenness Centrality (BC), Assortativity (r), Transitivity (T), Efficiency (E_g), Modularity (Q) and Density (D)) were extracted. Based on their connectivity metrics, MS profiles were first statistically compared and second, classified using four different learning machines (Logistic Regression, Random Forest, Support Vector Machine and AdaBoost), combined in a higher level ensemble model by majority voting. Finally, the impact of the GM spatial resolution on the MS clinical profiles classification was analyzed.

Results: Using binary comparisons between the four MS clinical profiles, statistical differences and classification performances higher than 0.7 were observed. Good performances were obtained when comparing the two early clinical forms, RRMS and PPMS (F1 score of 0.86), and the two neurodegenerative profiles, PPMS and SPMS (F1 score of 0.72). When comparing the two atlases, slightly better performances were obtained with the Glasser 2016 atlas, especially between RRMS with PPMS (F1 score of 0.83), compared to the FSAverage atlas (F1 score of 0.69). Also, the thresholding value for graph binarization was investigated suggesting more informative graph properties in the percentile range between 0.6 and 0.8.

Conclusion: An automated pipeline was proposed for the classification of MS clinical profiles using six global graph metrics extracted from the GM morphological connectome of MS patients. This work demonstrated that GM morphological connectivity data could provide good classification performances by combining four simple ML models, without the cost of long and complex MR techniques, such as MR diffusion, and/or deep learning architectures.

Efficacy of Transcranial Direct Current Stimulation (tDCS) on Balance and Gait in Multiple Sclerosis Patients: A Machine Learning Approach

Transcranial direct current stimulation (tDCS) has emerged as an appealing rehabilitative approach to improve brain function, with promising data on gait and balance in people with multiple sclerosis (MS). However, single variable weights have not yet been adequately assessed. Hence, the aim of this pilot randomized controlled trial was to evaluate the tDCS effects on balance and gait in patients with MS through a machine learning approach. In this pilot randomized controlled trial (RCT), we included people with relapsing−remitting MS and an Expanded Disability Status Scale >1 and <5 that were randomly allocated to two groups—a study group, undergoing a 10-session anodal motor cortex tDCS, and a control group, undergoing a sham treatment. Both groups underwent a specific balance and gait rehabilitative program. We assessed as outcome measures the Berg Balance Scale (BBS), Fall Risk Index and timed up-and-go and 6-min-walking tests at baseline (T0), the end of intervention (T1) and 4 (T2) and 6 weeks after the intervention (T3) with an inertial motion unit. At each time point, we performed a multiple factor analysis through a machine learning approach to allow the analysis of the influence of the balance and gait variables, grouping the participants based on the results. Seventeen MS patients (aged 40.6 ± 14.4 years), 9 in the study group and 8 in the sham group, were included. We reported a significant repeated measures difference between groups for distances covered (6MWT (meters), p < 0.03). At T1, we showed a significant increase in distance (m) with a mean difference (MD) of 37.0 [−59.0, 17.0] (p = 0.003), and in BBS with a MD of 2.0 [−4.0, 3.0] (p = 0.03). At T2, these improvements did not seem to be significantly maintained; however, considering the machine learning analysis, the Silhouette Index of 0.34, with a low cluster overlap trend, confirmed the possible short-term effects (T2), even at 6 weeks. Therefore, this pilot RCT showed that tDCS may provide non-sustained improvements in gait and balance in MS patients. In this scenario, machine learning could suggest evidence of prolonged beneficial effects.

Role of artificial intelligence in MS clinical practice

•

For medical applications, machine learning (including deep learning) are the most commonly used artificial intelligence (AI) approaches.

•

It can improve multiple sclerosis (MS) diagnosis, prognostication and treatment monitoring.

•

Thanks to AI, MRI and cognitive phenotypes of MS patients were identified.

•

AI can shorten MRI protocols for MS, allowing the application of advanced techniques.

•

It can reduce the human effort for MRI analysis, especially for lesion segmentation.

Machine learning (ML) and its subset, deep learning (DL), are branches of artificial intelligence (AI) showing promising findings in the medical field, especially when applied to imaging data. Given the substantial role of MRI in the diagnosis and management of patients with multiple sclerosis (MS), this disease is an ideal candidate for the application of AI techniques. In this narrative review, we are going to discuss the potential applications of AI for MS clinical practice, together with their limitations. Among their several advantages, ML algorithms are able to automate repetitive tasks, to analyze more data in less time and to achieve higher accuracy and reproducibility than the human counterpart. To date, these algorithms have been applied to MS diagnosis, prognosis, disease and treatment monitoring. Other fields of application have been improvement of MRI protocols as well as automated lesion and tissue segmentation. However, several challenges remain, including a better understanding of the information selected by AI algorithms, appropriate multicenter and longitudinal validations of results and practical aspects regarding hardware and software integration. Finally, one cannot overemphasize the paramount importance of human supervision, in order to optimize the use and take full advantage of the potential of AI approaches.

MAGNIMS recommendations for harmonization of MRI data in MS multicenter studies

•

Sharing data from cooperative studies is essential to develop new biomarkers in MS.

•

Differences in MRI acquisition, analysis, storage represent a substantial constraint.

•

We review the state of the art and developments in the harmonization of MRI.

•

We provide recommendations to harmonize large MRI datasets in the MS field.

There is an increasing need of sharing harmonized data from large, cooperative studies as this is essential to develop new diagnostic and prognostic biomarkers. In the field of multiple sclerosis (MS), the issue has become of paramount importance due to the need to translate into the clinical setting some of the most recent MRI achievements. However, differences in MRI acquisition parameters, image analysis and data storage across sites, with their potential bias, represent a substantial constraint. This review focuses on the state of the art, recent technical advances, and desirable future developments of the harmonization of acquisition, analysis and storage of large-scale multicentre MRI data of MS cohorts. Huge efforts are currently being made to achieve all the requirements needed to provide harmonized MRI datasets in the MS field, as proper management of large imaging datasets is one of our greatest opportunities and challenges in the coming years. Recommendations based on these achievements will be provided here. Despite the advances that have been made, the complexity of these tasks requires further research by specialized academical centres, with dedicated technical and human resources. Such collective efforts involving different professional figures are of crucial importance to offer to MS patients a personalised management while minimizing consumption of resources.

An Accurate Multiple Sclerosis Detection Model Based on Exemplar Multiple Parameters Local Phase Quantization: ExMPLPQ

Multiple sclerosis (MS) is a chronic demyelinating condition characterized by plaques in the white matter of the central nervous system that can be detected using magnetic resonance imaging (MRI). Many deep learning models for automated MS detection based on MRI have been presented in the literature. We developed a computationally lightweight machine learning model for MS diagnosis using a novel handcrafted feature engineering approach. The study dataset comprised axial and sagittal brain MRI images that were prospectively acquired from 72 MS and 59 healthy subjects who attended the Ozal University Medical Faculty in 2021. The dataset was divided into three study subsets: axial images only (n = 1652), sagittal images only (n = 1775), and combined axial and sagittal images (n = 3427) of both MS and healthy classes. All images were resized to 224 × 224. Subsequently, the features were generated with a fixed-size patch-based (exemplar) feature extraction model based on local phase quantization (LPQ) with three-parameter settings. The resulting exemplar multiple parameters LPQ (ExMPLPQ) features were concatenated to form a large final feature vector. The top discriminative features were selected using iterative neighborhood component analysis (INCA). Finally, a k-nearest neighbor (kNN) algorithm, Fine kNN, was deployed to perform binary classification of the brain images into MS vs. healthy classes. The ExMPLPQ-based model attained 98.37%, 97.75%, and 98.22% binary classification accuracy rates for axial, sagittal, and hybrid datasets, respectively, using Fine kNN with 10-fold cross-validation. Furthermore, our model outperformed 19 established pre-trained deep learning models that were trained and tested with the same data. Unlike deep models, the ExMPLPQ-based model is computationally lightweight yet highly accurate. It has the potential to be implemented as an automated diagnostic tool to screen brain MRIs for white matter lesions in suspected MS patients.

Early Diagnosis of Multiple Sclerosis Using Swept-Source Optical Coherence Tomography and Convolutional Neural Networks Trained with Data Augmentation

BACKGROUND

The aim of this paper is to implement a system to facilitate the diagnosis of multiple sclerosis (MS) in its initial stages. It does so using a convolutional neural network (CNN) to classify images captured with swept-source optical coherence tomography (SS-OCT).

METHODS

SS-OCT images from 48 control subjects and 48 recently diagnosed MS patients have been used. These images show the thicknesses (45 × 60 points) of the following structures: complete retina, retinal nerve fiber layer, two ganglion cell layers (GCL+, GCL++) and choroid. The Cohen distance is used to identify the structures and the regions within them with greatest discriminant capacity. The original database of OCT images is augmented by a deep convolutional generative adversarial network to expand the CNN's training set.

RESULTS

The retinal structures with greatest discriminant capacity are the GCL++ (44.99% of image points), complete retina (26.71%) and GCL+ (22.93%). Thresholding these images and using them as inputs to a CNN comprising two convolution modules and one classification module obtains sensitivity = specificity = 1.0.

CONCLUSIONS

Feature pre-selection and the use of a convolutional neural network may be a promising, nonharmful, low-cost, easy-to-perform and effective means of assisting the early diagnosis of MS based on SS-OCT thickness data.

Ocular manifestations of multiple sclerosis in patients from three countries: A Web-based survey

OBJECTIVE

This study evaluates the epidemiological characteristics, ophthalmological manifestations, and different therapeutic options available for patients with multiple sclerosis (MS) in China, Spain, and Cuba.

METHODS

A self-designed questionnaire was used to conduct a comparable descriptive cross-sectional study on patients with MS. The survey included patients' demographic data, ocular manifestations related to MS, and treatment methodology followed in the three countries. The online survey was designed using the Wenjuanxing survey platform, and a survey link was circulated through WhatsApp, WeChat, and emails. Quantitative data were expressed as mean and standard deviation, the Kruskal-Wallis test was used for non-parametric variables. Qualitative data were expressed as numerical and percentage. The chi-square test (χ²) was used to compare the group's response categories. The statistical difference was considered significant when p < 0.05.

RESULTS

The female-to-male ratio in all the three countries was 2-3:1, and relapsing-remitting MS (RRMS) was the most frequent in all three countries. Vision loss was slow and progressive in half of the patients from the three countries, with no significant differences (p = 0.524). A higher percentage of steroid treatment was observed in Chinese patients in comparison with the patients from other two countries (p < 0.001), and a similar trend was seen in the use of traditional medicines. Almost one-third of patients who did not receive any treatment recovered spontaneously in all the three countries (p = 0.097).

CONCLUSIONS

MS occurs more frequently in the relapsing-remitting clinical form and there is a clear female predominance. The first ocular crisis or clinical debut of MS is characterized by slow and progressive visual impairment, increasing and adding to other ocular manifestations during its evolutionary course. Spontaneous recovery of vision after an attack of optic neuritis in the course of MS is possible.

Emerging deep learning techniques using magnetic resonance imaging data applied in multiple sclerosis and clinical isolated syndrome patients (Review)

Computer-aided diagnosis systems aim to assist clinicians in the early identification of abnormal signs in order to optimize the interpretation of medical images and increase diagnostic precision. Multiple sclerosis (MS) and clinically isolated syndrome (CIS) are chronic inflammatory, demyelinating diseases affecting the central nervous system. Recent advances in deep learning (DL) techniques have led to novel computational paradigms in MS and CIS imaging designed for automatic segmentation and detection of areas of interest and automatic classification of anatomic structures, as well as optimization of neuroimaging protocols. To this end, there are several publications presenting artificial intelligence-based predictive models aiming to increase diagnostic accuracy and to facilitate optimal clinical management in patients diagnosed with MS and/or CIS. The current study presents a thorough review covering DL techniques that have been applied in MS and CIS during recent years, shedding light on their current advances and limitations.

Applications of deep learning techniques for automated multiple sclerosis detection using magnetic resonance imaging: A review

Multiple Sclerosis (MS) is a type of brain disease which causes visual, sensory, and motor problems for people with a detrimental effect on the functioning of the nervous system. In order to diagnose MS, multiple screening methods have been proposed so far; among them, magnetic resonance imaging (MRI) has received considerable attention among physicians. MRI modalities provide physicians with fundamental information about the structure and function of the brain, which is crucial for the rapid diagnosis of MS lesions. Diagnosing MS using MRI is time-consuming, tedious, and prone to manual errors. Research on the implementation of computer aided diagnosis system (CADS) based on artificial intelligence (AI) to diagnose MS involves conventional machine learning and deep learning (DL) methods. In conventional machine learning, feature extraction, feature selection, and classification steps are carried out by using trial and error; on the contrary, these steps in DL are based on deep layers whose values are automatically learn. In this paper, a complete review of automated MS diagnosis methods performed using DL techniques with MRI neuroimaging modalities is provided. Initially, the steps involved in various CADS proposed using MRI modalities and DL techniques for MS diagnosis are investigated. The important preprocessing techniques employed in various works are analyzed. Most of the published papers on MS diagnosis using MRI modalities and DL are presented. The most significant challenges facing and future direction of automated diagnosis of MS using MRI modalities and DL techniques are also provided.

Interpretable deep learning as a means for decrypting disease signature in multiple sclerosis

Objective.The mechanisms driving multiple sclerosis (MS) are still largely unknown, calling for new methods allowing to detect and characterize tissue degeneration since the early stages of the disease. Our aim is to decrypt the microstructural signatures of the Primary Progressive versus the Relapsing-Remitting state of disease based on diffusion and structural magnetic resonance imaging data.Approach.A selection of microstructural descriptors, based on the 3D-Simple Harmonics Oscillator Based Reconstruction and Estimation and the set of new algebraically independent Rotation Invariant spherical harmonics Features, was considered and used to feed convolutional neural networks (CNNs) models. Classical measures derived from diffusion tensor imaging, that are fractional anisotropy and mean diffusivity, were used as benchmark for diffusion MRI (dMRI). Finally, T1-weighted images were also considered for the sake of comparison with the state-of-the-art. A CNN model was fit to each feature map and layerwise relevance propagation (LRP) heatmaps were generated for each model, target class and subject in the test set. Average heatmaps were calculated across correctly classified patients and size-corrected metrics were derived on a set of regions of interest to assess the LRP contrast between the two classes.Main results.Our results demonstrated that dMRI features extracted in grey matter tissues can help in disambiguating primary progressive multiple sclerosis from relapsing-remitting multiple sclerosis patients and, moreover, that LRP heatmaps highlight areas of high relevance which relate well with what is known from literature for MS disease.Significance.Within a patient stratification task, LRP allows detecting the input voxels that mostly contribute to the classification of the patients in either of the two classes for each feature, potentially bringing to light hidden data properties which might reveal peculiar disease-state factors.

Ensemble Learning for Multiple Sclerosis Disability Estimation Using Brain Structural Connectivity

BACKGROUND

Multiple Sclerosis (MS) is an autoimmune inflammatory disease of the central nervous system characterized by demyelination and neurodegeneration processes. It leads to different clinical courses and degrees of disability that need to be anticipated by the neurologist for personalized therapy. Recently, machine learning (ML) techniques have reached a high level of performance in brain disease diagnosis and/or prognosis, but the decision process of a trained ML system is typically non-transparent. Using brain structural connectivity data, a fully automatic ensemble learning model, augmented with an interpretable model, is proposed for the estimation of MS patients' disability, measured by the Expanded Disability Status Scale (EDSS).

METHOD

An ensemble of four boosting-based models (GBM, XGBoost, CatBoost, LightBoost) organized following a stacking generalization scheme, was developed using DTI-based structural connectivity data. In addition, an interpretable model based on conditional logistic regression was developed to explain the best performances in terms of white matter (WM) links for three classes of EDSS (Low, Medium, High).

RESULTS

The ensemble model reached excellent level of performance (RMSE of 0.92 ± 0.28) compared to single-based models and provided a better EDSS estimation using DTI-based structural connectivity data compared to conventional MRI measures associated with patient data (age, gender and disease duration). Used for interpretation of the estimation process, the counterfactual method showed the importance of certain brain networks, corresponding mainly to left hemisphere WM links, connecting the left superior temporal with the left posterior cingulate and the right precuneus gray matter regions, and the inter-hemispheric WM links constituting the corpus callosum. Also, a better accuracy estimation was found for the high disability class.

CONCLUSION

The combination of advanced ML models and sensitive techniques such as DTI-based structural connectivity demonstrated to be useful for the estimation of MS patients' disability and to point out the most important brain WM networks involved in disability.

Biological network analysis with deep learning

Recent advancements in experimental high-throughput technologies have expanded the availability and quantity of molecular data in biology. Given the importance of interactions in biological processes, such as the interactions between proteins or the bonds within a chemical compound, this data is often represented in the form of a biological network. The rise of this data has created a need for new computational tools to analyze networks. One major trend in the field is to use deep learning for this goal and, more specifically, to use methods that work with networks, the so-called graph neural networks (GNNs). In this article, we describe biological networks and review the principles and underlying algorithms of GNNs. We then discuss domains in bioinformatics in which graph neural networks are frequently being applied at the moment, such as protein function prediction, protein-protein interaction prediction and in silico drug discovery and development. Finally, we highlight application areas such as gene regulatory networks and disease diagnosis where deep learning is emerging as a new tool to answer classic questions like gene interaction prediction and automatic disease prediction from data.

Biological network analysis with deep learning

Recent advancements in experimental high-throughput technologies have expanded the availability and quantity of molecular data in biology. Given the importance of interactions in biological processes, such as the interactions between proteins or the bonds within a chemical compound, this data is often represented in the form of a biological network. The rise of this data has created a need for new computational tools to analyze networks. One major trend in the field is to use deep learning for this goal and, more specifically, to use methods that work with networks, the so-called graph neural networks (GNNs). In this article, we describe biological networks and review the principles and underlying algorithms of GNNs. We then discuss domains in bioinformatics in which graph neural networks are frequently being applied at the moment, such as protein function prediction, protein-protein interaction prediction and in silico drug discovery and development. Finally, we highlight application areas such as gene regulatory networks and disease diagnosis where deep learning is emerging as a new tool to answer classic questions like gene interaction prediction and automatic disease prediction from data.

Grad-CAM helps interpret the deep learning models trained to classify multiple sclerosis types using clinical brain magnetic resonance imaging

BACKGROUND

Deep learning using convolutional neural networks (CNNs) has shown great promise in advancing neuroscience research. However, the ability to interpret the CNNs lags far behind, confounding their clinical translation.

NEW METHOD

We interrogated 3 heatmap-generating techniques that have increasing generalizability for CNN interpretation: class activation mapping (CAM), gradient (Grad)-CAM, and Grad-CAM++. To investigate the impact of CNNs on heatmap generation, we also examined 6 different models trained to classify brain magnetic resonance imaging into 3 types: relapsing-remitting multiple sclerosis (RRMS), secondary progressive MS (SPMS), and control. Further, we designed novel methods to visualize and quantify the heatmaps to improve interpretability.

RESULTS

Grad-CAM showed the best heatmap localizing ability, and CNNs with a global average pooling layer and pretrained weights had the best classification performance. Based on the best-performing CNN model, called VGG19, the 95th percentile values of Grad-CAM in SPMS were significantly higher than RRMS, indicating greater heterogeneity. Further, voxel-wise analysis of the thresholded Grad-CAM confirmed the difference identified visually between RRMS and SPMS in discriminative brain regions: occipital versus frontal and occipital, or temporal/parietal.

COMPARISON WITH EXISTING METHODS

No study has examined the CAM methods together using clinical images. There is also lack of study on the impact of CNN architecture on heatmap outcomes, and of technologies to quantify heatmap patterns in clinical settings.

CONCLUSIONS

Grad-CAM outperforms CAM and Grad-CAM++. Integrating Grad-CAM, novel heatmap quantification approaches, and robust CNN models may be an effective strategy in identifying the most crucial brain areas underlying disease development in MS.

Investigation of Deep-Learning-Driven Identification of Multiple Sclerosis Patients Based on Susceptibility-Weighted Images Using Relevance Analysis

The diagnosis of multiple sclerosis (MS) is usually based on clinical symptoms and signs of damage to the central nervous system, which is assessed using magnetic resonance imaging. The correct interpretation of these data requires excellent clinical expertise and experience. Deep neural networks aim to assist clinicians in identifying MS using imaging data. However, before such networks can be integrated into clinical workflow, it is crucial to understand their classification strategy. In this study, we propose to use a convolutional neural network to identify MS patients in combination with attribution algorithms to investigate the classification decisions. The network was trained using images acquired with susceptibility-weighted imaging (SWI), which is known to be sensitive to the presence of paramagnetic iron components and is routinely applied in imaging protocols for MS patients. Different attribution algorithms were used to the trained network resulting in heatmaps visualizing the contribution of each input voxel to the classification decision. Based on the quantitative image perturbation method, we selected DeepLIFT heatmaps for further investigation. Single-subject analysis revealed veins and adjacent voxels as signs for MS, while the population-based study revealed relevant brain areas common to most subjects in a class. This pattern was found to be stable across different echo times and also for a multi-echo trained network. Intensity analysis of the relevant voxels revealed a group difference, which was found to be primarily based on the T1w magnitude images, which are part of the SWI calculation. This difference was not observed in the phase mask data.

Deep learning for brain disorders: from data processing to disease treatment

In order to reach precision medicine and improve patients' quality of life, machine learning is increasingly used in medicine. Brain disorders are often complex and heterogeneous, and several modalities such as demographic, clinical, imaging, genetics and environmental data have been studied to improve their understanding. Deep learning, a subpart of machine learning, provides complex algorithms that can learn from such various data. It has become state of the art in numerous fields, including computer vision and natural language processing, and is also growingly applied in medicine. In this article, we review the use of deep learning for brain disorders. More specifically, we identify the main applications, the concerned disorders and the types of architectures and data used. Finally, we provide guidelines to bridge the gap between research studies and clinical routine.

Artificial intelligence for brain diseases: A systematic review

Artificial intelligence (AI) is a major branch of computer science that is fruitfully used for analyzing complex medical data and extracting meaningful relationships in datasets, for several clinical aims. Specifically, in the brain care domain, several innovative approaches have achieved remarkable results and open new perspectives in terms of diagnosis, planning, and outcome prediction. In this work, we present an overview of different artificial intelligent techniques used in the brain care domain, along with a review of important clinical applications. A systematic and careful literature search in major databases such as Pubmed, Scopus, and Web of Science was carried out using "artificial intelligence" and "brain" as main keywords. Further references were integrated by cross-referencing from key articles. 155 studies out of 2696 were identified, which actually made use of AI algorithms for different purposes (diagnosis, surgical treatment, intra-operative assistance, and postoperative assessment). Artificial neural networks have risen to prominent positions among the most widely used analytical tools. Classic machine learning approaches such as support vector machine and random forest are still widely used. Task-specific algorithms are designed for solving specific problems. Brain images are one of the most used data types. AI has the possibility to improve clinicians' decision-making ability in neuroscience applications. However, major issues still need to be addressed for a better practical use of AI in the brain. To this aim, it is important to both gather comprehensive data and build explainable AI algorithms.

Diverse Applications of Artificial Intelligence in Neuroradiology

Recent advances in artificial intelligence (AI) and deep learning (DL) hold promise to augment neuroimaging diagnosis for patients with brain tumors and stroke. Here, the authors review the diverse landscape of emerging neuroimaging applications of AI, including workflow optimization, lesion segmentation, and precision education. Given the many modalities used in diagnosing neurologic diseases, AI may be deployed to integrate across modalities (MR imaging, computed tomography, PET, electroencephalography, clinical and laboratory findings), facilitate crosstalk among specialists, and potentially improve diagnosis in patients with trauma, multiple sclerosis, epilepsy, and neurodegeneration. Together, there are myriad applications of AI for neuroradiology."

Inferring Multiple Sclerosis Stages from the Blood Transcriptome via Machine Learning

Peripheral blood mononuclear cells (PBMCs) bear specific dysregulations in genes and pathways at distinct stages of multiple sclerosis (MS) that may help with classifying MS and non-MS subjects, specifying the early stage of disease, or discriminating among MS courses. Here we describe an unbiased machine learning workflow to build MS stage-specific classifiers based on PBMC transcriptomics profiles from more than 300 individuals, including healthy subjects and patients with clinically isolated syndromes, relapsing-remitting MS, primary or secondary progressive MS, or other neurological disorders. The pipeline, designed to optimize and compare the performance of distinct machine learning algorithms in the training cohort, generates predictive models not influenced by demographic features, such as age and gender, and displays high accuracy in the independent validation cohort. Proper application of machine learning to transcriptional profiles of circulating blood cells may allow identification of disease state and stage in MS.

Generated PBMC transcriptomes from multiple sclerosis and control subjects

Unbiased machine learning workflow allows algorithm comparison and optimization

Classifiers built on training cohort have high accuracy in the independent test set

PBMC transcriptomes identify disease state and stage in multiple sclerosis

Connection of miR-185 and miR-320a expression levels with response to interferon-beta in multiple sclerosis patients

BACKGROUND

Multiple sclerosis (MS) is an inflammatory autoimmune disease characterized by neurodegeneration in the CNS. Interferon-beta (IFN-β) is an FDA-approved drug used as the first-line treatment for relapse-remitting multiple sclerosis (RRMS). The exact mechanism of IFN-β during the treatment of RRMS still remains unknown. Recently, many studies have shifted towards the role of miRNAs in the treatment of MS patients.

METHODS

Herein, the expression level of miR-185-5p and miR-320a has been evaluated in order to candidate them as novel biomarkers for monitoring the response to IFN-β therapy. For this purpose, one-hundred whole blood samples from patients with RRMS were collected, consisting of 50 responders and 50 non-responders to IFN-β therapy. To predict the possible molecular mechanisms of IFN-β and highlight the role of these miRNAs, in silico analysis was applied to enrich the signaling pathways which may be involved based on the target genes of miR-185-5p and miR-320a.

RESULTS

It is identified that the differentially expressed miR-185-5p was statistically significant between the two treated groups with IFN-β. Furthermore, MAPK signaling pathway was suggested as the main non-canonical pathway involved in IFN-β therapy.

CONCLUSION

miR-185-5p could be considered as a novel biomarker for monitoring the response to IFN-β therapy.

CVSnet: A machine learning approach for automated central vein sign assessment in multiple sclerosis

The central vein sign (CVS) is an efficient imaging biomarker for multiple sclerosis (MS) diagnosis, but its application in clinical routine is limited by inter-rater variability and the expenditure of time associated with manual assessment. We describe a deep learning-based prototype for automated assessment of the CVS in white matter MS lesions using data from three different imaging centers. We retrospectively analyzed data from 3 T magnetic resonance images acquired on four scanners from two different vendors, including adults with MS (n = 42), MS mimics (n = 33, encompassing 12 distinct neurological diseases mimicking MS) and uncertain diagnosis (n = 5). Brain white matter lesions were manually segmented on FLAIR* images. Perivenular assessment was performed according to consensus guidelines and used as ground truth, yielding 539 CVS-positive (CVS⁺ ) and 448 CVS-negative (CVS^- ) lesions. A 3D convolutional neural network ("CVSnet") was designed and trained on 47 datasets, keeping 33 for testing. FLAIR* lesion patches of CVS⁺ /CVS^- lesions were used for training and validation (n = 375/298) and for testing (n = 164/150). Performance was evaluated lesion-wise and subject-wise and compared with a state-of-the-art vesselness filtering approach through McNemar's test. The proposed CVSnet approached human performance, with lesion-wise median balanced accuracy of 81%, and subject-wise balanced accuracy of 89% on the validation set, and 91% on the test set. The process of CVS assessment, in previously manually segmented lesions, was ~ 600-fold faster using the proposed CVSnet compared with human visual assessment (test set: 4 seconds vs. 40 minutes). On the validation and test sets, the lesion-wise performance outperformed the vesselness filter method (P < 0.001). The proposed deep learning prototype shows promising performance in differentiating MS from its mimics. Our approach was evaluated using data from different hospitals, enabling larger multicenter trials to evaluate the benefit of introducing the CVS marker into MS diagnostic criteria.

Considering patient clinical history impacts performance of machine learning models in predicting course of multiple sclerosis

Multiple Sclerosis (MS) progresses at an unpredictable rate, but predictions on the disease course in each patient would be extremely useful to tailor therapy to the individual needs. We explore different machine learning (ML) approaches to predict whether a patient will shift from the initial Relapsing-Remitting (RR) to the Secondary Progressive (SP) form of the disease, using only "real world" data available in clinical routine. The clinical records of 1624 outpatients (207 in the SP phase) attending the MS service of Sant'Andrea hospital, Rome, Italy, were used. Predictions at 180, 360 or 720 days from the last visit were obtained considering either the data of the last available visit (Visit-Oriented setting), comparing four classical ML methods (Random Forest, Support Vector Machine, K-Nearest Neighbours and AdaBoost) or the whole clinical history of each patient (History-Oriented setting), using a Recurrent Neural Network model, specifically designed for historical data. Missing values were handled by removing either all clinical records presenting at least one missing parameter (Feature-saving approach) or the 3 clinical parameters which contained missing values (Record-saving approach). The performances of the classifiers were rated using common indicators, such as Recall (or Sensitivity) and Precision (or Positive predictive value). In the visit-oriented setting, the Record-saving approach yielded Recall values from 70% to 100%, but low Precision (5% to 10%), which however increased to 50% when considering only predictions for which the model returned a probability above a given "confidence threshold". For the History-oriented setting, both indicators increased as prediction time lengthened, reaching values of 67% (Recall) and 42% (Precision) at 720 days. We show how "real world" data can be effectively used to forecast the evolution of MS, leading to high Recall values and propose innovative approaches to improve Precision towards clinically useful values.