1
|
Pilehvari S, Morgan Y, Peng W. An analytical review on the use of artificial intelligence and machine learning in diagnosis, prediction, and risk factor analysis of multiple sclerosis. Mult Scler Relat Disord 2024; 89:105761. [PMID: 39018642 DOI: 10.1016/j.msard.2024.105761] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Revised: 06/19/2024] [Accepted: 07/04/2024] [Indexed: 07/19/2024]
Abstract
Medical research offers potential for disease prediction, like Multiple Sclerosis (MS). This neurological disorder damages nerve cell sheaths, with treatments focusing on symptom relief. Manual MS detection is time-consuming and error prone. Though MS lesion detection has been studied, limited attention has been paid to clinical analysis and computational risk factor prediction. Artificial intelligence (AI) techniques and Machine Learning (ML) methods offer accurate and effective alternatives to mapping MS progression. However, there are challenges in accessing clinical data and interdisciplinary collaboration. By analyzing 103 papers, we recognize the trends, strengths and weaknesses of AI, ML, and statistical methods applied to MS diagnosis. AI/ML-based approaches are suggested to identify MS risk factors, select significant MS features, and improve the diagnostic accuracy, such as Rule-based Fuzzy Logic (RBFL), Adaptive Fuzzy Inference System (ANFIS), Artificial Neural Network methods (ANN), Support Vector Machine (SVM), and Bayesian Networks (BNs). Meanwhile, applications of the Expanded Disability Status Scale (EDSS) and Magnetic Resonance Imaging (MRI) can enhance MS diagnostic accuracy. By examining established risk factors like obesity, smoking, and education, some research tackled the issue of disease progression. The performance metrics varied across different aspects of MS studies: Diagnosis: Sensitivity ranged from 60 % to 98 %, specificity from 60 % to 98 %, and accuracy from 61 % to 97 %. Prediction: Sensitivity ranged from 76 % to 98 %, specificity from 65 % to 98 %, and accuracy from 62 % to 99 %. Segmentation: Accuracy ranged up to 96.7 %. Classification: Sensitivity ranged from 78 % to 97.34 %, specificity from 65 % to 99.32 %, and accuracy from 71 % to 97.94 %. Furthermore, the literature shows that combining techniques can improve efficiency, exploiting their strengths for better overall performance.
Collapse
Affiliation(s)
- Shima Pilehvari
- University of Regina, 3737 Wascana Parkway, Regina, SK, S4S 0A2, Canada
| | - Yasser Morgan
- University of Regina, 3737 Wascana Parkway, Regina, SK, S4S 0A2, Canada
| | - Wei Peng
- University of Regina, 3737 Wascana Parkway, Regina, SK, S4S 0A2, Canada.
| |
Collapse
|
2
|
Aghababaei A, Arian R, Soltanipour A, Ashtari F, Rabbani H, Kafieh R. Discrimination of multiple sclerosis using scanning laser ophthalmoscopy images with autoencoder-based feature extraction. Mult Scler Relat Disord 2024; 88:105743. [PMID: 38945032 DOI: 10.1016/j.msard.2024.105743] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2024] [Accepted: 06/20/2024] [Indexed: 07/02/2024]
Abstract
OBJECTIVE Optical coherence tomography (OCT) investigations have revealed that the thickness of inner retinal layers becomes decreased in multiple sclerosis (MS) patients, compared to healthy control (HC) individuals. To date, a number of studies have applied machine learning to OCT thickness measurements, aiming to enable accurate and automated diagnosis of the disease. However, there have much less emphasis on other less common retinal imaging modalities, like infrared scanning laser ophthalmoscopy (IR-SLO), for classifying MS. IR-SLO uses laser light to capture high-resolution fundus images, often performed in conjunction with OCT to lock B-scans at a fixed position. METHODS We incorporated two independent datasets of IR-SLO images from the Isfahan and Johns Hopkins centers, consisting of 164 MS and 150 HC images. A subject-wise data splitting approach was employed to ensure that there was no leakage between training and test datasets. Several state-of-the-art convolutional neural networks (CNNs), including VGG-16, VGG-19, ResNet-50, and InceptionV3, and a CNN with a custom architecture were employed. In the next step, we designed a convolutional autoencoder (CAE) to extract semantic features subsequently given as inputs to four conventional ML classifiers, including support vector machine (SVM), k-nearest neighbor (K-NN), random forest (RF), and multi-layer perceptron (MLP). RESULTS The custom CNN (85 % accuracy, 85 % sensitivity, 87 % specificity, 93 % area under the receiver operating characteristics [AUROC], and 94 % area under the precision-recall curve [AUPRC]) outperformed state-of-the-art models (84 % accuracy, 83 % sensitivity, 87 % specificity, 92 % AUROC, and 94 % AUPRC); however, utilizing a combination of the CAE and MLP yields even superior results (88 % accuracy, 86 % sensitivity, 91 % specificity, 94 % AUROC, and 95 % AUPRC). CONCLUSIONS We utilized IR-SLO images to differentiate between MS and HC eyes, with promising results achieved using a combination of CAE and MLP. Future multi-center studies involving more heterogenous data are necessary to assess the feasibility of integrating IR-SLO images into routine clinical practice.
Collapse
Affiliation(s)
- Ali Aghababaei
- Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran; School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Roya Arian
- Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Asieh Soltanipour
- Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Fereshteh Ashtari
- Isfahan Neurosciences Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Hossein Rabbani
- Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Raheleh Kafieh
- Department of Engineering, Durham University, South Road, Durham, UK.
| |
Collapse
|
3
|
Arian R, Aghababaei A, Soltanipour A, Khodabandeh Z, Rakhshani S, Iyer SB, Ashtari F, Rabbani H, Kafieh R. SLO-Net: Enhancing Multiple Sclerosis Diagnosis Beyond Optical Coherence Tomography Using Infrared Reflectance Scanning Laser Ophthalmoscopy Images. Transl Vis Sci Technol 2024; 13:13. [PMID: 39017629 PMCID: PMC11262482 DOI: 10.1167/tvst.13.7.13] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Accepted: 04/27/2024] [Indexed: 07/18/2024] Open
Abstract
Purpose Several machine learning studies have used optical coherence tomography (OCT) for multiple sclerosis (MS) classification with promising outcomes. Infrared reflectance scanning laser ophthalmoscopy (IR-SLO) captures high-resolution fundus images, commonly combined with OCT for fixed B-scan positions. However, no machine learning research has utilized IR-SLO images for automated MS diagnosis. Methods This study utilized a dataset comprised of IR-SLO images and OCT data from Isfahan, Iran, encompassing 32 MS and 70 healthy individuals. A number of convolutional neural networks (CNNs)-namely, VGG-16, VGG-19, ResNet-50, ResNet-101, and a custom architecture-were trained with both IR-SLO images and OCT thickness maps as two separate input datasets. The highest performing models for each modality were then integrated to create a bimodal model that receives the combination of OCT thickness maps and IR-SLO images. Subject-wise data splitting was employed to prevent data leakage among training, validation, and testing sets. Results Overall, images of the 102 patients from the internal dataset were divided into test, validation, and training subsets. Subsequently, we employed a bootstrapping approach on the training data through iterative sampling with replacement. The performance of the proposed bimodal model was evaluated on the internal test dataset, demonstrating an accuracy of 92.40% ± 4.1% (95% confidence interval [CI], 83.61-98.08), sensitivity of 95.43% ± 5.75% (95% CI, 83.71-100.0), specificity of 92.82% ± 3.72% (95% CI, 81.15-96.77), area under the receiver operating characteristic (AUROC) curve of 96.99% ± 2.99% (95% CI, 86.11-99.78), and area under the precision-recall curve (AUPRC) of 97.27% ± 2.94% (95% CI, 86.83-99.83). Furthermore, to assess the model generalization ability, we examined its performance on an external test dataset following the same bootstrap methodology, achieving promising results, with accuracy of 85.43% ± 0.08% (95% CI, 71.43-100.0), sensitivity of 97.33% ± 0.06% (95% CI, 83.33-100.0), specificity of 84.6% ± 0.10% (95% CI, 71.43-100.0), AUROC curve of 99.67% ± 0.02% (95% CI, 95.63-100.0), and AUPRC of 99.65% ± 0.02% (95% CI, 94.90-100.0). Conclusions Incorporating both modalities improves the performance of automated diagnosis of MS, showcasing the potential of utilizing IR-SLO as a complementary tool alongside OCT. Translational Relevance Should the results of our proposed bimodal model be validated in future work with larger and more diverse datasets, diagnosis of MS based on both OCT and IR-SLO can be reliably integrated into routine clinical practice.
Collapse
Affiliation(s)
- Roya Arian
- Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Ali Aghababaei
- Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
- School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Asieh Soltanipour
- Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Zahra Khodabandeh
- Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Sajed Rakhshani
- Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Shwasa B. Iyer
- Department of Engineering, Durham University, Durham, UK
| | - Fereshteh Ashtari
- Isfahan Neurosciences Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Hossein Rabbani
- Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Raheleh Kafieh
- Department of Engineering, Durham University, Durham, UK
| |
Collapse
|
4
|
Farabi Maleki S, Yousefi M, Afshar S, Pedrammehr S, Lim CP, Jafarizadeh A, Asadi H. Artificial Intelligence for Multiple Sclerosis Management Using Retinal Images: Pearl, Peaks, and Pitfalls. Semin Ophthalmol 2024; 39:271-288. [PMID: 38088176 DOI: 10.1080/08820538.2023.2293030] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/27/2023] [Accepted: 11/23/2023] [Indexed: 03/28/2024]
Abstract
Multiple sclerosis (MS) is a complex autoimmune disease characterized by inflammatory processes, demyelination, neurodegeneration, and axonal damage within the central nervous system (CNS). Retinal imaging, particularly Optical coherence tomography (OCT), has emerged as a crucial tool for investigating MS-related retinal injury. The integration of artificial intelligence(AI) has shown promise in enhancing OCT analysis for MS. Researchers are actively utilizing AI algorithms to accurately detect and classify MS-related abnormalities, leading to improved efficiency in diagnosis, monitoring, and personalized treatment planning. The prognostic value of AI in predicting MS disease progression has garnered substantial attention. Machine learning (ML) and deep learning (DL) algorithms can analyze longitudinal OCT data to forecast the course of the disease, providing critical information for personalized treatment planning and improved patient outcomes. Early detection of high-risk patients allows for targeted interventions to mitigate disability progression effectively. As such, AI-driven approaches yielded remarkable abilities in classifying distinct MS subtypes based on retinal features, aiding in disease characterization and guiding tailored therapeutic strategies. Additionally, these algorithms have enhanced the accuracy and efficiency of OCT image segmentation, streamlined diagnostic processes, and reduced human error. This study reviews the current research studies on the integration of AI,including ML and DL algorithms, with OCT in the context of MS. It examines the advancements, challenges, potential prospects, and ethical concerns of AI-powered techniques in enhancing MS diagnosis, monitoring disease progression, revolutionizing patient care, the development of patient screening tools, and supported clinical decision-making based on OCT images.
Collapse
Affiliation(s)
| | - Milad Yousefi
- Faculty of Mathematics, Statistics and Computer Sciences, University of Tabriz, Tabriz, Iran
| | - Sayeh Afshar
- Nikookari Eye Center, Tabriz University of Medical Sciences, Tabriz, Iran
| | | | - Chee Peng Lim
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Burwood, Australia
| | - Ali Jafarizadeh
- Nikookari Eye Center, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Houshyar Asadi
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Burwood, Australia
| |
Collapse
|
5
|
Montolío A, Cegoñino J, Garcia-Martin E, Pérez Del Palomar A. The macular retinal ganglion cell layer as a biomarker for diagnosis and prognosis in multiple sclerosis: A deep learning approach. Acta Ophthalmol 2024; 102:e272-e284. [PMID: 37300357 DOI: 10.1111/aos.15722] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Revised: 05/12/2023] [Accepted: 05/28/2023] [Indexed: 06/12/2023]
Abstract
PURPOSE The macular ganglion cell layer (mGCL) is a strong potential biomarker of axonal degeneration in multiple sclerosis (MS). For this reason, this study aims to develop a computer-aided method to facilitate diagnosis and prognosis in MS. METHODS This paper combines a cross-sectional study of 72 MS patients and 30 healthy control subjects for diagnosis and a 10-year longitudinal study of the same MS patients for the prediction of disability progression, during which the mGCL was measured using optical coherence tomography (OCT). Deep neural networks were used as an automatic classifier. RESULTS For MS diagnosis, greatest accuracy (90.3%) was achieved using 17 features as inputs. The neural network architecture comprised the input layer, two hidden layers and the output layer with softmax activation. For the prediction of disability progression 8 years later, accuracy of 81.9% was achieved with a neural network comprising two hidden layers and 400 epochs. CONCLUSION We present evidence that by applying deep learning techniques to clinical and mGCL thickness data it is possible to identify MS and predict the course of the disease. This approach potentially constitutes a non-invasive, low-cost, easy-to-implement and effective method.
Collapse
Affiliation(s)
- Alberto Montolío
- Biomaterials Group, Aragon Institute of Engineering Research (I3A), University of Zaragoza, Zaragoza, Spain
- Mechanical Engineering Department, University of Zaragoza, Zaragoza, Spain
| | - José Cegoñino
- Biomaterials Group, Aragon Institute of Engineering Research (I3A), University of Zaragoza, Zaragoza, Spain
- Mechanical Engineering Department, University of Zaragoza, Zaragoza, Spain
| | - Elena Garcia-Martin
- Ophthalmology Department, Miguel Servet University Hospital, Zaragoza, Spain
- GIMSO Research and Innovation Group, Aragon Institute for Health Research (IIS Aragon), Zaragoza, Spain
| | - Amaya Pérez Del Palomar
- Biomaterials Group, Aragon Institute of Engineering Research (I3A), University of Zaragoza, Zaragoza, Spain
- Mechanical Engineering Department, University of Zaragoza, Zaragoza, Spain
| |
Collapse
|
6
|
López-Varela E, Barreira N, Pascual NO, Castillo MRA, Penedo MG. Generation of synthetic intermediate slices in 3D OCT cubes for improving pathology detection and monitoring. Comput Biol Med 2023; 163:107214. [PMID: 37418898 DOI: 10.1016/j.compbiomed.2023.107214] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2022] [Revised: 05/25/2023] [Accepted: 06/25/2023] [Indexed: 07/09/2023]
Abstract
OCT is a non-invasive imaging technique commonly used to obtain 3D volumes of the ocular structure. These volumes allow the monitoring of ocular and systemic diseases through the observation of subtle changes in the different structures present in the eye. In order to observe these changes it is essential that the OCT volumes have a high resolution in all axes, but unfortunately there is an inverse relationship between the quality of the OCT images and the number of slices of the cube. This results in routine clinical examinations using cubes that generally contain high-resolution images with few slices. This lack of slices complicates the monitoring of changes in the retina hindering the diagnostic process and reducing the effectiveness of 3D visualizations. Therefore, increasing the cross-sectional resolution of OCT cubes would improve the visualization of these changes aiding the clinician in the diagnostic process. In this work we present a novel fully automatic methodology to perform the synthesis of intermediate slices of OCT image volumes in an unsupervised manner. To perform this synthesis, we propose a fully convolutional neural network architecture that uses information from two adjacent slices to generate the intermediate synthetic slice. We also propose a training methodology, where we use three adjacent slices to train the network by contrastive learning and image reconstruction. We test our methodology with three different types of OCT volumes commonly used in the clinical setting and validate the quality of the synthetic slices created with several medical experts and using an expert system.
Collapse
Affiliation(s)
- Emilio López-Varela
- VARPA Group, Biomedical Research Institute of A Coruña (INIBIC), University of A Coruña, A Coruña, Spain; CITIC-Research Center of Information and Communication Technologies, University of A Coruña, A Coruña, Spain.
| | - Noelia Barreira
- VARPA Group, Biomedical Research Institute of A Coruña (INIBIC), University of A Coruña, A Coruña, Spain; CITIC-Research Center of Information and Communication Technologies, University of A Coruña, A Coruña, Spain.
| | - Nuria Olivier Pascual
- Servizo de Oftalmoloxía, Complejo Hospitalario Universitario de Ferrol (CHUF), Av. da Residencia S/N, Ferrol 15405, Spain.
| | - Maria Rosa Arroyo Castillo
- Servizo de Oftalmoloxía, Complejo Hospitalario Universitario de Ferrol (CHUF), Av. da Residencia S/N, Ferrol 15405, Spain.
| | - Manuel G Penedo
- VARPA Group, Biomedical Research Institute of A Coruña (INIBIC), University of A Coruña, A Coruña, Spain; CITIC-Research Center of Information and Communication Technologies, University of A Coruña, A Coruña, Spain.
| |
Collapse
|
7
|
Khodabandeh Z, Rabbani H, Ashtari F, Zimmermann HG, Motamedi S, Brandt AU, Paul F, Kafieh R. Discrimination of multiple sclerosis using OCT images from two different centers. Mult Scler Relat Disord 2023; 77:104846. [PMID: 37413855 DOI: 10.1016/j.msard.2023.104846] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Accepted: 06/19/2023] [Indexed: 07/08/2023]
Abstract
BACKGROUND Multiple sclerosis (MS) is one of the most prevalent chronic inflammatory diseases caused by demyelination and axonal damage in the central nervous system. Structural retinal imaging via optical coherence tomography (OCT) shows promise as a noninvasive biomarker for monitoring of MS. There are successful reports regarding the application of Artificial Intelligence (AI) in the analysis of cross-sectional OCTs in ophthalmologic diseases. However, the alteration of thicknesses of various retinal layers in MS is noticeably subtle compared to other ophthalmologic diseases. Therefore, raw cross-sectional OCTs are replaced with multilayer segmented OCTs for discrimination of MS and healthy controls (HCs). METHODS To conform to the principles of trustworthy AI, interpretability is provided by visualizing the regional layer contribution to classification performance with the proposed occlusion sensitivity approach. The robustness of the classification is also guaranteed by showing the effectiveness of the algorithm while being tested on the new independent dataset. The most discriminative features from different topologies of the multilayer segmented OCTs are selected by the dimension reduction method. Support vector machine (SVM), random forest (RF), and artificial neural network (ANN) are used for classification. Patient-wise cross-validation (CV) is utilized to evaluate the performance of the algorithm, where the training and test folds contain records from different subjects. RESULTS The most discriminative topology is determined to square with a size of 40 pixels and the most influential layers are the ganglion cell and inner plexiform layer (GCIPL) and inner nuclear layer (INL). Linear SVM resulted in 88% Accuracy (with standard deviation (std) = 0.49 in 10 times of execution to indicate the repeatability), 78% precision (std=1.48), and 63% recall (std=1.35) in the discrimination of MS and HCs using macular multilayer segmented OCTs. CONCLUSION The proposed classification algorithm is expected to help neurologists in the early diagnosis of MS. This paper distinguishes itself from other studies by employing two distinct datasets, which enhances the robustness of its findings in comparison with previous studies with lack of external validation. This study aims to circumvent the utilization of deep learning methods due to the limited quantity of the available data and convincingly demonstrates that favorable outcomes can be achieved without relying on deep learning techniques.
Collapse
Affiliation(s)
- Zahra Khodabandeh
- School of Advanced Technologies in Medicine, Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Hossein Rabbani
- School of Advanced Technologies in Medicine, Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Fereshteh Ashtari
- Isfahan Neurosciences Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Hanna G Zimmermann
- Experimental and Clinical Research Center, Max Delbrück Center for Molecular Medicine and Charité- Universitätsmedizin Berlin, Berlin, Germany; NeuroCure Clinical Research Center- Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
| | - Seyedamirhosein Motamedi
- Experimental and Clinical Research Center, Max Delbrück Center for Molecular Medicine and Charité- Universitätsmedizin Berlin, Berlin, Germany; NeuroCure Clinical Research Center- Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
| | - Alexander U Brandt
- Experimental and Clinical Research Center, Max Delbrück Center for Molecular Medicine and Charité- Universitätsmedizin Berlin, Berlin, Germany; NeuroCure Clinical Research Center- Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany; Department of Neurology, University of California, Irvine, CA, USA
| | - Friedemann Paul
- Experimental and Clinical Research Center, Max Delbrück Center for Molecular Medicine and Charité- Universitätsmedizin Berlin, Berlin, Germany; NeuroCure Clinical Research Center- Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany; Department of Neurology, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
| | - Rahele Kafieh
- School of Advanced Technologies in Medicine, Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran; NeuroCure Clinical Research Center- Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany; Department of Engineering, Durham University, Durham, UK.
| |
Collapse
|
8
|
Hernandez M, Ramon-Julvez U, Vilades E, Cordon B, Mayordomo E, Garcia-Martin E. Explainable artificial intelligence toward usable and trustworthy computer-aided diagnosis of multiple sclerosis from Optical Coherence Tomography. PLoS One 2023; 18:e0289495. [PMID: 37549174 PMCID: PMC10406231 DOI: 10.1371/journal.pone.0289495] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Accepted: 07/19/2023] [Indexed: 08/09/2023] Open
Abstract
BACKGROUND Several studies indicate that the anterior visual pathway provides information about the dynamics of axonal degeneration in Multiple Sclerosis (MS). Current research in the field is focused on the quest for the most discriminative features among patients and controls and the development of machine learning models that yield computer-aided solutions widely usable in clinical practice. However, most studies are conducted with small samples and the models are used as black boxes. Clinicians should not trust machine learning decisions unless they come with comprehensive and easily understandable explanations. MATERIALS AND METHODS A total of 216 eyes from 111 healthy controls and 100 eyes from 59 patients with relapsing-remitting MS were enrolled. The feature set was obtained from the thickness of the ganglion cell layer (GCL) and the retinal nerve fiber layer (RNFL). Measurements were acquired by the novel Posterior Pole protocol from Spectralis Optical Coherence Tomography (OCT) device. We compared two black-box methods (gradient boosting and random forests) with a glass-box method (explainable boosting machine). Explainability was studied using SHAP for the black-box methods and the scores of the glass-box method. RESULTS The best-performing models were obtained for the GCL layer. Explainability pointed out to the temporal location of the GCL layer that is usually broken or thinning in MS and the relationship between low thickness values and high probability of MS, which is coherent with clinical knowledge. CONCLUSIONS The insights on how to use explainability shown in this work represent a first important step toward a trustworthy computer-aided solution for the diagnosis of MS with OCT.
Collapse
Affiliation(s)
- Monica Hernandez
- Computer Science Department, University of Zaragoza, Zaragoza, Spain
- Aragon Institute on Engineering Research, Zaragoza, Spain
| | - Ubaldo Ramon-Julvez
- Computer Science Department, University of Zaragoza, Zaragoza, Spain
- Aragon Institute on Engineering Research, Zaragoza, Spain
| | - Elisa Vilades
- Ophtalmology Department, Miguel Servet Hospital, Zaragoza, Spain
| | - Beatriz Cordon
- Ophtalmology Department, Miguel Servet Hospital, Zaragoza, Spain
| | - Elvira Mayordomo
- Computer Science Department, University of Zaragoza, Zaragoza, Spain
- Aragon Institute on Engineering Research, Zaragoza, Spain
| | | |
Collapse
|
9
|
Tan Y, Sun X. Ocular images-based artificial intelligence on systemic diseases. Biomed Eng Online 2023; 22:49. [PMID: 37208715 DOI: 10.1186/s12938-023-01110-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Accepted: 05/02/2023] [Indexed: 05/21/2023] Open
Abstract
PURPOSE To provide a summary of the research advances on ocular images-based artificial intelligence on systemic diseases. METHODS Narrative literature review. RESULTS Ocular images-based artificial intelligence has been used in a variety of systemic diseases, including endocrine, cardiovascular, neurological, renal, autoimmune, and hematological diseases, and many others. However, the studies are still at an early stage. The majority of studies have used AI only for diseases diagnosis, and the specific mechanisms linking systemic diseases to ocular images are still unclear. In addition, there are many limitations to the research, such as the number of images, the interpretability of artificial intelligence, rare diseases, and ethical and legal issues. CONCLUSION While ocular images-based artificial intelligence is widely used, the relationship between the eye and the whole body should be more clearly elucidated.
Collapse
Affiliation(s)
- Yuhe Tan
- Department of Ophthalmology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Xufang Sun
- Department of Ophthalmology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.
| |
Collapse
|
10
|
Giulivi C, Zhang K, Arakawa H. Recent advances and new perspectives in mitochondrial dysfunction. Sci Rep 2023; 13:7977. [PMID: 37198256 DOI: 10.1038/s41598-023-34624-8] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/19/2023] Open
Affiliation(s)
- Cecilia Giulivi
- School of Veterinary Medicine, University of California at Davis and The MIND Institute, University of California Davis, Davis, CA, USA.
| | - Kezhong Zhang
- Center for Molecular Medicine and Genetics, Wayne State University School of Medicine, Detroit, USA.
| | - Hirofumi Arakawa
- Division of Cancer Biology, National Cancer Center Research Institute, Tokyo, Japan.
| |
Collapse
|
11
|
Ortiz M, Mallen V, Boquete L, Sánchez-Morla EM, Cordón B, Vilades E, Dongil-Moreno FJ, Miguel-Jiménez JM, Garcia-Martin E. Diagnosis of multiple sclerosis using optical coherence tomography supported by artificial intelligence. Mult Scler Relat Disord 2023; 74:104725. [PMID: 37086637 DOI: 10.1016/j.msard.2023.104725] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2023] [Revised: 03/15/2023] [Accepted: 04/16/2023] [Indexed: 04/24/2023]
Abstract
BACKGROUND Current procedures for diagnosing multiple sclerosis (MS) present a series of limitations, making it critically important to identify new biomarkers. The aim of the study was to identify new biomarkers for the early diagnosis of MS using spectral-domain optical coherence tomography (OCT) and artificial intelligence. METHODS Spectral domain OCT was performed on 79 patients with relapsing-remitting multiple sclerosis (RRMS) (disease duration ≤ 2 years, no history of optic neuritis) and on 69 age-matched healthy controls using the posterior pole protocol that incorporates the anatomic Positioning System. Median retinal thickness values in both eyes and inter-eye difference in healthy controls and patients were evaluated by area under the receiver operating characteristic (AUROC) curve analysis in the foveal, parafoveal and perifoveal areas and in the overall area spanned by the three rings. The structures with the greatest discriminant capacity - retinal thickness and inter-eye difference - were used as inputs to a convolutional neural network to assess the diagnostic capability. RESULTS Analysis of retinal thickness and inter-eye difference in RRMS patients revealed that greatest alteration occurred in the ganglion cell (GCL), inner plexiform (IPL), and inner retinal (IRL) layers. By using the average thickness of the GCL (AUROC = 0.82) and the inter-eye difference in the IPL (AUROC = 0.71) as inputs to a two-layer convolutional neural network, automatic diagnosis attained accuracy = 0.87, sensitivity = 0.82, and specificity = 0.92. CONCLUSION This study adds weight to the argument that neuroretinal structure analysis could be incorporated into the diagnostic criteria for MS.
Collapse
Affiliation(s)
- Miguel Ortiz
- School of Physics, University of Melbourne, Melbourne, VIC 3010, Australia
| | - Victor Mallen
- Department of Ophthalmology, Miguel Servet University Hospital, Zaragoza, Spain; Aragon Institute for Health Research (IIS Aragon). Miguel Servet Ophthalmology Innovation and Research Group (GIMSO), University of Zaragoza, Spain
| | - Luciano Boquete
- Biomedical Engineering Group, Department of Electronics, University of Alcalá, Alcalá de Henares, Spain
| | | | - Beatriz Cordón
- Department of Ophthalmology, Miguel Servet University Hospital, Zaragoza, Spain; Aragon Institute for Health Research (IIS Aragon). Miguel Servet Ophthalmology Innovation and Research Group (GIMSO), University of Zaragoza, Spain
| | - Elisa Vilades
- Department of Ophthalmology, Miguel Servet University Hospital, Zaragoza, Spain; Aragon Institute for Health Research (IIS Aragon). Miguel Servet Ophthalmology Innovation and Research Group (GIMSO), University of Zaragoza, Spain
| | - Francisco J Dongil-Moreno
- Biomedical Engineering Group, Department of Electronics, University of Alcalá, Alcalá de Henares, Spain
| | - Juan M Miguel-Jiménez
- Biomedical Engineering Group, Department of Electronics, University of Alcalá, Alcalá de Henares, Spain
| | - Elena Garcia-Martin
- Department of Ophthalmology, Miguel Servet University Hospital, Zaragoza, Spain; Aragon Institute for Health Research (IIS Aragon). Miguel Servet Ophthalmology Innovation and Research Group (GIMSO), University of Zaragoza, Spain.
| |
Collapse
|
12
|
Olatunji SO, Alsheikh N, Alnajrani L, Alanazy A, Almusairii M, Alshammasi S, Alansari A, Zaghdoud R, Alahmadi A, Basheer Ahmed MI, Ahmed MS, Alhiyafi J. Comprehensible Machine-Learning-Based Models for the Pre-Emptive Diagnosis of Multiple Sclerosis Using Clinical Data: A Retrospective Study in the Eastern Province of Saudi Arabia. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2023; 20:4261. [PMID: 36901273 PMCID: PMC10002108 DOI: 10.3390/ijerph20054261] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Revised: 02/22/2023] [Accepted: 02/24/2023] [Indexed: 06/18/2023]
Abstract
Multiple Sclerosis (MS) is characterized by chronic deterioration of the nervous system, mainly the brain and the spinal cord. An individual with MS develops the condition when the immune system begins attacking nerve fibers and the myelin sheathing that covers them, affecting the communication between the brain and the rest of the body and eventually causing permanent damage to the nerve. Patients with MS (pwMS) might experience different symptoms depending on which nerve was damaged and how much damage it has sustained. Currently, there is no cure for MS; however, there are clinical guidelines that help control the disease and its accompanying symptoms. Additionally, no specific laboratory biomarker can precisely identify the presence of MS, leaving specialists with a differential diagnosis that relies on ruling out other possible diseases with similar symptoms. Since the emergence of Machine Learning (ML) in the healthcare industry, it has become an effective tool for uncovering hidden patterns that aid in diagnosing several ailments. Several studies have been conducted to diagnose MS using ML and Deep Learning (DL) models trained using MRI images, achieving promising results. However, complex and expensive diagnostic tools are needed to collect and examine imaging data. Thus, the intention of this study is to implement a cost-effective, clinical data-driven model that is capable of diagnosing pwMS. The dataset was obtained from King Fahad Specialty Hospital (KFSH) in Dammam, Saudi Arabia. Several ML algorithms were compared, namely Support Vector Machine (SVM), Decision Tree (DT), Logistic Regression (LR), Random Forest (RF), Extreme Gradient Boosting (XGBoost), Adaptive Boosting (AdaBoost), and Extra Trees (ET). The results indicated that the ET model outpaced the rest with an accuracy of 94.74%, recall of 97.26%, and precision of 94.67%.
Collapse
Affiliation(s)
- Sunday O. Olatunji
- College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Nawal Alsheikh
- College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Lujain Alnajrani
- College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Alhatoon Alanazy
- College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Meshael Almusairii
- College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Salam Alshammasi
- College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Aisha Alansari
- College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Rim Zaghdoud
- College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Alaa Alahmadi
- College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Mohammed Imran Basheer Ahmed
- College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Mohammed Salih Ahmed
- College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Jamal Alhiyafi
- Department of Computer Science, Kettering University, Flint, MI 48504, USA
| |
Collapse
|
13
|
Diagnostic performance of artificial intelligence in multiple sclerosis: a systematic review and meta-analysis. Neurol Sci 2023; 44:499-517. [PMID: 36303065 DOI: 10.1007/s10072-022-06460-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2022] [Accepted: 10/17/2022] [Indexed: 11/06/2022]
Abstract
BACKGROUND The expansion of the availability of advanced imaging methods needs more time, expertise, and resources which is in contrast to the primary goal of the imaging techniques. To overcome most of these difficulties, artificial intelligence (AI) can be used. A number of studies used AI models for multiple sclerosis (MS) diagnosis and reported diverse results. Therefore, we aim to perform a comprehensive systematic review and meta-analysis study on the role of AI in the diagnosis of MS. METHODS We performed a systematic search using four databases including PubMed, Scopus, Web of Science, and IEEE. Studies that applied deep learning or AI to the diagnosis of MS based on any modalities were considered eligible in our study. The accuracy, sensitivity, specificity, precision, and area under curve (AUC) were pooled with a random-effects model and 95% confidence interval (CI). RESULTS After the screening, 41 articles with 5989 individuals met the inclusion criteria and were included in our qualitative and quantitative synthesis. Our analysis showed that the overall accuracy among studies was 94% (95%CI: 93%, 96%). The pooled sensitivity and specificity were 92% (95%CI: 90%, 95%) and 93% (95%CI: 90%, 96%), respectively. Furthermore, our analysis showed 92% precision in MS diagnosis for AI studies (95%CI: 88%, 97%). Also, the overall pooled AUC was 93% (95%CI: 89%, 96%). CONCLUSION Overall, AI models can further improve our diagnostic practice in MS patients. Our results indicate that the use of AI can aid the clinicians in accurate diagnosis of MS and improve current diagnostic approaches as most of the parameters including accuracy, sensitivity, specificity, precision, and AUC were considerably high, especially when using MRI data.
Collapse
|
14
|
Albano V, Dammacco R, Manni A, Sisto D, Iaffaldano A, Mavilio A, Alessio G, Trojano M, Paolicelli D. Macular ganglion cell-inner plexiform layer defect patterns in multiple sclerosis patients without optic neuritis: A Spectral-Domain-Optical Coherence Tomography Cross-Sectional, Case-Control, Pilot Study. Eur J Ophthalmol 2023; 33:546-555. [PMID: 35799453 DOI: 10.1177/11206721221112803] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2023]
Abstract
PURPOSE Spectral-domain optical coherence tomography (SD-OCT) was used to evaluate, in patients with multiple sclerosis without a history of optic neuritis (MSNON), the proportion of the different macular ganglion cell-inner plexiform layer complex (mGCIP) defect patterns. The results were compared with those of healthy controls (HCs). METHODS In this cross-sectional case-control study, 34 eyes of 34 individuals, 17 with MSNON and 17 HCs, were evaluated. All participants underwent mGCIP thickness measurement using SD-OCT (Zeiss Cirrus HD-OCT 4000, macular cube protocol). The mGCIP defect patterns were classified in nine types (minimal, inner, outer, diffuse mild, diffuse severe inferior confined, inferior dominant, superior confined, and superior dominant), according to the shape derived by the deviation map of the instrument, and the proportion of each type was assessed. RESULTS A mGCIP defect pattern was detected in 70.5% of MSNON eyes, with an inner type as the most frequent pattern (47%), followed by the outer type (11.7%) and the inferior confined type (11.7%). No defect was found in Hcs. CONCLUSIONS A significant thinning of the mGCIP with the frequent presence of an inner defect was seen in MSNON patients. The presence of this defect may serve as a biomarker of subclinical optic nerve involvement in MS patients.
Collapse
Affiliation(s)
- Valeria Albano
- Department of Neurosciences, Institute of Ophthalmology, University of Bari, Bari, Italy
| | - Rosanna Dammacco
- Department of Neurosciences, Institute of Ophthalmology, University of Bari, Bari, Italy
| | - Alessia Manni
- Department of Neurosciences, Institute of Neurology, University of Bari, Bari, Italy
| | - Dario Sisto
- Department of Neurosciences, Institute of Ophthalmology, University of Bari, Bari, Italy
| | - Antonio Iaffaldano
- Department of Neurosciences, Institute of Neurology, University of Bari, Bari, Italy
| | - Alberto Mavilio
- 27287Local Health Authority Brindisi, Social Health District, Brindisi, Italy
| | - Giovanni Alessio
- Department of Neurosciences, Institute of Ophthalmology, University of Bari, Bari, Italy
| | - Maria Trojano
- Department of Neurosciences, Institute of Neurology, University of Bari, Bari, Italy
| | - Damiano Paolicelli
- Department of Neurosciences, Institute of Ophthalmology, University of Bari, Bari, Italy
| |
Collapse
|
15
|
Aslam N, Khan IU, Bashamakh A, Alghool FA, Aboulnour M, Alsuwayan NM, Alturaif RK, Brahimi S, Aljameel SS, Al Ghamdi K. Multiple Sclerosis Diagnosis Using Machine Learning and Deep Learning: Challenges and Opportunities. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22207856. [PMID: 36298206 PMCID: PMC9609137 DOI: 10.3390/s22207856] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 06/29/2022] [Accepted: 10/11/2022] [Indexed: 05/17/2023]
Abstract
Multiple Sclerosis (MS) is a disease that impacts the central nervous system (CNS), which can lead to brain, spinal cord, and optic nerve problems. A total of 2.8 million are estimated to suffer from MS. Globally, a new case of MS is reported every five minutes. In this review, we discuss the proposed approaches to diagnosing MS using machine learning (ML) published between 2011 and 2022. Numerous models have been developed using different types of data, including magnetic resonance imaging (MRI) and clinical data. We identified the methods that achieved the best results in diagnosing MS. The most implemented approaches are SVM, RF, and CNN. Moreover, we discussed the challenges and opportunities in MS diagnosis to improve AI systems to enable researchers and practitioners to enhance their approaches and improve the automated diagnosis of MS. The challenges faced by automated MS diagnosis include difficulty distinguishing the disease from other diseases showing similar symptoms, protecting the confidentiality of the patients' data, achieving reliable ML models that are also easily understood by non-experts, and the difficulty of collecting a large reliable dataset. Moreover, we discussed several opportunities in the field such as the implementation of secure platforms, employing better AI solutions, developing better disease prognosis systems, combining more than one data type for better MS prediction and using OCT data for diagnosis, utilizing larger, multi-center datasets to improve the reliability of the developed models, and commercialization.
Collapse
Affiliation(s)
- Nida Aslam
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
- Correspondence:
| | - Irfan Ullah Khan
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Asma Bashamakh
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Fatima A. Alghool
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Menna Aboulnour
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Noorah M. Alsuwayan
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Rawa’a K. Alturaif
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Samiha Brahimi
- Department of Computer Information Systems, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Sumayh S. Aljameel
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Kholoud Al Ghamdi
- Department of Physiology, College of Medicine, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| |
Collapse
|
16
|
Comparison of Machine Learning Methods Using Spectralis OCT for Diagnosis and Disability Progression Prognosis in Multiple Sclerosis. Ann Biomed Eng 2022; 50:507-528. [PMID: 35220529 PMCID: PMC9001622 DOI: 10.1007/s10439-022-02930-3] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2021] [Accepted: 02/10/2022] [Indexed: 12/28/2022]
Abstract
Machine learning approaches in diagnosis and prognosis of multiple sclerosis (MS) were analysed using retinal nerve fiber layer (RNFL) thickness, measured by optical coherence tomography (OCT). A cross-sectional study (72 MS patients and 30 healthy controls) was used for diagnosis. These 72 MS patients were involved in a 10-year longitudinal follow-up study for prognostic purposes. Structural measurements of RNFL thickness were performed using different Spectralis OCT protocols: fast macular thickness protocol to measure macular RNFL, and fast RNFL thickness protocol and fast RNFL-N thickness protocol to measure peripapillary RNFL. Binary classifiers such as multiple linear regression (MLR), support vector machines (SVM), decision tree (DT), k-nearest neighbours (k-NN), Naïve Bayes (NB), ensemble classifier (EC) and long short-term memory (LSTM) recurrent neural network were tested. For MS diagnosis, the best acquisition protocol was fast macular thickness protocol using k-NN (accuracy: 95.8%; sensitivity: 94.4%; specificity: 97.2%; precision: 97.1%; AUC: 0.958). For MS prognosis, our model with a 3-year follow up to predict disability progression 8 years later was the best predictive model. DT performed best for fast macular thickness protocol (accuracy: 91.3%; sensitivity: 90.0%; specificity: 92.5%; precision: 92.3%; AUC: 0.913) and SVM for fast RNFL-N thickness protocol (accuracy: 91.3%; sensitivity: 87.5%; specificity: 95.0%; precision: 94.6%; AUC: 0.913). This work concludes that measurements of RNFL thickness obtained with Spectralis OCT have a good ability to diagnose MS and to predict disability progression in MS patients. This machine learning approach would help clinicians to have valuable information.
Collapse
|
17
|
Nabizadeh F, Masrouri S, Ramezannezhad E, Ghaderi A, Sharafi AM, Soraneh S, Moghadasi AN. Artificial intelligence in the diagnosis of Multiple Sclerosis: a systematic review. Mult Scler Relat Disord 2022; 59:103673. [DOI: 10.1016/j.msard.2022.103673] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2022] [Revised: 01/24/2022] [Accepted: 02/05/2022] [Indexed: 10/19/2022]
|
18
|
López-Dorado A, Ortiz M, Satue M, Rodrigo MJ, Barea R, Sánchez-Morla EM, Cavaliere C, Rodríguez-Ascariz JM, Orduna-Hospital E, Boquete L, Garcia-Martin E. Early Diagnosis of Multiple Sclerosis Using Swept-Source Optical Coherence Tomography and Convolutional Neural Networks Trained with Data Augmentation. SENSORS (BASEL, SWITZERLAND) 2021; 22:167. [PMID: 35009710 PMCID: PMC8747672 DOI: 10.3390/s22010167] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/03/2021] [Revised: 12/21/2021] [Accepted: 12/22/2021] [Indexed: 05/07/2023]
Abstract
BACKGROUND The aim of this paper is to implement a system to facilitate the diagnosis of multiple sclerosis (MS) in its initial stages. It does so using a convolutional neural network (CNN) to classify images captured with swept-source optical coherence tomography (SS-OCT). METHODS SS-OCT images from 48 control subjects and 48 recently diagnosed MS patients have been used. These images show the thicknesses (45 × 60 points) of the following structures: complete retina, retinal nerve fiber layer, two ganglion cell layers (GCL+, GCL++) and choroid. The Cohen distance is used to identify the structures and the regions within them with greatest discriminant capacity. The original database of OCT images is augmented by a deep convolutional generative adversarial network to expand the CNN's training set. RESULTS The retinal structures with greatest discriminant capacity are the GCL++ (44.99% of image points), complete retina (26.71%) and GCL+ (22.93%). Thresholding these images and using them as inputs to a CNN comprising two convolution modules and one classification module obtains sensitivity = specificity = 1.0. CONCLUSIONS Feature pre-selection and the use of a convolutional neural network may be a promising, nonharmful, low-cost, easy-to-perform and effective means of assisting the early diagnosis of MS based on SS-OCT thickness data.
Collapse
Affiliation(s)
- Almudena López-Dorado
- Biomedical Engineering Group, Department of Electronics, University of Alcalá, 28801 Alcalá de Henares, Spain; (A.L.-D.); (R.B.); (C.C.); (J.M.R.-A.)
| | - Miguel Ortiz
- Computer Vision, Imaging and Machine Intelligence Research Group, Interdisciplinary Center for Security, Reliability and Trust (SnT), University of Luxembourg, 4365 Luxembourg, Luxembourg;
| | - María Satue
- Miguel Servet Ophthalmology Innovation and Research Group (GIMSO), Department of Ophthalmology, Aragon Institute for Health Research (IIS Aragon), Miguel Servet University Hospital, University of Zaragoza, 50018 Zaragoza, Spain; (M.S.); (M.J.R.); (E.O.-H.)
| | - María J. Rodrigo
- Miguel Servet Ophthalmology Innovation and Research Group (GIMSO), Department of Ophthalmology, Aragon Institute for Health Research (IIS Aragon), Miguel Servet University Hospital, University of Zaragoza, 50018 Zaragoza, Spain; (M.S.); (M.J.R.); (E.O.-H.)
| | - Rafael Barea
- Biomedical Engineering Group, Department of Electronics, University of Alcalá, 28801 Alcalá de Henares, Spain; (A.L.-D.); (R.B.); (C.C.); (J.M.R.-A.)
| | - Eva M. Sánchez-Morla
- Department of Psychiatry, Hospital 12 de Octubre Research Institute (i+12), 28041 Madrid, Spain;
- Faculty of Medicine, Complutense University of Madrid, 28040 Madrid, Spain
- Biomedical Research Networking Centre in Mental Health (CIBERSAM), 28029 Madrid, Spain
| | - Carlo Cavaliere
- Biomedical Engineering Group, Department of Electronics, University of Alcalá, 28801 Alcalá de Henares, Spain; (A.L.-D.); (R.B.); (C.C.); (J.M.R.-A.)
| | - José M. Rodríguez-Ascariz
- Biomedical Engineering Group, Department of Electronics, University of Alcalá, 28801 Alcalá de Henares, Spain; (A.L.-D.); (R.B.); (C.C.); (J.M.R.-A.)
| | - Elvira Orduna-Hospital
- Miguel Servet Ophthalmology Innovation and Research Group (GIMSO), Department of Ophthalmology, Aragon Institute for Health Research (IIS Aragon), Miguel Servet University Hospital, University of Zaragoza, 50018 Zaragoza, Spain; (M.S.); (M.J.R.); (E.O.-H.)
| | - Luciano Boquete
- Biomedical Engineering Group, Department of Electronics, University of Alcalá, 28801 Alcalá de Henares, Spain; (A.L.-D.); (R.B.); (C.C.); (J.M.R.-A.)
| | - Elena Garcia-Martin
- Miguel Servet Ophthalmology Innovation and Research Group (GIMSO), Department of Ophthalmology, Aragon Institute for Health Research (IIS Aragon), Miguel Servet University Hospital, University of Zaragoza, 50018 Zaragoza, Spain; (M.S.); (M.J.R.); (E.O.-H.)
| |
Collapse
|
19
|
Hassan B, Qin S, Ahmed R, Hassan T, Taguri AH, Hashmi S, Werghi N. Deep learning based joint segmentation and characterization of multi-class retinal fluid lesions on OCT scans for clinical use in anti-VEGF therapy. Comput Biol Med 2021; 136:104727. [PMID: 34385089 DOI: 10.1016/j.compbiomed.2021.104727] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2021] [Revised: 07/31/2021] [Accepted: 08/01/2021] [Indexed: 11/19/2022]
Abstract
BACKGROUND In anti-vascular endothelial growth factor (anti-VEGF) therapy, an accurate estimation of multi-class retinal fluid (MRF) is required for the activity prescription and intravitreal dose. This study proposes an end-to-end deep learning-based retinal fluids segmentation network (RFS-Net) to segment and recognize three MRF lesion manifestations, namely, intraretinal fluid (IRF), subretinal fluid (SRF), and pigment epithelial detachment (PED), from multi-vendor optical coherence tomography (OCT) imagery. The proposed image analysis tool will optimize anti-VEGF therapy and contribute to reducing the inter- and intra-observer variability. METHOD The proposed RFS-Net architecture integrates the atrous spatial pyramid pooling (ASPP), residual, and inception modules in the encoder path to learn better features and conserve more global information for precise segmentation and characterization of MRF lesions. The RFS-Net model is trained and validated using OCT scans from multiple vendors (Topcon, Cirrus, Spectralis), collected from three publicly available datasets. The first dataset consisted of OCT volumes obtained from 112 subjects (a total of 11,334 B-scans) is used for both training and evaluation purposes. Moreover, the remaining two datasets are only used for evaluation purposes to check the trained RFS-Net's generalizability on unseen OCT scans. The two evaluation datasets contain a total of 1572 OCT B-scans from 1255 subjects. The performance of the proposed RFS-Net model is assessed through various evaluation metrics. RESULTS The proposed RFS-Net model achieved the mean F1 scores of 0.762, 0.796, and 0.805 for segmenting IRF, SRF, and PED. Moreover, with the automated segmentation of the three retinal manifestations, the RFS-Net brings a considerable gain in efficiency compared to the tedious and demanding manual segmentation procedure of the MRF. CONCLUSIONS Our proposed RFS-Net is a potential diagnostic tool for the automatic segmentation of MRF (IRF, SRF, and PED) lesions. It is expected to strengthen the inter-observer agreement, and standardization of dosimetry is envisaged as a result.
Collapse
Affiliation(s)
- Bilal Hassan
- School of Automation Science and Electrical Engineering, Beihang University (BUAA), Beijing, 100191, China.
| | - Shiyin Qin
- School of Automation Science and Electrical Engineering, Beihang University (BUAA), Beijing, 100191, China; School of Electrical Engineering and Intelligentization, Dongguan University of Technology, Dongguan, 523808, China
| | - Ramsha Ahmed
- School of Computer and Communication Engineering, University of Science and Technology Beijing (USTB), Beijing, 100083, China
| | - Taimur Hassan
- Center for Cyber-Physical Systems, Khalifa University of Science and Technology, Abu Dhabi, 127788, United Arab Emirates
| | - Abdel Hakeem Taguri
- Abu Dhabi Healthcare Company (SEHA), Abu Dhabi, 127788, United Arab Emirates
| | - Shahrukh Hashmi
- Abu Dhabi Healthcare Company (SEHA), Abu Dhabi, 127788, United Arab Emirates
| | - Naoufel Werghi
- Center for Cyber-Physical Systems, Khalifa University of Science and Technology, Abu Dhabi, 127788, United Arab Emirates
| |
Collapse
|
20
|
Montolío A, Martín-Gallego A, Cegoñino J, Orduna E, Vilades E, Garcia-Martin E, Palomar APD. Machine learning in diagnosis and disability prediction of multiple sclerosis using optical coherence tomography. Comput Biol Med 2021; 133:104416. [PMID: 33946022 DOI: 10.1016/j.compbiomed.2021.104416] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2020] [Revised: 03/25/2021] [Accepted: 04/16/2021] [Indexed: 01/02/2023]
Abstract
BACKGROUND Multiple sclerosis (MS) is a neurodegenerative disease that affects the central nervous system, especially the brain, spinal cord, and optic nerve. Diagnosis of this disease is a very complex process and generally requires a lot of time. In addition, treatments are applied without any information on the disability course in each MS patient. For these two reasons, the objective of this study was to improve the MS diagnosis and predict the long-term course of disability in MS patients based on clinical data and retinal nerve fiber layer (RNFL) thickness, measured by optical coherence tomography (OCT). MATERIAL AND METHODS A total of 104 healthy controls and 108 MS patients, 82 of whom had a 10-year follow-up, were enrolled. Classification algorithms such as multiple linear regression (MLR), support vector machines (SVM), decision tree (DT), k-nearest neighbours (k-NN), Naïve Bayes (NB), ensemble classifier (EC) and long short-term memory (LSTM) recurrent neural network were tested to develop two predictive models: MS diagnosis model and MS disability course prediction model. RESULTS For MS diagnosis, the best result was obtained using EC (accuracy: 87.7%; sensitivity: 87.0%; specificity: 88.5%; precision: 88.7%; AUC: 0.8775). In line with this good performance, the accuracy was 85.4% using k-NN and 84.4% using SVM. And, for long-term prediction of MS disability course, LSTM recurrent neural network was the most appropriate classifier (accuracy: 81.7%; sensitivity: 81.1%; specificity: 82.2%; precision: 78.9%; AUC: 0.8165). The use of MLR, SVM and k-NN also showed a good performance (AUC ≥ 0.8). CONCLUSIONS This study demonstrated that machine learning techniques, using clinical and OCT data, can help establish an early diagnosis and predict the course of MS. This advance could help clinicians select more specific treatments for each MS patient. Therefore, our findings underscore the potential of RNFL thickness as a reliable MS biomarker.
Collapse
Affiliation(s)
- Alberto Montolío
- Group of Biomaterials, Aragon Institute of Engineering Research (I3A), University of Zaragoza, Zaragoza, Spain; Department of Mechanical Engineering, University of Zaragoza, Zaragoza, Spain
| | - Alejandro Martín-Gallego
- Group of Biomaterials, Aragon Institute of Engineering Research (I3A), University of Zaragoza, Zaragoza, Spain; Department of Mechanical Engineering, University of Zaragoza, Zaragoza, Spain
| | - José Cegoñino
- Group of Biomaterials, Aragon Institute of Engineering Research (I3A), University of Zaragoza, Zaragoza, Spain; Department of Mechanical Engineering, University of Zaragoza, Zaragoza, Spain
| | - Elvira Orduna
- Ophthalmology Department, Miguel Servet University Hospital, Zaragoza, Spain; GIMSO Research and Innovative Group, Aragon Institute for Health Research (IIS Aragon), Zaragoza, Spain
| | - Elisa Vilades
- Ophthalmology Department, Miguel Servet University Hospital, Zaragoza, Spain; GIMSO Research and Innovative Group, Aragon Institute for Health Research (IIS Aragon), Zaragoza, Spain
| | - Elena Garcia-Martin
- Ophthalmology Department, Miguel Servet University Hospital, Zaragoza, Spain; GIMSO Research and Innovative Group, Aragon Institute for Health Research (IIS Aragon), Zaragoza, Spain
| | - Amaya Pérez Del Palomar
- Group of Biomaterials, Aragon Institute of Engineering Research (I3A), University of Zaragoza, Zaragoza, Spain; Department of Mechanical Engineering, University of Zaragoza, Zaragoza, Spain.
| |
Collapse
|