1
|
Demuth S, Paris J, Faddeenkov I, De Sèze J, Gourraud PA. Clinical applications of deep learning in neuroinflammatory diseases: A scoping review. Rev Neurol (Paris) 2024:S0035-3787(24)00522-8. [PMID: 38772806 DOI: 10.1016/j.neurol.2024.04.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2024] [Revised: 03/26/2024] [Accepted: 04/09/2024] [Indexed: 05/23/2024]
Abstract
BACKGROUND Deep learning (DL) is an artificial intelligence technology that has aroused much excitement for predictive medicine due to its ability to process raw data modalities such as images, text, and time series of signals. OBJECTIVES Here, we intend to give the clinical reader elements to understand this technology, taking neuroinflammatory diseases as an illustrative use case of clinical translation efforts. We reviewed the scope of this rapidly evolving field to get quantitative insights about which clinical applications concentrate the efforts and which data modalities are most commonly used. METHODS We queried the PubMed database for articles reporting DL algorithms for clinical applications in neuroinflammatory diseases and the radiology.healthairegister.com website for commercial algorithms. RESULTS The review included 148 articles published between 2018 and 2024 and five commercial algorithms. The clinical applications could be grouped as computer-aided diagnosis, individual prognosis, functional assessment, the segmentation of radiological structures, and the optimization of data acquisition. Our review highlighted important discrepancies in efforts. The segmentation of radiological structures and computer-aided diagnosis currently concentrate most efforts with an overrepresentation of imaging. Various model architectures have addressed different applications, relatively low volume of data, and diverse data modalities. We report the high-level technical characteristics of the algorithms and synthesize narratively the clinical applications. Predictive performances and some common a priori on this topic are finally discussed. CONCLUSION The currently reported efforts position DL as an information processing technology, enhancing existing modalities of paraclinical investigations and bringing perspectives to make innovative ones actionable for healthcare.
Collapse
Affiliation(s)
- S Demuth
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France; Inserm U1119 : biopathologie de la myéline, neuroprotection et stratégies thérapeutiques, University of Strasbourg, 1, rue Eugène-Boeckel - CS 60026, 67084 Strasbourg, France.
| | - J Paris
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France
| | - I Faddeenkov
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France
| | - J De Sèze
- Inserm U1119 : biopathologie de la myéline, neuroprotection et stratégies thérapeutiques, University of Strasbourg, 1, rue Eugène-Boeckel - CS 60026, 67084 Strasbourg, France; Department of Neurology, University Hospital of Strasbourg, 1, avenue Molière, 67200 Strasbourg, France; Inserm CIC 1434 Clinical Investigation Center, University Hospital of Strasbourg, 1, avenue Molière, 67200 Strasbourg, France
| | - P-A Gourraud
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France; "Data clinic", Department of Public Health, University Hospital of Nantes, Nantes, France
| |
Collapse
|
2
|
Chaves H, Serra MM, Shalom DE, Ananía P, Rueda F, Osa Sanz E, Stefanoff NI, Rodríguez Murúa S, Costa ME, Kitamura FC, Yañez P, Cejas C, Correale J, Ferrante E, Fernández Slezak D, Farez MF. Assessing robustness and generalization of a deep neural network for brain MS lesion segmentation on real-world data. Eur Radiol 2024; 34:2024-2035. [PMID: 37650967 DOI: 10.1007/s00330-023-10093-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2023] [Revised: 07/01/2023] [Accepted: 07/12/2023] [Indexed: 09/01/2023]
Abstract
OBJECTIVES Evaluate the performance of a deep learning (DL)-based model for multiple sclerosis (MS) lesion segmentation and compare it to other DL and non-DL algorithms. METHODS This ambispective, multicenter study assessed the performance of a DL-based model for MS lesion segmentation and compared it to alternative DL- and non-DL-based methods. Models were tested on internal (n = 20) and external (n = 18) datasets from Latin America, and on an external dataset from Europe (n = 49). We also examined robustness by rescanning six patients (n = 6) from our MS clinical cohort. Moreover, we studied inter-human annotator agreement and discussed our findings in light of these results. Performance and robustness were assessed using intraclass correlation coefficient (ICC), Dice coefficient (DC), and coefficient of variation (CV). RESULTS Inter-human ICC ranged from 0.89 to 0.95, while spatial agreement among annotators showed a median DC of 0.63. Using expert manual segmentations as ground truth, our DL model achieved a median DC of 0.73 on the internal, 0.66 on the external, and 0.70 on the challenge datasets. The performance of our DL model exceeded that of the alternative algorithms on all datasets. In the robustness experiment, our DL model also achieved higher DC (ranging from 0.82 to 0.90) and lower CV (ranging from 0.7 to 7.9%) when compared to the alternative methods. CONCLUSION Our DL-based model outperformed alternative methods for brain MS lesion segmentation. The model also proved to generalize well on unseen data and has a robust performance and low processing times both on real-world and challenge-based data. CLINICAL RELEVANCE STATEMENT Our DL-based model demonstrated superior performance in accurately segmenting brain MS lesions compared to alternative methods, indicating its potential for clinical application with improved accuracy, robustness, and efficiency. KEY POINTS • Automated lesion load quantification in MS patients is valuable; however, more accurate methods are still necessary. • A novel deep learning model outperformed alternative MS lesion segmentation methods on multisite datasets. • Deep learning models are particularly suitable for MS lesion segmentation in clinical scenarios.
Collapse
Affiliation(s)
- Hernán Chaves
- Diagnostic Imaging Department, Fleni, Montañeses, 2325 (C1428AQK), Ciudad de Buenos Aires, Argentina.
| | - María M Serra
- Diagnostic Imaging Department, Fleni, Montañeses, 2325 (C1428AQK), Ciudad de Buenos Aires, Argentina
| | - Diego E Shalom
- Department of Physics, University of Buenos Aires (UBA), Buenos Aires, Argentina
- Physics Institute of Buenos Aires (IFIBA) CONICET, Buenos Aires, Argentina
- Laboratorio de Neurociencia, Universidad Torcuato Di Tella, Buenos Aires, Argentina
| | | | - Fernanda Rueda
- Radiology Department, Diagnósticos da América SA (Dasa), Rio de Janeiro, Brazil
| | - Emilia Osa Sanz
- Diagnostic Imaging Department, Fleni, Montañeses, 2325 (C1428AQK), Ciudad de Buenos Aires, Argentina
| | - Nadia I Stefanoff
- Diagnostic Imaging Department, Fleni, Montañeses, 2325 (C1428AQK), Ciudad de Buenos Aires, Argentina
| | - Sofía Rodríguez Murúa
- Center for Research On Neuroimmunological Diseases (CIEN), Fleni, Buenos Aires, Argentina
| | | | - Felipe C Kitamura
- DasaInova, Diagnósticos da América SA (Dasa), São Paulo, São Paulo, Brazil
| | - Paulina Yañez
- Diagnostic Imaging Department, Fleni, Montañeses, 2325 (C1428AQK), Ciudad de Buenos Aires, Argentina
| | - Claudia Cejas
- Diagnostic Imaging Department, Fleni, Montañeses, 2325 (C1428AQK), Ciudad de Buenos Aires, Argentina
| | | | - Enzo Ferrante
- Instituto de Investigación en Señales, Sistemas e Inteligencia Computacional, sinc(i) CONICET-UNL, Santa Fe, Argentina
| | - Diego Fernández Slezak
- Center for Research On Neuroimmunological Diseases (CIEN), Fleni, Buenos Aires, Argentina
- Departamento de Computación, Facultad de Ciencias Exactas y Naturales, Universidad de Buenos Aires (UBA), Buenos Aires, Argentina
- Instituto de Investigación en Ciencias de la Computación (ICC), CONICET-UBA, Buenos Aires, Argentina
| | - Mauricio F Farez
- Radiology Department, Diagnósticos da América SA (Dasa), Rio de Janeiro, Brazil
- Center for Research On Neuroimmunological Diseases (CIEN), Fleni, Buenos Aires, Argentina
- Center for Biostatistics, Epidemiology and Public Health (CEBES), Fleni, Buenos Aires, Argentina
| |
Collapse
|
3
|
Weeda MM, van Nederpelt DR, Twisk JWR, Brouwer I, Kuijer JPA, van Dam M, Hulst HE, Killestein J, Barkhof F, Vrenken H, Pouwels PJW. Multimodal MRI study on the relation between WM integrity and connected GM atrophy and its effect on disability in early multiple sclerosis. J Neurol 2024; 271:355-373. [PMID: 37716917 PMCID: PMC10769935 DOI: 10.1007/s00415-023-11937-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Revised: 08/09/2023] [Accepted: 08/11/2023] [Indexed: 09/18/2023]
Abstract
BACKGROUND Multiple sclerosis (MS) is characterized by pathology in white matter (WM) and atrophy of grey matter (GM), but it remains unclear how these processes are related, or how they influence clinical progression. OBJECTIVE To study the spatial and temporal relationship between GM atrophy and damage in connected WM in relapsing-remitting (RR) MS in relation to clinical progression. METHODS Healthy control (HC) and early RRMS subjects visited our center twice with a 1-year interval for MRI and clinical examinations, including the Expanded Disability Status Scale (EDSS) and Multiple Sclerosis Functional Composite (MSFC) scores. RRMS subjects were categorized as MSFC decliners or non-decliners based on ΔMSFC over time. Ten deep (D)GM and 62 cortical (C) GM structures were segmented and probabilistic tractography was performed to identify the connected WM. WM integrity was determined per tract with, amongst others, fractional anisotropy (FA), mean diffusivity (MD), neurite density index (NDI), and myelin water fraction (MWF). Linear mixed models (LMMs) were used to investigate GM and WM differences between HC and RRMS, and between MSFC decliners and non-decliners. LMM was also used to test associations between baseline WM z-scores and changes in connected GM z-scores, and between baseline GM z-scores and changes in connected WM z-scores, in HC/RRMS subjects and in MSFC decliners/non-decliners. RESULTS We included 13 HCs and 31 RRMS subjects with an average disease duration of 3.5 years and a median EDSS of 3.0. Fifteen RRMS subjects showed declining MSFC scores over time, and they showed higher atrophy rates and greater WM integrity loss compared to non-decliners. Lower baseline WM integrity was associated with increased CGM atrophy over time in RRMS, but not in HC subjects. This effect was only seen in MSFC decliners, especially when an extended WM z-score was used, which included FA, MD, NDI and MWF. Baseline GM measures were not significantly related to WM integrity changes over time in any of the groups. DISCUSSION Lower baseline WM integrity was related to more cortical atrophy in RRMS subjects that showed clinical progression over a 1-year follow-up, while baseline GM did not affect WM integrity changes over time. WM damage, therefore, seems to drive atrophy more than conversely.
Collapse
Affiliation(s)
- Merlin M Weeda
- MS Center Amsterdam, Radiology and Nuclear Medicine, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands.
| | - D R van Nederpelt
- MS Center Amsterdam, Radiology and Nuclear Medicine, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands
| | - J W R Twisk
- Epidemiology and Data Science, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands
| | - I Brouwer
- MS Center Amsterdam, Radiology and Nuclear Medicine, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands
| | - J P A Kuijer
- MS Center Amsterdam, Radiology and Nuclear Medicine, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands
| | - M van Dam
- MS Center Amsterdam, Anatomy and Neurosciences, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands
| | - H E Hulst
- Health-, Medical-, and Neuropsychology Unit, Institute of Psychology, Leiden University, Leiden, The Netherlands
| | - J Killestein
- MS Center Amsterdam, Neurology, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands
| | - F Barkhof
- MS Center Amsterdam, Radiology and Nuclear Medicine, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands
- UCL Queen Square Institute of Neurology and Centre for Medical Image Computing, University College London, London, UK
| | - H Vrenken
- MS Center Amsterdam, Radiology and Nuclear Medicine, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands
| | - P J W Pouwels
- MS Center Amsterdam, Radiology and Nuclear Medicine, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, Amsterdam UMC Location VUmc, Amsterdam, The Netherlands
| |
Collapse
|
4
|
Wahlig SG, Nedelec P, Weiss DA, Rudie JD, Sugrue LP, Rauschecker AM. 3D U-Net for automated detection of multiple sclerosis lesions: utility of transfer learning from other pathologies. Front Neurosci 2023; 17:1188336. [PMID: 37965219 PMCID: PMC10641790 DOI: 10.3389/fnins.2023.1188336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Accepted: 09/26/2023] [Indexed: 11/16/2023] Open
Abstract
Background and purpose Deep learning algorithms for segmentation of multiple sclerosis (MS) plaques generally require training on large datasets. This manuscript evaluates the effect of transfer learning from segmentation of another pathology to facilitate use of smaller MS-specific training datasets. That is, a model trained for detection of one type of pathology was re-trained to identify MS lesions and active demyelination. Materials and methods In this retrospective study using MRI exams from 149 patients spanning 4/18/2014 to 7/8/2021, 3D convolutional neural networks were trained with a variable number of manually-segmented MS studies. Models were trained for FLAIR lesion segmentation at a single timepoint, new FLAIR lesion segmentation comparing two timepoints, and enhancing (actively demyelinating) lesion segmentation on T1 post-contrast imaging. Models were trained either de-novo or fine-tuned with transfer learning applied to a pre-existing model initially trained on non-MS data. Performance was evaluated with lesionwise sensitivity and positive predictive value (PPV). Results For single timepoint FLAIR lesion segmentation with 10 training studies, a fine-tuned model demonstrated improved performance [lesionwise sensitivity 0.55 ± 0.02 (mean ± standard error), PPV 0.66 ± 0.02] compared to a de-novo model (sensitivity 0.49 ± 0.02, p = 0.001; PPV 0.32 ± 0.02, p < 0.001). For new lesion segmentation with 30 training studies and their prior comparisons, a fine-tuned model demonstrated similar sensitivity (0.49 ± 0.05) and significantly improved PPV (0.60 ± 0.05) compared to a de-novo model (sensitivity 0.51 ± 0.04, p = 0.437; PPV 0.43 ± 0.04, p = 0.002). For enhancement segmentation with 20 training studies, a fine-tuned model demonstrated significantly improved overall performance (sensitivity 0.74 ± 0.06, PPV 0.69 ± 0.05) compared to a de-novo model (sensitivity 0.44 ± 0.09, p = 0.001; PPV 0.37 ± 0.05, p = 0.001). Conclusion By fine-tuning models trained for other disease pathologies with MS-specific data, competitive models identifying existing MS plaques, new MS plaques, and active demyelination can be built with substantially smaller datasets than would otherwise be required to train new models.
Collapse
Affiliation(s)
- Stephen G. Wahlig
- Center for Intelligent Imaging (ci), Department of Radiology and Biomedical Imaging, University of California, San Francisco, San Francisco, CA, United States
| | - Pierre Nedelec
- Center for Intelligent Imaging (ci), Department of Radiology and Biomedical Imaging, University of California, San Francisco, San Francisco, CA, United States
| | - David A. Weiss
- Center for Intelligent Imaging (ci), Department of Radiology and Biomedical Imaging, University of California, San Francisco, San Francisco, CA, United States
| | - Jeffrey D. Rudie
- Center for Intelligent Imaging (ci), Department of Radiology and Biomedical Imaging, University of California, San Francisco, San Francisco, CA, United States
- Department of Radiology, University of California, San Diego, San Diego, CA, United States
| | - Leo P. Sugrue
- Center for Intelligent Imaging (ci), Department of Radiology and Biomedical Imaging, University of California, San Francisco, San Francisco, CA, United States
| | - Andreas M. Rauschecker
- Center for Intelligent Imaging (ci), Department of Radiology and Biomedical Imaging, University of California, San Francisco, San Francisco, CA, United States
| |
Collapse
|
5
|
Gentile G, Jenkinson M, Griffanti L, Luchetti L, Leoncini M, Inderyas M, Mortilla M, Cortese R, De Stefano N, Battaglini M. BIANCA-MS: An optimized tool for automated multiple sclerosis lesion segmentation. Hum Brain Mapp 2023; 44:4893-4913. [PMID: 37530598 PMCID: PMC10472913 DOI: 10.1002/hbm.26424] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Revised: 05/20/2023] [Accepted: 07/06/2023] [Indexed: 08/03/2023] Open
Abstract
In this work we present BIANCA-MS, a novel tool for brain white matter lesion segmentation in multiple sclerosis (MS), able to generalize across both the wide spectrum of MRI acquisition protocols and the heterogeneity of manually labeled data. BIANCA-MS is based on the original version of BIANCA and implements two innovative elements: a harmonized setting, tested under different MRI protocols, which avoids the need to further tune algorithm parameters to each dataset; and a cleaning step developed to improve consistency in automated and manual segmentations, thus reducing unwanted variability in output segmentations and validation data. BIANCA-MS was tested on three datasets, acquired with different MRI protocols. First, we compared BIANCA-MS to other widely used tools. Second, we tested how BIANCA-MS performs in separate datasets. Finally, we evaluated BIANCA-MS performance on a pooled dataset where all MRI data were merged. We calculated the overlap using the DICE spatial similarity index (SI) as well as the number of false positive/negative clusters (nFPC/nFNC) in comparison to the manual masks processed with the cleaning step. BIANCA-MS clearly outperformed other available tools in both high- and low-resolution images and provided comparable performance across different scanning protocols, sets of modalities and image resolutions. BIANCA-MS performance on the pooled dataset (SI: 0.72 ± 0.25, nFPC: 13 ± 11, nFNC: 4 ± 8) were comparable to those achieved on each individual dataset (median across datasets SI: 0.72 ± 0.28, nFPC: 14 ± 11, nFNC: 4 ± 8). Our findings suggest that BIANCA-MS is a robust and accurate approach for automated MS lesion segmentation.
Collapse
Affiliation(s)
- Giordano Gentile
- Department of Medicine, Surgery and NeuroscienceUniversity of SienaSienaItaly
- SIENA Imaging SRLSienaItaly
| | - Mark Jenkinson
- Welcome Centre for Integrative Neuroimaging (WIN), FMRIB, Nuffield Department of Clinical NeurosciencesUniversity of Oxford, John Radcliffe HospitalOxfordUK
- Australian Institute of Machine Learning (AIML), School of Computer and Mathematical SciencesUniversity of AdelaideAdelaideSouth AustraliaAustralia
- South Australian Health and Medical Research Institute (SAHMRI)AdelaideSouth AustraliaAustralia
| | - Ludovica Griffanti
- Welcome Centre for Integrative Neuroimaging (WIN), FMRIB, Nuffield Department of Clinical NeurosciencesUniversity of Oxford, John Radcliffe HospitalOxfordUK
- Welcome Centre for Integrative Neuroimaging (WIN), OHBA, Department of PsychiatryUniversity of Oxford, Warneford HospitalOxfordUK
| | - Ludovico Luchetti
- Department of Medicine, Surgery and NeuroscienceUniversity of SienaSienaItaly
| | - Matteo Leoncini
- Department of Medicine, Surgery and NeuroscienceUniversity of SienaSienaItaly
- SIENA Imaging SRLSienaItaly
| | - Maira Inderyas
- Department of Medicine, Surgery and NeuroscienceUniversity of SienaSienaItaly
- SIENA Imaging SRLSienaItaly
| | | | - Rosa Cortese
- Department of Medicine, Surgery and NeuroscienceUniversity of SienaSienaItaly
| | - Nicola De Stefano
- Department of Medicine, Surgery and NeuroscienceUniversity of SienaSienaItaly
| | - Marco Battaglini
- Department of Medicine, Surgery and NeuroscienceUniversity of SienaSienaItaly
- SIENA Imaging SRLSienaItaly
| |
Collapse
|
6
|
Wang W, Shi L, Ma H, Zhu S, Ge Y, Xu K. Comparison of the clinical value of MRI and plasma markers for cognitive impairment in patients aged ≥75 years: a retrospective study. PeerJ 2023; 11:e15581. [PMID: 37366421 PMCID: PMC10290829 DOI: 10.7717/peerj.15581] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Accepted: 05/26/2023] [Indexed: 06/28/2023] Open
Abstract
Background Dementia has become the main cause of disability in older adults aged ≥75 years. Cerebral small vessel disease (CSVD) is involved in cognitive impairment (CI) and dementia and is a cause of vascular CI (VCI), which is manageable and its onset and progression can be delayed. Simple and effective markers will be beneficial to the early detection and intervention of CI. The aim of this study is to investigate the clinical application value of plasma amyloid β1-42 (Aβ42), phosphorylated tau 181 (p-tau181) and conventional structural magnetic resonance imaging (MRI) parameters for cognitive impairment (CI) in patients aged ≥75 years. Methods We retrospectively selected patients who visited the Affiliated Hospital of Xuzhou Medical University and were clinically diagnosed with or without cognitive dysfunction between May 2018 and November 2021. Plasma indicators (Aβ42 and p-tau181) and conventional structural MRI parameters were collected and analyzed. Multivariate logistic regression and receiver operator characteristic (ROC) curve were used to evaluate the diagnostic value. Results One hundred and eighty-four subjects were included, including 54 cases in CI group and 130 cases in noncognitive impairment (NCI) groups, respectively. Univariate logistic regression analysis revealed that the percentages of Aβ42+, P-tau 181+, and Aβ42+/P-tau181+ showed no significant difference between the groups of CI and NCI (all P > 0.05). Multivariate logistic regression analysis showed that moderate/severe periventricular WMH (PVWMH) (OR 2.857, (1.365-5.983), P = 0.005), lateral ventricle body index (LVBI) (OR 0.413, (0.243-0.700), P = 0.001), and cortical atrophy (OR 1.304, (1.079-1.575), P = 0.006) were factors associated with CI. The combined model including PVWMH, LVBI, and cortical atrophy to detect CI and NCI showed an area under the ROC curve (AUROC) is 0.782, with the sensitivity and specificity 68.5% and 78.5%, respectively. Conclusion For individuals ≥75 years, plasma Aβ42 and P-tau181 might not be associated with cognitive impairment, and MRI parameters, including PVWMH, LVBI and cortical atrophy, are related to CI. The cognitive statuses of people over 75 years old were used as the endpoint event in this study. Therefore, it can be considered that these MRI markers might have more important clinical significance for early assessment and dynamic observation, but more studies are still needed to verify this hypothesis.
Collapse
Affiliation(s)
- Wei Wang
- Nanjing Medical University, Nanjing, Jiangsu, China
- Department of Radiology, The Affiliated Hospital of Xuzhou Medical University, Xuzhou, Jiangsu, China
- School of Medical Imaging, Xuzhou Medical University, Xuzhou, Jiangsu, China
- Institute of Medical Imaging and Digital Medicine, Xuzhou Medical University, Xuzhou, Jiangsu, China
| | - Lin Shi
- Department of Radiology, The Second Affiliated Hospital of Shandong First Medical University, Taian, Shangdong, China
| | - Hong Ma
- Department of Radiology, The Affiliated Hospital of Xuzhou Medical University, Xuzhou, Jiangsu, China
- School of Medical Imaging, Xuzhou Medical University, Xuzhou, Jiangsu, China
- Institute of Medical Imaging and Digital Medicine, Xuzhou Medical University, Xuzhou, Jiangsu, China
| | - Shiguang Zhu
- Department of Neurology, The Affiliated Hospital of Xuzhou Medical University, Xuzhou, Jiangsu, China
| | - Yaqiong Ge
- GE Healthcare, Precision Health Institution, Shanghai, China
| | - Kai Xu
- Nanjing Medical University, Nanjing, Jiangsu, China
- Department of Radiology, The Affiliated Hospital of Xuzhou Medical University, Xuzhou, Jiangsu, China
- School of Medical Imaging, Xuzhou Medical University, Xuzhou, Jiangsu, China
- Institute of Medical Imaging and Digital Medicine, Xuzhou Medical University, Xuzhou, Jiangsu, China
| |
Collapse
|
7
|
Automatic Intelligent System Using Medical of Things for Multiple Sclerosis Detection. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2023; 2023:4776770. [PMID: 36864930 PMCID: PMC9974276 DOI: 10.1155/2023/4776770] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/24/2022] [Revised: 07/31/2022] [Accepted: 08/16/2022] [Indexed: 02/25/2023]
Abstract
Malfunctions in the immune system cause multiple sclerosis (MS), which initiates mild to severe nerve damage. MS will disturb the signal communication between the brain and other body parts, and early diagnosis will help reduce the harshness of MS in humankind. Magnetic resonance imaging (MRI) supported MS detection is a standard clinical procedure in which the bio-image recorded with a chosen modality is considered to assess the severity of the disease. The proposed research aims to implement a convolutional neural network (CNN) supported scheme to detect MS lesions in the chosen brain MRI slices. The stages of this framework include (i) image collection and resizing, (ii) deep feature mining, (iii) hand-crafted feature mining, (iii) feature optimization with firefly algorithm, and (iv) serial feature integration and classification. In this work, five-fold cross-validation is executed, and the final result is considered for the assessment. The brain MRI slices with/without the skull section are examined separately, presenting the attained results. The experimental outcome of this study confirms that the VGG16 with random forest (RF) classifier offered a classification accuracy of >98% MRI with skull, and VGG16 with K-nearest neighbor (KNN) provided an accuracy of >98% without the skull.
Collapse
|
8
|
Sarica B, Seker DZ, Bayram B. A dense residual U-net for multiple sclerosis lesions segmentation from multi-sequence 3D MR images. Int J Med Inform 2023; 170:104965. [PMID: 36580821 DOI: 10.1016/j.ijmedinf.2022.104965] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Accepted: 12/08/2022] [Indexed: 12/28/2022]
Abstract
Multiple Sclerosis (MS) is an autoimmune disease that causes brain and spinal cord lesions, which magnetic resonance imaging (MRI) can detect and characterize. Recently, deep learning methods have achieved remarkable results in the automated segmentation of MS lesions from MRI data. Hence, this study proposes a novel dense residual U-Net model that combines attention gate (AG), efficient channel attention (ECA), and Atrous Spatial Pyramid Pooling (ASPP) to enhance the performance of the automatic MS lesion segmentation using 3D MRI sequences. First, convolution layers in each block of the U-Net architecture are replaced by residual blocks and connected densely. Then, AGs are exploited to capture salient features passed through the skip connections. The ECA module is appended at the end of each residual block and each downsampling block of U-Net. Later, the bottleneck of U-Net is replaced with the ASSP module to extract multi-scale contextual information. Furthermore, 3D MR images of Fluid Attenuated Inversion Recovery (FLAIR), T1-weighted (T1-w), and T2-weighted (T2-w) are exploited jointly to perform better MS lesion segmentation. The proposed model is validated on the publicly available ISBI2015 and MSSEG2016 challenge datasets. This model produced an ISBI score of 92.75, a mean Dice score of 66.88%, a mean positive predictive value (PPV) of 86.50%, and a mean lesion-wise true positive rate (LTPR) of 60.64% on the ISBI2015 testing set. Also, it achieved a mean Dice score of 67.27%, a mean PPV of 65.19%, and a mean sensitivity of 74.40% on the MSSEG2016 testing set. The results show that the proposed model performs better than the results of some experts and some of the other state-of-the-art methods realized related to this particular subject. Specifically, the best Dice score and the best LTPR are obtained on the ISBI2015 testing set by using the proposed model to segment MS lesions.
Collapse
Affiliation(s)
- Beytullah Sarica
- Istanbul Technical University, Graduate School, Department of Applied Informatics, Istanbul, 34469, Turkey.
| | - Dursun Zafer Seker
- Istanbul Technical University, Civil Engineering Faculty, Department of Geomatics Engineering, Istanbul, 34469, Turkey.
| | - Bulent Bayram
- Yildiz Technical University, Civil Engineering Faculty, Department of Geomatics Engineering, Istanbul, 34220, Turkey.
| |
Collapse
|
9
|
Diaz-Hurtado M, Martínez-Heras E, Solana E, Casas-Roma J, Llufriu S, Kanber B, Prados F. Recent advances in the longitudinal segmentation of multiple sclerosis lesions on magnetic resonance imaging: a review. Neuroradiology 2022; 64:2103-2117. [PMID: 35864180 DOI: 10.1007/s00234-022-03019-3] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Accepted: 07/12/2022] [Indexed: 01/18/2023]
Abstract
Multiple sclerosis (MS) is a chronic autoimmune disease characterized by demyelinating lesions that are often visible on magnetic resonance imaging (MRI). Segmentation of these lesions can provide imaging biomarkers of disease burden that can help monitor disease progression and the imaging response to treatment. Manual delineation of MRI lesions is tedious and prone to subjective bias, while automated lesion segmentation methods offer objectivity and speed, the latter being particularly important when analysing large datasets. Lesion segmentation can be broadly categorised into two groups: cross-sectional methods, which use imaging data acquired at a single time-point to characterise MRI lesions; and longitudinal methods, which use imaging data from the same subject acquired at two or more different time-points to characterise lesions over time. The main objective of longitudinal segmentation approaches is to more accurately detect the presence of new MS lesions and the growth or remission of existing lesions, which may be effective biomarkers of disease progression and treatment response. This paper reviews articles on longitudinal MS lesion segmentation methods published over the past 10 years. These are divided into traditional machine learning methods and deep learning techniques. PubMed articles using longitudinal information and comparing fully automatic two time point segmentations in any step of the process were selected. Nineteen articles were reviewed. There is an increasing number of deep learning techniques for longitudinal MS lesion segmentation that are promising to help better understand disease progression.
Collapse
Affiliation(s)
| | - Eloy Martínez-Heras
- Center of Neuroimmunology, Laboratory of Advanced Imaging in Neuroimmunological Diseases, Hospital Clinic Barcelona, Institut d'Investigacions Biomèdiques August Pi I Sunyer (IDIBAPS), Universitat de Barcelona, Barcelona, Spain
| | - Elisabeth Solana
- Center of Neuroimmunology, Laboratory of Advanced Imaging in Neuroimmunological Diseases, Hospital Clinic Barcelona, Institut d'Investigacions Biomèdiques August Pi I Sunyer (IDIBAPS), Universitat de Barcelona, Barcelona, Spain
| | - Jordi Casas-Roma
- E-Health Center, Universitat Oberta de Catalunya, Barcelona, Spain
| | - Sara Llufriu
- Center of Neuroimmunology, Laboratory of Advanced Imaging in Neuroimmunological Diseases, Hospital Clinic Barcelona, Institut d'Investigacions Biomèdiques August Pi I Sunyer (IDIBAPS), Universitat de Barcelona, Barcelona, Spain
| | - Baris Kanber
- Centre for Medical Image Computing, Department of Medical Physics and Biomedical Engineering, University College London, London, UK.,National Institute for Health Research Biomedical Research Centre, University College London, London, UK.,Queen Square MS Centre, Department of Neuroinflammation, Faculty of Brain Sciences, UCL Institute of Neurology, University College London, London, UK
| | - Ferran Prados
- E-Health Center, Universitat Oberta de Catalunya, Barcelona, Spain.,Centre for Medical Image Computing, Department of Medical Physics and Biomedical Engineering, University College London, London, UK.,National Institute for Health Research Biomedical Research Centre, University College London, London, UK.,Queen Square MS Centre, Department of Neuroinflammation, Faculty of Brain Sciences, UCL Institute of Neurology, University College London, London, UK
| |
Collapse
|
10
|
Framework to Segment and Evaluate Multiple Sclerosis Lesion in MRI Slices Using VGG-UNet. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:4928096. [PMID: 35694573 PMCID: PMC9184172 DOI: 10.1155/2022/4928096] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Accepted: 05/19/2022] [Indexed: 12/12/2022]
Abstract
Multiple sclerosis (MS) is an autoimmune disease that causes mild to severe issues in the central nervous system (CNS). Early detection and treatment are necessary to reduce the harshness of the disease in individuals. The proposed work aims to implement a convolutional neural network (CNN) segmentation scheme to extract the MS lesion in a 2D brain MRI slice. To achieve a better MS detection, this work implemented the VGG-UNet scheme in which the pretrained VGG19 is considered as the encoder section. This scheme is tested on 30 patient images (600 images with dimension 512 × 512 × 3 pixels), and the experimental outcome confirms that this scheme provides a better result compared to traditional UNet, SegNet, VGG-UNet, and VGG-SegNet. The experimental investigation implemented on axial, coronal and sagittal plane 2D slices of Flair modality confirms that this work provides a better value of Jaccard (>85%), Dice (>92%), and accuracy (>98%).
Collapse
|
11
|
De Stefano N, Battaglini M, Pareto D, Cortese R, Zhang J, Oesingmann N, Prados F, Rocca MA, Valsasina P, Vrenken H, Gandini Wheeler-Kingshott CAM, Filippi M, Barkhof F, Rovira À. MAGNIMS recommendations for harmonization of MRI data in MS multicenter studies. Neuroimage Clin 2022; 34:102972. [PMID: 35245791 PMCID: PMC8892169 DOI: 10.1016/j.nicl.2022.102972] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2021] [Revised: 02/22/2022] [Accepted: 02/23/2022] [Indexed: 11/24/2022]
Abstract
Sharing data from cooperative studies is essential to develop new biomarkers in MS. Differences in MRI acquisition, analysis, storage represent a substantial constraint. We review the state of the art and developments in the harmonization of MRI. We provide recommendations to harmonize large MRI datasets in the MS field.
There is an increasing need of sharing harmonized data from large, cooperative studies as this is essential to develop new diagnostic and prognostic biomarkers. In the field of multiple sclerosis (MS), the issue has become of paramount importance due to the need to translate into the clinical setting some of the most recent MRI achievements. However, differences in MRI acquisition parameters, image analysis and data storage across sites, with their potential bias, represent a substantial constraint. This review focuses on the state of the art, recent technical advances, and desirable future developments of the harmonization of acquisition, analysis and storage of large-scale multicentre MRI data of MS cohorts. Huge efforts are currently being made to achieve all the requirements needed to provide harmonized MRI datasets in the MS field, as proper management of large imaging datasets is one of our greatest opportunities and challenges in the coming years. Recommendations based on these achievements will be provided here. Despite the advances that have been made, the complexity of these tasks requires further research by specialized academical centres, with dedicated technical and human resources. Such collective efforts involving different professional figures are of crucial importance to offer to MS patients a personalised management while minimizing consumption of resources.
Collapse
Affiliation(s)
- Nicola De Stefano
- Department of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy.
| | - Marco Battaglini
- Department of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy
| | - Deborah Pareto
- Section of Neuroradiology, Department of Radiology, Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Barcelona, Spain
| | - Rosa Cortese
- Department of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy
| | - Jian Zhang
- Department of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy
| | | | - Ferran Prados
- Queen Square Multiple Sclerosis Centre, Department of Neuroinflammation, UCL Queen Square Institute of Neurology, University College London, London, United Kingdom; Center for Medical Imaging Computing, Medical Physics and Biomedical Engineering, UCL, London, WC1V 6LJ, United Kingdom; e-Health Center, Universitat Oberta de Catalunya, Barcelona, Spain
| | - Maria A Rocca
- Neuroimaging Research Unit, Division of Neuroscience, and Neurology Unit, IRCCS San Raffaele Scientific Institute, Milan, Italy; Neurology Unit, IRCCS San Raffaele Scientific Institute, Milan, Italy; Vita-Salute San Raffaele University, Milan, Italy
| | - Paola Valsasina
- Neuroimaging Research Unit, Division of Neuroscience, and Neurology Unit, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Hugo Vrenken
- Amsterdam Neuroscience, MS Center Amsterdam, Department of Radiology and Nuclear Medicine, Amsterdam UMC, Amsterdam, Netherlands
| | - Claudia A M Gandini Wheeler-Kingshott
- Queen Square Multiple Sclerosis Centre, Department of Neuroinflammation, UCL Queen Square Institute of Neurology, University College London, London, United Kingdom; Brain MRI 3T Research Center, C. Mondino National Neurological Institute, Pavia, Italy; Department of Brain and Behavioural Sciences, University of Pavia, Pavia, Italy
| | - Massimo Filippi
- Neuroimaging Research Unit, Division of Neuroscience, and Neurology Unit, IRCCS San Raffaele Scientific Institute, Milan, Italy; Neurology Unit, IRCCS San Raffaele Scientific Institute, Milan, Italy; Vita-Salute San Raffaele University, Milan, Italy; Neurorehabilitation Unit, and Neurophysiology Service, IRCCS San Raffaele Scientific Institute, Milan, Italy; Neurophysiology Service, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Frederik Barkhof
- Queen Square Multiple Sclerosis Centre, Department of Neuroinflammation, UCL Queen Square Institute of Neurology, University College London, London, United Kingdom; Center for Medical Imaging Computing, Medical Physics and Biomedical Engineering, UCL, London, WC1V 6LJ, United Kingdom; Amsterdam Neuroscience, MS Center Amsterdam, Department of Radiology and Nuclear Medicine, Amsterdam UMC, Amsterdam, Netherlands
| | - Àlex Rovira
- Section of Neuroradiology, Department of Radiology, Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Barcelona, Spain
| |
Collapse
|
12
|
Tran P, Thoprakarn U, Gourieux E, Dos Santos CL, Cavedo E, Guizard N, Cotton F, Krolak-Salmon P, Delmaire C, Heidelberg D, Pyatigorskaya N, Ströer S, Dormont D, Martini JB, Chupin M. Automatic segmentation of white matter hyperintensities: validation and comparison with state-of-the-art methods on both Multiple Sclerosis and elderly subjects. Neuroimage Clin 2022; 33:102940. [PMID: 35051744 PMCID: PMC8896108 DOI: 10.1016/j.nicl.2022.102940] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Revised: 12/15/2021] [Accepted: 01/06/2022] [Indexed: 11/27/2022]
Abstract
Automatic segmentation of MS lesions and age-related WMH from 3D T1 and T2-FLAIR. Comparison to consensus show improved performance of WHASA-3D compared to WHASA. WHASA-3D outperforms available state-of-the-art methods with their default settings. WHASA-3D could be a useful tool for clinical practice and clinical trials.
Different types of white matter hyperintensities (WMH) can be observed through MRI in the brain and spinal cord, especially Multiple Sclerosis (MS) lesions for patients suffering from MS and age-related WMH for subjects with cognitive disorders and/or elderly people. To better diagnose and monitor the disease progression, the quantitative evaluation of WMH load has proven to be useful for clinical routine and trials. Since manual delineation for WMH segmentation is highly time-consuming and suffers from intra and inter observer variability, several methods have been proposed to automatically segment either MS lesions or age-related WMH, but none is validated on both WMH types. Here, we aim at proposing the White matter Hyperintensities Automatic Segmentation Algorithm adapted to 3D T2-FLAIR datasets (WHASA-3D), a fast and robust automatic segmentation tool designed to be implemented in clinical practice for the detection of both MS lesions and age-related WMH in the brain, using both 3D T1-weighted and T2-FLAIR images. In order to increase its robustness for MS lesions, WHASA-3D expands the original WHASA method, which relies on the coupling of non-linear diffusion framework and watershed parcellation, where regions considered as WMH are selected based on intensity and location characteristics, and finally refined with geodesic dilation. The previous validation was performed on 2D T2-FLAIR and subjects with cognitive disorders and elderly subjects. 60 subjects from a heterogeneous database of dementia patients, multiple sclerosis patients and elderly subjects with multiple MRI scanners and a wide range of lesion loads were used to evaluate WHASA and WHASA-3D through volume and spatial agreement in comparison with consensus reference segmentations. In addition, a direct comparison on the MS database with six available supervised and unsupervised state-of-the-art WMH segmentation methods (LST-LGA and LPA, Lesion-TOADS, lesionBrain, BIANCA and nicMSlesions) with default and optimised settings (when feasible) was conducted. WHASA-3D confirmed an improved performance with respect to WHASA, achieving a better spatial overlap (Dice) (0.67 vs 0.63), a reduced absolute volume error (AVE) (3.11 vs 6.2 mL) and an increased volume agreement (intraclass correlation coefficient, ICC) (0.96 vs 0.78). Compared to available state-of-the-art algorithms on the MS database, WHASA-3D outperformed both unsupervised and supervised methods when used with their default settings, showing the highest volume agreement (ICC = 0.95) as well as the highest average Dice (0.58). Optimising and/or retraining LST-LGA, BIANCA and nicMSlesions, using a subset of the MS database as training set, resulted in improved performances on the remaining testing set (average Dice: LST-LGA default/optimized = 0.41/0.51, BIANCA default/optimized = 0.22/0.39, nicMSlesions default/optimized = 0.17/0.63, WHASA-3D = 0.58). Evaluation and comparison results suggest that WHASA-3D is a reliable and easy-to-use method for the automated segmentation of white matter hyperintensities, for both MS lesions and age-related WMH. Further validation on larger datasets would be useful to confirm these first findings.
Collapse
Affiliation(s)
- Philippe Tran
- Qynapse, Paris, France; Equipe-projet ARAMIS, ICM, CNRS UMR 7225, Inserm U1117, Sorbonne Université UMR_S 1127, Centre Inria de Paris, Groupe Hospitalier Pitié-Salpêtrière Charles Foix, Faculté de Médecine Sorbonne Université, Paris, France.
| | | | - Emmanuelle Gourieux
- CATI, ICM, CNRS UMR 7225, Inserm U1117, Sorbonne Université UMR_S 1127, Paris, France; NeuroSpin, CEA, Saclay, France
| | | | | | | | - François Cotton
- Service de Radiologie, Centre Hospitalier Lyon-Sud, Hospices Civils de Lyon, Pierre-Bénite, France; Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1206, F-69495, Pierre-Bénite, France
| | - Pierre Krolak-Salmon
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1206, F-69495, Pierre-Bénite, France; Clinical and Research Memory Centre of Lyon, Hospices Civils de Lyon, Lyon, France; INSERM, U1028, UMR CNRS 5292, Lyon Neuroscience Research Center, Lyon, France
| | | | - Damien Heidelberg
- Service de Radiologie, Centre Hospitalier Lyon-Sud, Hospices Civils de Lyon, Pierre-Bénite, France
| | - Nadya Pyatigorskaya
- Department of Neuroradiology, Groupe Hospitalier Pitié-Salpêtrière, AP-HP, Sorbonne Université UMR_S 1127, Paris, France
| | - Sébastian Ströer
- Department of Neuroradiology, Groupe Hospitalier Pitié-Salpêtrière, AP-HP, Sorbonne Université UMR_S 1127, Paris, France
| | - Didier Dormont
- Equipe-projet ARAMIS, ICM, CNRS UMR 7225, Inserm U1117, Sorbonne Université UMR_S 1127, Centre Inria de Paris, Groupe Hospitalier Pitié-Salpêtrière Charles Foix, Faculté de Médecine Sorbonne Université, Paris, France; Department of Neuroradiology, Groupe Hospitalier Pitié-Salpêtrière, AP-HP, Sorbonne Université UMR_S 1127, Paris, France
| | | | - Marie Chupin
- CATI, ICM, CNRS UMR 7225, Inserm U1117, Sorbonne Université UMR_S 1127, Paris, France
| | | |
Collapse
|
13
|
Wulms N, Redmann L, Herpertz C, Bonberg N, Berger K, Sundermann B, Minnerup H. The Effect of Training Sample Size on the Prediction of White Matter Hyperintensity Volume in a Healthy Population Using BIANCA. Front Aging Neurosci 2022; 13:720636. [PMID: 35126084 PMCID: PMC8812526 DOI: 10.3389/fnagi.2021.720636] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Accepted: 11/29/2021] [Indexed: 12/01/2022] Open
Abstract
Introduction: White matter hyperintensities of presumed vascular origin (WMH) are an important magnetic resonance imaging marker of cerebral small vessel disease and are associated with cognitive decline, stroke, and mortality. Their relevance in healthy individuals, however, is less clear. This is partly due to the methodological challenge of accurately measuring rare and small WMH with automated segmentation programs. In this study, we tested whether WMH volumetry with FMRIB software library v6.0 (FSL; https://fsl.fmrib.ox.ac.uk/fsl/fslwiki) Brain Intensity AbNormality Classification Algorithm (BIANCA), a customizable and trainable algorithm that quantifies WMH volume based on individual data training sets, can be optimized for a normal aging population. Methods: We evaluated the effect of varying training sample sizes on the accuracy and the robustness of the predicted white matter hyperintensity volume in a population (n = 201) with a low prevalence of confluent WMH and a substantial proportion of participants without WMH. BIANCA was trained with seven different sample sizes between 10 and 40 with increments of 5. For each sample size, 100 random samples of T1w and FLAIR images were drawn and trained with manually delineated masks. For validation, we defined an internal and external validation set and compared the mean absolute error, resulting from the difference between manually delineated and predicted WMH volumes for each set. For spatial overlap, we calculated the Dice similarity index (SI) for the external validation cohort. Results: The study population had a median WMH volume of 0.34 ml (IQR of 1.6 ml) and included n = 28 (18%) participants without any WMH. The mean absolute error of the difference between BIANCA prediction and manually delineated masks was minimized and became more robust with an increasing number of training participants. The lowest mean absolute error of 0.05 ml (SD of 0.24 ml) was identified in the external validation set with a training sample size of 35. Compared to the volumetric overlap, the spatial overlap was poor with an average Dice similarity index of 0.14 (SD 0.16) in the external cohort, driven by subjects with very low lesion volumes. Discussion: We found that the performance of BIANCA, particularly the robustness of predictions, could be optimized for use in populations with a low WMH load by enlargement of the training sample size. Further work is needed to evaluate and potentially improve the prediction accuracy for low lesion volumes. These findings are important for current and future population-based studies with the majority of participants being normal aging people.
Collapse
Affiliation(s)
- Niklas Wulms
- Institute of Epidemiology and Social Medicine, University of Muenster, Muenster, Germany
- *Correspondence: Niklas Wulms
| | - Lea Redmann
- Institute of Epidemiology and Social Medicine, University of Muenster, Muenster, Germany
| | - Christine Herpertz
- Institute of Epidemiology and Social Medicine, University of Muenster, Muenster, Germany
| | - Nadine Bonberg
- Institute of Epidemiology and Social Medicine, University of Muenster, Muenster, Germany
| | - Klaus Berger
- Institute of Epidemiology and Social Medicine, University of Muenster, Muenster, Germany
| | - Benedikt Sundermann
- Clinic of Radiology, University Hospital Muenster, Muenster, Germany
- Institute of Radiology and Neuroradiology, Evangelisches Krankenhaus, Medical Campus, University of Oldenburg, Oldenburg, Germany
- Research Center Neurosensory Science, University of Oldenburg, Oldenburg, Germany
| | - Heike Minnerup
- Institute of Epidemiology and Social Medicine, University of Muenster, Muenster, Germany
| |
Collapse
|
14
|
Hindsholm AM, Cramer SP, Simonsen HJ, Frederiksen JL, Andersen F, Højgaard L, Ladefoged CN, Lindberg U. Assessment of Artificial Intelligence Automatic Multiple Sclerosis Lesion Delineation Tool for Clinical Use. Clin Neuroradiol 2021; 32:643-653. [PMID: 34542644 PMCID: PMC9424132 DOI: 10.1007/s00062-021-01089-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Accepted: 08/16/2021] [Indexed: 11/24/2022]
Abstract
PURPOSE To implement and validate an existing algorithm for automatic delineation of white matter lesions on magnetic resonance imaging (MRI) in patients with multiple sclerosis (MS) on a local single-center dataset. METHODS We implemented a white matter hyperintensity segmentation model, based on a 2D convolutional neural network, using the conventional T2-weighted fluid attenuated inversion recovery (FLAIR) MRI sequence as input. The model was adapted for delineation of MS lesions by further training on a local dataset of 93 MS patients with a total of 3040 lesions. A quantitative evaluation was performed on ten test patients, in which model-generated masks were compared to manually delineated masks from two expert delineators. A subsequent qualitative evaluation of the implemented model was performed by two expert delineators, in which generated delineation masks on a clinical dataset of 53 patients were rated acceptable (< 10% errors) or unacceptable (> 10% errors) based on the total number of true lesions. RESULTS The quantitative evaluation resulted in an average accuracy score (F1) of 0.71, recall of 0.77 and dice similarity coefficient of 0.62. Our implemented model obtained the highest scores in all three metrics, when compared to three out of the box lesion segmentation models. In the clinical evaluation an average of 94% of our 53 model-generated masks were rated acceptable. CONCLUSION After adaptation to our local dataset, the implemented segmentation model was able to delineate MS lesions with a high clinical value as rated by delineation experts while outperforming popular out of the box applications. This serves as a promising step towards implementation of automatic lesion delineation in our MS clinic.
Collapse
Affiliation(s)
- Amalie Monberg Hindsholm
- Department of Clinical Physiology, Nuclear Medicine and PET, Rigshospitalet, University of Copenhagen, Blegdamsvej 9, 2100, Copenhagen east, Denmark.
| | - Stig Præstekjær Cramer
- Department of Clinical Physiology, Nuclear Medicine and PET, Rigshospitalet, University of Copenhagen, Blegdamsvej 9, 2100, Copenhagen east, Denmark
| | - Helle Juhl Simonsen
- Department of Clinical Physiology, Nuclear Medicine and PET, Rigshospitalet, University of Copenhagen, Blegdamsvej 9, 2100, Copenhagen east, Denmark
| | - Jette Lautrup Frederiksen
- Danish Multiple Sclerosis Center, Department of Neurology, Rigshospitalet, University of Copenhagen, Valdemar Hansens Vej 13, 2600, Glostrup, Denmark
| | - Flemming Andersen
- Department of Clinical Physiology, Nuclear Medicine and PET, Rigshospitalet, University of Copenhagen, Blegdamsvej 9, 2100, Copenhagen east, Denmark
| | - Liselotte Højgaard
- Department of Clinical Physiology, Nuclear Medicine and PET, Rigshospitalet, University of Copenhagen, Blegdamsvej 9, 2100, Copenhagen east, Denmark
| | - Claes Nøhr Ladefoged
- Department of Clinical Physiology, Nuclear Medicine and PET, Rigshospitalet, University of Copenhagen, Blegdamsvej 9, 2100, Copenhagen east, Denmark
| | - Ulrich Lindberg
- Department of Clinical Physiology, Nuclear Medicine and PET, Rigshospitalet, University of Copenhagen, Blegdamsvej 9, 2100, Copenhagen east, Denmark
| |
Collapse
|
15
|
Kontopodis EE, Papadaki E, Trivizakis E, Maris TG, Simos P, Papadakis GZ, Tsatsakis A, Spandidos DA, Karantanas A, Marias K. Emerging deep learning techniques using magnetic resonance imaging data applied in multiple sclerosis and clinical isolated syndrome patients (Review). Exp Ther Med 2021; 22:1149. [PMID: 34504594 PMCID: PMC8393268 DOI: 10.3892/etm.2021.10583] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Accepted: 07/29/2021] [Indexed: 12/18/2022] Open
Abstract
Computer-aided diagnosis systems aim to assist clinicians in the early identification of abnormal signs in order to optimize the interpretation of medical images and increase diagnostic precision. Multiple sclerosis (MS) and clinically isolated syndrome (CIS) are chronic inflammatory, demyelinating diseases affecting the central nervous system. Recent advances in deep learning (DL) techniques have led to novel computational paradigms in MS and CIS imaging designed for automatic segmentation and detection of areas of interest and automatic classification of anatomic structures, as well as optimization of neuroimaging protocols. To this end, there are several publications presenting artificial intelligence-based predictive models aiming to increase diagnostic accuracy and to facilitate optimal clinical management in patients diagnosed with MS and/or CIS. The current study presents a thorough review covering DL techniques that have been applied in MS and CIS during recent years, shedding light on their current advances and limitations.
Collapse
Affiliation(s)
- Eleftherios E Kontopodis
- Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research and Technology-Hellas, 70013 Heraklion, Greece.,Department of Radiology, Medical School, University of Crete, 70013 Heraklion, Greece
| | - Efrosini Papadaki
- Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research and Technology-Hellas, 70013 Heraklion, Greece.,Department of Radiology, Medical School, University of Crete, 70013 Heraklion, Greece
| | - Eleftherios Trivizakis
- Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research and Technology-Hellas, 70013 Heraklion, Greece.,Department of Radiology, Medical School, University of Crete, 70013 Heraklion, Greece
| | - Thomas G Maris
- Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research and Technology-Hellas, 70013 Heraklion, Greece.,Department of Radiology, Medical School, University of Crete, 70013 Heraklion, Greece
| | - Panagiotis Simos
- Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research and Technology-Hellas, 70013 Heraklion, Greece.,Department of Psychiatry and Behavioral Sciences, Medical School, University of Crete, 70013 Heraklion, Greece
| | - Georgios Z Papadakis
- Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research and Technology-Hellas, 70013 Heraklion, Greece.,Department of Radiology, Medical School, University of Crete, 70013 Heraklion, Greece
| | - Aristidis Tsatsakis
- Centre of Toxicology Science and Research, Faculty of Medicine, University of Crete, 71003 Heraklion, Greece
| | - Demetrios A Spandidos
- Laboratory of Clinical Virology, Medical School, University of Crete, 71003 Heraklion, Greece
| | - Apostolos Karantanas
- Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research and Technology-Hellas, 70013 Heraklion, Greece.,Department of Radiology, Medical School, University of Crete, 70013 Heraklion, Greece
| | - Kostas Marias
- Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research and Technology-Hellas, 70013 Heraklion, Greece.,Department of Electrical and Computer Engineering, Hellenic Mediterranean University, 71410 Heraklion, Greece
| |
Collapse
|
16
|
Ngamsombat C, Gonçalves Filho ALM, Longo MGF, Cauley SF, Setsompop K, Kirsch JE, Tian Q, Fan Q, Polak D, Liu W, Lo WC, Gilberto González R, Schaefer PW, Rapalino O, Conklin J, Huang SY. Evaluation of Ultrafast Wave-Controlled Aliasing in Parallel Imaging 3D-FLAIR in the Visualization and Volumetric Estimation of Cerebral White Matter Lesions. AJNR Am J Neuroradiol 2021; 42:1584-1590. [PMID: 34244127 DOI: 10.3174/ajnr.a7191] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2021] [Accepted: 03/29/2021] [Indexed: 12/18/2022]
Abstract
BACKGROUND AND PURPOSE Our aim was to evaluate an ultrafast 3D-FLAIR sequence using Wave-controlled aliasing in parallel imaging encoding (Wave-FLAIR) compared with standard 3D-FLAIR in the visualization and volumetric estimation of cerebral white matter lesions in a clinical setting. MATERIALS AND METHODS Forty-two consecutive patients underwent 3T brain MR imaging, including standard 3D-FLAIR (acceleration factor = 2, scan time = 7 minutes 50 seconds) and resolution-matched ultrafast Wave-FLAIR sequences (acceleration factor = 6, scan time = 2 minutes 45 seconds for the 20-channel coil; acceleration factor = 9, scan time = 1 minute 50 seconds for the 32-channel coil) as part of clinical evaluation for demyelinating disease. Automated segmentation of cerebral white matter lesions was performed using the Lesion Segmentation Tool in SPM. Student t tests, intraclass correlation coefficients, relative lesion volume difference, and Dice similarity coefficients were used to compare volumetric measurements among sequences. Two blinded neuroradiologists evaluated the visualization of white matter lesions, artifacts, and overall diagnostic quality using a predefined 5-point scale. RESULTS Standard and Wave-FLAIR sequences showed excellent agreement of lesion volumes with an intraclass correlation coefficient of 0.99 and mean Dice similarity coefficient of 0.97 (SD, 0.05) (range, 0.84-0.99). Wave-FLAIR was noninferior to standard FLAIR for visualization of lesions and motion. The diagnostic quality for Wave-FLAIR was slightly greater than for standard FLAIR for infratentorial lesions (P < .001), and there were fewer pulsation artifacts on Wave-FLAIR compared with standard FLAIR (P < .001). CONCLUSIONS Ultrafast Wave-FLAIR provides superior visualization of infratentorial lesions while preserving overall diagnostic quality and yields white matter lesion volumes comparable with those estimated using standard FLAIR. The availability of ultrafast Wave-FLAIR may facilitate the greater use of 3D-FLAIR sequences in the evaluation of patients with suspected demyelinating disease.
Collapse
Affiliation(s)
- C Ngamsombat
- From the Department of (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.).,Athinoula A. Martinos Center for Biomedical Imaging (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F, D.P., J.C., S.Y.H.), Massachusetts General Hospital, Boston, Massachusetts.,Department of Radiology (C.N.), Faculty of Medicine, Siriraj Hospital, Mahidol University, Thailand
| | - A L M Gonçalves Filho
- From the Department of (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.).,Athinoula A. Martinos Center for Biomedical Imaging (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F, D.P., J.C., S.Y.H.), Massachusetts General Hospital, Boston, Massachusetts.,Harvard Medical School (A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.), Boston, Massachusetts
| | - M G F Longo
- From the Department of (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.).,Athinoula A. Martinos Center for Biomedical Imaging (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F, D.P., J.C., S.Y.H.), Massachusetts General Hospital, Boston, Massachusetts.,Harvard Medical School (A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.), Boston, Massachusetts
| | - S F Cauley
- From the Department of (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.).,Athinoula A. Martinos Center for Biomedical Imaging (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F, D.P., J.C., S.Y.H.), Massachusetts General Hospital, Boston, Massachusetts.,Harvard Medical School (A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.), Boston, Massachusetts
| | - K Setsompop
- From the Department of (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.).,Athinoula A. Martinos Center for Biomedical Imaging (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F, D.P., J.C., S.Y.H.), Massachusetts General Hospital, Boston, Massachusetts.,Harvard Medical School (A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.), Boston, Massachusetts.,Harvard-MIT Division of Health Sciences and Technology (K.S., S.Y.H.), Massachusetts Institute of Technology, Cambridge, Massachusetts
| | - J E Kirsch
- From the Department of (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.).,Athinoula A. Martinos Center for Biomedical Imaging (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F, D.P., J.C., S.Y.H.), Massachusetts General Hospital, Boston, Massachusetts.,Harvard Medical School (A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.), Boston, Massachusetts
| | - Q Tian
- From the Department of (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.).,Athinoula A. Martinos Center for Biomedical Imaging (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F, D.P., J.C., S.Y.H.), Massachusetts General Hospital, Boston, Massachusetts.,Harvard Medical School (A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.), Boston, Massachusetts
| | - Q Fan
- From the Department of (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.).,Athinoula A. Martinos Center for Biomedical Imaging (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F, D.P., J.C., S.Y.H.), Massachusetts General Hospital, Boston, Massachusetts.,Harvard Medical School (A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.), Boston, Massachusetts
| | - D Polak
- Athinoula A. Martinos Center for Biomedical Imaging (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F, D.P., J.C., S.Y.H.), Massachusetts General Hospital, Boston, Massachusetts.,Department of Physics and Astronomy (D.P.), Heidelberg University, Heidelberg, Germany.,Siemens Healthcare GmbH, (D.P., W.-C.L.), Erlangen, Germany
| | - W Liu
- Siemens Shenzhen Magnetic Resonance Ltd (W.L.), Shenzhen, China
| | - W-C Lo
- Siemens Healthcare GmbH, (D.P., W.-C.L.), Erlangen, Germany
| | - R Gilberto González
- From the Department of (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.).,Harvard Medical School (A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.), Boston, Massachusetts
| | - P W Schaefer
- From the Department of (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.).,Harvard Medical School (A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.), Boston, Massachusetts
| | - O Rapalino
- From the Department of (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.).,Harvard Medical School (A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.), Boston, Massachusetts
| | - J Conklin
- From the Department of (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.).,Athinoula A. Martinos Center for Biomedical Imaging (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F, D.P., J.C., S.Y.H.), Massachusetts General Hospital, Boston, Massachusetts.,Harvard Medical School (A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.), Boston, Massachusetts
| | - S Y Huang
- From the Department of (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.) .,Athinoula A. Martinos Center for Biomedical Imaging (C.N., A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F, D.P., J.C., S.Y.H.), Massachusetts General Hospital, Boston, Massachusetts.,Harvard Medical School (A.L.M.G.F., M.G.F.L., S.F.C., K.S., J.E.K., Q.T., Q.F., R.G.G., P.W.S., O.R., J.C., S.Y.H.), Boston, Massachusetts.,Harvard-MIT Division of Health Sciences and Technology (K.S., S.Y.H.), Massachusetts Institute of Technology, Cambridge, Massachusetts
| |
Collapse
|
17
|
Park G, Hong J, Duffy BA, Lee JM, Kim H. White matter hyperintensities segmentation using the ensemble U-Net with multi-scale highlighting foregrounds. Neuroimage 2021; 237:118140. [PMID: 33957235 PMCID: PMC8382044 DOI: 10.1016/j.neuroimage.2021.118140] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2020] [Revised: 04/13/2021] [Accepted: 04/16/2021] [Indexed: 01/18/2023] Open
Abstract
White matter hyperintensities (WMHs) are abnormal signals within the white matter region on the human brain MRI and have been associated with aging processes, cognitive decline, and dementia. In the current study, we proposed a U-Net with multi-scale highlighting foregrounds (HF) for WMHs segmentation. Our method, U-Net with HF, is designed to improve the detection of the WMH voxels with partial volume effects. We evaluated the segmentation performance of the proposed approach using the Challenge training dataset. Then we assessed the clinical utility of the WMH volumes that were automatically computed using our method and the Alzheimer’s Disease Neuroimaging Initiative database. We demonstrated that the U-Net with HF significantly improved the detection of the WMH voxels at the boundary of the WMHs or in small WMH clusters quantitatively and qualitatively. Up to date, the proposed method has achieved the best overall evaluation scores, the highest dice similarity index, and the best F1-score among 39 methods submitted on the WMH Segmentation Challenge that was initially hosted by MICCAI 2017 and is continuously accepting new challengers. The evaluation of the clinical utility showed that the WMH volume that was automatically computed using U-Net with HF was significantly associated with cognitive performance and improves the classification between cognitive normal and Alzheimer’s disease subjects and between patients with mild cognitive impairment and those with Alzheimer’s disease. The implementation of our proposed method is publicly available using Dockerhub (https://hub.docker.com/r/wmhchallenge/pgs).
Collapse
Affiliation(s)
- Gilsoon Park
- Department of Biomedical Engineering, Hanyang University, Seoul, South Korea
| | - Jinwoo Hong
- Department of Biomedical Engineering, Hanyang University, Seoul, South Korea
| | - Ben A Duffy
- USC Mark and Mary Stevens Neuroimaging and Informatics Institute, University of Southern California, Los Angeles, CA 90033, USA
| | - Jong-Min Lee
- Department of Biomedical Engineering, Hanyang University, Seoul, South Korea.
| | - Hosung Kim
- USC Mark and Mary Stevens Neuroimaging and Informatics Institute, University of Southern California, Los Angeles, CA 90033, USA
| |
Collapse
|
18
|
La Rosa F, Abdulkadir A, Fartaria MJ, Rahmanzadeh R, Lu PJ, Galbusera R, Barakovic M, Thiran JP, Granziera C, Cuadra MB. Multiple sclerosis cortical and WM lesion segmentation at 3T MRI: a deep learning method based on FLAIR and MP2RAGE. NEUROIMAGE-CLINICAL 2020; 27:102335. [PMID: 32663798 PMCID: PMC7358270 DOI: 10.1016/j.nicl.2020.102335] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/28/2020] [Revised: 06/16/2020] [Accepted: 06/26/2020] [Indexed: 01/22/2023]
Abstract
The presence of cortical lesions in multiple sclerosis patients has emerged as an important biomarker of the disease. They appear in the earliest stages of the illness and have been shown to correlate with the severity of clinical symptoms. However, cortical lesions are hardly visible in conventional magnetic resonance imaging (MRI) at 3T, and thus their automated detection has been so far little explored. In this study, we propose a fully-convolutional deep learning approach, based on the 3D U-Net, for the automated segmentation of cortical and white matter lesions at 3T. For this purpose, we consider a clinically plausible MRI setting consisting of two MRI contrasts only: one conventional T2-weighted sequence (FLAIR), and one specialized T1-weighted sequence (MP2RAGE). We include 90 patients from two different centers with a total of 728 and 3856 gray and white matter lesions, respectively. We show that two reference methods developed for white matter lesion segmentation are inadequate to detect small cortical lesions, whereas our proposed framework is able to achieve a detection rate of 76% for both cortical and white matter lesions with a false positive rate of 29% in comparison to manual segmentation. Further results suggest that our framework generalizes well for both types of lesion in subjects acquired in two hospitals with different scanners.
Collapse
Affiliation(s)
- Francesco La Rosa
- Signal Processing Laboratory (LTS5), École Polytechnique Fédérale de Lausanne, Switzerland; Medical Image Analysis Laboratory, Center for Biomedical Imaging (CIBM), University of Lausanne, Switzerland; Department of Radiology, Lausanne University Hospital and University of Lausanne, Switzerland.
| | - Ahmed Abdulkadir
- University Hospital of Old Age Psychiatry and Psychotherapy, University of Bern, Bern, Switzerland; Center for Biomedical Image Computing and Analytics at the Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States
| | - Mário João Fartaria
- Signal Processing Laboratory (LTS5), École Polytechnique Fédérale de Lausanne, Switzerland; Department of Radiology, Lausanne University Hospital and University of Lausanne, Switzerland; Advanced Clinical Imaging Technology, Siemens Healthcare AG, Lausanne, Switzerland
| | - Reza Rahmanzadeh
- Translational Imaging in Neurology Basel, Department of Medicine and Biomedical Engineering, University Hospital Basel and University of Basel, Basel, Switzerland; Neurologic Clinic and Policlinic, Departments of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland
| | - Po-Jui Lu
- Translational Imaging in Neurology Basel, Department of Medicine and Biomedical Engineering, University Hospital Basel and University of Basel, Basel, Switzerland; Neurologic Clinic and Policlinic, Departments of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland
| | - Riccardo Galbusera
- Translational Imaging in Neurology Basel, Department of Medicine and Biomedical Engineering, University Hospital Basel and University of Basel, Basel, Switzerland; Neurologic Clinic and Policlinic, Departments of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland
| | - Muhamed Barakovic
- Translational Imaging in Neurology Basel, Department of Medicine and Biomedical Engineering, University Hospital Basel and University of Basel, Basel, Switzerland; Neurologic Clinic and Policlinic, Departments of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland
| | - Jean-Philippe Thiran
- Signal Processing Laboratory (LTS5), École Polytechnique Fédérale de Lausanne, Switzerland; Department of Radiology, Lausanne University Hospital and University of Lausanne, Switzerland
| | - Cristina Granziera
- Translational Imaging in Neurology Basel, Department of Medicine and Biomedical Engineering, University Hospital Basel and University of Basel, Basel, Switzerland; Neurologic Clinic and Policlinic, Departments of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland
| | - Merixtell Bach Cuadra
- Signal Processing Laboratory (LTS5), École Polytechnique Fédérale de Lausanne, Switzerland; Medical Image Analysis Laboratory, Center for Biomedical Imaging (CIBM), University of Lausanne, Switzerland; Department of Radiology, Lausanne University Hospital and University of Lausanne, Switzerland
| |
Collapse
|