1
|
Demuth S, Paris J, Faddeenkov I, De Sèze J, Gourraud PA. Clinical applications of deep learning in neuroinflammatory diseases: A scoping review. Rev Neurol (Paris) 2024:S0035-3787(24)00522-8. [PMID: 38772806 DOI: 10.1016/j.neurol.2024.04.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2024] [Revised: 03/26/2024] [Accepted: 04/09/2024] [Indexed: 05/23/2024]
Abstract
BACKGROUND Deep learning (DL) is an artificial intelligence technology that has aroused much excitement for predictive medicine due to its ability to process raw data modalities such as images, text, and time series of signals. OBJECTIVES Here, we intend to give the clinical reader elements to understand this technology, taking neuroinflammatory diseases as an illustrative use case of clinical translation efforts. We reviewed the scope of this rapidly evolving field to get quantitative insights about which clinical applications concentrate the efforts and which data modalities are most commonly used. METHODS We queried the PubMed database for articles reporting DL algorithms for clinical applications in neuroinflammatory diseases and the radiology.healthairegister.com website for commercial algorithms. RESULTS The review included 148 articles published between 2018 and 2024 and five commercial algorithms. The clinical applications could be grouped as computer-aided diagnosis, individual prognosis, functional assessment, the segmentation of radiological structures, and the optimization of data acquisition. Our review highlighted important discrepancies in efforts. The segmentation of radiological structures and computer-aided diagnosis currently concentrate most efforts with an overrepresentation of imaging. Various model architectures have addressed different applications, relatively low volume of data, and diverse data modalities. We report the high-level technical characteristics of the algorithms and synthesize narratively the clinical applications. Predictive performances and some common a priori on this topic are finally discussed. CONCLUSION The currently reported efforts position DL as an information processing technology, enhancing existing modalities of paraclinical investigations and bringing perspectives to make innovative ones actionable for healthcare.
Collapse
Affiliation(s)
- S Demuth
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France; Inserm U1119 : biopathologie de la myéline, neuroprotection et stratégies thérapeutiques, University of Strasbourg, 1, rue Eugène-Boeckel - CS 60026, 67084 Strasbourg, France.
| | - J Paris
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France
| | - I Faddeenkov
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France
| | - J De Sèze
- Inserm U1119 : biopathologie de la myéline, neuroprotection et stratégies thérapeutiques, University of Strasbourg, 1, rue Eugène-Boeckel - CS 60026, 67084 Strasbourg, France; Department of Neurology, University Hospital of Strasbourg, 1, avenue Molière, 67200 Strasbourg, France; Inserm CIC 1434 Clinical Investigation Center, University Hospital of Strasbourg, 1, avenue Molière, 67200 Strasbourg, France
| | - P-A Gourraud
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France; "Data clinic", Department of Public Health, University Hospital of Nantes, Nantes, France
| |
Collapse
|
2
|
Raj A, Gass A, Eisele P, Dabringhaus A, Kraemer M, Zöllner FG. A generalizable deep voxel-guided morphometry algorithm for the detection of subtle lesion dynamics in multiple sclerosis. Front Neurosci 2024; 18:1326108. [PMID: 38332857 PMCID: PMC10850259 DOI: 10.3389/fnins.2024.1326108] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2023] [Accepted: 01/10/2024] [Indexed: 02/10/2024] Open
Abstract
Introduction Multiple sclerosis (MS) is a chronic neurological disorder characterized by the progressive loss of myelin and axonal structures in the central nervous system. Accurate detection and monitoring of MS-related changes in brain structures are crucial for disease management and treatment evaluation. We propose a deep learning algorithm for creating Voxel-Guided Morphometry (VGM) maps from longitudinal MRI brain volumes for analyzing MS disease activity. Our approach focuses on developing a generalizable model that can effectively be applied to unseen datasets. Methods Longitudinal MS patient high-resolution 3D T1-weighted follow-up imaging from three different MRI systems were analyzed. We employed a 3D residual U-Net architecture with attention mechanisms. The U-Net serves as the backbone, enabling spatial feature extraction from MRI volumes. Attention mechanisms are integrated to enhance the model's ability to capture relevant information and highlight salient regions. Furthermore, we incorporate image normalization by histogram matching and resampling techniques to improve the networks' ability to generalize to unseen datasets from different MRI systems across imaging centers. This ensures robust performance across diverse data sources. Results Numerous experiments were conducted using a dataset of 71 longitudinal MRI brain volumes of MS patients. Our approach demonstrated a significant improvement of 4.3% in mean absolute error (MAE) against the state-of-the-art (SOTA) method. Furthermore, the algorithm's generalizability was evaluated on two unseen datasets (n = 116) with an average improvement of 4.2% in MAE over the SOTA approach. Discussion Results confirm that the proposed approach is fast and robust and has the potential for broader clinical applicability.
Collapse
Affiliation(s)
- Anish Raj
- Computer Assisted Clinical Medicine, Medical Faculty Mannheim, Heidelberg University, Mannheim, Baden Württemberg, Germany
- Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim, Heidelberg University, Mannheim, Baden Württemberg, Germany
| | - Achim Gass
- Department of Neurology, University Medical Centre Mannheim, Medical Faculty Mannheim, Heidelberg University, Mannheim, Baden Württemberg, Germany
- Mannheim Center for Translational Neurosciences, Heidelberg University, Mannheim, Baden Württemberg, Germany
| | - Philipp Eisele
- Department of Neurology, University Medical Centre Mannheim, Medical Faculty Mannheim, Heidelberg University, Mannheim, Baden Württemberg, Germany
- Mannheim Center for Translational Neurosciences, Heidelberg University, Mannheim, Baden Württemberg, Germany
| | | | - Matthias Kraemer
- VGMorph GmbH, Mülheim an der Ruhr, Nordrhein-Westfalen, Germany
- NeuroCentrum, Grevenbroich, Nordrhein-Westfalen, Germany
| | - Frank G. Zöllner
- Computer Assisted Clinical Medicine, Medical Faculty Mannheim, Heidelberg University, Mannheim, Baden Württemberg, Germany
- Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim, Heidelberg University, Mannheim, Baden Württemberg, Germany
| |
Collapse
|
3
|
Merkler B, Masson A, Ferré JC, Bajeux E, Edan G, Michel L, Page EL, Leclercq M, Pegat B, Lamy S, Corre GL, Ahrweiler K, Zagnoli F, Maréchal D, Combès B, Kerbrat A. Impact of automatic tools for detecting new lesions on therapeutic strategies offered to patients with MS by neurologists. Mult Scler Relat Disord 2023; 80:105064. [PMID: 37866026 DOI: 10.1016/j.msard.2023.105064] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Revised: 09/16/2023] [Accepted: 10/08/2023] [Indexed: 10/24/2023]
Abstract
BACKGROUND Automatic tools for detecting new lesions in patients with MS between two MRI scans are now available to clinicians. They have been assessed from the radiologist's point of view, but their impact on the therapeutic strategies that neurologists offer their patients has not yet been documented. OBJECTIVES To compare neurologist's decisions according to whether a lesion detection support system had been used and describe variability between neurologists on decision-making for the same clinical cases. METHODS We submitted 28 clinical cases associated with pairs of MRI images and radiological reports (produced by the same radiologist without vs. with the help of a system to detect new lesions) to 10 neurologists who regularly follow patients with MS. They examined each clinical case twice (without vs. with support system) in two sessions several weeks apart, and their patient management decisions were recorded. RESULTS There was considerable variability between neurologists on decision-making (both with and without support system). When the support system had been used, neurologists more often made changes to patient management (75 % vs. 68 % of cases, p = 0.01) and spent significantly less time analyzing the clinical cases (249 s vs. 216 s, p == 3.10-4). CONCLUSION The use of a lesion detection support system has an impact not only on radiologists' reports, but also on neurologists' subsequent decision-making. This observation constitutes another strong argument for promoting the wider use of such systems in clinical routine. However, despite their use, there is still considerable variability in decision-making across neurologists, which should encourage us to refine the guidelines.
Collapse
Affiliation(s)
| | - Arthur Masson
- EMPENN research team, IRISA, CNRS‑INSERM‑INRIA, Rennes University, France
| | - Jean Christophe Ferré
- EMPENN research team, IRISA, CNRS‑INSERM‑INRIA, Rennes University, France; Radiology Department, Rennes University Hospital, Rennes, France
| | - Emma Bajeux
- Public Health and Epidemiology Department, Rennes University Hospital, Rennes, France
| | - Gilles Edan
- EMPENN research team, IRISA, CNRS‑INSERM‑INRIA, Rennes University, France; Neurology Department, Rennes University Hospital, Rennes, France
| | - Laure Michel
- Neurology Department, Rennes University Hospital, Rennes, France
| | | | - Marion Leclercq
- Neurology Department, Rennes University Hospital, Rennes, France
| | - Benoit Pegat
- Neurology Department, Vannes Hospital, Vannes, France
| | - Simon Lamy
- Neurology Department, Rennes University Hospital, Rennes, France
| | | | - Kevin Ahrweiler
- Neurology Department, Saint Malo Hospital, Saint Malo, France
| | - Fabien Zagnoli
- Private neurology office, 22 Rue d'Aiguillon Brest, France
| | - Denis Maréchal
- Neurology Department, Brest University Hospital, Brest, France
| | - Benoît Combès
- EMPENN research team, IRISA, CNRS‑INSERM‑INRIA, Rennes University, France
| | - Anne Kerbrat
- EMPENN research team, IRISA, CNRS‑INSERM‑INRIA, Rennes University, France; Neurology Department, Rennes University Hospital, Rennes, France.
| |
Collapse
|
4
|
Spagnolo F, Depeursinge A, Schädelin S, Akbulut A, Müller H, Barakovic M, Melie-Garcia L, Bach Cuadra M, Granziera C. How far MS lesion detection and segmentation are integrated into the clinical workflow? A systematic review. Neuroimage Clin 2023; 39:103491. [PMID: 37659189 PMCID: PMC10480555 DOI: 10.1016/j.nicl.2023.103491] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Accepted: 08/04/2023] [Indexed: 09/04/2023]
Abstract
INTRODUCTION Over the past few years, the deep learning community has developed and validated a plethora of tools for lesion detection and segmentation in Multiple Sclerosis (MS). However, there is an important gap between validating models technically and clinically. To this end, a six-step framework necessary for the development, validation, and integration of quantitative tools in the clinic was recently proposed under the name of the Quantitative Neuroradiology Initiative (QNI). AIMS Investigate to what extent automatic tools in MS fulfill the QNI framework necessary to integrate automated detection and segmentation into the clinical neuroradiology workflow. METHODS Adopting the systematic Cochrane literature review methodology, we screened and summarised published scientific articles that perform automatic MS lesions detection and segmentation. We categorised the retrieved studies based on their degree of fulfillment of QNI's six-steps, which include a tool's technical assessment, clinical validation, and integration. RESULTS We found 156 studies; 146/156 (94%) fullfilled the first QNI step, 155/156 (99%) the second, 8/156 (5%) the third, 3/156 (2%) the fourth, 5/156 (3%) the fifth and only one the sixth. CONCLUSIONS To date, little has been done to evaluate the clinical performance and the integration in the clinical workflow of available methods for MS lesion detection/segmentation. In addition, the socio-economic effects and the impact on patients' management of such tools remain almost unexplored.
Collapse
Affiliation(s)
- Federico Spagnolo
- Translational Imaging in Neurology (ThINK) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland; Department of Neurology, University Hospital Basel, Basel, Switzerland; Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland; MedGIFT, Institute of Informatics, School of Management, HES-SO Valais-Wallis University of Applied Sciences and Arts Western Switzerland, Sierre, Switzerland
| | - Adrien Depeursinge
- MedGIFT, Institute of Informatics, School of Management, HES-SO Valais-Wallis University of Applied Sciences and Arts Western Switzerland, Sierre, Switzerland; Nuclear Medicine and Molecular Imaging Department, Lausanne University Hospital (CHUV) and University of Lausanne, Lausanne, Switzerland
| | - Sabine Schädelin
- Translational Imaging in Neurology (ThINK) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland; Clinical Trial Unit, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland
| | - Aysenur Akbulut
- Translational Imaging in Neurology (ThINK) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland; Ankara University School of Medicine, Ankara, Turkey
| | - Henning Müller
- MedGIFT, Institute of Informatics, School of Management, HES-SO Valais-Wallis University of Applied Sciences and Arts Western Switzerland, Sierre, Switzerland; The Sense Research and Innovation Center, Lausanne and Sion, Switzerland
| | - Muhamed Barakovic
- Translational Imaging in Neurology (ThINK) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland; Department of Neurology, University Hospital Basel, Basel, Switzerland; Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland
| | - Lester Melie-Garcia
- Translational Imaging in Neurology (ThINK) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland; Department of Neurology, University Hospital Basel, Basel, Switzerland; Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland
| | - Meritxell Bach Cuadra
- CIBM Center for Biomedical Imaging, Lausanne, Switzerland; Radiology Department, Lausanne University Hospital (CHUV) and University of Lausanne, Lausanne, Switzerland
| | - Cristina Granziera
- Translational Imaging in Neurology (ThINK) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland; Department of Neurology, University Hospital Basel, Basel, Switzerland; Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland.
| |
Collapse
|
5
|
Homssi M, Sweeney EM, Demmon E, Mannheim W, Sakirsky M, Wang Y, Gauthier SA, Gupta A, Nguyen TD. Evaluation of the Statistical Detection of Change Algorithm for Screening Patients with MS with New Lesion Activity on Longitudinal Brain MRI. AJNR Am J Neuroradiol 2023; 44:649-655. [PMID: 37142431 PMCID: PMC10249703 DOI: 10.3174/ajnr.a7858] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2023] [Accepted: 04/03/2023] [Indexed: 05/06/2023]
Abstract
BACKGROUND AND PURPOSE Identification of new MS lesions on longitudinal MR imaging by human readers is time-consuming and prone to error. Our objective was to evaluate the improvement in the performance of subject-level detection by readers when assisted by the automated statistical detection of change algorithm. MATERIALS AND METHODS A total of 200 patients with MS with a mean interscan interval of 13.2 (SD, 2.4) months were included. Statistical detection of change was applied to the baseline and follow-up FLAIR images to detect potential new lesions for confirmation by readers (Reader + statistical detection of change method). This method was compared with readers operating in the clinical workflow (Reader method) for a subject-level detection of new lesions. RESULTS Reader + statistical detection of change found 30 subjects (15.0%) with at least 1 new lesion, while Reader detected 16 subjects (8.0%). As a subject-level screening tool, statistical detection of change achieved a perfect sensitivity of 1.00 (95% CI, 0.88-1.00) and a moderate specificity of 0.67 (95% CI, 0.59-0.74). The agreement on a subject level was 0.91 (95% CI, 0.87-0.95) between Reader + statistical detection of change and Reader, and 0.72 (95% CI, 0.66-0.78) between Reader + statistical detection of change and statistical detection of change. CONCLUSIONS The statistical detection of change algorithm can serve as a time-saving screening tool to assist human readers in verifying 3D FLAIR images of patients with MS with suspected new lesions. Our promising results warrant further evaluation of statistical detection of change in prospective multireader clinical studies.
Collapse
Affiliation(s)
- M Homssi
- From the Department of Radiology (M.H., Y.W., A.G., T.D.N.)
| | - E M Sweeney
- Penn Statistics in Imaging and Visualization Endeavor (PennSIVE) Center, Department of Biostatistics, Epidemiology, and Informatics (E.M.S.), University of Pennsylvania, Philadelphia, Pennsylvania
| | - E Demmon
- Department of Neurology (E.D., W.M., M.S., S.A.G.)
| | - W Mannheim
- Department of Neurology (E.D., W.M., M.S., S.A.G.)
| | - M Sakirsky
- Department of Neurology (E.D., W.M., M.S., S.A.G.)
| | - Y Wang
- From the Department of Radiology (M.H., Y.W., A.G., T.D.N.)
| | - S A Gauthier
- Department of Neurology (E.D., W.M., M.S., S.A.G.)
- The Feil Family Brain & Mind Institute (S.A.G.), Weill Cornell Medicine, New York, New York
| | - A Gupta
- From the Department of Radiology (M.H., Y.W., A.G., T.D.N.)
| | - T D Nguyen
- From the Department of Radiology (M.H., Y.W., A.G., T.D.N.)
| |
Collapse
|
6
|
Sarica B, Seker DZ, Bayram B. A dense residual U-net for multiple sclerosis lesions segmentation from multi-sequence 3D MR images. Int J Med Inform 2023; 170:104965. [PMID: 36580821 DOI: 10.1016/j.ijmedinf.2022.104965] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Accepted: 12/08/2022] [Indexed: 12/28/2022]
Abstract
Multiple Sclerosis (MS) is an autoimmune disease that causes brain and spinal cord lesions, which magnetic resonance imaging (MRI) can detect and characterize. Recently, deep learning methods have achieved remarkable results in the automated segmentation of MS lesions from MRI data. Hence, this study proposes a novel dense residual U-Net model that combines attention gate (AG), efficient channel attention (ECA), and Atrous Spatial Pyramid Pooling (ASPP) to enhance the performance of the automatic MS lesion segmentation using 3D MRI sequences. First, convolution layers in each block of the U-Net architecture are replaced by residual blocks and connected densely. Then, AGs are exploited to capture salient features passed through the skip connections. The ECA module is appended at the end of each residual block and each downsampling block of U-Net. Later, the bottleneck of U-Net is replaced with the ASSP module to extract multi-scale contextual information. Furthermore, 3D MR images of Fluid Attenuated Inversion Recovery (FLAIR), T1-weighted (T1-w), and T2-weighted (T2-w) are exploited jointly to perform better MS lesion segmentation. The proposed model is validated on the publicly available ISBI2015 and MSSEG2016 challenge datasets. This model produced an ISBI score of 92.75, a mean Dice score of 66.88%, a mean positive predictive value (PPV) of 86.50%, and a mean lesion-wise true positive rate (LTPR) of 60.64% on the ISBI2015 testing set. Also, it achieved a mean Dice score of 67.27%, a mean PPV of 65.19%, and a mean sensitivity of 74.40% on the MSSEG2016 testing set. The results show that the proposed model performs better than the results of some experts and some of the other state-of-the-art methods realized related to this particular subject. Specifically, the best Dice score and the best LTPR are obtained on the ISBI2015 testing set by using the proposed model to segment MS lesions.
Collapse
Affiliation(s)
- Beytullah Sarica
- Istanbul Technical University, Graduate School, Department of Applied Informatics, Istanbul, 34469, Turkey.
| | - Dursun Zafer Seker
- Istanbul Technical University, Civil Engineering Faculty, Department of Geomatics Engineering, Istanbul, 34469, Turkey.
| | - Bulent Bayram
- Yildiz Technical University, Civil Engineering Faculty, Department of Geomatics Engineering, Istanbul, 34220, Turkey.
| |
Collapse
|