1
|
Mahmutoglu MA, Preetha CJ, Meredig H, Tonn JC, Weller M, Wick W, Bendszus M, Brugnara G, Vollmuth P. Deep Learning-based Identification of Brain MRI Sequences Using a Model Trained on Large Multicentric Study Cohorts. Radiol Artif Intell 2024; 6:e230095. [PMID: 38166331 PMCID: PMC10831512 DOI: 10.1148/ryai.230095] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Revised: 09/30/2023] [Accepted: 10/30/2023] [Indexed: 01/04/2024]
Abstract
Purpose To develop a fully automated device- and sequence-independent convolutional neural network (CNN) for reliable and high-throughput labeling of heterogeneous, unstructured MRI data. Materials and Methods Retrospective, multicentric brain MRI data (2179 patients with glioblastoma, 8544 examinations, 63 327 sequences) from 249 hospitals and 29 scanner types were used to develop a network based on ResNet-18 architecture to differentiate nine MRI sequence types, including T1-weighted, postcontrast T1-weighted, T2-weighted, fluid-attenuated inversion recovery, susceptibility-weighted, apparent diffusion coefficient, diffusion-weighted (low and high b value), and gradient-recalled echo T2*-weighted and dynamic susceptibility contrast-related images. The two-dimensional-midsection images from each sequence were allocated to training or validation (approximately 80%) and testing (approximately 20%) using a stratified split to ensure balanced groups across institutions, patients, and MRI sequence types. The prediction accuracy was quantified for each sequence type, and subgroup comparison of model performance was performed using χ2 tests. Results On the test set, the overall accuracy of the CNN (ResNet-18) ensemble model among all sequence types was 97.9% (95% CI: 97.6, 98.1), ranging from 84.2% for susceptibility-weighted images (95% CI: 81.8, 86.6) to 99.8% for T2-weighted images (95% CI: 99.7, 99.9). The ResNet-18 model achieved significantly better accuracy compared with ResNet-50 despite its simpler architecture (97.9% vs 97.1%; P ≤ .001). The accuracy of the ResNet-18 model was not affected by the presence versus absence of tumor on the two-dimensional-midsection images for any sequence type (P > .05). Conclusion The developed CNN (www.github.com/neuroAI-HD/HD-SEQ-ID) reliably differentiates nine types of MRI sequences within multicenter and large-scale population neuroimaging data and may enhance the speed, accuracy, and efficiency of clinical and research neuroradiologic workflows. Keywords: MR-Imaging, Neural Networks, CNS, Brain/Brain Stem, Computer Applications-General (Informatics), Convolutional Neural Network (CNN), Deep Learning Algorithms, Machine Learning Algorithms Supplemental material is available for this article. © RSNA, 2023.
Collapse
Affiliation(s)
- Mustafa Ahmed Mahmutoglu
- From the Department of Neuroradiology (M.A.M., C.J.P., H.M., M.B., G.B., P.V.), Department of Neuroradiology, Division for Computational Neuroimaging (M.A.M., C.J.P., H.M., G.B., P.V.), and Department of Neurology (W.W.), Heidelberg University Hospital, Im Neuenheimer Feld 400, 69120 Heidelberg, Germany; Department of Neurosurgery, University Hospital Munich LMU, Munich, Germany (J.C.T.); and Department of Neurology, Clinical Neuroscience Center, University Hospital Zurich and University of Zurich, Zurich, Switzerland (M.W.)
| | - Chandrakanth Jayachandran Preetha
- From the Department of Neuroradiology (M.A.M., C.J.P., H.M., M.B., G.B., P.V.), Department of Neuroradiology, Division for Computational Neuroimaging (M.A.M., C.J.P., H.M., G.B., P.V.), and Department of Neurology (W.W.), Heidelberg University Hospital, Im Neuenheimer Feld 400, 69120 Heidelberg, Germany; Department of Neurosurgery, University Hospital Munich LMU, Munich, Germany (J.C.T.); and Department of Neurology, Clinical Neuroscience Center, University Hospital Zurich and University of Zurich, Zurich, Switzerland (M.W.)
| | - Hagen Meredig
- From the Department of Neuroradiology (M.A.M., C.J.P., H.M., M.B., G.B., P.V.), Department of Neuroradiology, Division for Computational Neuroimaging (M.A.M., C.J.P., H.M., G.B., P.V.), and Department of Neurology (W.W.), Heidelberg University Hospital, Im Neuenheimer Feld 400, 69120 Heidelberg, Germany; Department of Neurosurgery, University Hospital Munich LMU, Munich, Germany (J.C.T.); and Department of Neurology, Clinical Neuroscience Center, University Hospital Zurich and University of Zurich, Zurich, Switzerland (M.W.)
| | - Joerg-Christian Tonn
- From the Department of Neuroradiology (M.A.M., C.J.P., H.M., M.B., G.B., P.V.), Department of Neuroradiology, Division for Computational Neuroimaging (M.A.M., C.J.P., H.M., G.B., P.V.), and Department of Neurology (W.W.), Heidelberg University Hospital, Im Neuenheimer Feld 400, 69120 Heidelberg, Germany; Department of Neurosurgery, University Hospital Munich LMU, Munich, Germany (J.C.T.); and Department of Neurology, Clinical Neuroscience Center, University Hospital Zurich and University of Zurich, Zurich, Switzerland (M.W.)
| | - Michael Weller
- From the Department of Neuroradiology (M.A.M., C.J.P., H.M., M.B., G.B., P.V.), Department of Neuroradiology, Division for Computational Neuroimaging (M.A.M., C.J.P., H.M., G.B., P.V.), and Department of Neurology (W.W.), Heidelberg University Hospital, Im Neuenheimer Feld 400, 69120 Heidelberg, Germany; Department of Neurosurgery, University Hospital Munich LMU, Munich, Germany (J.C.T.); and Department of Neurology, Clinical Neuroscience Center, University Hospital Zurich and University of Zurich, Zurich, Switzerland (M.W.)
| | - Wolfgang Wick
- From the Department of Neuroradiology (M.A.M., C.J.P., H.M., M.B., G.B., P.V.), Department of Neuroradiology, Division for Computational Neuroimaging (M.A.M., C.J.P., H.M., G.B., P.V.), and Department of Neurology (W.W.), Heidelberg University Hospital, Im Neuenheimer Feld 400, 69120 Heidelberg, Germany; Department of Neurosurgery, University Hospital Munich LMU, Munich, Germany (J.C.T.); and Department of Neurology, Clinical Neuroscience Center, University Hospital Zurich and University of Zurich, Zurich, Switzerland (M.W.)
| | - Martin Bendszus
- From the Department of Neuroradiology (M.A.M., C.J.P., H.M., M.B., G.B., P.V.), Department of Neuroradiology, Division for Computational Neuroimaging (M.A.M., C.J.P., H.M., G.B., P.V.), and Department of Neurology (W.W.), Heidelberg University Hospital, Im Neuenheimer Feld 400, 69120 Heidelberg, Germany; Department of Neurosurgery, University Hospital Munich LMU, Munich, Germany (J.C.T.); and Department of Neurology, Clinical Neuroscience Center, University Hospital Zurich and University of Zurich, Zurich, Switzerland (M.W.)
| | - Gianluca Brugnara
- From the Department of Neuroradiology (M.A.M., C.J.P., H.M., M.B., G.B., P.V.), Department of Neuroradiology, Division for Computational Neuroimaging (M.A.M., C.J.P., H.M., G.B., P.V.), and Department of Neurology (W.W.), Heidelberg University Hospital, Im Neuenheimer Feld 400, 69120 Heidelberg, Germany; Department of Neurosurgery, University Hospital Munich LMU, Munich, Germany (J.C.T.); and Department of Neurology, Clinical Neuroscience Center, University Hospital Zurich and University of Zurich, Zurich, Switzerland (M.W.)
| | - Philipp Vollmuth
- From the Department of Neuroradiology (M.A.M., C.J.P., H.M., M.B., G.B., P.V.), Department of Neuroradiology, Division for Computational Neuroimaging (M.A.M., C.J.P., H.M., G.B., P.V.), and Department of Neurology (W.W.), Heidelberg University Hospital, Im Neuenheimer Feld 400, 69120 Heidelberg, Germany; Department of Neurosurgery, University Hospital Munich LMU, Munich, Germany (J.C.T.); and Department of Neurology, Clinical Neuroscience Center, University Hospital Zurich and University of Zurich, Zurich, Switzerland (M.W.)
| |
Collapse
|
3
|
Neubauer A, Menegaux A, Wendt J, Li HB, Schmitz-Koep B, Ruzok T, Thalhammer M, Schinz D, Bartmann P, Wolke D, Priller J, Zimmer C, Rueckert D, Hedderich DM, Sorg C. Aberrant claustrum structure in preterm-born neonates: an MRI study. Neuroimage Clin 2023; 37:103286. [PMID: 36516730 PMCID: PMC9755238 DOI: 10.1016/j.nicl.2022.103286] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2022] [Revised: 11/18/2022] [Accepted: 12/06/2022] [Indexed: 12/13/2022]
Abstract
The human claustrum is a gray matter structure in the white matter between insula and striatum. Previous analysis found altered claustrum microstructure in very preterm-born adults associated with lower cognitive performance. As the claustrum development is related to hypoxia-ischemia sensitive transient cell populations being at-risk in premature birth, we hypothesized that claustrum structure is already altered in preterm-born neonates. We studied anatomical and diffusion-weighted MRIs of 83 preterm- and 83 term-born neonates at term-equivalent age. Additionally, claustrum development was analyzed both in a spectrum of 377 term-born neonates and longitudinally in 53 preterm-born subjects. Data was provided by the developing Human Connectome Project. Claustrum development showed increasing volume, increasing fractional anisotropy (FA), and decreasing mean diffusivity (MD) around term both across term- and preterm-born neonates. Relative to term-born ones, preterm-born neonates had (i) increased absolute and relative claustrum volumes, both indicating increased cellular and/or extracellular matter and being in contrast to other subcortical gray matter regions of decreased volumes such as thalamus; (ii) lower claustrum FA and higher claustrum MD, pointing at increased extracellular matrix and impaired axonal integrity; and (iii) aberrant covariance between claustrum FA and MD, respectively, and that of distributed gray matter regions, hinting at relatively altered claustrum microstructure. Results together demonstrate specifically aberrant claustrum structure in preterm-born neonates, suggesting altered claustrum development in prematurity, potentially relevant for later cognitive performance.
Collapse
Affiliation(s)
- Antonia Neubauer
- Department of Neuroradiology, Klinikum Rechts der Isar, Technical University of Munich, Germany; School of Medicine, Klinikum Rechts der Isar, Technical University of Munich, Germany.
| | - Aurore Menegaux
- Department of Neuroradiology, Klinikum Rechts der Isar, Technical University of Munich, Germany; School of Medicine, Klinikum Rechts der Isar, Technical University of Munich, Germany
| | - Jil Wendt
- Department of Neuroradiology, Klinikum Rechts der Isar, Technical University of Munich, Germany; School of Medicine, Klinikum Rechts der Isar, Technical University of Munich, Germany
| | - Hongwei Bran Li
- Department of Informatics, Technical University of Munich, Germany; Department of Quantitative Biomedicine, University of Zurich, Switzerland
| | - Benita Schmitz-Koep
- Department of Neuroradiology, Klinikum Rechts der Isar, Technical University of Munich, Germany; School of Medicine, Klinikum Rechts der Isar, Technical University of Munich, Germany
| | - Tobias Ruzok
- Department of Neuroradiology, Klinikum Rechts der Isar, Technical University of Munich, Germany; School of Medicine, Klinikum Rechts der Isar, Technical University of Munich, Germany
| | - Melissa Thalhammer
- Department of Neuroradiology, Klinikum Rechts der Isar, Technical University of Munich, Germany; School of Medicine, Klinikum Rechts der Isar, Technical University of Munich, Germany
| | - David Schinz
- Department of Neuroradiology, Klinikum Rechts der Isar, Technical University of Munich, Germany; School of Medicine, Klinikum Rechts der Isar, Technical University of Munich, Germany
| | - Peter Bartmann
- Department of Neonatology and Pediatric Intensive Care, University Hospital Bonn, Germany
| | - Dieter Wolke
- Department of Psychology, University of Warwick, Coventry, UK; Warwick Medical School, University of Warwick, Coventry, UK
| | - Josef Priller
- Department of Psychiatry and Psychotherapy, Klinikum Rechts der Isar, Technical University of Munich, Germany; Neuropsychiatry, Charité - Universitätsmedizin Berlin and DZNE, Berlin, Germany; University of Edinburgh and UK DRI, Edinburgh, UK
| | - Claus Zimmer
- Department of Neuroradiology, Klinikum Rechts der Isar, Technical University of Munich, Germany; School of Medicine, Klinikum Rechts der Isar, Technical University of Munich, Germany
| | - Daniel Rueckert
- School of Medicine, Klinikum Rechts der Isar, Technical University of Munich, Germany; Department of Informatics, Technical University of Munich, Germany; Department of Computing, Imperial College London, UK
| | - Dennis M Hedderich
- Department of Neuroradiology, Klinikum Rechts der Isar, Technical University of Munich, Germany; School of Medicine, Klinikum Rechts der Isar, Technical University of Munich, Germany
| | - Christian Sorg
- Department of Neuroradiology, Klinikum Rechts der Isar, Technical University of Munich, Germany; School of Medicine, Klinikum Rechts der Isar, Technical University of Munich, Germany; Department of Psychiatry and Psychotherapy, Klinikum Rechts der Isar, Technical University of Munich, Germany
| |
Collapse
|