1
|
Möller H, Graf R, Schmitt J, Keinert B, Schön H, Atad M, Sekuboyina A, Streckenbach F, Kofler F, Kroencke T, Bette S, Willich SN, Keil T, Niendorf T, Pischon T, Endemann B, Menze B, Rueckert D, Kirschke JS. SPINEPS-automatic whole spine segmentation of T2-weighted MR images using a two-phase approach to multi-class semantic and instance segmentation. Eur Radiol 2024:10.1007/s00330-024-11155-y. [PMID: 39470797 DOI: 10.1007/s00330-024-11155-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2024] [Revised: 09/02/2024] [Accepted: 10/14/2024] [Indexed: 11/01/2024]
Abstract
OBJECTIVES Introducing SPINEPS, a deep learning method for semantic and instance segmentation of 14 spinal structures (ten vertebra substructures, intervertebral discs, spinal cord, spinal canal, and sacrum) in whole-body sagittal T2-weighted turbo spin echo images. MATERIAL AND METHODS This local ethics committee-approved study utilized a public dataset (train/test 179/39 subjects, 137 female), a German National Cohort (NAKO) subset (train/test 1412/65 subjects, mean age 53, 694 female), and an in-house dataset (test 10 subjects, mean age 70, 5 female). SPINEPS is a semantic segmentation model, followed by a sliding window approach utilizing a second model to create instance masks from the semantic ones. Segmentation evaluation metrics included the Dice score and average symmetrical surface distance (ASSD). Statistical significance was assessed using the Wilcoxon signed-rank test. RESULTS On the public dataset, SPINEPS outperformed a nnUNet baseline on every structure and metric (e.g., an average over vertebra instances: dice 0.933 vs 0.911, p < 0.001, ASSD 0.21 vs 0.435, p < 0.001). SPINEPS trained on automated annotations of the NAKO achieves an average global Dice score of 0.918 on the combined NAKO and in-house test split. Adding the training data from the public dataset outperforms this (average instance-wise Dice score over the vertebra substructures 0.803 vs 0.778, average global Dice score 0.931 vs 0.918). CONCLUSION SPINEPS offers segmentation of 14 spinal structures in T2w sagittal images. It provides a semantic mask and an instance mask separating the vertebrae and intervertebral discs. This is the first publicly available algorithm to enable this segmentation. KEY POINTS Question No publicly available automatic approach can yield semantic and instance segmentation masks for the whole spine (including posterior elements) in T2-weighted sagittal TSE images. Findings Segmenting semantically first and then instance-wise outperforms a baseline trained directly on instance segmentation. The developed model produces high-resolution MRI segmentations for the whole spine. Clinical relevance This study introduces an automatic approach to whole spine segmentation, including posterior elements, in arbitrary fields of view T2w sagittal MR images, enabling easy biomarker extraction, automatic localization of pathologies and degenerative diseases, and quantifying analyses as downstream research.
Collapse
Affiliation(s)
- Hendrik Möller
- Department of Diagnostic and Interventional Neuroradiology, School of Medicine and Health, Technical University of Munich, Munich, Germany.
- Institut Für KI Und Informatik in Der Medizin, Klinikum Rechts Der Isar, Technical University of Munich, Munich, Germany.
| | - Robert Graf
- Department of Diagnostic and Interventional Neuroradiology, School of Medicine and Health, Technical University of Munich, Munich, Germany
- Institut Für KI Und Informatik in Der Medizin, Klinikum Rechts Der Isar, Technical University of Munich, Munich, Germany
| | - Joachim Schmitt
- Department of Diagnostic and Interventional Neuroradiology, School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Benjamin Keinert
- Department of Diagnostic and Interventional Neuroradiology, School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Hanna Schön
- Department of Diagnostic and Interventional Neuroradiology, School of Medicine and Health, Technical University of Munich, Munich, Germany
- Department of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, University Medical Center Rostock, Rostock, Germany
| | - Matan Atad
- Department of Diagnostic and Interventional Neuroradiology, School of Medicine and Health, Technical University of Munich, Munich, Germany
- Institut Für KI Und Informatik in Der Medizin, Klinikum Rechts Der Isar, Technical University of Munich, Munich, Germany
| | - Anjany Sekuboyina
- Department of Diagnostic and Interventional Neuroradiology, School of Medicine and Health, Technical University of Munich, Munich, Germany
- Department of Quantitative Biomedicine, University of Zurich, Zurich, Switzerland
| | - Felix Streckenbach
- Department of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, University Medical Center Rostock, Rostock, Germany
| | - Florian Kofler
- Department of Diagnostic and Interventional Neuroradiology, School of Medicine and Health, Technical University of Munich, Munich, Germany
- Institut Für KI Und Informatik in Der Medizin, Klinikum Rechts Der Isar, Technical University of Munich, Munich, Germany
- Helmholtz AI, Helmholtz Munich, Neuherberg, Germany
- TranslaTUM-Central Institute for Translational Cancer Research, Technical University of Munich, Munich, Germany
| | - Thomas Kroencke
- Department of Diagnostic and Interventional Radiology, University Hospital Augsburg, Augsburg, Germany
- Centre for Advanced Analytics and Predictive Sciences, Augsburg University, Augsburg, Germany
| | - Stefanie Bette
- Department of Diagnostic and Interventional Radiology, University Hospital Augsburg, Augsburg, Germany
| | - Stefan N Willich
- Institute of Social Medicine, Epidemiology and Health Economics, Charité-Universitätsmedizin Berlin, Berlin, Germany
| | - Thomas Keil
- Institute of Social Medicine, Epidemiology and Health Economics, Charité-Universitätsmedizin Berlin, Berlin, Germany
- Institute of Clinical Epidemiology and Biometry, University of Würzburg, Würzburg, Germany
- State Institute of Health I, Bavarian Health and Food Safety Auhtority, Erlangen, Germany
| | - Thoralf Niendorf
- Max Delbrück Center for Molecular Medicine in the Helmholtz Association, Berlin, Germany
| | - Tobias Pischon
- Molecular Epidemiology Research Group, Max-Delbrueck-Center for Molecular Medicine in the Helmholtz Association (MDC), Berlin, Germany
- Biobank Technology Platform, Max-Delbrueck-Center for Molecular Medicine in the Helmholtz Association (MDC), Berlin, Germany
- Charité-Universitätsmedizin Berlin, Corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany
| | - Beate Endemann
- Max Delbrück Center for Molecular Medicine in the Helmholtz Association, Berlin, Germany
| | - Bjoern Menze
- Department of Quantitative Biomedicine, University of Zurich, Zurich, Switzerland
| | - Daniel Rueckert
- Institut Für KI Und Informatik in Der Medizin, Klinikum Rechts Der Isar, Technical University of Munich, Munich, Germany
- Department of Computing, Imperial College London, London, UK
| | - Jan S Kirschke
- Department of Diagnostic and Interventional Neuroradiology, School of Medicine and Health, Technical University of Munich, Munich, Germany
| |
Collapse
|