1
|
Xiong X, Graves SA, Gross BA, Buatti JM, Beichel RR. Lumbar and Thoracic Vertebrae Segmentation in CT Scans Using a 3D Multi-Object Localization and Segmentation CNN. Tomography 2024; 10:738-760. [PMID: 38787017 PMCID: PMC11125921 DOI: 10.3390/tomography10050057] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2024] [Revised: 05/04/2024] [Accepted: 05/06/2024] [Indexed: 05/25/2024] Open
Abstract
Radiation treatment of cancers like prostate or cervix cancer requires considering nearby bone structures like vertebrae. In this work, we present and validate a novel automated method for the 3D segmentation of individual lumbar and thoracic vertebra in computed tomography (CT) scans. It is based on a single, low-complexity convolutional neural network (CNN) architecture which works well even if little application-specific training data are available. It is based on volume patch-based processing, enabling the handling of arbitrary scan sizes. For each patch, it performs segmentation and an estimation of up to three vertebrae center locations in one step, which enables utilizing an advanced post-processing scheme to achieve high segmentation accuracy, as required for clinical use. Overall, 1763 vertebrae were used for the performance assessment. On 26 CT scans acquired for standard radiation treatment planning, a Dice coefficient of 0.921 ± 0.047 (mean ± standard deviation) and a signed distance error of 0.271 ± 0.748 mm was achieved. On the large-sized publicly available VerSe2020 data set with 129 CT scans depicting lumbar and thoracic vertebrae, the overall Dice coefficient was 0.940 ± 0.065 and the signed distance error was 0.109 ± 0.301 mm. A comparison to other methods that have been validated on VerSe data showed that our approach achieved a better overall segmentation performance.
Collapse
Affiliation(s)
- Xiaofan Xiong
- Department of Biomedical Engineering, The University of Iowa, Iowa City, IA 52242, USA;
| | - Stephen A. Graves
- Department of Radiology, The University of Iowa, Iowa City, IA 52242, USA;
| | - Brandie A. Gross
- Department of Radiation Oncology, University of Iowa Hospitals and Clinics, Iowa City, IA 52242, USA; (B.A.G.); (J.M.B.)
| | - John M. Buatti
- Department of Radiation Oncology, University of Iowa Hospitals and Clinics, Iowa City, IA 52242, USA; (B.A.G.); (J.M.B.)
| | - Reinhard R. Beichel
- Department of Electrical and Computer Engineering, The University of Iowa, Iowa City, IA 52242, USA
| |
Collapse
|
2
|
Eisazadeh R, Shahbazi-Akbari M, Mirshahvalad SA, Pirich C, Beheshti M. Application of Artificial Intelligence in Oncologic Molecular PET-Imaging: A Narrative Review on Beyond [ 18F]F-FDG Tracers Part II. [ 18F]F-FLT, [ 18F]F-FET, [ 11C]C-MET and Other Less-Commonly Used Radiotracers. Semin Nucl Med 2024; 54:293-301. [PMID: 38331629 DOI: 10.1053/j.semnuclmed.2024.01.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Accepted: 01/11/2024] [Indexed: 02/10/2024]
Abstract
Following the previous part of the narrative review on artificial intelligence (AI) applications in positron emission tomography (PET) using tracers rather than 18F-fluorodeoxyglucose ([18F]F-FDG), in this part we review the impact of PET-derived radiomics data on the diagnostic performance of other PET radiotracers, 18F-O-(2-fluoroethyl)-L-tyrosine ([18F]F-FET), 18F-Fluorothymidine ([18F]F-FLT) and 11C-Methionine ([11C]C-MET). [18F]F-FET-PET, using an artificial amino acid taken up into upregulated tumoral cells, showed potential in lesion detection and tumor characterization, especially with its ability to reflect glioma heterogeneity. [18F]F-FET-PET-derived textural features appeared to have the potential to reveal considerable information for accurate delineation for guiding biopsy and treatment, differentiate between low-grade and high-grade glioma and related wild-type genotypes, and distinguish pseudoprogression from true progression. In addition, models built using clinical parameters and [18F]F-FET-PET-derived radiomics features showed acceptable results for survival stratification of glioblastoma patients. [18F]F-FLT-PET-based characteristics also showed potential in evaluating glioma patients, correlating with Ki-67 and patient prognosis. AI-based PET-volumetry using this radiotracer as a proliferation marker also revealed promising preliminary results in terms of guide-targeting bone marrow-preserving adaptive radiation therapy. Similar to [18F]F-FET, the other amino acid tracer which reflects cellular proliferation, [11C]C-MET, has also shown acceptable performance in predicting tumor grade, distinguishing brain tumor recurrence from radiation necrosis, and treatment monitoring by PET-derived radiomics models. In addition, PET-derived radiomics features of various radiotracers such as [18F]F-DOPA, [18F]F-FACBC, [18F]F-NaF, [68Ga]Ga-CXCR-4 and [18F]F-FMISO may also provide useful information for tumor characterization and predict of disease outcome. In conclusion, AI using tracers beyond [18F]F-FDG could improve the diagnostic performance of PET-imaging for specific indications and help clinicians in their daily routine by providing features that are often not detectable by the naked eye.
Collapse
Affiliation(s)
- Roya Eisazadeh
- Division of Molecular Imaging & Theranostics, Department of Nuclear Medicine, University Hospital, Paracelsus Medical University, Salzburg, Austria
| | - Malihe Shahbazi-Akbari
- Division of Molecular Imaging & Theranostics, Department of Nuclear Medicine, University Hospital, Paracelsus Medical University, Salzburg, Austria; Research center for Nuclear Medicine, Department of Nuclear Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Seyed Ali Mirshahvalad
- Division of Molecular Imaging & Theranostics, Department of Nuclear Medicine, University Hospital, Paracelsus Medical University, Salzburg, Austria; Research center for Nuclear Medicine, Department of Nuclear Medicine, Tehran University of Medical Sciences, Tehran, Iran; Joint Department of Medical Imaging, University Medical Imaging Toronto (UMIT), University Health Network, Mount Sinai Hospital & Women's College Hospital; University of Toronto, Toronto, Ontario, Canada
| | - Christian Pirich
- Division of Molecular Imaging & Theranostics, Department of Nuclear Medicine, University Hospital, Paracelsus Medical University, Salzburg, Austria
| | - Mohsen Beheshti
- Division of Molecular Imaging & Theranostics, Department of Nuclear Medicine, University Hospital, Paracelsus Medical University, Salzburg, Austria.
| |
Collapse
|
3
|
Xiong X, Smith BJ, Graves SA, Graham MM, Buatti JM, Beichel RR. Head and Neck Cancer Segmentation in FDG PET Images: Performance Comparison of Convolutional Neural Networks and Vision Transformers. Tomography 2023; 9:1933-1948. [PMID: 37888743 PMCID: PMC10611182 DOI: 10.3390/tomography9050151] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 10/11/2023] [Accepted: 10/13/2023] [Indexed: 10/28/2023] Open
Abstract
Convolutional neural networks (CNNs) have a proven track record in medical image segmentation. Recently, Vision Transformers were introduced and are gaining popularity for many computer vision applications, including object detection, classification, and segmentation. Machine learning algorithms such as CNNs or Transformers are subject to an inductive bias, which can have a significant impact on the performance of machine learning models. This is especially relevant for medical image segmentation applications where limited training data are available, and a model's inductive bias should help it to generalize well. In this work, we quantitatively assess the performance of two CNN-based networks (U-Net and U-Net-CBAM) and three popular Transformer-based segmentation network architectures (UNETR, TransBTS, and VT-UNet) in the context of HNC lesion segmentation in volumetric [F-18] fluorodeoxyglucose (FDG) PET scans. For performance assessment, 272 FDG PET-CT scans of a clinical trial (ACRIN 6685) were utilized, which includes a total of 650 lesions (primary: 272 and secondary: 378). The image data used are highly diverse and representative for clinical use. For performance analysis, several error metrics were utilized. The achieved Dice coefficient ranged from 0.833 to 0.809 with the best performance being achieved by CNN-based approaches. U-Net-CBAM, which utilizes spatial and channel attention, showed several advantages for smaller lesions compared to the standard U-Net. Furthermore, our results provide some insight regarding the image features relevant for this specific segmentation application. In addition, results highlight the need to utilize primary as well as secondary lesions to derive clinically relevant segmentation performance estimates avoiding biases.
Collapse
Affiliation(s)
- Xiaofan Xiong
- Department of Biomedical Engineering, The University of Iowa, Iowa City, IA 52242, USA
| | - Brian J. Smith
- Department of Biostatistics, The University of Iowa, Iowa City, IA 52242, USA
| | - Stephen A. Graves
- Department of Radiology, The University of Iowa, Iowa City, IA 52242, USA; (S.A.G.)
| | - Michael M. Graham
- Department of Radiology, The University of Iowa, Iowa City, IA 52242, USA; (S.A.G.)
| | - John M. Buatti
- Department of Radiation Oncology, University of Iowa Hospitals and Clinics, Iowa City, IA 52242, USA
| | - Reinhard R. Beichel
- Department of Electrical and Computer Engineering, The University of Iowa, Iowa City, IA 52242, USA
| |
Collapse
|
4
|
Systematic Review of Tumor Segmentation Strategies for Bone Metastases. Cancers (Basel) 2023; 15:cancers15061750. [PMID: 36980636 PMCID: PMC10046265 DOI: 10.3390/cancers15061750] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Revised: 03/09/2023] [Accepted: 03/10/2023] [Indexed: 03/18/2023] Open
Abstract
Purpose: To investigate the segmentation approaches for bone metastases in differentiating benign from malignant bone lesions and characterizing malignant bone lesions. Method: The literature search was conducted in Scopus, PubMed, IEEE and MedLine, and Web of Science electronic databases following the guidelines of Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). A total of 77 original articles, 24 review articles, and 1 comparison paper published between January 2010 and March 2022 were included in the review. Results: The results showed that most studies used neural network-based approaches (58.44%) and CT-based imaging (50.65%) out of 77 original articles. However, the review highlights the lack of a gold standard for tumor boundaries and the need for manual correction of the segmentation output, which largely explains the absence of clinical translation studies. Moreover, only 19 studies (24.67%) specifically mentioned the feasibility of their proposed methods for use in clinical practice. Conclusion: Development of tumor segmentation techniques that combine anatomical information and metabolic activities is encouraging despite not having an optimal tumor segmentation method for all applications or can compensate for all the difficulties built into data limitations.
Collapse
|