1
|
Systematic Review of Tumor Segmentation Strategies for Bone Metastases. Cancers (Basel) 2023; 15:cancers15061750. [PMID: 36980636 PMCID: PMC10046265 DOI: 10.3390/cancers15061750] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Revised: 03/09/2023] [Accepted: 03/10/2023] [Indexed: 03/18/2023] Open
Abstract
Purpose: To investigate the segmentation approaches for bone metastases in differentiating benign from malignant bone lesions and characterizing malignant bone lesions. Method: The literature search was conducted in Scopus, PubMed, IEEE and MedLine, and Web of Science electronic databases following the guidelines of Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). A total of 77 original articles, 24 review articles, and 1 comparison paper published between January 2010 and March 2022 were included in the review. Results: The results showed that most studies used neural network-based approaches (58.44%) and CT-based imaging (50.65%) out of 77 original articles. However, the review highlights the lack of a gold standard for tumor boundaries and the need for manual correction of the segmentation output, which largely explains the absence of clinical translation studies. Moreover, only 19 studies (24.67%) specifically mentioned the feasibility of their proposed methods for use in clinical practice. Conclusion: Development of tumor segmentation techniques that combine anatomical information and metabolic activities is encouraging despite not having an optimal tumor segmentation method for all applications or can compensate for all the difficulties built into data limitations.
Collapse
|
2
|
Kriwanek F, Ulbrich L, Lechner W, Lütgendorf-Caucig C, Konrad S, Waldstein C, Herrmann H, Georg D, Widder J, Traub-Weidinger T, Rausch I. Impact of SSTR PET on Inter-Observer Variability of Target Delineation of Meningioma and the Possibility of Using Threshold-Based Segmentations in Radiation Oncology. Cancers (Basel) 2022; 14:cancers14184435. [PMID: 36139596 PMCID: PMC9497299 DOI: 10.3390/cancers14184435] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Revised: 08/31/2022] [Accepted: 09/08/2022] [Indexed: 11/24/2022] Open
Abstract
Aim: The aim of this study was to assess the effects of including somatostatin receptor agonist (SSTR) PET imaging in meningioma radiotherapy planning by means of changes in inter-observer variability (IOV). Further, the possibility of using threshold-based delineation approaches for semiautomatic tumor volume definition was assessed. Patients and Methods: Sixteen patients with meningioma undergoing fractionated radiotherapy were delineated by five radiation oncologists. IOV was calculated by comparing each delineation to a consensus delineation, based on the simultaneous truth and performance level estimation (STAPLE) algorithm. The consensus delineation was used to adapt a threshold-based delineation, based on a maximization of the mean Dice coefficient. To test the threshold-based approach, seven patients with SSTR-positive meningioma were additionally evaluated as a validation group. Results: The average Dice coefficients for delineations based on MRI alone was 0.84 ± 0.12. For delineation based on MRI + PET, a significantly higher dice coefficient of 0.87 ± 0.08 was found (p < 0.001). The Hausdorff distance decreased from 10.96 ± 11.98 mm to 8.83 ± 12.21 mm (p < 0.001) when adding PET for the lesion delineation. The best threshold value for a threshold-based delineation was found to be 14.0% of the SUVmax, with an average Dice coefficient of 0.50 ± 0.19 compared to the consensus delineation. In the validation cohort, a Dice coefficient of 0.56 ± 0.29 and a Hausdorff coefficient of 27.15 ± 21.54 mm were found for the threshold-based approach. Conclusions: SSTR-PET added to standard imaging with CT and MRI reduces the IOV in radiotherapy planning for patients with meningioma. When using a threshold-based approach for PET-based delineation of meningioma, a relatively low threshold of 14.0% of the SUVmax was found to provide the best agreement with a consensus delineation.
Collapse
Affiliation(s)
- Florian Kriwanek
- Division of Nuclear Medicine, Department of Biomedical Imaging and Image Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria
| | - Leo Ulbrich
- Department of Radiation Oncology, Medical University of Vienna, 1090 Vienna, Austria
| | - Wolfgang Lechner
- Department of Radiation Oncology, Medical University of Vienna, 1090 Vienna, Austria
| | | | - Stefan Konrad
- Department of Radiation Oncology, Medical University of Vienna, 1090 Vienna, Austria
| | - Cora Waldstein
- Department of Radiation Oncology, Medical University of Vienna, 1090 Vienna, Austria
| | - Harald Herrmann
- Department of Radiation Oncology, Medical University of Vienna, 1090 Vienna, Austria
| | - Dietmar Georg
- Department of Radiation Oncology, Medical University of Vienna, 1090 Vienna, Austria
| | - Joachim Widder
- Department of Radiation Oncology, Medical University of Vienna, 1090 Vienna, Austria
| | - Tatjana Traub-Weidinger
- Division of Nuclear Medicine, Department of Biomedical Imaging and Image Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria
- Correspondence:
| | - Ivo Rausch
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, 1090 Vienna, Austria
| |
Collapse
|
3
|
Novel Harmonization Method for Multi-Centric Radiomic Studies in Non-Small Cell Lung Cancer. Curr Oncol 2022; 29:5179-5194. [PMID: 35892979 PMCID: PMC9332210 DOI: 10.3390/curroncol29080410] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2022] [Revised: 07/08/2022] [Accepted: 07/14/2022] [Indexed: 01/06/2023] Open
Abstract
The purpose of this multi-centric work was to investigate the relationship between radiomic features extracted from pre-treatment computed tomography (CT), positron emission tomography (PET) imaging, and clinical outcomes for stereotactic body radiation therapy (SBRT) in early-stage non-small cell lung cancer (NSCLC). One-hundred and seventeen patients who received SBRT for early-stage NSCLC were retrospectively identified from seven Italian centers. The tumor was identified on pre-treatment free-breathing CT and PET images, from which we extracted 3004 quantitative radiomic features. The primary outcome was 24-month progression-free-survival (PFS) based on cancer recurrence (local/non-local) following SBRT. A harmonization technique was proposed for CT features considering lesion and contralateral healthy lung tissues using the LASSO algorithm as a feature selector. Models with harmonized CT features (B models) demonstrated better performances compared to the ones using only original CT features (C models). A linear support vector machine (SVM) with harmonized CT and PET features (A1 model) showed an area under the curve (AUC) of 0.77 (0.63–0.85) for predicting the primary outcome in an external validation cohort. The addition of clinical features did not enhance the model performance. This study provided the basis for validating our novel CT data harmonization strategy, involving delta radiomics. The harmonized radiomic models demonstrated the capability to properly predict patient prognosis.
Collapse
|
4
|
Falahatpour Z, Geramifar P, Mahdavi SR, Abdollahi H, Salimi Y, Nikoofar A, Ay MR. Potential advantages of FDG-PET radiomic feature map for target volume delineation in lung cancer radiotherapy. J Appl Clin Med Phys 2022; 23:e13696. [PMID: 35699200 PMCID: PMC9512354 DOI: 10.1002/acm2.13696] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2021] [Revised: 04/20/2022] [Accepted: 05/27/2022] [Indexed: 11/09/2022] Open
Abstract
PURPOSE To investigate the potential benefits of FDG PET radiomic feature maps (RFMs) for target delineation in non-small cell lung cancer (NSCLC) radiotherapy. METHODS Thirty-two NSCLC patients undergoing FDG PET/CT imaging were included. For each patient, nine grey-level co-occurrence matrix (GLCM) RFMs were generated. gross target volume (GTV) and clinical target volume (CTV) were contoured on CT (GTVCT , CTVCT ), PET (GTVPET40 , CTVPET40 ), and RFMs (GTVRFM , CTVRFM ,). Intratumoral heterogeneity areas were segmented as GTVPET50-Boost and radiomic boost target volume (RTVBoost ) on PET and RFMs, respectively. GTVCT in homogenous tumors and GTVPET40 in heterogeneous tumors were considered as GTVgold standard (GTVGS ). One-way analysis of variance was conducted to determine the threshold that finds the best conformity for GTVRFM with GTVGS . Dice similarity coefficient (DSC) and mean absolute percent error (MAPE) were calculated. Linear regression analysis was employed to report the correlations between the gold standard and RFM-derived target volumes. RESULTS Entropy, contrast, and Haralick correlation (H-correlation) were selected for tumor segmentation. The threshold values of 80%, 50%, and 10% have the best conformity of GTVRFM-entropy , GTVRFM-contrast , and GTVRFM-H-correlation with GTVGS , respectively. The linear regression results showed a positive correlation between GTVGS and GTVRFM-entropy (r = 0.98, p < 0.001), between GTVGS and GTVRFM-contrast (r = 0.93, p < 0.001), and between GTVGS and GTVRFM-H-correlation (r = 0.91, p < 0.001). The average threshold values of 45% and 15% were resulted in the best segmentation matching between CTVRFM-entropy and CTVRFM-contrast with CTVGS , respectively. Moreover, we used RFM to determine RTVBoost in the heterogeneous tumors. Comparison of RTVBoost with GTVPET50-Boost MAPE showed the volume error differences of 31.7%, 36%, and 34.7% in RTVBoost-entropy , RTVBoost-contrast , and RTVBoost-H-correlation , respectively. CONCLUSIONS FDG PET-based radiomics features in NSCLC demonstrated a promising potential for decision support in radiotherapy, helping radiation oncologists delineate tumors and generate accurate segmentation for heterogeneous region of tumors.
Collapse
Affiliation(s)
- Zahra Falahatpour
- Department of Medical Physics, Tehran University of Medical Sciences, Tehran, Iran
| | - Parham Geramifar
- Research Center for Nuclear Medicine, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Seyed Rabie Mahdavi
- Department of Medical Physics, Faculty of Medical Sciences, Iran University of Medical Sciences, Tehran, Iran
| | - Hamid Abdollahi
- Department of Radiology Technology, Faculty of Allied Medicine, Kerman University of Medical Sciences, Kerman, Iran
| | - Yazdan Salimi
- Department of Biomedical Engineering and Medical Physics, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Alireza Nikoofar
- Department of Radiation Oncology, Faculty of Medical Sciences, Iran University of Medical Sciences, Tehran, Iran
| | - Mohammad Reza Ay
- Department of Medical Physics, Tehran University of Medical Sciences, Tehran, Iran
| |
Collapse
|
5
|
Bundschuh L, Prokic V, Guckenberger M, Tanadini-Lang S, Essler M, Bundschuh RA. A Novel Radiomics-Based Tumor Volume Segmentation Algorithm for Lung Tumors in FDG-PET/CT after 3D Motion Correction—A Technical Feasibility and Stability Study. Diagnostics (Basel) 2022; 12:diagnostics12030576. [PMID: 35328128 PMCID: PMC8947476 DOI: 10.3390/diagnostics12030576] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2022] [Revised: 02/18/2022] [Accepted: 02/21/2022] [Indexed: 12/11/2022] Open
Abstract
Positron emission tomography (PET) provides important additional information when applied in radiation therapy treatment planning. However, the optimal way to define tumors in PET images is still undetermined. As radiomics features are gaining more and more importance in PET image interpretation as well, we aimed to use textural features for an optimal differentiation between tumoral tissue and surrounding tissue to segment-target lesions based on three textural parameters found to be suitable in previous analysis (Kurtosis, Local Entropy and Long Zone Emphasis). Intended for use in radiation therapy planning, this algorithm was combined with a previously described motion-correction algorithm and validated in phantom data. In addition, feasibility was shown in five patients. The algorithms provided sufficient results for phantom and patient data. The stability of the results was analyzed in 20 consecutive measurements of phantom data. Results for textural feature-based algorithms were slightly worse than those of the threshold-based reference algorithm (mean standard deviation 1.2%—compared to 4.2% to 8.6%) However, the Entropy-based algorithm came the closest to the real volume of the phantom sphere of 6 ccm with a mean measured volume of 26.5 ccm. The threshold-based algorithm found a mean volume of 25.0 ccm. In conclusion, we showed a novel, radiomics-based tumor segmentation algorithm in FDG-PET with promising results in phantom studies concerning recovered lesion volume and reasonable results in stability in consecutive measurements. Segmentation based on Entropy was the most precise in comparison with sphere volume but showed the worst stability in consecutive measurements. Despite these promising results, further studies with larger patient cohorts and histopathological standards need to be performed for further validation of the presented algorithms and their applicability in clinical routines. In addition, their application in other tumor entities needs to be studied.
Collapse
Affiliation(s)
- Lena Bundschuh
- Department of Nuclear Medicine, University Hospital Bonn, 53127 Bonn, Germany; (M.E.); (R.A.B.)
- Correspondence: ; Tel.: +49-228-287-16181
| | - Vesna Prokic
- Department of Physics, University Koblenz-Landau, 55118 Koblenz, Germany;
- RheinAhrCampus, University of Applied Science, 56075 Koblenz, Germany
| | - Matthias Guckenberger
- Department of Radiation Oncology, University Hospital Zurich, University of Zurich, 8091 Zurich, Switzerland; (M.G.); (S.T.-L.)
| | - Stephanie Tanadini-Lang
- Department of Radiation Oncology, University Hospital Zurich, University of Zurich, 8091 Zurich, Switzerland; (M.G.); (S.T.-L.)
| | - Markus Essler
- Department of Nuclear Medicine, University Hospital Bonn, 53127 Bonn, Germany; (M.E.); (R.A.B.)
| | - Ralph A. Bundschuh
- Department of Nuclear Medicine, University Hospital Bonn, 53127 Bonn, Germany; (M.E.); (R.A.B.)
| |
Collapse
|
6
|
Abstract
Positron emission tomography (PET)/computed tomography (CT) are nuclear diagnostic imaging modalities that are routinely deployed for cancer staging and monitoring. They hold the advantage of detecting disease related biochemical and physiologic abnormalities in advance of anatomical changes, thus widely used for staging of disease progression, identification of the treatment gross tumor volume, monitoring of disease, as well as prediction of outcomes and personalization of treatment regimens. Among the arsenal of different functional imaging modalities, nuclear imaging has benefited from early adoption of quantitative image analysis starting from simple standard uptake value normalization to more advanced extraction of complex imaging uptake patterns; thanks to application of sophisticated image processing and machine learning algorithms. In this review, we discuss the application of image processing and machine/deep learning techniques to PET/CT imaging with special focus on the oncological radiotherapy domain as a case study and draw examples from our work and others to highlight current status and future potentials.
Collapse
Affiliation(s)
- Lise Wei
- Department of Radiation Oncology, Physics Division, University of Michigan, Ann Arbor, MI
| | - Issam El Naqa
- Department of Radiation Oncology, Physics Division, University of Michigan, Ann Arbor, MI.
| |
Collapse
|
7
|
A Systematic Review of PET Textural Analysis and Radiomics in Cancer. Diagnostics (Basel) 2021; 11:diagnostics11020380. [PMID: 33672285 PMCID: PMC7926413 DOI: 10.3390/diagnostics11020380] [Citation(s) in RCA: 34] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2021] [Revised: 02/10/2021] [Accepted: 02/19/2021] [Indexed: 12/12/2022] Open
Abstract
Background: Although many works have supported the utility of PET radiomics, several authors have raised concerns over the robustness and replicability of the results. This study aimed to perform a systematic review on the topic of PET radiomics and the used methodologies. Methods: PubMed was searched up to 15 October 2020. Original research articles based on human data specifying at least one tumor type and PET image were included, excluding those that apply only first-order statistics and those including fewer than 20 patients. Each publication, cancer type, objective and several methodological parameters (number of patients and features, validation approach, among other things) were extracted. Results: A total of 290 studies were included. Lung (28%) and head and neck (24%) were the most studied cancers. The most common objective was prognosis/treatment response (46%), followed by diagnosis/staging (21%), tumor characterization (18%) and technical evaluations (15%). The average number of patients included was 114 (median = 71; range 20–1419), and the average number of high-order features calculated per study was 31 (median = 26, range 1–286). Conclusions: PET radiomics is a promising field, but the number of patients in most publications is insufficient, and very few papers perform in-depth validations. The role of standardization initiatives will be crucial in the upcoming years.
Collapse
|
8
|
Pfaehler E, Mesotten L, Kramer G, Thomeer M, Vanhove K, de Jong J, Adriaensens P, Hoekstra OS, Boellaard R. Repeatability of two semi-automatic artificial intelligence approaches for tumor segmentation in PET. EJNMMI Res 2021; 11:4. [PMID: 33409747 PMCID: PMC7788118 DOI: 10.1186/s13550-020-00744-9] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2020] [Accepted: 12/10/2020] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Positron emission tomography (PET) is routinely used for cancer staging and treatment follow-up. Metabolic active tumor volume (MATV) as well as total MATV (TMATV-including primary tumor, lymph nodes and metastasis) and/or total lesion glycolysis derived from PET images have been identified as prognostic factor or for the evaluation of treatment efficacy in cancer patients. To this end, a segmentation approach with high precision and repeatability is important. However, the implementation of a repeatable and accurate segmentation algorithm remains an ongoing challenge. METHODS In this study, we compare two semi-automatic artificial intelligence (AI)-based segmentation methods with conventional semi-automatic segmentation approaches in terms of repeatability. One segmentation approach is based on a textural feature (TF) segmentation approach designed for accurate and repeatable segmentation of primary tumors and metastasis. Moreover, a convolutional neural network (CNN) is trained. The algorithms are trained, validated and tested using a lung cancer PET dataset. The segmentation accuracy of both segmentation approaches is compared using the Jaccard coefficient (JC). Additionally, the approaches are externally tested on a fully independent test-retest dataset. The repeatability of the methods is compared with those of two majority vote (MV2, MV3) approaches, 41%SUVMAX, and a SUV > 4 segmentation (SUV4). Repeatability is assessed with test-retest coefficients (TRT%) and intraclass correlation coefficient (ICC). An ICC > 0.9 was regarded as representing excellent repeatability. RESULTS The accuracy of the segmentations with the reference segmentation was good (JC median TF: 0.7, CNN: 0.73). Both segmentation approaches outperformed most other conventional segmentation methods in terms of test-retest coefficient (TRT% mean: TF: 13.0%, CNN: 13.9%, MV2: 14.1%, MV3: 28.1%, 41%SUVMAX: 28.1%, SUV4: 18.1%) and ICC (TF: 0.98, MV2: 0.97, CNN: 0.99, MV3: 0.73, SUV4: 0.81, and 41%SUVMAX: 0.68). CONCLUSION The semi-automatic AI-based segmentation approaches used in this study provided better repeatability than conventional segmentation approaches. Moreover, both algorithms lead to accurate segmentations for both primary tumors as well as metastasis and are therefore good candidates for PET tumor segmentation.
Collapse
Affiliation(s)
- Elisabeth Pfaehler
- Department of Nuclear Medicine and Molecular Imaging, Medical Imaging Center, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands.
| | - Liesbet Mesotten
- Faculty of Medicine and Life Sciences, Hasselt University, Agoralaan Building D, 3590, Diepenbeek, Belgium
- Department of Nuclear Medicine, Ziekenhuis Oost Limburg, Schiepse Bos 6, 3600, Genk, Belgium
| | - Gem Kramer
- Department of Radiology and Nuclear Medicine, VU University Medical Center, Amsterdam, The Netherlands
| | - Michiel Thomeer
- Faculty of Medicine and Life Sciences, Hasselt University, Agoralaan Building D, 3590, Diepenbeek, Belgium
- Department of Respiratory Medicine, Ziekenhuis Oost Limburg, Schiepse Bos 6, 3600, Genk, Belgium
| | - Karolien Vanhove
- Faculty of Medicine and Life Sciences, Hasselt University, Agoralaan Building D, 3590, Diepenbeek, Belgium
- Department of Respiratory Medicine, AZ Vesalius Hospital, Hazelereik 51, 3700, Tongeren, Belgium
| | - Johan de Jong
- Department of Nuclear Medicine and Molecular Imaging, Medical Imaging Center, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Peter Adriaensens
- Institute for Materials Research (IMO) - Division Chemistry, Hasselt University, Agoralaan Building D, 3590, Diepenbeek, Belgium
| | - Otto S Hoekstra
- Department of Radiology and Nuclear Medicine, VU University Medical Center, Amsterdam, The Netherlands
| | - Ronald Boellaard
- Department of Nuclear Medicine and Molecular Imaging, Medical Imaging Center, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
- Department of Radiology and Nuclear Medicine, VU University Medical Center, Amsterdam, The Netherlands
| |
Collapse
|
9
|
Li L, Lu W, Tan S. Variational PET/CT Tumor Co-segmentation Integrated with PET Restoration. IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2020; 4:37-49. [PMID: 32939423 DOI: 10.1109/trpms.2019.2911597] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
PET and CT are widely used imaging modalities in radiation oncology. PET imaging has a high contrast but blurry tumor edges due to its limited spatial resolution, while CT imaging has a high resolution but a low contrast between tumor and soft normal tissues. Tumor segmentation from either a single PET or CT image is difficult. It is known that co-segmentation methods utilizing the complementary information between PET and CT can improve segmentation accuracy. These information can be either consistent or inconsistent in the image-level. How to correctly localize tumor edges with these inconsistent information is a major challenge for co-segmentation methods. In this study, we proposed a novel variational method for tumor co-segmentation in PET/CT, with a fusion strategy specifically designed to handle the information inconsistency between PET and CT in an adaptive way - the method can automatically decide which modality should be more trustful when PET and CT disagree to each other for localizing the tumor boundary. The proposed method was constructed based on the Γ-convergence approximation of the Mumford-Shah (MS) segmentation model. A PET restoration process was integrated into the co-segmentation process, which further eliminate the uncertainty for tumor segmentation introduced by the blurring of tumor edges in PET. The performance of the proposed method was validated on a test dataset with fifty non-small cell lung cancer patients. Experimental results demonstrated that the proposed method had a high accuracy for PET/CT co-segmentation and PET restoration, and can accurately estimate the blur kernel of the PET scanner as well. For those complex images in which the tumors exhibit Fluorodeoxyglucose (FDG) uptake inhomogeneity or even invade adjacent soft normal tissues, the proposed method can still accurately segment the tumors. It achieved an average dice similarity indexes (DSI) of 0.85 ± 0.06, volume error (VE) of 0.09 ± 0.08, and classification error (CE) of 0.31 ± 0.13.
Collapse
Affiliation(s)
- Laquan Li
- Key Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Wei Lu
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York 10065, USA
| | - Shan Tan
- Key Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China
| |
Collapse
|
10
|
Rocha J, Cunha A, Mendonça AM. Conventional Filtering Versus U-Net Based Models for Pulmonary Nodule Segmentation in CT Images. J Med Syst 2020; 44:81. [PMID: 32140870 DOI: 10.1007/s10916-020-1541-9] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2019] [Accepted: 02/07/2020] [Indexed: 11/29/2022]
Abstract
Lung cancer is considered one of the deadliest diseases in the world. An early and accurate diagnosis aims to promote the detection and characterization of pulmonary nodules, which is of vital importance to increase the patients' survival rates. The mentioned characterization is done through a segmentation process, facing several challenges due to the diversity in nodular shape, size, and texture, as well as the presence of adjacent structures. This paper tackles pulmonary nodule segmentation in computed tomography scans proposing three distinct methodologies. First, a conventional approach which applies the Sliding Band Filter (SBF) to estimate the filter's support points, matching the border coordinates. The remaining approaches are Deep Learning based, using the U-Net and a novel network called SegU-Net to achieve the same goal. Their performance is compared, as this work aims to identify the most promising tool to improve nodule characterization. All methodologies used 2653 nodules from the LIDC database, achieving a Dice score of 0.663, 0.830, and 0.823 for the SBF, U-Net and SegU-Net respectively. This way, the U-Net based models yield more identical results to the ground truth reference annotated by specialists, thus being a more reliable approach for the proposed exercise. The novel network revealed similar scores to the U-Net, while at the same time reducing computational cost and improving memory efficiency. Consequently, such study may contribute to the possible implementation of this model in a decision support system, assisting the physicians in establishing a reliable diagnosis of lung pathologies based on this segmentation task.
Collapse
Affiliation(s)
- Joana Rocha
- Faculdade de Engenharia, Universidade do Porto, Rua Dr. Roberto Frias s/n, 4200 - 465, Porto, Portugal. .,INESC Technology and Science, Rua Dr. Roberto Frias s/n, 4200 - 465, Porto, Portugal.
| | - António Cunha
- INESC Technology and Science, Rua Dr. Roberto Frias s/n, 4200 - 465, Porto, Portugal.,Universidade de Trás-os-Montes e Alto Douro, Quinta de Prados, 5001-801, Vila Real, Portugal
| | - Ana Maria Mendonça
- Faculdade de Engenharia, Universidade do Porto, Rua Dr. Roberto Frias s/n, 4200 - 465, Porto, Portugal.,INESC Technology and Science, Rua Dr. Roberto Frias s/n, 4200 - 465, Porto, Portugal
| |
Collapse
|
11
|
Mak RH, Endres MG, Paik JH, Sergeev RA, Aerts H, Williams CL, Lakhani KR, Guinan EC. Use of Crowd Innovation to Develop an Artificial Intelligence-Based Solution for Radiation Therapy Targeting. JAMA Oncol 2019; 5:654-661. [PMID: 30998808 PMCID: PMC6512265 DOI: 10.1001/jamaoncol.2019.0159] [Citation(s) in RCA: 41] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2018] [Accepted: 01/07/2019] [Indexed: 12/19/2022]
Abstract
IMPORTANCE Radiation therapy (RT) is a critical cancer treatment, but the existing radiation oncologist work force does not meet growing global demand. One key physician task in RT planning involves tumor segmentation for targeting, which requires substantial training and is subject to significant interobserver variation. OBJECTIVE To determine whether crowd innovation could be used to rapidly produce artificial intelligence (AI) solutions that replicate the accuracy of an expert radiation oncologist in segmenting lung tumors for RT targeting. DESIGN, SETTING, AND PARTICIPANTS We conducted a 10-week, prize-based, online, 3-phase challenge (prizes totaled $55 000). A well-curated data set, including computed tomographic (CT) scans and lung tumor segmentations generated by an expert for clinical care, was used for the contest (CT scans from 461 patients; median 157 images per scan; 77 942 images in total; 8144 images with tumor present). Contestants were provided a training set of 229 CT scans with accompanying expert contours to develop their algorithms and given feedback on their performance throughout the contest, including from the expert clinician. MAIN OUTCOMES AND MEASURES The AI algorithms generated by contestants were automatically scored on an independent data set that was withheld from contestants, and performance ranked using quantitative metrics that evaluated overlap of each algorithm's automated segmentations with the expert's segmentations. Performance was further benchmarked against human expert interobserver and intraobserver variation. RESULTS A total of 564 contestants from 62 countries registered for this challenge, and 34 (6%) submitted algorithms. The automated segmentations produced by the top 5 AI algorithms, when combined using an ensemble model, had an accuracy (Dice coefficient = 0.79) that was within the benchmark of mean interobserver variation measured between 6 human experts. For phase 1, the top 7 algorithms had average custom segmentation scores (S scores) on the holdout data set ranging from 0.15 to 0.38, and suboptimal performance using relative measures of error. The average S scores for phase 2 increased to 0.53 to 0.57, with a similar improvement in other performance metrics. In phase 3, performance of the top algorithm increased by an additional 9%. Combining the top 5 algorithms from phase 2 and phase 3 using an ensemble model, yielded an additional 9% to 12% improvement in performance with a final S score reaching 0.68. CONCLUSIONS AND RELEVANCE A combined crowd innovation and AI approach rapidly produced automated algorithms that replicated the skills of a highly trained physician for a critical task in radiation therapy. These AI algorithms could improve cancer care globally by transferring the skills of expert clinicians to under-resourced health care settings.
Collapse
Affiliation(s)
- Raymond H. Mak
- Department of Radiation Oncology, Brigham and Women’s Hospital/Dana-Farber Cancer Institute/Harvard Medical School, Boston, Massachusetts
| | - Michael G. Endres
- Laboratory for Innovation Science at Harvard, Harvard University, Boston, Massachusetts
- Institute for Quantitative Social Science, Harvard University, Cambridge, Massachusetts
| | - Jin H. Paik
- Laboratory for Innovation Science at Harvard, Harvard University, Boston, Massachusetts
- Harvard Business School, Boston, Massachusetts
| | - Rinat A. Sergeev
- Laboratory for Innovation Science at Harvard, Harvard University, Boston, Massachusetts
- Harvard Business School, Boston, Massachusetts
| | - Hugo Aerts
- Department of Radiation Oncology, Brigham and Women’s Hospital/Dana-Farber Cancer Institute/Harvard Medical School, Boston, Massachusetts
- Department of Radiology, Brigham and Women’s Hospital, Boston, Massachusetts
| | - Christopher L. Williams
- Department of Radiation Oncology, Brigham and Women’s Hospital/Dana-Farber Cancer Institute/Harvard Medical School, Boston, Massachusetts
| | - Karim R. Lakhani
- Laboratory for Innovation Science at Harvard, Harvard University, Boston, Massachusetts
- Harvard Business School, Boston, Massachusetts
- The National Bureau of Economic Research, Cambridge, Massachusetts
| | - Eva C. Guinan
- Department of Radiation Oncology, Brigham and Women’s Hospital/Dana-Farber Cancer Institute/Harvard Medical School, Boston, Massachusetts
- Laboratory for Innovation Science at Harvard, Harvard University, Boston, Massachusetts
| |
Collapse
|
12
|
Li L, Zhao X, Lu W, Tan S. Deep Learning for Variational Multimodality Tumor Segmentation in PET/CT. Neurocomputing 2019; 392:277-295. [PMID: 32773965 DOI: 10.1016/j.neucom.2018.10.099] [Citation(s) in RCA: 48] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
Positron emission tomography/computed tomography (PET/CT) imaging can simultaneously acquire functional metabolic information and anatomical information of the human body. How to rationally fuse the complementary information in PET/CT for accurate tumor segmentation is challenging. In this study, a novel deep learning based variational method was proposed to automatically fuse multimodality information for tumor segmentation in PET/CT. A 3D fully convolutional network (FCN) was first designed and trained to produce a probability map from the CT image. The learnt probability map describes the probability of each CT voxel belonging to the tumor or the background, and roughly distinguishes the tumor from its surrounding soft tissues. A fuzzy variational model was then proposed to incorporate the probability map and the PET intensity image for an accurate multimodality tumor segmentation, where the probability map acted as a membership degree prior. A split Bregman algorithm was used to minimize the variational model. The proposed method was validated on a non-small cell lung cancer dataset with 84 PET/CT images. Experimental results demonstrated that: 1). Only a few training samples were needed for training the designed network to produce the probability map; 2). The proposed method can be applied to small datasets, normally seen in clinic research; 3). The proposed method successfully fused the complementary information in PET/CT, and outperformed two existing deep learning-based multimodality segmentation methods and other multimodality segmentation methods using traditional fusion strategies (without deep learning); 4). The proposed method had a good performance for tumor segmentation, even for those with Fluorodeoxyglucose (FDG) uptake inhomogeneity and blurred tumor edges (two major challenges in PET single modality segmentation) and complex surrounding soft tissues (one major challenge in CT single modality segmentation), and achieved an average dice similarity indexes (DSI) of 0.86 ± 0.05, sensitivity (SE) of 0.86 ± 0.07, positive predictive value (PPV) of 0.87 ± 0.10, volume error (VE) of 0.16 ± 0.12, and classification error (CE) of 0.30 ± 0.12.
Collapse
Affiliation(s)
- Laquan Li
- Key Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China.,College of Science, Chongqing University of Posts and Telecommunications, Chongqing 400065, China
| | - Xiangming Zhao
- Key Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Wei Lu
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, New York 10065, USA
| | - Shan Tan
- Key Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China
| |
Collapse
|
13
|
Lian C, Ruan S, Denoeux T, Li H, Vera P. Joint Tumor Segmentation in PET-CT Images Using Co-Clustering and Fusion Based on Belief Functions. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2019; 28:755-766. [PMID: 30296224 PMCID: PMC8191586 DOI: 10.1109/tip.2018.2872908] [Citation(s) in RCA: 37] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
Precise delineation of target tumor is a key factor to ensure the effectiveness of radiation therapy. While hybrid positron emission tomography-computed tomography (PET-CT) has become a standard imaging tool in the practice of radiation oncology, many existing automatic/semi-automatic methods still perform tumor segmentation on mono-modal images. In this paper, a co-clustering algorithm is proposed to concurrently segment 3D tumors in PET-CT images, considering that the two complementary imaging modalities can combine functional and anatomical information to improve segmentation performance. The theory of belief functions is adopted in the proposed method to model, fuse, and reason with uncertain and imprecise knowledge from noisy and blurry PET-CT images. To ensure reliable segmentation for each modality, the distance metric for the quantification of clustering distortions and spatial smoothness is iteratively adapted during the clustering procedure. On the other hand, to encourage consistent segmentation between different modalities, a specific context term is proposed in the clustering objective function. Moreover, during the iterative optimization process, clustering results for the two distinct modalities are further adjusted via a belief-functions-based information fusion strategy. The proposed method has been evaluated on a data set consisting of 21 paired PET-CT images for non-small cell lung cancer patients. The quantitative and qualitative evaluations show that our proposed method performs well compared with the state-of-the-art methods.
Collapse
|
14
|
Wang H, Zhang N, Huo L, Zhang B. Dual-modality multi-atlas segmentation of torso organs from [ 18F]FDG-PET/CT images. Int J Comput Assist Radiol Surg 2018; 14:473-482. [PMID: 30390179 DOI: 10.1007/s11548-018-1879-3] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2018] [Accepted: 10/23/2018] [Indexed: 11/28/2022]
Abstract
PURPOSE Automated segmentation of torso organs from positron emission tomography/computed tomography (PET/CT) images is a prerequisite step for nuclear medicine image analysis. However, accurate organ segmentation from clinical PET/CT is challenging due to the poor soft tissue contrast in the low-dose CT image and the low spatial resolution of the PET image. To overcome these challenges, we developed a multi-atlas segmentation (MAS) framework for torso organ segmentation from 2-deoxy-2-[18F]fluoro-D-glucose PET/CT images. METHOD Our key idea is to use PET information to compensate for the imperfect CT contrast and use surface-based atlas fusion to overcome the low PET resolution. First, all the organs are segmented from CT using a conventional MAS method, and then the abdomen region of the PET image is automatically cropped. Focusing on the cropped PET image, a refined MAS segmentation of the abdominal organs is performed, using a surface-based atlas fusion approach to reach subvoxel accuracy. RESULTS This method was validated based on 69 PET/CT images. The Dice coefficients of the target organs were between 0.80 and 0.96, and the average surface distances were between 1.58 and 2.44 mm. Compared to the CT-based segmentation, the PET-based segmentation gained a Dice increase of 0.06 and an ASD decrease of 0.38 mm. The surface-based atlas fusion leads to significant accuracy improvement for the liver and kidneys and saved ~ 10 min computation time compared to volumetric atlas fusion. CONCLUSIONS The presented method achieves better segmentation accuracy than conventional MAS method within acceptable computation time for clinical applications.
Collapse
Affiliation(s)
- Hongkai Wang
- Department of Biomedical Engineering, Dalian University of Technology, Dalian, Liaoning, China
| | - Nan Zhang
- Department of Biomedical Engineering, Dalian University of Technology, Dalian, Liaoning, China
| | - Li Huo
- Department of Nuclear Medicine, Peking Union Medical College Hospital, Beijing, China
| | - Bin Zhang
- Department of Biomedical Engineering, Dalian University of Technology, Dalian, Liaoning, China.
| |
Collapse
|
15
|
Hanzouli-Ben Salah H, Lapuyade-Lahorgue J, Bert J, Benoit D, Lambin P, Van Baardwijk A, Monfrini E, Pieczynski W, Visvikis D, Hatt M. A framework based on hidden Markov trees for multimodal PET/CT image co-segmentation. Med Phys 2017; 44:5835-5848. [PMID: 28837224 DOI: 10.1002/mp.12531] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2016] [Revised: 07/05/2017] [Accepted: 08/08/2017] [Indexed: 01/03/2023] Open
Abstract
PURPOSE The purpose of this study was to investigate the use of a probabilistic quad-tree graph (hidden Markov tree, HMT) to provide fast computation, robustness and an interpretational framework for multimodality image processing and to evaluate this framework for single gross tumor target (GTV) delineation from both positron emission tomography (PET) and computed tomography (CT) images. METHODS We exploited joint statistical dependencies between hidden states to handle the data stack using multi-observation, multi-resolution of HMT and Bayesian inference. This framework was applied to segmentation of lung tumors in PET/CT datasets taking into consideration simultaneously the CT and the PET image information. PET and CT images were considered using either the original voxels intensities, or after wavelet/contourlet enhancement. The Dice similarity coefficient (DSC), sensitivity (SE), positive predictive value (PPV) were used to assess the performance of the proposed approach on one simulated and 15 clinical PET/CT datasets of non-small cell lung cancer (NSCLC) cases. The surrogate of truth was a statistical consensus (obtained with the Simultaneous Truth and Performance Level Estimation algorithm) of three manual delineations performed by experts on fused PET/CT images. The proposed framework was applied to PET-only, CT-only and PET/CT datasets, and were compared to standard and improved fuzzy c-means (FCM) multimodal implementations. RESULTS A high agreement with the consensus of manual delineations was observed when using both PET and CT images. Contourlet-based HMT led to the best results with a DSC of 0.92 ± 0.11 compared to 0.89 ± 0.13 and 0.90 ± 0.12 for Intensity-based HMT and Wavelet-based HMT, respectively. Considering PET or CT only in the HMT led to much lower accuracy. Standard and improved FCM led to comparatively lower accuracy than HMT, even when considering multimodal implementations. CONCLUSIONS We evaluated the accuracy of the proposed HMT-based framework for PET/CT image segmentation. The proposed method reached good accuracy, especially with pre-processing in the contourlet domain.
Collapse
Affiliation(s)
| | | | - Julien Bert
- INSERM, UMR 1101, LaTIM, IBSAM, UBO, UBL, Brest, France
| | - Didier Benoit
- INSERM, UMR 1101, LaTIM, IBSAM, UBO, UBL, Brest, France
| | - Philippe Lambin
- Department of Radiation Oncology (MAASTRO), GROW - School for Oncology and Developmental Biology, Maastricht University Medical Center, Maastricht, The Netherlands
| | - Angela Van Baardwijk
- Department of Radiation Oncology (MAASTRO), GROW - School for Oncology and Developmental Biology, Maastricht University Medical Center, Maastricht, The Netherlands
| | - Emmanuel Monfrini
- SAMOVAR, Télécom SudParis, CNRS, Université Paris-Saclay, 9 rue Charles Fourier, 91000, Evry, France
| | - Wojciech Pieczynski
- SAMOVAR, Télécom SudParis, CNRS, Université Paris-Saclay, 9 rue Charles Fourier, 91000, Evry, France
| | | | - Mathieu Hatt
- INSERM, UMR 1101, LaTIM, IBSAM, UBO, UBL, Brest, France
| |
Collapse
|
16
|
Sbei A, ElBedoui K, Barhoumi W, Maksud P, Maktouf C. Hybrid PET/MRI co-segmentation based on joint fuzzy connectedness and graph cut. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2017; 149:29-41. [PMID: 28802328 DOI: 10.1016/j.cmpb.2017.07.006] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/10/2017] [Revised: 06/03/2017] [Accepted: 07/18/2017] [Indexed: 06/07/2023]
Abstract
BACKGROUND AND OBJECTIVE Tumor segmentation from hybrid PET/MRI scans may be highly beneficial in radiotherapy treatment planning. Indeed, it gives for both modalities the suitable information that could make the delineation of tumors more accurate than using each one apart. We aim in this work to propose a co-segmentation method that deals with several challenges, notably the lack of one-to-one correspondence between tumors of the two modalities and the boundaries' smoothing. METHODS The proposed method is designed to surpass these limits, we propose a segmentation method based on the GCsummax technique. The method takes the advantage of Iterative Relative Fuzzy Connectedness (IRFC) on seeds initialization, and the standard min-cut/max-flow technique for the boundary smoothing. Seed initialization was accurately performed thanks to high uptake regions on PET. Besides, a visibility weighting scheme was adapted to achieve the task of co-segmentation using the IRFC algorithm. Then, given the co-segmented regions, we introduce a morphological-based technique that provides object seeds to standard Graph Cut (GC) allowing it to avoid the shrinking problem. Finally, for each modality, the segmentation task is formulated as an energy minimization problem which is resolved by a min-cut/max-flow technique. RESULTS The overlap ratio (denoted DSC) between our segmentation results and the ground-truth for PET images is 92.63 ± 1.03, while the DSC for MRI images is 90.61 ± 3.70. CONCLUSIONS The proposed method was tested on different types of diseases and it outperformed the state-of-the-art methods. We show its superiority in terms of assymetric relation between PET and MRI and tumors heterogeneity.
Collapse
Affiliation(s)
- Arafet Sbei
- Université de Tunis El Manar, Institut Supérieur d'Informatique, Research Team on Intelligent Systems in Imaging and Articial Vision (SIIVA), LR16ES06 Laboratoire de recherche en Informatique, Modélisation et Traitement de l'Information et de la Connaissance (LIMTIC), Tunisia; Nuclear Medicine Department, Pasteur Institute of Tunis, Tunis, Tunisia
| | - Khaoula ElBedoui
- Université de Tunis El Manar, Institut Supérieur d'Informatique, Research Team on Intelligent Systems in Imaging and Articial Vision (SIIVA), LR16ES06 Laboratoire de recherche en Informatique, Modélisation et Traitement de l'Information et de la Connaissance (LIMTIC), Tunisia; Université de Carthage, Ecole Nationale d'Ingénieurs de Carthage, Tunisia
| | - Walid Barhoumi
- Université de Tunis El Manar, Institut Supérieur d'Informatique, Research Team on Intelligent Systems in Imaging and Articial Vision (SIIVA), LR16ES06 Laboratoire de recherche en Informatique, Modélisation et Traitement de l'Information et de la Connaissance (LIMTIC), Tunisia; Université de Carthage, Ecole Nationale d'Ingénieurs de Carthage, Tunisia.
| | - Philippe Maksud
- Nuclear Medicine Department, Pitié-Salpêtrière Hospital, AP-HP, Paris, France
| | - Chokri Maktouf
- Nuclear Medicine Department, Pasteur Institute of Tunis, Tunis, Tunisia
| |
Collapse
|
17
|
Hatt M, Lee JA, Schmidtlein CR, Naqa IE, Caldwell C, De Bernardi E, Lu W, Das S, Geets X, Gregoire V, Jeraj R, MacManus MP, Mawlawi OR, Nestle U, Pugachev AB, Schöder H, Shepherd T, Spezi E, Visvikis D, Zaidi H, Kirov AS. Classification and evaluation strategies of auto-segmentation approaches for PET: Report of AAPM task group No. 211. Med Phys 2017; 44:e1-e42. [PMID: 28120467 DOI: 10.1002/mp.12124] [Citation(s) in RCA: 134] [Impact Index Per Article: 19.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2016] [Revised: 12/09/2016] [Accepted: 01/04/2017] [Indexed: 12/14/2022] Open
Abstract
PURPOSE The purpose of this educational report is to provide an overview of the present state-of-the-art PET auto-segmentation (PET-AS) algorithms and their respective validation, with an emphasis on providing the user with help in understanding the challenges and pitfalls associated with selecting and implementing a PET-AS algorithm for a particular application. APPROACH A brief description of the different types of PET-AS algorithms is provided using a classification based on method complexity and type. The advantages and the limitations of the current PET-AS algorithms are highlighted based on current publications and existing comparison studies. A review of the available image datasets and contour evaluation metrics in terms of their applicability for establishing a standardized evaluation of PET-AS algorithms is provided. The performance requirements for the algorithms and their dependence on the application, the radiotracer used and the evaluation criteria are described and discussed. Finally, a procedure for algorithm acceptance and implementation, as well as the complementary role of manual and auto-segmentation are addressed. FINDINGS A large number of PET-AS algorithms have been developed within the last 20 years. Many of the proposed algorithms are based on either fixed or adaptively selected thresholds. More recently, numerous papers have proposed the use of more advanced image analysis paradigms to perform semi-automated delineation of the PET images. However, the level of algorithm validation is variable and for most published algorithms is either insufficient or inconsistent which prevents recommending a single algorithm. This is compounded by the fact that realistic image configurations with low signal-to-noise ratios (SNR) and heterogeneous tracer distributions have rarely been used. Large variations in the evaluation methods used in the literature point to the need for a standardized evaluation protocol. CONCLUSIONS Available comparison studies suggest that PET-AS algorithms relying on advanced image analysis paradigms provide generally more accurate segmentation than approaches based on PET activity thresholds, particularly for realistic configurations. However, this may not be the case for simple shape lesions in situations with a narrower range of parameters, where simpler methods may also perform well. Recent algorithms which employ some type of consensus or automatic selection between several PET-AS methods have potential to overcome the limitations of the individual methods when appropriately trained. In either case, accuracy evaluation is required for each different PET scanner and scanning and image reconstruction protocol. For the simpler, less robust approaches, adaptation to scanning conditions, tumor type, and tumor location by optimization of parameters is necessary. The results from the method evaluation stage can be used to estimate the contouring uncertainty. All PET-AS contours should be critically verified by a physician. A standard test, i.e., a benchmark dedicated to evaluating both existing and future PET-AS algorithms needs to be designed, to aid clinicians in evaluating and selecting PET-AS algorithms and to establish performance limits for their acceptance for clinical use. The initial steps toward designing and building such a standard are undertaken by the task group members.
Collapse
Affiliation(s)
- Mathieu Hatt
- INSERM, UMR 1101, LaTIM, University of Brest, IBSAM, Brest, France
| | - John A Lee
- Université catholique de Louvain (IREC/MIRO) & FNRS, Brussels, 1200, Belgium
| | | | | | - Curtis Caldwell
- Sunnybrook Health Sciences Center, Toronto, ON, M4N 3M5, Canada
| | | | - Wei Lu
- Memorial Sloan Kettering Cancer Center, New York, NY, 10065, USA
| | - Shiva Das
- University of North Carolina, Chapel Hill, NC, 27599, USA
| | - Xavier Geets
- Université catholique de Louvain (IREC/MIRO) & FNRS, Brussels, 1200, Belgium
| | - Vincent Gregoire
- Université catholique de Louvain (IREC/MIRO) & FNRS, Brussels, 1200, Belgium
| | - Robert Jeraj
- University of Wisconsin, Madison, WI, 53705, USA
| | | | | | - Ursula Nestle
- Universitätsklinikum Freiburg, Freiburg, 79106, Germany
| | - Andrei B Pugachev
- University of Texas Southwestern Medical Center, Dallas, TX, 75390, USA
| | - Heiko Schöder
- Memorial Sloan Kettering Cancer Center, New York, NY, 10065, USA
| | | | - Emiliano Spezi
- School of Engineering, Cardiff University, Cardiff, Wales, United Kingdom
| | | | - Habib Zaidi
- Geneva University Hospital, Geneva, CH-1211, Switzerland
| | - Assen S Kirov
- Memorial Sloan Kettering Cancer Center, New York, NY, 10065, USA
| |
Collapse
|
18
|
Dong X, Wu P, Sun X, Li W, Wan H, Yu J, Xing L. Intra-tumour 18F-FDG uptake heterogeneity decreases the reliability on target volume definition with positron emission tomography/computed tomography imaging. J Med Imaging Radiat Oncol 2015; 59:338-45. [PMID: 25708154 DOI: 10.1111/1754-9485.12289] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2014] [Accepted: 12/23/2014] [Indexed: 12/12/2022]
Abstract
INTRODUCTION This study aims to explore whether the intra-tumour (18) F-fluorodeoxyglucose (FDG) uptake heterogeneity affects the reliability of target volume definition with FDG positron emission tomography/computed tomography (PET/CT) imaging for nonsmall cell lung cancer (NSCLC) and squamous cell oesophageal cancer (SCEC). METHODS Patients with NSCLC (n = 50) or SCEC (n = 50) who received (18)F-FDG PET/CT scanning before treatments were included in this retrospective study. Intra-tumour FDG uptake heterogeneity was assessed by visual scoring, the coefficient of variation (COV) of the standardised uptake value (SUV) and the image texture feature (entropy). Tumour volumes (gross tumour volume (GTV)) were delineated on the CT images (GTV(CT)), the fused PET/CT images (GTV(PET-CT)) and the PET images, using a threshold at 40% SUV(max) (GTV(PET40%)) or the SUV cut-off value of 2.5 (GTV(PET2.5)). The correlation between the FDG uptake heterogeneity parameters and the differences in tumour volumes among GTV(CT), GTV(PET-CT), GTV(PET40%) and GTV(PET2.5) was analysed. RESULTS For both NSCLC and SCEC, obvious correlations were found between uptake heterogeneity, SUV or tumour volumes. Three types of heterogeneity parameters were consistent and closely related to each other. Substantial differences between the four methods of GTV definition were found. The differences between the GTV correlated significantly with PET heterogeneity defined with the visual score, the COV or the textural feature-entropy for NSCLC and SCEC. CONCLUSIONS In tumours with a high FDG uptake heterogeneity, a larger GTV delineation difference was found. Advance image segmentation algorithms dealing with tracer uptake heterogeneity should be incorporated into the treatment planning system.
Collapse
Affiliation(s)
- Xinzhe Dong
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong University, Jinan, Shandong, China
| | - Peipei Wu
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong University, Jinan, Shandong, China
| | - Xiaorong Sun
- Department of Radiology, Shandong Cancer Hospital and Institute, Jinan, Shandong, China
| | - Wenwu Li
- Department of Radiology, Shandong Cancer Hospital and Institute, Jinan, Shandong, China
| | - Honglin Wan
- College of Physics and Electronic Science, Shandong Normal University, Jinan, Shandong, China
| | - Jinming Yu
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong University, Jinan, Shandong, China
| | - Ligang Xing
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong University, Jinan, Shandong, China
| |
Collapse
|
19
|
Fernandez-Lozano C, Seoane JA, Gestal M, Gaunt TR, Dorado J, Campbell C. Texture classification using feature selection and kernel-based techniques. Soft comput 2015. [DOI: 10.1007/s00500-014-1573-5] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
|
20
|
Jin Z, Arimura H, Shioyama Y, Nakamura K, Kuwazuru J, Magome T, Yabu-Uchi H, Honda H, Hirata H, Sasaki M. Computer-assisted delineation of lung tumor regions in treatment planning CT images with PET/CT image sets based on an optimum contour selection method. JOURNAL OF RADIATION RESEARCH 2014; 55:1153-62. [PMID: 24980022 PMCID: PMC4229921 DOI: 10.1093/jrr/rru056] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/09/2023]
Abstract
To assist radiation oncologists in the delineation of tumor regions during treatment planning for lung cancer, we have proposed an automated contouring algorithm based on an optimum contour selection (OCS) method for treatment planning computed tomography (CT) images with positron emission tomography (PET)/CT images. The basic concept of the OCS is to select a global optimum object contour based on multiple active delineations with a level set method around tumors. First, the PET images were registered to the planning CT images by using affine transformation matrices. The initial gross tumor volume (GTV) of each lung tumor was identified by thresholding the PET image at a certain standardized uptake value, and then each initial GTV location was corrected in the region of interest of the planning CT image. Finally, the contours of final GTV regions were determined in the planning CT images by using the OCS. The proposed method was evaluated by testing six cases with a Dice similarity coefficient (DSC), which denoted the degree of region similarity between the GTVs contoured by radiation oncologists and the proposed method. The average three-dimensional DSC for the six cases was 0.78 by the proposed method, but only 0.34 by a conventional method based on a simple level set method. The proposed method may be helpful for treatment planners in contouring the GTV regions.
Collapse
Affiliation(s)
- Ze Jin
- Department of Health Sciences, Graduate School of Medical Sciences, Kyushu University, 3-1-1, Maidashi, Higashi-ku, Fukuoka 812-8582, Japan
| | - Hidetaka Arimura
- Department of Health Sciences, Faculty of Medical Sciences, Kyushu University, 3-1-1, Maidashi, Higashi-ku, Fukuoka 812-8582, Japan
| | - Yoshiyuki Shioyama
- Department of Heavy Particle Therapy and Radiation Oncology, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
| | - Katsumasa Nakamura
- Department of Clinical Radiology, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
| | - Jumpei Kuwazuru
- Medipolis Proton Therapy and Research Center, Higashikata, Ibusuki-shi, Kagoshima, Japan
| | - Taiki Magome
- Department of Health Sciences, Graduate School of Medical Sciences, Kyushu University, 3-1-1, Maidashi, Higashi-ku, Fukuoka 812-8582, Japan
| | - Hidetake Yabu-Uchi
- Department of Health Sciences, Faculty of Medical Sciences, Kyushu University, 3-1-1, Maidashi, Higashi-ku, Fukuoka 812-8582, Japan
| | - Hiroshi Honda
- Department of Clinical Radiology, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
| | - Hideki Hirata
- Department of Health Sciences, Faculty of Medical Sciences, Kyushu University, 3-1-1, Maidashi, Higashi-ku, Fukuoka 812-8582, Japan
| | - Masayuki Sasaki
- Department of Health Sciences, Faculty of Medical Sciences, Kyushu University, 3-1-1, Maidashi, Higashi-ku, Fukuoka 812-8582, Japan
| |
Collapse
|
21
|
Foster B, Bagci U, Mansoor A, Xu Z, Mollura DJ. A review on segmentation of positron emission tomography images. Comput Biol Med 2014; 50:76-96. [PMID: 24845019 DOI: 10.1016/j.compbiomed.2014.04.014] [Citation(s) in RCA: 222] [Impact Index Per Article: 22.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2013] [Revised: 03/19/2014] [Accepted: 04/16/2014] [Indexed: 11/20/2022]
Abstract
Positron Emission Tomography (PET), a non-invasive functional imaging method at the molecular level, images the distribution of biologically targeted radiotracers with high sensitivity. PET imaging provides detailed quantitative information about many diseases and is often used to evaluate inflammation, infection, and cancer by detecting emitted photons from a radiotracer localized to abnormal cells. In order to differentiate abnormal tissue from surrounding areas in PET images, image segmentation methods play a vital role; therefore, accurate image segmentation is often necessary for proper disease detection, diagnosis, treatment planning, and follow-ups. In this review paper, we present state-of-the-art PET image segmentation methods, as well as the recent advances in image segmentation techniques. In order to make this manuscript self-contained, we also briefly explain the fundamentals of PET imaging, the challenges of diagnostic PET image analysis, and the effects of these challenges on the segmentation results.
Collapse
Affiliation(s)
- Brent Foster
- Center for Infectious Disease Imaging, Department of Radiology and Imaging Sciences, National Institutes of Health (NIH), Bethesda, MD 20892, United States
| | - Ulas Bagci
- Center for Infectious Disease Imaging, Department of Radiology and Imaging Sciences, National Institutes of Health (NIH), Bethesda, MD 20892, United States.
| | - Awais Mansoor
- Center for Infectious Disease Imaging, Department of Radiology and Imaging Sciences, National Institutes of Health (NIH), Bethesda, MD 20892, United States
| | - Ziyue Xu
- Center for Infectious Disease Imaging, Department of Radiology and Imaging Sciences, National Institutes of Health (NIH), Bethesda, MD 20892, United States
| | - Daniel J Mollura
- Center for Infectious Disease Imaging, Department of Radiology and Imaging Sciences, National Institutes of Health (NIH), Bethesda, MD 20892, United States
| |
Collapse
|