1
|
Wu Z, Guo B, Huang B, Zhao B, Qin Z, Hao X, Liang M, Xie J, Li S. Does the beta regularization parameter of bayesian penalized likelihood reconstruction always affect the quantification accuracy and image quality of positron emission tomography computed tomography? J Appl Clin Med Phys 2021; 22:224-233. [PMID: 33683004 PMCID: PMC7984479 DOI: 10.1002/acm2.13129] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2020] [Revised: 09/13/2020] [Accepted: 11/24/2020] [Indexed: 11/27/2022] Open
Abstract
Purpose This study aims to provide a detailed investigation on the noise penalization factor in Bayesian penalized likelihood (BPL)‐based algorithm, with the utilization of partial volume effect correction (PVC), so as to offer the suitable beta value and optimum standardized uptake value (SUV) parameters in clinical practice for small pulmonary nodules. Methods A National Electrical Manufacturers Association (NEMA) image‐quality phantom was scanned and images were reconstructed using BPL with beta values ranged from 100 to 1000. The recovery coefficient (RC), contrast recovery (CR), and background variability (BV) were measured to assess the quantification accuracy and image quality. In the clinical assessment, lesions were categorized into sub‐centimeter (<10 mm, n = 7) group and medium size (10–30 mm, n = 16) group. Signal‐to‐noise ratio (SNR) and contrast‐to‐noise ratio (CNR) were measured to evaluate the image quality and lesion detectability. With PVC was performed, the impact of beta values on SUVs (SUVmax, SUVmean, SUVpeak) of small pulmonary nodules was evaluated. Subjective image analysis was performed by two experienced readers. Results With the increasing of beta values, RC, CR, and BV decreased gradually in the phantom work. In the clinical study, SNR and CNR of both groups increased with the beta values (P < 0.001), although the sub‐centimeter group showed increases after the beta value reached over 700. In addition, highly significant negative correlations were observed between SUVs and beta values for both lesion‐size groups before the PVC (P < 0.001 for all). After the PVC, SUVpeak measured from the sub‐centimeter group was no significantly different among different beta values (P = 0.830). Conclusion Our study suggests using SUVpeak as the quantification parameter with PVC performed to mitigate the effects of beta regularization. Beta values between 300 and 400 were preferred for pulmonary nodules smaller than 30 mm.
Collapse
Affiliation(s)
- Zhifang Wu
- Department of Nuclear MedicineFirst Hospital of Shanxi Medical UniversityTaiyuanShanxiP.R. China
- Molecular Imaging Precision Medical Collaborative Innovation CenterShanxi Medical UniversityTaiyuanShanxiP.R. China
| | - Binwei Guo
- Department of Nuclear MedicineFirst Hospital of Shanxi Medical UniversityTaiyuanShanxiP.R. China
| | - Bin Huang
- Department of Nuclear MedicineFirst Hospital of Shanxi Medical UniversityTaiyuanShanxiP.R. China
| | - Bin Zhao
- Department of Nuclear MedicineFirst Hospital of Shanxi Medical UniversityTaiyuanShanxiP.R. China
| | - Zhixing Qin
- Department of Nuclear MedicineFirst Hospital of Shanxi Medical UniversityTaiyuanShanxiP.R. China
| | - Xinzhong Hao
- Department of Nuclear MedicineFirst Hospital of Shanxi Medical UniversityTaiyuanShanxiP.R. China
| | - Meng Liang
- Department of Nuclear MedicineFirst Hospital of Shanxi Medical UniversityTaiyuanShanxiP.R. China
| | - Jun Xie
- Department of Biochemistry and Molecular BiologyShanxi Medical UniversityTaiyuanShanxiP.R. China
| | - Sijin Li
- Department of Nuclear MedicineFirst Hospital of Shanxi Medical UniversityTaiyuanShanxiP.R. China
- Molecular Imaging Precision Medical Collaborative Innovation CenterShanxi Medical UniversityTaiyuanShanxiP.R. China
| |
Collapse
|
2
|
Li L, Lu W, Tan S. Variational PET/CT Tumor Co-segmentation Integrated with PET Restoration. IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2020; 4:37-49. [PMID: 32939423 DOI: 10.1109/trpms.2019.2911597] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
PET and CT are widely used imaging modalities in radiation oncology. PET imaging has a high contrast but blurry tumor edges due to its limited spatial resolution, while CT imaging has a high resolution but a low contrast between tumor and soft normal tissues. Tumor segmentation from either a single PET or CT image is difficult. It is known that co-segmentation methods utilizing the complementary information between PET and CT can improve segmentation accuracy. These information can be either consistent or inconsistent in the image-level. How to correctly localize tumor edges with these inconsistent information is a major challenge for co-segmentation methods. In this study, we proposed a novel variational method for tumor co-segmentation in PET/CT, with a fusion strategy specifically designed to handle the information inconsistency between PET and CT in an adaptive way - the method can automatically decide which modality should be more trustful when PET and CT disagree to each other for localizing the tumor boundary. The proposed method was constructed based on the Γ-convergence approximation of the Mumford-Shah (MS) segmentation model. A PET restoration process was integrated into the co-segmentation process, which further eliminate the uncertainty for tumor segmentation introduced by the blurring of tumor edges in PET. The performance of the proposed method was validated on a test dataset with fifty non-small cell lung cancer patients. Experimental results demonstrated that the proposed method had a high accuracy for PET/CT co-segmentation and PET restoration, and can accurately estimate the blur kernel of the PET scanner as well. For those complex images in which the tumors exhibit Fluorodeoxyglucose (FDG) uptake inhomogeneity or even invade adjacent soft normal tissues, the proposed method can still accurately segment the tumors. It achieved an average dice similarity indexes (DSI) of 0.85 ± 0.06, volume error (VE) of 0.09 ± 0.08, and classification error (CE) of 0.31 ± 0.13.
Collapse
Affiliation(s)
- Laquan Li
- Key Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Wei Lu
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York 10065, USA
| | - Shan Tan
- Key Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China
| |
Collapse
|
3
|
Li L, Zhao X, Lu W, Tan S. Deep Learning for Variational Multimodality Tumor Segmentation in PET/CT. Neurocomputing 2019; 392:277-295. [PMID: 32773965 DOI: 10.1016/j.neucom.2018.10.099] [Citation(s) in RCA: 48] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
Positron emission tomography/computed tomography (PET/CT) imaging can simultaneously acquire functional metabolic information and anatomical information of the human body. How to rationally fuse the complementary information in PET/CT for accurate tumor segmentation is challenging. In this study, a novel deep learning based variational method was proposed to automatically fuse multimodality information for tumor segmentation in PET/CT. A 3D fully convolutional network (FCN) was first designed and trained to produce a probability map from the CT image. The learnt probability map describes the probability of each CT voxel belonging to the tumor or the background, and roughly distinguishes the tumor from its surrounding soft tissues. A fuzzy variational model was then proposed to incorporate the probability map and the PET intensity image for an accurate multimodality tumor segmentation, where the probability map acted as a membership degree prior. A split Bregman algorithm was used to minimize the variational model. The proposed method was validated on a non-small cell lung cancer dataset with 84 PET/CT images. Experimental results demonstrated that: 1). Only a few training samples were needed for training the designed network to produce the probability map; 2). The proposed method can be applied to small datasets, normally seen in clinic research; 3). The proposed method successfully fused the complementary information in PET/CT, and outperformed two existing deep learning-based multimodality segmentation methods and other multimodality segmentation methods using traditional fusion strategies (without deep learning); 4). The proposed method had a good performance for tumor segmentation, even for those with Fluorodeoxyglucose (FDG) uptake inhomogeneity and blurred tumor edges (two major challenges in PET single modality segmentation) and complex surrounding soft tissues (one major challenge in CT single modality segmentation), and achieved an average dice similarity indexes (DSI) of 0.86 ± 0.05, sensitivity (SE) of 0.86 ± 0.07, positive predictive value (PPV) of 0.87 ± 0.10, volume error (VE) of 0.16 ± 0.12, and classification error (CE) of 0.30 ± 0.12.
Collapse
Affiliation(s)
- Laquan Li
- Key Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China.,College of Science, Chongqing University of Posts and Telecommunications, Chongqing 400065, China
| | - Xiangming Zhao
- Key Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Wei Lu
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, New York 10065, USA
| | - Shan Tan
- Key Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China
| |
Collapse
|
4
|
Lian C, Ruan S, Denoeux T, Li H, Vera P. Joint Tumor Segmentation in PET-CT Images Using Co-Clustering and Fusion Based on Belief Functions. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2019; 28:755-766. [PMID: 30296224 PMCID: PMC8191586 DOI: 10.1109/tip.2018.2872908] [Citation(s) in RCA: 37] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
Precise delineation of target tumor is a key factor to ensure the effectiveness of radiation therapy. While hybrid positron emission tomography-computed tomography (PET-CT) has become a standard imaging tool in the practice of radiation oncology, many existing automatic/semi-automatic methods still perform tumor segmentation on mono-modal images. In this paper, a co-clustering algorithm is proposed to concurrently segment 3D tumors in PET-CT images, considering that the two complementary imaging modalities can combine functional and anatomical information to improve segmentation performance. The theory of belief functions is adopted in the proposed method to model, fuse, and reason with uncertain and imprecise knowledge from noisy and blurry PET-CT images. To ensure reliable segmentation for each modality, the distance metric for the quantification of clustering distortions and spatial smoothness is iteratively adapted during the clustering procedure. On the other hand, to encourage consistent segmentation between different modalities, a specific context term is proposed in the clustering objective function. Moreover, during the iterative optimization process, clustering results for the two distinct modalities are further adjusted via a belief-functions-based information fusion strategy. The proposed method has been evaluated on a data set consisting of 21 paired PET-CT images for non-small cell lung cancer patients. The quantitative and qualitative evaluations show that our proposed method performs well compared with the state-of-the-art methods.
Collapse
|
5
|
Zhao X, Li L, Lu W, Tan S. Tumor co-segmentation in PET/CT using multi-modality fully convolutional neural network. Phys Med Biol 2018; 64:015011. [PMID: 30523964 PMCID: PMC7493812 DOI: 10.1088/1361-6560/aaf44b] [Citation(s) in RCA: 87] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Automatic tumor segmentation from medical images is an important step for computer-aided cancer diagnosis and treatment. Recently, deep learning has been successfully applied to this task, leading to state-of-the-art performance. However, most of existing deep learning segmentation methods only work for a single imaging modality. PET/CT scanner is nowadays widely used in the clinic, and is able to provide both metabolic information and anatomical information through integrating PET and CT into the same utility. In this study, we proposed a novel multi-modality segmentation method based on a 3D fully convolutional neural network (FCN), which is capable of taking account of both PET and CT information simultaneously for tumor segmentation. The network started with a multi-task training module, in which two parallel sub-segmentation architectures constructed using deep convolutional neural networks (CNNs) were designed to automatically extract feature maps from PET and CT respectively. A feature fusion module was subsequently designed based on cascaded convolutional blocks, which re-extracted features from PET/CT feature maps using a weighted cross entropy minimization strategy. The tumor mask was obtained as the output at the end of the network using a softmax function. The effectiveness of the proposed method was validated on a clinic PET/CT dataset of 84 patients with lung cancer. The results demonstrated that the proposed network was effective, fast and robust and achieved significantly performance gain over CNN-based methods and traditional methods using PET or CT only, two V-net based co-segmentation methods, two variational co-segmentation methods based on fuzzy set theory and a deep learning co-segmentation method using W-net.
Collapse
Affiliation(s)
- Xiangming Zhao
- Key Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Laquan Li
- Key Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Wei Lu
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, New York 10065, USA
| | - Shan Tan
- Key Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China
| |
Collapse
|
6
|
Delineation of lung cancer with FDG PET/CT during radiation therapy. Radiat Oncol 2018; 13:219. [PMID: 30419929 PMCID: PMC6233287 DOI: 10.1186/s13014-018-1163-2] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2018] [Accepted: 10/28/2018] [Indexed: 12/25/2022] Open
Abstract
OBJECTIVES To propose an easily applicable segmentation method (perPET-RT) for delineation of tumour volume during radiotherapy on interim fluorine 18 fluorodeoxyglucose (FDG) positron emission tomography/computed tomography (PET/CT) in patients with non-small cell lung cancer (NSCLC). MATERIAL AND METHODS Sixty-seven patients (51 primary tumours, 60 lymph nodes), from 4 prospective studies, underwent an FDG PET/CT scan during the fifth week of radiation therapy, using different generations of PET/CT. Per-therapeutic PET/CT scans were delineated in consensus by two experienced physicians leading to the gold standard threshold to be applied. The mathematical expression of Thopt, the optimal threshold to be applied as a function of the maximum standard uptake value (SUVmax), was determined. The performance of this method (perPET-RT) was assessed by computing the DICE similarity coefficient (DSC) and was compared with 8 fixed threshold values and 3 adaptive thresholding methods. RESULTS Thopt verified the following expression: Thopt = A.ln(1/SUVmax) + B where A and B were 2 constants. A and B were independent from the generation of PET/CT, but depended on the type of lesions (primary lung tumours vs. lymph nodes). PerPET-RT showed good to very good agreement in comparison to the gold standard. The mean and standard deviation of DSC value was 0.81 ± 0.13 for lung lesions and 0.78 ± 0.15 for lymph nodes. PerPET-RT showed a significant better agreement than the other segmentation methods (p < 0.001), except for one of the adaptive thresholding method ADT (p = 0.11). CONCLUSION On the database used, perPET-RT has proven its reliability and accuracy for tumour delineation on per-therapeutic FDG PET/CT using only SUVmax measurement. This method may be used to delineate tumour volume for dose-escalation planning. TRIAL REGISTRATION NCT01261598 , NCT01261585 , NCT01576796 .
Collapse
|
7
|
Taghanaki SA, Duggan N, Ma H, Hou X, Celler A, Benard F, Hamarneh G. Segmentation-free direct tumor volume and metabolic activity estimation from PET scans. Comput Med Imaging Graph 2018; 63:52-66. [DOI: 10.1016/j.compmedimag.2017.12.004] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2017] [Revised: 11/16/2017] [Accepted: 12/20/2017] [Indexed: 11/29/2022]
|
8
|
Hatt M, Lee JA, Schmidtlein CR, Naqa IE, Caldwell C, De Bernardi E, Lu W, Das S, Geets X, Gregoire V, Jeraj R, MacManus MP, Mawlawi OR, Nestle U, Pugachev AB, Schöder H, Shepherd T, Spezi E, Visvikis D, Zaidi H, Kirov AS. Classification and evaluation strategies of auto-segmentation approaches for PET: Report of AAPM task group No. 211. Med Phys 2017; 44:e1-e42. [PMID: 28120467 DOI: 10.1002/mp.12124] [Citation(s) in RCA: 134] [Impact Index Per Article: 19.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2016] [Revised: 12/09/2016] [Accepted: 01/04/2017] [Indexed: 12/14/2022] Open
Abstract
PURPOSE The purpose of this educational report is to provide an overview of the present state-of-the-art PET auto-segmentation (PET-AS) algorithms and their respective validation, with an emphasis on providing the user with help in understanding the challenges and pitfalls associated with selecting and implementing a PET-AS algorithm for a particular application. APPROACH A brief description of the different types of PET-AS algorithms is provided using a classification based on method complexity and type. The advantages and the limitations of the current PET-AS algorithms are highlighted based on current publications and existing comparison studies. A review of the available image datasets and contour evaluation metrics in terms of their applicability for establishing a standardized evaluation of PET-AS algorithms is provided. The performance requirements for the algorithms and their dependence on the application, the radiotracer used and the evaluation criteria are described and discussed. Finally, a procedure for algorithm acceptance and implementation, as well as the complementary role of manual and auto-segmentation are addressed. FINDINGS A large number of PET-AS algorithms have been developed within the last 20 years. Many of the proposed algorithms are based on either fixed or adaptively selected thresholds. More recently, numerous papers have proposed the use of more advanced image analysis paradigms to perform semi-automated delineation of the PET images. However, the level of algorithm validation is variable and for most published algorithms is either insufficient or inconsistent which prevents recommending a single algorithm. This is compounded by the fact that realistic image configurations with low signal-to-noise ratios (SNR) and heterogeneous tracer distributions have rarely been used. Large variations in the evaluation methods used in the literature point to the need for a standardized evaluation protocol. CONCLUSIONS Available comparison studies suggest that PET-AS algorithms relying on advanced image analysis paradigms provide generally more accurate segmentation than approaches based on PET activity thresholds, particularly for realistic configurations. However, this may not be the case for simple shape lesions in situations with a narrower range of parameters, where simpler methods may also perform well. Recent algorithms which employ some type of consensus or automatic selection between several PET-AS methods have potential to overcome the limitations of the individual methods when appropriately trained. In either case, accuracy evaluation is required for each different PET scanner and scanning and image reconstruction protocol. For the simpler, less robust approaches, adaptation to scanning conditions, tumor type, and tumor location by optimization of parameters is necessary. The results from the method evaluation stage can be used to estimate the contouring uncertainty. All PET-AS contours should be critically verified by a physician. A standard test, i.e., a benchmark dedicated to evaluating both existing and future PET-AS algorithms needs to be designed, to aid clinicians in evaluating and selecting PET-AS algorithms and to establish performance limits for their acceptance for clinical use. The initial steps toward designing and building such a standard are undertaken by the task group members.
Collapse
Affiliation(s)
- Mathieu Hatt
- INSERM, UMR 1101, LaTIM, University of Brest, IBSAM, Brest, France
| | - John A Lee
- Université catholique de Louvain (IREC/MIRO) & FNRS, Brussels, 1200, Belgium
| | | | | | - Curtis Caldwell
- Sunnybrook Health Sciences Center, Toronto, ON, M4N 3M5, Canada
| | | | - Wei Lu
- Memorial Sloan Kettering Cancer Center, New York, NY, 10065, USA
| | - Shiva Das
- University of North Carolina, Chapel Hill, NC, 27599, USA
| | - Xavier Geets
- Université catholique de Louvain (IREC/MIRO) & FNRS, Brussels, 1200, Belgium
| | - Vincent Gregoire
- Université catholique de Louvain (IREC/MIRO) & FNRS, Brussels, 1200, Belgium
| | - Robert Jeraj
- University of Wisconsin, Madison, WI, 53705, USA
| | | | | | - Ursula Nestle
- Universitätsklinikum Freiburg, Freiburg, 79106, Germany
| | - Andrei B Pugachev
- University of Texas Southwestern Medical Center, Dallas, TX, 75390, USA
| | - Heiko Schöder
- Memorial Sloan Kettering Cancer Center, New York, NY, 10065, USA
| | | | - Emiliano Spezi
- School of Engineering, Cardiff University, Cardiff, Wales, United Kingdom
| | | | - Habib Zaidi
- Geneva University Hospital, Geneva, CH-1211, Switzerland
| | - Assen S Kirov
- Memorial Sloan Kettering Cancer Center, New York, NY, 10065, USA
| |
Collapse
|
9
|
Lian C, Ruan S, Denoux T, Li H, Vera P. Spatial Evidential Clustering With Adaptive Distance Metric for Tumor Segmentation in FDG-PET Images. IEEE Trans Biomed Eng 2017; 65:21-30. [PMID: 28371772 DOI: 10.1109/tbme.2017.2688453] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
While the accurate delineation of tumor volumes in FDG-positron emission tomography (PET) is a vital task for diverse objectives in clinical oncology, noise and blur due to the imaging system make it a challenging work. In this paper, we propose to address the imprecision and noise inherent in PET using Dempster-Shafer theory, a powerful tool for modeling and reasoning with uncertain and/or imprecise information. Based on Dempster-Shafer theory, a novel evidential clustering algorithm is proposed and tailored for the tumor segmentation task in three-dimensional. For accurate clustering of PET voxels, each voxel is described not only by the single intensity value but also complementarily by textural features extracted from a patch surrounding the voxel. Considering that there are a large amount of textures without consensus regarding the most informative ones, and some of the extracted features are even unreliable due to the low-quality PET images, a specific procedure is included in the proposed clustering algorithm to adapt distance metric for properly representing the clustering distortions and the similarities between neighboring voxels. This integrated metric adaptation procedure will realize a low-dimensional transformation from the original space, and will limit the influence of unreliable inputs via feature selection. A Dempster-Shafer-theory-based spatial regularization is also proposed and included in the clustering algorithm, so as to effectively quantify the local homogeneity. The proposed method has been compared with other methods on the real-patient FDG-PET images, showing good performance.
Collapse
|
10
|
Li L, Wang J, Lu W, Tan S. Simultaneous Tumor Segmentation, Image Restoration, and Blur Kernel Estimation in PET Using Multiple Regularizations. COMPUTER VISION AND IMAGE UNDERSTANDING : CVIU 2017; 155:173-194. [PMID: 28603407 PMCID: PMC5463621 DOI: 10.1016/j.cviu.2016.10.002] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
Accurate tumor segmentation from PET images is crucial in many radiation oncology applications. Among others, partial volume effect (PVE) is recognized as one of the most important factors degrading imaging quality and segmentation accuracy in PET. Taking into account that image restoration and tumor segmentation are tightly coupled and can promote each other, we proposed a variational method to solve both problems simultaneously in this study. The proposed method integrated total variation (TV) semi-blind de-convolution and Mumford-Shah segmentation with multiple regularizations. Unlike many existing energy minimization methods using either TV or L2 regularization, the proposed method employed TV regularization over tumor edges to preserve edge information, and L2 regularization inside tumor regions to preserve the smooth change of the metabolic uptake in a PET image. The blur kernel was modeled as anisotropic Gaussian to address the resolution difference in transverse and axial directions commonly seen in a clinic PET scanner. The energy functional was rephrased using the Γ-convergence approximation and was iteratively optimized using the alternating minimization (AM) algorithm. The performance of the proposed method was validated on a physical phantom and two clinic datasets with non-Hodgkin's lymphoma and esophageal cancer, respectively. Experimental results demonstrated that the proposed method had high performance for simultaneous image restoration, tumor segmentation and scanner blur kernel estimation. Particularly, the recovery coefficients (RC) of the restored images of the proposed method in the phantom study were close to 1, indicating an efficient recovery of the original blurred images; for segmentation the proposed method achieved average dice similarity indexes (DSIs) of 0.79 and 0.80 for two clinic datasets, respectively; and the relative errors of the estimated blur kernel widths were less than 19% in the transversal direction and 7% in the axial direction.
Collapse
Affiliation(s)
- Laquan Li
- Key Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Jian Wang
- Key Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Wei Lu
- Department of Radiation Oncology, University of Maryland School of Medicine, Baltimore, Maryland 21201, USA
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York 10065, USA
| | - Shan Tan
- Key Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China
| |
Collapse
|
11
|
Ju W, Xiang D, Zhang B, Wang L, Kopriva I, Chen X. Random Walk and Graph Cut for Co-Segmentation of Lung Tumor on PET-CT Images. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2015; 24:5854-5867. [PMID: 26462198 DOI: 10.1109/tip.2015.2488902] [Citation(s) in RCA: 59] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Accurate lung tumor delineation plays an important role in radiotherapy treatment planning. Since the lung tumor has poor boundary in positron emission tomography (PET) images and low contrast in computed tomography (CT) images, segmentation of tumor in the PET and CT images is a challenging task. In this paper, we effectively integrate the two modalities by making fully use of the superior contrast of PET images and superior spatial resolution of CT images. Random walk and graph cut method is integrated to solve the segmentation problem, in which random walk is utilized as an initialization tool to provide object seeds for graph cut segmentation on the PET and CT images. The co-segmentation problem is formulated as an energy minimization problem which is solved by max-flow/min-cut method. A graph, including two sub-graphs and a special link, is constructed, in which one sub-graph is for the PET and another is for CT, and the special link encodes a context term which penalizes the difference of the tumor segmentation on the two modalities. To fully utilize the characteristics of PET and CT images, a novel energy representation is devised. For the PET, a downhill cost and a 3D derivative cost are proposed. For the CT, a shape penalty cost is integrated into the energy function which helps to constrain the tumor region during the segmentation. We validate our algorithm on a data set which consists of 18 PET-CT images. The experimental results indicate that the proposed method is superior to the graph cut method solely using the PET or CT is more accurate compared with the random walk method, random walk co-segmentation method, and non-improved graph cut method.
Collapse
|
12
|
Dewalle-Vignion AS, Betrouni N, Baillet C, Vermandel M. Is STAPLE algorithm confident to assess segmentation methods in PET imaging? Phys Med Biol 2015; 60:9473-91. [PMID: 26584044 DOI: 10.1088/0031-9155/60/24/9473] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
Accurate tumor segmentation in [18F]-fluorodeoxyglucose positron emission tomography is crucial for tumor response assessment and target volume definition in radiation therapy. Evaluation of segmentation methods from clinical data without ground truth is usually based on physicians' manual delineations. In this context, the simultaneous truth and performance level estimation (STAPLE) algorithm could be useful to manage the multi-observers variability. In this paper, we evaluated how this algorithm could accurately estimate the ground truth in PET imaging. Complete evaluation study using different criteria was performed on simulated data. The STAPLE algorithm was applied to manual and automatic segmentation results. A specific configuration of the implementation provided by the Computational Radiology Laboratory was used. Consensus obtained by the STAPLE algorithm from manual delineations appeared to be more accurate than manual delineations themselves (80% of overlap). An improvement of the accuracy was also observed when applying the STAPLE algorithm to automatic segmentations results. The STAPLE algorithm, with the configuration used in this paper, is more appropriate than manual delineations alone or automatic segmentations results alone to estimate the ground truth in PET imaging. Therefore, it might be preferred to assess the accuracy of tumor segmentation methods in PET imaging.
Collapse
Affiliation(s)
- Anne-Sophie Dewalle-Vignion
- Université Lille, Inserm, CHU Lille, U1189-ONCO-THAI-Image Assisted Laser Therapy for Oncology, F-59000 Lille, France
| | | | | | | |
Collapse
|
13
|
Carles M, Fechter T, Nemer U, Nanko N, Mix M, Nestle U, Schaefer A. Feasibility of a semi-automated contrast-oriented algorithm for tumor segmentation in retrospectively gated PET images: phantom and clinical validation. Phys Med Biol 2015; 60:9227-51. [DOI: 10.1088/0031-9155/60/24/9227] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
|
14
|
Impact of consensus contours from multiple PET segmentation methods on the accuracy of functional volume delineation. Eur J Nucl Med Mol Imaging 2015; 43:911-924. [DOI: 10.1007/s00259-015-3239-7] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2015] [Accepted: 10/27/2015] [Indexed: 12/22/2022]
|
15
|
Layer T, Blaickner M, Knäusl B, Georg D, Neuwirth J, Baum RP, Schuchardt C, Wiessalla S, Matz G. PET image segmentation using a Gaussian mixture model and Markov random fields. EJNMMI Phys 2015; 2:9. [PMID: 26501811 PMCID: PMC4545759 DOI: 10.1186/s40658-015-0110-7] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2014] [Accepted: 09/08/2014] [Indexed: 12/05/2022] Open
Abstract
Background Classification algorithms for positron emission tomography (PET) images support computational treatment planning in radiotherapy. Common clinical practice is based on manual delineation and fixed or iterative threshold methods, the latter of which requires regression curves dependent on many parameters. Methods An improved statistical approach using a Gaussian mixture model (GMM) is proposed to obtain initial estimates of a target volume, followed by a correction step based on a Markov random field (MRF) and a Gibbs distribution to account for dependencies among neighboring voxels. In order to evaluate the proposed algorithm, phantom measurements of spherical and non-spherical objects with the smallest diameter being 8 mm were performed at signal-to-background ratios (SBRs) between 2.06 and 9.39. Additionally 68Ga-PET data from patients with lesions in the liver and lymph nodes were evaluated. Results The proposed algorithm produces stable results for different reconstruction algorithms and different lesion shapes. Furthermore, it outperforms all threshold methods regarding detection rate, determines the spheres’ volumes more accurately than fixed threshold methods, and produces similar values as iterative thresholding. In a comparison with other statistical approaches, the algorithm performs equally well for larger volumes and even shows improvements for small volumes and SBRs. The comparison with experts’ manual delineations on the clinical data shows the same qualitative behavior as for the phantom measurements. Conclusions In conclusion, a generic probabilistic approach that does not require data measured beforehand is presented whose performance, robustness, and swiftness make it a feasible choice for PET segmentation.
Collapse
Affiliation(s)
- Thomas Layer
- Institute of Telecommunications, Vienna University of Technology, Karlsplatz 13, Vienna, 1040 Wien, Austria. .,Health & Environment Department, Austrian Institute of Technology, Donau-City-Strasse 1/2, Vienna, 1220 Wien, Austria.
| | - Matthias Blaickner
- Health & Environment Department, Austrian Institute of Technology, Donau-City-Strasse 1/2, Vienna, 1220 Wien, Austria.
| | - Barbara Knäusl
- Department of Radiation Oncology, Division of Medical Radiation Physics, Christian Doppler Laboratory for Medical Radiation Research for Radiation Oncology, Medical University of Vienna/AKH Vienna, Währinger Gürtel 18-20, Vienna, 1090 Wien, Austria.
| | - Dietmar Georg
- Department of Radiation Oncology, Division of Medical Radiation Physics, Christian Doppler Laboratory for Medical Radiation Research for Radiation Oncology, Medical University of Vienna/AKH Vienna, Währinger Gürtel 18-20, Vienna, 1090 Wien, Austria.
| | - Johannes Neuwirth
- Radiation Safety and Applications, Seibersdorf Labor GmbH, 2444 Seibersdorf, Seibersdorf, Austria.
| | - Richard P Baum
- THERANOSTICS Center for Molecular Radiotherapy and Molecular Imaging (PET/CT) ENETS Center of Excellence, Zentralklinik Bad Berka, Robert-Koch-Allee 9, 99437 Bad Berka, Bad Berka, Germany.
| | - Christiane Schuchardt
- THERANOSTICS Center for Molecular Radiotherapy and Molecular Imaging (PET/CT) ENETS Center of Excellence, Zentralklinik Bad Berka, Robert-Koch-Allee 9, 99437 Bad Berka, Bad Berka, Germany.
| | - Stefan Wiessalla
- THERANOSTICS Center for Molecular Radiotherapy and Molecular Imaging (PET/CT) ENETS Center of Excellence, Zentralklinik Bad Berka, Robert-Koch-Allee 9, 99437 Bad Berka, Bad Berka, Germany.
| | - Gerald Matz
- Institute of Telecommunications, Vienna University of Technology, Karlsplatz 13, Vienna, 1040 Wien, Austria.
| |
Collapse
|
16
|
Lelandais B, Ruan S, Denœux T, Vera P, Gardin I. Fusion of multi-tracer PET images for dose painting. Med Image Anal 2014; 18:1247-59. [PMID: 25128684 DOI: 10.1016/j.media.2014.06.014] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2014] [Revised: 05/25/2014] [Accepted: 06/28/2014] [Indexed: 11/19/2022]
Abstract
PET imaging with FluoroDesoxyGlucose (FDG) tracer is clinically used for the definition of Biological Target Volumes (BTVs) for radiotherapy. Recently, new tracers, such as FLuoroThymidine (FLT) or FluoroMisonidazol (FMiso), have been proposed. They provide complementary information for the definition of BTVs. Our work is to fuse multi-tracer PET images to obtain a good BTV definition and to help the radiation oncologist in dose painting. Due to the noise and the partial volume effect leading, respectively, to the presence of uncertainty and imprecision in PET images, the segmentation and the fusion of PET images is difficult. In this paper, a framework based on Belief Function Theory (BFT) is proposed for the segmentation of BTV from multi-tracer PET images. The first step is based on an extension of the Evidential C-Means (ECM) algorithm, taking advantage of neighboring voxels for dealing with uncertainty and imprecision in each mono-tracer PET image. Then, imprecision and uncertainty are, respectively, reduced using prior knowledge related to defects in the acquisition system and neighborhood information. Finally, a multi-tracer PET image fusion is performed. The results are represented by a set of parametric maps that provide important information for dose painting. The performances are evaluated on PET phantoms and patient data with lung cancer. Quantitative results show good performance of our method compared with other methods.
Collapse
Affiliation(s)
| | - Su Ruan
- QuantIF, LITIS EA 4108, University of Rouen, France
| | - Thierry Denœux
- Heudiasyc (UMR 7253), Université de Technologie de Compiègne, CNRS, Compiègne, France
| | - Pierre Vera
- Department of Nuclear medicine, Henri Becquerel Center, France
| | - Isabelle Gardin
- Department of Nuclear medicine, Henri Becquerel Center, France
| |
Collapse
|
17
|
|
18
|
Shusharina N, Cho J, Sharp GC, Choi NC. Correlation of (18)F-FDG avid volumes on pre-radiation therapy and post-radiation therapy FDG PET scans in recurrent lung cancer. Int J Radiat Oncol Biol Phys 2014; 89:137-44. [PMID: 24725696 DOI: 10.1016/j.ijrobp.2014.01.047] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2013] [Revised: 01/23/2014] [Accepted: 01/27/2014] [Indexed: 01/01/2023]
Abstract
PURPOSE To investigate the spatial correlation between high uptake regions of 2-deoxy-2-[(18)F]-fluoro-D-glucose positron emission tomography ((18)F-FDG PET) before and after therapy in recurrent lung cancer. METHODS AND MATERIALS We enrolled 106 patients with inoperable lung cancer into a prospective study whose primary objectives were to determine first, the earliest time point when the maximum decrease in FDG uptake representing the maximum metabolic response (MMR) is attainable and second, the optimum cutoff value of MMR based on its predicted tumor control probability, sensitivity, and specificity. Of those patients, 61 completed the required 4 serial (18)F-FDG PET examinations after therapy. Nineteen of 61 patients experienced local recurrence at the primary tumor and underwent analysis. The volumes of interest (VOI) on pretherapy FDG-PET were defined by use of an isocontour at ≥50% of maximum standard uptake value (SUVmax) (≥50% of SUVmax) with correction for heterogeneity. The VOI on posttherapy images were defined at ≥80% of SUVmax. The VOI of pretherapy and posttherapy (18)F-FDG PET images were correlated for the extent of overlap. RESULTS The size of VOI at pretherapy images was on average 25.7% (range, 8.8%-56.3%) of the pretherapy primary gross tumor volume (GTV), and their overlap fractions were 0.8 (95% confidence interval [CI]: 0.7-0.9), 0.63 (95% CI: 0.49-0.77), and 0.38 (95% CI: 0.19-0.57) of VOI of posttherapy FDG PET images at 10 days, 3 months, and 6 months, respectively. The residual uptake originated from the pretherapy VOI in 15 of 17 cases. CONCLUSIONS VOI defined by the SUVmax-≥50% isocontour may be a biological target volume for escalated radiation dose.
Collapse
Affiliation(s)
- Nadya Shusharina
- Department of Radiation Oncology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts.
| | - Joseph Cho
- Department of Radiation Oncology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| | - Gregory C Sharp
- Department of Radiation Oncology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| | - Noah C Choi
- Department of Radiation Oncology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
19
|
Prieto E, Martí-Climent J, Gómez-Fernández M, García-Velloso M, Valero M, Garrastachu P, Aristu J, Alcázar J, Torre W, Hernández J, Pardo F, Peñuelas I, Richter J. Validation of segmentation techniques for positron emission tomography using ex vivo images of oncological surgical specimens. Rev Esp Med Nucl Imagen Mol 2014. [DOI: 10.1016/j.remnie.2014.01.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
20
|
[Validation of segmentation techniques for positron emission tomography using ex-vivo images of oncological surgical specimens]. Rev Esp Med Nucl Imagen Mol 2013; 33:79-86. [PMID: 23953601 DOI: 10.1016/j.remn.2013.06.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2013] [Revised: 06/03/2013] [Accepted: 06/06/2013] [Indexed: 11/22/2022]
Abstract
OBJECTIVE To design a novel ex-vivo acquisition technique to establish a common framework to validate different segmentation techniques for oncological PET images. To evaluate several automatic segmentation algorithms on this set of images. MATERIAL AND METHODS In 15 patients with cancer, ex-vivo PET studies of surgical specimens removed during surgery were performed after injection of (18)F-FDG. Images were acquired in two scanners: a clinical PET/CT and a high-resolution PET scanner. Real tumor volume was determined in each patient, and a reference image was generated for segmentation of each tumor. Images were segmented with 12 automatic algorithms and with a standard method for PET (relative threshold at 42%) and results were evaluated by quantitative parameters. RESULTS It has been possible to demonstrate by segmentation of PET images of surgical specimens that on high resolution PET images, 8 out of 12 evaluated segmentation techniques outperformed the standard method, whose value is 42%. However, none of the algorithms outperformed the standard method when applied on images from the clinical PET/CT. Due to the great interest of this set of PET images, all studies have been published on the Internet in order to provide a common framework for validation and comparison of different segmentation techniques. CONCLUSIONS We have proposed a novel technique to validate segmentation techniques for oncological PET images, acquiring ex-vivo PET studies of surgical specimens. We have demonstrated the usefulness of this set of PET images by evaluating several automatic segmentation algorithms.
Collapse
|
21
|
Three-dimensional skeletonization and symbolic description in vascular imaging: preliminary results. Int J Comput Assist Radiol Surg 2012; 8:233-46. [DOI: 10.1007/s11548-012-0784-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2012] [Accepted: 07/11/2012] [Indexed: 10/28/2022]
|
22
|
Betrouni N, Makni N, Dewalle-Vignion AS, Vermandel M. MedataWeb: A shared platform for multimodality medical images and Atlases. Ing Rech Biomed 2012. [DOI: 10.1016/j.irbm.2012.04.003] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
23
|
|
24
|
Dewalle-Vignion AS, Makni N, Betrouni N, Huglo D, Stute S, Buvat I, Vermandel M. Nouvelle méthode de segmentation des volumes d’intérêt en TEP : utilisation de la théorie des possibilités. Ing Rech Biomed 2011. [DOI: 10.1016/j.irbm.2011.09.011] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/15/2022]
|
25
|
Hatt M, Boussion N, Cheze-Le Rest C, Visvikis D, Pradier O. [Metabolically active volumes automatic delineation methodologies in PET imaging: review and perspectives]. Cancer Radiother 2011; 16:70-81; quiz 82, 84. [PMID: 22041031 DOI: 10.1016/j.canrad.2011.07.243] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2011] [Revised: 05/31/2011] [Accepted: 07/04/2011] [Indexed: 12/26/2022]
Abstract
PET imaging is now considered a gold standard tool in clinical oncology, especially for diagnosis purposes. More recent applications such as therapy follow-up or tumor targeting in radiotherapy require a fast, accurate and robust metabolically active tumor volumes delineation on emission images, which cannot be obtained through manual contouring. This clinical need has sprung a large number of methodological developments regarding automatic methods to define tumor volumes on PET images. This paper reviews most of the methodologies that have been recently proposed and discusses their framework and methodological and/or clinical validation. Perspectives regarding the future work to be done are also suggested.
Collapse
Affiliation(s)
- M Hatt
- Inserm U650 LaTIM, CHU Morvan, 5, avenue Foch, 29609 Brest, France.
| | | | | | | | | |
Collapse
|
26
|
Hatt M, Cheze-le Rest C, van Baardwijk A, Lambin P, Pradier O, Visvikis D. Impact of tumor size and tracer uptake heterogeneity in (18)F-FDG PET and CT non-small cell lung cancer tumor delineation. J Nucl Med 2011; 52:1690-7. [PMID: 21990577 DOI: 10.2967/jnumed.111.092767] [Citation(s) in RCA: 111] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
UNLABELLED The objectives of this study were to investigate the relationship between CT- and (18)F-FDG PET-based tumor volumes in non-small cell lung cancer (NSCLC) and the impact of tumor size and uptake heterogeneity on various approaches to delineating uptake on PET images. METHODS Twenty-five NSCLC cancer patients with (18)F-FDG PET/CT were considered. Seventeen underwent surgical resection of their tumor, and the maximum diameter was measured. Two observers manually delineated the tumors on the CT images and the tumor uptake on the corresponding PET images, using a fixed threshold at 50% of the maximum (T(50)), an adaptive threshold methodology, and the fuzzy locally adaptive Bayesian (FLAB) algorithm. Maximum diameters of the delineated volumes were compared with the histopathology reference when available. The volumes of the tumors were compared, and correlations between the anatomic volume and PET uptake heterogeneity and the differences between delineations were investigated. RESULTS All maximum diameters measured on PET and CT images significantly correlated with the histopathology reference (r > 0.89, P < 0.0001). Significant differences were observed among the approaches: CT delineation resulted in large overestimation (+32% ± 37%), whereas all delineations on PET images resulted in underestimation (from -15% ± 17% for T(50) to -4% ± 8% for FLAB) except manual delineation (+8% ± 17%). Overall, CT volumes were significantly larger than PET volumes (55 ± 74 cm(3) for CT vs. from 18 ± 25 to 47 ± 76 cm(3) for PET). A significant correlation was found between anatomic tumor size and heterogeneity (larger lesions were more heterogeneous). Finally, the more heterogeneous the tumor uptake, the larger was the underestimation of PET volumes by threshold-based techniques. CONCLUSION Volumes based on CT images were larger than those based on PET images. Tumor size and tracer uptake heterogeneity have an impact on threshold-based methods, which should not be used for the delineation of cases of large heterogeneous NSCLC, as these methods tend to largely underestimate the spatial extent of the functional tumor in such cases. For an accurate delineation of PET volumes in NSCLC, advanced image segmentation algorithms able to deal with tracer uptake heterogeneity should be preferred.
Collapse
|