Impact of consensus contours from multiple PET segmentation methods on the accuracy of functional volume delineation

Does consensus contour improve robustness and accuracy in 18F-FDG PET radiomic features?

PURPOSE

The purpose of our study is to validate the robustness and accuracy of consensus contour in 2-deoxy-2-[18 F]fluoro-D-glucose (18 F-FDG) PET radiomic features.

METHODS

225 nasopharyngeal carcinoma (NPC) and 13 extended cardio-torso (XCAT) simulated data were enrolled. All segmentation were performed with four segmentation methods under two different initial masks, respectively. Consensus contour (ConSeg) was then developed using the majority vote rule. 107 radiomic features were extracted by Pyradiomics based on segmentation and the intraclass correlation coefficient (ICC) was calculated for each feature between masks or among segmentation, respectively. In XCAT ICC between segmentation and simulated ground truth were also calculated to access the accuracy.

RESULTS

ICC varied with the dataset, segmentation method, initial mask and feature type. ConSeg presented higher ICC for radiomic features in robustness tests and similar ICC in accuracy tests, compared with the average of four segmentation results. Higher ICC were also generally observed in irregular initial masks compared with rectangular masks in both robustness and accuracy tests. Furthermore, 19 features (17.76%) had ICC ≥ 0.75 in both robustness and accuracy tests for any of the segmentation methods or initial masks. The dataset was observed to have a large impact on the correlation relationships between radiomic features, but not the segmentation method or initial mask.

CONCLUSIONS

The consensus contour combined with irregular initial mask could improve the robustness and accuracy in radiomic analysis to some extent. The correlation relationships between radiomic features and feature clusters largely depended on the dataset, but not segmentation method or initial mask.

Automated hippocampal segmentation algorithms evaluated in stroke patients

Deep learning segmentation algorithms can produce reproducible results in a matter of seconds. However, their application to more complex datasets is uncertain and may fail in the presence of severe structural abnormalities-such as those commonly seen in stroke patients. In this investigation, six recent, deep learning-based hippocampal segmentation algorithms were tested on 641 stroke patients of a multicentric, open-source dataset ATLAS 2.0. The comparisons of the volumes showed that the methods are not interchangeable with concordance correlation coefficients from 0.266 to 0.816. While the segmentation algorithms demonstrated an overall good performance (volumetric similarity [VS] 0.816 to 0.972, DICE score 0.786 to 0.921, and Hausdorff distance [HD] 2.69 to 6.34), no single out-performing algorithm was identified: FastSurfer performed best in VS, QuickNat in DICE and average HD, and Hippodeep in HD. Segmentation performance was significantly lower for ipsilesional segmentation, with a decrease in performance as a function of lesion size due to the pathology-based domain shift. Only QuickNat showed a more robust performance in volumetric similarity. Even though there are many pre-trained segmentation methods, it is important to be aware of the possible decrease in performance for the segmentation results on the lesion side due to the pathology-based domain shift. The segmentation algorithm should be selected based on the research question and the evaluation parameter needed. More research is needed to improve current hippocampal segmentation methods.

Does consensus contours improve robustness and accuracy on [Formula: see text]F-FDG PET imaging tumor delineation?

PURPOSE

The aim of this study is to explore the robustness and accuracy of consensus contours with 225 nasopharyngeal carcinoma (NPC) clinical cases and 13 extended cardio-torso simulated lung tumors (XCAT) based on 2-deoxy-2-[[Formula: see text]F]fluoro-D-glucose ([Formula: see text]F-FDG) PET imaging.

METHODS

Primary tumor segmentation was performed with two different initial masks on 225 NPC [Formula: see text]F-FDG PET datasets and 13 XCAT simulations using methods of automatic segmentation with active contour, affinity propagation (AP), contrast-oriented thresholding (ST), and 41% maximum tumor value (41MAX), respectively. Consensus contours (ConSeg) were subsequently generated based on the majority vote rule. The metabolically active tumor volume (MATV), relative volume error (RE), Dice similarity coefficient (DSC) and their respective test-retest (TRT) metrics between different masks were adopted to analyze the results quantitatively. The nonparametric Friedman and post hoc Wilcoxon tests with Bonferroni adjustment for multiple comparisons were performed with [Formula: see text] 0.05 considered to be significant.

RESULTS

AP presented the highest variability for MATV in different masks, and ConSeg presented much better TRT performances in MATV compared with AP, and slightly poorer TRT in MATV compared with ST or 41MAXin most cases. Similar trends were also found in RE and DSC with the simulated data. The average of four segmentation results (AveSeg) showed better or comparable results in accuracy for most cases with respect to ConSeg. AP, AveSeg and ConSeg presented better RE and DSC in irregular masks as compared with rectangle masks. Additionally, all methods underestimated the tumour boundaries in relation to the ground truth for XCAT including respiratory motion.

CONCLUSIONS

The consensus method could be a robust approach to alleviate segmentation variabilities, but did not seem to improve the accuracy of segmentation results on average. Irregular initial masks might be at least in some cases attributable to mitigate the segmentation variability as well.

Impact of SSTR PET on Inter-Observer Variability of Target Delineation of Meningioma and the Possibility of Using Threshold-Based Segmentations in Radiation Oncology

Aim: The aim of this study was to assess the effects of including somatostatin receptor agonist (SSTR) PET imaging in meningioma radiotherapy planning by means of changes in inter-observer variability (IOV). Further, the possibility of using threshold-based delineation approaches for semiautomatic tumor volume definition was assessed. Patients and Methods: Sixteen patients with meningioma undergoing fractionated radiotherapy were delineated by five radiation oncologists. IOV was calculated by comparing each delineation to a consensus delineation, based on the simultaneous truth and performance level estimation (STAPLE) algorithm. The consensus delineation was used to adapt a threshold-based delineation, based on a maximization of the mean Dice coefficient. To test the threshold-based approach, seven patients with SSTR-positive meningioma were additionally evaluated as a validation group. Results: The average Dice coefficients for delineations based on MRI alone was 0.84 ± 0.12. For delineation based on MRI + PET, a significantly higher dice coefficient of 0.87 ± 0.08 was found (p < 0.001). The Hausdorff distance decreased from 10.96 ± 11.98 mm to 8.83 ± 12.21 mm (p < 0.001) when adding PET for the lesion delineation. The best threshold value for a threshold-based delineation was found to be 14.0% of the SUVmax, with an average Dice coefficient of 0.50 ± 0.19 compared to the consensus delineation. In the validation cohort, a Dice coefficient of 0.56 ± 0.29 and a Hausdorff coefficient of 27.15 ± 21.54 mm were found for the threshold-based approach. Conclusions: SSTR-PET added to standard imaging with CT and MRI reduces the IOV in radiotherapy planning for patients with meningioma. When using a threshold-based approach for PET-based delineation of meningioma, a relatively low threshold of 14.0% of the SUVmax was found to provide the best agreement with a consensus delineation.

GOECP/SEOR radiotheraphy guidelines for non-small-cell lung cancer

Non-small cell lung cancer (NSCLC) is a heterogeneous disease accounting for approximately 85% of all lung cancers. Only 17% of patients are diagnosed at an early stage. Treatment is multidisciplinary and radiotherapy plays a key role in all stages of the disease. More than 50% of patients with NSCLC are treated with radiotherapy (curative-intent or palliative). Technological advances-including highly conformal radiotherapy techniques, new immobilization and respiratory control systems, and precision image verification systems-allow clinicians to individualize treatment to maximize tumor control while minimizing treatment-related toxicity. Novel therapeutic regimens such as moderate hypofractionation and advanced techniques such as stereotactic body radiotherapy (SBRT) have reduced the number of radiotherapy sessions. The integration of SBRT into routine clinical practice has radically altered treatment of early-stage disease. SBRT also plays an increasingly important role in oligometastatic disease. The aim of the present guidelines is to review the role of radiotherapy in the treatment of localized, locally-advanced, and metastatic NSCLC. We review the main radiotherapy techniques and clarify the role of radiotherapy in routine clinical practice. These guidelines are based on the best available evidence. The level and grade of evidence supporting each recommendation is provided.

Joint EANM/SNMMI/ESTRO practice recommendations for the use of 2-[18F]FDG PET/CT external beam radiation treatment planning in lung cancer V1.0

Purpose

2-[¹⁸F]FDG PET/CT is of utmost importance for radiation treatment (RT) planning and response monitoring in lung cancer patients, in both non-small and small cell lung cancer (NSCLC and SCLC). This topic has been addressed in guidelines composed by experts within the field of radiation oncology. However, up to present, there is no procedural guideline on this subject, with involvement of the nuclear medicine societies.

Methods

A literature review was performed, followed by a discussion between a multidisciplinary team of experts in the different fields involved in the RT planning of lung cancer, in order to guide clinical management. The project was led by experts of the two nuclear medicine societies (EANM and SNMMI) and radiation oncology (ESTRO).

Results and conclusion

This guideline results from a joint and dynamic collaboration between the relevant disciplines for this topic. It provides a worldwide, state of the art, and multidisciplinary guide to 2-[¹⁸F]FDG PET/CT RT planning in NSCLC and SCLC. These practical recommendations describe applicable updates for existing clinical practices, highlight potential flaws, and provide solutions to overcome these as well. Finally, the recent developments considered for future application are also reviewed.

Optimizing Workflows for Fast and Reliable Metabolic Tumor Volume Measurements in Diffuse Large B Cell Lymphoma

PURPOSE

This pilot study aimed to determine interobserver reliability and ease of use of three workflows for measuring metabolic tumor volume (MTV) and total lesion glycolysis (TLG) in diffuse large B cell lymphoma (DLBCL).

PROCEDURES

Twelve baseline [¹⁸F]FDG PET/CT scans from DLBCL patients with wide variation in number and size of involved organs and lymph nodes were selected from the international PETRA consortium database. Three observers analyzed scans using three workflows. Workflow A: user-defined selection of individual lesions followed by four automated segmentations (41%SUVmax, A50%SUVpeak, SUV≥2.5, SUV≥4.0). For each lesion, observers indicated their "preferred segmentation." Individually selected lesions were summed to yield total MTV and TLG. Workflow B: fully automated preselection of [¹⁸F]FDG-avid structures (SUV≥4.0 and volume≥3ml), followed by removing non-tumor regions with single mouse clicks. Workflow C: preselected volumes based on Workflow B modified by manually adding lesions or removing physiological uptake, subsequently checked by experienced nuclear medicine physicians. Workflow C was performed 3 months later to avoid recall bias from the initial Workflow B analysis. Interobserver reliability was expressed as intraclass correlation coefficients (ICC).

RESULTS

Highest interobserver reliability in Workflow A was found for SUV≥2.5 and SUV≥4.0 methods (ICCs for MTV 0.96 and 0.94, respectively). SUV≥4.0 and A50%Peak were most and SUV≥2.5 was the least preferred segmentation method. Workflow B had an excellent interobserver reliability (ICC = 1.00) for MTV and TLG. Workflow C reduced the ICC for MTV and TLG to 0.92 and 0.97, respectively. Mean workflow analysis time per scan was 29, 7, and 22 min for A, B, and C, respectively.

CONCLUSIONS

Improved interobserver reliability and ease of use occurred using fully automated preselection (using SUV≥4.0 and volume≥3ml, Workflow B) compared with individual lesion selection by observers (Workflow A). Subsequent manual modification was necessary for some patients but reduced interobserver reliability which may need to be balanced against potential improvement on prognostic accuracy.

Interobserver agreement in automated metabolic tumor volume measurements of Deauville score 4 and 5 lesions at interim 18F-FDG PET in DLBCL

Introduction: Metabolic tumor volume (MTV) on interim-PET (I-PET) is a potential prognostic biomarker for diffuse large B-cell lymphoma (DLBCL). Implementation of MTV on I-PET requires consensus which semi-automated segmentation method delineates lesions most successfully with least user interaction. Methods used for baseline PET are not necessarily optimal for I-PET due to lower lesional standardized uptake values (SUV) at I-PET. Therefore, we aimed to evaluate which method provides the best delineation quality of Deauville-score (DS) 4-5 DLBCL lesions on I-PET at best interobserver agreement on delineation quality and, secondly, to assess the effect of lesional SUV_max on delineation quality and performance agreements. Methods: DS4-5 lesions from 45 I-PET scans were delineated using six semi-automated methods i) SUV 2.5, ii) SUV 4.0, iii) adaptive threshold [A50%peak], iv) 41% of maximum SUV [41%max], v) majority vote including voxels detected by ≥2 methods [MV2] and vi) detected by ≥3 methods [MV3]. Delineation quality per MTV was rated by three independent observers as acceptable or non-acceptable. For each method, observer scores on delineation quality, specific agreements and MTV were assessed for all lesions, and per category of lesional SUV_max (<5, 5-10, >10). Results: In 60 DS4-5 lesions on I-PET, MV3 performed best, with acceptable delineation in 90% of lesions, with a positive agreement (PA) of 93%. Delineation quality scores and agreements per method strongly depended on lesional SUV: the best delineation quality scores were obtained using MV3 in lesions with SUV_max<10 and SUV4.0 in more FDG-avid lesions. Consequently, overall delineation quality and PA improved by applying the most preferred method per SUV category instead of using MV3 as single best method. MV3- and SUV4.0-derived MTVs of lesions with SUV_max>10, were comparable after excluding visually failed MV3 contouring. For lesions with SUV_max<10, MTVs using different methods correlated poorly. Conclusion: On I-PET, MV3 performed best and provided the highest interobserver agreement regarding acceptable delineations of DS4-5 DLBCL lesions. However, delineation method preference strongly depended on lesional SUV. Therefore, we suggest to explore an approach that identifies the optimal delineation method per lesion as function of tumor FDG uptake characteristics, i.e. SUV_max.

Segmentation in Non-Small Cell Lung Tumors Using 18F-FDG PET/CT: Tips and Rules

The assessment of tumor parameters derived from F-FDG PET/CT in oncology provides valuable information in non-small cell lung cancer. A proper segmentation should delineate tumor with high accuracy, being the most important step to measure metabolic parameters. However, there is still no consensus about the optimal methodology. Additionally, some clinical conditions inherently tied to tumor and imaging can limit the proper tumor delineation. We present some practical cases that represent different aspects to consider during segmentation of primary non-small cell lung cancer by using F-FDG-PET/CT and some possible solutions to tackle with the most common limitations in clinical practice.

Random survival forest to predict transplant-eligible newly diagnosed multiple myeloma outcome including FDG-PET radiomics: a combined analysis of two independent prospective European trials

PURPOSE

Fluorodeoxyglucose-positron emission tomography/computed tomography (FDG-PET/CT) is included in the International Myeloma Working Group (IMWG) imaging guidelines for the work-up at diagnosis and the follow-up of multiple myeloma (MM) notably because it is a reliable tool as a predictor of prognosis. Nevertheless, none of the published studies focusing on the prognostic value of PET-derived features at baseline consider tumor heterogeneity, which could be of high importance in MM. The aim of this study was to evaluate the prognostic value of baseline PET-derived features in transplant-eligible newly diagnosed (TEND) MM patients enrolled in two prospective independent European randomized phase III trials using an innovative statistical random survival forest (RSF) approach.

METHODS

Imaging ancillary studies of IFM/DFCI2009 and EMN02/HO95 trials formed part of the present analysis (IMAJEM and EMN02/HO95, respectively). Among all patients initially enrolled in these studies, those with a positive baseline FDG-PET/CT imaging and focal bone lesions (FLs) and/or extramedullary disease (EMD) were included in the present analysis. A total of 17 image features (visual and quantitative, reflecting whole imaging characteristics) and 5 clinical/histopathological parameters were collected. The statistical analysis was conducted using two RSF approaches (train/validation + test and additional nested cross-validation) to predict progression-free survival (PFS).

RESULTS

One hundred thirty-nine patients were considered for this study. The final model based on the first RSF (train/validation + test) approach selected 3 features (treatment arm, hemoglobin, and SUV_maxBone Marrow (BM)) among the 22 involved initially, and two risk groups of patients (good and poor prognosis) could be defined with a mean hazard ratio of 4.3 ± 1.5 and a mean log-rank p value of 0.01 ± 0.01. The additional RSF (nested cross-validation) analysis highlighted the robustness of the proposed model across different splits of the dataset. Indeed, the first features selected using the train/validation + test approach remained the first ones over the folds with the nested approach.

CONCLUSION

We proposed a new prognosis model for TEND MM patients at diagnosis based on two RSF approaches.

TRIAL REGISTRATION

IMAJEM: NCT01309334 and EMN02/HO95: NCT01134484.

Automated Segmentation of Baseline Metabolic Total Tumor Burden in Diffuse Large B-Cell Lymphoma: Which Method Is Most Successful? A Study on Behalf of the PETRA Consortium

Metabolic tumor volume (MTV) is a promising biomarker of pretreatment risk in diffuse large B-cell lymphoma (DLBCL). Different segmentation methods can be used that predict prognosis equally well but give different optimal cutoffs for risk stratification. Segmentation can be cumbersome; a fast, easy, and robust method is needed. Our aims were to evaluate the best automated MTV workflow in DLBCL; determine whether uptake time, compliance or noncompliance with standardized recommendations for ¹⁸F-FDG scanning, and subsequent disease progression influence the success of segmentation; and assess differences in MTVs and discriminatory power of segmentation methods. Methods: One hundred forty baseline ¹⁸F-FDG PET/CT scans were selected from U.K. and Dutch studies on DLBCL to provide a balance between scans at 60 and 90 min of uptake, parameters compliant and noncompliant with standardized recommendations for scanning, and patients with and without progression. An automated tool was applied for segmentation using an SUV of 2.5 (SUV2.5), an SUV of 4.0 (SUV4.0), adaptive thresholding (A50P), 41% of SUV_max (41%), a majority vote including voxels detected by at least 2 methods (MV2), and a majority vote including voxels detected by at least 3 methods (MV3). Two independent observers rated the success of the tool to delineate MTV. Scans that required minimal interaction were rated as a success; scans that missed more than 50% of the tumor or required more than 2 editing steps were rated as a failure. Results: One hundred thirty-eight scans were evaluable, with significant differences in success and failure ratings among methods. The best performing was SUV4.0, with higher success and lower failure rates than any other method except MV2, which also performed well. SUV4.0 gave a good approximation of MTV in 105 (76%) scans, with simple editing for a satisfactory result in additionally 20% of cases. MTV was significantly different for all methods between patients with and without progression. The 41% segmentation method performed slightly worse, with longer uptake times; otherwise, scanning conditions and patient outcome did not influence the tool's performance. The discriminative power was similar among methods, but MTVs were significantly greater using SUV4.0 and MV2 than using other thresholds, except for SUV2.5. Conclusion: SUV4.0 and MV2 are recommended for further evaluation. Automated estimation of MTV is feasible.

PET segmentation of bulky tumors: Strategies and workflows to improve inter-observer variability

Background

PET-based tumor delineation is an error prone and labor intensive part of image analysis. Especially for patients with advanced disease showing bulky tumor FDG load, segmentations are challenging. Reducing the amount of user-interaction in the segmentation might help to facilitate segmentation tasks especially when labeling bulky and complex tumors. Therefore, this study reports on segmentation workflows/strategies that may reduce the inter-observer variability for large tumors with complex shapes with different levels of user-interaction.

Methods

Twenty PET images of bulky tumors were delineated independently by six observers using four strategies: (I) manual, (II) interactive threshold-based, (III) interactive threshold-based segmentation with the additional presentation of the PET-gradient image and (IV) the selection of the most reasonable result out of four established semi-automatic segmentation algorithms (Select-the-best approach). The segmentations were compared using Jaccard coefficients (JC) and percentage volume differences. To obtain a reference standard, a majority vote (MV) segmentation was calculated including all segmentations of experienced observers. Performed and MV segmentations were compared regarding positive predictive value (PPV), sensitivity (SE), and percentage volume differences.

Results

The results show that with decreasing user-interaction the inter-observer variability decreases. JC values and percentage volume differences of Select-the-best and a workflow including gradient information were significantly better than the measurements of the other segmentation strategies (p-value<0.01). Interactive threshold-based and manual segmentations also result in significant lower and more variable PPV/SE values when compared with the MV segmentation.

Conclusions

FDG PET segmentations of bulky tumors using strategies with lower user-interaction showed less inter-observer variability. None of the methods led to good results in all cases, but use of either the gradient or the Select-the-best workflow did outperform the other strategies tested and may be a good candidate for fast and reliable labeling of bulky and heterogeneous tumors.

Analyzing the co-localization of substantia nigra hyper-echogenicities and iron accumulation in Parkinson's disease: A multi-modal atlas study with transcranial ultrasound and MRI

•

Volumetric 3D analysis of hyper-echogenicities from transcranial ultrasound (TCS).

•

First multi-modal analysis of TCS and QSM-MRI in Parkinson's disease.

•

Computations of TCS-MRI registration and a novel multi-modal anatomical template.

•

TCS hyper-echogenicities are co-localized with QSM iron accumulations.

•

Co-localizations occur in the SNc and VTA, but nowhere else in the midbrain.

Background

Transcranial B-mode sonography (TCS) can detect hyperechogenic speckles in the area of the substantia nigra (SN) in Parkinson's disease (PD). These speckles correlate with iron accumulation in the SN tissue, but an exact volumetric localization in and around the SN is still unknown. Areas of increased iron content in brain tissue can be detected in vivo with magnetic resonance imaging, using quantitative susceptibility mapping (QSM).

Methods

In this work, we i) acquire, co-register and transform TCS and QSM imaging from a cohort of 23 PD patients and 27 healthy control subjects into a normalized atlas template space and ii) analyze and compare the 3D spatial distributions of iron accumulation in the midbrain, as detected by a signal increase (TCS+ and QSM+) in both modalities.

Results

We achieved sufficiently accurate intra-modal target registration errors (TRE<1 mm) for all MRI volumes and multi-modal TCS-MRI co-localization (TRE<4 mm) for 66.7% of TCS scans. In the caudal part of the midbrain, enlarged TCS+ and QSM+ areas were located within the SN pars compacta in PD patients in comparison to healthy controls. More cranially, overlapping TCS+ and QSM+ areas in PD subjects were found in the area of the ventral tegmental area (VTA).

Conclusion

Our findings are concordant with several QSM-based studies on iron-related alterations in the area SN pars compacta. They substantiate that TCS+ is an indicator of iron accumulation in Parkinson's disease within and in the vicinity of the SN. Furthermore, they are in favor of an involvement of the VTA and thereby the mesolimbic system in Parkinson's disease.

Task Group 174 Report: Utilization of [18 F]Fluorodeoxyglucose Positron Emission Tomography ([18 F]FDG-PET) in Radiation Therapy

The use of positron emission tomography (PET) in radiation therapy (RT) is rapidly increasing in the areas of staging, segmentation, treatment planning, and response assessment. The most common radiotracer is ¹⁸ F-fluorodeoxyglucose ([¹⁸ F]FDG), a glucose analog with demonstrated efficacy in cancer diagnosis and staging. However, diagnosis and RT planning are different endeavors with unique requirements, and very little literature is available for guiding physicists and clinicians in the utilization of [¹⁸ F]FDG-PET in RT. The two goals of this report are to educate and provide recommendations. The report provides background and education on current PET imaging systems, PET tracers, intensity quantification, and current utilization in RT (staging, segmentation, image registration, treatment planning, and therapy response assessment). Recommendations are provided on acceptance testing, annual and monthly quality assurance, scanning protocols to ensure consistency between interpatient scans and intrapatient longitudinal scans, reporting of patient and scan parameters in literature, requirements for incorporation of [¹⁸ F]FDG-PET in treatment planning systems, and image registration. The recommendations provided here are minimum requirements and are not meant to cover all aspects of the use of [¹⁸ F]FDG-PET for RT.

Machine-learned target volume delineation of 18F-FDG PET images after one cycle of induction chemotherapy

Biological tumour volume (GTV_PET) delineation on ¹⁸F-FDG PET acquired during induction chemotherapy (ICT) is challenging due to the reduced metabolic uptake and volume of the GTV_PET. Automatic segmentation algorithms applied to ¹⁸F-FDG PET (PET-AS) imaging have been used for GTV_PET delineation on ¹⁸F-FDG PET imaging acquired before ICT. However, their role has not been investigated in ¹⁸F-FDG PET imaging acquired after ICT. In this study we investigate PET-AS techniques, including ATLAAS a machine learned method, for accurate delineation of the GTV_PET after ICT. Twenty patients were enrolled onto a prospective phase I study (FiGaRO). PET/CT imaging was acquired at baseline and 3 weeks following 1 cycle of induction chemotherapy. The GTV_PET was manually delineated by a nuclear medicine physician and clinical oncologist. The resulting GTV_PET was used as the reference contour. The ATLAAS original statistical model was expanded to include images of reduced metabolic activity and the ATLAAS algorithm was re-trained on the new reference dataset. Estimated GTV_PET contours were derived using sixteen PET-AS methods and compared to the GTV_PET using the Dice Similarity Coefficient (DSC). The mean DSC for ATLAAS, 60% Peak Thresholding (PT60), Adaptive Thresholding (AT) and Watershed Thresholding (WT) was 0.72, 0.61, 0.63 and 0.60 respectively. The GTV_PET generated by ATLAAS compared favourably with manually delineated volumes and in comparison, to other PET-AS methods, was more accurate for GTV_PET delineation after ICT. ATLAAS would be a feasible method to reduce inter-observer variability in multi-centre trials.

Time to Prepare for Risk Adaptation in Lymphoma by Standardizing Measurement of Metabolic Tumor Burden

Increased tumor burden is associated with inferior outcomes in many lymphoma subtypes. Surrogates of tumor burden that are easy to measure, such as the maximum tumor dimension of the bulkiest lesion on CT, have been used as prognostic indices for many years. Recently, total metabolic tumor volume (MTV) and tumor lesion glycolysis have emerged as promising and robust biomarkers of outcome in various lymphomas. The median MTV and the optimal cutoffs to separate patients into risk groups in a study population are, however, highly dependent on the population characteristics and the delineation method used to outline tumor on the PET image. This issue has precluded the use of MTV for risk stratification in trials and clinical practice. Standardization of the methodology is timely to allow the potential for risk adaptation to be explored in addition to response adaptation using PET. Meetings between representatives from research groups active in the field were held under the auspices of the PET International Lymphoma and Myeloma Workshop. A summary of those discussions, which included a review of the literature and a practical assessment of methods used for outlining, including various software options, is presented. Finally, a proposal is made to perform a technical validation of MTV measurement enabling benchmark reference ranges to be derived for published delineation approaches used for outlining with various software. This process would require collation of representative imaging data sets of the most common lymphoma subtypes; agreement on pragmatic criteria for the selection of lesions; generation of a range of MTVs, with consensus to be reached on final contours in a training set; and development of automated software solutions with a set of minimum functionalities to reduce measurement variability. Methods developed in the above training exercise could then be applied to another data set, with a final set of contours and values generated. This final data set would provide a benchmark against which end-users could test their ability to measure MTVs that are consistent with expected values. The data set and automated software solutions could be shared with manufacturers with the aim of including these in standard workflows to allow standardization of MTV measurement across the world.

Repeatability of [18F]FDG PET/CT total metabolic active tumour volume and total tumour burden in NSCLC patients

Background

Total metabolic active tumour volume (TMATV) and total tumour burden (TTB) are increasingly studied as prognostic and predictive factors in non-small cell lung cancer (NSCLC) patients. In this study, we investigated the repeatability of TMATV and TTB as function of uptake interval, positron emission tomography/computed tomography (PET/CT) image reconstruction settings, and lesion delineation method. We used six lesion delineation methods, four direct PET image-derived delineations and two based on a majority vote approach, i.e. intersection between two or more delineations (MV2) and between three or more delineations (MV3). To evaluate the accuracy of those methods, they were compared with a reference delineation obtained from the consensus of the segmentations performed by three experienced observers. Ten NSCLC patients underwent two baseline whole-body [¹⁸F]2-Fluoro-2-deoxy-2-D-glucose ([¹⁸F]FDG) PET/CT studies on separate days, within 3 days. Two scans were obtained on each day at 60 and 90 min post-injection to assess the influence of tracer uptake interval. PET/CT images were reconstructed following the European Association of Nuclear Medicine Research Ltd. (EARL) compliant settings and with point-spread-function (PSF) modelling. Repeatability between the measurements of each day was determined and the influence of uptake interval, reconstruction settings, and lesion delineation method was assessed using the generalized estimating equations model.

Results

Based on the Jaccard index with the reference delineation, the MV2 lesion delineation method was the most successful method for automated lesion segmentation. The best overall repeatability (lowest repeatability coefficient, RC) was found for TTB from 90 min of tracer uptake scans reconstructed with EARL compliant settings and delineated with 41% of lesion’s maximum SUV method (RC = 11%). In most cases, TMATV and TTB repeatability were not significantly affected by changes in tracer uptake time or reconstruction settings. However, some lesion delineation methods had significantly different repeatability when applied to the same images.

Conclusions

This study suggests that under some circumstances TMATV and TTB repeatability are significantly affected by the lesion delineation method used. Performing the delineation with a majority vote approach improves reliability and does not hamper repeatability, regardless of acquisition and reconstruction settings. It is therefore concluded that by using a majority vote based tumour segmentation approach, TMATV and TTB in NSCLC patients can be measured with high reliability and precision.

Electronic supplementary material

The online version of this article (10.1186/s13550-019-0481-1) contains supplementary material, which is available to authorized users.

Delineation of lung cancer with FDG PET/CT during radiation therapy

OBJECTIVES

To propose an easily applicable segmentation method (perPET-RT) for delineation of tumour volume during radiotherapy on interim fluorine 18 fluorodeoxyglucose (FDG) positron emission tomography/computed tomography (PET/CT) in patients with non-small cell lung cancer (NSCLC).

MATERIAL AND METHODS

Sixty-seven patients (51 primary tumours, 60 lymph nodes), from 4 prospective studies, underwent an FDG PET/CT scan during the fifth week of radiation therapy, using different generations of PET/CT. Per-therapeutic PET/CT scans were delineated in consensus by two experienced physicians leading to the gold standard threshold to be applied. The mathematical expression of Th_opt, the optimal threshold to be applied as a function of the maximum standard uptake value (SUV_max), was determined. The performance of this method (perPET-RT) was assessed by computing the DICE similarity coefficient (DSC) and was compared with 8 fixed threshold values and 3 adaptive thresholding methods.

RESULTS

Th_opt verified the following expression: Th_opt = A.ln(1/SUV_max) + B where A and B were 2 constants. A and B were independent from the generation of PET/CT, but depended on the type of lesions (primary lung tumours vs. lymph nodes). PerPET-RT showed good to very good agreement in comparison to the gold standard. The mean and standard deviation of DSC value was 0.81 ± 0.13 for lung lesions and 0.78 ± 0.15 for lymph nodes. PerPET-RT showed a significant better agreement than the other segmentation methods (p < 0.001), except for one of the adaptive thresholding method ADT (p = 0.11).

CONCLUSION

On the database used, perPET-RT has proven its reliability and accuracy for tumour delineation on per-therapeutic FDG PET/CT using only SUV_max measurement. This method may be used to delineate tumour volume for dose-escalation planning.

TRIAL REGISTRATION

NCT01261598 , NCT01261585 , NCT01576796 .

[Siriade 2.0: An e-learning platform for radiation oncology contouring]

PURPOSE

In 2008, the French national society of radiation oncology (SFRO) and the association for radiation oncology continued education (AFCOR) created Siriade, an e-learning website dedicated to contouring.

MATERIAL AND METHODS

Between 2015 and 2017, this platform was updated using the latest digital online tools available. Two main sections were needed: a theoretical part and another section of online workshops.

RESULTS

Teaching courses are available as online commented videos, available on demand. The practical section of the website is an online contouring workshop that automatically generates a report quantifying the quality of the user's delineation compared with the experts'.

CONCLUSION

Siriade 2.0 is an innovating digital tool for radiation oncology initial and continuous education.

The developing role of FDG PET imaging for prognostication and radiotherapy target volume delineation in non-small cell lung cancer

Advancements in functional imaging technology have allowed new possibilities in contouring of target volumes, monitoring therapy, and predicting treatment outcome in non-small cell lung cancer (NSCLC). Consequently, the role of ¹⁸F-fluorodeoxyglucose positron emission tomography (FDG PET) has expanded in the last decades from a stand-alone diagnostic tool to a versatile instrument integrated with computed tomography (CT), with a prominent role in lung cancer radiotherapy. This review outlines the most recent literature on developments in FDG PET imaging for prognostication and radiotherapy target volume delineation (TVD) in NSCLC. We also describe the challenges facing the clinical implementation of these developments and present new ideas for future research.

Evaluation of prognostic models developed using standardised image features from different PET automated segmentation methods

Background

Prognosis in oesophageal cancer (OC) is poor. The 5-year overall survival (OS) rate is approximately 15%. Personalised medicine is hoped to increase the 5- and 10-year OS rates. Quantitative analysis of PET is gaining substantial interest in prognostic research but requires the accurate definition of the metabolic tumour volume. This study compares prognostic models developed in the same patient cohort using individual PET segmentation algorithms and assesses the impact on patient risk stratification.

Consecutive patients (n = 427) with biopsy-proven OC were included in final analysis. All patients were staged with PET/CT between September 2010 and July 2016. Nine automatic PET segmentation methods were studied. All tumour contours were subjectively analysed for accuracy, and segmentation methods with < 90% accuracy were excluded. Standardised image features were calculated, and a series of prognostic models were developed using identical clinical data. The proportion of patients changing risk classification group were calculated.

Results

Out of nine PET segmentation methods studied, clustering means (KM2), general clustering means (GCM3), adaptive thresholding (AT) and watershed thresholding (WT) methods were included for analysis. Known clinical prognostic factors (age, treatment and staging) were significant in all of the developed prognostic models. AT and KM2 segmentation methods developed identical prognostic models. Patient risk stratification was dependent on the segmentation method used to develop the prognostic model with up to 73 patients (17.1%) changing risk stratification group.

Conclusion

Prognostic models incorporating quantitative image features are dependent on the method used to delineate the primary tumour. This has a subsequent effect on risk stratification, with patients changing groups depending on the image segmentation method used.

Electronic supplementary material

The online version of this article (10.1186/s13550-018-0379-3) contains supplementary material, which is available to authorized users.

ESTRO ACROP guidelines for target volume definition in the treatment of locally advanced non-small cell lung cancer

Radiotherapy (RT) plays a major role in the curative treatment of locally advanced non-small cell lung cancer (NSCLC). Therefore, the ACROP committee was asked by the ESTRO to provide recommendations on target volume delineation for standard clinical scenarios in definitive (chemo)radiotherapy (RT) and adjuvant RT for locally advanced NSCLC. The guidelines given here are a result of the evaluation of a structured questionnaire followed by a consensus discussion, voting and writing procedure within the committee. Hence, we provide advice for methods and time-points of diagnostics and imaging before the start of treatment planning and for the mandatory and optional imaging to be used for planning itself. Concerning target volumes, recommendations are given for GTV delineation of primary tumour and lymph nodes followed by issues related to the delineation of CTVs for definitive and adjuvant radiotherapy. In the context of PTV delineation, recommendations about the management of geometric uncertainties and target motion are given. We further provide our opinions on normal tissue delineation and organisational and responsibility questions in the process of target volume delineation. This guideline intends to contribute to the standardisation and optimisation of the process of RT treatment planning for clinical practice and prospective studies.

Comparison of different automated lesion delineation methods for metabolic tumor volume of 18F-FDG PET/CT in patients with stage I lung adenocarcinoma

The aim of the study was to investigate the suitable segmentation method in small, low uptake and heterogeneous nodules of stage I lung adenocarcinoma.133 stage I lung adenocarcinoma patients with F-FDG PET/CT scans were enrolled in this retrospective study. All lesions were divided into different groups according to nodule density, nodule size, and the maximum standard uptake value (SUVmax) level. Four different PET segmentation methods were performed, including percentage threshold of SUVmax (T42% and T42% × RC), gradient-based threshold (adaptive iterative algorithm, AT-AIA), and background-related threshold (adaptive thresholding at 40% SUVmax, AT40%) approaches. The MTVs were evaluated and compared with CT volume (CTV). Percentage volume error (%VE) compared to CTV was calculated and the correlations between MTVs and CTV were analyzed.AT-AIA had the highest accuracy in large, high uptake, and solid nodules (72.5%, 72.4%, and 65.6%, respectively). AT40% had the highest accuracy in small, low uptake and nonsolid nodules (56.6%, 56.1%, and 62.6%, respectively). In part-solid nodules, the accuracy of AT-AIA (60.0%) and AT40% (56.7%) were higher than that of T42% and T42% × RC. The MTV of AT-AIA was in excellent correlation with the CTV in solid nodules (R = 0.831, P < .001) and in high uptake nodules (R = 0.830, P < .001). The MTV of AT40% was in good correlation with the CTV in nonsolid nodules (R = 0.686, P = .003) and in part-solid nodules (R = 0.731, P < .001).AT40% showed best performance in small, low uptake, nonsolid and part-solid lesions. AT-AIA was suitable for large, high uptake, and solid lesions.

Classification and evaluation strategies of auto-segmentation approaches for PET: Report of AAPM task group No. 211

PURPOSE

The purpose of this educational report is to provide an overview of the present state-of-the-art PET auto-segmentation (PET-AS) algorithms and their respective validation, with an emphasis on providing the user with help in understanding the challenges and pitfalls associated with selecting and implementing a PET-AS algorithm for a particular application.

APPROACH

A brief description of the different types of PET-AS algorithms is provided using a classification based on method complexity and type. The advantages and the limitations of the current PET-AS algorithms are highlighted based on current publications and existing comparison studies. A review of the available image datasets and contour evaluation metrics in terms of their applicability for establishing a standardized evaluation of PET-AS algorithms is provided. The performance requirements for the algorithms and their dependence on the application, the radiotracer used and the evaluation criteria are described and discussed. Finally, a procedure for algorithm acceptance and implementation, as well as the complementary role of manual and auto-segmentation are addressed.

FINDINGS

A large number of PET-AS algorithms have been developed within the last 20 years. Many of the proposed algorithms are based on either fixed or adaptively selected thresholds. More recently, numerous papers have proposed the use of more advanced image analysis paradigms to perform semi-automated delineation of the PET images. However, the level of algorithm validation is variable and for most published algorithms is either insufficient or inconsistent which prevents recommending a single algorithm. This is compounded by the fact that realistic image configurations with low signal-to-noise ratios (SNR) and heterogeneous tracer distributions have rarely been used. Large variations in the evaluation methods used in the literature point to the need for a standardized evaluation protocol.

CONCLUSIONS

Available comparison studies suggest that PET-AS algorithms relying on advanced image analysis paradigms provide generally more accurate segmentation than approaches based on PET activity thresholds, particularly for realistic configurations. However, this may not be the case for simple shape lesions in situations with a narrower range of parameters, where simpler methods may also perform well. Recent algorithms which employ some type of consensus or automatic selection between several PET-AS methods have potential to overcome the limitations of the individual methods when appropriately trained. In either case, accuracy evaluation is required for each different PET scanner and scanning and image reconstruction protocol. For the simpler, less robust approaches, adaptation to scanning conditions, tumor type, and tumor location by optimization of parameters is necessary. The results from the method evaluation stage can be used to estimate the contouring uncertainty. All PET-AS contours should be critically verified by a physician. A standard test, i.e., a benchmark dedicated to evaluating both existing and future PET-AS algorithms needs to be designed, to aid clinicians in evaluating and selecting PET-AS algorithms and to establish performance limits for their acceptance for clinical use. The initial steps toward designing and building such a standard are undertaken by the task group members.

[Role of functional imaging in the definition of target volumes for lung cancer radiotherapy]

Functional imaging with positron emission tomography (PET) is interesting to optimize lung radiotherapy planning, and probably to deliver a heterogeneous dose or adapt the radiation dose during treatment. Only fluorodeoxyglucose (FDG) PET-computed tomography (CT) is validated for staging lung cancer and planning radiotherapy. The optimal segmentation methods remain to be defined as well as the interest of "dose painting" from pre-treatment PET (metabolism: FDG) or hypoxia (fluoromisonidazole: FMISO) and the interest of replanning based on pertherapeutic PET.

Generic and robust method for automatic segmentation of PET images using an active contour model

PURPOSE

Although positron emission tomography (PET) images have shown potential to improve the accuracy of targeting in radiation therapy planning and assessment of response to treatment, the boundaries of tumors are not easily distinguishable from surrounding normal tissue owing to the low spatial resolution and inherent noisy characteristics of PET images. The objective of this study is to develop a generic and robust method for automatic delineation of tumor volumes using an active contour model and to evaluate its performance using phantom and clinical studies.

METHODS

MASAC, a method for automatic segmentation using an active contour model, incorporates the histogram fuzzy C-means clustering, and localized and textural information to constrain the active contour to detect boundaries in an accurate and robust manner. Moreover, the lattice Boltzmann method is used as an alternative approach for solving the level set equation to make it faster and suitable for parallel programming. Twenty simulated phantom studies and 16 clinical studies, including six cases of pharyngolaryngeal squamous cell carcinoma and ten cases of nonsmall cell lung cancer, were included to evaluate its performance. Besides, the proposed method was also compared with the contourlet-based active contour algorithm (CAC) and Schaefer's thresholding method (ST). The relative volume error (RE), Dice similarity coefficient (DSC), and classification error (CE) metrics were used to analyze the results quantitatively.

RESULTS

For the simulated phantom studies (PSs), MASAC and CAC provide similar segmentations of the different lesions, while ST fails to achieve reliable results. For the clinical datasets (2 cases with connected high-uptake regions excluded) (CSs), CAC provides for the lowest mean RE (-8.38% ± 27.49%), while MASAC achieves the best mean DSC (0.71 ± 0.09) and mean CE (53.92% ± 12.65%), respectively. MASAC could reliably quantify different types of lesions assessed in this work with good accuracy, resulting in a mean RE of -13.35% ± 11.87% and -11.15% ± 23.66%, a mean DSC of 0.89 ± 0.05 and 0.71 ± 0.09, and a mean CE of 19.19% ± 7.89% and 53.92% ± 12.65%, for PSs and CSs, respectively.

CONCLUSIONS

The authors' results demonstrate that the developed novel PET segmentation algorithm is applicable to various types of lesions in the authors' study and is capable of producing accurate and consistent target volume delineations, potentially resulting in reduced intraobserver and interobserver variabilities observed when using manual delineation and improved accuracy in treatment planning and outcome evaluation.

ATLAAS: an automatic decision tree-based learning algorithm for advanced image segmentation in positron emission tomography

Accurate and reliable tumour delineation on positron emission tomography (PET) is crucial for radiotherapy treatment planning. PET automatic segmentation (PET-AS) eliminates intra- and interobserver variability, but there is currently no consensus on the optimal method to use, as different algorithms appear to perform better for different types of tumours. This work aimed to develop a predictive segmentation model, trained to automatically select and apply the best PET-AS method, according to the tumour characteristics. ATLAAS, the automatic decision tree-based learning algorithm for advanced segmentation is based on supervised machine learning using decision trees. The model includes nine PET-AS methods and was trained on a 100 PET scans with known true contour. A decision tree was built for each PET-AS algorithm to predict its accuracy, quantified using the Dice similarity coefficient (DSC), according to the tumour volume, tumour peak to background SUV ratio and a regional texture metric. The performance of ATLAAS was evaluated for 85 PET scans obtained from fillable and printed subresolution sandwich phantoms. ATLAAS showed excellent accuracy across a wide range of phantom data and predicted the best or near-best segmentation algorithm in 93% of cases. ATLAAS outperformed all single PET-AS methods on fillable phantom data with a DSC of 0.881, while the DSC for H&N phantom data was 0.819. DSCs higher than 0.650 were achieved in all cases. ATLAAS is an advanced automatic image segmentation algorithm based on decision tree predictive modelling, which can be trained on images with known true contour, to predict the best PET-AS method when the true contour is unknown. ATLAAS provides robust and accurate image segmentation with potential applications to radiation oncology.