Tools for consensus analysis of experts' contours for radiotherapy structure definitions

Impact of a contouring atlas on radiographer inter-observer variation in male pelvis radiotherapy

PURPOSE/OBJECTIVE

To determine the impact of a MR-based contouring atlas for male pelvis radiotherapy delineation on inter-observer variation to support radiographer led real-time magnetic resonance image guided adaptive radiotherapy (MRgART).

MATERIAL/METHODS

Eight RTTs contoured 25 MR images in the Monaco treatment planning system (Monaco 5.40.01), from 5 patients. The prostate, seminal vesicles, bladder, and rectum were delineated before and after the introduction of an atlas developed through multi-disciplinary consensus. Inter-observer contour variations (volume), time to contour and observer contouring confidence were determined at both time-points using a 5-point Likert scale. Descriptive statistics were used to analyse both continuous and categorical variables. Dice similarity coefficient (DSC), Dice-Jaccard coefficient (DJC) and Hausdorff distance were used to calculate similarity between observers.

RESULTS

Although variation in volume definition decreased for all structures among all observers post intervention, the change was not statistically significant. DSC and DJC measurements remained consistent following the introduction of the atlas for all observers. The highest similarity was found in the bladder and prostate whilst the lowest was the seminal vesicles. The mean contouring time for all observers was reduced by 50% following the introduction of the atlas (53 to 27 minutes, p=0.01). For all structures across all observers, the mean contouring confidence increased significantly from 2.3 to 3.5 out of 5 (p=0.02).

CONCLUSION

Although no significant improvements were observed in contour variation amongst observers, the introduction of the consensus-based contouring atlas improved contouring confidence and speed; key factors for a real-time RTT-led MRgART.

A Comparative Analysis of Implant-sparing Plan Versus Conventional Plans Utilizing Helical Tomotherapy in Breast Cancer Patients Undergoing Breast Reconstruction

BACKGROUND/AIM

To compare implant sparing irradiation with conventional radiotherapy (RT) using helical (H) and TomoDirect (TD) techniques in breast cancer patients undergoing immediate breast reconstruction (IBR).

PATIENTS AND METHODS

The dosimetric parameters of 40 patients with retropectoral implants receiving 50.4 Gy delivered in 28 fractions were analyzed. Three plans were created: H plan using conventional planning target volume (PTV) that included the chest wall, skin, and implant; TD plan using conventional PTV; and Hs plan using implant-sparing PTV. The H, TD, and Hs plans were compared for PTV doses, organ-at-risk (OAR) doses, and treatment times.

RESULTS

Dose distribution in the Hs plan was less homogeneous and uniform than that in the H and TD plans. The TD plan had lower lung, heart, contralateral breast, spinal cord, liver, and esophagus doses than the Hs plan. Compared to the Hs plan, the H plan had lower lung volume receiving 5Gy (V5) (39.1±3.9 vs. 41.2±3.9 Gy; p<0.001), higher V20 (12.3±1.3 vs. 11.5±2.6 Gy; p=0.02), and higher V30 (7.5±1.6 vs. 4.4±1.7 Gy; p<0.001). H plan outperformed Hs plan in heart dosimetric parameters except V20. The Hs plan had significantly lower mean implant doses (43.4±2.1 Gy) than the H plan (51.4±0.5 Gy; p<0.001) and the TD plan (51.9±0.6 Gy; p<0.001). Implementing an implant sparing technique for silicone dose reduction decreases lung doses.

CONCLUSION

Conventional H and TD plans outperform the implant sparing helical plan dosimetrically. Because capsular contracture during RT is unpredictable, long-term clinical outcomes are required to determine whether silicon should be spared.

Utility of 68Ga-DOTATATE PET-MRI for Gamma Knife® stereotactic radiosurgery treatment planning for meningioma

OBJECTIVES

To investigate the impact of adding 68Ga-DOTATATE PET/MRI to standard MRI for target volume delineation in Gamma Knife® stereotactic radiosurgery (GKSRS) for meningioma.

METHODS

Seventeen patients with 18 lesions undergoing GKSRS for WHO grade 1 meningioma were enrolled in a prospective study. All patients underwent pre-treatment 68Ga-DOTATATE PET/MRI examination in addition to standard procedures. Five clinicians independently contoured the gross tumour volume (GTV) based on standard MRI (GTVMRI) and PET/MRI (GTVPET/MRI) on separate occasions. Interobserver agreement was evaluated using Cohen's Kappa statistic (CKS), Dice similarity coefficient (DC), and Hausdorff distance (HD). Statistical analysis was performed with paired t-test and Wilcoxon signed rank test.

RESULTS

The addition of PET/MRI significantly increased GTV contour volume (mean GTVPET/MRI 3.59 cm3 versus mean GTVMRI 3.18 cm3, P = .008). Using the treating clinician's pre-treatment GTVMRI as the reference, median CKS (87.2 vs 77.5, P = .006) and DC (87.2 vs 77.4, P = .006) were significantly lower, and median HD (25.2 vs 31.0, P = .001) was significantly higher with the addition of PET/MRI. No significant difference was observed in interobserver contouring reproducibility between GTVMRI and GTVPET/MRI.

CONCLUSION

The addition of 68Ga-DOTATATE PET/MRI for target volume delineation in GKSRS for meningioma is associated with an increase in GTV volume and greater interobserver variation. PET/MRI did not affect interobserver contouring reproducibility.

ADVANCES IN KNOWLEDGE

This study provides novel insights into the impact of 68Ga-DOTATATE PET/MRI on GTV delineation and interobserver agreement in meningioma GKSRS, highlighting its potential for improving GKSRS treatment accuracy.

Impact of bowel space contouring variability on radiation dose and volume assessments in treatment planning for gynaecologic cancers

INTRODUCTION

Correlations between radiation dose/volume measures and small bowel (SB) toxicity are inconsistent in the medical literature. We assessed the impact of inter-provider variation in bowel bag contouring technique on estimates of radiation dose received by the SB during pelvic radiotherapy.

METHODS

Ten radiation oncologists contoured rectum, bladder and bowel bags on treatment planning computed tomography (CT) scans of two patients receiving adjuvant radiation for endometrial cancer. A radiation plan was generated for each patient and used to determine the radiation dose/volume for each organ. Kappa statistics were applied to assess the inter-provider contouring agreement, and Levene test evaluated the homogeneity of variance for radiation dose/volume metrics, including the V45Gy (cm3 ).

RESULTS

The bowel bag showed greater variation in radiation dose/volume estimates compared to the bladder and rectum. The V45Gy ranged from 163 to 384 cm3 for data set A and 109 to 409 cm3 for dataset B. Kappa values were 0.82/0.83, 0.92/0.92 and 0.94/0.86 for the bowel bag, rectum, and bladder on data sets A/B, demonstrating lower inter-provider agreement for bowel bag compared with bladder and rectum.

CONCLUSION

Inter-provider contouring variability is more significant for the bowel bag than the rectum and bladder, with an associated greater variability in dose and volume estimates during radiation planning.

Impact of bowel space contouring variability on radiation dose and volume assessments in treatment planning for gynaecologic cancers

Introduction

Correlations between radiation dose/volume measures and small bowel (SB) toxicity are inconsistent in the medical literature. We assessed the impact of inter‐provider variation in bowel bag contouring technique on estimates of radiation dose received by the SB during pelvic radiotherapy.

Methods

Ten radiation oncologists contoured rectum, bladder and bowel bags on treatment planning computed tomography (CT) scans of two patients receiving adjuvant radiation for endometrial cancer. A radiation plan was generated for each patient and used to determine the radiation dose/volume for each organ. Kappa statistics were applied to assess the inter‐provider contouring agreement, and Levene test evaluated the homogeneity of variance for radiation dose/volume metrics, including the V45Gy (cm3).

Results

The bowel bag showed greater variation in radiation dose/volume estimates compared to the bladder and rectum. The V45Gy ranged from 163 to 384 cm3 for data set A and 109 to 409 cm3 for dataset B. Kappa values were 0.82/0.83, 0.92/0.92 and 0.94/0.86 for the bowel bag, rectum, and bladder on data sets A/B, demonstrating lower inter‐provider agreement for bowel bag compared with bladder and rectum.

Conclusion

Inter‐provider contouring variability is more significant for the bowel bag than the rectum and bladder, with an associated greater variability in dose and volume estimates during radiation planning.

Overcoming inter-observer planning variability in target volume contouring and dose planning for high-risk neuroblastoma - a European multicenter effort of the SIOPEN radiotherapy committee

BACKGROUND AND PURPOSE

To establish an international quality standard for contouring and planning for high-risk neuroblastoma within the prospective High-Risk Neuroblastoma Study 2 of SIOP-Europe-Neuroblastoma (SIOPEN HR-NBL2), which includes a randomized question on dose escalation for residual disease.

MATERIALS AND METHODS

Data on four patients with high-risk neuroblastoma were selected and distributed to the radiotherapy committee of the HR-NBL2 study for independent contouring and planning. Differences in contouring were analyzed using apparent and kappa-corrected agreement. Plans were analyzed regarding the dose-volume histogram metrics. Results were discussed among experts and agreement was obtained.

RESULTS

Substantial agreement was found for contouring of the heart (0.64), liver (0.70), left lung (0.74), and right lung (0.74). For contouring of the gastrointestinal tract (0.54), left kidney (0.60), and right kidney (0.59) moderate agreement was obtained. For target volume delineation, agreement for preoperative tumour extent was moderate (0.42), for CTV fair (0.35) and only low (0.06) for residual tumour, respectively. The dose planning strategies appeared to be relatively homogeneous among all experts.

CONCLUSION

Considerable variability was found for the delineation of target volumes, particularly the boost volume, whereas the contouring of the organs at risk and the planning strategy were reasonably consistent. In order to obtain reliable results from the randomized HR-NBL2 trial, standardization of target volume delineation based on adequate imaging is crucial.

GEC-ESTRO (ACROP)-ABS-CBG Consensus Brachytherapy Target Definition Guidelines for Recurrent Endometrial and Cervical Tumors in the Vagina

PURPOSE

Representatives from the Gynecologic Groupe European de Curietherapie-European Society for Radiation Therapy and Oncology (GYN GEC-ESTRO), the American Brachytherapy Society (ABS), and the Canadian Brachytherapy Group (CBG) met to develop international consensus recommendations for target definitions for image-guided adaptive brachytherapy for vaginal recurrences of endometrial or cervical cancer.

METHODS AND MATERIALS

Seventeen radiation oncologists and 2 medical physicists participated. Before an in-person meeting each participant anonymously contoured 3 recurrent endometrial/cervical cancer cases. Participants contoured the residual gross primary tumor volume (GTV-T_res), a high-risk clinical target volume (CTV-T_HR), and an intermediate-risk clinical target volume (CTV-T_IR), on T2-weighted magnetic resonance images (MRIs). All contours were drawn using Falcon EduCase. Contours were reviewed at an in-person meeting during which a consensus document was created defining agreed-upon target definitions (Trial 1). After establishing these definitions, the group was sent one of the cases again (recurrent cervical cancer vaginal recurrence) and asked to contour the targets again (Trial 2). The Computerized Environment for Radiation Research (CERR) software (The Mathworks, Natwick, MA) was used to analyze the contours. Kappa statistics were generated to assess level of agreement between contours. A conformity index (CI), defined as the ratio between the intersection and union volume of a given pair of contours, was calculated. A simultaneous truth and performance level estimation (STAPLE) contour was created for the CTV-T_HR and CTV-T_IR for the postmeeting case.

RESULTS

Consensus definitions for GTV-T_res, CTV-T_HR, and CTV-T_IR were established. Kappa statistics (Trial 1/Trial 2) for GTV-T_res, CTV-T_HR, and CTV-T_IR were 0.536/0.583, 0.575/0.743 and 0.522/0.707. Kappa statistics for Trial 2 for the CTV-T_HR and CTV-T_IR showed "substantial" agreement while the GTV-T_res remained at moderate agreement.

CONCLUSIONS

This consensus provides recommendations to facilitate future collaborations for MRI-guided adaptive brachytherapy target definitions in endometrial/cervical vaginal recurrences.

Utility of non-contrast-enhanced magnetic resonance imaging in predicting preoperative clinical stage and prognosis in patients with thymic epithelial tumor

PURPOSE

The purpose of this study was to find useful imaging features on non-contrast-enhanced magnetic resonance imaging (MRI) that can divide patients with thymic epithelial tumor (TET) into clinical stage I-II and III-IV groups under assumption that contrast media are contraindicated.

MATERIALS AND METHODS

This retrospective study included 106 patients (median age, 60 years; range, 27-82 years; 62 women) with surgically resected TET who underwent MRI between August 1986 and July 2015. All cases were classified according to the 2015 WHO classification and staged using the eighth edition of the TNM system. Two radiologists independently evaluated 14 categories of MRI findings; the findings in patients with stage I-II were compared with those of patients with stage III-IV using a logistic regression model. Disease-specific survival associated with significant findings was calculated using the Kaplan-Meier method.

RESULTS

Univariate analysis showed that stage III-IV patients were more likely to have tumors with an irregular contour, heterogeneity on T1WI, low-signal intensity on T2WI, irregular border with lung, findings of great vessel invasion (GVI) (hereafter, GVI sign), pericardial thickening/nodule, and lymphadenopathy (all, P < 0.01). On multivariable analysis, only two findings, irregular border between tumor and lung (odds ratio [OR], 272.8; 95% CI 26.6-2794.1; P < 0.001) and positive GVI sign (OR, 49.3; 95% CI 4.5-539.8; P = 0.001) remained statistically significant. Patients with one or both features had significantly worse survival (log-rank test, P < 0.001).

CONCLUSION

For patients with TET who are unable to receive contrast for preoperative staging, the two image findings of an irregular border between tumor and lung and the positive GVI sign on non-contrast-enhanced MRI could be helpful in determining stage III-IV disease which is associated with a worse survival.

Interobserver Variability Prediction of Primary Gross Tumor in a Patient with Non-Small Cell Lung Cancer

This research addresses the problem of interobserver variability (IOV), in which different oncologists manually delineate varying primary gross tumor volume (pGTV) contours, adding risk to targeted radiation treatments. Thus, a method of IOV reduction is urgently needed. Hypothesizing that the radiation oncologist’s IOV may shrink with the aid of IOV maps, we propose IOV prediction network (IOV-Net), a deep-learning model that uses the fuzzy membership function to produce high-quality maps based on computed tomography (CT) images. To test the prediction accuracy, a ground-truth pGTV IOV map was created using the manual contour delineations of radiation therapy structures provided by five expert oncologists. Then, we tasked IOV-Net with producing a map of its own. The mean squared error (prediction vs. ground truth) and its standard deviation were 0.0038 and 0.0005, respectively. To test the clinical feasibility of our method, CT images were divided into two groups, and oncologists from our institution created manual contours with and without IOV map guidance. The Dice similarity coefficient and Jaccard index increased by ~6 and 7%, respectively, and the Hausdorff distance decreased by 2.5 mm, indicating a statistically significant IOV reduction (p < 0.05). Hence, IOV-net and its resultant IOV maps have the potential to improve radiation therapy efficacy worldwide.

Dummy run quality assurance study in the Korean Radiation Oncology Group 19 − 09 multi-institutional prospective cohort study of breast cancer

Background

The Korean Radiation Oncology Group (KROG) 19 − 09 prospective cohort study aims to determine the effect of regional nodal irradiation on regional recurrence rates in ypN0 breast cancer patients. Dosimetric variations between radiotherapy (RT) plans of participating institutions may affect the clinical outcome of the study. We performed this study to assess inter-institutional dosimetric variations by dummy run.

Methods

Twelve participating institutions created RT plans for four clinical scenarios using computed tomography images of two dummy cases. Based on a reference structure set, we analyzed dose-volume histograms after collecting the RT plans.

Results

We found variations in dose distribution between institutions, especially in the regional nodal areas. Whole breast and regional nodal irradiation (WBI + RNI) plans had lower inter-institutional agreement and similarity for 95% isodose lines than WBI plans. Fleiss’s kappa values, which were used to measure inter-institutional agreement for the 95% isodose lines, were 0.830 and 0.767 for the large and medium breast WBI plans, respectively, and 0.731 and 0.679 for the large and medium breast WBI + RNI plans, respectively. There were outliers in minimum dose delivered to 95% of the structure (D95%) of axillary level 1 among WBI plans and in D95% of the interpectoral region and axillary level 4 among WBI + RNI plans.

Conclusion

We found inter-institutional and inter-case variations in radiation dose delivered to target volumes and organs at risk. As KROG 19 − 09 is a prospective cohort study, we accepted the dosimetric variation among the different institutions. Actual patient RT plan data should be collected to achieve reliable KROG 19 − 09 study results.

Variation in clinical target volume delineation in postoperative radiotherapy for biliary tract cancer

We aimed to evaluate the inter-clinician variability in the clinical target volume (CTV) for postoperative radiotherapy (PORT) for biliary tract cancer (BTC) including extrahepatic bile duct cancer (EBDC) and gallbladder cancer (GBC). Nine experienced radiation oncologists delineated PORT CTVs for distal EBDC (pT2N1), proximal EBDC (pT2bN1) and GBC (pT2bN1) patients. The expectation maximization algorithm for Simultaneous Truth and Performance Level Estimation (STAPLE) was used to quantify expert agreements. We generated volumes with a confidence level of 80% to compare the maximum distance to each CTV in six directions. The degree of agreement was moderate; overall kappa values were 0.573 for distal EBDC, 0.513 for proximal EBDC, and 0.511 for GBC. In the distal EBDC, a larger variation was noted in the right, post, and inferior direction. In the proximal EBDC, all borders except the right and left direction showed a larger variation. In the GBC, a larger variation was found in the anterior, posterior, and inferior direction. The posterior and inferior borders were the common area having discrepancies, associated with the insufficient coverage of the paraaortic node. A consensus guideline is needed to reduce inter-clinician variability in the CTVs and adequate coverage of regional lymph node area.

Delineation uncertainties of tumour volumes on MRI of head and neck cancer patients

•

Role of target delineation uncertainties in head and neck cancer patients.

•

Knowing contouring variations for MRI allows better adaptation of MRLinac for H&N cancers.

•

An interobserver variation for GTV among 8 observers was below 2 mm using MRI.

•

Variability between observers might improve using other imaging modalities.

Background

During the last decade, radiotherapy using MR Linac has gone from research to clinical implementation for different cancer locations. For head and neck cancer (HNC), target delineation based only on MR images is not yet standard, and the utilisation of MRI instead of PET/CT in radiotherapy planning is not well established. We aimed to analyse the inter-observer variation (IOV) in delineating GTV (gross tumour volume) on MR images only for patients with HNC.

Material/methods

32 HNC patients from two independent departments were included. Four clinical oncologists from Denmark and four radiation oncologists from Australia had independently contoured primary tumour GTVs (GTV-T) and nodal GTVs (GTV-N) on T2-weighted MR images obtained at the time of treatment planning. Observers were provided with sets of images, delineation guidelines and patient synopsis. Simultaneous truth and performance level estimation (STAPLE) reference volumes were generated for each structure using all observer contours. The IOV was assessed using the DICE Similarity Coefficient (DSC) and mean absolute surface distance (MASD).

Results

32 GTV-Ts and 68 GTV-Ns were contoured per observer. The median MASD for GTV-Ts and GTV-Ns across all patients was 0.17 cm (range 0.08–0.39 cm) and 0.07 cm (range 0.04–0.33 cm), respectively. Median DSC relative to a STAPLE volume for GTV-Ts and GTV-Ns across all patients were 0.73 and 0.76, respectively. A significant correlation was seen between median DSCs and median volumes of GTV-Ts (Spearman correlation coefficient 0.76, p < 0.001) and of GTV-Ns (Spearman correlation coefficient 0.55, p < 0.001).

Conclusion

Contouring GTVs in patients with HNC on MRI showed that the median IOV for GTV-T and GTV-N was below 2 mm, based on observes from two separate radiation departments. However, there are still specific regions in tumours that are difficult to resolve as either malignant tissue or oedema that potentially could be improved by further training in MR-only delineation.

Dosimetric impact of interfraction prostate and seminal vesicle volume changes and rotation: A post-hoc analysis of a phase III randomized trial of MRI-guided versus CT-guided stereotactic body radiotherapy

BACKGROUND AND PURPOSE

Interfraction volumetric changes/rotations in the prostate and proximal seminal vesicles (SVs) might compromise target coverage when tight margins are used for prostate stereotactic body radiotherapy (SBRT). We investigated on-board MRI images from MRI-guided SBRT to better understand this.

MATERIALS AND METHODS

Twenty consecutive patients treated with MRI-guided prostate SBRT (40 Gy/5 fractions) enrolled on the MRI arm of a phase III randomized trial were included. A 2 mm isotropic margin was used for prostate and proximal SVPTV. Target volume, prostate dimensions, angles of the proximal SV on axial (angle α) and sagittal view (angle θ) were measured on a 0.35 T simulation MRI and five on-board pre-treatment MRIs. Dice coefficient of the targets and target dosimetry were calculated.

RESULTS

All patients experienced an isotropic increase in prostate volume during SBRT (p = 0.0016): 0.1%, 9.0%, 12.1%, 15.1%, and 14.2% (median) at fractions 1-5, respectively, regardless of baseline volume, which was significantly reduced with neoadjuvant ADT (p = 0.0042). There was minimal interfraction rotation of prostate, however, considerable variations in proximal SV angle α (median 21.5°) and angle θ (median 17.6°) were seen. Median V100% was 97.5% and 87.1% for prostate and proximal SV CTV, respectively. V95%≥95% was achieved in 94% of fractions for the prostate and in 59% for proximal SV.

CONCLUSION

Prostate volume consistently increased during SBRT. Interfraction prostatic rotation was minimal while rotation of the proximal SV was considerable. Prostate dosimetry was favorable, but online adaptive therapy may be indicated occasionally to account for prostatic swelling and in particular proximal SV rotations.

The impact of organ-at-risk contour variations on automatically generated treatment plans for NSCLC

BACKGROUND AND PURPOSE

Quality of automatic contouring is generally assessed by comparison with manual delineations, but the effect of contour differences on the resulting dose distribution remains unknown. This study evaluated dosimetric differences between treatment plans optimized using various organ-at-risk (OAR) contouring methods.

MATERIALS AND METHODS

OARs of twenty lung cancer patients were manually and automatically contoured, after which user-adjustments were made. For each contour set, an automated treatment plan was generated. The dosimetric effect of intra-observer contour variation and the influence of contour variations on treatment plan evaluation and generation were studied using dose-volume histogram (DVH)-parameters for thoracic OARs.

RESULTS

Dosimetric effect of intra-observer contour variability was highest for Heart D_max (3.4 ± 6.8 Gy) and lowest for Lungs-GTV D_mean (0.3 ± 0.4 Gy). The effect of contour variation on treatment plan evaluation was highest for Heart D_max (6.0 ± 13.4 Gy) and Esophagus D_max (8.7 ± 17.2 Gy). Dose differences for the various treatment plans, evaluated on the reference (manual) contour, were on average below 1 Gy/1%. For Heart D_mean, higher dose differences were found for overlap with PTV (median 0.2 Gy, 95% 1.7 Gy) vs. no PTV overlap (median 0 Gy, 95% 0.5 Gy). For D_max-parameters, largest dose difference was found between 0-1 cm distance to PTV (median 1.5 Gy, 95% 4.7 Gy).

CONCLUSION

Dose differences arising from automatic contour variations were of the same magnitude or lower than intra-observer contour variability. For Heart D_mean, we recommend delineation errors to be corrected when the heart overlaps with the PTV. For D_max-parameters, we recommend checking contours if the distance is close to PTV (<5 cm). For the lungs, only obvious large errors need to be adjusted.

Geometric contour variation in clinical target volume of axillary lymph nodes in breast cancer radiotherapy: an AIRO multi-institutional study

OBJECTIVES

To determine interobserver variability in axillary nodal contouring in breast cancer (BC) radiotherapy (RT) by comparing the clinical target volume of participating single centres (SC-CTV) with a gold-standard CTV (GS-CTV).

METHODS

The GS-CTV of three patients (P1, P2, P3) with increasing complexity was created in DICOM format from the median contour of axillary CTVs drawn by BC experts, validated using the simultaneous truth and performance-level estimation and peer-reviewed. GS-CTVs were compared with the correspondent SC-CTVs drawn by radiation oncologists, using validated metrics and a total score (TS) integrating all of them.

RESULTS

Eighteen RT centres participated in the study. Comparative analyses revealed that, on average, the SC-CTVs were smaller than GS-CTV for P1 and P2 (by -29.25% and -27.83%, respectively) and larger for P3 (by +12.53%). The mean Jaccard index was greater for P1 and P2 compared to P3, but the overlap extent value was around 0.50 or less. Regarding nodal levels, L4 showed the highest concordance with the GS. In the intra-patient comparison, L2 and L3 achieved lower TS than L4. Nodal levels showed discrepancy with GS, which was not statistically significant for P1, and negligible for P2, while P3 had the worst agreement. DICE similarity coefficient did not exceed the minimum threshold for agreement of 0.70 in all the measurements.

CONCLUSIONS

Substantial differences were observed between SC- and GS-CTV, especially for P3 with altered arm setup. L2 and L3 were the most critical levels. The study highlighted these key points to address.

ADVANCES IN KNOWLEDGE

The present study compares, by means of validated geometric indexes, manual segmentations of axillary lymph nodes in breast cancer from different observers and different institutions made on radiotherapy planning CT images. Assessing such variability is of paramount importance, as geometric uncertainties might lead to incorrect dosimetry and compromise oncological outcome.

Interfractional Geometric Variations and Dosimetric Benefits of Stereotactic MRI Guided Online Adaptive Radiotherapy (SMART) of Prostate Bed after Radical Prostatectomy: Post-Hoc Analysis of a Phase II Trial

PURPOSE

To evaluate geometric variations of patients receiving stereotactic body radiotherapy (SBRT) after radical prostatectomy and the dosimetric benefits of stereotactic MRI guided adaptive radiotherapy (SMART) to compensate for these variations.

MATERIALS/METHODS

The CTV and OAR were contoured on 55 MRI setup scans of 11 patients treated with an MR-LINAC and enrolled in a phase II trial of post-prostatectomy SBRT. All patients followed institutional bladder and rectum preparation protocols and received five fractions of 6-6.8 Gy to the prostate bed. Interfractional changes in volume were calculated and shape deformation was quantified by the Dice similar coefficient (DSC). Changes in CTV-V95%, bladder and rectum maximum dose, V32.5Gy and V27.5Gy were predicted by recalculating the initial plan on daily MRI. SMART was retrospectively simulated if the predicted dose exceeded pre-set criteria.

RESULTS

The CTV volume and shape remained stable with a median volumetric change of 3.0% (IQR -3.0% to 11.5%) and DSC of 0.83 (IQR 0.79 to 0.88). Relatively large volumetric changes in bladder (median -24.5%, IQR -34.6% to 14.5%) and rectum (median 5.4%, IQR - 9.7% to 20.7%) were observed while shape changes were moderate (median DSC of 0.79 and 0.73, respectively). The median CTV-V95% was 98.4% (IQR 94.9% to 99.6%) for the predicted doses. However, SMART would have been deemed beneficial for 78.2% of the 55 fractions based on target undercoverage (16.4%), exceeding OAR constraints (50.9%), or both (10.9%). Simulated SMART improved the dosimetry and met dosimetric criteria in all fractions. Moderate correlations were observed between the CTV-V95% and target DSC (R2 = 0.73) and bladder mean dose versus volumetric changes (R2 = 0.61).

CONCLUSIONS

Interfractional dosimetric variations resulting from anatomic deformation are commonly encountered with post-prostatectomy RT and can be mitigated with SMART.

Method of computing direction-dependent margins for the development of consensus contouring guidelines

BACKGROUND

Clinical target volume (CTV) contouring guidelines are frequently developed through studies in which experts contour the CTV for a representative set of cases for a given treatment site and the consensus CTVs are analyzed to generate margin recommendations. Measures of interobserver variability are used to quantify agreement between experts. In cases where an isotropic margin is not appropriate, however, there is no standard method to compute margins in specified directions that represent possible routes of tumor spread. Moreover, interobserver variability metrics are often measures of volume overlap that do not account for the dependence of disagreement on direction. To aid in the development of consensus contouring guidelines, this study demonstrates a novel method of quantifying CTV margins and interobserver variability in clinician-specified directions.

METHODS

The proposed algorithm was applied to 11 cases of non-spine bone metastases to compute the consensus CTV margin in each direction of intraosseous and extraosseous disease. The median over all cases for each route of spread yielded the recommended margins. The disagreement between experts on the CTV margin was quantified by computing the median of the coefficients of variation for intraosseous and extraosseous margins.

RESULTS

The recommended intraosseous and extraosseous margins were 7.0 mm and 8.0 mm, respectively. The median coefficient of variation quantifying the margin disagreement between experts was 0.59 and 0.48 for intraosseous and extraosseous disease.

CONCLUSIONS

The proposed algorithm permits the generation of margin recommendations in relation to adjacent anatomy and quantifies interobserver variability in specified directions. This method can be applied to future consensus CTV contouring studies.

Interobserver variability in clinical target volume delineation in anal squamous cell carcinoma

We evaluated the inter-physician variability in the target contouring of the radiotherapy for anal squamous cell carcinoma (ASCC). Clinical target volume (CTV) of three patients diagnosed with ASCC was delineated by seven experienced radiation oncologists from multi-institution. These patients were staged as pT1N1a, cT2N0, and cT4N1a, respectively, according to 8^th edition of the American Joint Committee on Cancer staging system. Expert agreement was quantified using an expectation maximization algorithm for Simultaneous Truth and Performance Level Estimation (STAPLE). The maximum distance from the boundaries of the STAPLE generated volume with confidence level of 80% to those of the contour of each CTV in 6 directions was compared. CTV of pelvis which includes primary tumor, perirectal tissue and internal/external iliac lymph node (LN) area (CTV-pelvis) and CTV of inguinal area (CTV-inguinal) were obtained from the seven radiation oncologists. One radiation oncologist did not contain inguinal LN area in the treatment target volume of patient 2 (cT2N0 stage). CTV-inguinal displayed moderate agreement for each patient (overall kappa 0.58, 0.54 and 0.6, respectively), whereas CTV-pelvis showed substantial agreement (overall kappa 0.66, 0.68 and 0.64, respectively). Largest variation among each contour was shown in the inferior margin of the CTV-inguinal. For CTV-pelvis, anterior and superior margin showed the biggest variation. Overall, moderate to substantial agreement was shown for CTV delineation. However, large variations in the anterior and cranial boarder of the CTV-pelvis and the caudal margin of the CTV-inguinal suggest that further studies are needed to establish a clearer target volume delineation guideline.

MRI prostate contouring is not impaired by the use of a radiotherapy image acquisition set-up. An intra- and inter-observer paired comparative analysis with diagnostic set-up images

PURPOSE

The use of MRI for radiotherapy planning purposes is growing but image acquisition using radiotherapy set-ups has impaired image quality. Whether differences in image acquisition set-up could modify organ contouring has not been evaluated. Therefore, we aimed to evaluate differences in contouring between paired of image sets that were acquired in the same scanning session using different parameters.

MATERIAL AND METHODS

Ten patients underwent RT treatment planning with MRI co-registration. MRI was carried out using two different set-ups during the same session, MRI radiotherapy set-ups and MRI diagnostic set-ups. Prostates and rectums were retrospectively contoured in both image sets by 5 radiation oncologists and 4 radiologists. Intra-observer analysis was carried out comparing organ volumes, the Dice coefficient and hausdorff distance values between two contouring rounds. Inter-observer analysis was carried out by comparing individual contours to a generated STAPLE consensus contour, which is considered the gold standard reference.

RESULTS

No significant differences were observed between MRI acquisition set-ups. Significant differences were observed for the dice and hausdorff parameters, comparing individual contours to the STAPLE consensus contour, when analysing diagnostic images between rounds, although raw values were similar.

CONCLUSION

Prostate and rectum contours did not differ significantly when using diagnostic or radiotherapy MRI acquisition set-ups.

A dummy-run evaluation of postoperative hypofractionated intensity-modulated radiation therapy (POHIM-RT) trials for cervical cancer

The postoperative hypofractionated intensity-modulated radiation therapy (POHIM-RT) trial is a phase II study to evaluate toxicity following hypofractionated intensity modulated radiation therapy (IMRT) for cervical cancer. This study describes the results of a benchmark procedure for RT quality assurance of the POHIM-RT trial. Six participating institutions were provided computed tomography for RT planning and an IMRT plan for a sample and were instructed to delineate volumes, create a treatment plan and quality assurance (QA) plan, and submit the results of all procedures. The inter-institutional agreements on RT volume and plan results were evaluated using the kappa value and dice similarity coefficients. The simultaneous truth and performance level estimation (STAPLE) method was employed to generate a consensus target volume. The treatment volumes, organs-at-risk volumes, and results of the RT plan and QA reported by the institutions were acceptable and adhered well to the protocol. In terms of clinical target volume (CTV) delineation, there were differences between the institutions, particularly in vaginal cuff and paracolpium subsites. Consensus CTV was generated from the collected CTVs with the STAPLE method. The participating institutions showed considerable agreement regarding volume, dose and QA results. To improve CTV agreement in CTV, we provided feedback with images of the consensus target volume and detailed written guidelines for specific subsites that were the most heterogeneous.

Development and validation of a contouring guideline for the taste bud bearing tongue mucosa

PURPOSE

To introduce a contouring guideline for the taste bud bearing tongue mucosa for head and neck cancer patients receiving radiotherapy.

METHODS AND MATERIALS

CT simulation images of oropharyngeal cancer patients were used to delineate both the whole tongue (extrinsic/intrinsic tongue muscles, floor of mouth) and the taste bud bearing tongue mucosa (method A: adaptation of the whole tongue structure; method B: axial adaptation of a mid-sagittal contour). Volumetric and dosimetric parameters of the whole tongue and the two methods of mucosal delineation, spatial overlap between methods A and B, and inter-observer variability for method B were calculated.

RESULTS

The study cohort was comprised of 70 patients with T1-4 N0-1 tonsillar (83%) and base of tongue (17%) cancers. Most of the comparative parameters between the whole tongue and mucosa (method A) significantly differed (mean, minimum, and maximum dose, V5-V70, D40-D90). The mean dose calculated for the whole tongue deviated on average 3.77 Gy compared to method A. No significant differences were found between methods A and B of the taste bud bearing tongue mucosa structure, and none of the dosimetric parameters differed more than 1.03 Gy on average. The mean Dice similarity coefficient for both mucosal structures was 0.79 ± 0.05, and 0.63 ± 0.12 for the inter-observer analysis of method B.

CONCLUSIONS

We defined two methods for delineating the taste bud bearing mucosa and both are equally satisfactory procedures. Either method is preferable over delineation of the whole tongue as organ at risk for taste impairment.

Comparison of Dose Distribution in Regional Lymph Nodes in Whole-Breast Radiotherapy vs. Whole-Breast Plus Regional Lymph Node Irradiation: An In Silico Planning Study in Participating Institutions of the Phase III Randomized Trial (KROG 1701)

Simple Summary

The purpose of the current in silico planning study is to compare radiation doses of whole-breast irradiation (WBI) and whole-breast plus regional lymph node irradiation (WBI+RNI) administered to the regional lymph nodes (RLN) in pN1 breast cancer. Twenty-four participating institutions were asked to create plans of WBI and WBI+RNI for two dummy cases. In all RLN regions including supraclavicular lymph node, axillary lymph node, and internal mammary lymph node, the radiation dose to the RLN was higher in WBI+RNI plan than WBI plan.

Abstract

The purpose of the current in silico planning study is to compare radiation doses of whole-breast irradiation (WBI) and whole-breast plus regional lymph node irradiation (WBI+RNI) administered to the regional lymph nodes (RLN) in pN1 breast cancer. Twenty-four participating institutions were asked to create plans of WBI and WBI+RNI for two dummy cases. To compare target coverage between the participants, an isodose line equal to 90% of the prescribed dose was converted to an isodose contour (contour_{90% iso})_. The relative nodal dose (RND) was obtained using the ratio of RLN dose to the target dose. The Fleiss’s kappa values which represent inter-observer agreement of contour_{90% iso} were over 0.68. For RNI, 6 institutions included axillary lymph node (ALN), supraclavicular lymph node (SCN), and internal mammary lymph node (IMN), while 18 hospitals included only ALN and SCN. The median RND between the WBI and WBI+RNI were as follows: 0.64 vs. 1.05 (ALN level I), 0.27 vs. 1.08 (ALN level II), 0.02 vs. 1.12 (ALN level III), 0.01 vs. 1.12 (SCN), and 0.54 vs. 0.82 (IMN). In all nodal regions, the RND was significantly lower in WBI than in WBI+RNI (p < 0.01). In this study, we could identify the nodal dose difference between WBI and WBI+RNI.

Glioma consensus contouring recommendations from a MR-Linac International Consortium Research Group and evaluation of a CT-MRI and MRI-only workflow

Introduction

This study proposes contouring recommendations for radiation treatment planning target volumes and organs-at-risk (OARs) for both low grade and high grade gliomas.

Methods

Ten cases consisting of 5 glioblastomas and 5 grade II or III gliomas, including their respective gross tumor volume (GTV), clinical target volume (CTV), and OARs were each contoured by 6 experienced neuro-radiation oncologists from 5 international institutions. Each case was first contoured using only MRI sequences (MRI-only), and then re-contoured with the addition of a fused planning CT (CT-MRI). The level of agreement among all contours was assessed using simultaneous truth and performance level estimation (STAPLE) with the kappa statistic and Dice similarity coefficient.

Results

A high level of agreement was observed between the GTV and CTV contours in the MRI-only workflow with a mean kappa of 0.88 and 0.89, respectively, with no statistically significant differences compared to the CT-MRI workflow (p = 0.88 and p = 0.82 for GTV and CTV, respectively). Agreement in cochlea contours improved from a mean kappa of 0.39 to 0.41, to 0.69 to 0.71 with the addition of CT information (p < 0.0001 for both cochleae). Substantial to near perfect level of agreement was observed in all other contoured OARs with a mean kappa range of 0.60 to 0.90 in both MRI-only and CT-MRI workflows.

Conclusions

Consensus contouring recommendations for low grade and high grade gliomas were established using the results from the consensus STAPLE contours, which will serve as a basis for further study and clinical trials by the MR-Linac Consortium.

Electronic supplementary material

The online version of this article (10.1007/s11060-020-03605-6) contains supplementary material, which is available to authorized users.

Dosimetric evaluation of MRI-to-ultrasound automated image registration algorithms for prostate brachytherapy

PURPOSE

Identifying dominant intraprostatic lesions (DILs) on transrectal ultrasound (TRUS) images during prostate high-dose-rate brachytherapy treatment planning remains a significant challenge. Multiparametric MRI (mpMRI) is the tool of choice for DIL identification; however, the geometry of the prostate on mpMRI and on the TRUS may differ significantly, requiring image registration. This study assesses the dosimetric impact attributed to differences in DIL contours generated using commonly available MRI to TRUS automated registration: rigid, semi-rigid, and deformable image registration, respectively.

METHODS AND MATERIALS

Ten patients, each with mpMRI and TRUS data sets, were included in this study. Five radiation oncologists with expertise in TRUS-based high-dose-rate brachytherapy were asked cognitively to transfer the DIL from the mpMRI images of each patient to the TRUS image. The contours were analyzed for concordance using simultaneous truth and performance level estimation (STAPLE) algorithm. The impact of DIL contour differences due to registration variability was evaluated by comparing the STAPLE-DIL dosimetry from the reference (STAPLE) plan with that from the evaluation plans (manual and automated registration) for each patient. The dosimetric impact of the automatic registration approach was also validated using a margin expansion that normalizes the volume of the autoregistered DILs to the volumes of the STAPLE-DILs. Dose metrics including D₉₀, D_mean, V₁₅₀, and V₂₀₀ to the prostate and DIL were reported. For urethra and rectum, D₁₀ and V₈₀ were reported.

RESULTS

Significant differences in DIL coverage between reference and evaluation plans were found regardless of the algorithm methodology. No statistical difference was reported in STAPLE-DIL dosimetry when manual registration was used. A margin of 1.5 ± 0.8 mm, 1.1 ± 0.8 mm, and 2.5 ± 1.6 mm was required to be added for rigid, semi-rigid, and deformable registration, respectively, to mitigate the difference in STAPLE-DIL coverage between the evaluation and reference plans.

CONCLUSION

The dosimetric impact of integrating an MRI-delineated DIL into a TRUS-based brachytherapy workflow has been validated in this study. The results show that rigid, semi-rigid, and deformable registration algorithms lead to a significant undercoverage of the DIL D₉₀ and D_mean. A margin of at least 1.5 ± 0.8 mm, 1.1 ± 0.8 mm, and 2.5 ± 1.6 mm is required to be added to the rigid, semi-rigid, and deformable DIL registration to be suitable for DIL-boosting during prostate brachytherapy.

A Systematic Review of Contouring Guidelines in Radiation Oncology: Analysis of Frequency, Methodology, and Delivery of Consensus Recommendations

PURPOSE

Clinical trials have described variation in radiation therapy plan quality, of which contour delineation is a key component, and linked this to inferior patient outcomes. In response, consensus guidelines have been developed to standardize contour delineation. This investigation assesses trends in contouring guidelines and examines the methodologies used to generate and deliver recommendations.

METHODS AND MATERIALS

We conducted a literature search for contouring guidelines published after 1995. Of 11,124 citations, 332 were identified for full-text review to determine inclusion. We abstracted articles for the intent of the consensus process, key elements of the methodology, and mode of information delivery. A Fisher exact test was used to identify elements that differed among the guidelines generated for clinical trials and routine care.

RESULTS

Overall, 142 guidelines were included, of which 16 (11%) were developed for a clinical trial. There was an increase in guideline publication over time (0 from 1995-1999 vs 65 from 2015- 2019; P = .03), particularly among recommendations for stereotactic radiation and brachytherapy. The most common disease sites were head and neck (24%), gastrointestinal (12%), and gynecologic (12%). Methods used to develop recommendations included literature review (50%) and image-based methods (45%). Panels included a median of 10 physicians (interquartile range, 7-16); 70% of panels represented multidisciplinary expertise. Guidelines developed for a clinical trial were more likely to include an image-based approach, with quantitative analysis of contours submitted by the panel members and to publish a full set of image-based recommendations (P < .005).

CONCLUSIONS

This review highlights an increase in consensus contouring recommendations over time. Guidelines focus on disease sites, such as head and neck, with evidence supporting a correlation between treatment planning and patient outcomes, although variation exists in the approach to the consensus process. Elements that may improve guideline acceptance (ie, image-based consensus contour analysis) and usability (ie, inclusion of a full image set) are more common in guidelines developed for clinical trials.

Measuring Efficiency of Semi-automated Brain Tumor Segmentation by Simulating User Interaction

Traditionally, radiologists have crudely quantified tumor extent by measuring the longest and shortest dimension by dragging a cursor between opposite boundary points across a single image rather than full segmentation of the volumetric extent. For algorithmic-based volumetric segmentation, the degree of radiologist experiential involvement varies from confirming a fully automated segmentation, to making a single drag on an image to initiate semi-automated segmentation, to making multiple drags and clicks on multiple images during interactive segmentation. An experiment was designed to test an algorithm that allows various levels of interaction. Given the ground-truth of the BraTS training data, which delimits the brain tumors of 285 patients on multi-spectral MR, a computer simulation mimicked the process that a radiologist would follow to perform segmentation with real-time interaction. Clicks and drags were placed only where needed in response to the deviation between real-time segmentation results and assumed radiologist's goal, as provided by the ground-truth. Results of accuracy for various levels of interaction are presented along with estimated elapsed time, in order to measure efficiency. Average total elapsed time, including loading the study through confirming 3D contours, was 46 s.

The emerging role of radiation therapists in the contouring of organs at risk in radiotherapy: analysis of inter-observer variability with radiation oncologists for the chest and upper abdomen

Aims

To compare the contouring of organs at risk (OAR) between a clinical specialist radiation therapist (CSRT) and radiation oncologists (ROs) with different levels of expertise (senior–SRO, junior–JRO, fellow–FRO).

Methods

On ten planning computed tomography (CT) image sets of patients undergoing breast radiotherapy (RT), the observers independently contoured the contralateral breast, heart, left anterior descending artery (LAD), oesophagus, kidney, liver, spinal cord, stomach and trachea. The CSRT was instructed by the JRO e SRO. The inter-observer variability of contoured volumes was measured using the Dice similarity coefficient (DSC) (threshold of ≥ 0.7 for good concordance) and the centre of mass distance (CMD). The analysis of variance (ANOVA) was performed and a p-value < 0.01 was considered statistically significant.

Results

Good overlaps (DSC > 0.7) were obtained for all OARs, except for LAD (DSC = 0.34 ± 0.17, mean ± standard deviation) and oesophagus (DSC = 0.66 ± 0.06, mean ± SD). The mean CMD < 1 cm was achieved for all the OARs, but spinal cord (CMD = 1.22 cm). By pairing the observers, mean DSC > 0.7 and mean CMD < 1 cm were achieved in all cases. The best overlaps were seen for the pairs JRO-CSRT(DSC = 0.82; CMD = 0.49 cm) and SRO-JRO (DSC = 0.80; CMD = 0.51 cm).

Conclusions

Overall, good concordance was found for all the observers. Despite the short training in contouring, CSRT obtained good concordance with his tutor (JRO). Great variability was seen in contouring the LAD, due to its difficult visualization and identification of CT scans without contrast.

Comparing Breast Conservation Surgery Seromas Contoured by Radiation Therapists versus those Contoured by a Radiation Oncologist in Radiation Therapy Planning for Early-Stage Breast Cancer

INTRODUCTION

In the management of early-stage breast cancer using radiation therapy, computed tomography (CT) simulation is used to identify the breast conservation surgery (BCS) seroma as a proxy for the tumour bed. The delineation or contouring of the seroma is generally a task performed by a radiation oncologist (RO). With increasing patient numbers and other demands placed on ROs, the scope of practice for radiation therapists (RTs) is continually expanding, and the need for skills transfer from one profession to another has been investigated in recent years. This study aims to compare the BCS seroma volumes contoured by RTs with those contoured by ROs to add evidence in support of expanding the RTs' role in the treatment planning process in the management of early-stage breast cancer.

METHODS

A study was undertaken using the CT-simulation (CT-sim) data sets of patients with early-stage breast cancer treated in 2013. The CT-sim data sets had BCS seromas contoured by 1 of 5 ROs as part of routine clinical management. This study involved 4 RTs who each used the patient information to identify and contour breast seromas on 50 deidentified CT-sim data sets. Metrics used to compare RT versus RO contours included volume size, overlap between volumes, and geographical distance from the centre of volumes.

RESULTS

There were 50 CT-sim data sets with 1 RO contour and 4 RT contours analysed. The contour volumes of the 4 RTs and the ROs were assessed. Although there were 50 CT-sim data sets presented to each RT, analysis was carried out on 45, 43, 46, and 45 CT-sim data sets. There were no comparisons made where contours were not delineated. The contour volumes of the 4 RTs and the ROs were assessed with an interclass correlation coefficient, with a result of excellent reliability (0.975, 95% [0.963, 0.985]). The DICE similarity coefficient was used to compare the overlap of each RT contour with the RO contour; the results were favourable with mean (95% CI) DSCs 0.685, 0.640, 0.678, and 0.681, respectively. Comparing the RT and RO geographical centre of the seroma volumes, good to excellent reliability between the RTs and ROs was demonstrated (95% CI mean RO vs RT distances (mm): 3.75, 4.99, 7.71, and 3.39). There was no statistically significant difference between the distances (P = 0.65).

CONCLUSION

BCS seromas contoured by RTs compared well with those contoured by an RO. This research has provided further evidence to support RTs in assuming additional contouring responsibilities in radiation therapy planning for patients with early-stage breast cancer.

Mapping of Metastatic Level I Axillary Lymph Nodes in Patients with Newly Diagnosed Breast Cancer

PURPOSE

We examined the distribution of pretreatment nodal metastases to the level I axilla (Ax-L1) to assess the appropriateness of current breast atlases and provide guidelines in relationship to easily identifiable anatomic landmarks for accurate delineation of this lymph node (LN) basin.

METHODS AND MATERIALS

Patients with newly diagnosed breast cancer and biopsy-proven metastatic Ax-L1 LNs were identified. We related the location of each LN to its most adjacent rib and its distance from the bottom of the humeral head, axillary vessels, and a line connecting the anterior aspects of the pectoralis and latissimus dorsi muscles (P-L line). LNs were mapped onto a representative planning computed tomography scan, and their distribution was used to validate the current Radiation Therapy Oncology Group, European Society for Radiotherapy and Oncology, and Radiotherapy Comparative Effectiveness breast atlases. Furthermore, we examined metastases to a subregion encompassing the superolateral Ax-L1, irradiation of which correlates highly with lymphedema.

RESULTS

We identified 106 eligible patients with 107 biopsied LNs. All LNs fell between the second and fifth ribs (mean, 3.8 ± 0.56). Mean distance from the inferior aspect of the humeral head was 4.3 ± 1.6 cm (range, 0.3-8.4). Mean distance from the inferior aspect of the axillary vessels was 2.9 ± 1.5 cm (range, -0.6 to 5.4). Mean distance from the P-L line was 0.01 ± 1.9 cm (range, -2.2 to 2.4); negative and positive values denote medial or lateral to the P-L line. A Radiation Therapy Oncology Group-compliant Ax-L1 consensus contour, created from contours by 4 attending breast radiation oncologists, partially or fully missed 45% of mapped LNs. European Society for Radiotherapy and Oncology- and Radiotherapy Comparative Effectiveness-compliant Ax-L1 similarly missed 46% and 34% of mapped LNs, respectively. LNs were most frequently missed in the lateral direction. The superolateral Ax-L1 encompassed 9.3% of the mapped LNs.

CONCLUSIONS

A significant percentage of at-risk Ax-L1 tissue falls outside current contouring atlases. We propose expansion of the recommended Ax-L1 borders, most notably in the lateral direction.

Evaluation of measures for assessing time-saving of automatic organ-at-risk segmentation in radiotherapy

•

Automatic delineation software shows promising results in terms of time-saving.

•

Standard geometry measures do not have a high correlation with delineation time.

•

New evaluation measures were introduced: added path length (APL) and surface DSC.

•

(Added) path length showed the highest correlation with time-recordings.

•

This makes APL the most representative measure for clinical usefulness.

Background and purpose

In radiotherapy, automatic organ-at-risk segmentation algorithms allow faster delineation times, but clinically relevant contour evaluation remains challenging. Commonly used measures to assess automatic contours, such as volumetric Dice Similarity Coefficient (DSC) or Hausdorff distance, have shown to be good measures for geometric similarity, but do not always correlate with clinical applicability of the contours, or time needed to adjust them. This study aimed to evaluate the correlation of new and commonly used evaluation measures with time-saving during contouring.

Materials and methods

Twenty lung cancer patients were used to compare user-adjustments after atlas-based and deep-learning contouring with manual contouring. The absolute time needed (s) of adjusting the auto-contour compared to manual contouring was recorded, from this relative time-saving (%) was calculated. New evaluation measures (surface DSC and added path length, APL) and conventional evaluation measures (volumetric DSC and Hausdorff distance) were correlated with time-recordings and time-savings, quantified with the Pearson correlation coefficient, R.

Results

The highest correlation (R = 0.87) was found between APL and absolute adaption time. Lower correlations were found for APL with relative time-saving (R = −0.38), for surface DSC with absolute adaption time (R = −0.69) and relative time-saving (R = 0.57). Volumetric DSC and Hausdorff distance also showed lower correlation coefficients for absolute adaptation time (R = −0.32 and 0.64, respectively) and relative time-saving (R = 0.44 and −0.64, respectively).

Conclusion

Surface DSC and APL are better indicators for contour adaptation time and time-saving when using auto-segmentation and provide more clinically relevant and better quantitative measures for automatically-generated contour quality, compared to commonly-used geometry-based measures.

MRI-based interstitial brachytherapy for vaginal tumors: A multi-institutional study on practice patterns, contouring, and consensus definitions of target volumes

PURPOSE

Interstitial brachytherapy (ISBT) can be effective for vaginal tumors due to its ability to deliver conformal treatment with 3D planning. As there is no consensus for 3D vaginal brachytherapy (BT) contouring, the goals of this study are to evaluate the variability in practices and contouring, and to develop consensus concepts on target definitions.

METHODS

A survey/contouring study was conducted with 16 radiation oncologists from 10 Canadian academic centers. The study included three vaginal ISBT cases. Participants were provided staging, prebrachytherapy (pre-BT), and BT MRIs. Participants responded to a questionnaire and contoured on the provided images. Agreement between contours was analyzed. A meeting was held to develop consensus definitions of targets.

RESULTS

Median ISBT experience was 3.5 years. All 16 participants regularly contour with MRI, whereas three also plan on MRI. For the three cases, there was variation into how CTVHR and CTVIR was defined. Kappa statistics showed higher agreement with bulky tumors (mean 0.59) as compared with small residual tumors (mean 0.29). For all cases, kappa was highest in pre-BT GTVres as compared with BT GTVres (mean 0.58, 0.46). Consensus concepts to define targets were developed.

CONCLUSIONS

Variations exist in how ISBT targets are defined for vaginal tumors. Highest contouring variability was seen with small residual at BT. Contouring is more consistent on pre-BT MRI as compared with BT MRI suggesting a needle distortion effect. Consensus CTVHR and CTVIR definitions have been developed and further work is warranted to establish international standards.

NRG brain tumor specialists consensus guidelines for glioblastoma contouring

INTRODUCTION

NRG protocols for glioblastoma allow for clinical target volume (CTV) reductions at natural barriers; however, literature examining CTV contouring and the relevant white matter pathways is lacking. This study proposes consensus CTV guidelines, with a focus on areas of controversy while highlighting common errors in glioblastoma target delineation.

METHODS

Ten academic radiation oncologists specializing in brain tumor treatment contoured CTVs on four glioblastoma cases. CTV expansions were based on NRG trial guidelines. Contour consensus was assessed and summarized by kappa statistics. A meeting was held to discuss the mathematically averaged contours and form consensus contours and recommendations.

RESULTS

Contours of the cavity plus enhancement (mean kappa 0.69) and T2-FLAIR signal (mean kappa 0.74) showed moderate to substantial agreement. Experts were asked to trim off anatomic barriers while respecting pathways of spread to develop their CTVs. Submitted CTV_4600 (mean kappa 0.80) and CTV_6000 (mean kappa 0.81) contours showed substantial to near perfect agreement. Simultaneous truth and performance level estimation (STAPLE) contours were then reviewed and modified by group consensus. Anatomic trimming reduced the amount of total brain tissue planned for radiation targeting by a 13.6% (range 8.7-17.9%) mean proportional reduction. Areas for close scrutiny of target delineation were described, with accompanying recommendations.

CONCLUSIONS

Consensus contouring guidelines were established based on expert contours. Careful delineation of anatomic pathways and barriers to spread can spare radiation to uninvolved tissue without compromising target coverage. Further study is necessary to accurately define optimal target volumes beyond isometric expansion techniques for individual patients.

Inter-observer variability of clinical target volume delineation in definitive radiotherapy of neck lymph node metastases from unknown primary. A cooperative study of the Italian Association of Radiotherapy and Clinical Oncology (AIRO) Head and Neck Group

BACKGROUND

This study, promoted by Italian Association of Radiotherapy and Clinical Oncology (AIRO) Head and Neck Group, aimed to assess the current national practice of target volume delineation on a case of neck lymph node metastases from unknown primary evaluating inter-observer variability, in a setting of primary radiotherapy.

MATERIALS AND METHODS

A case of metastatic neck lymph node from occult primary was proposed to 17 radiation oncologists. A national reference RT center was identified and considered as benchmark. Participants were requested to delineate target volumes. A structured questionnaire was administered. A comparison between following parameters of the CTVs was performed: centroids distances, Dice similarity index (DSI), Jaccard index and mean distance to agreement (MDA). Volume expressed in cubic centimeters and CTVs cranio-caudal extension were evaluated.

RESULTS

Sixteen of 17 radiation oncologists recommended three CTVs dose levels. (CTV HD, CTV ID and CTV LD); CTV ID was not delineated by one of the participants and by the reference center. The distance between the reference centroid and the mean centroid of CTVs HD was 1.09 cm (0.36-3.99 cm); for CTV LD, a mean centroids distance of 2.45 (0.27-4.83 cm) was found, and for CTV HD, mean DSI is 0.48 and mean Jaccard index is 0.32 and MDA was 8.89 mm. CTV LD showed a mean DSI of 0.46, mean Jaccard index of 0.31 and MDA of 14.87 when compared to the reference.

CONCLUSION

Many aspects concerning treatment optimization of cervical nodes metastases from occult primary remain unclear, and we found a notable heterogeneity of global radiotherapy management reporting discordances both in target volume delineation and volume prescription.

An in-silico quality assurance study of contouring target volumes in thoracic tumors within a cooperative group setting

•

We aimed at quantifying inter-observer Pancoast tumors delineation variability.

•

Experts’ delineations were used to define ground truth.

•

Other observers’ delineations were compared against ground truth.

•

High degree of variability was noted for most target volumes except GTV_P.

•

This unveils potentials for protocol modification for future IMRT studies.

Introduction

Target delineation variability is a significant technical impediment in multi-institutional trials which employ intensity modulated radiotherapy (IMRT), as there is a real potential for clinically meaningful variances that can impact the outcomes in clinical trials. The goal of this study is to determine the variability of target delineation among participants from different institutions as part of Southwest Oncology Group (SWOG) Radiotherapy Committee’s multi-institutional in-silico quality assurance study in patients with Pancoast tumors as a “dry run” for trial implementation.

Methods

CT simulation scans were acquired from four patients with Pancoast tumor. Two patients had simulation 4D-CT and FDG-FDG PET-CT while two patients had 3D-CT and FDG-FDG PET-CT. Seventeen SWOG-affiliated physicians independently delineated target volumes defined as gross primary and nodal tumor volumes (GTV_P & GTV_N), clinical target volume (CTV), and planning target volume (PTV).

Six board-certified thoracic radiation oncologists were designated as the ‘Experts’ for this study. Their delineations were used to create a simultaneous truth and performance level estimation (STAPLE) contours using ADMIRE software (Elekta AB, Sweden 2017). Individual participants’ contours were then compared with Experts’ STAPLE contours.

Results

When compared to the Experts’ STAPLE, GTV_P had the best agreement among all participants, while GTV_N showed the lowest agreement among all participants. There were no statistically significant differences in all studied parameters for all TVs for cases with 4D-CT versus cases with 3D-CT simulation scans.

Conclusions

High degree of inter-observer variation was noted for all target volume except for GTV_P, unveiling potentials for protocol modification for subsequent clinically meaningful improvement in target definition. Various similarity indices exist that can be used to guide multi-institutional radiotherapy delineation QA credentialing.

Contouring workload in adjuvant breast cancer radiotherapy

PURPOSE

To measure the impact of contouring on worktime in the adjuvant radiation treatment of breast cancer, and to identify factors that might affect the measurements.

MATERIAL AND METHODS

The dates and times of contouring clinical target volumes and organs at risk were recorded by a senior and by two junior radiation oncologists. Outcome measurements were contour times and the time from start to approval. The factors evaluated were patient age, type of surgery, radiation targets and setup, operator, planning station, part of the day and day of the week on which the contouring started. The Welch test was used to comparatively assess the measurements.

RESULTS

Two hundred and three cases were included in the analysis. The mean contour time per patient was 34minutes for a mean of 4.72 structures, with a mean of 7.1minutes per structure. The clinical target volume and organs at risk times did not differ significantly. The mean time from start to approval per patient was 29.4hours. Factors significantly associated with longer contour times were breast-conserving surgery (P=0.026), prone setup (P=0.002), junior operator (P<0.0001), Pinnacle planning station (P=0.026), contouring start in the morning (P=0.001), and contouring start by the end of the week (P<0.0001). Factors significantly associated with time from start to approval were age (P=0.038), junior operator (P<0.0001), planning station (P=0.016), and contouring start by the end of the week (P=0.004).

CONCLUSION

Contouring is a time-consuming process. Each delineated structure influences worktime, and many factors may be targeted for optimization of the workflow. These preliminary data will serve as basis for future prospective studies to determine how to establish a cost-effective solution.

A prospective in silico analysis of interdisciplinary and interobserver spatial variability in post-operative target delineation of high-risk oral cavity cancers: Does physician specialty matter?

Background

The aim of this study was to determine the interdisciplinary agreement in identifying the post-operative tumor bed.

Methods

Three radiation oncologists (ROs), four surgeons, and three radiologists segmented post-operative tumor and nodal beds for three patients with oral cavity cancer. Specialty cohort composite contours were created by STAPLE algorithm implementation results for interspecialty comparison. Dice similarity coefficient and Hausdorff distance were utilized to compare spatial differentials between specialties.

Results

There were significant differences between disciplines in target delineation. There was unacceptable variation in Dice similarity coefficient for each observer and discipline when compared to the STAPLE contours. Within surgery and radiology disciplines, there was good consistency in volumes. ROs and radiologists have similar Dice similarity coefficient scores compared to surgeons.

Conclusion

There were significant interdisciplinary differences in perceptions of tissue-at-risk. Better communication and explicit description of at-risk areas between disciplines is required to ensure high-risk areas are adequately targeted.

Fusion of Intraoperative Transrectal Ultrasound Images with Post-implant Computed Tomography and Magnetic Resonance Imaging

Purpose

To compare the impact of the fusion of intraoperative transrectal ultrasound (TRUS) images with day 30 computed tomography (CT) and magnetic resonance imaging (MRI) on prostate volume and dosimetry.

Methods and materials

Seventy-five consecutive patients with CT and MRI obtained on day 30 with a Fast Spin Echo T2-weighted magnetic resonance (MR) sequence were analyzed. A rigid manual registration was performed between the intraoperative TRUS and day-30 CT based on the prostate volume. A second manual rigid registration was performed between the intraoperative TRUS and the day-30 MRI. The prostate contours were manually modified on CT and MRI. The difference in prostate volume and dosimetry between CT and MRI were compared.

Results

Prostate volume was on average 8% (standard deviation (SD) ± 16%) larger on intraoperative TRUS than on CT and 6% (18%) larger than on MRI. In 48% of the cases, the difference in volume on CT was > 10% compared to MRI. The difference in prostate volume between CT and MRI was inversely correlated to the difference in D90 (minimum dose that covers 90% of the prostate volume) between CT and MRI (r = -0.58, P < .001). A D90 < 90% was found in 5% (n = 4) on MRI and in 10% (n = 7) on CT (Fisher exact test one-sided P = .59), but in no patient was the D90 < 90% on both MRI and CT.

Conclusions

When fusing TRUS images with CT and MRI, the differences in prostate volume between those modalities remain clinically important in nearly half of the patients, and this has a direct influence on how implant quality is evaluated.

Consensus Contouring Guidelines for Postoperative Completely Resected Cavity Stereotactic Radiosurgery for Brain Metastases

PURPOSE

To propose contouring guidelines based on consensus contours generated by 10 international experts for cavity stereotactic radiosurgery (SRS), an emerging treatment option after surgical resection of brain metastases. No guidelines for contouring the surgical cavity volume have been previously reported.

METHODS AND MATERIALS

Ten postoperative completely resected cases with varying clinical scenarios and locations within the brain were selected. For each case, 10 experts independently contoured the surgical cavity clinical target volume (CTV). All the contours were analyzed, and agreement was calculated using the simultaneous truth and performance level estimation (STAPLE) with the kappa statistic. A follow-up survey was also completed by each investigator to summarize their contouring rationale for a number of different clinical scenarios. The results from the survey and the consensus STAPLE contours were both summarized to establish contouring guidelines.

RESULTS

A high level of agreement was found between the expert CTV contours (mean sensitivity 0.75, mean specificity 0.98), and the mean kappa was 0.65. The agreement was statistically significant at P<.001 for all cases. From these results and analyses of the survey answers, the recommendations for CTV include fusion of the preoperative magnetic resonance imaging scan to aid in volume delineation; contouring the entire surgical tract regardless of the preoperative location of the tumor; extension of the CTV 5 to 10 mm along the dura overlying the bone flap to account for microscopic disease extension in cases with preoperative dural contact; and a margin of ≤5 mm into the adjacent sinus when preoperative venous sinus contact was present.

CONCLUSIONS

Consensus contouring guidelines for postoperative completely resected cavity SRS treatment were established using expert contours and clinical practice. However, in the absence of clinical data supporting these recommendations, these guidelines serve as a baseline for further study and refinement.

A dose based approach for evaluation of inter-observer variations in target delineation

BACKGROUND AND PURPOSE

Substantial inter-observer variations in target delineation have been presented previously. Target delineation for paediatric cases is difficult due to the small number of children, the variation in paediatric targets, the number of study protocols, and the individual patient's specific needs and demands. Uncertainties in target delineation might lead to under-dosage or over-dosage. The aim of this work is to apply the concept of a consensus volume and good quality treatment plans to visualise and quantify inter-observer target delineation variations in dosimetric terms in addition to conventional geometrically based volume concordance indices.

MATERIAL AND METHODS

Two paediatric cases were used to demonstrate the potential of adding dose metrics when evaluating target delineation diversity; Hodgkin's disease (case 1) and rhabdomyosarcoma of the parotid gland (case 2). The variability in target delineation (PTV delineations) between six centres was quantified using the generalised conformity index, CIgen, generated for volume overlap. The STAPLE algorithm, as implemented in CERR, was used for both cases to derive a consensus volumes. STAPLE is a probabilistic estimate of the true volume generated from all observers. Dose distributions created by each centre for the original target volumes were then applied to this consensus volume.

RESULTS

A considerable variation in target segmentation was seen in both cases. For case 1 the variation was 374-960 cm3 (average 669 cm3) and for case 2; 65-126 cm3 (average 109 cm3). CIgen were 0.53 and 0.70, respectively. The DVHs in absolute volume displayed for the delineated target volume as well as for the consensus volume adds information on both "compliant" target volumes as well as outliers which are hidden with just the use of concordance indices.

CONCLUSIONS

The DVHs in absolute volume add valuable and easily understood information to various indices for evaluating uniformity in target delineation.

Variability in axillary lymph node delineation for breast cancer radiotherapy in presence of guidelines on a multi-institutional platform

AIM

To quantify the variability between radiation oncologists (ROs) when outlining axillary nodes in breast cancer.

MATERIAL AND METHODS

For each participating center, three ROs with different levels of expertise, i.e., junior (J), senior (S) and expert (E), contoured axillary nodal levels (L1, L2, L3 and L4) on the CT images of three different patients (P) of an increasing degree of anatomical complexity (from P1 to P2 to P3), according to contouring guidelines. Consensus contours were generated using the simultaneous truth and performance level estimation (STAPLE) method.

RESULTS

Fifteen centers and 42 ROs participated. Overall, the median Dice similarity coefficient was 0.66. Statistically significant differences were observed according to the level of expertise (better agreement for J and E, worse for S); the axillary level (better agreement for L1 and L4, worse for L3); the patient (better agreement for P1, worse for P3). Statistically significant differences in contouring were found in 18% of the inter-center comparison. Less than a half of the centers could claim to have a good agreement between the internal ROs.

CONCLUSIONS

The overall intra-institute and inter-institute agreement was moderate. Central lymph-node levels were the most critical and variability increased as the complexity of the patient's anatomy increased. These findings might have an effect on the interpretation of results from multicenter and even mono-institute studies.

Toward a standard for the evaluation of PET-Auto-Segmentation methods following the recommendations of AAPM task group No. 211: Requirements and implementation

Purpose

The aim of this paper is to define the requirements and describe the design and implementation of a standard benchmark tool for evaluation and validation of PET‐auto‐segmentation (PET‐AS) algorithms. This work follows the recommendations of Task Group 211 (TG211) appointed by the American Association of Physicists in Medicine (AAPM).

Methods

The recommendations published in the AAPM TG211 report were used to derive a set of required features and to guide the design and structure of a benchmarking software tool. These items included the selection of appropriate representative data and reference contours obtained from established approaches and the description of available metrics. The benchmark was designed in a way that it could be extendable by inclusion of bespoke segmentation methods, while maintaining its main purpose of being a standard testing platform for newly developed PET‐AS methods. An example of implementation of the proposed framework, named PETASset, was built. In this work, a selection of PET‐AS methods representing common approaches to PET image segmentation was evaluated within PETASset for the purpose of testing and demonstrating the capabilities of the software as a benchmark platform.

Results

A selection of clinical, physical, and simulated phantom data, including “best estimates” reference contours from macroscopic specimens, simulation template, and CT scans was built into the PETASset application database. Specific metrics such as Dice Similarity Coefficient (DSC), Positive Predictive Value (PPV), and Sensitivity (S), were included to allow the user to compare the results of any given PET‐AS algorithm to the reference contours. In addition, a tool to generate structured reports on the evaluation of the performance of PET‐AS algorithms against the reference contours was built. The variation of the metric agreement values with the reference contours across the PET‐AS methods evaluated for demonstration were between 0.51 and 0.83, 0.44 and 0.86, and 0.61 and 1.00 for DSC, PPV, and the S metric, respectively. Examples of agreement limits were provided to show how the software could be used to evaluate a new algorithm against the existing state‐of‐the art.

Conclusions

PETASset provides a platform that allows standardizing the evaluation and comparison of different PET‐AS methods on a wide range of PET datasets. The developed platform will be available to users willing to evaluate their PET‐AS methods and contribute with more evaluation datasets.

Interobserver delineation uncertainty in involved-node radiation therapy (INRT) for early-stage Hodgkin lymphoma: on behalf of the Radiotherapy Committee of the EORTC lymphoma group

BACKGROUND AND PURPOSE

In early-stage classical Hodgkin lymphoma (HL) the target volume nowadays consists of the volume of the originally involved nodes. Delineation of this volume on a post-chemotherapy CT-scan is challenging. We report on the interobserver variability in target volume definition and its impact on resulting treatment plans.

MATERIALS AND METHODS

Two representative cases were selected (1: male, stage IB, localization: left axilla; 2: female, stage IIB, localizations: mediastinum and bilateral neck). Eight experienced observers individually defined the clinical target volume (CTV) using involved-node radiotherapy (INRT) as defined by the EORTC-GELA guidelines for the H10 trial. A consensus contour was generated and the standard deviation computed. We investigated the overlap between observer and consensus contour [Sørensen-Dice coefficient (DSC)] and the magnitude of gross deviations between the surfaces of the observer and consensus contour (Hausdorff distance). 3D-conformal (3D-CRT) and intensity-modulated radiotherapy (IMRT) plans were calculated for each contour in order to investigate the impact of interobserver variability on each treatment modality. Similar target coverage was enforced for all plans.

RESULTS

The median CTV was 120 cm³ (IQR: 95-173 cm³) for Case 1, and 255 cm³ (IQR: 183-293 cm³) for Case 2. DSC values were generally high (>0.7), and Hausdorff distances were about 30 mm. The SDs between all observer contours, providing an estimate of the systematic error associated with delineation uncertainty, ranged from 1.9 to 3.8 mm (median: 3.2 mm). Variations in mean dose resulting from different observer contours were small and were not higher in IMRT plans than in 3D-CRT plans.

CONCLUSIONS

We observed considerable differences in target volume delineation, but the systematic delineation uncertainty of around 3 mm is comparable to that reported in other tumour sites. This report is a first step towards calculating an evidence-based planning target volume margin for INRT in HL.

The role of delineation education programs for improving interobserver variability in target volume delineation in gastric cancer

OBJECTIVE

To assess whether delineation courses for radiation oncologists improve interobserver variability in target volume delineation for post-operative gastric cancer radiotherapy planning.

METHODS

29 radiation oncologists delineated target volumes in a gastric cancer patient. An experienced radiation oncologist lectured about delineation based on contouring atlas and delineation recommendations. After the course, the radiation oncologists, blinded to the previous delineation, provided delineation for the same patient.

RESULTS

The difference between delineated volumes and reference volumes for pre- and post-course clinical target volume (CTV) were 19.8% (-42.4 to 70.6%) and 12.3% (-12.0 to 27.3%) (p = 0.26), respectively. The planning target volume (PTV) differences pre- and post-course according to the reference volume were 20.5% (-40.7 to 93.7%) and 13.1% (-10.6 to 29.5%) (p = 0.30), respectively. The concordance volumes between the pre- and post-course CTVs and PTVs were 467.1 ± 89.2 vs 597.7 ± 54.6 cm³ (p < 0.001) and 738.6 ± 135.1 vs 893.2 ± 144.6 cm³ (p < 0.001), respectively. Minimum and maximum observer variations were seen at the cranial part and splenic hilus and at the caudal part of the CTV. The kappa indices compared with the reference contouring at pre- and post-course delineations were 0.68 and 0.82, respectively.

CONCLUSION

The delineation course improved interobserver variability for gastric cancer. However, impact of target volume changes on toxicity and local control should be evaluated for further studies. Advances in knowledge: This study demonstrated that a delineation course based on current recommendations helped physicians delineate smaller and more homogeneous target volumes. Better target volume delineation allows proper target volume irradiation and preventing unnecessary normal tissue irradiation.

Variability in target delineation of cervical carcinoma: A Korean radiation oncology group study (KROG 15-06)

PURPOSE

To determine inter-observer variability in target volume definition of cervical cancer in radical and adjuvant radiotherapy (RT) settings.

METHODS

Eight physicians contoured CTVs of 2 patients underwent definitive and postoperative RT. Each volume was analyzed using the individual/median volume ratio and generalized conformity index (CIgen). And center of mass (COM) of each contour was calculated. Expert agreement was quantified using an expectation maximization algorithm for Simultaneous Truth and Performance Level Estimation (STAPLE).

RESULTS

For definitive RT, the individual/median volume ratio ranged from 0.51 to 1.41, and CIgen was 0.531. Mean 3-dimensional distances of average to each COM were 7.8 mm. For postoperative RT setting, corresponding values were 0.65-1.38, 0.563, and 5.3 mm. Kappa value of expert agreement was 0.65 and 0.67, respectively. STAPLE estimates of the sensitivity, specificity, and kappa measures of inter-physician agreement were 0.73, 0.98, and 0.65 for the definitive and 0.75, 0.98, and 0.67 for the adjuvant radiotherapy setting. The largest difference was observed in the superior-inferior direction, particularly in the upper vagina and the common iliac area.

CONCLUSION

As there was still some variability in target delineation, more detailed guidelines for target volume delineation and continuing education would help to reduce this uncertainty.

An evaluation of the robustness of organ-at-risk recommendations made by GEC/ESTRO according to interobserver variability: a single-center experience

Purpose

Groupe Européen de Curiethérapie (GEC) and European Society for Radiotherapy & Oncology (ESTRO) has proposed a rectal dose constraint of the most exposed 2-cc volume (D_2cc of ≤ 75 Gy EQD_2α/β = 3) during external-beam plus high-dose-rate brachytherapy (HDR-BT) in localized prostate cancer patients. This study aimed to evaluate D_2cc for rectal contouring via interobserver variability.

Material and methods

Four blinded observers contoured rectums of 5 patients. Rectal contouring anatomical limits were determined through previous consensus. Dose-volume histogram (DVH) dosimetric parameters (D_0.1cc, D_1cc, and D_2cc) were analyzed according to GEC/ESTRO recommendations and subjected to intra- and interobserver comparisons. Latter comparisons involved coefficients of variation. For each parameter, the mean, standard deviation (SD), and range were evaluated. The effect of interobserver variation on total dose was analyzed by estimating the biologically equivalent rectal dose (EQD_2α/β = 3).

Results

Interobserver coefficients of variation for D_0.1cc, D_1cc, and D_2cc were 5.7%, 4.5%, and 4%, respectively. The highest interobserver rectal delineation variation yielded a rectal dose difference up to 5.8 Gy EQD₂. Estimated intraobserver variation for the reported D_2cc was 5.5% in the worst-case scenario (non-significant).

Conclusions

We observed acceptable interobserver variability in EQD₂ for D_2cc, with strong impacts on clinical threshold levels (D_2cc ≤ 75 Gy EQD₂) in some cases. This small, single-center analysis will be extended in a multicenter study.