Interobserver variability in clinical target volume delineation for primary mediastinal B-cell lymphoma

Contouring aid tools in radiotherapy. Smoothing: the false friend

OBJECTIVE

Contouring accuracy is critical in modern radiotherapy. Several tools are available to assist clinicians in this task. This study aims to evaluate the performance of the smoothing tool in the ARIA system to obtain more consistent volumes.

METHODS

Eleven different geometric shapes were delineated in ARIA v15.6 (Sphere, Cube, Square Prism, Six-Pointed Star Prism, Arrow Prism, And Cylinder and the respective volumes at 45° of axis deviation (_45)) in 1, 3, 5, 7, and 10 cm side or diameter each. Post-processing drawing tools to smooth those first-generated volumes were applied in different options (2D-ALL vs 3D) and grades (1, 3, 5, 10, 15, and 20). These volumetric transformations were analyzed by comparing different parameters: volume changes, center of mass, and DICE similarity coefficient index. Then we studied how smoothing affected two different volumes in a head and neck cancer patient: a single rounded node and the volume delineating cervical nodal areas.

RESULTS

No changes in data were found between 2D-ALL or 3D smoothing. Minimum deviations were found (range from 0 to 0.45 cm) in the center of mass. Volumes and the DICE index decreased as the degree of smoothing increased. Some discrepancies were found, especially in figures with cleft and spikes that behave differently. In the clinical case, smoothing should be applied only once throughout the target delineation process, preferably in the largest volume (PTV) to minimize errors.

CONCLUSION

Smoothing is a good tool to reduce artifacts due to the manual delineation of radiotherapy volumes. The resulting volumes must be always carefully reviewed.

Involved-site Radiotherapy Delineation Dilemmas in the Treatment of Adult Hodgkin Lymphoma: Turkish Society for Radiation Oncology Hematological Oncology, Pediatric Oncology and TBI Study Group Case-based Questionnaire Review (TROD 03-005)

AIMS

The International Lymphoma Radiation Oncology Group (ILROG) defined involved-site radiotherapy (ISRT) guidelines. These rules offer a certain variability that allows for autonomous decision-making in diverse clinical settings. However, this flexibility also gives rise to conflicts about the selection of treatment fields in the daily decision-making process. The aim of this study was to show the extent of interobserver variability when ILROG-ISRT recommendations were used in different clinical scenarios.

MATERIALS AND METHODS

The 10-question survey used in our study consisted of two parts (part A and part B) and was prepared by four senior radiation oncologists experienced in the haemato-oncology field. The results were presented by stratifying according to clinical experience (<10 years, ≥10 years). Binomial tests (one-sided) were conducted to assess whether answers for each group and the whole group reached a consensus.

RESULTS

Twenty-six radiation oncologists, 13 of whom had less than 10 years of experience and 13 seniors, participated in the survey. Eighty per cent of respondents thought ILROG did not bring sufficient solutions for all clinical scenarios but offered solutions in some cases. In different case-based scenarios, the consensus among the respondents decreased down to 38%. Senior radiation oncologists were found to have more doubts about the adequacy of current guidelines.

CONCLUSIONS

ILROG guidelines allow for a high degree of variability in real-life clinical scenarios and different interpretation of the recommendations may lead to increased toxicity and recurrences. Therefore, there is a need for refinement in ISRT delineation strategies. On behalf of the Turkish Society for Radiation Oncology Hematological Oncology, Pediatric Oncology and TBI Study Group, we are planning to carry out further educational contouring sessions to detect the interobserver variability in real-life contouring cases.

Internal Guidelines for Reducing Lymph Node Contour Variability in Total Marrow and Lymph Node Irradiation

BACKGROUND

The total marrow and lymph node irradiation (TMLI) target includes the bones, spleen, and lymph node chains, with the latter being the most challenging structures to contour. We evaluated the impact of introducing internal contour guidelines to reduce the inter- and intraobserver lymph node delineation variability in TMLI treatments.

METHODS

A total of 10 patients were randomly selected from our database of 104 TMLI patients so as to evaluate the guidelines' efficacy. The lymph node clinical target volume (CTV_LN) was recontoured according to the guidelines (CTV_LN_GL_RO1) and compared to the historical guidelines (CTV_LN_Old). Both topological (i.e., Dice similarity coefficient (DSC)) and dosimetric (i.e., V95 (the volume receiving 95% of the prescription dose) metrics were calculated for all paired contours.

RESULTS

The mean DSCs were 0.82 ± 0.09, 0.97 ± 0.01, and 0.98 ± 0.02, respectively, for CTV_LN_Old vs. CTV_LN_GL_RO1, and between the inter- and intraobserver contours following the guidelines. Correspondingly, the mean CTV_LN-V95 dose differences were 4.8 ± 4.7%, 0.03 ± 0.5%, and 0.1 ± 0.1%.

CONCLUSIONS

The guidelines reduced the CTV_LN contour variability. The high target coverage agreement revealed that historical CTV-to-planning-target-volume margins were safe, even if a relatively low DSC was observed.

The role of motion management and position verification in lymphoma radiotherapy

In the last decades, the substantial technical progress in radiation oncology offered the opportunity for more accurate planning and delivery of treatment. At the same time, the evolution of systemic treatment and the advent of modern diagnostic tools allowed for more accurate staging and consequently a safe reduction of radiotherapy (RT) target volumes and RT doses in the treatment of lymphomas. As a result, incidental irradiation of organs at risk was reduced, with a consequent reduction of severe late toxicity in long-term lymphoma survivors. Nevertheless, these innovations warrant that professionals pay attention to concurrently ensure precise planning and dose delivery to the target volume and safe sparing of the organs at risk. In particular, target and organ motion should be carefully managed in order to prevent any compromise of treatment efficacy. Several aspects should be taken into account during the treatment pathway to minimise uncertainties and to apply a valuable motion management strategy, when needed. These include: reliable image registration between diagnostic and planning radiologic exams to facilitate the contouring process, image guidance to limit positioning uncertainties and to ensure the accuracy of dose delivery and management of lung motion through procedures of respiratory gating and breath control. In this review, we will cover the current clinical approaches to minimise these uncertainties in patients treated with modern RT techniques, with a particular focus on mediastinal lymphoma. In addition, since uncertainties have a different impact on the dose deposition of protons compared to conventional x-rays, the role of motion management and position verification in proton beam therapy (PBT) will be discussed in a separate section.

A rapid review of influential factors and appraised solutions on organ delineation uncertainties reduction in radiotherapy

Background and purpose.Accurate volume delineation plays an essential role in radiotherapy. Contouring is a potential source of uncertainties in radiotherapy treatment planning that could affect treatment outcomes. Therefore, reducing the degree of contouring uncertainties is crucial. The role of utilized imaging modality in the organ delineation uncertainties has been investigated. This systematic review explores the influential factors on inter-and intra-observer uncertainties of target volume and organs at risk (OARs) delineation focusing on the used imaging modality for these uncertainties reduction and the reported subsequent histopathology and follow-up assessment.Methods and materials.An inclusive search strategy has been conducted to query the available online databases (Scopus, Google Scholar, PubMed, and Medline). 'Organ at risk', 'target', 'delineation', 'uncertainties', 'radiotherapy' and their relevant terms were utilized using every database searching syntax. Final article extraction was performed following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guideline. Included studies were limited to the ones published in English between 1995 and 2020 and that just deal with computed tomography (CT) and magnetic resonance imaging (MRI) modalities.Results.A total of 923 studies were screened and 78 were included of which 31 related to the prostate 20 to the breast, 18 to the head and neck, and 9 to the brain tumor site. 98% of the extracted studies performed volumetric analysis. Only 24% of the publications reported the dose deviations resulted from variation in volume delineation Also, heterogeneity in studied populations and reported geometric and volumetric parameters were identified such that quantitative synthesis was not appropriate.Conclusion.This review highlightes the inter- and intra-observer variations that could lead to contouring uncertainties and impede tumor control in radiotherapy. For improving volume delineation and reducing inter-observer variability, the implementation of well structured training programs, homogeneity in following consensus and guidelines, reliable ground truth selection, and proper imaging modality utilization could be clinically beneficial.

Primary Mediastinal B Cell Lymphoma in the Positron-Emission Tomography Era Executive Summary of the American Radium Society Appropriate Use Criteria

PURPOSE

Primary mediastinal B cell lymphoma (PMBCL) is a highly curable subtype of non-Hodgkin lymphoma that is diagnosed predominantly in adolescents and young adults. Consequently, long-term treatment-related morbidity is critical to consider when devising treatment strategies that include different chemoimmunotherapy strategies with or without radiation therapy. Furthermore, adaptive approaches using the end-of-chemotherapy (EOC) positron emission tomography (PET)/computed tomography (CT) scanning may help to determine which patients may benefit from additional therapies. We aimed to develop evidence-based guidelines for treating these patients.

METHODS AND MATERIALS

We conducted a systematic review in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guideline using the PubMed database. The ARS expert committee, composed of radiation oncologists, hematologists, and pediatric oncologists, developed consensus guidelines using the modified Delphi framework.

RESULTS

Nine studies met the full criteria for inclusion based on reporting outcomes on patients with primary mediastinal B cell lymphoma with EOC PET/CT response scored with the 5-point Deauville scale. These studies formed the evidence for these guidelines in managing patients with PMBCL according to the EOC PET response, including after a 5-point Deauville scale of 1 to 3, 4, or 5, and for patients with relapsed and refractory disease. The expert group also developed guidance on radiation simulation, treatment planning, and plan evaluation based on expert opinion.

CONCLUSIONS

Various treatment approaches exist in the management of PMBCL, including different chemoimmunotherapy regimens, the use of consolidative radiation therapy, and adaptive approaches based on EOC PET/CT response. These guidelines can be used by practitioners to provide appropriate treatment according to different disease scenarios.

Residual Site Radiotherapy After Immunochemotherapy in Primary Mediastinal B-Cell Lymphoma: A Monoinstitutional Retrospective Study

AIM

To evaluate the efficacy of residual site radiation therapy (RSRT) on local control (LC), progression-free (PFS) and overall (OS) survival in patients with primary mediastinal lymphoma (PMBCL), following rituximab and chemotherapy treatment (ICHT).

PATIENTS AND METHODS

The study included 34 patients with PMBCL treated between 2006 and 2014 with ICHT with/without autologous stem cell transplantation and RSRT. Between the end of ICHT/stem cell transplantation and RSRT, patients were evaluated with ¹⁸F-fluorodeoxyglucose positron-emission tomography. The gross tumor volume included morphological mediastinal residual disease after ICHT/SCT. The percentage of LC, PFS and OS were assessed.

RESULTS

All patients received RSRT with a median dose of 30 Gy. Median follow-up was 82 months. One patient out of 34 (3%) showed progressive disease 9 months from diagnosis. The 10-year PFS and OS were 97% and 97% respectively.

CONCLUSION

RSRT in patients with PMBCL treated with ICHT did not impact unfavorably on LC and patient survival.

The influence of the image registration method on the adaptive radiotherapy. A proof of the principle in a selected case of prostate IMRT

PURPOSE

To analyse the influence of the image registration method on the adaptive radiotherapy of an IMRT prostate treatment, and to compare the dose accumulation according to 3 different image registration methods with the planned dose.

MATERIAL AND METHODS

The IMRT prostate patient was CT imaged 3 times throughout his treatment. The prostate, PTV, rectum and bladder were segmented on each CT. A Rigid, a deformable (DIR) B-spline and a DIR with landmarks registration algorithms were employed. The difference between the accumulated doses and planned doses were evaluated by the gamma index. The Dice coefficient and Hausdorff distance was used to evaluate the overlap between volumes, to quantify the quality of the registration.

RESULTS

When comparing adaptive vs no adaptive RT, the gamma index calculation showed large differences depending on the image registration method (as much as 87.6% in the case of DIR B-spline). The quality of the registration was evaluated using an index such as the Dice coefficient. This showed that the best result was obtained with DIR with landmarks compared with the rest and it was always above 0.77, reported as a recommended minimum value for prostate studies in a multi-centre review.

CONCLUSIONS

Apart from showing the importance of the application of an adaptive RT protocol in a particular treatment, this work shows that the election of the registration method is decisive in the result of the adaptive radiotherapy and dose accumulation.

Interobserver delineation uncertainty in involved-node radiation therapy (INRT) for early-stage Hodgkin lymphoma: on behalf of the Radiotherapy Committee of the EORTC lymphoma group

BACKGROUND AND PURPOSE

In early-stage classical Hodgkin lymphoma (HL) the target volume nowadays consists of the volume of the originally involved nodes. Delineation of this volume on a post-chemotherapy CT-scan is challenging. We report on the interobserver variability in target volume definition and its impact on resulting treatment plans.

MATERIALS AND METHODS

Two representative cases were selected (1: male, stage IB, localization: left axilla; 2: female, stage IIB, localizations: mediastinum and bilateral neck). Eight experienced observers individually defined the clinical target volume (CTV) using involved-node radiotherapy (INRT) as defined by the EORTC-GELA guidelines for the H10 trial. A consensus contour was generated and the standard deviation computed. We investigated the overlap between observer and consensus contour [Sørensen-Dice coefficient (DSC)] and the magnitude of gross deviations between the surfaces of the observer and consensus contour (Hausdorff distance). 3D-conformal (3D-CRT) and intensity-modulated radiotherapy (IMRT) plans were calculated for each contour in order to investigate the impact of interobserver variability on each treatment modality. Similar target coverage was enforced for all plans.

RESULTS

The median CTV was 120 cm³ (IQR: 95-173 cm³) for Case 1, and 255 cm³ (IQR: 183-293 cm³) for Case 2. DSC values were generally high (>0.7), and Hausdorff distances were about 30 mm. The SDs between all observer contours, providing an estimate of the systematic error associated with delineation uncertainty, ranged from 1.9 to 3.8 mm (median: 3.2 mm). Variations in mean dose resulting from different observer contours were small and were not higher in IMRT plans than in 3D-CRT plans.

CONCLUSIONS

We observed considerable differences in target volume delineation, but the systematic delineation uncertainty of around 3 mm is comparable to that reported in other tumour sites. This report is a first step towards calculating an evidence-based planning target volume margin for INRT in HL.

Delineation of the larynx as organ at risk in radiotherapy: a contouring course within "Rete Oncologica Piemonte-Valle d'Aosta" network to reduce inter- and intraobserver variability

AIMS

To evaluate the usefulness of a contouring course in reducing inter- and intraobserver variability in the definition of the larynx as organ at risk (OAR).

METHODS

Within the "Rete Oncologica Piemonte-Valle d'Aosta" network, a contouring course focusing on larynx delineation was proposed. Twenty-six radiotherapist technicians (RTTs) experienced in delineating OARs were asked to contour larynx before and after the training. An expert radiation oncologist defined the reference volume for educational purpose. The contoured volumes obtained before and after the course were compared using descriptive statistics (mean value, standard deviation-SD, and coefficient of variation-COV) of volumes and maximum diameters. Conformity index (CI), dice coefficient (DC), and percentage of overlap were used to evaluate the spatial accuracy of the different volumes compared to the reference. Further analysis regarding the variation in the centre of mass (COM) displacement was performed.

RESULTS

The mean volume was 40.4 cm³ before and 65.9 cm³ after the course, approaching the reference value. Mean anteroposterior, laterolateral, and craniocaudal diameters improved, getting each closer to the reference. Moreover, the COM moved approaching reference coordinates. Mean percentage of intersection and DC strongly increased after the course, rising from 57.76 to 93.83 % and from 0.68 to 0.89, respectively. CI enhanced from 0.06 to 0.31.

CONCLUSIONS

This study shows an improvement in larynx definition after the contouring course with lower interobserver variability and major consistency compared to the reference volume. Other specific educational activities may further increase the quality of radiation therapy contouring in this setting.