Report from the Radiation Therapy Committee of the Southwest Oncology Group (SWOG): Research Objectives Workshop 2008

An in-silico quality assurance study of contouring target volumes in thoracic tumors within a cooperative group setting

•

We aimed at quantifying inter-observer Pancoast tumors delineation variability.

•

Experts’ delineations were used to define ground truth.

•

Other observers’ delineations were compared against ground truth.

•

High degree of variability was noted for most target volumes except GTV_P.

•

This unveils potentials for protocol modification for future IMRT studies.

Introduction

Target delineation variability is a significant technical impediment in multi-institutional trials which employ intensity modulated radiotherapy (IMRT), as there is a real potential for clinically meaningful variances that can impact the outcomes in clinical trials. The goal of this study is to determine the variability of target delineation among participants from different institutions as part of Southwest Oncology Group (SWOG) Radiotherapy Committee’s multi-institutional in-silico quality assurance study in patients with Pancoast tumors as a “dry run” for trial implementation.

Methods

CT simulation scans were acquired from four patients with Pancoast tumor. Two patients had simulation 4D-CT and FDG-FDG PET-CT while two patients had 3D-CT and FDG-FDG PET-CT. Seventeen SWOG-affiliated physicians independently delineated target volumes defined as gross primary and nodal tumor volumes (GTV_P & GTV_N), clinical target volume (CTV), and planning target volume (PTV).

Six board-certified thoracic radiation oncologists were designated as the ‘Experts’ for this study. Their delineations were used to create a simultaneous truth and performance level estimation (STAPLE) contours using ADMIRE software (Elekta AB, Sweden 2017). Individual participants’ contours were then compared with Experts’ STAPLE contours.

Results

When compared to the Experts’ STAPLE, GTV_P had the best agreement among all participants, while GTV_N showed the lowest agreement among all participants. There were no statistically significant differences in all studied parameters for all TVs for cases with 4D-CT versus cases with 3D-CT simulation scans.

Conclusions

High degree of inter-observer variation was noted for all target volume except for GTV_P, unveiling potentials for protocol modification for subsequent clinically meaningful improvement in target definition. Various similarity indices exist that can be used to guide multi-institutional radiotherapy delineation QA credentialing.

Report from the SWOG Radiation Oncology Committee: Research Objectives Workshop 2017

The Radiation Therapy Committee of SWOG periodically evaluates its strategic plan in an effort to maintain a current and relevant scientific focus, and to provide a standard platform for future development of protocol concepts. Participants in the 2017 Strategic Planning Workshop included leaders in cancer basic sciences, molecular theragnostics, pharmaceutical and technology industries, clinical trial design, oncology practice, and statistical analysis. The committee discussed high-priority research areas, such as optimization of combined modality therapy, radiation oncology-specific drug design, identification of molecular profiles predictive of radiation-induced local or distant tumor responses, and methods for normal tissue-specific mitigation of radiation toxicity. The following concepts emerged as dominant questions ready for national testing: (i) what is the role of radiotherapy in the treatment of oligometastatic, oligorecurrent, and oligoprogressive disease? (ii) How can combined modality therapy be used to enhance systemic and local response? (iii) Can we validate and optimize liquid biopsy and other biomarkers (such as novel imaging) to supplement current response criteria to guide therapy and clinical trial design endpoints? (iv) How can we overcome deficiencies of randomized survival endpoint trials in an era of increasing molecular stratification factors? And (v) how can we mitigate treatment-related side effects and maximize quality of life in cancer survivors? The committee concluded that many aspects of these questions are ready for clinical evaluation and example protocol concepts are provided that could improve rates of cancer cure and quality of survival. Clin Cancer Res; 24(15); 3500-9. ©2018 AACR.

Targeting the epigenetics of the DNA damage response in breast cancer

Cancer is as much an epigenetic disease as it is a genetic disease, and epigenetic alterations in cancer often serve as potent surrogates for genetic mutations. Because the epigenetic factors involved in the DNA damage response are regulated by multiple elements, therapies to target specific components of the epigenetic machinery can be inefficient. In contrast, therapies aimed at inhibiting the methionine cycle can indirectly inhibit both DNA and protein methylation, and the wide variety of genes and pathways that are affected by these methylations make this global strategy very attractive. In the present study, we propose an adjuvant therapy that targets the epigenetics of the DNA damage response in breast cancer cells and that results in efficient apoptosis and a reduction in distant metastases in vivo. We observed that a combined therapy designed to uncouple adenosine metabolism using dipyridamole in the presence of a new synthetic antifolate, 3-O-(3,4,5-trimethoxybenzoyl)-(-)-catechin, simultaneously and efficiently blocked both the folic cycle and the methionine cycle in breast cancer cells and sensitized these cells to radiotherapy. The treatment impeded the recruitment of 53BP1 and BRCA1 to the chromatin regions flanking DNA double-strand breaks and thereby avoided the DNA damage responses in breast cancer cells that were exposed to ionizing radiation. In addition, this hypomethylating therapy was also efficient in reducing the self-renewal capability of breast cancer-initiating cells and induced reversion of mesenchymal phenotypes in breast cancer cells.

Development of a software for quantitative evaluation radiotherapy target and organ-at-risk segmentation comparison

Modern radiotherapy requires accurate region of interest (ROI) inputs for plan optimization and delivery. Target delineation, however, remains operator-dependent and potentially serves as a major source of treatment delivery error. In order to optimize this critical, yet observer-driven process, a flexible web-based platform for individual and cooperative target delineation analysis and instruction was developed in order to meet the following unmet needs: (1) an open-source/open-access platform for automated/semiautomated quantitative interobserver and intraobserver ROI analysis and comparison, (2) a real-time interface for radiation oncology trainee online self-education in ROI definition, and (3) a source for pilot data to develop and validate quality metrics for institutional and cooperative group quality assurance efforts. The resultant software, Target Contour Testing/Instructional Computer Software (TaCTICS), developed using Ruby on Rails, has since been implemented and proven flexible, feasible, and useful in several distinct analytical and research applications.

Prospective assessment of an atlas-based intervention combined with real-time software feedback in contouring lymph node levels and organs-at-risk in the head and neck: Quantitative assessment of conformance to expert delineation

PURPOSE

A number of studies have previously assessed the role of teaching interventions to improve organ-at-risk (OAR) delineation. We present a preliminary study demonstrating the benefit of a combined atlas and real time software-based feedback intervention to aid in contouring of OARs in the head and neck.

METHODS AND MATERIALS

The study consisted of a baseline evaluation, a real-time feedback intervention, atlas presentation, and a follow-up evaluation. At baseline evaluation, 8 resident observers contoured 26 OARs on a computed tomography scan without intervention or aid. They then received feedback comparing their contours both statistically and graphically to a set of atlas-based expert contours. Additionally, they received access to an atlas to contour these structures. The resident observers were then asked to contour the same 26 OARs on a separate computed tomography scan with atlas access. In addition, 6 experts (5 radiation oncologists specializing in the head and neck, and 1 neuroradiologist) contoured the 26 OARs on both scans. A simultaneous truth and performance level estimation (STAPLE) composite of the expert contours was used as a gold-standard set for analysis of OAR contouring.

RESULTS

Of the 8 resident observers who initially participated in the study, 7 completed both phases of the study. Dice similarity coefficients were calculated for each user-drawn structure relative to the expert STAPLE composite for each structure. Mean dice similarity coefficients across all structures increased between phase 1 and phase 2 for each resident observer, demonstrating a statistically significant improvement in overall OAR-contouring ability (P < .01). Additionally, intervention improved contouring in 16/26 delineated organs-at-risk across resident observers at a statistically significant level (P ≤ .05) including all otic structures and suprahyoid lymph node levels of the head and neck.

CONCLUSIONS

Our data suggest that a combined atlas and real-time feedback-based educational intervention detectably improves contouring of OARs in the head and neck.

A pilot prospective feasibility study of organ-at-risk definition using Target Contour Testing/Instructional Computer Software (TaCTICS), a training and evaluation platform for radiotherapy target delineation

Target volume delineation is a critical, but time-consuming step in the creation of radiation therapy plans used in the treatment of many types of cancer. However, variability in target volume definitions can introduce substantial differences in resulting doses to tumors and critical structures. We developed TaCTICS, a web-based educational training software application targeted towards non-expert users. We report on a small, prospective study to evaluate the utility of this online tool in improving conformance of regions-of-interest (ROIs) with a reference set. Eight residents contoured a set of structures for a head-and-neck cancer case. Subsequently, they were provided access to TaCTICS as well as contouring atlases to allow evaluation of their contours in reference to other users as well as reference ROIs. The residents then contoured a second case using these resources. Volume overlap metrics between the users showed a substantial improvement following the intervention. Additionally, 66% of users reported that they found TaCTICS to be a useful educational tool and all participants reported they would like to use TaCTICS to track their contouring skills over the course of their residency.