Inter-observer variability of clinical target volume delineation for bladder cancer using CT and cone beam CT

Radiotherapy trial quality assurance processes: a systematic review

Quality assurance remains a neglected component of many trials, particularly for technical interventions, such as surgery and radiotherapy, for which quality of treatment is an important component in defining outcomes. We aimed to evaluate evidence for the processes used in radiotherapy quality assurance of clinical trials. A systematic review was undertaken focusing on use of a pre-trial outlining benchmark case and subsequent on-trial individual case reviews of outlining for recruited patients. These pre-trial and on-trial checks are used to ensure consistency and standardisation of treatment for each patient recruited to the trial by confirming protocol compliance. Non-adherence to the trial protocol has been shown to have a negative effect on trial outcomes. 29 studies published between January, 2000, and December, 2022, were identified that reported on either outlining benchmark case results or outlining individual case review results, or both. The trials identified varied in their use of radiotherapy quality assurance practices and reporting of outcomes was inconsistent. Deviations from trial protocols were frequent, particularly regarding outlining. Studies correlating benchmark case results with on-trial individual case reviews provided mixed results, meaning firm conclusions could not be drawn regarding the influence of the pre-trial benchmark case on subsequent on-trial performance. The optimal radiotherapy quality assurance processes were unclear, and there was little evidence available. Improved reporting of outcomes from radiotherapy quality assurance programmes is needed to develop an evidence base for the optimal approach to radiotherapy quality assurance in trials.

Clinical validation of an automatic atlas‐based segmentation tool for male pelvis CT images

Purpose

This retrospective work aims to evaluate the possible impact on intra‐ and inter‐observer variability, contouring time, and contour accuracy of introducing a pelvis computed tomography (CT) auto‐segmentation tool in radiotherapy planning workflow.

Methods

Tests were carried out on five structures (bladder, rectum, pelvic lymph‐nodes, and femoral heads) of six previously treated subjects, enrolling five radiation oncologists (ROs) to manually re‐contour and edit auto‐contours generated with a male pelvis CT atlas created with the commercial software MIM MAESTRO. The ROs first delineated manual contours (M). Then they modified the auto‐contours, producing automatic‐modified (AM) contours. The procedure was repeated to evaluate intra‐observer variability, producing M1, M2, AM1, and AM2 contour sets (each comprising 5 structures × 6 test patients × 5 ROs = 150 contours), for a total of 600 contours. Potential time savings was evaluated by comparing contouring and editing times. Structure contours were compared to a reference standard by means of Dice similarity coefficient (DSC) and mean distance to agreement (MDA), to assess intra‐ and inter‐observer variability. To exclude any automation bias, ROs evaluated both M and AM sets as “clinically acceptable” or “to be corrected” in a blind test.

Results

Comparing AM to M sets, a significant reduction of both inter‐observer variability (p < 0.001) and contouring time (‐45% whole pelvis, p < 0.001) was obtained. Intra‐observer variability reduction was significant only for bladder and femoral heads (p < 0.001). The statistical test showed no significant bias.

Conclusion

Our atlas‐based workflow proved to be effective for clinical practice as it can improve contour reproducibility and generate time savings. Based on these findings, institutions are encouraged to implement their auto‐segmentation method.

Improving radiation physics, tumor visualisation, and treatment quantification in radiotherapy with spectral or dual-energy CT

Over the past decade, spectral or dual‐energy CT has gained relevancy, especially in oncological radiology. Nonetheless, its use in the radiotherapy (RT) clinic remains limited. This review article aims to give an overview of the current state of spectral CT and to explore opportunities for applications in RT.

In this article, three groups of benefits of spectral CT over conventional CT in RT are recognized. Firstly, spectral CT provides more information of physical properties of the body, which can improve dose calculation. Furthermore, it improves the visibility of tumors, for a wide variety of malignancies as well as organs‐at‐risk OARs, which could reduce treatment uncertainty. And finally, spectral CT provides quantitative physiological information, which can be used to personalize and quantify treatment.

Image-guided Adaptive Radiotherapy for Bladder Cancer

Technological advancement has facilitated patient-specific radiotherapy in bladder cancer. This has been made possible by developments in image-guided radiotherapy (IGRT). Particularly transformative has been the integration of volumetric imaging into the workflow. The ability to visualise the bladder target using cone beam computed tomography and magnetic resonance imaging initially assisted with determining the magnitude of inter- and intra-fraction target change. It has led to greater confidence in ascertaining true anatomy at each fraction. The increased certainty of dose delivered to the bladder has permitted the safe reduction of planning target volume margins. IGRT has therefore improved target coverage with a reduction in integral dose to the surrounding tissue. Use of IGRT to feed back into plan and dose delivery optimisation according to the anatomy of the day has enabled adaptive radiotherapy bladder solutions. Here we undertake a review of the stepwise developments underpinning IGRT and adaptive radiotherapy strategies for external beam bladder cancer radiotherapy. We present the evidence in accordance with the framework for systematic clinical evaluation of technical innovations in radiation oncology (R-IDEAL).

Deep learning vs. atlas-based models for fast auto-segmentation of the masticatory muscles on head and neck CT images

BACKGROUND

Impaired function of masticatory muscles will lead to trismus. Routine delineation of these muscles during planning may improve dose tracking and facilitate dose reduction resulting in decreased radiation-related trismus. This study aimed to compare a deep learning model with a commercial atlas-based model for fast auto-segmentation of the masticatory muscles on head and neck computed tomography (CT) images.

MATERIAL AND METHODS

Paired masseter (M), temporalis (T), medial and lateral pterygoid (MP, LP) muscles were manually segmented on 56 CT images. CT images were randomly divided into training (n = 27) and validation (n = 29) cohorts. Two methods were used for automatic delineation of masticatory muscles (MMs): Deep learning auto-segmentation (DLAS) and atlas-based auto-segmentation (ABAS). The automatic algorithms were evaluated using Dice similarity coefficient (DSC), recall, precision, Hausdorff distance (HD), HD95, and mean surface distance (MSD). A consolidated score was calculated by normalizing the metrics against interobserver variability and averaging over all patients. Differences in dose (∆Dose) to MMs for DLAS and ABAS segmentations were assessed. A paired t-test was used to compare the geometric and dosimetric difference between DLAS and ABAS methods.

RESULTS

DLAS outperformed ABAS in delineating all MMs (p < 0.05). The DLAS mean DSC for M, T, MP, and LP ranged from 0.83 ± 0.03 to 0.89 ± 0.02, the ABAS mean DSC ranged from 0.79 ± 0.05 to 0.85 ± 0.04. The mean value for recall, HD, HD95, MSD also improved with DLAS for auto-segmentation. Interobserver variation revealed the highest variability in DSC and MSD for both T and MP, and the highest scores were achieved for T by both automatic algorithms. With few exceptions, the mean ∆D98%, ∆D95%, ∆D50%, and ∆D2% for all structures were below 10% for DLAS and ABAS and had no detectable statistical difference (P > 0.05). DLAS based contours had dose endpoints more closely matched with that of the manually segmented when compared with ABAS.

CONCLUSIONS

DLAS auto-segmentation of masticatory muscles for the head and neck radiotherapy had improved segmentation accuracy compared with ABAS with no qualitative difference in dosimetric endpoints compared to manually segmented contours.

Role of deformable image registration for delivered dose accumulation of adaptive external beam radiation therapy and brachytherapy in cervical cancer

Purpose

Deformable image registration (DIR) can be used to accumulate the absorbed dose distribution of daily image-guided adaptive external beam radiation treatment (EBRT) and brachytherapy (BT). Since dose-volume parameter addition assumes a uniform delivered EBRT dose around the planned BT boost, the added value of DIR over direct addition was investigated for dose accumulation in bladder and rectum.

Material and methods

For 10 patients (EBRT 46/46.2 Gy_EQD2, EBRT + BT: D₉₀ 85-90 Gy_EQD2, in equivalent dose in 2 Gy fractions), the actually delivered dose from adaptive volumetric-modulated arc therapy (VMAT)/intensity-modulated radiotherapy (IMRT) EBRT was calculated using the daily anatomy from the cone-beam computed tomography (CBCT) scans acquired prior to irradiation. The CBCT of the first EBRT fraction and the BT planning MRI were registered using DIR. The cumulative dose to the 2 cm³ with the highest dose (D_2cm3) from EBRT and BT to the bladder and rectum was calculated and compared to direct addition assuming a uniform EBRT dose (UD).

Results

Differences (DIR-UD) in the total EBRT + BT dose ranged between –0.2-3.9 Gy_EQD2 (bladder) and –1.0-3.7 Gy_EQD2 (rectum). The total EBRT + BT dose calculated with DIR was at most 104% of the dose calculated with the UD method.

Conclusions

Differences between UD and DIR were small (< 3.9 Gy_EQD2). The dose delivered with adaptive VMAT/IMRT EBRT to bladder and rectum near the planned BT boost can be considered uniform for the evaluation of bladder/rectum D_2cm3.

Roles of Deformable Image Registration in adaptive RT: From contour propagation to dose monitoring

Adaptive radiation therapy (ART) is based on the optimization of the treatment plan during the treatment delivery to compensate for anatomical deformations. Deformable Image Registration (DIR) then constitutes a key step in order to analyze the huge amount of daily or weekly images to provide clinically usefull information. Two main applications of DIR have been developped in ART: delineation propagation and dose accumulation. If delineation propagation is well validated and transfered in the clinic, some challenges remain to address for dose accumulation. In this paper, we review the recent developments of DIR in ART, particularly in prostate and head-and-neck (H&N), with a focus on their evaluation.

Uncertainties in volume delineation in radiation oncology: A systematic review and recommendations for future studies

BACKGROUND AND PURPOSE

Volume delineation is a well-recognised potential source of error in radiotherapy. Whilst it is important to quantify the degree of interobserver variability (IOV) in volume delineation, the resulting impact on dosimetry and clinical outcomes is a more relevant endpoint. We performed a literature review of studies evaluating IOV in target volume and organ-at-risk (OAR) delineation in order to analyse these with respect to the metrics used, reporting of dosimetric consequences, and use of statistical tests.

METHODS AND MATERIALS

Medline and Pubmed databases were queried for relevant articles using keywords. We included studies published in English between 2000 and 2014 with more than two observers.

RESULTS

119 studies were identified covering all major tumour sites. CTV (n=47) and GTV (n=38) were most commonly contoured. Median number of participants and data sets were 7 (3-50) and 9 (1-132) respectively. There was considerable heterogeneity in the use of metrics and methods of analysis. Statistical analysis of results was reported in 68% (n=81) and dosimetric consequences in 21% (n=25) of studies.

CONCLUSION

There is a lack of consistency in conducting and reporting analyses from IOV studies. We suggest a framework to use for future studies evaluating IOV.

Exploiting biological and physical determinants of radiotherapy toxicity to individualize treatment

The recent advances in radiation delivery can improve tumour control probability (TCP) and reduce treatment-related toxicity. The use of intensity-modulated radiotherapy (IMRT) in particular can reduce normal tissue toxicity, an objective in its own right, and can allow safe dose escalation in selected cases. Ideally, IMRT should be combined with image guidance to verify the position of the target, since patients, target and organs at risk can move day to day. Daily image guidance scans can be used to identify the position of normal tissue structures and potentially to compute the daily delivered dose. Fundamentally, it is still the tolerance of the normal tissues that limits radiotherapy (RT) dose and therefore tumour control. However, the dose-response relationships for both tumour and normal tissues are relatively steep, meaning that small dose differences can translate into clinically relevant improvements. Differences exist between individuals in the severity of toxicity experienced for a given dose of RT. Some of this difference may be the result of differences between the planned dose and the accumulated dose (DA). However, some may be owing to intrinsic differences in radiosensitivity of the normal tissues between individuals. This field has been developing rapidly, with the demonstration of definite associations between genetic polymorphisms and variation in toxicity recently described. It might be possible to identify more resistant patients who would be suitable for dose escalation, as well as more sensitive patients for whom toxicity could be reduced or avoided. Daily differences in delivered dose have been investigated within the VoxTox research programme, using the rectum as an example organ at risk. In patients with prostate cancer receiving curative RT, considerable daily variation in rectal position and dose can be demonstrated, although the median position matches the planning scan well. Overall, in 10 patients, the mean difference between planned and accumulated rectal equivalent uniform doses was -2.7 Gy (5%), and a dose reduction was seen in 7 of the 10 cases. If dose escalation was performed to take rectal dose back to the planned level, this should increase the mean TCP (as biochemical progression-free survival) by 5%. Combining radiogenomics with individual estimates of DA might identify almost half of patients undergoing radical RT who might benefit from either dose escalation, suggesting improved tumour cure or reduced toxicity or both.

The effect of prophylactic percutaneous endoscopic gastrostomy (PEG) tube placement on swallowing and swallow-related outcomes in patients undergoing radiotherapy for head and neck cancer: a systematic review

Patients undergoing radiotherapy for head and neck cancer (HNC) often experience malnutrition and dehydration during treatment. As a result, some centres place PEG tubes prophylactically (pPEG) to prevent these negative consequences. However, recent research has suggested that pPEG use may negatively affect swallowing physiology, function and/or quality of life, especially in the long term. The purpose of this study was to systematically review the literature on pPEG use in HNC patients undergoing radiotherapy and to determine its impact on swallowing-related outcomes. The following electronic databases were searched for all relevant primary research published through February 24, 2014: AMED, CINAHL, the Cochrane Library, Embase, Healthstar, Medline, and PsycINFO. Main search terms included HNC, radiotherapy, deglutition disorders, feeding tube(s), and prophylactic or elective. References for all accepted papers were hand searched to identify additional relevant research. Methodological quality was assessed using Cochrane's Risk of Bias. At all levels, two blinded raters provided judgments. Discrepancies were resolved by consensus. The search retrieved 181 unique citations. Twenty studies met our inclusion criteria. Quality assessment revealed that all studies were at risk for bias due to non-randomized sampling and unreported or inadequate blinding. Ten studies demonstrated selection bias with significant baseline differences between pPEG patients and controls. Results regarding the frequency and severity of dysphagia and swallowing-related outcomes were varied and inconclusive. The impact of pPEG use on swallowing and swallowing-related outcomes remains unclear. Well-controlled, randomized trials are needed to determine if pPEG places patients at greater risk for developing long-term dysphagia.

Random variation in rectal position during radiotherapy for prostate cancer is two to three times greater than that predicted from prostate motion

Objective:

Radiotherapy for prostate cancer does not explicitly take into account daily variation in the position of the rectum. It is important to accurately assess accumulated dose (D_A) to the rectum in order to understand the relationship between dose and toxicity. The primary objective of this work was to quantify systematic (Σ) and random (σ) variation in the position of the rectum during a course of prostate radiotherapy.

Methods:

The rectum was manually outlined on the kilo-voltage planning scan and 37 daily mega-voltage image guidance scans for 10 participants recruited to the VoxTox study. The femoral heads were used to produce a fixed point to which all rectal contours were referenced.

Results:

Σ [standard deviation (SD) of means] between planning and treatment was 4.2 mm in the anteroposterior (AP) direction and 1.3 mm left–right (LR). σ (root mean square of SDs) was 5.2 mm AP and 2.7 mm LR. Superior–inferior variation was less than one slice above and below the planning position.

Conclusion:

Our results for Σ are in line with published data for prostate motion. σ, however, was approximately twice as great as that seen for prostate motion. This suggests that D_A may differ from planned dose in some patients treated with radiotherapy for prostate cancer.

Advances in knowledge:

This work is the first to use daily imaging to quantify Σ and σ of the rectum in prostate cancer. σ was found to be greater than published data, providing strong rationale for further investigation of individual D_A.

Surface-constrained nonrigid registration for dose monitoring in prostate cancer radiotherapy

This paper addresses the issue of cumulative dose estimation from cone beam computed tomography (CBCT) images in prostate cancer radiotherapy. It focuses on the dose received by the surfaces of the main organs at risk, namely the bladder and rectum. We have proposed both a surface-constrained dose accumulation approach and its extensive evaluation. Our approach relied on the nonrigid registration (NRR) of daily acquired CBCT images on the planning CT image. This proposed NRR method was based on a Demons-like algorithm, implemented in combination with mutual information metric. It allowed for different levels of geometrical constraints to be considered, ensuring a better point to point correspondence, especially when large deformations occurred, or in high dose gradient areas. The three following implementations: 1) full iconic NRR; 2) iconic NRR constrained with landmarks (LCNRR); 3) NRR constrained with full delineation of organs (DBNRR). To obtain reference data, we designed a numerical phantom based on finite-element modeling and image simulation. The methods were assessed on both the numerical phantom and real patient data in order to quantify uncertainties in terms of dose accumulation. The LCNRR method appeared to constitute a good compromise for dose monitoring in clinical practice.

Evaluation of inter-observer variability of bladder boundary delineation on cone-beam CT

Background

In-room cone-beam computerized tomography (CBCT) imaging is a promising method to reduce setup errors, especially in organs such as the bladder that often have large intrafractional variations due to organ movement. CBCT image quality is limited by low contrast and imaging artifacts, but few data have been reported about inter-observer variability of bladder boundary delineation on CBCT. The aim of this work was to analyze and evaluate the inter-observer contouring uncertainties of bladder boundary delineation on CBCT images in a prospective fashion.

Methods

Five radiation oncologists contoured 10 bladders using the CBCT datasets of consecutive 10 patients (including 4 females) who were irradiated to the pelvic region. Prostates were also contoured in male patients. Patients who had had prostatectomy were excluded. The coefficient of variation (COV), conformity index (CI_gen), and coordinates of center-of-mass (COM) of the bladder and prostate were calculated for each patient.

Results

The mean COV for the bladder and prostate was 0.08 and 0.20, respectively. The mean CI_gen of the bladder and prostate was 0.81 and 0.66, respectively. The root mean square (RMS) of the inter-observer standard deviation (σ) of the COM displacement in the left-right (LR) and anterior-posterior (AP) direction was 0.79, 0.87 and 0.54 for the bladder and 0.63, 0.99 and 1.72 for the prostate. Regarding the mean COV and CI_gen for the bladder, the differences between males and females were not significant.

Conclusions

Inter-observer variability for bladder delineation on CBCT images was substantially small regardless of gender. We believe that our results support the applicability of CBCT in adaptive radiotherapy for bladder cancer.

Comparison of adaptive radiotherapy techniques for the treatment of bladder cancer

OBJECTIVE

Day-to-day anatomical variations complicate bladder cancer radiotherapy treatment. This work quantifies the impact on target coverage and irradiated normal tissue volume for different adaptive strategies.

METHODS

20 patients were retrospectively planned using different three-dimensional conformal radiotherapy treatment strategies for whole-bladder carcinoma: (i) "conventional" treatment used isotropic expansion of the clinical target volume (CTV) by 15 mm to the planning target volume (PTV) for daily treatment; (ii) "plan of the day" used daily volumetric on-treatment imaging [cone beam CT (CBCT)] to select from four available plans with varying superior PTV margins; (iii) "composite" strategies used on-treatment CBCTs from Fractions 1-3 to inform a composite CTV and adapted PTV (5- and 10-mm margins for composite 1 and composite 2, respectively) for subsequent treatment. Target coverage was evaluated from available CBCTs (the first three fractions then the minimum weekly thereafter), and the reduction in the irradiated volume (i.e. within the 95% isodose) was quantified.

RESULTS

Plan of the day improved target coverage (i.e. all of the bladder within the 95% isodose throughout the treatment) relative to conventional treatment (p=0.10), while no such benefit was observed with composite 2. Target coverage was reduced with composite 1 relative to conventional treatment. The mean irradiated volume was reduced by 17.2%, 35.0% and 14.6% relative to conventional treatment, for plan of the day, composite 1 and composite 2, respectively (p<0.01 in all cases). No parameters predictive of large changes in bladder volume later in the treatment were identified.

CONCLUSIONS

Adaptive techniques can maintain or improve target coverage while allowing for reduced irradiated volume and possibly reduced toxicity. The plan-of-the-day technique appeared to provide the optimal balance between target coverage and normal tissue sparing.

ADVANCES IN KNOWLEDGE

This study suggests that plan-of-the-day techniques will provide optimal outcomes for adaptive bladder radiotherapy.

The effect of delineation method and observer variability on bladder dose-volume histograms for prostate intensity modulated radiotherapy

PURPOSE

To quantify the effect of delineation method on bladder DVH, observer variability (OV) and contouring time for prostate IMRT plans.

MATERIALS AND METHODS

Planning CT scans and IMRT plans of 30 prostate cancer patients were anonymized. For 20 patients, 1 observer delineated the bladder using 9 methods. The effect of delineation method on the DVH curve, discrete dose levels and delineation time was quantified. For the 10 remaining CTs, 6 observers delineated bladder wall using 4 methods. Observer-based volume variation and intraclass correlation coefficient (ICC) were used to describe the dosimetric effects of OV.

RESULTS

Manual delineation of the bladder wall (BW_m) was significantly slower than any other method (mean: 20 min vs. ≤ 13 min) and the dosimetric effect of OV was significantly larger (V70 Gy ICC: 0.78 vs. 0.98). Only volumes created using a 2.5mm contraction from the outer surface, and a method providing a consistent wall volume, showed no notable dosimetric differences from BW_m in both absolute and relative volume.

CONCLUSIONS

Automatic contractions from the outer surface provide quicker, more reproducible and reasonably accurate substitutes for BW_m. The widespread use of automatic contractions to create a bladder wall volume would assist in the consistent application of IMRT dose constraints and the interpretation of reported dose.

Inter- and intra-observer variability in contouring of the prostate gland on planning computed tomography and cone beam computed tomography

PURPOSE

To investigate inter-/intra-observer variability in defining the prostate by use of planning computed tomography (PCT) and cone beam CT (CBCT) with magnetic resonance image (MRI) as guidance prior to the introduction of an adaptive radiotherapy for prostate cancer.

MATERIAL AND METHODS

We reviewed PCT and firstly acquired CBCT datasets of each ten patients with prostate cancer. Three physicians independently delineated the prostate based on PCT and CBCT with MRI as guidance, allowing determination of inter-physician variability. Two physicians repeated prostate contouring three times in total to investigate intra-physician variability. We compared delineated prostate volumes in terms of the generalized conformity index (CI(gen)), maximum variation ratio (MVR), and center of mass (COM).

RESULTS

There were no significant inter-/intra-observer differences in the estimation of prostate volume on both PCT and CBCT. For both inter- and intra-observer variability in contouring the prostate gland, there were no significant differences in MVR between PCT and CBCT. The CI(gen) for inter-observer variability was 0.74 by PCT and 0.69 by CBCT. The CI(gen) for intra-observer variability on PCT and CBCT was 0.84 and 0.81 for observer 2 and 0.76 and 0.73 for observer 3. COM analyses showed that the greatest inter-/intra-observer variability was in the measurement of the prostate apex and base. With respect to CI(gen) and COM analysis for the inter-observer variability, more precise delineation of the prostate was possible on PCT than CBCT. More precise contouring in terms of both CI(gen) and COM was demonstrated by observer 2 than observer 3.

CONCLUSIONS

Despite some ambiguity in apex and base level, there was a good consistency in delineating the gland on CBCT plus MRI-guided modification both among/within observer(s), without any significant difference from the consistency in defining the prostate on PCT. This study provides a framework for future studies of CBCT imaging of the prostate.