Impact of Peer Review in Reducing Uncertainty in the Definition of the Lung Target Volume Among Trainee Oncologists

Interobserver variability in target definition for stereotactic arrhythmia radioablation

Background

Stereotactic arrhythmia radioablation (STAR) is a potential new therapy for patients with refractory ventricular tachycardia (VT). The arrhythmogenic substrate (target) is synthesized from clinical and electro-anatomical information. This study was designed to evaluate the baseline interobserver variability in target delineation for STAR.

Methods

Delineation software designed for research purposes was used. The study was split into three phases. Firstly, electrophysiologists delineated a well-defined structure in three patients (spinal canal). Secondly, observers delineated the VT-target in three patients based on case descriptions. To evaluate baseline performance, a basic workflow approach was used, no advanced techniques were allowed. Thirdly, observers delineated three predefined segments from the 17-segment model. Interobserver variability was evaluated by assessing volumes, variation in distance to the median volume expressed by the root-mean-square of the standard deviation (RMS-SD) over the target volume, and the Dice-coefficient.

Results

Ten electrophysiologists completed the study. For the first phase interobserver variability was low as indicated by low variation in distance to the median volume (RMS-SD range: 0.02-0.02 cm) and high Dice-coefficients (mean: 0.97 ± 0.01). In the second phase distance to the median volume was large (RMS-SD range: 0.52-1.02 cm) and the Dice-coefficients low (mean: 0.40 ± 0.15). In the third phase, similar results were observed (RMS-SD range: 0.51-1.55 cm, Dice-coefficient mean: 0.31 ± 0.21).

Conclusions

Interobserver variability is high for manual delineation of the VT-target and ventricular segments. This evaluation of the baseline observer variation shows that there is a need for methods and tools to improve variability and allows for future comparison of interventions aiming to reduce observer variation, for STAR but possibly also for catheter ablation.