Interobserver variability in target volume delineation in definitive radiotherapy for thoracic esophageal cancer: a multi-center study from China

Contouring aid tools in radiotherapy. Smoothing: the false friend

OBJECTIVE

Contouring accuracy is critical in modern radiotherapy. Several tools are available to assist clinicians in this task. This study aims to evaluate the performance of the smoothing tool in the ARIA system to obtain more consistent volumes.

METHODS

Eleven different geometric shapes were delineated in ARIA v15.6 (Sphere, Cube, Square Prism, Six-Pointed Star Prism, Arrow Prism, And Cylinder and the respective volumes at 45° of axis deviation (_45)) in 1, 3, 5, 7, and 10 cm side or diameter each. Post-processing drawing tools to smooth those first-generated volumes were applied in different options (2D-ALL vs 3D) and grades (1, 3, 5, 10, 15, and 20). These volumetric transformations were analyzed by comparing different parameters: volume changes, center of mass, and DICE similarity coefficient index. Then we studied how smoothing affected two different volumes in a head and neck cancer patient: a single rounded node and the volume delineating cervical nodal areas.

RESULTS

No changes in data were found between 2D-ALL or 3D smoothing. Minimum deviations were found (range from 0 to 0.45 cm) in the center of mass. Volumes and the DICE index decreased as the degree of smoothing increased. Some discrepancies were found, especially in figures with cleft and spikes that behave differently. In the clinical case, smoothing should be applied only once throughout the target delineation process, preferably in the largest volume (PTV) to minimize errors.

CONCLUSION

Smoothing is a good tool to reduce artifacts due to the manual delineation of radiotherapy volumes. The resulting volumes must be always carefully reviewed.

Deep Learning for Automatic Gross Tumor Volumes Contouring in Esophageal Cancer Based on Contrast-Enhanced Computed Tomography Images: A Multi-Institutional Study

PURPOSE

To develop and externally validate an automatic artificial intelligence (AI) tool for delineating gross tumor volume (GTV) in patients with esophageal squamous cell carcinoma (ESCC), which can assist in neo-adjuvant or radical radiation therapy treatment planning.

METHODS AND MATERIALS

In this multi-institutional study, contrast-enhanced CT images from 580 eligible ESCC patients were retrospectively collected. The GTV contours delineated by 2 experts via consensus were used as ground truth. A 3-dimensional deep learning model was developed for GTV contouring in the training cohort and internally and externally validated in 3 validation cohorts. The AI tool was compared against 12 board-certified experts in 25 patients randomly selected from the external validation cohort to evaluate its assistance in improving contouring performance and reducing variation. Contouring performance was measured using dice similarity coefficient (DSC) and average surface distance. Additionally, our previously established radiomics model for predicting pathologic complete response was used to compare AI-generated and ground truth contours, to assess the potential of the AI contouring tool in radiomics analysis.

RESULTS

The AI tool demonstrated good GTV contouring performance in multicenter validation cohorts, with median DSC values of 0.865, 0.876, and 0.866 and median average surface distance values of 0.939, 0.789, and 0.875 mm, respectively. Furthermore, the AI tool significantly improved contouring performance for half of 12 board-certified experts (DSC values, 0.794-0.835 vs 0.856-0.881, P = .003-0.048), reduced the intra- and interobserver variations by 37.4% and 55.2%, respectively, and saved contouring time by 77.6%. In the radiomics analysis, 88.7% of radiomic features from ground truth and AI-generated contours demonstrated stable reproducibility, and similar pathologic complete response prediction performance for these contours (P = .430) was observed.

CONCLUSIONS

Our AI contouring tool can improve GTV contouring performance and facilitate radiomics analysis in ESCC patients, which indicates its potential for GTV contouring during radiation therapy treatment planning and radiomics studies.

Fully-automated, CT-only GTV contouring for palliative head and neck radiotherapy

Planning for palliative radiotherapy is performed without the advantage of MR or PET imaging in many clinics. Here, we investigated CT-only GTV delineation for palliative treatment of head and neck cancer. Two multi-institutional datasets of palliative-intent treatment plans were retrospectively acquired: a set of 102 non-contrast-enhanced CTs and a set of 96 contrast-enhanced CTs. The nnU-Net auto-segmentation network was chosen for its strength in medical image segmentation, and five approaches separately trained: (1) heuristic-cropped, non-contrast images with a single GTV channel, (2) cropping around a manually-placed point in the tumor center for non-contrast images with a single GTV channel, (3) contrast-enhanced images with a single GTV channel, (4) contrast-enhanced images with separate primary and nodal GTV channels, and (5) contrast-enhanced images along with synthetic MR images with separate primary and nodal GTV channels. Median Dice similarity coefficient ranged from 0.6 to 0.7, surface Dice from 0.30 to 0.56, and 95th Hausdorff distance from 14.7 to 19.7 mm across the five approaches. Only surface Dice exhibited statistically-significant difference across these five approaches using a two-tailed Wilcoxon Rank-Sum test (p ≤ 0.05). Our CT-only results met or exceeded published values for head and neck GTV autocontouring using multi-modality images. However, significant edits would be necessary before clinical use in palliative radiotherapy.

Application of radiomics in adrenal incidentaloma: a literature review

Assessment of adrenal incidentaloma relies on imaging analysis and evaluation of adrenal function. Radiomics as a tool for quantitative image analysis is useful for evaluation of adrenal incidentaloma. In this review, we examined radiomic literature on adrenal incidentaloma including both adrenal functional assessment and structural differentiation of benign versus malignant adrenal tumors. In this review, we summarized the status of radiomic application on adrenal incidentaloma and suggested potential direction for future research.

Comparative evaluation of a prototype deep learning algorithm for autosegmentation of normal tissues in head and neck radiotherapy

PURPOSE

To introduce and validate a newly developed deep-learning (DL) auto-segmentation algorithm for head and neck (HN) organs at risk (OARs) and to compare its performance with a published commercial algorithm.

METHODS

A total of 864 HN cancer cases were available to train and evaluate a prototype algorithm. The algorithm is based on a fully convolutional network with combined U-Net and V-net. A Dice loss plus Cross-Entropy Loss function with Adam optimizer was used in training. For 75 validation cases, OAR sets were generated with three DL-based models (A: the prototype model trained with gold data, B: a commercial software trained with the same data, and C: the same software trained with data from another institution). The auto-segmented structures were evaluated with Dice similarity coefficient (DSC), Hausdorff distance (HD), voxel-penalty metric (VPM) and DSC of area under dose-volume histograms. A subjective qualitative evaluation was performed on 20 random cases.

RESULTS

Overall trend was for the prototype algorithm to be the closest to the gold data by all five metrics. The average DSC/VPM/HD for algorithms A, B, and C were 0.81/84.1/1.6 mm, 0.74/62.8/3.2 mm, and 0.66/46.8/3.3 mm, respectively. 93% of model A structures were evaluated to be clinically useful.

CONCLUSION

The superior performance of the prototype was validated, even when trained with the same data. In addition to the challenges of perfecting the algorithms, the auto-segmentation results can differ when the same algorithm is trained at different institutions.

Inter-Observer and Intra-Observer Variability in Gross Tumor Volume Delineation of Primary Esophageal Carcinomas Based on Different Combinations of Diagnostic Multimodal Images

Background and Purpose

This study aimed to investigate inter-/intra-observer delineation variability in GTVs of primary esophageal carcinomas (ECs) based on planning CT with reference to different combinations of diagnostic multimodal images from endoscopy/EUS, esophagography and FDG-PET/CT.

Materials and Methods

Fifty patients with pathologically proven thoracic EC who underwent diagnostic multimodal images before concurrent chemoradiotherapy were enrolled. Five radiation oncologist independently delineated the GTVs based on planning CT only (GTV_C), CT combined with endoscopy/EUS (GTV_CE), CT combined with endoscopy/EUS and esophagography (X-ray) (GTV_CEX), and CT combined with endoscopy/EUS, esophagography, and FDG-PET/CT (GTV_CEXP). The intra-/inter-observer variability in the volume, longitudinal length, generalized CI (CI_gen), and position of the GTVs were assessed.

Results

The intra-/inter-observer variability in the volume and longitudinal length of the GTVs showed no significant differences (p>0.05). The mean intra-observer CI_gen values for all observers was 0.73 ± 0.15. The mean inter-observer CI_gen values for the four multimodal image combinations was 0.67 ± 0.11. The inter-observer CI_gen for the four combined images was the largest, showing significant differences with those for the other three combinations. The intra-observer CI_gen among different observers and inter-observer CI_gen among different combinations of multimodal images showed significant differences (p<0.001). The intra-observer CI_gen for the senior radiotherapists was larger than that for the junior radiotherapists (p<0.001).

Conclusion

For radiation oncologists with advanced medical imaging training and clinical experience, using diagnostic multimodal images from endoscopy/EUS, esophagography, and FDG-PET/CT could reduce the intra-/inter-observer variability and increase the accuracy of target delineation in primary esophageal carcinomas.

Impact of Regional Lymph Node Irradiation on Reducing Lymph Node Recurrence in Esophageal Cancer Patients

BACKGROUND/AIM

To evaluate the preventive effects of regional lymph node irradiation on lymph node recurrence in esophageal cancer (EC).

PATIENTS AND METHODS

The study included 289 patients who received definitive radiotherapy for EC. The regional lymph node area of group 1 was determined as the area with the highest probability of lymph node metastasis and group 2 was determined as the area with the next highest probability of lymph node metastasis depending on the primary site of EC.

RESULTS

The patients in whom group 2 was completely included in the irradiated field had a significantly lower rate of recurrence of regional lymph node metastasis than those in whom group 2 was not or insufficiently included (p=0.0337). There was no significant difference in overall survival (p=0.4627) or disease-specific survival (p=0.6174) between the two groups.

CONCLUSION

Regional lymph node irradiation did not have survival-prolonging effects but significantly reduced regional lymph node recurrence.