Longitudinal fan-beam computed tomography dataset for head-and-neck squamous cell carcinoma patients

A multicenter dataset for lymph node clinical target volume delineation of nasopharyngeal carcinoma

The deep learning (DL)-based prediction of accurate lymph node (LN) clinical target volumes (CTVs) for nasopharyngeal carcinoma (NPC) radiotherapy (RT) remains challenging. One of the main reasons is the variability of contours despite standardization processes by expert guidelines in combination with scarce data sharing in the community. Therefore, we retrospectively generated a 262-subjects dataset from four centers to develop the DL models for LN CTVs delineation. This dataset included 440 computed tomography images from different scanning phases, disease stages and treatment strategies. Three clinical expert boards, each comprising two experts (totalling six experts), manually delineated six basic LN CTVs on separate cohorts as the ground truth according to LN involvement and clinical requirements. Several state-of-the-art segmentation algorithms were evaluated on this benchmark, showing promising results for LN CTV segmentation. In conclusion, this work built a multicenter LN CTV segmentation dataset, which may be the first dataset for automatic LN CTV delineation development and evaluation, serving as a benchmark for future research.

MUsculo-Skeleton-Aware (MUSA) deep learning for anatomically guided head-and-neck CT deformable registration

Deep-learning-based deformable image registration (DL-DIR) has demonstrated improved accuracy compared to time-consuming non-DL methods across various anatomical sites. However, DL-DIR is still challenging in heterogeneous tissue regions with large deformation. In fact, several state-of-the-art DL-DIR methods fail to capture the large, anatomically plausible deformation when tested on head-and-neck computed tomography (CT) images. These results allude to the possibility that such complex head-and-neck deformation may be beyond the capacity of a single network structure or a homogeneous smoothness regularization. To address the challenge of combined multi-scale musculoskeletal motion and soft tissue deformation in the head-and-neck region, we propose a MUsculo-Skeleton-Aware (MUSA) framework to anatomically guide DL-DIR by leveraging the explicit multiresolution strategy and the inhomogeneous deformation constraints between the bony structures and soft tissue. The proposed method decomposes the complex deformation into a bulk posture change and residual fine deformation. It can accommodate both inter- and intra- subject registration. Our results show that the MUSA framework can consistently improve registration accuracy and, more importantly, the plausibility of deformation for various network architectures. The code will be publicly available at https://github.com/HengjieLiu/DIR-MUSA.

Artificial neural network-assisted prediction of radiobiological indices in head and neck cancer

Background and purpose

We proposed an artificial neural network model to predict radiobiological parameters for the head and neck squamous cell carcinoma patients treated with radiation therapy. The model uses the tumor specification, demographics, and radiation dose distribution to predict the tumor control probability and the normal tissue complications probability. These indices are crucial for the assessment and clinical management of cancer patients during treatment planning.

Methods

Two publicly available datasets of 31 and 215 head and neck squamous cell carcinoma patients treated with conformal radiation therapy were selected. The demographics, tumor specifications, and radiation therapy treatment parameters were extracted from the datasets used as inputs for the training of perceptron. Radiobiological indices are calculated by open-source software using dosevolume histograms from radiation therapy treatment plans. Those indices were used as output in the training of a single-layer neural network. The distribution of data used for training, validation, and testing purposes was 70, 15, and 15%, respectively.

Results

The best performance of the neural network was noted at epoch number 32 with the mean squared error of 0.0465. The accuracy of the prediction of radiobiological indices by the artificial neural network in training, validation, and test phases were determined to be 0.89, 0.87, and 0.82, respectively. We also found that the percentage volume of parotid inside the planning target volume is the significant parameter for the prediction of normal tissue complications probability.

Conclusion

We believe that the model has significant potential to predict radiobiological indices and help clinicians in treatment plan evaluation and treatment management of head and neck squamous cell carcinoma patients.

Segmentation of 71 Anatomical Structures Necessary for the Evaluation of Guideline-Conforming Clinical Target Volumes in Head and Neck Cancers

The delineation of the clinical target volumes (CTVs) for radiation therapy is time-consuming, requires intensive training and shows high inter-observer variability. Supervised deep-learning methods depend heavily on consistent training data; thus, State-of-the-Art research focuses on making CTV labels more homogeneous and strictly bounding them to current standards. International consensus expert guidelines standardize CTV delineation by conditioning the extension of the clinical target volume on the surrounding anatomical structures. Training strategies that directly follow the construction rules given in the expert guidelines or the possibility of quantifying the conformance of manually drawn contours to the guidelines are still missing. Seventy-one anatomical structures that are relevant to CTV delineation in head- and neck-cancer patients, according to the expert guidelines, were segmented on 104 computed tomography scans, to assess the possibility of automating their segmentation by State-of-the-Art deep learning methods. All 71 anatomical structures were subdivided into three subsets of non-overlapping structures, and a 3D nnU-Net model with five-fold cross-validation was trained for each subset, to automatically segment the structures on planning computed tomography scans. We report the DICE, Hausdorff distance and surface DICE for 71 + 5 anatomical structures, for most of which no previous segmentation accuracies have been reported. For those structures for which prediction values have been reported, our segmentation accuracy matched or exceeded the reported values. The predictions from our models were always better than those predicted by the TotalSegmentator. The sDICE with 2 mm margin was larger than 80% for almost all the structures. Individual structures with decreased segmentation accuracy are analyzed and discussed with respect to their impact on the CTV delineation following the expert guidelines. No deviation is expected to affect the rule-based automation of the CTV delineation.

Radiomics and dosiomics-based prediction of radiotherapy-induced xerostomia in head and neck cancer patients

BACKGROUND AND AIM

Dose-response modeling for radiotherapy-induced xerostomia in head and neck cancer (HN) patients is a promising frontier for personalized therapy. Feature extraction from diagnostic and therapeutic images (radiomics and dosiomics features) can be used for data-driven response modeling. The aim of this study is to develop xerostomia predictive models based on radiomics-dosiomics features.

METHODS

Data from the cancer imaging archive (TCIA) for 31 HN cancer patients were employed. For all patients, parotid CT radiomics features were extracted, utilizing Lasso regression for feature selection and multivariate modeling. The models were developed by selected features from pretreatment (CT1), mid-treatment (CT2), post-treatment (CT3), and delta features (ΔCT2-1, ΔCT3-1, ΔCT3-2). We also considered dosiomics features extracted from the parotid dose distribution images (Dose model). Thus, combination models of radio-dosiomics (CT + dose & ΔCT + dose) were developed. Moreover, clinical, and dose-volume histogram (DVH) models were built. Nested 10-fold cross-validation was used to assess the predictive classification of patients into those with and without xerostomia, and the area under the receiver operative characteristic curve (AUC) was used to compare the predictive power of the models. The sensitivity and accuracy of models also were obtained.

RESULTS

In total, 59 parotids were assessed, and 13 models were developed. Our results showed three models with AUC of 0.89 as most predictive, namely ΔCT2-1 + Dose (Sensitivity 0.99, Accuracy 0.94 & Specificity 0.86), CT3 model (Sensitivity 0.96, Accuracy 0.94 & Specificity 0.86) and DVH (Sensitivity 0.93, Accuracy 0.89 & Specificity 0.84). These models were followed by Clinical (AUC 0.89, Sensitivity 0.81, Accuracy 0.97 & Specificity 0.89) and CT2 & Dose (AUC 0.86, Sensitivity 0.97, Accuracy 0.87 & Specificity 0.82). The Dose model (developed by dosiomics features only) had AUC, Sensitivity, Specificity, and Accuracy of 0.72, 0.98, 0.33, and 0.79 respectively.

CONCLUSION

Quantitative features extracted from diagnostic imaging during and after radiotherapy alone or in combination with dosiomics markers obtained from dose distribution images can be used for radiotherapy response modeling, opening up prospects for personalization of therapies toward improved therapeutic outcomes.

Deformation driven Seq2Seq longitudinal tumor and organs-at-risk prediction for radiotherapy

PURPOSE

Radiotherapy presents unique challenges and clinical requirements for longitudinal tumor and organ-at-risk (OAR) prediction during treatment. The challenges include tumor inflammation/edema and radiation-induced changes in organ geometry, whereas the clinical requirements demand flexibility in input/output sequence timepoints to update the predictions on rolling basis and the grounding of all predictions in relationship to the pre-treatment imaging information for response and toxicity assessment in adaptive radiotherapy.

METHODS

To deal with the aforementioned challenges and to comply with the clinical requirements, we present a novel 3D sequence-to-sequence model based on Convolution Long Short-Term Memory (ConvLSTM) that makes use of series of deformation vector fields (DVFs) between individual timepoints and reference pre-treatment/planning CTs to predict future anatomical deformations and changes in gross tumor volume as well as critical OARs. High-quality DVF training data are created by employing hyper-parameter optimization on the subset of the training data with DICE coefficient and mutual information metric. We validated our model on two radiotherapy datasets: a publicly available head-and-neck dataset (28 patients with manually contoured pre-, mid-, and post-treatment CTs), and an internal non-small cell lung cancer dataset (63 patients with manually contoured planning CT and 6 weekly CBCTs).

RESULTS

The use of DVF representation and skip connections overcomes the blurring issue of ConvLSTM prediction with the traditional image representation. The mean and standard deviation of DICE for predictions of lung GTV at weeks 4, 5, and 6 were 0.83 ± 0.09, 0.82 ± 0.08, and 0.81 ± 0.10, respectively, and for post-treatment ipsilateral and contralateral parotids, were 0.81 ± 0.06 and 0.85 ± 0.02.

CONCLUSION

We presented a novel DVF-based Seq2Seq model for medical images, leveraging the complete 3D imaging information of a relatively large longitudinal clinical dataset, to carry out longitudinal GTV/OAR predictions for anatomical changes in HN and lung radiotherapy patients, which has potential to improve RT outcomes.