Deep learning based uncertainty prediction of deformable image registration for contour propagation and dose accumulation in online adaptive radiotherapy

Data Science Opportunities To Improve Radiotherapy Planning and Clinical Decision Making

Radiotherapy aims to achieve a high tumor control probability while minimizing damage to normal tissues. Personalizing radiotherapy treatments for individual patients, therefore, depends on integrating physical treatment planning with predictive models of tumor control and normal tissue complications. Predictive models could be improved using a wide range of rich data sources, including tumor and normal tissue genomics, radiomics, and dosiomics. Deep learning will drive improvements in classifying normal tissue tolerance, predicting intra-treatment tumor changes, tracking accumulated dose distributions, and quantifying the tumor response to radiotherapy based on imaging. Mechanistic patient-specific computer simulations ('digital twins') could also be used to guide adaptive radiotherapy. Overall, we are entering an era where improved modeling methods will allow the use of newly available data sources to better guide radiotherapy treatments.

An operator-independent quality assurance system for automatically generated structure sets

Objective. This study describes geometry-based and intensity-based tools for quality assurance (QA) of automatically generated structures for online adaptive radiotherapy, and designs an operator-independent traffic light system that identifies erroneous structure sets.Approach.A cohort of eight head and neck (HN) patients with daily CBCTs was selected for test development. Radiotherapy contours were propagated from planning computed tomography (CT) to daily cone beam CT (CBCT) using deformable image registration. These propagated structures were visually verified for acceptability. For each CBCT, several error scenarios were used to generate what were judged unacceptable structures. Ten additional HN patients with daily CBCTs and different error scenarios were selected for validation. A suite of tests based on image intensity, intensity gradient, and structure geometry was developed using acceptable and unacceptable HN planning structures. Combinations of one test applied to one structure, referred to as structure-test combinations, were selected for inclusion in the QA system based on their discriminatory power. A traffic light system was used to aggregate the structure-test combinations, and the system was evaluated on all fractions of the ten validation HN patients.Results.The QA system distinguished between acceptable and unacceptable fractions with high accuracy, labeling 294/324 acceptable fractions as green or yellow and 19/20 unacceptable fractions as yellow or red.Significance.This study demonstrates a system to supplement manual review of radiotherapy planning structures. Automated QA is performed by aggregating results from multiple intensity- and geometry-based tests.

Robust optimization strategies for contour uncertainties in online adaptive radiation therapy

Objective.Online adaptive radiation therapy requires fast and automated contouring of daily scans for treatment plan re-optimization. However, automated contouring is imperfect and introduces contour uncertainties. This work aims at developing and comparing robust optimization strategies accounting for such uncertainties.Approach.A deep-learning method was used to predict the uncertainty of deformable image registration, and to generate a finite set of daily contour samples. Ten optimization strategies were compared: two baseline methods, five methods that convert contour samples into voxel-wise probabilities, and three methods accounting explicitly for contour samples as scenarios in robust optimization. Target coverage and organ-at-risk (OAR) sparing were evaluated robustly for simplified proton therapy plans for five head-and-neck cancer patients.Results.We found that explicitly including target contour uncertainty in robust optimization provides robust target coverage with better OAR sparing than the baseline methods, without increasing the optimization time. Although OAR doses first increased when increasing target robustness, this effect could be prevented by additionally including robustness to OAR contour uncertainty. Compared to the probability-based methods, the scenario-based methods spared the OARs more, but increased integral dose and required more computation time.Significance.This work proposed efficient and beneficial strategies to mitigate contour uncertainty in treatment plan optimization. This facilitates the adoption of automatic contouring in online adaptive radiation therapy and, more generally, enables mitigation also of other sources of contour uncertainty in treatment planning.

Uncertainty estimation and evaluation of deformation image registration based convolutional neural networks

Objective.Fast and accurate deformable image registration (DIR), including DIR uncertainty estimation, is essential for safe and reliable clinical deployment. While recent deep learning models have shown promise in predicting DIR with its uncertainty, challenges persist in proper uncertainty evaluation and hyperparameter optimization for these methods. This work aims to develop and evaluate a model that can perform fast DIR and predict its uncertainty in seconds.Approach.This study introduces a novel probabilistic multi-resolution image registration model utilizing convolutional neural networks to estimate a multivariate normal distributed dense displacement field (DDF) in a multimodal image registration problem. To assess the quality of the DDF distribution predicted by the model, we propose a new metric based on the Kullback-Leibler divergence. The performance of our approach was evaluated against three other DIR algorithms (VoxelMorph, Monte Carlo dropout, and Monte Carlo B-spline) capable of predicting uncertainty. The evaluation of the models included not only the quality of the deformation but also the reliability of the estimated uncertainty. Our application investigated the registration of a treatment planning computed tomography (CT) to follow-up cone beam CT for daily adaptive radiotherapy.Main results.The hyperparameter tuning of the models showed a trade-off between the estimated uncertainty's reliability and the deformation's accuracy. In the optimal trade-off, our model excelled in contour propagation and uncertainty estimation (p <0.05) compared to existing uncertainty estimation models. We obtained an average dice similarity coefficient of 0.89 and a KL-divergence of 0.15.Significance.By addressing challenges in DIR uncertainty estimation and evaluation, our work showed that both the DIR and its uncertainty can be reliably predicted, paving the way for safe deployment in a clinical environment.

Artificial Intelligence Uncertainty Quantification in Radiotherapy Applications - A Scoping Review

Background/purpose

The use of artificial intelligence (AI) in radiotherapy (RT) is expanding rapidly. However, there exists a notable lack of clinician trust in AI models, underscoring the need for effective uncertainty quantification (UQ) methods. The purpose of this study was to scope existing literature related to UQ in RT, identify areas of improvement, and determine future directions.

Methods

We followed the PRISMA-ScR scoping review reporting guidelines. We utilized the population (human cancer patients), concept (utilization of AI UQ), context (radiotherapy applications) framework to structure our search and screening process. We conducted a systematic search spanning seven databases, supplemented by manual curation, up to January 2024. Our search yielded a total of 8980 articles for initial review. Manuscript screening and data extraction was performed in Covidence. Data extraction categories included general study characteristics, RT characteristics, AI characteristics, and UQ characteristics.

Results

We identified 56 articles published from 2015-2024. 10 domains of RT applications were represented; most studies evaluated auto-contouring (50%), followed by image-synthesis (13%), and multiple applications simultaneously (11%). 12 disease sites were represented, with head and neck cancer being the most common disease site independent of application space (32%). Imaging data was used in 91% of studies, while only 13% incorporated RT dose information. Most studies focused on failure detection as the main application of UQ (60%), with Monte Carlo dropout being the most commonly implemented UQ method (32%) followed by ensembling (16%). 55% of studies did not share code or datasets.

Conclusion

Our review revealed a lack of diversity in UQ for RT applications beyond auto-contouring. Moreover, there was a clear need to study additional UQ methods, such as conformal prediction. Our results may incentivize the development of guidelines for reporting and implementation of UQ in RT.

A review of the clinical introduction of 4D particle therapy research concepts

Background and purpose

Many 4D particle therapy research concepts have been recently translated into clinics, however, remaining substantial differences depend on the indication and institute-related aspects. This work aims to summarise current state-of-the-art 4D particle therapy technology and outline a roadmap for future research and developments.

Material and methods

This review focused on the clinical implementation of 4D approaches for imaging, treatment planning, delivery and evaluation based on the 2021 and 2022 4D Treatment Workshops for Particle Therapy as well as a review of the most recent surveys, guidelines and scientific papers dedicated to this topic.

Results

Available technological capabilities for motion surveillance and compensation determined the course of each 4D particle treatment. 4D motion management, delivery techniques and strategies including imaging were diverse and depended on many factors. These included aspects of motion amplitude, tumour location, as well as accelerator technology driving the necessity of centre-specific dosimetric validation. Novel methodologies for X-ray based image processing and MRI for real-time tumour tracking and motion management were shown to have a large potential for online and offline adaptation schemes compensating for potential anatomical changes over the treatment course. The latest research developments were dominated by particle imaging, artificial intelligence methods and FLASH adding another level of complexity but also opportunities in the context of 4D treatments.

Conclusion

This review showed that the rapid technological advances in radiation oncology together with the available intrafractional motion management and adaptive strategies paved the way towards clinical implementation.

Review and recommendations on deformable image registration uncertainties for radiotherapy applications

Deformable image registration (DIR) is a versatile tool used in many applications in radiotherapy (RT). DIR algorithms have been implemented in many commercial treatment planning systems providing accessible and easy-to-use solutions. However, the geometric uncertainty of DIR can be large and difficult to quantify, resulting in barriers to clinical practice. Currently, there is no agreement in the RT community on how to quantify these uncertainties and determine thresholds that distinguish a good DIR result from a poor one. This review summarises the current literature on sources of DIR uncertainties and their impact on RT applications. Recommendations are provided on how to handle these uncertainties for patient-specific use, commissioning, and research. Recommendations are also provided for developers and vendors to help users to understand DIR uncertainties and make the application of DIR in RT safer and more reliable.