Use of artificial neural network for pretreatment verification of intensity modulation radiation therapy fields

The influence of artificial intelligence on the work of the medical physicist in radiotherapy practice: a short review

There have been many applications and influences of Artificial intelligence (AI) in many sectors and its professionals, that of radiotherapy and the medical physicist is no different. AI and technological advances have necessitated changing roles of medical physicists due to the development of modernized technology with image-guided accessories for the radiotherapy treatment of cancer patients. Given the changing role of medical physicists in ensuring patient safety and optimal care, AI can reshape radiotherapy practice now and in some years to come. Medical physicists' roles in radiotherapy practice have evolved to meet technology for the management of better patient care in the age of modern radiotherapy. This short review provides an insight into the influence of AI on the changing role of medical physicists in each specific chain of the workflow in radiotherapy in which they are involved.

Towards real-time EPID-based 3D in vivo dosimetry for IMRT with Deep Neural Networks: A feasibility study

We investigate the potential of the Deep Dose Estimate (DDE) neural network to predict 3D dose distributions inside patients with Monte Carlo (MC) accuracy, based on transmitted EPID signals and patient CTs. The network was trained using as input patient CTs and first-order dose approximations (FOD). Accurate dose distributions (ADD) simulated with MC were given as training targets. 83 pelvic CTs were used to simulate ADDs and respective EPID signals for subfields of prostate IMRT plans (gantry at 0∘). FODs were produced as backprojections from the EPID signals. 581 ADD-FOD sets were produced and divided into training and test sets. An additional dataset simulated with gantry at 90∘ (lateral set) was used for evaluating the performance of the DDE at different beam directions. The quality of the FODs and DDE-predicted dose distributions (DDEP) with respect to ADDs, from the test and lateral sets, was evaluated with gamma analysis (3%,2 mm). The passing rates between FODs and ADDs were as low as 46%, while for DDEPs the passing rates were above 97% for the test set. Meaningful improvements were also observed for the lateral set. The high passing rates for DDEPs indicate that the DDE is able to convert FODs into ADDs. Moreover, the trained DDE predicts the dose inside a patient CT within 0.6 s/subfield (GPU), in contrast to 14 h needed for MC (CPU-cluster). 3D in vivo dose distributions due to clinical patient irradiation can be obtained within seconds, with MC-like accuracy, potentially paving the way towards real-time EPID-based in vivo dosimetry.

A recurrent neural network for rapid detection of delivery errors during real-time portal dosimetry

Background and purpose

Real-time portal dosimetry compares measured images with predicted images to detect delivery errors as the radiotherapy treatment proceeds. This work aimed to investigate the performance of a recurrent neural network for processing image metrics so as to detect delivery errors as early as possible in the treatment.

Materials and methods

Volumetric modulated arc therapy (VMAT) plans of six prostate patients were used to generate sequences of predicted portal images. Errors were introduced into the treatment plans and the modified plans were delivered to a water-equivalent phantom. Four different metrics were used to detect errors. These metrics were applied to a threshold-based method to detect the errors as soon as possible during the delivery, and also to a recurrent neural network consisting of four layers. A leave-two-out approach was used to set thresholds and train the neural network then test the resulting systems.

Results

When using a combination of metrics in conjunction with optimal thresholds, the median segment index at which the errors were detected was 107 out of 180. When using the neural network, the median segment index for error detection was 66 out of 180, with no false positives. The neural network reduced the rate of false negative results from 0.36 to 0.24.

Conclusions

The recurrent neural network allowed the detection of errors around 30% earlier than when using conventional threshold techniques. By appropriate training of the network, false positive alerts could be prevented, thereby avoiding unnecessary disruption to the patient workflow.

Improving the Quality of Care in Radiation Oncology using Artificial Intelligence

Radiation therapy is a complex process involving multiple professionals and steps from simulation to treatment planning to delivery, and these procedures are prone to error. Additionally, the imaging and treatment delivery equipment in radiotherapy is highly complex and interconnected and represents another risk point in the quality of care. Numerous quality assurance tasks are carried out to ensure quality and to detect and prevent potential errors in the process of care. Recent developments in artificial intelligence provide potential tools to the radiation oncology community to improve the efficiency and performance of quality assurance efforts. Targets for artificial intelligence enhancement include the quality assurance of treatment plans, target and tissue structure delineation used in the plans, delivery of the plans and the radiotherapy delivery equipment itself. Here we review recent developments of artificial intelligence applications that aim to improve quality assurance processes in radiation therapy and discuss some of the challenges and limitations that require further development work to realise the potential of artificial intelligence for quality assurance.

Commissioning and clinical implementation of an Autoencoder based Classification-Regression model for VMAT patient-specific QA in a multi-institution scenario

BACKGROUND AND PURPOSE

To commission and implement an Autoencoder based Classification-Regression (ACLR) model for VMAT patient-specific quality assurance (PSQA) in a multi-institution scenario.

MATERIALS AND METHODS

1835 VMAT plans from seven institutions were collected for the ACLR model commissioning and multi-institutional validation. We established three scenarios to validate the gamma passing rates (GPRs) prediction and classification accuracy with the ACLR model for different delivery equipment, QA devices, and treatment planning systems (TPS). The prediction performance of the ACLR model was evaluated using mean absolute error (MAE) and root mean square error (RMSE). The classification performance was evaluated using sensitivity and specificity. An independent end-to-end test (E2E) and routine QA of the ACLR model were performed to validate the clinical use of the model.

RESULTS

For multi-institution validations, the MAEs were 1.30-2.80% and 2.42-4.60% at 3%/3 mm and 3%/2 mm, respectively, and RMSEs were 1.55-2.98% and 2.83-4.95% at 3%/3 mm and 3%/2 mm, respectively, with different delivery equipment, QA devices, and TPS, while the sensitivity was 90% and specificity was 70.1% at 3%/2 mm. For the E2E, the deviations between the predicted and measured results were within 3%, and the model passed the consistency check for clinical implementation. The predicted results of the model were the same in daily QA, while the deviations between the repeated monthly measured GPRs were all within 2%.

CONCLUSIONS

The performance of the ACLR model in multi-institution scenarios was validated on a large scale. Routine QA of the ACLR model was established and the model could be used for VMAT PSQA clinically.

Error detection model developed using a multi-task convolutional neural network in patient-specific quality assurance for volumetric-modulated arc therapy

PURPOSE

In patient-specific quality assurance (QA) for static beam intensity-modulated radiation therapy (IMRT), machine-learning-based dose analysis methods have been developed to identify the cause of an error as an alternative to gamma analysis. Although these new methods have revealed that the cause of the error can be identified by analyzing the dose distribution obtained from the two-dimensional detector, they have not been extended to the analysis of volumetric-modulated arc therapy (VMAT) QA. In this study, we propose a deep learning approach to detect various types of errors in patient-specific VMAT QA.

METHODS

A total of 161 beams from 104 prostate VMAT plans were analyzed. All beams were measured using a cylindrical detector (Delta4; ScandiDos, Uppsala, Sweden), and predicted dose distributions in a cylindrical phantom were calculated using a treatment planning system (TPS). In addition to the error-free plan, we simulated 12 types of errors: two types of multileaf collimator positional errors (systematic or random leaf offset of 2 mm), two types of monitor unit (MU) scaling errors (±3%), two types of gantry rotation errors (±2° in clockwise and counterclockwise direction), and six types of phantom setup errors (±1 mm in lateral, longitudinal, and vertical directions). The error-introduced predicted dose distributions were created by editing the calculated dose distributions using a TPS with in-house software. Those 13 types of dose difference maps, consisting of an error-free map and 12 error maps, were created from the measured and predicted dose distributions and were used to train the convolutional neural network (CNN) model. Our model was a multi-task model that individually detected each of the 12 types of errors. Two datasets, Test sets 1 and 2, were prepared to evaluate the performance of the model. Test set 1 consisted of 13 types of dose maps used for training, whereas Test set 2 included the dose maps with 25 types of errors in addition to the error-free dose map. The dose map, which introduced 25 types of errors, was generated by combining two of the 12 types of simulated errors. For comparison with the performance of our model, gamma analysis was performed for Test sets 1 and 2 with the criteria set to 3%/2 mm and 2%/1 mm (dose difference/distance to agreement).

RESULTS

For Test set 1, the overall accuracy of our CNN model, gamma analysis with the criteria set to 3%/2 mm, and gamma analysis with the criteria set to 2%/1 mm was 0.92, 0.19, and 0.81, respectively. Similarly, for Test set 2, the overall accuracy was 0.44, 0.42, and 0.95, respectively. Our model outperformed gamma analysis in the classification of dose maps containing a single type error, and the performance of our model was inferior in the classification of dose maps containing compound errors.

CONCLUSIONS

A multi-task CNN model for detecting errors in patient-specific VMAT QA using a cylindrical measuring device was constructed, and its performance was evaluated. Our results demonstrate that our model was effective in identifying the error type in the dose map for VMAT QA.

Artificial Intelligence in magnetic Resonance guided Radiotherapy: Medical and physical considerations on state of art and future perspectives

Over the last years, technological innovation in Radiotherapy (RT) led to the introduction of Magnetic Resonance-guided RT (MRgRT) systems. Due to the higher soft tissue contrast compared to on-board CT-based systems, MRgRT is expected to significantly improve the treatment in many situations. MRgRT systems may extend the management of inter- and intra-fraction anatomical changes, offering the possibility of online adaptation of the dose distribution according to daily patient anatomy and to directly monitor tumor motion during treatment delivery by means of a continuous cine MR acquisition. Online adaptive treatments require a multidisciplinary and well-trained team, able to perform a series of operations in a safe, precise and fast manner while the patient is waiting on the treatment couch. Artificial Intelligence (AI) is expected to rapidly contribute to MRgRT, primarily by safely and efficiently automatising the various manual operations characterizing online adaptive treatments. Furthermore, AI is finding relevant applications in MRgRT in the fields of image segmentation, synthetic CT reconstruction, automatic (on-line) planning and the development of predictive models based on daily MRI. This review provides a comprehensive overview of the current AI integration in MRgRT from a medical physicist's perspective. Medical physicists are expected to be major actors in solving new tasks and in taking new responsibilities: their traditional role of guardians of the new technology implementation will change with increasing emphasis on the managing of AI tools, processes and advanced systems for imaging and data analysis, gradually replacing many repetitive manual tasks.

Artificial intelligence in radiation oncology

Artificial intelligence (AI) is a computer science that tries to mimic human-like intelligence in machines that use computer software and algorithms to perform specific tasks without direct human input. Machine learning (ML) is a subunit of AI that uses data-driven algorithms that learn to imitate human behavior based on a previous example or experience. Deep learning is an ML technique that uses deep neural networks to create a model. The growth and sharing of data, increasing computing power, and developments in AI have initiated a transformation in healthcare. Advances in radiation oncology have produced a significant amount of data that must be integrated with computed tomography imaging, dosimetry, and imaging performed before each fraction. Of the many algorithms used in radiation oncology, has advantages and limitations with different computational power requirements. The aim of this review is to summarize the radiotherapy (RT) process in workflow order by identifying specific areas in which quality and efficiency can be improved by ML. The RT stage is divided into seven stages: patient evaluation, simulation, contouring, planning, quality control, treatment application, and patient follow-up. A systematic evaluation of the applicability, limitations, and advantages of AI algorithms has been done for each stage.

Optimisation of a composite difference metric for prompt error detection in real-time portal dosimetry of simulated volumetric modulated arc therapy

OBJECTIVES

In real-time portal dosimetry, thresholds are set for several measures of difference between predicted and measured images, and signals larger than those thresholds signify an error. The aim of this work is to investigate the use of an additional composite difference metric (CDM) for earlier detection of errors.

METHODS

Portal images were predicted for the volumetric modulated arc therapy plans of six prostate patients. Errors in monitor units, aperture opening, aperture position and path length were deliberately introduced into all 180 segments of the treatment plans, and these plans were delivered to a water-equivalent phantom. Four different metrics, consisting of central axis signal, mean image value and two image difference measures, were used to identify errors, and a CDM was added, consisting of a weighted power sum of the individual metrics. To optimise the weights of the CDM and to evaluate the resulting timeliness of error detection, a leave-pair-out strategy was used. For each combination of four patients, the weights of the CDM were determined by an exhaustive search, and the result was evaluated on the remaining two patients.

RESULTS

The median segment index at which the errors were identified was 87 (range 40-130) when using all of the individual metrics separately. Using a CDM as well as multiple separate metrics reduced this to 73 (35-95). The median weighting factors of the four metrics constituting the composite were (0.15, 0.10, 0.15, 0.00). Due to selection of suitable threshold levels, there was only one false positive result in the six patients.

CONCLUSION

This study shows that, in conjunction with appropriate error thresholds, use of a CDM is able to identify increased image differences around 20% earlier than the separate measures.

ADVANCES IN KNOWLEDGE

This study shows the value of combining difference metrics to allow earlier detection of errors during real-time portal dosimetry for volumetric modulated arc therapy treatment.

Multi-task autoencoder based classification-regression model for patient-specific VMAT QA

Patient-specific quality assurance (PSQA) of volumetric modulated arc therapy (VMAT) to assure accurate treatment delivery is resource-intensive and time-consuming. Recently, machine learning has been increasingly investigated in PSQA results prediction. However, the classification performance of models at different criteria needs further improvement and clinical validation (CV), especially for predicting plans with low gamma passing rates (GPRs). In this study, we developed and validated a novel multi-task model called autoencoder based classification-regression (ACLR) for VMAT PSQA. The classification and regression were integrated into one model, both parts were trained alternatively while minimizing a defined loss function. The classification was used as an intermediate result to improve the regression accuracy. Different tasks of GPRs prediction and classification based on different criteria were trained simultaneously. Balanced sampling techniques were used to improve the prediction accuracy and classification sensitivity for the unbalanced VMAT plans. Fifty-four metrics were selected as inputs to describe the plan modulation-complexity and delivery-characteristics, while the outputs were PSQA GPRs. A total of 426 clinically delivered VMAT plans were used for technical validation (TV), and another 150 VMAT plans were used for CV to evaluate the generalization performance of the model. The ACLR performance was compared with the Poisson Lasso (PL) model and found significant improvement in prediction accuracy. In TV, the absolute prediction error (APE) of ACLR was 1.76%, 2.60%, and 4.66% at 3%/3 mm, 3%/2 mm, and 2%/2 mm, respectively; whereas the APE of PL was 2.10%, 3.04%, and 5.29% at 3%/3 mm, 3%/2 mm, and 2%/2 mm, respectively. No significant difference was found between CV and TV in prediction accuracy. ACLR model set with 3%/3 mm can achieve 100% sensitivity and 83% specificity. The ACLR model could classify the unbalanced VMAT QA results accurately, and it can be readily applied in clinical practice for virtual VMAT QA.

Overview of artificial intelligence-based applications in radiotherapy: Recommendations for implementation and quality assurance

Artificial Intelligence (AI) is currently being introduced into different domains, including medicine. Specifically in radiation oncology, machine learning models allow automation and optimization of the workflow. A lack of knowledge and interpretation of these AI models can hold back wide-spread and full deployment into clinical practice. To facilitate the integration of AI models in the radiotherapy workflow, generally applicable recommendations on implementation and quality assurance (QA) of AI models are presented. For commonly used applications in radiotherapy such as auto-segmentation, automated treatment planning and synthetic computed tomography (sCT) the basic concepts are discussed in depth. Emphasis is put on the commissioning, implementation and case-specific and routine QA of AI models needed for a methodical introduction in clinical practice.

Artificial intelligence in radiation oncology

Artificial intelligence (AI) has the potential to fundamentally alter the way medicine is practised. AI platforms excel in recognizing complex patterns in medical data and provide a quantitative, rather than purely qualitative, assessment of clinical conditions. Accordingly, AI could have particularly transformative applications in radiation oncology given the multifaceted and highly technical nature of this field of medicine with a heavy reliance on digital data processing and computer software. Indeed, AI has the potential to improve the accuracy, precision, efficiency and overall quality of radiation therapy for patients with cancer. In this Perspective, we first provide a general description of AI methods, followed by a high-level overview of the radiation therapy workflow with discussion of the implications that AI is likely to have on each step of this process. Finally, we describe the challenges associated with the clinical development and implementation of AI platforms in radiation oncology and provide our perspective on how these platforms might change the roles of radiotherapy medical professionals.

Artificial Intelligence in radiotherapy: state of the art and future directions

Recent advances in computing capability allowed the development of sophisticated predictive models to assess complex relationships within observational data, described as Artificial Intelligence. Medicine is one of the several fields of application and Radiation oncology could benefit from these approaches, particularly in patients' medical records, imaging, baseline pathology, planning or instrumental data. Artificial Intelligence systems could simplify many steps of the complex workflow of radiotherapy such as segmentation, planning or delivery. However, Artificial Intelligence could be considered as a "black box" in which human operator may only understand input and output predictions and its application to the clinical practice remains a challenge. The low transparency of the overall system is questionable from manifold points of view (ethical included). Given the complexity of this issue, we collected the basic definitions to help the clinician to understand current literature, and overviewed experiences regarding implementation of AI within radiotherapy clinical workflow, aiming to describe this field from the clinician perspective.