Machine learning and registration for automatic seed localization in 3D US images for prostate brachytherapy

A prostate seed implantation robot system based on human-computer interactions: Augmented reality and voice control

The technology of robot-assisted prostate seed implantation has developed rapidly. However, during the process, there are some problems to be solved, such as non-intuitive visualization effects and complicated robot control. To improve the intelligence and visualization of the operation process, a voice control technology of prostate seed implantation robot in augmented reality environment was proposed. Initially, the MRI image of the prostate was denoised and segmented. The three-dimensional model of prostate and its surrounding tissues was reconstructed by surface rendering technology. Combined with holographic application program, the augmented reality system of prostate seed implantation was built. An improved singular value decomposition three-dimensional registration algorithm based on iterative closest point was proposed, and the results of three-dimensional registration experiments verified that the algorithm could effectively improve the three-dimensional registration accuracy. A fusion algorithm based on spectral subtraction and BP neural network was proposed. The experimental results showed that the average delay of the fusion algorithm was 1.314 s, and the overall response time of the integrated system was 1.5 s. The fusion algorithm could effectively improve the reliability of the voice control system, and the integrated system could meet the responsiveness requirements of prostate seed implantation.

Prospective validation of a machine learning model for applicator and hybrid interstitial needle selection in high-dose-rate (HDR) cervical brachytherapy

PURPOSE

To Demonstrate the clinical validation of a machine learning (ML) model for applicator and interstitial needle prediction in gynecologic brachytherapy through a prospective clinical study in a single institution.

METHODS

The study included cervical cancer patients receiving high-dose-rate brachytherapy using intracavitary (IC) or hybrid interstitial (IC/IS) applicators. For each patient, the primary radiation oncologist contoured the high-risk clinical target volume on a pre-brachytherapy MRI, indicated the approximate applicator location, and made a clinical determination of the first fraction applicator. A pre-trained ML model predicted the applicator and IC/IS needle arrangement using tumor geometry. Following the first fraction, ML and radiation oncologist predictions were compared and a replanning study determined the applicator providing optimal organ-at-risk (OAR) dosimetry. The ML-predicted applicator and needle arrangement and the clinical determination were compared to this dosimetric ground truth.

RESULTS

Ten patients were accrued from December 2020 to October 2022. Compared to the dosimetrically optimal applicator, both the radiation oncologist and ML had an accuracy of 70%. ML demonstrated better identification of patients requiring IC/IS applicators and provided balanced IC and IC/IS predictions. The needle selection model achieved an average accuracy of 82.5%. ML-predicted needle arrangements matched or improved plan quality when compared to clinically selected arrangements. Overall, ML predictions led to an average total improvement of 2.0 Gy to OAR doses over three treatment fractions when compared to clinical predictions.

CONCLUSION

In the context of a single institution study, the presented ML model demonstrates valuable decision-support for the applicator and needle selection process with the potential to provide improved dosimetry. Future work will include a multi-center study to assess generalizability.

Artificial intelligence applications in brachytherapy: A literature review

PURPOSE

Artificial intelligence (AI) has the potential to simplify and optimize various steps of the brachytherapy workflow, and this literature review aims to provide an overview of the work done in this field.

METHODS AND MATERIALS

We conducted a literature search in June 2022 on PubMed, Embase, and Cochrane for papers that proposed AI applications in brachytherapy.

RESULTS

A total of 80 papers satisfied inclusion/exclusion criteria. These papers were categorized as follows: segmentation (24), registration and image processing (6), preplanning (13), dose prediction and treatment planning (11), applicator/catheter/needle reconstruction (16), and quality assurance (10). AI techniques ranged from classical models such as support vector machines and decision tree-based learning to newer techniques such as U-Net and deep reinforcement learning, and were applied to facilitate small steps of a process (e.g., optimizing applicator selection) or even automate the entire step of the workflow (e.g., end-to-end preplanning). Many of these algorithms demonstrated human-level performance and offer significant improvements in speed.

CONCLUSIONS

AI has potential to augment, automate, and/or accelerate many steps of the brachytherapy workflow. We recommend that future studies adhere to standard reporting guidelines. We also stress the importance of using larger sample sizes and reporting results using clinically interpretable measures.

Automatic estimation of knee effusion from limited MRI data

Knee effusion is a common comorbidity in osteoarthritis. To quantify the amount of effusion, semi quantitative assessment scales have been developed that classify fluid levels on an integer scale from 0 to 3. In this work, we investigated the use of a neural network (NN) that used MRI Osteoarthritis Knee Scores effusion-synovitis (MOAKS-ES) values to distinguish physiologic fluid levels from higher fluid levels in MR images of the knee. We evaluate its effectiveness on low-resolution images to examine its potential in low-field, low-cost MRI. We created a dense NN (dNN) for detecting effusion, defined as a nonzero MOAKS-ES score, from MRI scans. Both the training and performance evaluation of the network were conducted using public radiological data from the Osteoarthritis Initiative (OAI). The model was trained using sagittal turbo-spin-echo (TSE) MR images from 1628 knees. The accuracy was compared to VGG16, a commonly used convolutional classification network. Robustness of the dNN was assessed by adding zero-mean Gaussian noise to the test images with a standard deviation of 5-30% of the maximum test data intensity. Also, inference was performed on a test data set of 163 knees, which includes a smaller test set of 36 knees that was also assessed by a musculoskeletal radiologist and the performance of the dNN and the radiologist compared. For the larger test data set, the dNN performed with an average accuracy of 62%. In addition, the network proved robust to noise, classifying the noisy images with minimal degradation to accuracy. When given MRI scans with 5% Gaussian noise, the network performed similarly, with an average accuracy of 61%. For the smaller 36-knee test data set, assessed both by the dNN and by a radiologist, the network performed better than the radiologist on average. Classifying knee effusion from low-resolution images with a similar accuracy as a human radiologist using neural networks is feasible, suggesting automatic assessment of images from low-cost, low-field scanners as a potentially useful assessment tool.