Prostate and dominant intraprostatic lesion segmentation on PET/CT using cascaded regional-net

The use of deep learning in interventional radiotherapy (brachytherapy): A review with a focus on open source and open data

Deep learning advanced to one of the most important technologies in almost all medical fields. Especially in areas, related to medical imaging it plays a big role. However, in interventional radiotherapy (brachytherapy) deep learning is still in an early phase. In this review, first, we investigated and scrutinised the role of deep learning in all processes of interventional radiotherapy and directly related fields. Additionally, we summarised the most recent developments. For better understanding, we provide explanations of key terms and approaches to solving common deep learning problems. To reproduce results of deep learning algorithms both source code and training data must be available. Therefore, a second focus of this work is on the analysis of the availability of open source, open data and open models. In our analysis, we were able to show that deep learning plays already a major role in some areas of interventional radiotherapy, but is still hardly present in others. Nevertheless, its impact is increasing with the years, partly self-propelled but also influenced by closely related fields. Open source, data and models are growing in number but are still scarce and unevenly distributed among different research groups. The reluctance in publishing code, data and models limits reproducibility and restricts evaluation to mono-institutional datasets. The conclusion of our analysis is that deep learning can positively change the workflow of interventional radiotherapy but there is still room for improvements when it comes to reproducible results and standardised evaluation methods.

Multi-modal tumor segmentation methods based on deep learning: a narrative review

Background and Objective

Automatic tumor segmentation is a critical component in clinical diagnosis and treatment. Although single-modal imaging provides useful information, multi-modal imaging provides a more comprehensive understanding of the tumor. Multi-modal tumor segmentation has been an essential topic in medical image processing. With the remarkable performance of deep learning (DL) methods in medical image analysis, multi-modal tumor segmentation based on DL has attracted significant attention. This study aimed to provide an overview of recent DL-based multi-modal tumor segmentation methods.

Methods

In in the PubMed and Google Scholar databases, the keywords "multi-modal", "deep learning", and "tumor segmentation" were used to systematically search English articles in the past 5 years. The date range was from 1 January 2018 to 1 June 2023. A total of 78 English articles were reviewed.

Key Content and Findings

We introduce public datasets, evaluation methods, and multi-modal data processing. We also summarize common DL network structures, techniques, and multi-modal image fusion methods used in different tumor segmentation tasks. Finally, we conclude this study by presenting perspectives for future research.

Conclusions

In multi-modal tumor segmentation tasks, DL technique is a powerful method. With the fusion methods of different modal data, the DL framework can effectively use the characteristics of different modal data to improve the accuracy of tumor segmentation.

Assessing the Feasibility of Using Artificial Intelligence-Segmented Dominant Intraprostatic Lesion for Focal Intraprostatic Boost With External Beam Radiation Therapy

PURPOSE

The delineation of dominant intraprostatic gross tumor volumes (GTVs) on multiparametric magnetic resonance imaging (mpMRI) can be subject to interobserver variability. We evaluated whether deep learning artificial intelligence (AI)-segmented GTVs can provide a similar degree of intraprostatic boosting with external beam radiation therapy (EBRT) as radiation oncologist (RO)-delineated GTVs.

METHODS AND MATERIALS

We identified 124 patients who underwent mpMRI followed by EBRT between 2010 and 2013. A reference GTV was delineated by an RO and approved by a board-certified radiologist. We trained an AI algorithm for GTV delineation on 89 patients, and tested the algorithm on 35 patients, each with at least 1 PI-RADS (Prostate Imaging Reporting and Data System) 4 or 5 lesion (46 total lesions). We then asked 5 additional ROs to independently delineate GTVs on the test set. We compared lesion detectability and geometric accuracy of the GTVs from AI and 5 ROs against the reference GTV. Then, we generated EBRT plans (77 Gy prostate) that boosted each observer-specific GTV to 95 Gy. We compared reference GTV dose (D98%) across observers using a mixed-effects model.

RESULTS

On a lesion level, AI GTV exhibited a sensitivity of 82.6% and positive predictive value of 86.4%. Respective ranges among the 5 RO GTVs were 84.8% to 95.7% and 95.1% to 100.0%. Among 30 GTVs mutually identified by all observers, no significant differences in Dice coefficient were detected between AI and any of the 5 ROs. Across all patients, only 2 of 5 ROs had a reference GTV D98% that significantly differed from that of AI by 2.56 Gy (P = .02) and 3.20 Gy (P = .003). The presence of false-negative (-5.97 Gy; P < .001) but not false-positive (P = .24) lesions was associated with reference GTV D98%.

CONCLUSIONS

AI-segmented GTVs demonstrate potential for intraprostatic boosting, although the degree of boosting may be adversely affected by false-negative lesions. Prospective review of AI-segmented GTVs remains essential.

Lesion segmentation on 18F-fluciclovine PET/CT images using deep learning

Background and purpose

A novel radiotracer, 18F-fluciclovine (anti-3-18F-FACBC), has been demonstrated to be associated with significantly improved survival when it is used in PET/CT imaging to guide postprostatectomy salvage radiotherapy for prostate cancer. We aimed to investigate the feasibility of using a deep learning method to automatically detect and segment lesions on 18F-fluciclovine PET/CT images.

Materials and methods

We retrospectively identified 84 patients who are enrolled in Arm B of the Emory Molecular Prostate Imaging for Radiotherapy Enhancement (EMPIRE-1) trial. All 84 patients had prostate adenocarcinoma and underwent prostatectomy and 18F-fluciclovine PET/CT imaging with lesions identified and delineated by physicians. Three different neural networks with increasing levels of complexity (U-net, Cascaded U-net, and a cascaded detection segmentation network) were trained and tested on the 84 patients with a fivefold cross-validation strategy and a hold-out test, using manual contours as the ground truth. We also investigated using both PET and CT or using PET only as input to the neural network. Dice similarity coefficient (DSC), 95th percentile Hausdorff distance (HD95), center-of-mass distance (CMD), and volume difference (VD) were used to quantify the quality of segmentation results against ground truth contours provided by physicians.

Results

All three deep learning methods were able to detect 144/155 lesions and 153/155 lesions successfully when PET+CT and PET only, respectively, served as input. Quantitative results demonstrated that the neural network with the best performance was able to segment lesions with an average DSC of 0.68 ± 0.15 and HD95 of 4 ± 2 mm. The center of mass of the segmented contours deviated from physician contours by approximately 2 mm on average, and the volume difference was less than 1 cc. The novel network proposed by us achieves the best performance compared to current networks. The addition of CT as input to the neural network contributed to more cases of failure (DSC = 0), and among those cases of DSC > 0, it was shown to produce no statistically significant difference with the use of only PET as input for our proposed method.

Conclusion

Quantitative results demonstrated the feasibility of the deep learning methods in automatically segmenting lesions on 18F-fluciclovine PET/CT images. This indicates the great potential of 18F-fluciclovine PET/CT combined with deep learning for providing a second check in identifying lesions as well as saving time and effort for physicians in contouring.

Deep learning based automated delineation of the intraprostatic gross tumour volume in PSMA-PET for patients with primary prostate cancer

PURPOSE

With the increased use of focal radiation dose escalation for primary prostate cancer (PCa), accurate delineation of gross tumor volume (GTV) in prostate-specific membrane antigen PET (PSMA-PET) becomes crucial. Manual approaches are time-consuming and observer dependent. The purpose of this study was to create a deep learning model for the accurate delineation of the intraprostatic GTV in PSMA-PET.

METHODS

A 3D U-Net was trained on 128 different 18F-PSMA-1007 PET images from three different institutions. Testing was done on 52 patients including one independent internal cohort (Freiburg: n = 19) and three independent external cohorts (Dresden: n = 14 18F-PSMA-1007, Boston: Massachusetts General Hospital (MGH): n = 9 18F-DCFPyL-PSMA and Dana-Farber Cancer Institute (DFCI): n = 10 68Ga-PSMA-11). Expert contours were generated in consensus using a validated technique. CNN predictions were compared to expert contours using Dice similarity coefficient (DSC). Co-registered whole-mount histology was used for the internal testing cohort to assess sensitivity/specificity.

RESULTS

Median DSCs were Freiburg: 0.82 (IQR: 0.73-0.88), Dresden: 0.71 (IQR: 0.53-0.75), MGH: 0.80 (IQR: 0.64-0.83) and DFCI: 0.80 (IQR: 0.67-0.84), respectively. Median sensitivity for CNN and expert contours were 0.88 (IQR: 0.68-0.97) and 0.85 (IQR: 0.75-0.88) (p = 0.40), respectively. GTV volumes did not differ significantly (p > 0.1 for all comparisons). Median specificity of 0.83 (IQR: 0.57-0.97) and 0.88 (IQR: 0.69-0.98) were observed for CNN and expert contours (p = 0.014), respectively. CNN prediction took 3.81 seconds on average per patient.

CONCLUSION

The CNN was trained and tested on internal and external datasets as well as histopathology reference, achieving a fast GTV segmentation for three PSMA-PET tracers with high diagnostic accuracy comparable to manual experts.

A Review of the Metrics Used to Assess Auto-Contouring Systems in Radiotherapy

Auto-contouring could revolutionise future planning of radiotherapy treatment. The lack of consensus on how to assess and validate auto-contouring systems currently limits clinical use. This review formally quantifies the assessment metrics used in studies published during one calendar year and assesses the need for standardised practice. A PubMed literature search was undertaken for papers evaluating radiotherapy auto-contouring published during 2021. Papers were assessed for types of metric and the methodology used to generate ground-truth comparators. Our PubMed search identified 212 studies, of which 117 met the criteria for clinical review. Geometric assessment metrics were used in 116 of 117 studies (99.1%). This includes the Dice Similarity Coefficient used in 113 (96.6%) studies. Clinically relevant metrics, such as qualitative, dosimetric and time-saving metrics, were less frequently used in 22 (18.8%), 27 (23.1%) and 18 (15.4%) of 117 studies, respectively. There was heterogeneity within each category of metric. Over 90 different names for geometric measures were used. Methods for qualitative assessment were different in all but two papers. Variation existed in the methods used to generate radiotherapy plans for dosimetric assessment. Consideration of editing time was only given in 11 (9.4%) papers. A single manual contour as a ground-truth comparator was used in 65 (55.6%) studies. Only 31 (26.5%) studies compared auto-contours to usual inter- and/or intra-observer variation. In conclusion, significant variation exists in how research papers currently assess the accuracy of automatically generated contours. Geometric measures are the most popular, however their clinical utility is unknown. There is heterogeneity in the methods used to perform clinical assessment. Considering the different stages of system implementation may provide a framework to decide the most appropriate metrics. This analysis supports the need for a consensus on the clinical implementation of auto-contouring.

Karawun: a software package for assisting evaluation of advances in multimodal imaging for neurosurgical planning and intraoperative neuronavigation

PURPOSE

The neuroimaging research community-which includes a broad range of scientific, medical, statistical, and engineering disciplines-has developed many tools to advance our knowledge of brain structure, function, development, aging, and disease. Past research efforts have clearly shaped clinical practice. However, translation of new methodologies into clinical practice is challenging. Anything that can reduce these barriers has the potential to improve the rate at which research outcomes can contribute to clinical practice. In this article, we introduce Karawun, a file format conversion tool, that has become a key part of our work in translating advances in diffusion imaging acquisition and analysis into neurosurgical practice at our institution.

METHODS

Karawun links analysis workflows created using open-source neuroimaging software, to Brainlab (Brainlab AG, Munich, Germany), a commercially available surgical planning and navigation suite. Karawun achieves this using DICOM standards supporting representation of 3D structures, including tractography streamlines, and thus offers far more than traditional screenshot or color overlay approaches.

RESULTS

We show that neurosurgical planning data, created from multimodal imaging data using analysis methods implemented in open-source research software, can be imported into Brainlab. The datasets can be manipulated as if they were created by Brainlab, including 3D visualizations of white matter tracts and other objects.

CONCLUSION

Clinicians can explore and interact with the results of research neuroimaging pipelines using familiar tools within their standard clinical workflow, understand the impact of the new methods on their practice and provide feedback to methods developers. This capability has been important to the translation of advanced analysis techniques into practice at our institution.

Feasibility of biology-guided radiotherapy using PSMA-PET to boost to dominant intraprostatic tumour

•

Biology-guided radiation therapy (BGRT) uses PET imaging for online image guidance.

•

PSMA PET uptake is abundant in the dominant intraprostatic lesion (DIL).

•

BgRT boost to PSMA-avid subvolume in the prostate region may be feasible.

•

Suitable targets for BgRT were identified in the ProPSMA clinical trial.

Background

Methods

Results

Conclusions