Whole-body voxel-based internal dosimetry using deep learning

Improving 18F-FDG PET Quantification Through a Spatial Normalization Method

Quantification of 18F-FDG PET images is useful for accurate diagnosis and evaluation of various brain diseases, including brain tumors, epilepsy, dementia, and Parkinson disease. However, accurate quantification of 18F-FDG PET images requires matched 3-dimensional T1 MRI scans of the same individuals to provide detailed information on brain anatomy. In this paper, we propose a transfer learning approach to adapt a pretrained deep neural network model from amyloid PET to spatially normalize 18F-FDG PET images without the need for 3-dimensional MRI. Methods: The proposed method is based on a deep learning model for automatic spatial normalization of 18F-FDG brain PET images, which was developed by fine-tuning a pretrained model for amyloid PET using only 103 18F-FDG PET and MR images. After training, the algorithm was tested on 65 internal and 78 external test sets. All T1 MR images with a 1-mm isotropic voxel size were processed with FreeSurfer software to provide cortical segmentation maps used to extract a ground-truth regional SUV ratio using cerebellar gray matter as a reference region. These values were compared with those from spatial normalization-based quantification methods using the proposed method and statistical parametric mapping software. Results: The proposed method showed superior spatial normalization compared with statistical parametric mapping, as evidenced by increased normalized mutual information and better size and shape matching in PET images. Quantitative evaluation revealed a consistently higher SUV ratio correlation and intraclass correlation coefficients for the proposed method across various brain regions in both internal and external datasets. The remarkably good correlation and intraclass correlation coefficient values of the proposed method for the external dataset are noteworthy, considering the dataset's different ethnic distribution and the use of different PET scanners and image reconstruction algorithms. Conclusion: This study successfully applied transfer learning to a deep neural network for 18F-FDG PET spatial normalization, demonstrating its resource efficiency and improved performance. This highlights the efficacy of transfer learning, which requires a smaller number of datasets than does the original network training, thus increasing the potential for broader use of deep learning-based brain PET spatial normalization techniques for various clinical and research radiotracers.

Future Perspectives of Artificial Intelligence in Bone Marrow Dosimetry and Individualized Radioligand Therapy

Radioligand therapy is an emerging and effective treatment option for various types of malignancies, but may be intricately linked to hematological side effects such as anemia, lymphopenia or thrombocytopenia. The safety and efficacy of novel theranostic agents, targeting increasingly complex targets, can be well served by comprehensive dosimetry. However, optimization in patient management and patient selection based on risk-factors predicting adverse events and built upon reliable dose-response relations is still an open demand. In this context, artificial intelligence methods, especially machine learning and deep learning algorithms, may play a crucial role. This review provides an overview of upcoming opportunities for integrating artificial intelligence methods into the field of dosimetry in nuclear medicine by improving bone marrow and blood dosimetry accuracy, enabling early identification of potential hematological risk-factors, and allowing for adaptive treatment planning. It will further exemplify inspirational success stories from neighboring disciplines that may be translated to nuclear medicine practices, and will provide conceptual suggestions for future directions. In the future, we expect artificial intelligence-assisted (predictive) dosimetry combined with clinical parameters to pave the way towards truly personalized theranostics in radioligand therapy.

Deep transformer-based personalized dosimetry from SPECT/CT images: a hybrid approach for [177Lu]Lu-DOTATATE radiopharmaceutical therapy

PURPOSE

Accurate dosimetry is critical for ensuring the safety and efficacy of radiopharmaceutical therapies. In current clinical dosimetry practice, MIRD formalisms are widely employed. However, with the rapid advancement of deep learning (DL) algorithms, there has been an increasing interest in leveraging the calculation speed and automation capabilities for different tasks. We aimed to develop a hybrid transformer-based deep learning (DL) model that incorporates a multiple voxel S-value (MSV) approach for voxel-level dosimetry in [177Lu]Lu-DOTATATE therapy. The goal was to enhance the performance of the model to achieve accuracy levels closely aligned with Monte Carlo (MC) simulations, considered as the standard of reference. We extended our analysis to include MIRD formalisms (SSV and MSV), thereby conducting a comprehensive dosimetry study.

METHODS

We used a dataset consisting of 22 patients undergoing up to 4 cycles of [177Lu]Lu-DOTATATE therapy. MC simulations were used to generate reference absorbed dose maps. In addition, MIRD formalism approaches, namely, single S-value (SSV) and MSV techniques, were performed. A UNEt TRansformer (UNETR) DL architecture was trained using five-fold cross-validation to generate MC-based dose maps. Co-registered CT images were fed into the network as input, whereas the difference between MC and MSV (MC-MSV) was set as output. DL results are then integrated to MSV to revive the MC dose maps. Finally, the dose maps generated by MSV, SSV, and DL were quantitatively compared to the MC reference at both voxel level and organ level (organs at risk and lesions).

RESULTS

The DL approach showed slightly better performance (voxel relative absolute error (RAE) = 5.28 ± 1.32) compared to MSV (voxel RAE = 5.54 ± 1.4) and outperformed SSV (voxel RAE = 7.8 ± 3.02). Gamma analysis pass rates were 99.0 ± 1.2%, 98.8 ± 1.3%, and 98.7 ± 1.52% for DL, MSV, and SSV approaches, respectively. The computational time for MC was the highest (~2 days for a single-bed SPECT study) compared to MSV, SSV, and DL, whereas the DL-based approach outperformed the other approaches in terms of time efficiency (3 s for a single-bed SPECT). Organ-wise analysis showed absolute percent errors of 1.44 ± 3.05%, 1.18 ± 2.65%, and 1.15 ± 2.5% for SSV, MSV, and DL approaches, respectively, in lesion-absorbed doses.

CONCLUSION

A hybrid transformer-based deep learning model was developed for fast and accurate dose map generation, outperforming the MIRD approaches, specifically in heterogenous regions. The model achieved accuracy close to MC gold standard and has potential for clinical implementation for use on large-scale datasets.

Activity quantification and dosimetry in radiopharmaceutical therapy with reference to 177Lutetium

Radiopharmaceutical therapy has been widely adopted owing primarily to the development of novel radiopharmaceuticals. To fully utilize the potential of these RPTs in the era of precision medicine, therapy must be optimized to the patient's tumor characteristics. The vastly disparate dosimetry methodologies need to be harmonized as the first step towards this. Multiple factors play a crucial role in the shift from empirical activity administration to patient-specific dosimetry-based administrations from RPT. Factors such as variable responses seen in patients with presumably similar clinical characteristics underscore the need to standardize and validate dosimetry calculations. These efforts combined with ongoing initiatives to streamline the dosimetry process facilitate the implementation of radiomolecular precision oncology. However, various challenges hinder the widespread adoption of personalized dosimetry-based activity administration, particularly when compared to the more convenient and resource-efficient approach of empiric activity administration. This review outlines the fundamental principles, procedures, and methodologies related to image activity quantification and dosimetry with a specific focus on 177Lutetium-based radiopharmaceuticals.

Empowering PET: harnessing deep learning for improved clinical insight

This review aims to take a journey into the transformative impact of artificial intelligence (AI) on positron emission tomography (PET) imaging. To this scope, a broad overview of AI applications in the field of nuclear medicine and a thorough exploration of deep learning (DL) implementations in cancer diagnosis and therapy through PET imaging will be presented. We firstly describe the behind-the-scenes use of AI for image generation, including acquisition (event positioning, noise reduction though time-of-flight estimation and scatter correction), reconstruction (data-driven and model-driven approaches), restoration (supervised and unsupervised methods), and motion correction. Thereafter, we outline the integration of AI into clinical practice through the applications to segmentation, detection and classification, quantification, treatment planning, dosimetry, and radiomics/radiogenomics combined to tumour biological characteristics. Thus, this review seeks to showcase the overarching transformation of the field, ultimately leading to tangible improvements in patient treatment and response assessment. Finally, limitations and ethical considerations of the AI application to PET imaging and future directions of multimodal data mining in this discipline will be briefly discussed, including pressing challenges to the adoption of AI in molecular imaging such as the access to and interoperability of huge amount of data as well as the "black-box" problem, contributing to the ongoing dialogue on the transformative potential of AI in nuclear medicine.Relevance statementAI is rapidly revolutionising the world of medicine, including the fields of radiology and nuclear medicine. In the near future, AI will be used to support healthcare professionals. These advances will lead to improvements in diagnosis, in the assessment of response to treatment, in clinical decision making and in patient management.Key points• Applying AI has the potential to enhance the entire PET imaging pipeline.• AI may support several clinical tasks in both PET diagnosis and prognosis.• Interpreting the relationships between imaging and multiomics data will heavily rely on AI.

Impact of deep learning-based multiorgan segmentation methods on patient-specific internal dosimetry in PET/CT imaging: A comparative study

PURPOSE

Accurate and fast multiorgan segmentation is essential in image-based internal dosimetry in nuclear medicine. While conventional manual PET image segmentation is widely used, it suffers from both being time-consuming as well as subject to human error. This study exploited 2D and 3D deep learning (DL) models. Key organs in the trunk of the body were segmented and then used as a reference for networks.

METHODS

The pre-trained p2p-U-Net-GAN and HighRes3D architectures were fine-tuned with PET-only images as inputs. Additionally, the HighRes3D model was alternatively trained with PET/CT images. Evaluation metrics such as sensitivity (SEN), specificity (SPC), intersection over union (IoU), and Dice scores were considered to assess the performance of the networks. The impact of DL-assisted PET image segmentation methods was further assessed using the Monte Carlo (MC)-derived S-values to be used for internal dosimetry.

RESULTS

A fair comparison with manual low-dose CT-aided segmentation of the PET images was also conducted. Although both 2D and 3D models performed well, the HighRes3D offers superior performance with Dice scores higher than 0.90. Key evaluation metrics such as SEN, SPC, and IoU vary between 0.89-0.93, 0.98-0.99, and 0.87-0.89 intervals, respectively, indicating the encouraging performance of the models. The percentage differences between the manual and DL segmentation methods in the calculated S-values varied between 0.1% and 6% with a maximum attributed to the stomach.

CONCLUSION

The findings prove while the incorporation of anatomical information provided by the CT data offers superior performance in terms of Dice score, the performance of HighRes3D remains comparable without the extra CT channel. It is concluded that both proposed DL-based methods provide automated and fast segmentation of whole-body PET/CT images with promising evaluation metrics. Between them, the HighRes3D is more pronounced by providing better performance and can therefore be the method of choice for 18F-FDG-PET image segmentation.

DBPNDNet: dual-branch networks using 3DCNN toward pulmonary nodule detection

With the advancement of artificial intelligence, CNNs have been successfully introduced into the discipline of medical data analyzing. Clinically, automatic pulmonary nodules detection remains an intractable issue since those nodules existing in the lung parenchyma or on the chest wall are tough to be visually distinguished from shadows, background noises, blood vessels, and bones. Thus, when making medical diagnosis, clinical doctors need to first pay attention to the intensity cue and contour characteristic of pulmonary nodules, so as to locate the specific spatial locations of nodules. To automate the detection process, we propose an efficient architecture of multi-task and dual-branch 3D convolution neural networks, called DBPNDNet, for automatic pulmonary nodule detection and segmentation. Among the dual-branch structure, one branch is designed for candidate region extraction of pulmonary nodule detection, while the other incorporated branch is exploited for lesion region semantic segmentation of pulmonary nodules. In addition, we develop a 3D attention weighted feature fusion module according to the doctor's diagnosis perspective, so that the captured information obtained by the designed segmentation branch can further promote the effect of the adopted detection branch mutually. The experiment has been implemented and assessed on the commonly used dataset for medical image analysis to evaluate our designed framework. On average, our framework achieved a sensitivity of 91.33% false positives per CT scan and reached 97.14% sensitivity with 8 FPs per scan. The results of the experiments indicate that our framework outperforms other mainstream approaches.

Radiomics and Artificial Intelligence in Radiotheranostics: A Review of Applications for Radioligands Targeting Somatostatin Receptors and Prostate-Specific Membrane Antigens

Radiotheranostics refers to the pairing of radioactive imaging biomarkers with radioactive therapeutic compounds that deliver ionizing radiation. Given the introduction of very promising radiopharmaceuticals, the radiotheranostics approach is creating a novel paradigm in personalized, targeted radionuclide therapies (TRTs), also known as radiopharmaceuticals (RPTs). Radiotherapeutic pairs targeting somatostatin receptors (SSTR) and prostate-specific membrane antigens (PSMA) are increasingly being used to diagnose and treat patients with metastatic neuroendocrine tumors (NETs) and prostate cancer. In parallel, radiomics and artificial intelligence (AI), as important areas in quantitative image analysis, are paving the way for significantly enhanced workflows in diagnostic and theranostic fields, from data and image processing to clinical decision support, improving patient selection, personalized treatment strategies, response prediction, and prognostication. Furthermore, AI has the potential for tremendous effectiveness in patient dosimetry which copes with complex and time-consuming tasks in the RPT workflow. The present work provides a comprehensive overview of radiomics and AI application in radiotheranostics, focusing on pairs of SSTR- or PSMA-targeting radioligands, describing the fundamental concepts and specific imaging/treatment features. Our review includes ligands radiolabeled by 68Ga, 18F, 177Lu, 64Cu, 90Y, and 225Ac. Specifically, contributions via radiomics and AI towards improved image acquisition, reconstruction, treatment response, segmentation, restaging, lesion classification, dose prediction, and estimation as well as ongoing developments and future directions are discussed.

90Y SPECT scatter estimation and voxel dosimetry in radioembolization using a unified deep learning framework

PURPOSE

90Y SPECT-based dosimetry following radioembolization (RE) in liver malignancies is challenging due to the inherent scatter and the poor spatial resolution of bremsstrahlung SPECT. This study explores a deep-learning-based absorbed dose-rate estimation method for 90Y that mitigates the impact of poor SPECT image quality on dosimetry and the accuracy-efficiency trade-off of Monte Carlo (MC)-based scatter estimation and voxel dosimetry methods.

METHODS

Our unified framework consists of three stages: convolutional neural network (CNN)-based bremsstrahlung scatter estimation, SPECT reconstruction with scatter correction (SC) and absorbed dose-rate map generation with a residual learning network (DblurDoseNet). The input to the framework is the measured SPECT projections and CT, and the output is the absorbed dose-rate map. For training and testing under realistic conditions, we generated a series of virtual patient phantom activity/density maps from post-therapy images of patients treated with 90Y-RE at our clinic. To train the scatter estimation network, we use the scatter projections for phantoms generated from MC simulation as the ground truth (GT). To train the dosimetry network, we use MC dose-rate maps generated directly from the activity/density maps of phantoms as the GT (Phantom + MC Dose). We compared performance of our framework (SPECT w/CNN SC + DblurDoseNet) and MC dosimetry (SPECT w/CNN SC + MC Dose) using normalized root mean square error (NRMSE) and normalized mean absolute error (NMAE) relative to GT.

RESULTS

When testing on virtual patient phantoms, our CNN predicted scatter projections had NRMSE of 4.0% ± 0.7% on average. For the SPECT reconstruction with CNN SC, we observed a significant improvement on NRMSE (9.2% ± 1.7%), compared to reconstructions with no SC (149.5% ± 31.2%). In terms of virtual patient dose-rate estimation, SPECT w/CNN SC + DblurDoseNet had a NMAE of 8.6% ± 5.7% and 5.4% ± 4.8% in lesions and healthy livers, respectively; compared to 24.0% ± 6.1% and 17.7% ± 2.1% for SPECT w/CNN SC + MC Dose. In patient dose-rate maps, though no GT was available, we observed sharper lesion boundaries and increased lesion-to-background ratios with our framework. For a typical patient data set, the trained networks took ~ 1 s to generate the scatter estimate and ~ 20 s to generate the dose-rate map (matrix size: 512 × 512 × 194) on a single GPU (NVIDIA V100).

CONCLUSION

Our deep learning framework, trained using true activity/density maps, has the potential to outperform non-learning voxel dosimetry methods such as MC that are dependent on SPECT image quality. Across comprehensive testing and evaluations on multiple targeted lesions and healthy livers in virtual patients, our proposed deep learning framework demonstrated higher (66% on average in terms of NMAE) estimation accuracy than the current "gold-standard" MC method. The enhanced computing speed with our framework without sacrificing accuracy is highly relevant for clinical dosimetry following 90Y-RE.

On the Use of Artificial Intelligence for Dosimetry of Radiopharmaceutical Therapies

Routine clinical dosimetry along with radiopharmaceutical therapies is key for future treatment personalization. However, dosimetry is considered complex and time-consuming with various challenges amongst the required steps within the dosimetry workflow. The general workflow for image-based dosimetry consists of quantitative imaging, the segmentation of organs and tumors, fitting of the time-activity-curves, and the conversion to absorbed dose. This work reviews the potential and advantages of the use of artificial intelligence to improve speed and accuracy of every single step of the dosimetry workflow.

Future trends for patient-specific dosimetry methodology in molecular radiotherapy

Molecular radiotherapy is rapidly expanding, and new radiotherapeutics are emerging. The majority of treatments is still performed using empirical fixed activities and not tailored for individual patients. Molecular radiotherapy dosimetry is often seen as a promising candidate that would allow personalisation of treatments as outcome should ultimately depend on the absorbed doses delivered and not the activities administered. The field of molecular radiotherapy dosimetry has made considerable progress towards the feasibility of routine clinical dosimetry with reasonably accurate absorbed-dose estimates for a range of molecular radiotherapy dosimetry applications. A range of challenges remain with respect to the accurate quantification, assessment of time-integrated activity and absorbed dose estimation. In this review, we summarise a range of technological and methodological advancements, mainly focussed on beta-emitting molecular radiotherapeutics, that aim to improve molecular radiotherapy dosimetry to achieve accurate, reproducible, and streamlined dosimetry. We describe how these new technologies can potentially improve the often time-consuming considered process of dosimetry and provide suggestions as to what further developments might be required.

Physics-Guided Deep Scatter Estimation by Weak Supervision for Quantitative SPECT

Accurate scatter estimation is important in quantitative SPECT for improving image contrast and accuracy. With a large number of photon histories, Monte-Carlo (MC) simulation can yield accurate scatter estimation, but is computationally expensive. Recent deep learning-based approaches can yield accurate scatter estimates quickly, yet full MC simulation is still required to generate scatter estimates as ground truth labels for all training data. Here we propose a physics-guided weakly supervised training framework for fast and accurate scatter estimation in quantitative SPECT by using a 100× shorter MC simulation as weak labels and enhancing them with deep neural networks. Our weakly supervised approach also allows quick fine-tuning of the trained network to any new test data for further improved performance with an additional short MC simulation (weak label) for patient-specific scatter modelling. Our method was trained with 18 XCAT phantoms with diverse anatomies / activities and then was evaluated on 6 XCAT phantoms, 4 realistic virtual patient phantoms, 1 torso phantom and 3 clinical scans from 2 patients for 177Lu SPECT with single / dual photopeaks (113, 208 keV). Our proposed weakly supervised method yielded comparable performance to the supervised counterpart in phantom experiments, but with significantly reduced computation in labeling. Our proposed method with patient-specific fine-tuning achieved more accurate scatter estimates than the supervised method in clinical scans. Our method with physics-guided weak supervision enables accurate deep scatter estimation in quantitative SPECT, while requiring much lower computation in labeling, enabling patient-specific fine-tuning capability in testing.

The predictive value of pretherapy [68Ga]Ga-DOTA-TATE PET and biomarkers in [177Lu]Lu-PRRT tumor dosimetry

PURPOSE

Metastatic neuroendocrine tumors (NETs) overexpressing type 2 somatostatin receptors are the target for peptide receptor radionuclide therapy (PRRT) through the theragnostic pair of 68Ga/177Lu-DOTATATE. The main purpose of this study was to develop machine learning models to predict therapeutic tumor dose using pre therapy 68Ga -PET and clinicopathological biomarkers.

METHODS

We retrospectively analyzed 90 segmented metastatic NETs from 25 patients (M14/F11, age 63.7 ± 9.5, range 38-76) treated by 177Lu-DOTATATE at our institute. Patients underwent both pretherapy [68Ga]Ga-DOTA-TATE PET/CT and four timepoints SPECT/CT at  ~ 4, 24, 96, and 168 h post-177Lu-DOTATATE infusion. Tumors were segmented by a radiologist on baseline CT or MRI and transferred to co-registered PET/CT and SPECT/CT, and normal organs were segmented by deep learning-based method on CT of the PET and SPECT. The SUV metrics and tumor-to-normal tissue SUV ratios (SUV_TNRs) were calculated from 68Ga -PET at the contour-level. Posttherapy dosimetry was performed based on the co-registration of SPECT/CTs to generate time-integrated-activity, followed by an in-house Monte Carlo-based absorbed dose estimation. The correlation between delivered 177Lu Tumor absorbed dose and PET-derived metrics along with baseline clinicopathological biomarkers (such as Creatinine, Chromogranin A and prior therapies) were evaluated. Multiple interpretable machine-learning algorithms were developed to predict tumor dose using these pretherapy information. Model performance on a nested tenfold cross-validation was evaluated in terms of coefficient of determination (R2), mean-absolute-error (MAE), and mean-relative-absolute-error (MRAE).

RESULTS

SUVmean showed a significant correlation (q-value < 0.05) with absorbed dose (Spearman ρ = 0.64), followed by TLSUVmean (SUVmean of total-lesion-burden) and SUVpeak (ρ = 0.45 and 0.41, respectively). The predictive value of PET-SUVmean in estimation of posttherapy absorbed dose was stronger compared to PET-SUVpeak, and SUV_TNRs in terms of univariate analysis (R2 = 0.28 vs. R2 ≤ 0.12). An optimal trivariate random forest model composed of SUVmean, TLSUVmean, and total liver SUVmean (normal and tumoral liver) provided the best performance in tumor dose prediction with R2 = 0.64, MAE = 0.73 Gy/GBq, and MRAE = 0.2.

CONCLUSION

Our preliminary results demonstrate the feasibility of using baseline PET images for prediction of absorbed dose prior to 177Lu-PRRT. Machine learning models combining multiple PET-based metrics performed better than using a single SUV value and using other investigated clinicopathological biomarkers. Developing such quantitative models forms the groundwork for the role of 68Ga -PET not only for the implementation of personalized treatment planning but also for patient stratification in the era of precision medicine.

Fast dose calculation in x-ray guided interventions by using deep learning

Objective.Patient dose estimation in x-ray-guided interventions is essential to prevent radiation-induced biological side effects. Current dose monitoring systems estimate the skin dose based in dose metrics such as the reference air kerma. However, these approximations do not take into account the exact patient morphology and organs composition. Furthermore, accurate organ dose estimation has not been proposed for these procedures. Monte Carlo simulation can accurately estimate the dose by recreating the irradiation process generated during the x-ray imaging, but at a high computation time, limiting an intra-operative application. This work presents a fast deep convolutional neural network trained with MC simulations for patient dose estimation during x-ray-guided interventions.Approach.We introduced a modified 3D U-Net that utilizes a patient's CT scan and the numerical values of imaging settings as input to produce a Monte Carlo dose map. To create a dataset of dose maps, we simulated the x-ray irradiation process for the abdominal region using a publicly available dataset of 82 patient CT scans. The simulation involved varying the angulation, position, and tube voltage of the x-ray source for each scan. We additionally conducted a clinical study during endovascular abdominal aortic repairs to validate the reliability of our Monte Carlo simulation dose maps. Dose measurements were taken at four specific anatomical points on the skin and compared to the corresponding simulated doses. The proposed network was trained using a 4-fold cross-validation approach with 65 patients, and evaluating the performance on the remaining 17 patients during testing.Main results.The clinical validation demonstrated a average error within the anatomical points of 5.1%. The network yielded test errors of 11.5 ± 4.6% and 6.2 ± 1.5% for peak and average skin doses, respectively. Furthermore, the mean errors for the abdominal region and pancreas doses were 5.0 ± 1.4% and 13.1 ± 2.7%, respectively.Significance.Our network can accurately predict a personalized 3D dose map considering the current imaging settings. A short computation time was achieved, making our approach a potential solution for dose monitoring and reporting commercial systems.

A machine learning-based model for a dose point kernel calculation

PURPOSE

Absorbed dose calculation by kernel convolution requires the prior determination of dose point kernels (DPK). This study reports on the design, implementation, and test of a multi-target regressor approach to generate the DPKs for monoenergetic sources and a model to obtain DPKs for beta emitters.

METHODS

DPK for monoenergetic electron sources were calculated using the FLUKA Monte Carlo (MC) code for many materials of clinical interest and initial energies ranging from 10 to 3000 keV. Regressor Chains (RC) with three different coefficients regularization/shrinkage models were used as base regressors. Electron monoenergetic scaled DPKs (sDPKs) were used to assess the corresponding sDPKs for beta emitters typically used in nuclear medicine, which were compared against reference published data. Finally, the beta emitters sDPK were applied to a patient-specific case calculating the Voxel Dose Kernel (VDK) for a hepatic radioembolization treatment with [Formula: see text]Y.

RESULTS

The three trained machine learning models demonstrated a promising capacity to predict the sDPK for both monoenergetic emissions and beta emitters of clinical interest attaining differences lower than [Formula: see text] in the mean average percentage error (MAPE) as compared with previous studies. Furthermore, differences lower than [Formula: see text] were obtained for the absorbed dose in patient-specific dosimetry comparing against full stochastic MC calculations.

CONCLUSION

An ML model was developed to assess dosimetry calculations in nuclear medicine. The implemented approach has shown the capacity to accurately predict the sDPK for monoenergetic beta sources in a wide range of energy in different materials. The ML model to calculate the sDPK for beta-emitting radionuclides allowed to obtain VDK useful to achieve reliable patient-specific absorbed dose distributions required short computation times.

Voxel-Based Internal Dosimetry for 177Lu-Labeled Radiopharmaceutical Therapy Using Deep Residual Learning

Purpose

In this study, we propose a deep learning (DL)-based voxel-based dosimetry method in which dose maps acquired using the multiple voxel S-value (VSV) approach were used for residual learning.

Methods

Twenty-two SPECT/CT datasets from seven patients who underwent 177Lu-DOTATATE treatment were used in this study. The dose maps generated from Monte Carlo (MC) simulations were used as the reference approach and target images for network training. The multiple VSV approach was used for residual learning and compared with dose maps generated from deep learning. The conventional 3D U-Net network was modified for residual learning. The absorbed doses in the organs were calculated as the mass-weighted average of the volume of interest (VOI).

Results

The DL approach provided a slightly more accurate estimation than the multiple-VSV approach, but the results were not statistically significant. The single-VSV approach yielded a relatively inaccurate estimation. No significant difference was noted between the multiple VSV and DL approach on the dose maps. However, this difference was prominent in the error maps. The multiple VSV and DL approach showed a similar correlation. In contrast, the multiple VSV approach underestimated doses in the low-dose range, but it accounted for the underestimation when the DL approach was applied.

Conclusion

Dose estimation using the deep learning-based approach was approximately equal to that in the MC simulation. Accordingly, the proposed deep learning network is useful for accurate and fast dosimetry after radiation therapy using 177Lu-labeled radiopharmaceuticals.

Dose evaluation of the one-year-old child in PET imaging by18F-(DOPA, FDG, FLT, FET) and68Ga-EDTA using reference voxel phantoms

Because of more sensitive organs due to high growth rates, evaluating the absorbed dose is essential for children to prevent irreparable damage. Therefore, to this aim, a one-year-old child's whole-body effective dose and organ absorbed dose were evaluated for various PET imaging Radiopharmaceuticals such as:¹⁸F-DOPA,¹⁸F-FDG,¹⁸F-FLT,¹⁸F-FET, and⁶⁸Ga-EDTA. For this aim, one-year-old child reference voxel phantoms and GATE Monte Carlo simulation were used, and the results were compared with the ICRP128 report (for stylized phantom). The highest absorbed dose was related to bladder wall (for¹⁸F-DOPA,¹⁸F-FET, and⁶⁸Ga-EDTA), heart wall (for¹⁸F-FDG), and liver (for¹⁸F-FLT) between 30 organs that have been studied. Comparing the results with the ICRP128 report values for a one-year-old child show a significant difference in some organs. Comparison of the effective dose with the ICRP128 report shows a relative difference of 22%, 12.5%, 11.8%, 10.8% and 8.6% for¹⁸F-DOPA,⁶⁸Ga-EDTA,¹⁸F-FDG,¹⁸F-FET,¹⁸F-FLT, respectively. In conclusion, using new one-year-old voxel phantoms could provide a better estimate of organs absorbed dose and whole-body effective dose due to its exact structure.

Voxel-S-value methods adapted to heterogeneous media for quantitative Y-90 microsphere radioembolization dosimetry

PURPOSE

The absorbed dose estimation from Voxel-S-Value (VSV) method in heterogeneous media is suboptimal as VSVs are calculated in homogeneous media. The aim of this study is to develop and evaluate new VSV methods in order to enhance the accuracy of Y-90 microspheres absorbed dose estimation in liver, lungs, tumors and lung-liver interface regions.

METHODS

Ten patients with Y-90 microspheres SPECT/CT and PET/CT data, six of whom had additional Tc-99m-macroaggregated albumin SPECT/CT data, were analyzed from the Deep Blue Data Repository. Seven existing VSV methods along with three newly proposed VSV methods were evaluated: liver and lung kernel with center voxel scaling (LiLuCK), liver kernel with density correction and lung kernel with center voxel scaling (LiKDLuCK), liver kernel with center voxel scaling and lung kernel with density correction (LiCKLuKD). Monte Carlo (MC) results were regarded as the gold standard. Absolute absorbed dose errors (%AADE) of these methods for the liver, lungs, tumors, upper liver, and lower lungs were assessed.

RESULTS

Liver and tumor's median %AADE of all methods were <3% for three types of imaging data. In the lungs, however, three recently proposed VSV methods provided median %AADEs of less than 7%, whereas the differences exceeded 20% for existing methods that did not use a lung kernel. LiCKLuKD could achieve median %AADE <2% in the liver, upper liver and tumors, and median %AADE <7% in the lungs and lower lungs in three types of data.

CONCLUSION

All methods are consistent with MC in the liver and tumors. Methods with tissue-specific kernel and effective correction achieve smaller errors in lungs. LiCKLuKD has comparable results with MC in absorbed dose estimation of Y-90 radioembolization for all target regions.

Artificial Intelligence in Nuclear Medicine: Opportunities, Challenges, and Responsibilities Toward a Trustworthy Ecosystem

Trustworthiness is a core tenet of medicine. The patient-physician relationship is evolving from a dyad to a broader ecosystem of health care. With the emergence of artificial intelligence (AI) in medicine, the elements of trust must be revisited. We envision a road map for the establishment of trustworthy AI ecosystems in nuclear medicine. In this report, AI is contextualized in the history of technologic revolutions. Opportunities for AI applications in nuclear medicine related to diagnosis, therapy, and workflow efficiency, as well as emerging challenges and critical responsibilities, are discussed. Establishing and maintaining leadership in AI require a concerted effort to promote the rational and safe deployment of this innovative technology by engaging patients, nuclear medicine physicians, scientists, technologists, and referring providers, among other stakeholders, while protecting our patients and society. This strategic plan was prepared by the AI task force of the Society of Nuclear Medicine and Molecular Imaging.

A Machine Learning based model for a Dose Point Kernel calculation

PURPOSE

Absorbed dose calculation by kernel convolution requires the prior determination of dose point kernels (DPK). This study shows applications of machine learning to generate the DPKs for monoenergetic sources and a model to obtain DPKs for beta emitters.

METHODS

DPK for monoenergetic electron sources were calculated using the FLUKA Monte Carlo (MC) code for many materials of clinical interest and initial energies ranging from 10 to 3000 keV. Three machine learning (ML) algorithms were trained using the MC DPKs. Electron monoenergetic scaled DPKs (sDPKs) were used to assess the corresponding sDPKs for beta emitters typically used in nuclear medicine, which were compared against reference published data. Finally, the ML sDPK approach was applied to a patient-specific case calculating the dose voxel kernels (DVK) for a hepatic radioembolization treatment with \(^{90}\)Y.

RESULTS

The three trained machine learning models demonstrated a promising capacity to predict the sDPK for both monoenergetic emissions and beta emitters of clinical interest attaining differences lower than \(10%\) in the mean average percentage error (MAPE) as compared with previous studies. Furthermore, differences lower than \(7 %\) were obtained for the absorbed dose in patient-specific dosimetry comparing against full stochastic MC calculations.

CONCLUSION

An ML model was developed to assess dosimetry calculations in nuclear medicine. The implemented approach has shown the capacity to accurately predict the sDPK for monoenergetic beta sources in a wide range of energy in different materials. The ML model to calculate the sDPK for beta-emitting radionuclides allowed to obtain VDK useful to achieve reliable patient-specific absorbed dose distributions required remarkable short computation times.

Deep-TOF-PET: Deep learning-guided generation of time-of-flight from non-TOF brain PET images in the image and projection domains

We aim to synthesize brain time-of-flight (TOF) PET images/sinograms from their corresponding non-TOF information in the image space (IS) and sinogram space (SS) to increase the signal-to-noise ratio (SNR) and contrast of abnormalities, and decrease the bias in tracer uptake quantification. One hundred forty clinical brain 18 F-FDG PET/CT scans were collected to generate TOF and non-TOF sinograms. The TOF sinograms were split into seven time bins (0, ±1, ±2, ±3). The predicted TOF sinogram was reconstructed and the performance of both models (IS and SS) compared with reference TOF and non-TOF. Wide-ranging quantitative and statistical analysis metrics, including structural similarity index metric (SSIM), root mean square error (RMSE), as well as 28 radiomic features for 83 brain regions were extracted to evaluate the performance of the CycleGAN model. SSIM and RMSE of 0.99 ± 0.03, 0.98 ± 0.02 and 0.12 ± 0.09, 0.16 ± 0.04 were achieved for the generated TOF-PET images in IS and SS, respectively. They were 0.97 ± 0.03 and 0.22 ± 0.12, respectively, for non-TOF-PET images. The Bland & Altman analysis revealed that the lowest tracer uptake value bias (-0.02%) and minimum variance (95% CI: -0.17%, +0.21%) were achieved for TOF-PET images generated in IS. For malignant lesions, the contrast in the test dataset was enhanced from 3.22 ± 2.51 for non-TOF to 3.34 ± 0.41 and 3.65 ± 3.10 for TOF PET in SS and IS, respectively. The implemented CycleGAN is capable of generating TOF from non-TOF PET images to achieve better image quality.

3D Convolutional Neural Network Framework with Deep Learning for Nuclear Medicine

Though artificial intelligence (AI) has been used in nuclear medicine for more than 50 years, more progress has been made in deep learning (DL) and machine learning (ML), which have driven the development of new AI abilities in the field. ANNs are used in both deep learning and machine learning in nuclear medicine. Alternatively, if 3D convolutional neural network (CNN) is used, the inputs may be the actual images that are being analyzed, rather than a set of inputs. In nuclear medicine, artificial intelligence reimagines and reengineers the field's therapeutic and scientific capabilities. Understanding the concepts of 3D CNN and U-Net in the context of nuclear medicine provides for a deeper engagement with clinical and research applications, as well as the ability to troubleshoot problems when they emerge. Business analytics, risk assessment, quality assurance, and basic classifications are all examples of simple ML applications. General nuclear medicine, SPECT, PET, MRI, and CT may benefit from more advanced DL applications for classification, detection, localization, segmentation, quantification, and radiomic feature extraction utilizing 3D CNNs. An ANN may be used to analyze a small dataset at the same time as traditional statistical methods, as well as bigger datasets. Nuclear medicine's clinical and research practices have been largely unaffected by the introduction of artificial intelligence (AI). Clinical and research landscapes have been fundamentally altered by the advent of 3D CNN and U-Net applications. Nuclear medicine professionals must now have at least an elementary understanding of AI principles such as neural networks (ANNs) and convolutional neural networks (CNNs).

Robust-Deep: A Method for Increasing Brain Imaging Datasets to Improve Deep Learning Models' Performance and Robustness

A small dataset commonly affects generalization, robustness, and overall performance of deep neural networks (DNNs) in medical imaging research. Since gathering large clinical databases is always difficult, we proposed an analytical method for producing a large realistic/diverse dataset. Clinical brain PET/CT/MR images including full-dose (FD), low-dose (LD) corresponding to only 5 % of events acquired in the FD scan, non-attenuated correction (NAC) and CT-based measured attenuation correction (MAC) PET images, CT images and T1 and T2 MR sequences of 35 patients were included. All images were registered to the Montreal Neurological Institute (MNI) template. Laplacian blending was used to make a natural presentation using information in the frequency domain of images from two separate patients, as well as the blending mask. This classical technique from the computer vision and image processing communities is still widely used and unlike modern DNNs, does not require the availability of training data. A modified ResNet DNN was implemented to evaluate four image-to-image translation tasks, including LD to FD, LD+MR to FD, NAC to MAC, and MRI to CT, with and without using the synthesized images. Quantitative analysis using established metrics, including the peak signal-to-noise ratio (PSNR), structural similarity index metric (SSIM), and joint histogram analysis was performed for quantitative evaluation. The quantitative comparison between the registered small dataset containing 35 patients and the large dataset containing 350 synthesized plus 35 real dataset demonstrated improvement of the RMSE and SSIM by 29% and 8% for LD to FD, 40% and 7% for LD+MRI to FD, 16% and 8% for NAC to MAC, and 24% and 11% for MRI to CT mapping task, respectively. The qualitative/quantitative analysis demonstrated that the proposed model improved the performance of all four DNN models through producing images of higher quality and lower quantitative bias and variance compared to reference images.

Simulation of Gamma-Ray Transmission Buildup Factors for Stratified Spherical Layers

Deterministic particle transport codes usually take into account scattered photons with correct attenuation laws and application of buildup factor to incident beam. Transmission buildup factors for adipose, bone, muscle, and skin human tissues, as well as for various combinations of these media for point isotropic photon source with energies of .15, 1.5 and 15 MeV, for different thickness of layers, were carried out using Geant4 (version 10.5) simulation toolkit. Also, we performed the analysis of existing multilayered shield fitting models (Lin and Jiang, Kalos, Burke and Beck) of buildup factor and the proposition of a new model. We found that the model combining those of Burke and Beck, for low atomic number (Z) followed by high Z materials and Kalos 1 for high Z followed by low Z materials, accurately reproduces simulation results with approximated deviation of 3 ± 3%, 2 ± 2%, and 3 ± 2% for 2, 3, and 4 layers, respectively. Since buildup factors are the key parameter for point kernel calculations, a correct study can be of great interest to the large community of radiation physicists, in general, and to medical imaging and radiotreatment physicists, especially.

Personalized Dosimetry in Targeted Radiation Therapy: A Look to Methods, Tools and Critical Aspects

Targeted radiation therapy (TRT) is a strategy increasingly adopted for the treatment of different types of cancer. The urge for optimization, as stated by the European Council Directive (2013/59/EURATOM), requires the implementation of a personalized dosimetric approach, similar to what already happens in external beam radiation therapy (EBRT). The purpose of this paper is to provide a thorough introduction to the field of personalized dosimetry in TRT, explaining its rationale in the context of optimization and describing the currently available methodologies. After listing the main therapies currently employed, the clinical workflow for the absorbed dose calculation is described, based on works of the most experienced authors in the literature and recent guidelines. Moreover, the widespread software packages for internal dosimetry are presented and critical aspects discussed. Overall, a selection of the most important and recent articles about this topic is provided.

COLI-Net: Deep learning-assisted fully automated COVID-19 lung and infection pneumonia lesion detection and segmentation from chest computed tomography images

We present a deep learning (DL)-based automated whole lung and COVID-19 pneumonia infectious lesions (COLI-Net) detection and segmentation from chest computed tomography (CT) images. This multicenter/multiscanner study involved 2368 (347'259 2D slices) and 190 (17 341 2D slices) volumetric CT exams along with their corresponding manual segmentation of lungs and lesions, respectively. All images were cropped, resized, and the intensity values clipped and normalized. A residual network with non-square Dice loss function built upon TensorFlow was employed. The accuracy of lung and COVID-19 lesions segmentation was evaluated on an external reverse transcription-polymerase chain reaction positive COVID-19 dataset (7'333 2D slices) collected at five different centers. To evaluate the segmentation performance, we calculated different quantitative metrics, including radiomic features. The mean Dice coefficients were 0.98 ± 0.011 (95% CI, 0.98-0.99) and 0.91 ± 0.038 (95% CI, 0.90-0.91) for lung and lesions segmentation, respectively. The mean relative Hounsfield unit differences were 0.03 ± 0.84% (95% CI, -0.12 to 0.18) and -0.18 ± 3.4% (95% CI, -0.8 to 0.44) for the lung and lesions, respectively. The relative volume difference for lung and lesions were 0.38 ± 1.2% (95% CI, 0.16-0.59) and 0.81 ± 6.6% (95% CI, -0.39 to 2), respectively. Most radiomic features had a mean relative error less than 5% with the highest mean relative error achieved for the lung for the range first-order feature (-6.95%) and least axis length shape feature (8.68%) for lesions. We developed an automated DL-guided three-dimensional whole lung and infected regions segmentation in COVID-19 patients to provide fast, consistent, robust, and human error immune framework for lung and pneumonia lesion detection and quantification.

Quantitative SPECT/CT for dosimetry of peptide receptor radionuclide therapy

Neuroendocrine tumors (NETs) are uncommon malignancies of increasing incidence and prevalence. As these slow growing tumors usually overexpress somatostatin receptors (SSTRs), the use of ⁶⁸Ga-DOTA-peptides (gallium-68 chelated with dodecane tetra-acetic acid to somatostatin), which bind to the SSTRs, allows for PET based imaging and selection of patients for peptide receptor radionuclide therapy (PRRT). PRRT with radiolabeled somatostatin analogues such as ¹⁷⁷Lu-DOTATATE (lutetium-177-[DOTA,Tyr³]-octreotate), is mainly used for the treatment of metastatic or inoperable NETs. However, PRRT is generally administered at a fixed injected activity in order not to exceed dose limits in critical organs, which is suboptimal given the variability in radiopharmaceutical uptake among patients. Advances in SPECT (single photon emission computed tomography) imaging enable the absolute quantitative measure of the true radiopharmaceutical distribution providing for PRRT dosimetry in each patient. Personalized PRRT based on patient-specific dosimetry could improve therapeutic efficacy by optimizing effective tumor absorbed dose while limiting treatment related radiotoxicity.

DblurDoseNet: A deep residual learning network for voxel radionuclide dosimetry compensating for single-photon emission computerized tomography imaging resolution

PURPOSE

Current methods for patient-specific voxel-level dosimetry in radionuclide therapy suffer from a trade-off between accuracy and computational efficiency. Monte Carlo (MC) radiation transport algorithms are considered the gold standard for voxel-level dosimetry but can be computationally expensive, whereas faster dose voxel kernel (DVK) convolution can be suboptimal in the presence of tissue heterogeneities. Furthermore, the accuracies of both these methods are limited by the spatial resolution of the reconstructed emission image. To overcome these limitations, this paper considers a single deep convolutional neural network (CNN) with residual learning (named DblurDoseNet) that learns to produce dose-rate maps while compensating for the limited resolution of SPECT images.

METHODS

We trained our CNN using MC-generated dose-rate maps that directly corresponded to the true activity maps in virtual patient phantoms. Residual learning was applied such that our CNN learned only the difference between the true dose-rate map and DVK dose-rate map with density scaling. Our CNN consists of a 3D depth feature extractor followed by a 2D U-Net, where the input was 11 slices (3.3 cm) of a given Lu-177 SPECT/CT image and density map, and the output was the dose-rate map corresponding to the center slice. The CNN was trained with nine virtual patient phantoms and tested on five different phantoms plus 42 SPECT/CT scans of patients who underwent Lu-177 DOTATATE therapy.

RESULTS

When testing on virtual patient phantoms, the lesion/organ mean dose-rate error and the normalized root mean square error (NRMSE) relative to the ground truth of the CNN method was consistently lower than DVK and MC, when applied to SPECT images. Compared to DVK/MC, the average improvement for the CNN in mean dose-rate error was 55%/53% and 66%/56%; and in NRMSE was 18%/17% and 10%/11% for lesion and kidney regions, respectively. Line profiles and dose-volume histograms demonstrated compensation for SPECT resolution effects in the CNN-generated dose-rate maps. The ensemble noise standard deviation, determined from multiple Poisson realizations, was improved by 21%/27% compared to DVK/MC. In patients, potential improvements from CNN dose-rate maps compared to DVK/MC were illustrated qualitatively, due to the absence of ground truth. The trained residual CNN took about 30 s on a single GPU (Tesla V100) to generate a 512 × 512 × 130 dose-rate map for a patient.

CONCLUSION

The proposed residual CNN, trained using phantoms generated from patient images, has potential for real-time patient-specific dosimetry in clinical treatment planning due to its demonstrated improvement in accuracy, resolution, noise, and speed over the DVK/MC approaches.

DeepTOFSino: A deep learning model for synthesizing full-dose time-of-flight bin sinograms from their corresponding low-dose sinograms

PURPOSE

Reducing the injected activity and/or the scanning time is a desirable goal to minimize radiation exposure and maximize patients' comfort. To achieve this goal, we developed a deep neural network (DNN) model for synthesizing full-dose (FD) time-of-flight (TOF) bin sinograms from their corresponding fast/low-dose (LD) TOF bin sinograms.

METHODS

Clinical brain PET/CT raw data of 140 normal and abnormal patients were employed to create LD and FD TOF bin sinograms. The LD TOF sinograms were created through 5% undersampling of FD list-mode PET data. The TOF sinograms were split into seven time bins (0, ±1, ±2, ±3). Residual network (ResNet) algorithms were trained separately to generate FD bins from LD bins. An extra ResNet model was trained to synthesize FD images from LD images to compare the performance of DNN in sinogram space (SS) vs implementation in image space (IS). Comprehensive quantitative and statistical analysis was performed to assess the performance of the proposed model using established quantitative metrics, including the peak signal-to-noise ratio (PSNR), structural similarity index metric (SSIM) region-wise standardized uptake value (SUV) bias and statistical analysis for 83 brain regions.

RESULTS

SSIM and PSNR values of 0.97 ± 0.01, 0.98 ± 0.01 and 33.70 ± 0.32, 39.36 ± 0.21 were obtained for IS and SS, respectively, compared to 0.86 ± 0.02and 31.12 ± 0.22 for reference LD images. The absolute average SUV bias was 0.96 ± 0.95% and 1.40 ± 0.72% for SS and IS implementations, respectively. The joint histogram analysis revealed the lowest mean square error (MSE) and highest correlation (R² = 0.99, MSE = 0.019) was achieved by SS compared to IS (R² = 0.97, MSE= 0.028). The Bland & Altman analysis showed that the lowest SUV bias (-0.4%) and minimum variance (95% CI: -2.6%, +1.9%) were achieved by SS images. The voxel-wise t-test analysis revealed the presence of voxels with statistically significantly lower values in LD, IS, and SS images compared to FD images respectively.

CONCLUSION

The results demonstrated that images reconstructed from the predicted TOF FD sinograms using the SS approach led to higher image quality and lower bias compared to images predicted from LD images.

Fully Automated Gross Tumor Volume Delineation From PET in Head and Neck Cancer Using Deep Learning Algorithms

PURPOSE

The availability of automated, accurate, and robust gross tumor volume (GTV) segmentation algorithms is critical for the management of head and neck cancer (HNC) patients. In this work, we evaluated 3 state-of-the-art deep learning algorithms combined with 8 different loss functions for PET image segmentation using a comprehensive training set and evaluated its performance on an external validation set of HNC patients.

PATIENTS AND METHODS

18F-FDG PET/CT images of 470 patients presenting with HNC on which manually defined GTVs serving as standard of reference were used for training (340 patients), evaluation (30 patients), and testing (100 patients from different centers) of these algorithms. PET image intensity was converted to SUVs and normalized in the range (0-1) using the SUVmax of the whole data set. PET images were cropped to 12 × 12 × 12 cm3 subvolumes using isotropic voxel spacing of 3 × 3 × 3 mm3 containing the whole tumor and neighboring background including lymph nodes. We used different approaches for data augmentation, including rotation (-15 degrees, +15 degrees), scaling (-20%, 20%), random flipping (3 axes), and elastic deformation (sigma = 1 and proportion to deform = 0.7) to increase the number of training sets. Three state-of-the-art networks, including Dense-VNet, NN-UNet, and Res-Net, with 8 different loss functions, including Dice, generalized Wasserstein Dice loss, Dice plus XEnt loss, generalized Dice loss, cross-entropy, sensitivity-specificity, and Tversky, were used. Overall, 28 different networks were built. Standard image segmentation metrics, including Dice similarity, image-derived PET metrics, first-order, and shape radiomic features, were used for performance assessment of these algorithms.

RESULTS

The best results in terms of Dice coefficient (mean ± SD) were achieved by cross-entropy for Res-Net (0.86 ± 0.05; 95% confidence interval [CI], 0.85-0.87), Dense-VNet (0.85 ± 0.058; 95% CI, 0.84-0.86), and Dice plus XEnt for NN-UNet (0.87 ± 0.05; 95% CI, 0.86-0.88). The difference between the 3 networks was not statistically significant (P > 0.05). The percent relative error (RE%) of SUVmax quantification was less than 5% in networks with a Dice coefficient more than 0.84, whereas a lower RE% (0.41%) was achieved by Res-Net with cross-entropy loss. For maximum 3-dimensional diameter and sphericity shape features, all networks achieved a RE ≤ 5% and ≤10%, respectively, reflecting a small variability.

CONCLUSIONS

Deep learning algorithms exhibited promising performance for automated GTV delineation on HNC PET images. Different loss functions performed competitively when using different networks and cross-entropy for Res-Net, Dense-VNet, and Dice plus XEnt for NN-UNet emerged as reliable networks for GTV delineation. Caution should be exercised for clinical deployment owing to the occurrence of outliers in deep learning-based algorithms.

Role of Artificial Intelligence in Theranostics:: Toward Routine Personalized Radiopharmaceutical Therapies

We highlight emerging uses of artificial intelligence (AI) in the field of theranostics, focusing on its significant potential to enable routine and reliable personalization of radiopharmaceutical therapies (RPTs). Personalized RPTs require patient-specific dosimetry calculations accompanying therapy. Additionally we discuss the potential to exploit biological information from diagnostic and therapeutic molecular images to derive biomarkers for absorbed dose and outcome prediction; toward personalization of therapies. We try to motivate the nuclear medicine community to expand and align efforts into making routine and reliable personalization of RPTs a reality.

Personalized brachytherapy dose reconstruction using deep learning

BACKGROUND AND PURPOSE

Accurate calculation of the absorbed dose delivered to the tumor and normal tissues improves treatment gain factor, which is the major advantage of brachytherapy over external radiation therapy. To address the simplifications of TG-43 assumptions that ignore the dosimetric impact of medium heterogeneities, we proposed a deep learning (DL)-based approach, which improves the accuracy while requiring a reasonable computation time.

MATERIALS AND METHODS

We developed a Monte Carlo (MC)-based personalized brachytherapy dosimetry simulator (PBrDoseSim), deployed to generate patient-specific dose distributions. A deep neural network (DNN) was trained to predict personalized dose distributions derived from MC simulations, serving as ground truth. The paired channel input used for the training is composed of dose distribution kernel in water medium along with the full-volumetric density maps obtained from CT images reflecting medium heterogeneity.

RESULTS

The predicted single-dwell dose kernels were in good agreement with MC-based kernels serving as reference, achieving a mean relative absolute error (MRAE) and mean absolute error (MAE) of 1.16 ± 0.42% and 4.2 ± 2.7 × 10^-4 (Gy.sec^-1/voxel), respectively. The MRAE of the dose volume histograms (DVHs) between the DNN and MC calculations in the clinical target volume were 1.8 ± 0.86%, 0.56 ± 0.56%, and 1.48 ± 0.72% for D90, V150, and V100, respectively. For bladder, sigmoid, and rectum, the MRAE of D5cc between the DNN and MC calculations were 2.7 ± 1.7%, 1.9 ± 1.3%, and 2.1 ± 1.7%, respectively.

CONCLUSION

The proposed DNN-based personalized brachytherapy dosimetry approach exhibited comparable performance to the MC method while overcoming the computational burden of MC calculations and oversimplifications of TG-43.

Deep learning-assisted ultra-fast/low-dose whole-body PET/CT imaging

PURPOSE

Tendency is to moderate the injected activity and/or reduce acquisition time in PET examinations to minimize potential radiation hazards and increase patient comfort. This work aims to assess the performance of regular full-dose (FD) synthesis from fast/low-dose (LD) whole-body (WB) PET images using deep learning techniques.

METHODS

Instead of using synthetic LD scans, two separate clinical WB 18F-Fluorodeoxyglucose (18F-FDG) PET/CT studies of 100 patients were acquired: one regular FD (~ 27 min) and one fast or LD (~ 3 min) consisting of 1/8th of the standard acquisition time. A modified cycle-consistent generative adversarial network (CycleGAN) and residual neural network (ResNET) models, denoted as CGAN and RNET, respectively, were implemented to predict FD PET images. The quality of the predicted PET images was assessed by two nuclear medicine physicians. Moreover, the diagnostic quality of the predicted PET images was evaluated using a pass/fail scheme for lesion detectability task. Quantitative analysis using established metrics including standardized uptake value (SUV) bias was performed for the liver, left/right lung, brain, and 400 malignant lesions from the test and evaluation datasets.

RESULTS

CGAN scored 4.92 and 3.88 (out of 5) (adequate to good) for brain and neck + trunk, respectively. The average SUV bias calculated over normal tissues was 3.39 ± 0.71% and - 3.83 ± 1.25% for CGAN and RNET, respectively. Bland-Altman analysis reported the lowest SUV bias (0.01%) and 95% confidence interval of - 0.36, + 0.47 for CGAN compared with the reference FD images for malignant lesions.

CONCLUSION

CycleGAN is able to synthesize clinical FD WB PET images from LD images with 1/8th of standard injected activity or acquisition time. The predicted FD images present almost similar performance in terms of lesion detectability, qualitative scores, and quantification bias and variance.

Applications of artificial intelligence in nuclear medicine image generation

Recently, the application of artificial intelligence (AI) in medical imaging (including nuclear medicine imaging) has rapidly developed. Most AI applications in nuclear medicine imaging have focused on the diagnosis, treatment monitoring, and correlation analyses with pathology or specific gene mutation. It can also be used for image generation to shorten the time of image acquisition, reduce the dose of injected tracer, and enhance image quality. This work provides an overview of the application of AI in image generation for single-photon emission computed tomography (SPECT) and positron emission tomography (PET) either without or with anatomical information [CT or magnetic resonance imaging (MRI)]. This review focused on four aspects, including imaging physics, image reconstruction, image postprocessing, and internal dosimetry. AI application in generating attenuation map, estimating scatter events, boosting image quality, and predicting internal dose map is summarized and discussed.