Short Acquisition Time PET/MR Pharmacokinetic Modelling Using CNNs. In: Frangi AF, Schnabel JA, Davatzikos C, Alberola-lópez C, Fichtinger G, editors. Medical Image Computing and Computer Assisted Intervention – MICCAI 2018. Cham: Springer International Publishing; 2018. pp. 48-56. [DOI: 10.1007/978-3-030-00928-1_6]

Synthetic pulmonary perfusion images from 4DCT for functional avoidance using deep learning

Purpose.To develop and evaluate the performance of a deep learning model to generate synthetic pulmonary perfusion images from clinical 4DCT images for patients undergoing radiotherapy for lung cancer.Methods. A clinical data set of 58 pre- and post-radiotherapy^99mTc-labeled MAA-SPECT perfusion studies (32 patients) each with contemporaneous 4DCT studies was collected. Using the inhale and exhale phases of the 4DCT, a 3D-residual network was trained to create synthetic perfusion images utilizing the MAA-SPECT as ground truth. The training process was repeated for a 50-imaging study, five-fold validation with twenty model instances trained per fold. The highest performing model instance from each fold was selected for inference upon the eight-study test set. A manual lung segmentation was used to compute correlation metrics constrained to the voxels within the lungs. From the pre-treatment test cases (N = 5), 50th percentile contours of well-perfused lung were generated from both the clinical and synthetic perfusion images and the agreement was quantified.Results. Across the hold-out test set, our deep learning model predicted perfusion with a Spearman correlation coefficient of 0.70 (IQR: 0.61-0.76) and a Pearson correlation coefficient of 0.66 (IQR: 0.49-0.73). The agreement of the functional avoidance contour pairs was Dice of 0.803 (IQR: 0.750-0.810) and average surface distance of 5.92 mm (IQR: 5.68-7.55).Conclusion. We demonstrate that from 4DCT alone, a deep learning model can generate synthetic perfusion images with potential application in functional avoidance treatment planning.

Applications of artificial intelligence and deep learning in molecular imaging and radiotherapy

This brief review summarizes the major applications of artificial intelligence (AI), in particular deep learning approaches, in molecular imaging and radiation therapy research. To this end, the applications of artificial intelligence in five generic fields of molecular imaging and radiation therapy, including PET instrumentation design, PET image reconstruction quantification and segmentation, image denoising (low-dose imaging), radiation dosimetry and computer-aided diagnosis, and outcome prediction are discussed. This review sets out to cover briefly the fundamental concepts of AI and deep learning followed by a presentation of seminal achievements and the challenges facing their adoption in clinical setting.

Machine Learning in PET: from Photon Detection to Quantitative Image Reconstruction

Machine learning has found unique applications in nuclear medicine from photon detection to quantitative image reconstruction. While there have been impressive strides in detector development for time-of-flight positron emission tomography, most detectors still make use of simple signal processing methods to extract the time and position information from the detector signals. Now with the availability of fast waveform digitizers, machine learning techniques have been applied to estimate the position and arrival time of high-energy photons. In quantitative image reconstruction, machine learning has been used to estimate various corrections factors, including scattered events and attenuation images, as well as to reduce statistical noise in reconstructed images. Here machine learning either provides a faster alternative to an existing time-consuming computation, such as in the case of scatter estimation, or creates a data-driven approach to map an implicitly defined function, such as in the case of estimating the attenuation map for PET/MR scans. In this article, we will review the abovementioned applications of machine learning in nuclear medicine.