Synthesis of Realistic Simultaneous Positron Emission Tomography and Magnetic Resonance Imaging Data

Synergistic motion compensation strategies for positron emission tomography when acquired simultaneously with magnetic resonance imaging

Subject motion in positron emission tomography (PET) is a key factor that degrades image resolution and quality, limiting its potential capabilities. Correcting for it is complicated due to the lack of sufficient measured PET data from each position. This poses a significant barrier in calculating the amount of motion occurring during a scan. Motion correction can be implemented at different stages of data processing either during or after image reconstruction, and once applied accurately can substantially improve image quality and information accuracy. With the development of integrated PET-MRI (magnetic resonance imaging) scanners, internal organ motion can be measured concurrently with both PET and MRI. In this review paper, we explore the synergistic use of PET and MRI data to correct for any motion that affects the PET images. Different types of motion that can occur during PET-MRI acquisitions are presented and the associated motion detection, estimation and correction methods are reviewed. Finally, some highlights from recent literature in selected human and animal imaging applications are presented and the importance of motion correction for accurate kinetic modelling in dynamic PET-MRI is emphasized. This article is part of the theme issue 'Synergistic tomographic image reconstruction: part 2'.

Flexible numerical simulation framework for dynamic PET-MR data

This paper presents a simulation framework for dynamic PET-MR. The main focus of this framework is to provide motion-resolved MR and PET data and ground truth motion information. This can be used in the optimisation and quantitative evaluation of image registration and in assessing the error propagation due to inaccuracies in motion estimation in complex motion-compensated reconstruction algorithms. Contrast and tracer kinetics can also be simulated and are available as ground truth information. To closely emulate medical examination, input and output of the simulation are files in standardised open-source raw data formats. This enables the use of existing raw data as a template input and ensures seamless integration of the output into existing reconstruction pipelines. The proposed framework was validated in PET-MR and image registration applications. It was used to simulate a FDG-PET-MR scan with cardiac and respiratory motion. Ground truth motion information could be utilised to optimise parameters for PET and synergistic PET-MR image registration. In addition, a free-breathing dynamic contrast enhancement (DCE) abdominal scan of a patient with hepatic lesions was simulated. In order to correct for breathing motion, a motion-corrected image reconstruction scheme was used and a Toft's model was fit to the DCE data to obtain quantitative DCE-MRI parameters. Utilising the ground truth motion information, the dependency of quantitative DCE-MR images on the accuracy of the motion estimation was evaluated. We demonstrated that respiratory motion had to be available with an average accuracy of at least the spatial resolution of the DCE-MR images in order to ensure an improvement in lesions visualisation and quantification compared to no motion correction. The proposed framework provides a valuable tool with a wide range of scientific PET and MR applications and will be available as part of the open-source project Synergistic Image Reconstruction Framework (SIRF).

Arterial Spin Labeling Images Synthesis From sMRI Using Unbalanced Deep Discriminant Learning

Adequate medical images are often indispensable in contemporary deep learning-based medical imaging studies, although the acquisition of certain image modalities may be limited due to several issues including high costs and patients issues. However, thanks to recent advances in deep learning techniques, the above tough problem can be substantially alleviated by medical images synthesis, by which various modalities including T1/T2/DTI MRI images, PET images, cardiac ultrasound images, retinal images, and so on, have already been synthesized. Unfortunately, the arterial spin labeling (ASL) image, which is an important fMRI indicator in dementia diseases diagnosis nowadays, has never been comprehensively investigated for the synthesis purpose yet. In this paper, ASL images have been successfully synthesized from structural magnetic resonance images for the first time. Technically, a novel unbalanced deep discriminant learning-based model equipped with new ResNet sub-structures is proposed to realize the synthesis of ASL images from structural magnetic resonance images. The extensive experiments have been conducted. Comprehensive statistical analyses reveal that: 1) this newly introduced model is capable to synthesize ASL images that are similar towards real ones acquired by actual scanning; 2) synthesized ASL images obtained by the new model have demonstrated outstanding performance when undergoing rigorous tests of region-based and voxel-based corrections of partial volume effects, which are essential in ASL images processing; and 3) it is also promising that the diagnosis performance of dementia diseases can be significantly improved with the help of synthesized ASL images obtained by the new model, based on a multi-modal MRI dataset containing 355 demented patients in this paper.

Offset compensated baseline restoration and computationally efficient hybrid interpolation for the brain PET

The acquisition of positron emission tomography (PET) pulses introduces artifacts and limits the performance of the scanner. To minimize these inadequacies, this work focuses on the design of an offset compensated digital baseline restorer (BLR) along with a two-stage hybrid interpolator. They respectively treat the incoming pulse offsets and limited temporal resolution and improve the scanner performance in terms of calculating depth of interactions and line of responses. The offset of incoming PET pulses is compensated by the BLR and then their interesting parts are selected. The selected signal portion is up-sampled with a hybrid interpolator. It is composed of an optimized weighted least-squares interpolator (WLSI) and a simplified linear interpolator. The processes of calibrating the WLSI coefficients and characterizing the BLR and the interpolator modules are described. The functionality of the proposed modules is verified with an experimental setup. Results have shown that the devised BLR effectively compensates a dynamic range of bipolar offsets. The signal selection process allows focusing only on the relevant signal part and avoids the unnecessary operations during the post-interpolation process. Additionally, the hybrid nature allows improving the signal temporal resolution with an appropriate precession at a reduced computational complexity compared to the mono-interpolation-based arithmetically complex counterparts. The component-level architectures of the BLR and the interpolator modules are also described. It promises an efficient integration of these modules in modern PET scanners while using standard and economical analog-to-digital converters and field-programmable gate arrays. It avoids the development of high-performance and expensive application-specific integrated circuits and results in a cost-effective realization.

SMART (SiMulAtion and ReconsTruction) PET: an efficient PET simulation-reconstruction tool

Background

Positron-emission tomography (PET) simulators are frequently used for development and performance evaluation of segmentation methods or quantitative uptake metrics. To date, most PET simulation tools are based on Monte Carlo simulations, which are computationally demanding. Other analytical simulation tools lack the implementation of time of flight (TOF) or resolution modelling (RM). In this study, a fast and easy-to-use PET simulation-reconstruction package, SiMulAtion and ReconsTruction (SMART)-PET, is developed and validated, which includes both TOF and RM. SMART-PET, its documentation and instructions to calibrate the tool to a specific PET/CT system are available on Zenodo.

SMART-PET allows the fast generation of 3D PET images. As input, it requires one image representing the activity distribution and one representing the corresponding CT image/attenuation map. It allows the user to adjust different parameters, such as reconstruction settings (TOF/RM), noise level or scan duration. Furthermore, a random spatial shift can be included, representing patient repositioning. To evaluate the tool, simulated images were compared with real scan data of the NEMA NU 2 image quality phantom. The scan was acquired as a 60-min list-mode scan and reconstructed with and without TOF and/or RM. For every reconstruction setting, ten statistically equivalent images, representing 30, 60, 120 and 300 s scan duration, were generated. Simulated and real-scan data were compared regarding coefficient of variation in the phantom background and activity recovery coefficients (RCs) of the spheres. Furthermore, standard deviation images of each of the ten statistically equivalent images were compared.

Results

SMART-PET produces images comparable to actual phantom data. The image characteristics of simulated and real PET images varied in similar ways as function of reconstruction protocols and noise levels. The change in image noise with variation of simulated TOF settings followed the theoretically expected behaviour. RC as function of sphere size agreed within 0.3–11% between simulated and actual phantom data.

Conclusions

SMART-PET allows for rapid and easy simulation of PET data. The user can change various acquisition and reconstruction settings (including RM and TOF) and noise levels. The images obtained show similar image characteristics as those seen in actual phantom data.

Electronic supplementary material

The online version of this article (10.1186/s40658-018-0215-x) contains supplementary material, which is available to authorized users.