Unsupervised arterial spin labeling image super-resolution via multi-scale generative adversarial network

High-resolution MRI synthesis using a data-driven framework with denoising diffusion probabilistic modeling

Objective. High-resolution magnetic resonance imaging (MRI) can enhance lesion diagnosis, prognosis, and delineation. However, gradient power and hardware limitations prohibit recording thin slices or sub-1 mm resolution. Furthermore, long scan time is not clinically acceptable. Conventional high-resolution images generated using statistical or analytical methods include the limitation of capturing complex, high-dimensional image data with intricate patterns and structures. This study aims to harness cutting-edge diffusion probabilistic deep learning techniques to create a framework for generating high-resolution MRI from low-resolution counterparts, improving the uncertainty of denoising diffusion probabilistic models (DDPM).Approach. DDPM includes two processes. The forward process employs a Markov chain to systematically introduce Gaussian noise to low-resolution MRI images. In the reverse process, a U-Net model is trained to denoise the forward process images and produce high-resolution images conditioned on the features of their low-resolution counterparts. The proposed framework was demonstrated using T2-weighted MRI images from institutional prostate patients and brain patients collected in the Brain Tumor Segmentation Challenge 2020 (BraTS2020).Main results. For the prostate dataset, the bicubic interpolation model (Bicubic), conditional generative-adversarial network (CGAN), and our proposed DDPM framework improved the noise quality measure from low-resolution images by 4.4%, 5.7%, and 12.8%, respectively. Our method enhanced the signal-to-noise ratios by 11.7%, surpassing Bicubic (9.8%) and CGAN (8.1%). In the BraTS2020 dataset, the proposed framework and Bicubic enhanced peak signal-to-noise ratio from resolution-degraded images by 9.1% and 5.8%. The multi-scale structural similarity indexes were 0.970 ± 0.019, 0.968 ± 0.022, and 0.967 ± 0.023 for the proposed method, CGAN, and Bicubic, respectively.Significance. This study explores a deep learning-based diffusion probabilistic framework for improving MR image resolution. Such a framework can be used to improve clinical workflow by obtaining high-resolution images without penalty of the long scan time. Future investigation will likely focus on prospectively testing the efficacy of this framework with different clinical indications.

Bidirectional Mapping Perception-enhanced Cycle-consistent Generative Adversarial Network for Super-resolution of Brain MRI images

As an effective tool for visualizing neurodegeneration, high-resolution structural magnetism facilitates quantitative image analysis and clinical applications. Super-resolution reconstruction technology allows to improve the resolution of images without upgrading the scanning hardware. However, existing super-resolution techniques relied on paired image data sets and lacked further quantitative analysis of the generated images. In this study, we proposed a semi-supervised generative adversarial network (GAN) model for super-resolution of brain MRI, and the synthetic images were evaluated using various quantitative measures. This model adopted the cycle-consistency structure to allow for a mixture of unpaired data for training. Perceptual loss was further introduced into the model to preserve detailed texture features at high frequencies. 363 subjects with both high-resolution (HR) and low-resolution (LR) scans and 217 subjects with HR scans only were used for model derivation, training, and validation. We extracted multiple voxel-based and surface-based morphological features of the synthetic and real 3D HR images for comparison. We further evaluated the synthetic images in the differential diagnosis of diseases. Our model achieved superior mean absolute error (0.049±0.021), mean squared error (0.0059±0.0043), peak signal-to-noise ratio (29.41±3.71), structural similarity index measure (0.914±0.048). Eight morphological metrics, both voxel-based and surface-based, showed significant agreement (P<0.0001). The gap of accuracy in disease diagnosis between synthetic and real HR images was within 5% and significantly outperformed the LR images. Our proposed model enables the reconstruction of HR MRI and could be used accurately for image quantification.Clinical relevance- Quantitative evaluation of the synthetic high-resolution images was used to determine whether the synthetic images have sufficient realism and diversity.