Temporally aware volumetric generative adversarial network-based MR image reconstruction with simultaneous respiratory motion compensation: Initial feasibility in 3D dynamic cine cardiac MRI

Motion compensated self supervised deep learning for highly accelerated 3D ultrashort Echo time pulmonary MRI

PURPOSE

To investigate motion compensated, self-supervised, model based deep learning (MBDL) as a method to reconstruct free breathing, 3D pulmonary UTE acquisitions.

THEORY AND METHODS

A self-supervised eXtra dimension MBDL architecture (XD-MBDL) was developed that combined respiratory states to reconstruct a single high-quality 3D image. Non-rigid motion fields were incorporated into this architecture by estimating motion fields from a lower resolution motion resolved (XD-GRASP) reconstruction. Motion compensated XD-MBDL was evaluated on lung UTE datasets with and without contrast and compared to constrained reconstructions and variants of self-supervised MBDL that do not account for dynamic respiratory states or leverage motion correction.

RESULTS

Images reconstructed using XD-MBDL demonstrate improved image quality as measured by apparent SNR (aSNR), contrast to noise ratio (CNR), and visual assessment relative to self-supervised MBDL approaches that do not account for dynamic respiratory states, XD-GRASP and a recently proposed motion compensated iterative reconstruction strategy (iMoCo). Additionally, XD-MBDL reduced reconstruction time relative to both XD-GRASP and iMoCo.

CONCLUSION

A method was developed to allow self-supervised MBDL to combine multiple respiratory states to reconstruct a single image. This method was combined with graphics processing unit (GPU)-based image registration to further improve reconstruction quality. This approach showed promising results reconstructing a user-selected respiratory phase from free breathing 3D pulmonary UTE acquisitions.

Image-to-image generative adversarial networks for synthesizing perfusion parameter maps from DSC-MR images in cerebrovascular disease

Stroke is a major cause of death or disability. As imaging-based patient stratification improves acute stroke therapy, dynamic susceptibility contrast magnetic resonance imaging (DSC-MRI) is of major interest in image brain perfusion. However, expert-level perfusion maps require a manual or semi-manual post-processing by a medical expert making the procedure time-consuming and less-standardized. Modern machine learning methods such as generative adversarial networks (GANs) have the potential to automate the perfusion map generation on an expert level without manual validation. We propose a modified pix2pix GAN with a temporal component (temp-pix2pix-GAN) that generates perfusion maps in an end-to-end fashion. We train our model on perfusion maps infused with expert knowledge to encode it into the GANs. The performance was trained and evaluated using the structural similarity index measure (SSIM) on two datasets including patients with acute stroke and the steno-occlusive disease. Our temp-pix2pix architecture showed high performance on the acute stroke dataset for all perfusion maps (mean SSIM 0.92-0.99) and good performance on data including patients with the steno-occlusive disease (mean SSIM 0.84-0.99). While clinical validation is still necessary for future studies, our results mark an important step toward automated expert-level perfusion maps and thus fast patient stratification.

Undersampling artifact reduction for free-breathing 3D stack-of-radial MRI based on a deep adversarial learning network

PURPOSE

Stack-of-radial MRI allows free-breathing abdominal scans, however, it requires relatively long acquisition time. Undersampling reduces scan time but can cause streaking artifacts and degrade image quality. This study developed deep learning networks with adversarial loss and evaluated the performance of reducing streaking artifacts and preserving perceptual image sharpness.

METHODS

A 3D generative adversarial network (GAN) was developed for reducing streaking artifacts in stack-of-radial abdominal scans. Training and validation datasets were self-gated to 5 respiratory states to reduce motion artifacts and to effectively augment the data. The network used a combination of three loss functions to constrain the anatomy and preserve image quality: adversarial loss, mean-squared-error loss and structural similarity index loss. The performance of the network was investigated for 3-5 times undersampled data from 2 institutions. The performance of the GAN for 5 times accelerated images was compared with a 3D U-Net and evaluated using quantitative NMSE, SSIM and region of interest (ROI) measurements as well as qualitative scores of radiologists.

RESULTS

The 3D GAN showed similar NMSE (0.0657 vs. 0.0559, p = 0.5217) and significantly higher SSIM (0.841 vs. 0.798, p < 0.0001) compared to U-Net. ROI analysis showed GAN removed streaks in both the background air and the tissue and was not significantly different from the reference mean and variations. Radiologists' scores showed GAN had a significant improvement of 1.6 point (p = 0.004) on a 4-point scale in streaking score while no significant difference in sharpness score compared to the input.

CONCLUSION

3D GAN removes streaking artifacts and preserves perceptual image details.

Cardiac Magnetic Resonance Imaging for the Diagnosis of Infective Endocarditis in the COVID-19 Era

INTRODUCTION

In the COVID-19 pandemic, to minimize aerosol-generating procedures, cardiac magnetic resonance imaging (CMR) was utilized at our institution as an alternative to transesophageal echocardiography (TEE) for diagnosing infective endocarditis (IE).

METHODS

This retrospective study evaluated the clinical utility of CMR for detecting IE among 14 patients growing typical microorganisms on blood cultures or meeting modified Duke criteria.

RESULTS

7 cases were treated for IE. In 2 cases, CMR results were notable for possible leaflet vegetations and were clinically meaningful in guiding antibiotic therapy, obtaining further imaging, and/or pursuing surgical intervention. In 2 cases, vegetations were missed on CMR but detected on TEE. In 3 cases, CMR was nondiagnostic, but patients were treated empirically. There was no difference in antibiotic duration or outcomes over 1 year.

CONCLUSION

CMR demonstrated mixed results in diagnosing valvular vegetations and guiding clinical decision making. Further prospective controlled trials of CMR vs TEE are warranted.