TArgeted Motion Estimation and Reduction (TAMER): Data Consistency Based Motion Mitigation for MRI Using a Reduced Model Joint Optimization

Accelerated motion correction with deep generative diffusion models

PURPOSE

The aim of this work is to develop a method to solve the ill-posed inverse problem of accelerated image reconstruction while correcting forward model imperfections in the context of subject motion during MRI examinations.

METHODS

The proposed solution uses a Bayesian framework based on deep generative diffusion models to jointly estimate a motion-free image and rigid motion estimates from subsampled and motion-corrupt two-dimensional (2D) k-space data.

RESULTS

We demonstrate the ability to reconstruct motion-free images from accelerated two-dimensional (2D) Cartesian and non-Cartesian scans without any external reference signal. We show that our method improves over existing correction techniques on both simulated and prospectively accelerated data.

CONCLUSION

We propose a flexible framework for retrospective motion correction of accelerated MRI based on deep generative diffusion models, with potential application to other forward model corruptions.

Motion compensated structured low-rank reconstruction for 3D multi-shot EPI

PURPOSE

The 3D multi-shot EPI imaging offers several benefits including higher SNR and high isotropic resolution compared to 2D single shot EPI. However, it suffers from shot-to-shot inconsistencies arising from physiologically induced phase variations and bulk motion. This work proposed a motion compensated structured low-rank (mcSLR) reconstruction method to address both issues for 3D multi-shot EPI.

METHODS

Structured low-rank reconstruction has been successfully used in previous work to deal with inter-shot phase variations for 3D multi-shot EPI imaging. It circumvents the estimation of phase variations by reconstructing an individual image for each phase state which are then sum-of-squares combined, exploiting their linear interdependency encoded in structured low-rank constraints. However, structured low-rank constraints become less effective in the presence of inter-shot motion, which corrupts image magnitude consistency and invalidates the linear relationship between shots. Thus, this work jointly models inter-shot phase variations and motion corruptions by incorporating rigid motion compensation for structured low-rank reconstruction, where motion estimates are obtained in a fully data-driven way without relying on external hardware or imaging navigators.

RESULTS

Simulation and in vivo experiments at 7T have demonstrated that the mcSLR method can effectively reduce image artifacts and improve the robustness of 3D multi-shot EPI, outperforming existing methods which only address inter-shot phase variations or motion, but not both.

CONCLUSION

The proposed mcSLR reconstruction compensates for rigid motion, and thus improves the validity of structured low-rank constraints, resulting in improved robustness of 3D multi-shot EPI to both inter-shot motion and phase variations.

Unsupervised MRI motion artifact disentanglement: introducing MAUDGAN

Objective.This study developed an unsupervised motion artifact reduction method for magnetic resonance imaging (MRI) images of patients with brain tumors. The proposed novel design uses multi-parametric multicenter contrast-enhanced T1W (ceT1W) and T2-FLAIR MRI images.Approach.The proposed framework included two generators, two discriminators, and two feature extractor networks. A 3-fold cross-validation was used to train and fine-tune the hyperparameters of the proposed model using 230 brain MRI images with tumors, which were then tested on 148 patients'in-vivodatasets. An ablation was performed to evaluate the model's compartments. Our model was compared with Pix2pix and CycleGAN. Six evaluation metrics were reported, including normalized mean squared error (NMSE), structural similarity index (SSIM), multi-scale-SSIM (MS-SSIM), peak signal-to-noise ratio (PSNR), visual information fidelity (VIF), and multi-scale gradient magnitude similarity deviation (MS-GMSD). Artifact reduction and consistency of tumor regions, image contrast, and sharpness were evaluated by three evaluators using Likert scales and compared with ANOVA and Tukey's HSD tests.Main results.On average, our method outperforms comparative models to remove heavy motion artifacts with the lowest NMSE (18.34±5.07%) and MS-GMSD (0.07 ± 0.03) for heavy motion artifact level. Additionally, our method creates motion-free images with the highest SSIM (0.93 ± 0.04), PSNR (30.63 ± 4.96), and VIF (0.45 ± 0.05) values, along with comparable MS-SSIM (0.96 ± 0.31). Similarly, our method outperformed comparative models in removingin-vivomotion artifacts for different distortion levels except for MS- SSIM and VIF, which have comparable performance with CycleGAN. Moreover, our method had a consistent performance for different artifact levels. For the heavy level of motion artifacts, our method got the highest Likert scores of 2.82 ± 0.52, 1.88 ± 0.71, and 1.02 ± 0.14 (p-values≪0.0001) for our method, CycleGAN, and Pix2pix respectively. Similar trends were also found for other motion artifact levels.Significance.Our proposed unsupervised method was demonstrated to reduce motion artifacts from the ceT1W brain images under a multi-parametric framework.

Deep-learning-based motion correction using multichannel MRI data: a study using simulated artifacts in the fastMRI dataset

Deep learning presents a generalizable solution for motion correction requiring no pulse sequence modifications or additional hardware, but previous networks have all been applied to coil-combined data. Multichannel MRI data provide a degree of spatial encoding that may be useful for motion correction. We hypothesize that incorporating deep learning for motion correction prior to coil combination will improve results. A conditional generative adversarial network was trained using simulated rigid motion artifacts in brain images acquired at multiple sites with multiple contrasts (not limited to healthy subjects). We compared the performance of deep-learning-based motion correction on individual channel images (single-channel model) with that performed after coil combination (channel-combined model). We also investigate simultaneous motion correction of all channel data from an image volume (multichannel model). The single-channel model significantly (p < 0.0001) improved mean absolute error, with an average 50.9% improvement compared with the uncorrected images. This was significantly (p < 0.0001) better than the 36.3% improvement achieved by the channel-combined model (conventional approach). The multichannel model provided no significant improvement in quantitative measures of image quality compared with the uncorrected images. Results were independent of the presence of pathology, and generalizable to a new center unseen during training. Performing motion correction on single-channel images prior to coil combination provided an improvement in performance compared with conventional deep-learning-based motion correction. Improved deep learning methods for retrospective correction of motion-affected MR images could reduce the need for repeat scans if applied in a clinical setting.

A cardiac MRI motion artifact reduction method based on edge enhancement network

Cardiac magnetic resonance imaging (MRI) usually requires a long acquisition time. The movement of the patients during MRI acquisition will produce image artifacts. Previous studies have shown that clear MR image texture edges are of great significance for pathological diagnosis. In this paper, a motion artifact reduction method for cardiac MRI based on edge enhancement network is proposed. Firstly, the four-plane normal vector adaptive fractional differential mask is applied to extract the edge features of blurred images. The four-plane normal vector method can reduce the noise information in the edge feature maps. The adaptive fractional order is selected according to the normal mean gradient and the local Gaussian curvature entropy of the images. Secondly, the extracted edge feature maps and blurred images are input into the de-artifact network. In this network, the edge fusion feature extraction network and the edge fusion transformer network are specially designed. The former combines the edge feature maps with the fuzzy feature maps to extract the edge feature information. The latter combines the edge attention network and the fuzzy attention network, which can focus on the blurred image edges. Finally, extensive experiments show that the proposed method can obtain higher peak signal-to-noise ratio and structural similarity index measure compared to state-of-art methods. The de-artifact images have clear texture edges.

MRI motion artifact reduction using a conditional diffusion probabilistic model (MAR-CDPM)

BACKGROUND

High-resolution magnetic resonance imaging (MRI) with excellent soft-tissue contrast is a valuable tool utilized for diagnosis and prognosis. However, MRI sequences with long acquisition time are susceptible to motion artifacts, which can adversely affect the accuracy of post-processing algorithms.

PURPOSE

This study proposes a novel retrospective motion correction method named "motion artifact reduction using conditional diffusion probabilistic model" (MAR-CDPM). The MAR-CDPM aimed to remove motion artifacts from multicenter three-dimensional contrast-enhanced T1 magnetization-prepared rapid acquisition gradient echo (3D ceT1 MPRAGE) brain dataset with different brain tumor types.

MATERIALS AND METHODS

This study employed two publicly accessible MRI datasets: one containing 3D ceT1 MPRAGE and 2D T2-fluid attenuated inversion recovery (FLAIR) images from 230 patients with diverse brain tumors, and the other comprising 3D T1-weighted (T1W) MRI images of 148 healthy volunteers, which included real motion artifacts. The former was used to train and evaluate the model using the in silico data, and the latter was used to evaluate the model performance to remove real motion artifacts. A motion simulation was performed in k-space domain to generate an in silico dataset with minor, moderate, and heavy distortion levels. The diffusion process of the MAR-CDPM was then implemented in k-space to convert structure data into Gaussian noise by gradually increasing motion artifact levels. A conditional network with a Unet backbone was trained to reverse the diffusion process to convert the distorted images to structured data. The MAR-CDPM was trained in two scenarios: one conditioning on the time step t $t$ of the diffusion process, and the other conditioning on both t $t$ and T2-FLAIR images. The MAR-CDPM was quantitatively and qualitatively compared with supervised Unet, Unet conditioned on T2-FLAIR, CycleGAN, Pix2pix, and Pix2pix conditioned on T2-FLAIR models. To quantify the spatial distortions and the level of remaining motion artifacts after applying the models, quantitative metrics were reported including normalized mean squared error (NMSE), structural similarity index (SSIM), multiscale structural similarity index (MS-SSIM), peak signal-to-noise ratio (PSNR), visual information fidelity (VIF), and multiscale gradient magnitude similarity deviation (MS-GMSD). Tukey's Honestly Significant Difference multiple comparison test was employed to quantify the difference between the models where p-value < 0.05 $ < 0.05$ was considered statistically significant.

RESULTS

Qualitatively, MAR-CDPM outperformed these methods in preserving soft-tissue contrast and different brain regions. It also successfully preserved tumor boundaries for heavy motion artifacts, like the supervised method. Our MAR-CDPM recovered motion-free in silico images with the highest PSNR and VIF for all distortion levels where the differences were statistically significant (p-values< 0.05 $< 0.05$ ). In addition, our method conditioned on t and T2-FLAIR outperformed (p-values< 0.05 $< 0.05$ ) other methods to remove motion artifacts from the in silico dataset in terms of NMSE, MS-SSIM, SSIM, and MS-GMSD. Moreover, our method conditioned on only t outperformed generative models (p-values< 0.05 $< 0.05$ ) and had comparable performances compared with the supervised model (p-values> 0.05 $> 0.05$ ) to remove real motion artifacts.

CONCLUSIONS

The MAR-CDPM could successfully remove motion artifacts from 3D ceT1 MPRAGE. It is particularly beneficial for elderly who may experience involuntary movements during high-resolution MRI imaging with long acquisition times.

Unsupervised dual-domain disentangled network for removal of rigid motion artifacts in MRI

Motion artifacts in magnetic resonance imaging (MRI) have always been a serious issue because they can affect subsequent diagnosis and treatment. Supervised deep learning methods have been investigated for the removal of motion artifacts; however, they require paired data that are difficult to obtain in clinical settings. Although unsupervised methods are widely proposed to fully use clinical unpaired data, they generally focus on anatomical structures generated by the spatial domain while ignoring phase error (deviations or inaccuracies in phase information that are possibly caused by rigid motion artifacts during image acquisition) provided by the frequency domain. In this study, a 2D unsupervised deep learning method named unsupervised disentangled dual-domain network (UDDN) was proposed to effectively disentangle and remove unwanted rigid motion artifacts from images. In UDDN, a dual-domain encoding module was presented to capture different types of information from the spatial and frequency domains to enrich the information. Moreover, a cross-domain attention fusion module was proposed to effectively fuse information from different domains, reduce information redundancy, and improve the performance of motion artifact removal. UDDN was validated on a publicly available dataset and a clinical dataset. Qualitative and quantitative experimental results showed that our method could effectively remove motion artifacts and reconstruct image details. Moreover, the performance of UDDN surpasses that of several state-of-the-art unsupervised methods and is comparable with that of the supervised method. Therefore, our method has great potential for clinical application in MRI, such as real-time removal of rigid motion artifacts.

Motion guidance lines for robust data consistency-based retrospective motion correction in 2D and 3D MRI

PURPOSE

To develop a robust retrospective motion-correction technique based on repeating k-space guidance lines for improving motion correction in Cartesian 2D and 3D brain MRI.

METHODS

The motion guidance lines are inserted into the standard sequence orderings for 2D turbo spin echo and 3D MPRAGE to inform a data consistency-based motion estimation and reconstruction, which can be guided by a low-resolution scout. The extremely limited number of required guidance lines are repeated during each echo train and discarded in the final image reconstruction. Thus, integration within a standard k-space acquisition ordering ensures the expected image quality/contrast and motion sensitivity of that sequence.

RESULTS

Through simulation and in vivo 2D multislice and 3D motion experiments, we demonstrate that respectively 2 or 4 optimized motion guidance lines per shot enables accurate motion estimation and correction. Clinically acceptable reconstruction times are achieved through fully separable on-the-fly motion optimizations (˜1 s/shot) using standard scanner GPU hardware.

CONCLUSION

The addition of guidance lines to scout accelerated motion estimation facilitates robust retrospective motion correction that can be effectively introduced without perturbing standard clinical protocols and workflows.

Single-heartbeat cardiac cine imaging via jointly regularized nonrigid motion-corrected reconstruction

The aim of the current study was to develop a novel approach for 2D breath-hold cardiac cine imaging from a single heartbeat, by combining cardiac motion-corrected reconstructions and nonrigidly aligned patch-based regularization. Conventional cardiac cine imaging is obtained via motion-resolved reconstructions of data acquired over multiple heartbeats. Here, we achieve single-heartbeat cine imaging by incorporating nonrigid cardiac motion correction into the reconstruction of each cardiac phase, in conjunction with a motion-aligned patch-based regularization. The proposed Motion-Corrected CINE (MC-CINE) incorporates all acquired data into the reconstruction of each (motion-corrected) cardiac phase, resulting in a better posed problem than motion-resolved approaches. MC-CINE was compared with iterative sensitivity encoding (itSENSE) and Extra-Dimensional Golden Angle Radial Sparse Parallel (XD-GRASP) in 14 healthy subjects in terms of image sharpness, reader scoring (range: 1-5) and reader ranking (range: 1-9) of image quality, and single-slice left ventricular assessment. MC-CINE was significantly superior to both itSENSE and XD-GRASP using 20 heartbeats, two heartbeats, and one heartbeat. Iterative SENSE, XD-GRASP, and MC-CINE achieved a sharpness of 74%, 74%, and 82% using 20 heartbeats, and 53%, 66%, and 82% with one heartbeat, respectively. The corresponding results for reader scoring were 4.0, 4.7, and 4.9 with 20 heartbeats, and 1.1, 3.0, and 3.9 with one heartbeat. The corresponding results for reader ranking were 5.3, 7.3, and 8.6 with 20 heartbeats, and 1.0, 3.2, and 5.4 with one heartbeat. MC-CINE using a single heartbeat presented nonsignificant differences in image quality to itSENSE with 20 heartbeats. MC-CINE and XD-GRASP at one heartbeat both presented a nonsignificant negative bias of less than 2% in ejection fraction relative to the reference itSENSE. It was concluded that the proposed MC-CINE significantly improves image quality relative to itSENSE and XD-GRASP, enabling 2D cine from a single heartbeat.

Clinical Evaluation of Scout Accelerated Motion Estimation and Reduction Technique for 3D MR Imaging in the Inpatient and Emergency Department Settings

BACKGROUND AND PURPOSE

A scout accelerated motion estimation and reduction (SAMER) framework has been developed for efficient retrospective motion correction. The goal of this study was to perform an initial evaluation of SAMER in a series of clinical brain MR imaging examinations.

MATERIALS AND METHODS

Ninety-seven patients who underwent MR imaging in the inpatient and emergency department settings were included in the study. SAMER motion correction was retrospectively applied to an accelerated T1-weighted MPRAGE sequence that was included in brain MR imaging examinations performed with and without contrast. Two blinded neuroradiologists graded images with and without SAMER motion correction on a 5-tier motion severity scale (none = 1, minimal = 2, mild = 3, moderate = 4, severe = 5).

RESULTS

The median SAMER reconstruction time was 1 minute 47 seconds. SAMER motion correction significantly improved overall motion grades across all examinations (P < .005). Motion artifacts were reduced in 28% of cases, unchanged in 64% of cases, and increased in 8% of cases. SAMER improved motion grades in 100% of moderate motion cases and 75% of severe motion cases. Sixty-nine percent of nondiagnostic motion cases (grades 4 and 5) were considered diagnostic after SAMER motion correction. For cases with minimal or no motion, SAMER had negligible impact on the overall motion grade. For cases with mild, moderate, and severe motion, SAMER improved the motion grade by an average of 0.3 (SD, 0.5), 1.1 (SD, 0.3), and 1.1 (SD, 0.8) grades, respectively.

CONCLUSIONS

SAMER improved the diagnostic image quality of clinical brain MR imaging examinations with motion artifacts. The improvement was most pronounced for cases with moderate or severe motion.

High-resolution dynamic susceptibility contrast perfusion imaging using higher-order temporal smoothness regularization

PURPOSE

To improve image quality and resolution of dynamic susceptibility contrast perfusion weighted imaging (DSC-PWI) by developing acquisition and reconstruction methods exploiting the temporal regularity property of DSC-PWI signal.

THEORY AND METHODS

A novel regularized reconstruction is proposed that recovers DSC-PWI series from interleaved segmented spiral k-space acquisition using higher order temporal smoothness (HOTS) properties of the DSC-PWI signal. The HOTS regularization is designed to tackle representational insufficiency of the standard first-order temporal regularizations for supporting higher accelerations. The higher accelerations allow for k-space coverage with shorter spiral interleaves resulting in improved acquisition point spread function, and acquisition of images at multiple TEs for more accurate DSC-PWI analysis.

RESULTS

The methods were evaluated in simulated and in-vivo studies. HOTS regularization provided increasingly more accurate models for DSC-PWI than the standard first-order methods with either quadratic or robust norms at the expense of increased noise. HOTS DSC-PWI optimized for noise and accuracy demonstrated significant advantages over both spiral DSC-PWI without temporal regularization and traditional echo-planar DSC-PWI, improving resolution and mitigating image artifacts associated with long readout, including blurring and geometric distortions. In context of multi-echo DSC-PWI, the novel methods allowed ∼4.3× decrease of voxel volume, providing 2× number of TEs compared to the previously published results.

CONCLUSIONS

Proposed HOTS reconstruction combined with dynamic spiral sampling represents a valid mechanism for improving image quality and resolution of DSC-PWI significantly beyond those available with established fast imaging techniques.

Deep learning-based motion quantification from k-space for fast model-based magnetic resonance imaging motion correction

BACKGROUND

Intra-scan rigid-body motion is a costly and ubiquitous problem in clinical magnetic resonance imaging (MRI) of the head.

PURPOSE

State-of-the-art methods for retrospective motion correction in MRI are often computationally expensive or in the case of image-to-image deep learning (DL) based methods can be prone to undesired alterations of the image (hallucinations'). In this work we introduce a novel rigid-body motion correction method which combines the advantages of classical model-driven and data-consistency (DC) preserving approaches with a novel DL algorithm, to provide fast and robust retrospective motion correction.

METHODS

The proposed Motion Parameter Estimating Densenet (MoPED) retrospectively estimates subject head motion during MRI acquisitions using a DL network with DenseBlocks and multitask learning. It quantifies the 2D rigid in-plane motion parameters slice-wise for each echo train (ET) of a Cartesian T2-weighted 2D Turbo-Spin-Echo sequence. The network receives a center patch of the motion corrupted k-space as well as an additional motion-free low-resolution reference scan to provide the ground truth orientation. The supervised training utilizes motion simulations based on 28 acquisitions with subject-wise training, validation, and test data splits of 70%, 23%, and 7%. During inference, MoPED is embedded in an iterative DC-driven motion correction algorithm which alternatingly updates estimates of the motion parameters and motion-corrected low-resolution k-space data. The estimated motion parameters are then used to reconstruct the final motion corrected image. The mean absolute/squared error and the Pearson correlation coefficient were used to analyze the motion parameter estimation quality on in-silico data in a quantitative evaluation. Structural similarity (SSIM), DC error and root mean squared error (RMSE) were used as metrics of image quality improvement. Furthermore, the generalization capability of the network was analyzed on two in-vivo motion volumes with 28 slices each and on one simulated T1-weighted volume.

RESULTS

The motion estimation achieves a Pearson correlation of 0.968 to the simulated ground-truth of the 2433 test data slices used. In-silico results indicate that MoPED decreases the time for the optimization by a factor of around 27 compared to a conventional method and is able to reduce the RMSE of the reconstructions and average DC error by more than a factor of two compared to uncorrected images. In-vivo experiments show a decrease in computation time by a factor of around 20, a RMSE decrease from 0.055 to 0.033 and an SSIM increase from 0.795 to 0.862. Furthermore, contrast independence is demonstrated as MoPED is also able to correct T1-weighted images in simulations without retraining. Due to the model-based correction, no hallucinations were observed.

CONCLUSIONS

Incorporating DL in a model-based motion correction algorithm shows great benefit on the optimization and computation time. The k-space-based estimation also allows a data consistent correction and therefore avoids the risk of hallucinations of image-to-image approaches.

Motion-corrected 3D-EPTI with efficient 4D navigator acquisition for fast and robust whole-brain quantitative imaging

PURPOSE

To develop a motion estimation and correction method for motion-robust three-dimensional (3D) quantitative imaging with 3D-echo-planar time-resolved imaging.

THEORY AND METHODS

The 3D-echo-planar time-resolved imaging technique was designed with additional four-dimensional navigator acquisition (x-y-z-echoes) to achieve fast and motion-robust quantitative imaging of the human brain. The four-dimensional-navigator is inserted into the relaxation-recovery deadtime of the sequence in every pulse TR (∼2 s) to avoid extra scan time, and to provide continuous tracking of the 3D head motion and B0 -inhomogeneity changes. By using an optimized spatiotemporal encoding combined with a partial-Fourier scheme, the navigator acquires a large central k-t data block for accurate motion estimation using only four small-flip-angle excitations and readouts, resulting in negligible signal-recovery reduction to the 3D-echo-planar time-resolved imaging acquisition. By incorporating the estimated motion and B0 -inhomogeneity changes into the reconstruction, multi-contrast images can be recovered with reduced motion artifacts.

RESULTS

Simulation shows the cost to the SNR efficiency from the added navigator acquisitions is <1%. Both simulation and in vivo retrospective experiments were conducted, that demonstrate the four-dimensional navigator provided accurate estimation of the 3D motion and B0 -inhomogeneity changes, allowing effective reduction of image artifacts in quantitative maps. Finally, in vivo prospective undersampling acquisition was performed with and without head motion, in which the motion corrupted data after correction show close image quality and consistent quantifications to the motion-free scan, providing reliable quantitative measurements even with head motion.

CONCLUSION

The proposed four-dimensional navigator acquisition provides reliable tracking of the head motion and B0 change with negligible SNR cost, equips the 3D-echo-planar time-resolved imaging technique for motion-robust and efficient quantitative imaging.

Stacked U-Nets with self-assisted priors towards robust correction of rigid motion artifact in brain MRI

Magnetic Resonance Imaging (MRI) is sensitive to motion caused by patient movement due to the relatively long data acquisition time. This could cause severe degradation of image quality and therefore affect the overall diagnosis. In this paper, we develop an efficient retrospective 2D deep learning method called stacked U-Nets with self-assisted priors to address the problem of rigid motion artifacts in 3D brain MRI. The proposed work exploits the usage of additional knowledge priors from the corrupted images themselves without the need for additional contrast data. The proposed network learns the missed structural details through sharing auxiliary information from the contiguous slices of the same distorted subject. We further design a refinement stacked U-Nets that facilitates preserving the spatial image details and improves the pixel-to-pixel dependency. To perform network training, simulation of MRI motion artifacts is inevitable. The proposed network is optimized by minimizing the loss of structural similarity (SSIM) using the synthesized motion-corrupted images from 83 real motion-free subjects. We present an intensive analysis using various types of image priors: the proposed self-assisted priors and priors from other image contrast of the same subject. The experimental analysis proves the effectiveness and feasibility of our self-assisted priors since it does not require any further data scans. The overall image quality of the motion-corrected images via the proposed motion correction network significantly improves SSIM from 71.66% to 95.03% and declines the mean square error from 99.25 to 29.76. These results indicate the high similarity of the brain's anatomical structure in the corrected images compared to the motion-free data. The motion-corrected results of both the simulated and real motion data showed the potential of the proposed motion correction network to be feasible and applicable in clinical practices.

Joint Frequency and Image Space Learning for MRI Reconstruction and Analysis

We propose neural network layers that explicitly combine frequency and image feature representations and show that they can be used as a versatile building block for reconstruction from frequency space data. Our work is motivated by the challenges arising in MRI acquisition where the signal is a corrupted Fourier transform of the desired image. The proposed joint learning schemes enable both correction of artifacts native to the frequency space and manipulation of image space representations to reconstruct coherent image structures at every layer of the network. This is in contrast to most current deep learning approaches for image reconstruction that treat frequency and image space features separately and often operate exclusively in one of the two spaces. We demonstrate the advantages of joint convolutional learning for a variety of tasks, including motion correction, denoising, reconstruction from undersampled acquisitions, and combined undersampling and motion correction on simulated and real world multicoil MRI data. The joint models produce consistently high quality output images across all tasks and datasets. When integrated into a state of the art unrolled optimization network with physics-inspired data consistency constraints for undersampled reconstruction, the proposed architectures significantly improve the optimization landscape, which yields an order of magnitude reduction of training time. This result suggests that joint representations are particularly well suited for MRI signals in deep learning networks. Our code and pretrained models are publicly available at https://github.com/nalinimsingh/interlacer.

Learning-based motion artifact removal networks for quantitative R 2 ∗ mapping

PURPOSE

To introduce two novel learning-based motion artifact removal networks (LEARN) for the estimation of quantitative motion- and B 0 -inhomogeneity-corrected R 2 ∗ maps from motion-corrupted multi-Gradient-Recalled Echo (mGRE) MRI data.

METHODS

We train two convolutional neural networks (CNNs) to correct motion artifacts for high-quality estimation of quantitative B 0 -inhomogeneity-corrected R 2 ∗ maps from mGRE sequences. The first CNN, LEARN-IMG, performs motion correction on complex mGRE images, to enable the subsequent computation of high-quality motion-free quantitative R 2 ∗ (and any other mGRE-enabled) maps using the standard voxel-wise analysis or machine learning-based analysis. The second CNN, LEARN-BIO, is trained to directly generate motion- and B 0 -inhomogeneity-corrected quantitative R 2 ∗ maps from motion-corrupted magnitude-only mGRE images by taking advantage of the biophysical model describing the mGRE signal decay.

RESULTS

We show that both CNNs trained on synthetic MR images are capable of suppressing motion artifacts while preserving details in the predicted quantitative R 2 ∗ maps. Significant reduction of motion artifacts on experimental in vivo motion-corrupted data has also been achieved by using our trained models.

CONCLUSION

Both LEARN-IMG and LEARN-BIO can enable the computation of high-quality motion- and B 0 -inhomogeneity-corrected R 2 ∗ maps. LEARN-IMG performs motion correction on mGRE images and relies on the subsequent analysis for the estimation of R 2 ∗ maps, while LEARN-BIO directly performs motion- and B 0 -inhomogeneity-corrected R 2 ∗ estimation. Both LEARN-IMG and LEARN-BIO jointly process all the available gradient echoes, which enables them to exploit spatial patterns available in the data. The high computational speed of LEARN-BIO is an advantage that can lead to a broader clinical application.

Comparison of prospective and retrospective motion correction in 3D-encoded neuroanatomical MRI

PURPOSE

To compare prospective motion correction (PMC) and retrospective motion correction (RMC) in Cartesian 3D-encoded MPRAGE scans and to investigate the effects of correction frequency and parallel imaging on the performance of RMC.

METHODS

Head motion was estimated using a markerless tracking system and sent to a modified MPRAGE sequence, which can continuously update the imaging FOV to perform PMC. The prospective correction was applied either before each echo train (before-ET) or at every sixth readout within the ET (within-ET). RMC was applied during image reconstruction by adjusting k-space trajectories according to the measured motion. The motion correction frequency was retrospectively increased with RMC or decreased with reverse RMC. Phantom and in vivo experiments were used to compare PMC and RMC, as well as to compare within-ET and before-ET correction frequency during continuous motion. The correction quality was quantitatively evaluated using the structural similarity index measure with a reference image without motion correction and without intentional motion.

RESULTS

PMC resulted in superior image quality compared to RMC both visually and quantitatively. Increasing the correction frequency from before-ET to within-ET reduced the motion artifacts in RMC. A hybrid PMC and RMC correction, that is, retrospectively increasing the correction frequency of before-ET PMC to within-ET, also reduced motion artifacts. Inferior performance of RMC compared to PMC was shown with GRAPPA calibration data without intentional motion and without any GRAPPA acceleration.

CONCLUSION

Reductions in local Nyquist violations with PMC resulted in superior image quality compared to RMC. Increasing the motion correction frequency to within-ET reduced the motion artifacts in both RMC and PMC.

How Machine Learning is Powering Neuroimaging to Improve Brain Health

This report presents an overview of how machine learning is rapidly advancing clinical translational imaging in ways that will aid in the early detection, prediction, and treatment of diseases that threaten brain health. Towards this goal, we aresharing the information presented at a symposium, "Neuroimaging Indicators of Brain Structure and Function - Closing the Gap Between Research and Clinical Application", co-hosted by the McCance Center for Brain Health at Mass General Hospital and the MIT HST Neuroimaging Training Program on February 12, 2021. The symposium focused on the potential for machine learning approaches, applied to increasingly large-scale neuroimaging datasets, to transform healthcare delivery and change the trajectory of brain health by addressing brain care earlier in the lifespan. While not exhaustive, this overview uniquely addresses many of the technical challenges from image formation, to analysis and visualization, to synthesis and incorporation into the clinical workflow. Some of the ethical challenges inherent to this work are also explored, as are some of the regulatory requirements for implementation. We seek to educate, motivate, and inspire graduate students, postdoctoral fellows, and early career investigators to contribute to a future where neuroimaging meaningfully contributes to the maintenance of brain health.

Scout accelerated motion estimation and reduction (SAMER)

PURPOSE

To demonstrate a navigator/tracking-free retrospective motion estimation technique that facilitates clinically acceptable reconstruction time.

METHODS

Scout accelerated motion estimation and reduction (SAMER) uses a single 3-5 s, low-resolution scout scan and a novel sequence reordering to independently determine motion states by minimizing the data-consistency error in a SENSE plus motion forward model. This eliminates time-consuming alternating optimization as no updates to the imaging volume are required during the motion estimation. The SAMER approach was assessed quantitatively through extensive simulation and was evaluated in vivo across multiple motion scenarios and clinical imaging contrasts. Finally, SAMER was synergistically combined with advanced encoding (Wave-CAIPI) to facilitate rapid motion-free imaging.

RESULTS

The highly accelerated scout provided sufficient information to achieve accurate motion trajectory estimation (accuracy ~0.2 mm or degrees). The novel sequence reordering improved the stability of the motion parameter estimation and image reconstruction while preserving the clinical imaging contrast. Clinically acceptable computation times for the motion estimation (~4 s/shot) are demonstrated through a fully separable (non-alternating) motion search across the shots. Substantial artifact reduction was demonstrated in vivo as well as corresponding improvement in the quantitative error metric. Finally, the extension of SAMER to Wave-encoding enabled rapid high-quality imaging at up to R = 9-fold acceleration.

CONCLUSION

SAMER significantly improved the computational scalability for retrospective motion estimation and correction.

Fetal Neuroimaging Updates

MR imaging is used in conjunction with ultrasound screening for fetal brain abnormalities because it offers better contrast, higher resolution, and has multiplanar capabilities that increase the accuracy and confidence of diagnosis. Fetal motion still severely limits the MR imaging sequences that can be acquired. We outline the current acquisition strategies for fetal brain MR imaging and discuss the near term advances that will improve its reliability. Prospective and retrospective motion correction aim to make the complement of MR neuroimaging modalities available for fetal diagnosis, improve the performance of existing modalities, and open new horizons to understanding in utero brain development.

Reducing the Complexity of Model-Based MRI Reconstructions via Sparsification

Model-based reconstruction methods have emerged as a powerful alternative to classical Fourier-based MRI techniques, largely because of their ability to explicitly model (and therefore, potentially overcome) moderate field inhomogeneities, streamline reconstruction from non-Cartesian sampling, and even allow for the use of custom designed non-Fourier encoding methods. Their application in such scenarios, however, often comes with a substantial increase in computational cost, owing to the fact that the corresponding forward model in such settings no longer possesses a direct Fourier Transform based implementation. This paper introduces an algorithmic framework designed to reduce the computational burden associated with model-based MRI reconstruction tasks. The key innovation is the strategic sparsification of the corresponding forward operators for these models, giving rise to approximations of the forward models (and their adjoints) that admit low computational complexity application. This enables overall a reduced computational complexity application of popular iterative first-order reconstruction methods for these reconstruction tasks. Computational results obtained on both synthetic and experimental data illustrate the viability and efficiency of the approach.

A multi-inversion multi-echo spin and gradient echo echo planar imaging sequence with low image distortion for rapid quantitative parameter mapping and synthetic image contrasts

PURPOSE

Brain imaging exams typically take 10-20 min and involve multiple sequential acquisitions. A low-distortion whole-brain echo planar imaging (EPI)-based approach was developed to efficiently encode multiple contrasts in one acquisition, allowing for calculation of quantitative parameter maps and synthetic contrast-weighted images.

METHODS

Inversion prepared spin- and gradient-echo EPI was developed with slice-order shuffling across measurements for efficient acquisition with T1 , T2 , and T 2 ∗ weighting. A dictionary-matching approach was used to fit the images to quantitative parameter maps, which in turn were used to create synthetic weighted images with typical clinical contrasts. Dynamic slice-optimized multi-coil shimming with a B0 shim array was used to reduce B0 inhomogeneity and, therefore, image distortion by >50%. Multi-shot EPI was also implemented to minimize distortion and blurring while enabling high in-plane resolution. A low-rank reconstruction approach was used to mitigate errors from shot-to-shot phase variation.

RESULTS

The slice-optimized shimming approach was combined with in-plane parallel-imaging acceleration of 4× to enable single-shot EPI with more than eight-fold distortion reduction. The proposed sequence efficiently obtained 40 contrasts across the whole-brain in just over 1 min at 1.2 × 1.2 × 3 mm resolution. The multi-shot variant of the sequence achieved higher in-plane resolution of 1 × 1 × 4 mm with good image quality in 4 min. Derived quantitative maps showed comparable values to conventional mapping methods.

CONCLUSION

The approach allows fast whole-brain imaging with quantitative parameter maps and synthetic weighted contrasts. The slice-optimized multi-coil shimming and multi-shot reconstruction approaches result in minimal EPI distortion, giving the sequence the potential to be used in rapid screening applications.

Retrospective motion artifact correction of structural MRI images using deep learning improves the quality of cortical surface reconstructions

Head motion during MRI acquisition presents significant challenges for neuroimaging analyses. In this work, we present a retrospective motion correction framework built on a Fourier domain motion simulation model combined with established 3D convolutional neural network (CNN) architectures. Quantitative evaluation metrics were used to validate the method on three separate multi-site datasets. The 3D CNN was trained using motion-free images that were corrupted using simulated artifacts. CNN based correction successfully diminished the severity of artifacts on real motion affected data on a separate test dataset as measured by significant improvements in image quality metrics compared to a minimal motion reference image. On the test set of 13 image pairs, the mean peak signal-to-noise-ratio was improved from 31.7 to 33.3 dB. Furthermore, improvements in cortical surface reconstruction quality were demonstrated using a blinded manual quality assessment on the Parkinson's Progression Markers Initiative (PPMI) dataset. Upon applying the correction algorithm, out of a total of 617 images, the number of quality control failures was reduced from 61 to 38. On this same dataset, we investigated whether motion correction resulted in a more statistically significant relationship between cortical thickness and Parkinson's disease. Before correction, significant cortical thinning was found to be restricted to limited regions within the temporal and frontal lobes. After correction, there was found to be more widespread and significant cortical thinning bilaterally across the temporal lobes and frontal cortex. Our results highlight the utility of image domain motion correction for use in studies with a high prevalence of motion artifacts, such as studies of movement disorders as well as infant and pediatric subjects.

Appearance Learning for Image-Based Motion Estimation in Tomography

In tomographic imaging, anatomical structures are reconstructed by applying a pseudo-inverse forward model to acquired signals. Geometric information within this process is usually depending on the system setting only, i.e., the scanner position or readout direction. Patient motion therefore corrupts the geometry alignment in the reconstruction process resulting in motion artifacts. We propose an appearance learning approach recognizing the structures of rigid motion independently from the scanned object. To this end, we train a siamese triplet network to predict the reprojection error (RPE) for the complete acquisition as well as an approximate distribution of the RPE along the single views from the reconstructed volume in a multi-task learning approach. The RPE measures the motion-induced geometric deviations independent of the object based on virtual marker positions, which are available during training. We train our network using 27 patients and deploy a 21-4-2 split for training, validation and testing. In average, we achieve a residual mean RPE of 0.013mm with an inter-patient standard deviation of 0.022mm. This is twice the accuracy compared to previously published results. In a motion estimation benchmark the proposed approach achieves superior results in comparison with two state-of-the-art measures in nine out of twelve experiments. The clinical applicability of the proposed method is demonstrated on a motion-affected clinical dataset.

Joint multi-contrast variational network reconstruction (jVN) with application to rapid 2D and 3D imaging

PURPOSE

To improve the image quality of highly accelerated multi-channel MRI data by learning a joint variational network that reconstructs multiple clinical contrasts jointly.

METHODS

Data from our multi-contrast acquisition were embedded into the variational network architecture where shared anatomical information is exchanged by mixing the input contrasts. Complementary k-space sampling across imaging contrasts and Bunch-Phase/Wave-Encoding were used for data acquisition to improve the reconstruction at high accelerations. At 3T, our joint variational network approach across T1w, T2w and T2-FLAIR-weighted brain scans was tested for retrospective under-sampling at R = 6 (2D) and R = 4 × 4 (3D) acceleration. Prospective acceleration was also performed for 3D data where the combined acquisition time for whole brain coverage at 1 mm isotropic resolution across three contrasts was less than 3 min.

RESULTS

Across all test datasets, our joint multi-contrast network better preserved fine anatomical details with reduced image-blurring when compared to the corresponding single-contrast reconstructions. Improvement in image quality was also obtained through complementary k-space sampling and Bunch-Phase/Wave-Encoding where the synergistic combination yielded the overall best performance as evidenced by exemplary slices and quantitative error metrics.

CONCLUSION

By leveraging shared anatomical structures across the jointly reconstructed scans, our joint multi-contrast approach learnt more efficient regularizers, which helped to retain natural image appearance and avoid over-smoothing. When synergistically combined with advanced encoding techniques, the performance was further improved, enabling up to R = 16-fold acceleration with good image quality. This should help pave the way to very rapid high-resolution brain exams.

A High-Speed Low-Cost VLSI System Capable of On-Chip Online Learning for Dynamic Vision Sensor Data Classification

This paper proposes a high-speed low-cost VLSI system capable of on-chip online learning for classifying address-event representation (AER) streams from dynamic vision sensor (DVS) retina chips. The proposed system executes a lightweight statistic algorithm based on simple binary features extracted from AER streams and a Random Ferns classifier to classify these features. The proposed system’s characteristics of multi-level pipelines and parallel processing circuits achieves a high throughput up to 1 spike event per clock cycle for AER data processing. Thanks to the nature of the lightweight algorithm, our hardware system is realized in a low-cost memory-centric paradigm. In addition, the system is capable of on-chip online learning to flexibly adapt to different in-situ application scenarios. The extra overheads for on-chip learning in terms of time and resource consumption are quite low, as the training procedure of the Random Ferns is quite simple, requiring few auxiliary learning circuits. An FPGA prototype of the proposed VLSI system was implemented with 9.5~96.7% memory consumption and <11% computational and logic resources on a Xilinx Zynq-7045 chip platform. It was running at a clock frequency of 100 MHz and achieved a peak processing throughput up to 100 Meps (Mega events per second), with an estimated power consumption of 690 mW leading to a high energy efficiency of 145 Meps/W or 145 event/μJ. We tested the prototype system on MNIST-DVS, Poker-DVS, and Posture-DVS datasets, and obtained classification accuracies of 77.9%, 99.4% and 99.3%, respectively. Compared to prior works, our VLSI system achieves higher processing speeds, higher computing efficiency, comparable accuracy, and lower resource costs.

Correction of out-of-FOV motion artifacts using convolutional neural network

PURPOSE

Subject motion during MRI scan can result in severe degradation of image quality. Existing motion correction algorithms rely on the assumption that no information is missing during motions. However, this assumption does not hold when out-of-FOV motion happens. Currently available algorithms are not able to correct for image artifacts introduced by out-of-FOV motion. The purpose of this study is to demonstrate the feasibility of incorporating convolutional neural network (CNN) derived prior image into solving the out-of-FOV motion problem.

METHODS AND MATERIALS

A modified U-net network was proposed to correct out-of-FOV motion artifacts by incorporating motion parameters into the loss function. A motion model based data fidelity term was applied in combination with the CNN prediction to further improve the motion correction performance. We trained the CNN on 1113 MPRAGE images with simulated oscillating and sudden motion trajectories, and compared our algorithm to a gradient-based autofocusing (AF) algorithm in both 2D and 3D images. Additional experiment was performed to demonstrate the feasibility of transferring the networks to different dataset. We also evaluated the robustness of this algorithm by adding Gaussian noise to the motion parameters. The motion correction performance was evaluated using mean square error (NMSE), peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM).

RESULTS

The proposed algorithm outperformed AF-based algorithm for both 2D (NMSE: 0.0066 ± 0.0009 vs 0.0141 ± 0.008, P < .01; PSNR: 29.60 ± 0.74 vs 21.71 ± 0.27, P < .01; SSIM: 0.89 ± 0.014 vs 0.73 ± 0.004, P < .01) and 3D imaging (NMSE: 0.0067 ± 0.0008 vs 0.070 ± 0.021, P < .01; PSNR: 32.40 ± 1.63 vs 22.32 ± 2.378, P < .01; SSIM: 0.89 ± 0.01 vs 0.62 ± 0.03, P < .01). Robust reconstruction was achieved with 20% data missed due to the out-of-FOV motion.

CONCLUSION

In conclusion, the proposed CNN-based motion correction algorithm can significantly reduce out-of-FOV motion artifacts and achieve better image quality compared to AF-based algorithm.

Validation of Highly Accelerated Wave-CAIPI SWI Compared with Conventional SWI and T2*-Weighted Gradient Recalled-Echo for Routine Clinical Brain MRI at 3T

BACKGROUND AND PURPOSE

SWI is valuable for characterization of intracranial hemorrhage and mineralization but has long acquisition times. We compared a highly accelerated wave-controlled aliasing in parallel imaging (CAIPI) SWI sequence with 2 commonly used alternatives, standard SWI and T2*-weighted gradient recalled-echo (T2*W GRE), for routine clinical brain imaging at 3T.

MATERIALS AND METHODS

A total of 246 consecutive adult patients were prospectively evaluated using a conventional SWI or T2*W GRE sequence and an optimized wave-CAIPI SWI sequence, which was 3-5 times faster than the standard sequence. Two blinded radiologists scored each sequence for the presence of hemorrhage, the number of microhemorrhages, and severity of motion artifacts. Wave-CAIPI SWI was then evaluated in head-to-head comparison with the conventional sequences for visualization of pathology, artifacts, and overall diagnostic quality. Forced-choice comparisons were used for all scores. Wave-CAIPI SWI was tested for superiority relative to T2*W GRE and for noninferiority relative to standard SWI using a 15% noninferiority margin.

RESULTS

Compared with T2*W GRE, wave-CAIPI SWI detected hemorrhages in more cases (P < .001) and detected more microhemorrhages (P < .001). Wave-CAIPI SWI was superior to T2*W GRE for visualization of pathology, artifacts, and overall diagnostic quality (all P < .001). Compared with standard SWI, wave-CAIPI SWI showed no difference in the presence or number of hemorrhages identified. Wave-CAIPI SWI was noninferior to standard SWI for the visualization of pathology (P < .001), artifacts (P < .01), and overall diagnostic quality (P < .01). Motion was less severe with wave-CAIPI SWI than with standard SWI (P < .01).

CONCLUSIONS

Wave-CAIPI SWI provided superior visualization of pathology and overall diagnostic quality compared with T2*W GRE and was noninferior to standard SWI with reduced scan times and reduced motion artifacts.

Highly accelerated multishot echo planar imaging through synergistic machine learning and joint reconstruction

PURPOSE

To introduce a combined machine learning (ML)- and physics-based image reconstruction framework that enables navigator-free, highly accelerated multishot echo planar imaging (msEPI) and demonstrate its application in high-resolution structural and diffusion imaging.

METHODS

Single-shot EPI is an efficient encoding technique, but does not lend itself well to high-resolution imaging because of severe distortion artifacts and blurring. Although msEPI can mitigate these artifacts, high-quality msEPI has been elusive because of phase mismatch arising from shot-to-shot variations which preclude the combination of the multiple-shot data into a single image. We utilize deep learning to obtain an interim image with minimal artifacts, which permits estimation of image phase variations attributed to shot-to-shot changes. These variations are then included in a joint virtual coil sensitivity encoding (JVC-SENSE) reconstruction to utilize data from all shots and improve upon the ML solution.

RESULTS

Our combined ML + physics approach enabled Rinplane × multiband (MB) = 8- × 2-fold acceleration using 2 EPI shots for multiecho imaging, so that whole-brain T2 and T2 * parameter maps could be derived from an 8.3-second acquisition at 1 × 1 × 3-mm3 resolution. This has also allowed high-resolution diffusion imaging with high geometrical fidelity using 5 shots at Rinplane × MB = 9- × 2-fold acceleration. To make these possible, we extended the state-of-the-art MUSSELS reconstruction technique to simultaneous multislice encoding and used it as an input to our ML network.

CONCLUSION

Combination of ML and JVC-SENSE enabled navigator-free msEPI at higher accelerations than previously possible while using fewer shots, with reduced vulnerability to poor generalizability and poor acceptance of end-to-end ML approaches.

Ultimate MRI

The basic principles of Magnetic Resonance have been understood for over 70 years and a mainstay of medical imaging for over 40. At this point, it's no longer about simply porting these principles to medical imaging. But we are by no means confined to simply polishing either. Significant innovation and even revolution can come to old technologies. The recent revolution in optical microscopy shattered the resolution constraint imposed by a seemingly fundamental physical law (the diffraction limit) and reinvigorated a 500-year-old modality. Progress comes from re-examining old-ways and sidestepping underlying assumptions. This is already underway for MRI; and is fueled by advances in image reconstruction. Reconstruction increasingly employs sophisticated general models often using subtle and hopefully innocuous prior knowledge about the object. This allows a careful re-examination of some basic prerequisites for MRI such as uniform static fields, linear encoding fields, full Nyquist sampling, or even a stationary object. These powerful reconstruction tools are driving changes in acquisition strategy and basic hardware. The scanner of the future will know more about itself and its patient and his/her biology than ever before. This strategy emboldens relaxed hardware constraints and more specialized scanners, hopefully expanding the reach and value offered by MR imaging.

Network Accelerated Motion Estimation and Reduction (NAMER): Convolutional neural network guided retrospective motion correction using a separable motion model

PURPOSE

We introduce and validate a scalable retrospective motion correction technique for brain imaging that incorporates a machine learning component into a model-based motion minimization.

METHODS

A convolutional neural network (CNN) trained to remove motion artifacts from 2D T₂ -weighted rapid acquisition with refocused echoes (RARE) images is introduced into a model-based data-consistency optimization to jointly search for 2D motion parameters and the uncorrupted image. Our separable motion model allows for efficient intrashot (line-by-line) motion correction of highly corrupted shots, as opposed to previous methods which do not scale well with this refinement of the motion model. Final image generation incorporates the motion parameters within a model-based image reconstruction. The method is tested in simulations and in vivo motion experiments of in-plane motion corruption.

RESULTS

While the convolutional neural network alone provides some motion mitigation (at the expense of introduced blurring), allowing it to guide the iterative joint-optimization both improves the search convergence and renders the joint-optimization separable. This enables rapid mitigation within shots in addition to between shots. For 2D in-plane motion correction experiments, the result is a significant reduction of both image space root mean square error in simulations, and a reduction of motion artifacts in the in vivo motion tests.

CONCLUSION

The separability and convergence improvements afforded by the combined convolutional neural network+model-based method shows the potential for meaningful postacquisition motion mitigation in clinical MRI.

Motion Artifact Reduction Using a Convolutional Neural Network for Dynamic Contrast Enhanced MR Imaging of the Liver

Purpose:

To improve the quality of images obtained via dynamic contrast enhanced MRI (DCE-MRI), which contain motion artifacts and blurring using a deep learning approach.

Materials and Methods:

A multi-channel convolutional neural network-based method is proposed for reducing the motion artifacts and blurring caused by respiratory motion in images obtained via DCE-MRI of the liver. The training datasets for the neural network included images with and without respiration-induced motion artifacts or blurring, and the distortions were generated by simulating the phase error in k-space. Patient studies were conducted using a multi-phase T₁-weighted spoiled gradient echo sequence for the liver, which contained breath-hold failures occurring during data acquisition. The trained network was applied to the acquired images to analyze the filtering performance, and the intensities and contrast ratios before and after denoising were compared via Bland–Altman plots.

Results:

The proposed network was found to be significantly reducing the magnitude of the artifacts and blurring induced by respiratory motion, and the contrast ratios of the images after processing via the network were consistent with those of the unprocessed images.

Conclusion:

A deep learning-based method for removing motion artifacts in images obtained via DCE-MRI of the liver was demonstrated and validated.

Markerless high-frequency prospective motion correction for neuroanatomical MRI

PURPOSE

To integrate markerless head motion tracking with prospectively corrected neuroanatomical MRI sequences and to investigate high-frequency motion correction during imaging echo trains.

METHODS

A commercial 3D surface tracking system, which estimates head motion by registering point cloud reconstructions of the face, was used to adapt the imaging FOV based on head movement during MPRAGE and T₂ SPACE (3D variable flip-angle turbo spin-echo) sequences. The FOV position and orientation were updated every 6 lines of k-space (< 50 ms) to enable "within-echo-train" prospective motion correction (PMC). Comparisons were made with scans using "before-echo-train" PMC, in which the FOV was updated only once per TR, before the start of each echo train (ET). Continuous-motion experiments with phantoms and in vivo were used to compare these high-frequency and low-frequency correction strategies. MPRAGE images were processed with FreeSurfer to compare estimates of brain structure volumes and cortical thickness in scans with different PMC.

RESULTS

The median absolute pose differences between markerless tracking and MR image registration were 0.07/0.26/0.15 mm for x/y/z translation and 0.06º/0.02º/0.12° for rotation about x/y/z. The PMC with markerless tracking substantially reduced motion artifacts. The continuous-motion experiments showed that within-ET PMC, which minimizes FOV encoding errors during ETs that last over 1 second, reduces artifacts compared with before-ET PMC. T₂ SPACE was found to be more sensitive to motion during ETs than MPRAGE. FreeSurfer morphometry estimates from within-ET PMC MPRAGE images were the most accurate.

CONCLUSION

Markerless head tracking can be used for PMC, and high-frequency within-ET PMC can reduce sensitivity to motion during long imaging ETs.

Image reconstruction by domain-transform manifold learning

Image reconstruction is essential for imaging applications across the physical and life sciences, including optical and radar systems, magnetic resonance imaging, X-ray computed tomography, positron emission tomography, ultrasound imaging and radio astronomy. During image acquisition, the sensor encodes an intermediate representation of an object in the sensor domain, which is subsequently reconstructed into an image by an inversion of the encoding function. Image reconstruction is challenging because analytic knowledge of the exact inverse transform may not exist a priori, especially in the presence of sensor non-idealities and noise. Thus, the standard reconstruction approach involves approximating the inverse function with multiple ad hoc stages in a signal processing chain, the composition of which depends on the details of each acquisition strategy, and often requires expert parameter tuning to optimize reconstruction performance. Here we present a unified framework for image reconstruction-automated transform by manifold approximation (AUTOMAP)-which recasts image reconstruction as a data-driven supervised learning task that allows a mapping between the sensor and the image domain to emerge from an appropriate corpus of training data. We implement AUTOMAP with a deep neural network and exhibit its flexibility in learning reconstruction transforms for various magnetic resonance imaging acquisition strategies, using the same network architecture and hyperparameters. We further demonstrate that manifold learning during training results in sparse representations of domain transforms along low-dimensional data manifolds, and observe superior immunity to noise and a reduction in reconstruction artefacts compared with conventional handcrafted reconstruction methods. In addition to improving the reconstruction performance of existing acquisition methodologies, we anticipate that AUTOMAP and other learned reconstruction approaches will accelerate the development of new acquisition strategies across imaging modalities.

Autocalibrated wave-CAIPI reconstruction; Joint optimization of k-space trajectory and parallel imaging reconstruction

PURPOSE

Fast MRI acquisitions often rely on efficient traversal of k-space and hardware limitations, or other physical effects can cause the k-space trajectory to deviate from a theoretical path in a manner dependent on the image prescription and protocol parameters. Additional measurements or generalized calibrations are typically needed to characterize the discrepancies. We propose an autocalibrated technique to determine these discrepancies.

METHODS

A joint optimization is used to estimate the trajectory simultaneously with the parallel imaging reconstruction, without the need for additional measurements. Model reduction is introduced to make this optimization computationally efficient, and to ensure final image quality.

RESULTS

We demonstrate our approach for the wave-CAIPI fast acquisition method that uses a corkscrew k-space path to efficiently encode k-space and spread the voxel aliasing. Model reduction allows for the 3D trajectory to be automatically calculated in fewer than 30 s on standard vendor hardware. The method achieves equivalent accuracy to full-gradient calibration scans.

CONCLUSIONS

The proposed method allows for high-quality wave-CAIPI reconstruction across wide ranges of protocol parameters, such as field of view (FOV) location/orientation, bandwidth, echo time (TE), resolution, and sinusoidal amplitude/frequency. Our framework should allow for the autocalibration of gradient trajectories from many other fast MRI techniques in clinically relevant time. Magn Reson Med 78:1093-1099, 2017. © 2016 International Society for Magnetic Resonance in Medicine.