Automated Detection of Motion Artefacts in MR Imaging Using Decision Forests

A motion assessment method for reference stack selection in fetal brain MRI reconstruction based on tensor rank approximation

Slice-to-volume registration and super-resolution reconstruction are commonly used to generate 3D volumes of the fetal brain from 2D stacks of slices acquired in multiple orientations. A critical initial step in this pipeline is to select one stack with the minimum motion among all input stacks as a reference for registration. An accurate and unbiased motion assessment (MA) is thus crucial for successful selection. Here, we presented an MA method that determines the minimum motion stack based on 3D low-rank approximation using CANDECOMP/PARAFAC (CP) decomposition. Compared to the current 2D singular value decomposition (SVD) based method that requires flattening stacks into matrices to obtain ranks, in which the spatial information is lost, the CP-based method can factorize 3D stack into low-rank and sparse components in a computationally efficient manner. The difference between the original stack and its low-rank approximation was proposed as the motion indicator. Experiments on linearly and randomly simulated motion illustrated that CP demonstrated higher sensitivity in detecting small motion with a lower baseline bias, and achieved a higher assessment accuracy of 95.45% in identifying the minimum motion stack, compared to the SVD-based method with 58.18%. CP also showed superior motion assessment capabilities in real-data evaluations. Additionally, combining CP with the existing SRR-SVR pipeline significantly improved 3D volume reconstruction. The results indicated that our proposed CP showed superior performance compared to SVD-based methods with higher sensitivity to motion, assessment accuracy, and lower baseline bias, and can be used as a prior step to improve fetal brain reconstruction.

Development, evaluation and validation of machine learning models to predict hospitalizations of patients with coronary artery disease within the next 12 months

BACKGROUND

Improved survival of patients after acute coronary syndromes, population growth, and overall life expectancy rise have led to a significant increase in the proportion of patients with stable coronary artery disease (CAD), creating a significant load on the entire healthcare system. The disease often progresses with the development of many complications while significantly increasing the likelihood of hospitalization. Developing and applying a machine learning model for predicting hospitalizations of patients with CAD to an inpatient medical facility will allow for close monitoring of high-risk patients, early preventive interventions, and optimized medical care.

AIMS

Development and external validation of personalized models for predicting the preventable hospitalizations of patients with stable CAD and its complications using ML algorithms and data of real-world clinical practice.

METHODS

135,873 depersonalized electronic health records of 49,103 patients with stable CAD were included in the study. Anthropometric measurements, physical examination results, laboratory, instrumental, anamnestic, and socio-demographic data, widely used in routine medical practice, were considered as potential predictors, a total of 73 features. Logistic regression, decision tree-based methods including gradient boosting (AdaBoost, LightGBM, XGBoost, CatBoost) and bagging (RandomForest and ExtraTrees), discriminant analysis (LinearDiscriminant, QuadraticDiscriminant), and naive Bayes classifier were compared. External validation was performed on the data of a separate region.

RESULTS

The best results and stability to external validation data were shown by the CatBoost model with an AUC of 0.875 (95% CI 0.865-0.885) for the internal testing and 0.872 (95% CI 0.856-0.886) for the external validation. The best model showed good performance evaluated through AUROC, Brier score and standardized net benefit (for the target NPV threshold) for the validation dataset that was only slightly similar to the train data.

CONCLUSION

The metrics of the best model were superior to previously published studies. The results of external validation demonstrated the relative stability of the model to new data from another region that confirms the possibility of the model's application in real clinical practice.

Towards a unified approach for unsupervised brain MRI Motion Artefact Detection with few shot Anomaly Detection

Automated Motion Artefact Detection (MAD) in Magnetic Resonance Imaging (MRI) is a field of study that aims to automatically flag motion artefacts in order to prevent the requirement for a repeat scan. In this paper, we identify and tackle the three current challenges in the field of automated MAD; (1) reliance on fully-supervised training, meaning they require specific examples of Motion Artefacts (MA), (2) inconsistent use of benchmark datasets across different works and use of private datasets for testing and training of newly proposed MAD techniques and (3) a lack of sufficiently large datasets for MRI MAD. To address these challenges, we demonstrate how MAs can be identified by formulating the problem as an unsupervised Anomaly Detection (AD) task. We compare the performance of three State-of-the-Art AD algorithms DeepSVDD, Interpolated Gaussian Descriptor and FewSOME on two open-source Brain MRI datasets on the task of MAD and MA severity classification, with FewSOME achieving a MAD AUC >90% on both datasets and a Spearman Rank Correlation Coefficient of 0.8 on the task of MA severity classification. These models are trained in the few shot setting, meaning large Brain MRI datasets are not required to build robust MAD algorithms. This work also sets a standard protocol for testing MAD algorithms on open-source benchmark datasets. In addition to addressing these challenges, we demonstrate how our proposed 'anomaly-aware' scoring function improves FewSOME's MAD performance in the setting where one and two shots of the anomalous class are available for training. Code available at https://github.com/niamhbelton/Unsupervised-Brain-MRI-Motion-Artefact-Detection/.

Deep Convolutional Neural Networks Provide Motion Grading for High-Resolution Peripheral Quantitative Computed Tomography of the Scaphoid

In vivo high-resolution peripheral quantitative computed tomography (HR-pQCT) studies on bone characteristics are limited, partly due to the lack of standardized and objective techniques to describe motion artifacts responsible for lower-quality images. This study investigates the ability of such deep-learning techniques to assess image quality in HR-pQCT datasets of human scaphoids. In total, 1451 stacks of 482 scaphoid images from 53 patients, each with up to six follow-ups within one year, and each with one non-displaced fractured and one contralateral intact scaphoid, were independently graded by three observers using a visual grading scale for motion artifacts. A 3D-CNN was used to assess image quality. The accuracy of the 3D-CNN to assess the image quality compared to the mean results of three skilled operators was between 92% and 96%. The 3D-CNN classifier reached an ROC-AUC score of 0.94. The average assessment time for one scaphoid was 2.5 s. This study demonstrates that a deep-learning approach for rating radiological image quality provides objective assessments of motion grading for the scaphoid with a high accuracy and a short assessment time. In the future, such a 3D-CNN approach can be used as a resource-saving and cost-effective tool to classify the image quality of HR-pQCT datasets in a reliable, reproducible and objective way.

A generalised deep meta-learning model for automated quality control of cardiovascular magnetic resonance images

BACKGROUND AND OBJECTIVES

Cardiovascular magnetic resonance (CMR) imaging is a powerful modality in functional and anatomical assessment for various cardiovascular diseases. Sufficient image quality is essential to achieve proper diagnosis and treatment. A large number of medical images, the variety of imaging artefacts, and the workload of imaging centres are amongst the factors that reveal the necessity of automatic image quality assessment (IQA). However, automated IQA requires access to bulk annotated datasets for training deep learning (DL) models. Labelling medical images is a tedious, costly and time-consuming process, which creates a fundamental challenge in proposing DL-based methods for medical applications. This study aims to present a new method for CMR IQA when there is limited access to annotated datasets.

METHODS

The proposed generalised deep meta-learning model can evaluate the quality by learning tasks in the prior stage and then fine-tuning the resulting model on a small labelled dataset of the desired tasks. This model was evaluated on the data of over 6,000 subjects from the UK Biobank for five defined tasks, including detecting respiratory motion, cardiac motion, Aliasing and Gibbs ringing artefacts and images without artefacts.

RESULTS

The results of extensive experiments show the superiority of the proposed model. Besides, comparing the model's accuracy with the domain adaptation model indicates a significant difference by using only 64 annotated images related to the desired tasks.

CONCLUSION

The proposed model can identify unknown artefacts in images with acceptable accuracy, which makes it suitable for medical applications and quality assessment of large cohorts. CODE AVAILABILITY: https://github.com/HosseinSimchi/META-IQA-CMRImages.

Application of synthetic data in the training of artificial intelligence for automated quality assurance in magnetic resonance imaging

BACKGROUND

Magnetic resonance imaging scanner faults can be missed during routine quality assurance (QA) if they are subtle, intermittent, or the test being performed is insensitive to the type of fault. Coil element malfunction is a common fault within MRI scanners, which may go undetected for quite some time. Consequently, this may lead to poor image quality and the potential for misdiagnoses.

PURPOSE

Daily QA typically consists of an automated signal to noise ratio test and in some instances this test is insensitive to coil element malfunction. Instead of relying on daily QA testing, it was proposed to utilize patient images in conjunction with a trained neural network to detect coil element malfunction, even when it presents as a very subtle defect. The advantage to using patient images over phantom testing is real-time monitoring can be achieved. This allows clinical staff to focus more on patient throughput without being burdened by daily testing.

METHODS

A neural network was trained using simulated coil failure in 3958 abdominal or pelvic images from 497 patients. The accuracy of the trained network was then tested on an unseen dataset of 109 images from which 44 patients which had coil element malfunction present. Five MRI radiographers were shown 249 images with and without real coil malfunction to assess their accuracy compared to the neural network in identifying the scanner fault.

RESULTS

The neural network achieved an accuracy of 91.74% in identifying coil element malfunction in the unseen data. Radiographers tasked with identifying coil element malfunction had an average accuracy of 59.99%. In the same test case, the neural network outperformed all radiographers with an accuracy of 91.56%.

CONCLUSION

This work demonstrates that neural networks trained with artificial data can successfully identify MRI scanner coil element malfunction in clinical images. The method provided better accuracy than MRI radiographers (technologists) at identifying coil element malfunction and highlights the potential utility of AI methods as an alternative to support traditional QA. Further, our methodology of training neural networks with simulated data could potentially identify other faults, allowing centers to produce robust fault detection systems with minimal data.

Superconducting magnet designs and MRI accessibility: A review

Presently, magnetic resonance imaging (MRI) magnets must deliver excellent magnetic field (B₀ ) uniformity to achieve optimum image quality. Long magnets can satisfy the homogeneity requirements but require considerable superconducting material. These designs result in large, heavy, and costly systems that aggravate as field strength increases. Furthermore, the tight temperature tolerance of niobium titanium magnets adds instability to the system and requires operation at liquid helium temperature. These issues are crucial factors in the disparity of MR density and field strength use across the globe. Low-income settings show reduced access to MRI, especially to high field strengths. This article summarizes the proposed modifications to MRI superconducting magnet design and their impact on accessibility, including compact, reduced liquid helium, and specialty systems. Reducing the amount of superconductor inevitably entails shrinking the magnet size, resulting in higher field inhomogeneity. This work also reviews the state-of-the-art imaging and reconstruction methods to overcome this issue. Finally, we summarize the current and future challenges and opportunities in the design of accessible MRI.

Image-based motion artifact reduction on liver dynamic contrast enhanced MRI

Liver MRI images often suffer from degraded quality due to ghosting or blurring artifacts caused by patient respiratory or bulk motion. In this study, we developed a two-stage deep learning model to reduce motion artifact on dynamic contrast enhanced (DCE) liver MRIs. The stage-I network utilized a deep residual network with a densely connected multi-resolution block (DRN-DCMB) network to remove most motion artifacts. The stage-II network applied the generative adversarial network (GAN) and perceptual loss compensation to preserve image structural features. The stage-I network served as the generator of GAN and its pretrained parameters in stage-I were further updated via backpropagation during stage-II training. The stage-I network was trained using small image patches with simulated motion artifacts including image-space rotational and translational motion, and K-space based centric and interleaved linear motion, sinusoidal, and rotational motion to mimic liver motion patterns. The stage-II network training used full-size images with the same types of simulated motion. The liver DCE-MRI image volumes without obvious motion artifacts in 10 patients were used for the training process, of which 1020 images of 8 patients were used for training and 240 images of 2 patients for validation. Finally, the whole two-stage deep learning model was tested with simulated motion images (312 clean images from 5 test patients) and patient images with real motion artifacts (28 motion images from 12 patients). The resulted images after two-stage processing demonstrated reduced motion artifacts while preserved anatomic details without image blurriness, with SSIM of 0.935 ± 0.092, MSE of 60.7 ± 9.0 × 10^-3, and PSNR of 32.054 ± 2.219.

Motion grading of high-resolution quantitative computed tomography supported by deep convolutional neural networks

Image quality degradation due to subject motion confounds the precision and reproducibility of measurements of bone density, morphology and mechanical properties from high-resolution peripheral quantitative computed tomography (HR-pQCT). Time-consuming operator-based scoring of motion artefacts remains the gold standard to determine the degree of acceptable motion. However, due to the subjectiveness of manual grading, HR-pQCT scans of poor quality, which cannot be used for analysis, may be accepted upon initial review, leaving patients with incomplete or inaccurate imaging results. Convolutional Neural Networks (CNNs) enable fast image analysis with relatively few pre-processing requirements in an operator-independent and fully automated way for image classification tasks. This study aimed to develop a CNN that can predict motion scores from HR-pQCT images, while also being aware of uncertain predictions that require manual confirmation. The CNN calculated motion scores within seconds and achieved a high F1-score (86.8 ± 2.8 %), with good precision (87.5 ± 2.7 %), recall (86.7 ± 2.9 %) and a substantial agreement with the ground truth measured by Cohen's kappa (κ = 68.6 ± 6.2 %); motion scores of the test dataset were predicted by the algorithm with comparable accuracy, precision, sensitivity and agreement as by the operators (p > 0.05). This post-processing approach may be used to assess the effect of motion scores on microstructural analysis and can be immediately implemented into clinical protocols, significantly reducing the time for quality assessment and control of HR-pQCT scans.

A Review of Artificial Intelligence in Cerebrovascular Disease Imaging: Applications and Challenges

BACKGROUND

A variety of emerging medical imaging technologies based on artificial intelligence have been widely applied in many diseases, but they are still limitedly used in the cerebrovascular field even though the diseases can lead to catastrophic consequences.

OBJECTIVE

This work aims to discuss the current challenges and future directions of artificial intelligence technology in cerebrovascular diseases through reviewing the existing literature related to applications in terms of computer-aided detection, prediction and treatment of cerebrovascular diseases.

METHODS

Based on artificial intelligence applications in four representative cerebrovascular diseases including intracranial aneurysm, arteriovenous malformation, arteriosclerosis and moyamoya disease, this paper systematically reviews studies published between 2006 and 2021 in five databases: National Center for Biotechnology Information, Elsevier Science Direct, IEEE Xplore Digital Library, Web of Science and Springer Link. And three refinement steps were further conducted after identifying relevant literature from these databases.

RESULTS

For the popular research topic, most of the included publications involved computer-aided detection and prediction of aneurysms, while studies about arteriovenous malformation, arteriosclerosis and moyamoya disease showed an upward trend in recent years. Both conventional machine learning and deep learning algorithms were utilized in these publications, but machine learning techniques accounted for a larger proportion.

CONCLUSION

Algorithms related to artificial intelligence, especially deep learning, are promising tools for medical imaging analysis and will enhance the performance of computer-aided detection, prediction and treatment of cerebrovascular diseases.

From Accuracy to Reliability and Robustness in Cardiac Magnetic Resonance Image Segmentation: A Review

Since the rise of deep learning (DL) in the mid-2010s, cardiac magnetic resonance (CMR) image segmentation has achieved state-of-the-art performance. Despite achieving inter-observer variability in terms of different accuracy performance measures, visual inspections reveal errors in most segmentation results, indicating a lack of reliability and robustness of DL segmentation models, which can be critical if a model was to be deployed into clinical practice. In this work, we aim to bring attention to reliability and robustness, two unmet needs of cardiac image segmentation methods, which are hampering their translation into practice. To this end, we first study the performance accuracy evolution of CMR segmentation, illustrate the improvements brought by DL algorithms and highlight the symptoms of performance stagnation. Afterwards, we provide formal definitions of reliability and robustness. Based on the two definitions, we identify the factors that limit the reliability and robustness of state-of-the-art deep learning CMR segmentation techniques. Finally, we give an overview of the current set of works that focus on improving the reliability and robustness of CMR segmentation, and we categorize them into two families of methods: quality control methods and model improvement techniques. The first category corresponds to simpler strategies that only aim to flag situations where a model may be incurring poor reliability or robustness. The second one, instead, directly tackles the problem by bringing improvements into different aspects of the CMR segmentation model development process. We aim to bring the attention of more researchers towards these emerging trends regarding the development of reliable and robust CMR segmentation frameworks, which can guarantee the safe use of DL in clinical routines and studies.

ArtifactID: Identifying artifacts in low-field MRI of the brain using deep learning

Low-field MR scanners are more accessible in resource-constrained settings where skilled personnel are scarce. Images acquired in such scenarios are prone to artifacts such as wrap-around and Gibbs ringing. Such artifacts negatively affect the diagnostic quality and may be confused with pathology or reduce the region of interest visibility. As a first step solution, ArtifactID identifies wrap-around and Gibbs ringing in low-field brain MRI. We utilized two datasets: 179 T₁-weighted pathological brain images from a 0.36 T scanner and 581 publicly available T₁-weighted brain images. Individual binary classification models were trained to identify through-plane wrap-around, in-plane wrap-around, and Gibbs ringing. Visual explanations obtained via the GradCAM method helped develop trust in the wrap-around model. The mean precision and recall metrics across the four implemented models were 97.6% and 92.83% respectively. Agreement analysis of the models and the radiologists' labels returned Cohen's kappa values of 0.768 ± 0.062, 1.00 ± 0.000, 0.89 ± 0.085, and 0.878 ± 0.103 for the through-plane wrap-around, in-plane wrap-around, and Gibbs ringing models, respectively.

Short-term memory neural network-based cognitive computing in sports training complexity pattern recognition

With the development of Chinese sports, many sports training researchers try to use artificial intelligence technology to study the training methods and training elements of athletes. However, in reality, these methods are often based on different basic training principles, resulting in the reduction in the generalization ability of artificial intelligence networks. This paper studies the complexity of sports training principles by using an artificial intelligence network model. Based on the improved model of dropout optimization algorithm, this paper proposes an artificial intelligence sports training node prediction method based on the combination of dropout optimization algorithm and short-term memory neural network (LSTM), which avoids the establishment of complex sports training models. Based on artificial intelligence operation and maintenance records and sports training core capacity experimental data, the maximum node static estimation of artificial intelligence sports training is realized. The research shows that the node prediction model is established by using the method described in this paper. Through experimental comparison and analysis, the model has high prediction accuracy. Due to the state memory function of LSTM, it has advantages in the prediction of 2000 data on a long time scale. The mean absolute error percentage of the prediction results is less than 3.4%, and the maximum absolute error percentage is less than 5.2%. The artificial intelligence network model in this paper has good generalization ability. Compared with other models, the model proposed in this paper can get more accurate prediction results in sports training of different groups and effectively alleviate the problem of overfitting. Therefore, traditional stadiums and gymnasiums should actively introduce artificial intelligence technology with a more positive attitude, to realize the development and innovation in technology application, service innovation, management efficiency, and function integration.

Evaluation of motion artifacts in brain magnetic resonance images using convolutional neural network-based prediction of full-reference image quality assessment metrics

Purpose: Motion artifacts in magnetic resonance (MR) images mostly undergo subjective evaluation, which is poorly reproducible, time consuming, and costly. Recently, full-reference image quality assessment (FR-IQA) metrics, such as structural similarity (SSIM), have been used, but they require a reference image and hence cannot be used to evaluate clinical images. We developed a convolutional neural network (CNN) model to quantify motion artifacts without using reference images. Approach: The brain MR images were obtained from an open dataset. The motion-corrupted images were generated retrospectively, and the peak signal-to-noise ratio, cross-correlation coefficient, and SSIM were calculated. The CNN was trained using these images and their FR-IQA metrics to predict the FR-IQA metrics without reference images. Receiver operating characteristic (ROC) curves were created for binary classification, with artifact scores < 4 indicating the need for rescanning. ROC curve analysis was performed on the binary classification of the real motion images. Results: The predicted FR-IQA metric having the highest correlation with the subjective evaluation was SSIM, which was able to classify images requiring rescanning with a sensitivity of 89.5%, specificity of 78.2%, and area under the ROC curve (AUC) of 0.930. The real motion artifacts were classified with the AUC of 0.928. Conclusions: Our CNN model predicts FR-IQA metrics with high accuracy, which enables quantitative assessment of motion artifacts in MR images without reference images. It enables classification of images requiring rescanning with a high AUC, which can improve the workflow of MR imaging examinations.

Adversarial Bayesian Optimization for Quantifying Motion Artifact Within MRI

Subject motion during an MRI sequence can cause ghosting effects or diffuse image noise in the phase-encoding direction and hence is likely to bias findings in neuroimaging studies. Detecting motion artifacts often relies on experts visually inspecting MRIs, which is subjective and expensive. To improve this detection, we develop a framework to automatically quantify the severity of motion artifact within a brain MRI. We formulate this task as a regression problem and train the regressor from a data set of MRIs with various amounts of motion artifacts. To resolve the issue of missing fine-grained ground-truth labels (level of artifacts), we propose Adversarial Bayesian Optimization (ABO) to infer the distribution of motion parameters (i.e., rotation and translation) underlying the acquired MRI data and then inject synthetic motion artifacts sampled from that estimated distribution into motion-free MRIs. After training the regressor on the synthetic data, we applied the model to quantify the motion level in 990 MRIs collected by the National Consortium on Alcohol and Neurodevelopment in Adolescence. Results show that the motion level derived by our approach is more reliable than the traditional metric based on Entropy Focus Criterion and manually defined binary labels.

Cine Cardiac MRI Motion Artifact Reduction Using a Recurrent Neural Network

Cine cardiac magnetic resonance imaging (MRI) is widely used for the diagnosis of cardiac diseases thanks to its ability to present cardiovascular features in excellent contrast. As compared to computed tomography (CT), MRI, however, requires a long scan time, which inevitably induces motion artifacts and causes patients' discomfort. Thus, there has been a strong clinical motivation to develop techniques to reduce both the scan time and motion artifacts. Given its successful applications in other medical imaging tasks such as MRI super-resolution and CT metal artifact reduction, deep learning is a promising approach for cardiac MRI motion artifact reduction. In this paper, we propose a novel recurrent generative adversarial network model for cardiac MRI motion artifact reduction. This model utilizes bi-directional convolutional long short-term memory (ConvLSTM) and multi-scale convolutions to improve the performance of the proposed network, in which bi-directional ConvLSTMs handle long-range temporal features while multi-scale convolutions gather both local and global features. We demonstrate a decent generalizability of the proposed method thanks to the novel architecture of our deep network that captures the essential relationship of cardiovascular dynamics. Indeed, our extensive experiments show that our method achieves better image quality for cine cardiac MRI images than existing state-of-the-art methods. In addition, our method can generate reliable missing intermediate frames based on their adjacent frames, improving the temporal resolution of cine cardiac MRI sequences.

Brain MRI artefact detection and correction using convolutional neural networks

BACKGROUND AND OBJECTIVE

Brain MRI is one of the most commonly used diagnostic imaging tools to detect neurodegenerative disease. Diagnostic image quality is a key factor to enable robust image analysis algorithms developed for downstream tasks such as segmentation. In clinical practice, one of the main challenges is the presence of image artefacts, which can lead to low diagnostic image quality.

METHODS

In this paper, we propose using dense convolutional neural networks to detect and a residual U-net architecture to correct motion related brain MRI artefacts. We first generate synthetic artefacts using an MR physics based corruption strategy. Then, we use a detection strategy based on dense convolutional neural network to detect artefacts. The detected artefacts are corrected using a residual U-net network trained on corrupted data.

RESULTS

Our pipeline for detection and correction of artefacts is capable of reaching not only better quality image quality, but also better segmentation accuracy of stroke segmentation. The algorithm is validated using 28 cases brain MRI stroke segmentation dataset and showed an accuracy of 97.8% for detecting artefacts in our experiments. We also illustrated the improved image quality and segmentation accuracy with the proposed correction algorithm.

CONCLUSIONS

Ensuring high image quality and high segmentation quality jointly can improve the automatic image analysis pipelines and reduce the influence of low image quality on final prognosis. With this work, we illustrate a performance analysis on brain MRI stroke segmentation.

Hardware Failure Prediction on Imbalanced Times Series Data : Generation of Artificial Data Using Gaussian Process and Applying LSTMFCN to Predict Broken Hardware

Magnetic resonance imaging (MRI) systems and their continuous, failure-free operation is crucial for high-quality diagnostics and seamless workflows. One important hardware component is coils as they detect the magnetic signal. Before every MRI scan, several image features are captured which represent the used coil's condition. These image features recorded over time are used to train machine learning models for classification of coils into normal and broken coils for faster and easier maintenance. The state-of-the-art techniques for classification of time series involve different kinds of neural networks. We leveraged sequential data and trained three models, long short-term memory (LSTM), fully convolutional network (FCN), and the combination of those called LSTMFCN as reported by Karim et al. (IEEE access 6:1662-1669, 2017). We found LSTMFCN to combine the benefits of LSTM and FCN. Thus, we achieved the highest F1-score of 87.45% and the highest accuracy of 99.35% using LSTMFCN. Furthermore, we tackled the high data imbalance of only 2.1% data collected from broken coils by training a Gaussian process (GP) regressor and adding predicted sequences as artificial samples to our broken labelled data. Adding 40 synthetic samples increased the classification results of LSTMFCN to an F1-score of 92.30% and accuracy of 99.83%. Thus, MRI head/neck coils can be classified normal or broken by training a LSTMFCN on image features, successfully. Augmenting the data using GP-generated samples can improve the performance even further.

Deep Learning-Based Detection and Correction of Cardiac MR Motion Artefacts During Reconstruction for High-Quality Segmentation

Segmenting anatomical structures in medical images has been successfully addressed with deep learning methods for a range of applications. However, this success is heavily dependent on the quality of the image that is being segmented. A commonly neglected point in the medical image analysis community is the vast amount of clinical images that have severe image artefacts due to organ motion, movement of the patient and/or image acquisition related issues. In this paper, we discuss the implications of image motion artefacts on cardiac MR segmentation and compare a variety of approaches for jointly correcting for artefacts and segmenting the cardiac cavity. The method is based on our recently developed joint artefact detection and reconstruction method, which reconstructs high quality MR images from k-space using a joint loss function and essentially converts the artefact correction task to an under-sampled image reconstruction task by enforcing a data consistency term. In this paper, we propose to use a segmentation network coupled with this in an end-to-end framework. Our training optimises three different tasks: 1) image artefact detection, 2) artefact correction and 3) image segmentation. We train the reconstruction network to automatically correct for motion-related artefacts using synthetically corrupted cardiac MR k-space data and uncorrected reconstructed images. Using a test set of 500 2D+time cine MR acquisitions from the UK Biobank data set, we achieve demonstrably good image quality and high segmentation accuracy in the presence of synthetic motion artefacts. We showcase better performance compared to various image correction architectures.

Classifying MRI motion severity using a stacked ensemble approach

Motion artifacts are a common occurrence in Magnetic Resonance Imaging exam. Motion during acquisition has a profound impact on workflow efficiency, often requiring a repeat of sequences. Furthermore, motion artifacts may escape notice by technologists, only to be revealed at the time of reading by the radiologists, affecting their diagnostic quality. There is a paucity of clinical tools to identify and quantitatively assess the severity of motion artifacts in MRI. An image with subtle motion may still have diagnostic value, while severe motion may be uninterpretable by radiologists and requires the exam to be repeated. Therefore, a tool for the automatic identification of motion artifacts would aid in maintaining diagnostic quality, while potentially driving workflow efficiencies. Here we aim to quantify the severity of motion artifacts from MRI images using deep learning. Impact of subject movement parameters like displacement and rotation on image quality is also studied. A state-of-the-art, stacked ensemble model was developed to classify motion artifacts into five levels (no motion, slight, mild, moderate and severe) in brain scans. The stacked ensemble model is able to robustly predict rigid-body motion severity across different acquisition parameters, including T1-weighted and T2-weighted slices acquired in different anatomical planes. The ensemble model with XGBoost metalearner achieves 91.6% accuracy, 94.8% area under the curve, 90% Cohen's Kappa, and is observed to be more accurate and robust than the individual base learners.

Artificial intelligence: improving the efficiency of cardiovascular imaging

INTRODUCTION

Artificial intelligence (AI) describes the use of computational techniques to mimic human intelligence. In healthcare, this typically involves large medical datasets being used to predict a diagnosis, identify new disease genotypes or phenotypes, or guide treatment strategies. Noninvasive imaging remains a cornerstone for the diagnosis, risk stratification, and management of patients with cardiovascular disease. AI can facilitate every stage of the imaging process, from acquisition and reconstruction, to segmentation, measurement, interpretation, and subsequent clinical pathways.

AREAS COVERED

In this paper, we review state-of-the-art AI techniques and their current applications in cardiac imaging, and discuss the future role of AI as a precision medicine tool.

EXPERT OPINION

Cardiovascular medicine is primed for scalable AI applications which can interpret vast amounts of clinical and imaging data in greater depth than ever before. AI-augmented medical systems have the potential to improve workflow and provide reproducible and objective quantitative results which can inform clinical decisions. In the foreseeable future, AI may work in the background of cardiac image analysis software and routine clinical reporting, automatically collecting data and enabling real-time diagnosis and risk stratification.

Motion artifacts reduction in brain MRI by means of a deep residual network with densely connected multi-resolution blocks (DRN-DCMB)

OBJECTIVE

Magnetic resonance imaging (MRI) acquisition is inherently sensitive to motion, and motion artifact reduction is essential for improving image quality in MRI.

METHODS

We developed a deep residual network with densely connected multi-resolution blocks (DRN-DCMB) model to reduce the motion artifacts in T1 weighted (T1W) spin echo images acquired on different imaging planes before and after contrast injection. The DRN-DCMB network consisted of multiple multi-resolution blocks connected with dense connections in a feedforward manner. A single residual unit was used to connect the input and output of the entire network with one shortcut connection to predict a residual image (i.e. artifact image). The model was trained with five motion-free T1W image stacks (pre-contrast axial and sagittal, and post-contrast axial, coronal, and sagittal images) with simulated motion artifacts.

RESULTS

In other 86 testing image stacks with simulated artifacts, our DRN-DCMB model outperformed other state-of-the-art deep learning models with significantly higher structural similarity index (SSIM) and improvement in signal-to-noise ratio (ISNR). The DRN-DCMB model was also applied to 121 testing image stacks appeared with various degrees of real motion artifacts. The acquired images and processed images by the DRN-DCMB model were randomly mixed, and image quality was blindly evaluated by a neuroradiologist. The DRN-DCMB model significantly improved the overall image quality, reduced the severity of the motion artifacts, and improved the image sharpness, while kept the image contrast.

CONCLUSION

Our DRN-DCMB model provided an effective method for reducing motion artifacts and improving the overall clinical image quality of brain MRI.

Fully Automated, Quality-Controlled Cardiac Analysis From CMR: Validation and Large-Scale Application to Characterize Cardiac Function

Objectives

This study sought to develop a fully automated framework for cardiac function analysis from cardiac magnetic resonance (CMR), including comprehensive quality control (QC) algorithms to detect erroneous output.

Background

Analysis of cine CMR imaging using deep learning (DL) algorithms could automate ventricular function assessment. However, variable image quality, variability in phenotypes of disease, and unavoidable weaknesses in training of DL algorithms currently prevent their use in clinical practice.

Methods

The framework consists of a pre-analysis DL image QC, followed by a DL algorithm for biventricular segmentation in long-axis and short-axis views, myocardial feature-tracking (FT), and a post-analysis QC to detect erroneous results. The study validated the framework in healthy subjects and cardiac patients by comparison against manual analysis (n = 100) and evaluation of the QC steps’ ability to detect erroneous results (n = 700). Next, this method was used to obtain reference values for cardiac function metrics from the UK Biobank.

Results

Automated analysis correlated highly with manual analysis for left and right ventricular volumes (all r > 0.95), strain (circumferential r = 0.89, longitudinal r > 0.89), and filling and ejection rates (all r ≥ 0.93). There was no significant bias for cardiac volumes and filling and ejection rates, except for right ventricular end-systolic volume (bias +1.80 ml; p = 0.01). The bias for FT strain was <1.3%. The sensitivity of detection of erroneous output was 95% for volume-derived parameters and 93% for FT strain. Finally, reference values were automatically derived from 2,029 CMR exams in healthy subjects.

Conclusions

The study demonstrates a DL-based framework for automated, quality-controlled characterization of cardiac function from cine CMR, without the need for direct clinician oversight.

Automatic CNN-based detection of cardiac MR motion artefacts using k-space data augmentation and curriculum learning

Good quality of medical images is a prerequisite for the success of subsequent image analysis pipelines. Quality assessment of medical images is therefore an essential activity and for large population studies such as the UK Biobank (UKBB), manual identification of artefacts such as those caused by unanticipated motion is tedious and time-consuming. Therefore, there is an urgent need for automatic image quality assessment techniques. In this paper, we propose a method to automatically detect the presence of motion-related artefacts in cardiac magnetic resonance (CMR) cine images. We compare two deep learning architectures to classify poor quality CMR images: 1) 3D spatio-temporal Convolutional Neural Networks (3D-CNN), 2) Long-term Recurrent Convolutional Network (LRCN). Though in real clinical setup motion artefacts are common, high-quality imaging of UKBB, which comprises cross-sectional population data of volunteers who do not necessarily have health problems creates a highly imbalanced classification problem. Due to the high number of good quality images compared to the relatively low number of images with motion artefacts, we propose a novel data augmentation scheme based on synthetic artefact creation in k-space. We also investigate a learning approach using a predetermined curriculum based on synthetic artefact severity. We evaluate our pipeline on a subset of the UK Biobank data set consisting of 3510 CMR images. The LRCN architecture outperformed the 3D-CNN architecture and was able to detect 2D+time short axis images with motion artefacts in less than 1ms with high recall. We compare our approach to a range of state-of-the-art quality assessment methods. The novel data augmentation and curriculum learning approaches both improved classification performance achieving overall area under the ROC curve of 0.89.

A Deep Learning-Based Approach to Reduce Rescan and Recall Rates in Clinical MRI Examinations

BACKGROUND AND PURPOSE

MR imaging rescans and recalls can create large hospital revenue loss. The purpose of this study was to develop a fast, automated method for assessing rescan need in motion-corrupted brain series.

MATERIALS AND METHODS

A deep learning-based approach was developed, outputting a probability for a series to be clinically useful. Comparison of this per-series probability with a threshold, which can depend on scan indication and reading radiologist, determines whether a series needs to be rescanned. The deep learning classification performance was compared with that of 4 technologists and 5 radiologists in 49 test series with low and moderate motion artifacts. These series were assumed to be scanned for 2 scan indications: screening for multiple sclerosis and stroke.

RESULTS

The image-quality rating was found to be scan indication- and reading radiologist-dependent. Of the 49 test datasets, technologists created a mean ratio of rescans/recalls of (4.7 ± 5.1)/(9.5 ± 6.8) for MS and (8.6 ± 7.7)/(1.6 ± 1.9) for stroke. With thresholds adapted for scan indication and reading radiologist, deep learning created a rescan/recall ratio of (7.3 ± 2.2)/(3.2 ± 2.5) for MS, and (3.6 ± 1.5)/(2.8 ± 1.6) for stroke. Due to the large variability in the technologists' assessments, it was only the decrease in the recall rate for MS, for which the deep learning algorithm was trained, that was statistically significant (P = .03).

CONCLUSIONS

Fast, automated deep learning-based image-quality rating can decrease rescan and recall rates, while rendering them technologist-independent. It was estimated that decreasing rescans and recalls from the technologists' values to the values of deep learning could save hospitals $24,000/scanner/year.