Deep Learning-based Prescription of Cardiac MRI Planes

Improving privacy-preserving multi-faceted long short-term memory for accurate evaluation of encrypted time-series MRI images in heart disease

In therapeutic diagnostics, early diagnosis and monitoring of heart disease is dependent on fast time-series MRI data processing. Robust encryption techniques are necessary to guarantee patient confidentiality. While deep learning (DL) algorithm have improved medical imaging, privacy and performance are still hard to balance. In this study, a novel approach for analyzing homomorphivally-encrypted (HE) time-series MRI data is introduced: The Multi-Faceted Long Short-Term Memory (MF-LSTM). This method includes privacy protection. The MF-LSTM architecture protects patient's privacy while accurately categorizing and forecasting cardiac disease, with accuracy (97.5%), precision (96.5%), recall (98.3%), and F1-score (97.4%). While segmentation methods help to improve interpretability by identifying important region in encrypted MRI images, Generalized Histogram Equalization (GHE) improves image quality. Extensive testing on selected dataset if encrypted time-series MRI images proves the method's stability and efficacy, outperforming previous approaches. The finding shows that the suggested technique can decode medical image to expose visual representation as well as sequential movement while protecting privacy and providing accurate medical image evaluation.

Designing Clinical MRI for Enhanced Workflow and Value

MRI is an expensive and traditionally time-intensive modality in imaging. With the paradigm shift toward value-based healthcare, radiology departments must examine the entire MRI process cycle to identify opportunities to optimize efficiency and enhance value for patients. Digital tools such as "frictionless scheduling" prioritize patient preference and convenience, thereby delivering patient-centered care. Recent advances in conventional and deep learning-based accelerated image reconstruction methods have reduced image acquisition time to such a degree that so-called nongradient time now constitutes a major percentage of total room time. For this reason, architectural design strategies that reconfigure patient preparation processes and decrease the turnaround time between scans can substantially impact overall throughput while also improving patient comfort and privacy. Real-time informatics tools that provide an enterprise-wide overview of MRI workflow and Picture Archiving and Communication System (PACS)-integrated instant messaging can complement these efforts by offering transparent, situational data and facilitating communication between radiology team members. Finally, long-term investment in training, recruiting, and retaining a highly skilled technologist workforce is essential for building a pipeline and team of technologists committed to excellence. Here, we highlight various opportunities for optimizing MRI workflow and enhancing value by offering many of our own on-the-ground experiences and conclude by anticipating some of the future directions for process improvement and innovation in clinical MR imaging. EVIDENCE LEVEL: N/A TECHNICAL EFFICACY: Stage 1.

Deep learning-based automated scan plane positioning for brain magnetic resonance imaging

Background

Manual planning of scans in clinical magnetic resonance imaging (MRI) exhibits poor accuracy, lacks consistency, and is time-consuming. Meanwhile, classical automated scan plane positioning methods that rely on certain assumptions are not accurate or stable enough, and are computationally inefficient for practical application scenarios. This study aims to develop and evaluate an effective, reliable, and accurate deep learning-based framework that incorporates prior physical knowledge for automatic head scan plane positioning in MRI.

Methods

A deep learning-based end-to-end automated scan plane positioning framework has been developed for MRI head scans. Our model takes a three-dimensional (3D) pre-scan image input, utilizing a cascaded 3D convolutional neural network to detect anatomical landmarks from coarse to fine. And then, with the determined landmarks, accurate scan plane localization can be achieved. A multi-scale spatial information fusion module was employed to aggregate high- and low-resolution features, combined with physically meaningful point regression loss (PRL) function and direction regression loss (DRL) function. Meanwhile, we simulate complex clinical scenarios to design data augmentation strategies.

Results

Our proposed approach shows good performance on a clinically wide range of 229 MRI head scans, with a point-to-point absolute error (PAE) of 0.872 mm, a point-to-point relative error (PRE) of 0.10%, and an average angular error (AAE) of 0.502°, 0.381°, and 0.675° for the sagittal, transverse, and coronal planes, respectively.

Conclusions

The proposed deep learning-based automated scan plane positioning shows high efficiency, accuracy and robustness when evaluated on varied clinical head MRI scans with differences in positioning, contrast, noise levels and pathologies.

The Role of Artificial Intelligence in Cardiac Imaging

Artificial intelligence (AI) is having a significant impact in medical imaging, advancing almost every aspect of the field, from image acquisition and postprocessing to automated image analysis with outreach toward supporting decision making. Noninvasive cardiac imaging is one of the main and most exciting fields for AI development. The aim of this review is to describe the main applications of AI in cardiac imaging, including CT and MR imaging, and provide an overview of recent advancements and available clinical applications that can improve clinical workflow, disease detection, and prognostication in cardiac disease.

Artificial Intelligence and Its Role in Diagnosing Heart Failure: A Narrative Review

Heart failure (HF) is prevalent globally. It is a dynamic disease with varying definitions and classifications due to multiple pathophysiologies and etiologies. The diagnosis, clinical staging, and treatment of HF become complex and subjective, impacting patient prognosis and mortality. Technological advancements, like artificial intelligence (AI), have been significant roleplays in medicine and are increasingly used in cardiovascular medicine to transform drug discovery, clinical care, risk prediction, diagnosis, and treatment. Medical and surgical interventions specific to HF patients rely significantly on early identification of HF. Hospitalization and treatment costs for HF are high, with readmissions increasing the burden. AI can help improve diagnostic accuracy by recognizing patterns and using them in multiple areas of HF management. AI has shown promise in offering early detection and precise diagnoses with the help of ECG analysis, advanced cardiac imaging, leveraging biomarkers, and cardiopulmonary stress testing. However, its challenges include data access, model interpretability, ethical concerns, and generalizability across diverse populations. Despite these ongoing efforts to refine AI models, it suggests a promising future for HF diagnosis. After applying exclusion and inclusion criteria, we searched for data available on PubMed, Google Scholar, and the Cochrane Library and found 150 relevant papers. This review focuses on AI's significant contribution to HF diagnosis in recent years, drastically altering HF treatment and outcomes.

A simulation-based phantom model for generating synthetic mitral valve image data-application to MRI acquisition planning

PURPOSE

Numerical phantom methods are widely used in the development of medical imaging methods. They enable quantitative evaluation and direct comparison with controlled and known ground truth information. Cardiac magnetic resonance has the potential for a comprehensive evaluation of the mitral valve (MV). The goal of this work is the development of a numerical simulation framework that supports the investigation of MRI imaging strategies for the mitral valve.

METHODS

We present a pipeline for synthetic image generation based on the combination of individual anatomical 3D models with a position-based dynamics simulation of the mitral valve closure. The corresponding images are generated using modality-specific intensity models and spatiotemporal sampling concepts. We test the applicability in the context of MRI imaging strategies for the assessment of the mitral valve. Synthetic images are generated with different strategies regarding image orientation (SAX and rLAX) and spatial sampling density.

RESULTS

The suitability of the imaging strategy is evaluated by comparing MV segmentations against ground truth annotations. The generated synthetic images were compared to ones acquired with similar parameters, and the result is promising. The quantitative analysis of annotation results suggests that the rLAX sampling strategy is preferable for MV assessment, reaching accuracy values that are comparable to or even outperform literature values.

CONCLUSION

The proposed approach provides a valuable tool for the evaluation and optimization of cardiac valve image acquisition. Its application to the use case identifies the radial image sampling strategy as the most suitable for MV assessment through MRI.

Automatic view plane prescription for cardiac magnetic resonance imaging via supervision by spatial relationship between views

BACKGROUND

View planning for the acquisition of cardiac magnetic resonance (CMR) imaging remains a demanding task in clinical practice.

PURPOSE

Existing approaches to its automation relied either on an additional volumetric image not typically acquired in clinic routine, or on laborious manual annotations of cardiac structural landmarks. This work presents a clinic-compatible, annotation-free system for automatic CMR view planning.

METHODS

The system mines the spatial relationship-more specifically, locates the intersecting lines-between the target planes and source views, and trains U-Net-based deep networks to regress heatmaps defined by distances from the intersecting lines. On the one hand, the intersection lines are the prescription lines prescribed by the technologists at the time of image acquisition using cardiac landmarks, and retrospectively identified from the spatial relationship. On the other hand, as the spatial relationship is self-contained in properly stored data, for example, in the DICOM format, the need for additional manual annotation is eliminated. In addition, the interplay of the multiple target planes predicted in a source view is utilized in a stacked hourglass architecture consisting of repeated U-Net-style building blocks to gradually improve the regression. Then, a multiview planning strategy is proposed to aggregate information from the predicted heatmaps for all the source views of a target plane, for a globally optimal prescription, mimicking the similar strategy practiced by skilled human prescribers. For performance evaluation, the retrospectively identified planes prescribed by the technologists are used as the ground truth, and the plane angle differences and localization distances between the planes prescribed by our system and the ground truth are compared.

RESULTS

The retrospective experiments include 181 clinical CMR exams, which are randomly split into training, validation, and test sets in the ratio of 64:16:20. Our system yields the mean angular difference and point-to-plane distance of 5.68∘ $^\circ$ and 3.12 mm, respectively, on the held-out test set. It not only achieves superior accuracy to existing approaches including conventional atlas-based and newer deep-learning-based in prescribing the four standard CMR planes but also demonstrates prescription of the first cardiac-anatomy-oriented plane(s) from the body-oriented scout.

CONCLUSIONS

The proposed system demonstrates accurate automatic CMR view plane prescription based on deep learning on properly archived data, without the need for further manual annotation. This work opens a new direction for automatic view planning of anatomy-oriented medical imaging beyond CMR.

New clinical opportunities of low-field MRI: heart, lung, body, and musculoskeletal

Contemporary whole-body low-field MRI scanners (< 1 T) present new and exciting opportunities for improved body imaging. The fundamental reason is that the reduced off-resonance and reduced SAR provide substantially increased flexibility in the design of MRI pulse sequences. Promising body applications include lung parenchyma imaging, imaging adjacent to metallic implants, cardiac imaging, and dynamic imaging in general. The lower cost of such systems may make MRI favorable for screening high-risk populations and population health research, and the more open configurations allowed may prove favorable for obese subjects and for pregnant women. This article summarizes promising body applications for contemporary whole-body low-field MRI systems, with a focus on new platforms developed within the past 5 years. This is an active area of research, and one can expect many improvements as MRI physicists fully explore the landscape of pulse sequences that are feasible, and as clinicians apply these to patient populations.

Present and Future Innovations in AI and Cardiac MRI

Cardiac MRI is used to diagnose and treat patients with a multitude of cardiovascular diseases. Despite the growth of clinical cardiac MRI, complicated image prescriptions and long acquisition protocols limit the specialty and restrain its impact on the practice of medicine. Artificial intelligence (AI)-the ability to mimic human intelligence in learning and performing tasks-will impact nearly all aspects of MRI. Deep learning (DL) primarily uses an artificial neural network to learn a specific task from example data sets. Self-driving scanners are increasingly available, where AI automatically controls cardiac image prescriptions. These scanners offer faster image collection with higher spatial and temporal resolution, eliminating the need for cardiac triggering or breath holding. In the future, fully automated inline image analysis will most likely provide all contour drawings and initial measurements to the reader. Advanced analysis using radiomic or DL features may provide new insights and information not typically extracted in the current analysis workflow. AI may further help integrate these features with clinical, genetic, wearable-device, and "omics" data to improve patient outcomes. This article presents an overview of AI and its application in cardiac MRI, including in image acquisition, reconstruction, and processing, and opportunities for more personalized cardiovascular care through extraction of novel imaging markers.

Deep Learning for Cardiovascular Imaging: A Review

Importance

Artificial intelligence (AI), driven by advances in deep learning (DL), has the potential to reshape the field of cardiovascular imaging (CVI). While DL for CVI is still in its infancy, research is accelerating to aid in the acquisition, processing, and/or interpretation of CVI across various modalities, with several commercial products already in clinical use. It is imperative that cardiovascular imagers are familiar with DL systems, including a basic understanding of how they work, their relative strengths compared with other automated systems, and possible pitfalls in their implementation. The goal of this article is to review the methodology and application of DL to CVI in a simple, digestible fashion toward demystifying this emerging technology.

Observations

At its core, DL is simply the application of a series of tunable mathematical operations that translate input data into a desired output. Based on artificial neural networks that are inspired by the human nervous system, there are several types of DL architectures suited to different tasks; convolutional neural networks are particularly adept at extracting valuable information from CVI data. We survey some of the notable applications of DL to tasks across the spectrum of CVI modalities. We also discuss challenges in the development and implementation of DL systems, including avoiding overfitting, preventing systematic bias, improving explainability, and fostering a human-machine partnership. Finally, we conclude with a vision of the future of DL for CVI.

Conclusions and Relevance

Deep learning has the potential to meaningfully affect the field of CVI. Rather than a threat, DL could be seen as a partner to cardiovascular imagers in reducing technical burden and improving efficiency and quality of care. High-quality prospective evidence is still needed to demonstrate how the benefits of DL CVI systems may outweigh the risks.

Deep Learning Synthetic Strain: Quantitative Assessment of Regional Myocardial Wall Motion at MRI

Purpose

To assess the feasibility of a newly developed algorithm, called deep learning synthetic strain (DLSS), to infer myocardial velocity from cine steady-state free precession (SSFP) images and detect wall motion abnormalities in patients with ischemic heart disease.

Materials and Methods

In this retrospective study, DLSS was developed by using a data set of 223 cardiac MRI examinations including cine SSFP images and four-dimensional flow velocity data (November 2017 to May 2021). To establish normal ranges, segmental strain was measured in 40 individuals (mean age, 41 years ± 17 [SD]; 30 men) without cardiac disease. Then, DLSS performance in the detection of wall motion abnormalities was assessed in a separate group of patients with coronary artery disease, and these findings were compared with consensus results of four independent cardiothoracic radiologists (ground truth). Algorithm performance was evaluated by using receiver operating characteristic curve analysis.

Results

Median peak segmental radial strain in individuals with normal cardiac MRI findings was 38% (IQR: 30%-48%). Among patients with ischemic heart disease (846 segments in 53 patients; mean age, 61 years ± 12; 41 men), the Cohen κ among four cardiothoracic readers for detecting wall motion abnormalities was 0.60-0.78. DLSS achieved an area under the receiver operating characteristic curve of 0.90. Using a fixed 30% threshold for abnormal peak radial strain, the algorithm achieved a sensitivity, specificity, and accuracy of 86%, 85%, and 86%, respectively.

Conclusion

The deep learning algorithm had comparable performance with subspecialty radiologists in inferring myocardial velocity from cine SSFP images and identifying myocardial wall motion abnormalities at rest in patients with ischemic heart disease.Keywords: Neural Networks, Cardiac, MR Imaging, Ischemia/Infarction Supplemental material is available for this article. © RSNA, 2023.

Automated Placement of Scan and Pre-Scan Volumes for Breast MRI Using a Convolutional Neural Network

Graphically prescribed patient-specific imaging volumes and local pre-scan volumes are routinely placed by MRI technologists to optimize image quality. However, manual placement of these volumes by MR technologists is time-consuming, tedious, and subject to intra- and inter-operator variability. Resolving these bottlenecks is critical with the rise in abbreviated breast MRI exams for screening purposes. This work proposes an automated approach for the placement of scan and pre-scan volumes for breast MRI. Anatomic 3-plane scout image series and associated scan volumes were retrospectively collected from 333 clinical breast exams acquired on 10 individual MRI scanners. Bilateral pre-scan volumes were also generated and reviewed in consensus by three MR physicists. A deep convolutional neural network was trained to predict both the scan and pre-scan volumes from the 3-plane scout images. The agreement between the network-predicted volumes and the clinical scan volumes or physicist-placed pre-scan volumes was evaluated using the intersection over union, the absolute distance between volume centers, and the difference in volume sizes. The scan volume model achieved a median 3D intersection over union of 0.69. The median error in scan volume location was 2.7 cm and the median size error was 2%. The median 3D intersection over union for the pre-scan placement was 0.68 with no significant difference in mean value between the left and right pre-scan volumes. The median error in the pre-scan volume location was 1.3 cm and the median size error was -2%. The average estimated uncertainty in positioning or volume size for both models ranged from 0.2 to 3.4 cm. Overall, this work demonstrates the feasibility of an automated approach for the placement of scan and pre-scan volumes based on a neural network model.

Artificial Intelligence in Cardiovascular CT and MR Imaging

The technological development of Artificial Intelligence (AI) has grown rapidly in recent years. The applications of AI to cardiovascular imaging are various and could improve the radiologists' workflow, speeding up acquisition and post-processing time, increasing image quality and diagnostic accuracy. Several studies have already proved AI applications in Coronary Computed Tomography Angiography and Cardiac Magnetic Resonance, including automatic evaluation of calcium score, quantification of coronary stenosis and plaque analysis, or the automatic quantification of heart volumes and myocardial tissue characterization. The aim of this review is to summarize the latest advances in the field of AI applied to cardiovascular CT and MR imaging.

Advancing cardiovascular medicine with machine learning: Progress, potential, and perspective

Recent advances in machine learning (ML) have made it possible to analyze high-dimensional and complex data-such as free text, images, waveforms, videos, and sound-in an automated manner by successfully learning complex associations within these data. Cardiovascular medicine is particularly well poised to take advantage of these ML advances, due to the widespread digitization of medical data and the large number of diagnostic tests used to evaluate cardiovascular disease. Various ML approaches have successfully been applied to cardiovascular tests and diseases to automate interpretation, accurately perform measurements, and, in some cases, predict novel diagnoses from less invasive tests, effectively expanding the utility of more widely accessible diagnostic tests. Here, we present examples of some impactful advances in cardiovascular medicine using ML across a variety of modalities, with a focus on deep learning applications.

Generalizability of Machine Learning Models: Quantitative Evaluation of Three Methodological Pitfalls

Purpose

To investigate the impact of the following three methodological pitfalls on model generalizability: (a) violation of the independence assumption, (b) model evaluation with an inappropriate performance indicator or baseline for comparison, and (c) batch effect.

Materials and Methods

The authors used retrospective CT, histopathologic analysis, and radiography datasets to develop machine learning models with and without the three methodological pitfalls to quantitatively illustrate their effect on model performance and generalizability. F1 score was used to measure performance, and differences in performance between models developed with and without errors were assessed using the Wilcoxon rank sum test when applicable.

Results

Violation of the independence assumption by applying oversampling, feature selection, and data augmentation before splitting data into training, validation, and test sets seemingly improved model F1 scores by 71.2% for predicting local recurrence and 5.0% for predicting 3-year overall survival in head and neck cancer and by 46.0% for distinguishing histopathologic patterns in lung cancer. Randomly distributing data points for a patient across datasets superficially improved the F1 score by 21.8%. High model performance metrics did not indicate high-quality lung segmentation. In the presence of a batch effect, a model built for pneumonia detection had an F1 score of 98.7% but correctly classified only 3.86% of samples from a new dataset of healthy patients.

Conclusion

Machine learning models developed with these methodological pitfalls, which are undetectable during internal evaluation, produce inaccurate predictions; thus, understanding and avoiding these pitfalls is necessary for developing generalizable models.Keywords: Random Forest, Diagnosis, Prognosis, Convolutional Neural Network (CNN), Medical Image Analysis, Generalizability, Machine Learning, Deep Learning, Model Evaluation Supplemental material is available for this article. Published under a CC BY 4.0 license.

[Artificial intelligence and radiomics : Value in cardiac MRI]

CLINICAL/METHODICAL ISSUE

Cardiac diseases are the leading cause of death. Many diseases can be specifically treated once a valid diagnosis is established. Cardiac magnetic resonance imaging (MRI) plays a central role in the workup of many cardiac pathologies. However, image acquisition as well as interpretation and related secondary image evaluation are time-consuming and complex.

STANDARD RADIOLOGICAL METHODS

Cardiac MRI is becoming increasingly established in international guidelines for the evaluation of cardiac function and differential diagnosis of a wide variety of cardiac diseases.

METHODOLOGICAL INNOVATIONS

Cardiac MRI has limited reproducibility due to the acquisition technique and interpretation of findings with complex secondary measurements. Artificial intelligence techniques and radiomics offer the potential to improve the acquisition, interpretation, and reproducibility of cardiac MRI.

PERFORMANCE

Research suggests that artificial intelligence and radiomic analysis can improve cardiac MRI in terms of image acquisition and also diagnostic and prognostic value. Furthermore, the implementation of artificial intelligence and radiomics may result in the identification of new biomarkers.

ACHIEVEMENTS AND PRACTICAL RECOMMENDATIONS

The implementation of artificial intelligence in cardiac MRI has great potential. However, the current level of evidence is still limited in some aspects; in particular there are too few prospective and large multicenter studies available. As a result, the algorithms developed are often not sufficiently validated scientifically and are not yet applied in clinical routine.

Simultaneous multi-parametric acquisition and reconstruction techniques in cardiac magnetic resonance imaging: Basic concepts and status of clinical development

Simultaneous multi-parametric acquisition and reconstruction techniques (SMART) are gaining attention for their potential to overcome some of cardiovascular magnetic resonance imaging's (CMR) clinical limitations. The major advantages of SMART lie within their ability to simultaneously capture multiple "features" such as cardiac motion, respiratory motion, T1/T2 relaxation. This review aims to summarize the overarching theory of SMART, describing key concepts that many of these techniques share to produce co-registered, high quality CMR images in less time and with less requirements for specialized personnel. Further, this review provides an overview of the recent developments in the field of SMART by describing how they work, the parameters they can acquire, their status of clinical testing and validation, and by providing examples for how their use can improve the current state of clinical CMR workflows. Many of the SMART are in early phases of development and testing, thus larger scale, controlled trials are needed to evaluate their use in clinical setting and with different cardiac pathologies.

Compact pediatric cardiac magnetic resonance imaging protocols

Cardiac MRI is in many respects an ideal modality for pediatric cardiovascular imaging, enabling a complete noninvasive assessment of anatomy, morphology, function and flow in one radiation-free and potentially non-contrast exam. Nonetheless, traditionally lengthy and complex imaging acquisition strategies have often limited its broader use beyond specialized centers. In this review, the author presents practical cardiac MRI imaging protocols to facilitate the performance of succinct yet successful exams that provide the most salient clinical data for the majority of congenital and acquired pediatric cardiac disease. In addition, the author reviews newer and evolving techniques that permit more rapid but similarly diagnostic MRI, including compressed sensing and artificial intelligence/machine learning reconstruction, four-dimensional flow acquisition and blood pool contrast agents. With the modern armamentarium of cardiac MRI methods, the goal of compact yet comprehensive exams in children can now be realized.

The Applications of Artificial Intelligence in Cardiovascular Magnetic Resonance-A Comprehensive Review

Cardiovascular disease remains an integral field on which new research in both the biomedical and technological fields is based, as it remains the leading cause of mortality and morbidity worldwide. However, despite the progress of cardiac imaging techniques, the heart remains a challenging organ to study. Artificial intelligence (AI) has emerged as one of the major innovations in the field of diagnostic imaging, with a dramatic impact on cardiovascular magnetic resonance imaging (CMR). AI will be increasingly present in the medical world, with strong potential for greater diagnostic efficiency and accuracy. Regarding the use of AI in image acquisition and reconstruction, the main role was to reduce the time of image acquisition and analysis, one of the biggest challenges concerning magnetic resonance; moreover, it has been seen to play a role in the automatic correction of artifacts. The use of these techniques in image segmentation has allowed automatic and accurate quantification of the volumes and masses of the left and right ventricles, with occasional need for manual correction. Furthermore, AI can be a useful tool to directly help the clinician in the diagnosis and derivation of prognostic information of cardiovascular diseases. This review addresses the applications and future prospects of AI in CMR imaging, from image acquisition and reconstruction to image segmentation, tissue characterization, diagnostic evaluation, and prognostication.

Cardiac MR: From Theory to Practice

Cardiovascular disease (CVD) is the leading single cause of morbidity and mortality, causing over 17. 9 million deaths worldwide per year with associated costs of over $800 billion. Improving prevention, diagnosis, and treatment of CVD is therefore a global priority. Cardiovascular magnetic resonance (CMR) has emerged as a clinically important technique for the assessment of cardiovascular anatomy, function, perfusion, and viability. However, diversity and complexity of imaging, reconstruction and analysis methods pose some limitations to the widespread use of CMR. Especially in view of recent developments in the field of machine learning that provide novel solutions to address existing problems, it is necessary to bridge the gap between the clinical and scientific communities. This review covers five essential aspects of CMR to provide a comprehensive overview ranging from CVDs to CMR pulse sequence design, acquisition protocols, motion handling, image reconstruction and quantitative analysis of the obtained data. (1) The basic MR physics of CMR is introduced. Basic pulse sequence building blocks that are commonly used in CMR imaging are presented. Sequences containing these building blocks are formed for parametric mapping and functional imaging techniques. Commonly perceived artifacts and potential countermeasures are discussed for these methods. (2) CMR methods for identifying CVDs are illustrated. Basic anatomy and functional processes are described to understand the cardiac pathologies and how they can be captured by CMR imaging. (3) The planning and conduct of a complete CMR exam which is targeted for the respective pathology is shown. Building blocks are illustrated to create an efficient and patient-centered workflow. Further strategies to cope with challenging patients are discussed. (4) Imaging acceleration and reconstruction techniques are presented that enable acquisition of spatial, temporal, and parametric dynamics of the cardiac cycle. The handling of respiratory and cardiac motion strategies as well as their integration into the reconstruction processes is showcased. (5) Recent advances on deep learning-based reconstructions for this purpose are summarized. Furthermore, an overview of novel deep learning image segmentation and analysis methods is provided with a focus on automatic, fast and reliable extraction of biomarkers and parameters of clinical relevance.

Short-term memory neural network-based cognitive computing in sports training complexity pattern recognition

With the development of Chinese sports, many sports training researchers try to use artificial intelligence technology to study the training methods and training elements of athletes. However, in reality, these methods are often based on different basic training principles, resulting in the reduction in the generalization ability of artificial intelligence networks. This paper studies the complexity of sports training principles by using an artificial intelligence network model. Based on the improved model of dropout optimization algorithm, this paper proposes an artificial intelligence sports training node prediction method based on the combination of dropout optimization algorithm and short-term memory neural network (LSTM), which avoids the establishment of complex sports training models. Based on artificial intelligence operation and maintenance records and sports training core capacity experimental data, the maximum node static estimation of artificial intelligence sports training is realized. The research shows that the node prediction model is established by using the method described in this paper. Through experimental comparison and analysis, the model has high prediction accuracy. Due to the state memory function of LSTM, it has advantages in the prediction of 2000 data on a long time scale. The mean absolute error percentage of the prediction results is less than 3.4%, and the maximum absolute error percentage is less than 5.2%. The artificial intelligence network model in this paper has good generalization ability. Compared with other models, the model proposed in this paper can get more accurate prediction results in sports training of different groups and effectively alleviate the problem of overfitting. Therefore, traditional stadiums and gymnasiums should actively introduce artificial intelligence technology with a more positive attitude, to realize the development and innovation in technology application, service innovation, management efficiency, and function integration.

Automatic measurement plane placement for 4D Flow MRI of the great vessels using deep learning

PURPOSE

Despite the great potential and flexibility of 4D flow MRI for hemodynamic analysis, a major limitation is the need for time-consuming and user-dependent post-processing. We propose a fast four-step algorithm for rapid, robust, and repeatable flow measurements in the great vessels based on automatic placement of measurement planes and vessel segmentation.

METHODS

Our algorithm works by (1) subsampling the 3D image into 3D patches, (2) predicting the probability of each patch containing individual vessels and location/orientation of the vessel within the patch via a convolutional neural network, (3) selecting the predicted planes with highest probabilities for each vessel, and (4) shifting the plane centers to the maximum velocity within each plane. The method was trained on 283 scans and evaluated on 40 unseen scans by comparing algorithm-derived processing times, plane locations, and flow measurements to those of two manual observers (graduate students) using t-tests, Pearson correlation, and Bland-Altman analysis.

RESULTS

The average processing time for the algorithm (18 s) was shorter than observer 1 (362 s; P < 0.001) and observer 2 (317 s; P < 0.001). The distance between planes placed by the algorithm and those placed by manual observers was slightly greater (O1 vs. algorithm: 9.0 mm, O2 vs. algorithm: 10.3 mm) than the distance between planes placed by the two manual observers (8.3 mm). The correlation between flow values for planes placed by the algorithm and those placed by manual observers was slightly lower (O1 vs. algorithm: R = 0.68, O2 vs. algorithm: R = 0.72) than the flow correlation between the two manual observers (R = 0.81).

CONCLUSION

Our method is a feasible and accurate approach for fast, reproducible, and automated flow measurement and visualization in 4D flow MRI of the great vessels, with similar variability compared to a manual annotator as the variability between two manual observers. This approach could be applied in other anatomical regions.

Landmark Detection in Cardiac MRI by Using a Convolutional Neural Network

PURPOSE

To develop a convolutional neural network (CNN) solution for landmark detection in cardiac MRI (CMR).

MATERIALS AND METHODS

This retrospective study included cine, late gadolinium enhancement (LGE), and T1 mapping examinations from two hospitals. The training set included 2329 patients (34 089 images; mean age, 54.1 years; 1471 men; December 2017 to March 2020). A hold-out test set included 531 patients (7723 images; mean age, 51.5 years; 323 men; May 2020 to July 2020). CNN models were developed to detect two mitral valve plane and apical points on long-axis images. On short-axis images, anterior and posterior right ventricular (RV) insertion points and left ventricular (LV) center points were detected. Model outputs were compared with manual labels assigned by two readers. The trained model was deployed to MRI scanners.

RESULTS

For the long-axis images, successful detection of cardiac landmarks ranged from 99.7% to 100% for cine images and from 99.2% to 99.5% for LGE images. For the short-axis images, detection rates were 96.6% for cine, 97.6% for LGE, and 98.7% for T1 mapping. The Euclidean distances between model-assigned and manually assigned labels ranged from 2 to 3.5 mm for different landmarks, indicating close agreement between model-derived landmarks and manually assigned labels. For all views and imaging sequences, no differences between the models' assessment of images and the readers' assessment of images were found for the anterior RV insertion angle or LV length. Model inference for a typical cardiac cine series took 610 msec with the graphics processing unit and 5.6 seconds with central processing unit.

CONCLUSION

A CNN was developed for landmark detection on both long- and short-axis CMR images acquired with cine, LGE, and T1 mapping sequences, and the accuracy of the CNN was comparable with the interreader variation.Keywords: Cardiac, Heart, Convolutional Neural Network (CNN), Deep Learning Algorithms, Machine Learning Algorithms, Feature Detection, Quantification, Supervised Learning, MR Imaging Supplemental material is available for this article. Published under a CC BY 4.0 license.

Automated cardiac volume assessment and cardiac long- and short-axis imaging plane prediction from electrocardiogram-gated computed tomography volumes enabled by deep learning

AIMS

To develop an automated method for bloodpool segmentation and imaging plane re-slicing of cardiac computed tomography (CT) via deep learning (DL) for clinical use in coronary artery disease (CAD) wall motion assessment and reproducible longitudinal imaging.

METHODS AND RESULTS

One hundred patients who underwent clinically indicated cardiac CT scans with manually segmented left ventricle (LV) and left atrial (LA) chambers were used for training. For each patient, long-axis (LAX) and short-axis planes were manually defined by an imaging expert. A DL model was trained to predict bloodpool segmentations and imaging planes. Deep learning bloodpool segmentations showed close agreement with manual LV [median Dice: 0.91, Hausdorff distance (HD): 6.18 mm] and LA (Dice: 0.93, HD: 7.35 mm) segmentations and a strong correlation with manual ejection fraction (Pearson r: 0.95 LV, 0.92 LA). Predicted planes had low median location (6.96 mm) and angular orientation (7.96 ° ) errors which were comparable to inter-reader differences (P > 0.71). 84-97% of DL-prescribed LAX planes correctly intersected American Heart Association segments, which was comparable (P > 0.05) to manual slicing. In a test cohort of 144 patients, we evaluated the ability of the DL approach to provide diagnostic imaging planes. Visual scoring by two blinded experts determined ≥94% of DL-predicted planes to be diagnostically adequate. Further, DL-enabled visualization of LV wall motion abnormalities due to CAD and provided reproducible planes upon repeat imaging.

CONCLUSION

A volumetric, DL approach provides multiple chamber segmentations and can re-slice the imaging volume along standardized cardiac imaging planes for reproducible wall motion abnormality and functional assessment.

MR Imaging in the 21st Century: Technical Innovation over the First Two Decades

Clinical MRI systems have continually improved over the years since their introduction in the 1980s. In MRI technical development, the developments in each MRI system component, including data acquisition, image reconstruction, and hardware systems, have impacted the others. Progress in each component has induced new technology development opportunities in other components. New technologies outside of the MRI field, for example, computer science, data processing, and semiconductors, have been immediately incorporated into MRI development, which resulted in innovative applications. With high performance computing and MR technology innovations, MRI can now provide large volumes of functional and anatomical image datasets, which are important tools in various research fields. MRI systems are now combined with other modalities, such as positron emission tomography (PET) or therapeutic devices. These hybrid systems provide additional capabilities.

In this review, MRI advances in the last two decades will be considered. We will discuss the progress of MRI systems, the enabling technology, established applications, current trends, and the future outlook.

Automated CT Staging of Chronic Obstructive Pulmonary Disease Severity for Predicting Disease Progression and Mortality with a Deep Learning Convolutional Neural Network

Purpose

To develop a deep learning-based algorithm to stage the severity of chronic obstructive pulmonary disease (COPD) through quantification of emphysema and air trapping on CT images and to assess the ability of the proposed stages to prognosticate 5-year progression and mortality.

Materials and Methods

In this retrospective study, an algorithm using co-registration and lung segmentation was developed in-house to automate quantification of emphysema and air trapping from inspiratory and expiratory CT images. The algorithm was then tested in a separate group of 8951 patients from the COPD Genetic Epidemiology study (date range, 2007-2017). With measurements of emphysema and air trapping, bivariable thresholds were determined to define CT stages of severity (mild, moderate, severe, and very severe) and were evaluated for their ability to prognosticate disease progression and mortality using logistic regression and Cox regression.

Results

On the basis of CT stages, the odds of disease progression were greatest among patients with very severe disease (odds ratio [OR], 2.67; 95% CI: 2.02, 3.53; P < .001) and were elevated in patients with moderate disease (OR, 1.50; 95% CI: 1.22, 1.84; P = .001). The hazard ratio of mortality for very severe disease at CT was 2.23 times the normal ratio (95% CI: 1.93, 2.58; P < .001). When combined with Global Initiative for Chronic Obstructive Lung Disease (GOLD) staging, patients with GOLD stage 2 disease had the greatest odds of disease progression when the CT stage was severe (OR, 4.48; 95% CI: 3.18, 6.31; P < .001) or very severe (OR, 4.72; 95% CI: 3.13, 7.13; P < .001).

Conclusion

Automated CT algorithms can facilitate staging of COPD severity, have diagnostic performance comparable with that of spirometric GOLD staging, and provide further prognostic value when used in conjunction with GOLD staging.Supplemental material is available for this article.© RSNA, 2021See also commentary by Kalra and Ebrahimian in this issue.

Artificial Intelligence and Texture Analysis in Cardiac Imaging

PURPOSE OF REVIEW

The aim of this structured review is to summarize the current research applications and opportunities arising from artificial intelligence (AI) and texture analysis with regard to cardiac imaging.

RECENT FINDINGS

Current research findings suggest tremendous potential for AI in cardiac imaging, especially with regard to objective image analyses, overcoming the limitations of an observer-dependent subjective image interpretation. Researchers have used this technique across multiple imaging modalities, for instance to detect myocardial scars in cardiac MR imaging, to predict contrast enhancement in non-contrast studies, and to improve image acquisition and reconstruction. AI in medical imaging has the potential to provide novel, much-needed applications for improving patient care pertaining to the cardiovascular system. While several shortcomings are still present in the current methodology, AI may serve as a resourceful assistant to radiologists and clinicians alike.

Artificial intelligence: improving the efficiency of cardiovascular imaging

INTRODUCTION

Artificial intelligence (AI) describes the use of computational techniques to mimic human intelligence. In healthcare, this typically involves large medical datasets being used to predict a diagnosis, identify new disease genotypes or phenotypes, or guide treatment strategies. Noninvasive imaging remains a cornerstone for the diagnosis, risk stratification, and management of patients with cardiovascular disease. AI can facilitate every stage of the imaging process, from acquisition and reconstruction, to segmentation, measurement, interpretation, and subsequent clinical pathways.

AREAS COVERED

In this paper, we review state-of-the-art AI techniques and their current applications in cardiac imaging, and discuss the future role of AI as a precision medicine tool.

EXPERT OPINION

Cardiovascular medicine is primed for scalable AI applications which can interpret vast amounts of clinical and imaging data in greater depth than ever before. AI-augmented medical systems have the potential to improve workflow and provide reproducible and objective quantitative results which can inform clinical decisions. In the foreseeable future, AI may work in the background of cardiac image analysis software and routine clinical reporting, automatically collecting data and enabling real-time diagnosis and risk stratification.

Deep Learning Single-Frame and Multiframe Super-Resolution for Cardiac MRI

Background Cardiac MRI is limited by long acquisition times, yet faster acquisition of smaller-matrix images reduces spatial detail. Deep learning (DL) might enable both faster acquisition and higher spatial detail via super-resolution. Purpose To explore the feasibility of using DL to enhance spatial detail from small-matrix MRI acquisitions and evaluate its performance against that of conventional image upscaling methods. Materials and Methods Short-axis cine cardiac MRI examinations performed between January 2012 and December 2018 at one institution were retrospectively collected for algorithm development and testing. Convolutional neural networks (CNNs), a form of DL, were trained to perform super resolution in image space by using synthetically generated low-resolution data. There were 70%, 20%, and 10% of examinations allocated to training, validation, and test sets, respectively. CNNs were compared against bicubic interpolation and Fourier-based zero padding by calculating the structural similarity index (SSIM) between high-resolution ground truth and each upscaling method. Means and standard deviations of the SSIM were reported, and statistical significance was determined by using the Wilcoxon signed-rank test. For evaluation of clinical performance, left ventricular volumes were measured, and statistical significance was determined by using the paired Student t test. Results For CNN training and retrospective analysis, 400 MRI scans from 367 patients (mean age, 48 years ± 18; 214 men) were included. All CNNs outperformed zero padding and bicubic interpolation at upsampling factors from two to 64 (P < .001). CNNs outperformed zero padding on more than 99.2% of slices (9828 of 9907). In addition, 10 patients (mean age, 51 years ± 22; seven men) were prospectively recruited for super-resolution MRI. Super-resolved low-resolution images yielded left ventricular volumes comparable to those from full-resolution images (P > .05), and super-resolved full-resolution images appeared to further enhance anatomic detail. Conclusion Deep learning outperformed conventional upscaling methods and recovered high-frequency spatial information. Although training was performed only on short-axis cardiac MRI examinations, the proposed strategy appeared to improve quality in other imaging planes. © RSNA, 2020 Online supplemental material is available for this article.