Application and Translation of Artificial Intelligence to Cardiovascular Imaging in Nuclear Medicine and Noncontrast CT

Reproducibility of Left Ventricular Function Derived From Cardiac Magnetic Resonance and Gated 13N-Ammonia Positron Emission Tomography Myocardial Perfusion Imaging: A Head-to-Head Comparison Using Hybrid Positron Emission Tomography/Magnetic Resonance

RATIONALE AND OBJECTIVES

Cardiac magnetic resonance (CMR) and gated 13N-ammonia positron emission tomography myocardial perfusion imaging (PET-MPI) offer accurate and highly comparable global left ventricular ejection fraction (LVEF) measurements. In addition to accuracy, however, reproducibility is crucial to avoid variations in LVEF assessment potentially negatively impacting treatment decisions. We performed a head-to-head comparison of the reproducibility of LVEF measurements derived from simultaneously acquired CMR and PET-MPI using different state-of-the-art commercially available software.

MATERIALS AND METHODS

93 patients undergoing hybrid PET/MR were retrospectively included. LVEF was derived from CMR and PET-MPI at two separate core labs, using two state-of-the-art software packages for CMR (cvi42 and Medis Suite MR) and PET (QPET and CardIQ Physio). Intra- and inter-reader agreement was assessed using correlation and Bland-Altman (BA) analyses.

RESULTS

While intra- and inter-reader reproducibility of LVEF was high among both modalities and all software packages (r ≥ 0.87 and ICC≥0.91, all significant at p < 0.0001), LVEF derived from PET-MPI and analyzed with QPET outperformed all other analyses (intra-reader reproducibility: r = 0.99, ICC=0.99; inter-reader reproducibility: r = 0.98, ICC=1.00; Pearson correlations significantly higher than all others at p ≤ 0.0001). BA analyses showed smaller biases for LVEF derived from PET-MPI (-0.1% and +0.9% for intra-reader, -0.4% and -0.8% for inter-reader agreement) than those derived from CMR (+0.7% and +2.8% for intra-reader, -0.9% and -2.2% for inter-reader agreement) with similar results for BA limits of agreement.

CONCLUSION

Gated 13N-ammonia PET-MPI provides equivalent reproducibility of LVEF compared to CMR. It may offer a valid alternative to CMR for patients requiring LV functional assessment.

2022 Artificial intelligence primer for the nuclear cardiologist

Driven by advances in computing power, the past decade has seen rapid developments in artificial intelligence (AI) which now offers potential enhancements to every aspect of nuclear cardiology workflow including acquisition, reconstruction, segmentation, direct image analysis, and interpretation; as well as facilitating clinical and imaging big-data integration for superior personalized risk stratification. To understand the relevance and potential of AI in their field, this review provides a primer for nuclear cardiologists in 2022. The aim is to explain terminology and provide a summary of key current implementations, challenges, and future aspirations of AI-based enhancements to nuclear cardiology.

Patient-level explainable machine learning to predict major adverse cardiovascular events from SPECT MPI and CCTA imaging

BACKGROUND

Machine learning (ML) has shown promise in improving the risk prediction in non-invasive cardiovascular imaging, including SPECT MPI and coronary CT angiography. However, most algorithms used remain black boxes to clinicians in how they compute their predictions. Furthermore, objective consideration of the multitude of available clinical data, along with the visual and quantitative assessments from CCTA and SPECT, are critical for optimal patient risk stratification. We aim to provide an explainable ML approach to predict MACE using clinical, CCTA, and SPECT data.

METHODS

Consecutive patients who underwent clinically indicated CCTA and SPECT myocardial imaging for suspected CAD were included and followed up for MACEs. A MACE was defined as a composite outcome that included all-cause mortality, myocardial infarction, or late revascularization. We employed an Automated Machine Learning (AutoML) approach to predict MACE using clinical, CCTA, and SPECT data. Various mainstream models with different sets of hyperparameters have been explored, and critical predictors of risk are obtained using explainable techniques on the global and patient levels. Ten-fold cross-validation was used in training and evaluating the AutoML model.

RESULTS

A total of 956 patients were included (mean age 61.1 ±14.2 years, 54% men, 89% hypertension, 81% diabetes, 84% dyslipidemia). Obstructive CAD on CCTA and ischemia on SPECT were observed in 14% of patients, and 11% experienced MACE. ML prediction's sensitivity, specificity, and accuracy in predicting a MACE were 69.61%, 99.77%, and 96.54%, respectively. The top 10 global predictive features included 8 CCTA attributes (segment involvement score, number of vessels with severe plaque ≥70, ≥50% stenosis in the left marginal coronary artery, calcified plaque, ≥50% stenosis in the left circumflex coronary artery, plaque type in the left marginal coronary artery, stenosis degree in the second obtuse marginal of the left circumflex artery, and stenosis category in the marginals of the left circumflex artery) and 2 clinical features (past medical history of MI or left bundle branch block, being an ever smoker).

CONCLUSION

ML can accurately predict risk of developing a MACE in patients suspected of CAD undergoing SPECT MPI and CCTA. ML feature-ranking can also show, at a sample- as well as at a patient-level, which features are key in making such a prediction.

Developing a novel positronium biomarker for cardiac myxoma imaging

PURPOSE

Cardiac myxoma (CM), the most common cardiac tumor in adults, accounts for 50-75% of benign cardiac tumors. The diagnosis of CM is often elusive, especially in young stroke survivors and transthoracic echocardiography (TTE) is the initial technique for the differential diagnostics of CM. Less invasive cardiac computed tomography (CT) and magnetic resonance imaging (MRI) are not available for the majority of cardiac patients. Here, a robust imaging approach, ortho-Positronium (o-Ps) imaging, is presented to determine cardiac myxoma extracted from patients undergoing urgent cardiac surgery due to unexpected atrial masses. We aimed to assess if the o-Ps atom, produced copiously in intramolecular voids during the PET imaging, serves as a biomarker for CM diagnosing.

METHODS

Six perioperative CM and normal (adipose) tissue samples from patients, with primary diagnosis confirmed by the histopathology examination, were examined using positron annihilation lifetime spectroscopy (PALS) and micro-CT. Additionally, cell cultures and confocal microscopy techniques were used to picture cell morphology and origin.

RESULTS

We observed significant shortening in the mean o-Ps lifetime in tumor with compare to normal tissues: an average value of 1.92(02) ns and 2.72(05) ns for CM and the adipose tissue, respectively. Microscopic differences between tumor samples, confirmed in histopathology examination and micro-CT, did not influenced the major positronium imaging results.

CONCLUSIONS

Our findings, combined with o-Ps lifetime analysis, revealed the novel emerging positronium imaging marker (o-PS) for cardiovascular imaging. This method opens the new perspective to facilitate the quantitative in vivo assessment of intracardiac masses on a molecular (nanoscale) level.

Advances in Single-Photon Emission Computed Tomography

The clinical presentation of coronary artery disease (CAD) has changed during the last 20 years with less ischemia on stress testing and more nonobstructive CAD on coronary angiography. Single-photon emission computed tomography (SPECT) myocardial perfusion imaging should include the measurement of myocardial flow reserve and assessment of coronary calcium for the diagnosis of nonobstructive CAD and coronary microvascular disease. SPECT/CT systems provide reliable attenuation correction for better specificity and low-dose CT for coronary calcium evaluation. SPECT MFR measurement is accurate, well validated, and repeatable.

Real-World and Regulatory Perspectives of Artificial Intelligence in Cardiovascular Imaging

Recent progress in digital health data recording, advances in computing power, and methodological approaches that extract information from data as artificial intelligence are expected to have a disruptive impact on technology in medicine. One of the potential benefits is the ability to extract new and essential insights from the vast amount of data generated during health care delivery every day. Cardiovascular imaging is boosted by new intelligent automatic methods to manage, process, segment, and analyze petabytes of image data exceeding historical manual capacities. Algorithms that learn from data raise new challenges for regulatory bodies. Partially autonomous behavior and adaptive modifications and a lack of transparency in deriving evidence from complex data pose considerable problems. Controlling new technologies requires new controlling techniques and ongoing regulatory research. All stakeholders must participate in the quest to find a fair balance between innovation and regulation. The regulatory approach to artificial intelligence must be risk-based and resilient. A focus on unknown emerging risks demands continuous surveillance and clinical evaluation during the total product life cycle. Since learning algorithms are data-driven, high-quality data is fundamental for good machine learning practice. Mining, processing, validation, governance, and data control must account for bias, error, inappropriate use, drifts, and shifts, particularly in real-world data. Regulators worldwide are tackling twenty-first century challenges raised by “learning” medical devices. Ethical concerns and regulatory approaches are presented. The paper concludes with a discussion on the future of responsible artificial intelligence.

Handling missing values in machine learning to predict patient-specific risk of adverse cardiac events: Insights from REFINE SPECT registry

BACKGROUND

Machine learning (ML) models can improve prediction of major adverse cardiovascular events (MACE), but in clinical practice some values may be missing. We evaluated the influence of missing values in ML models for patient-specific prediction of MACE risk.

METHODS

We included 20,179 patients from the multicenter REFINE SPECT registry with MACE follow-up data. We evaluated seven methods for handling missing values: 1) removal of variables with missing values (ML-Remove), 2) imputation with median and unique category for continuous and categorical variables, respectively (ML-Traditional), 3) unique category for missing variables (ML-Unique), 4) cluster-based imputation (ML-Cluster), 5) regression-based imputation (ML-Regression), 6) missRanger imputation (ML-MR), and 7) multiple imputation (ML-MICE). We trained ML models with full data and simulated missing values in testing patients. Prediction performance was evaluated using area under the receiver-operating characteristic curve (AUC) and compared with a model without missing values (ML-All), expert visual diagnosis and total perfusion deficit (TPD).

RESULTS

During mean follow-up of 4.7 ± 1.5 years, 3,541 patients experienced at least one MACE (3.7% annualized risk). ML-All (reference model-no missing values) had AUC 0.799 for MACE risk prediction. All seven models with missing values had lower AUC (ML-Remove: 0.778, ML-MICE: 0.774, ML-Cluster: 0.771, ML-Traditional: 0.771, ML-Regression: 0.770, ML-MR: 0.766, and ML-Unique: 0.766; p < 0.01 for ML-Remove vs remaining methods). Stress TPD (AUC 0.698) and visual diagnosis (0.681) had the lowest AUCs.

CONCLUSION

Missing values reduce the accuracy of ML models when predicting MACE risk. Removing variables with missing values and retraining the model may yield superior patient-level prediction performance.

Applications of Generative Adversarial Networks (GANs) in Positron Emission Tomography (PET) imaging: A review

PURPOSE

This paper reviews recent applications of Generative Adversarial Networks (GANs) in Positron Emission Tomography (PET) imaging. Recent advances in Deep Learning (DL) and GANs catalysed the research of their applications in medical imaging modalities. As a result, several unique GAN topologies have emerged and been assessed in an experimental environment over the last two years.

METHODS

The present work extensively describes GAN architectures and their applications in PET imaging. The identification of relevant publications was performed via approved publication indexing websites and repositories. Web of Science, Scopus, and Google Scholar were the major sources of information.

RESULTS

The research identified a hundred articles that address PET imaging applications such as attenuation correction, de-noising, scatter correction, removal of artefacts, image fusion, high-dose image estimation, super-resolution, segmentation, and cross-modality synthesis. These applications are presented and accompanied by the corresponding research works.

CONCLUSION

GANs are rapidly employed in PET imaging tasks. However, specific limitations must be eliminated to reach their full potential and gain the medical community's trust in everyday clinical practice.

Classification of ischemia from myocardial polar maps in 15O-H2O cardiac perfusion imaging using a convolutional neural network

We implemented a two-dimensional convolutional neural network (CNN) for classification of polar maps extracted from Carimas (Turku PET Centre, Finland) software used for myocardial perfusion analysis. 138 polar maps from ¹⁵O–H₂O stress perfusion study in JPEG format from patients classified as ischemic or non-ischemic based on finding obstructive coronary artery disease (CAD) on invasive coronary artery angiography were used. The CNN was evaluated against the clinical interpretation. The classification accuracy was evaluated with: accuracy (ACC), area under the receiver operating characteristic curve (AUC), F1 score (F1S), sensitivity (SEN), specificity (SPE) and precision (PRE). The CNN had a median ACC of 0.8261, AUC of 0.8058, F1S of 0.7647, SEN of 0.6500, SPE of 0.9615 and PRE of 0.9286. In comparison, clinical interpretation had ACC of 0.8696, AUC of 0.8558, F1S of 0.8333, SEN of 0.7500, SPE of 0.9615 and PRE of 0.9375. The CNN classified only 2 cases differently than the clinical interpretation. The clinical interpretation and CNN had similar accuracy in classifying false positives and true negatives. Classification of ischemia is feasible in ¹⁵O–H₂O stress perfusion imaging using JPEG polar maps alone with a custom CNN and may be useful for the detection of obstructive CAD.

Artificial Intelligence and Cardiac PET/Computed Tomography Imaging

Artificial intelligence is an important technology, with rapidly expanding applications for cardiac PET. We review the common terminology, including methods for training and testing, which are fundamental to understanding artificial intelligence. Next, we highlight applications to improve image acquisition, reconstruction, and segmentation. Computed tomographic imaging is commonly acquired in conjunction with PET and various artificial intelligence methods have been applied, including methods to automatically extract anatomic information or generate synthetic attenuation images. Last, we describe methods to automate disease diagnosis or risk stratification. This summary highlights the current and future clinical applications of artificial intelligence to cardiovascular PET imaging.

Machine Learning Algorithms to Detect Sex in Myocardial Perfusion Imaging

Myocardial perfusion imaging (MPI) is an essential tool used to diagnose and manage patients with suspected or known coronary artery disease. Additionally, the General Data Protection Regulation (GDPR) represents a milestone about individuals' data security concerns. On the other hand, Machine Learning (ML) has had several applications in the most diverse knowledge areas. It is conceived as a technology with huge potential to revolutionize health care. In this context, we developed ML models to evaluate their ability to distinguish an individual's sex from MPI assessment. We used 260 polar maps (140 men/120 women) to train ML algorithms from a database of patients referred to a university hospital for clinically indicated MPI from January 2016 to December 2018. We tested 07 different ML models, namely, Classification and Regression Tree (CART), Naive Bayes (NB), K-Nearest Neighbors (KNN), Support Vector Machine (SVM), Adaptive Boosting (AB), Random Forests (RF) and, Gradient Boosting (GB). We used a cross-validation strategy. Our work demonstrated that ML algorithms could perform well in assessing the sex of patients undergoing myocardial scintigraphy exams. All the models had accuracy greater than 82%. However, only SVM achieved 90%. KNN, RF, AB, GB had, respectively, 88, 86, 85, 83%. Accuracy standard deviation was lower in KNN, AB, and RF (0.06). SVM and RF had had the best area under the receiver operating characteristic curve (0.93), followed by GB (0.92), KNN (0.91), AB, and NB (0.9). SVM and AB achieved the best precision. Our results bring some challenges regarding the autonomy of patients who wish to keep sex information confidential and certainly add greater complexity to the debate about what data should be considered sensitive to the light of the GDPR.

Artificial intelligence in echocardiography: detection, functional evaluation, and disease diagnosis

Ultrasound is one of the most important examinations for clinical diagnosis of cardiovascular diseases. The speed of image movements driven by the frequency of the beating heart is faster than that of other organs. This particularity of echocardiography poses a challenge for sonographers to diagnose accurately. However, artificial intelligence for detection, functional evaluation, and disease diagnosis has gradually become an alternative for accurate diagnosis and treatment using echocardiography. This work discusses the current application of artificial intelligence in echocardiography technology, its limitations, and future development directions.

The application of artificial intelligence and data integration in COVID-19 studies: a scoping review

Objective

To summarize how artificial intelligence (AI) is being applied in COVID-19 research and determine whether these AI applications integrated heterogenous data from different sources for modeling.

Materials and Methods

We searched 2 major COVID-19 literature databases, the National Institutes of Health’s LitCovid and the World Health Organization’s COVID-19 database on March 9, 2021. Following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guideline, 2 reviewers independently reviewed all the articles in 2 rounds of screening.

Results

In the 794 studies included in the final qualitative analysis, we identified 7 key COVID-19 research areas in which AI was applied, including disease forecasting, medical imaging-based diagnosis and prognosis, early detection and prognosis (non-imaging), drug repurposing and early drug discovery, social media data analysis, genomic, transcriptomic, and proteomic data analysis, and other COVID-19 research topics. We also found that there was a lack of heterogenous data integration in these AI applications.

Discussion

Risk factors relevant to COVID-19 outcomes exist in heterogeneous data sources, including electronic health records, surveillance systems, sociodemographic datasets, and many more. However, most AI applications in COVID-19 research adopted a single-sourced approach that could omit important risk factors and thus lead to biased algorithms. Integrating heterogeneous data for modeling will help realize the full potential of AI algorithms, improve precision, and reduce bias.

Conclusion

There is a lack of data integration in the AI applications in COVID-19 research and a need for a multilevel AI framework that supports the analysis of heterogeneous data from different sources.

Explainable artificial intelligence in high-throughput drug repositioning for subgroup stratifications with interventionable potential

Enabling precision medicine requires developing robust patient stratification methods as well as drugs tailored to homogeneous subgroups of patients from a heterogeneous population. Developing de novo drugs is expensive and time consuming with an ultimately low FDA approval rate. These limitations make developing new drugs for a small portion of a disease population unfeasible. Therefore, drug repositioning is an essential alternative for developing new drugs for a disease subpopulation. This shows the importance of developing data-driven approaches that find druggable homogeneous subgroups within the disease population and reposition the drugs for these subgroups. In this study, we developed an explainable AI approach for patient stratification and drug repositioning. Contrast pattern mining and network analysis were used to discover homogeneous subgroups within a disease population. For each subgroup, a biomedical network analysis was done to find the drugs that are most relevant to a given subgroup of patients. The set of candidate drugs for each subgroup was ranked using an aggregated drug score assigned to each drug. The proposed method represents a human-in-the-loop framework, where medical experts use the data-driven results to generate hypotheses and obtain insights into potential therapeutic candidates for patients who belong to a subgroup. Colorectal cancer (CRC) was used as a case study. Patients' phenotypic and genotypic data was utilized with a heterogeneous knowledge base because it gives a multi-view perspective for finding new indications for drugs outside of their original use. Our analysis of the top candidate drugs for the subgroups identified by medical experts showed that most of these drugs are cancer-related, and most of them have the potential to be a CRC regimen based on studies in the literature.

Quantitative clinical nuclear cardiology, part 2: Evolving/emerging applications

Quantitative analysis has been applied extensively to image processing and interpretation in nuclear cardiology to improve disease diagnosis and risk stratification. This is Part 2 of a two-part continuing medical education article, which will review the potential clinical role for emerging quantitative analysis tools. The article will describe advanced methods for quantifying dyssynchrony, ventricular function and perfusion, and hybrid imaging analysis. This article discusses evolving methods to measure myocardial blood flow with positron emission tomography and single-photon emission computed tomography. Novel quantitative assessments of myocardial viability, microcalcification and in patients with cardiac sarcoidosis and cardiac amyloidosis will also be described. Lastly, we will review the potential role for artificial intelligence to improve image analysis, disease diagnosis, and risk prediction. The potential clinical role for all these novel techniques will be highlighted as well as methods to optimize their implementation.

Quantitative clinical nuclear cardiology, part 2: Evolving/emerging applications

Quantitative analysis has been applied extensively to image processing and interpretation in nuclear cardiology to improve disease diagnosis and risk stratification. This is Part 2 of a two-part continuing medical education article, which will review the potential clinical role for emerging quantitative analysis tools. The article will describe advanced methods for quantifying dyssynchrony, ventricular function and perfusion, and hybrid imaging analysis. This article discusses evolving methods to measure myocardial blood flow with positron emission tomography and single-photon emission computed tomography. Novel quantitative assessments of myocardial viability, microcalcification and in patients with cardiac sarcoidosis and cardiac amyloidosis will also be described. Lastly, we will review the potential role for artificial intelligence to improve image analysis, disease diagnosis, and risk prediction. The potential clinical role for all these novel techniques will be highlighted as well as methods to optimize their implementation. (J Nucl Cardiol 2020).