Multimodal deep learning of fundus abnormalities and traditional risk factors for cardiovascular risk prediction

M2AI-CVD: Multi-modal AI approach cardiovascular risk prediction system using fundus images

Cardiovascular diseases (CVD) represent a significant global health challenge, often remaining undetected until severe cardiac events, such as heart attacks or strokes, occur. In regions like Qatar, research focused on non-invasive CVD identification methods, such as retinal imaging and dual-energy X-ray absorptiometry (DXA), is limited. This study presents a groundbreaking system known as Multi-Modal Artificial Intelligence for Cardiovascular Disease (M2AI-CVD), designed to provide highly accurate predictions of CVD. The M2AI-CVD framework employs a four-fold methodology: First, it rigorously evaluates image quality and processes lower-quality images for further analysis. Subsequently, it uses the Entropy-based Fuzzy C Means (EnFCM) algorithm for precise image segmentation. The Multi-Modal Boltzmann Machine (MMBM) is then employed to extract relevant features from various data modalities, while the Genetic Algorithm (GA) selects the most informative features. Finally, a ZFNet Convolutional Neural Network (ZFNetCNN) classifies images, effectively distinguishing between CVD and Non-CVD cases. The research's culmination, tested across five distinct datasets, yields outstanding results, with an accuracy of 95.89%, sensitivity of 96.89%, and specificity of 98.7%. This multi-modal AI approach offers a promising solution for the accurate and early detection of cardiovascular diseases, significantly improving the prospects of timely intervention and improved patient outcomes in the realm of cardiovascular health.

Distribution coefficient prediction using multimodal machine learning based on soil adsorption factors, XRF, and XRD spectrum data

The distribution coefficient (Kd) plays a crucial role in predicting the migration behavior of radionuclides in the soil environment. However, Kd depends on the complexities of geological and environmental factors, and existing models often do not reflect the unique soil properties. We propose a multimodal technique to predict Kd values for radionuclide adsorption in soils surrounding nuclear facilities in Republic of Korea. We integrated and trained three sub-networks reflecting different data domains: soil adsorption factors for physicochemical conditions, X-ray fluorescence (XRF) data, and X-ray diffraction (XRD) spectra for inherent soil properties. Our multimodal model achieved high performance, with a coefficient of determination (R2) of 0.84 and root mean squared error (RMSE) of 0.89 for natural log-transformed Kd. This is the first study to develop a multimodal model that simultaneously incorporates inherent soil properties and adsorption factors to predict Kd. We investigated influential peaks in XRD spectra and also revealed that pH and calcium oxide (CaO) were significant variables in soil adsorption factors and XRF data, respectively. These results promote the use of a multimodal model to predict Kd values by integrating data from different domains, providing a cost-effective and novel approach to elucidate the mechanisms of radionuclide adsorption in soil.

Artificial intelligence-enhanced patient evaluation: bridging art and science

The advent of digital health and artificial intelligence (AI) has promised to revolutionize clinical care, but real-world patient evaluation has yet to witness transformative changes. As history taking and physical examination continue to rely on long-established practices, a growing pipeline of AI-enhanced digital tools may soon augment the traditional clinical encounter into a data-driven process. This article presents an evidence-backed vision of how promising AI applications may enhance traditional practices, streamlining tedious tasks while elevating diverse data sources, including AI-enabled stethoscopes, cameras, and wearable sensors, to platforms for personalized medicine and efficient care delivery. Through the lens of traditional patient evaluation, we illustrate how digital technologies may soon be interwoven into routine clinical workflows, introducing a novel paradigm of longitudinal monitoring. Finally, we provide a skeptic's view on the practical, ethical, and regulatory challenges that limit the uptake of such technologies.

Triglyceride-Glucose Index as Predictor for Hypertension, CHD and STROKE Risk among Non-Diabetic Patients: A NHANES Cross-Sectional Study 2001-2020

BACKGROUND

Cardiovascular disease (CVD) is a leading cause of global mortality. Early intervention and prevention of CVD depend on accurately predicting the risk of CVD. This study aimed to investigate the association between the TyG index and the risk of coronary heart disease (CHD), congestive heart failure (CHF), heart attack (HA), stroke, and hypertension (HTN) among patients without diabetes in the United States.

METHODS

In this retrospective, cross-sectional study, we used data from the National Health and Nutrition Examination Survey (NHANES) from 2001 to 2020. We conducted several regression analysis models and calculated the sensitivity and specificity of (TyG) index for predicting the onset of CHD, CHF, HA, stroke, and HTN.

RESULTS

A total of 10,937 individuals without diabetes participated in our study. Individuals with a TyG index greater than 8.96 displayed significant increasing in various parameters, including BMI, systolic/diastolic blood pressure, total cholesterol, LDL, and Apo-B levels (p < 0.001). Almost all regression models ensured that a higher TyGI value was associated with higher odds of having CHD, CHF, HA, stroke, and HTN, which patients with a TyGI value higher than 8.96 have odds ratios of 2.24-5.58 for CHD, 1.68-4.42 for stroke, 2.45-3.77 for HA and 1.75-3.93 for HTN comparing than patients with a TyGI value lower than 8.11 (p-value < 0.05).We evaluated the predictive value of the TyG index for each endpoint, obtaining the following area under the curve (AUC) values: 54.75% for CHF (95% CI: 0.542-0.614), 52.32% for stroke (95% CI: 0.529-0.584), 55.67% for HA (95% CI: 0.595-0.646), 55.59% for HTN (95% CI: 0.574-0.597), and 50.31% for CHD (95% CI: 0.592-0.646).

CONCLUSION

The TyG index showed a strong correlation with cardiovascular risk factors in individuals without diabetes, however it was a poor predictor of almost studied cardiovascular diseases.

Deep Learning Models for the Screening of Cognitive Impairment Using Multimodal Fundus Images

OBJECTIVE

We aimed to develop a deep learning system capable of identifying subjects with cognitive impairment quickly and easily based on multimodal ocular images.

DESIGN

Cross sectional study.

SUBJECTS

Participants of Beijing Eye Study 2011 and patients attending Beijing Tongren Eye Center and Beijing Tongren Hospital Physical Examination Center.

METHODS

We trained and validated a deep learning algorithm to assess cognitive impairment using retrospectively collected data from the Beijing Eye Study 2011. Cognitive impairment was defined as a Mini-Mental State Examination score < 24. Based on fundus photographs and OCT images, we developed 5 models based on the following sets of images: macula-centered fundus photographs, optic disc-centered fundus photographs, fundus photographs of both fields, OCT images, and fundus photographs of both fields with OCT (multimodal). The performance of the models was evaluated and compared in an external validation data set, which was collected from patients attending Beijing Tongren Eye Center and Beijing Tongren Hospital Physical Examination Center.

MAIN OUTCOME MEASURES

Area under the curve (AUC).

RESULTS

A total of 9424 retinal photographs and 4712 OCT images were used to develop the model. The external validation sets from each center included 1180 fundus photographs and 590 OCT images. Model comparison revealed that the multimodal performed best, achieving an AUC of 0.820 in the internal validation set, 0.786 in external validation set 1, and 0.784 in external validation set 2. We evaluated the performance of the multi-model in different sexes and different age groups; there were no significant differences. The heatmap analysis showed that signals around the optic disc in fundus photographs and the retina and choroid around the macular and optic disc regions in OCT images were used by the multimodal to identify participants with cognitive impairment.

CONCLUSIONS

Fundus photographs and OCT can provide valuable information on cognitive function. Multimodal models provide richer information compared with single-mode models. Deep learning algorithms based on multimodal retinal images may be capable of screening cognitive impairment. This technique has potential value for broader implementation in community-based screening or clinic settings.

FINANCIAL DISCLOSURE(S)

Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Diagnosing Systemic Disorders with AI Algorithms Based on Ocular Images

The advent of artificial intelligence (AI), especially the state-of-the-art deep learning frameworks, has begun a silent revolution in all medical subfields, including ophthalmology. Due to their specific microvascular and neural structures, the eyes are anatomically associated with the rest of the body. Hence, ocular image-based AI technology may be a useful alternative or additional screening strategy for systemic diseases, especially where resources are scarce. This review summarizes the current applications of AI related to the prediction of systemic diseases from multimodal ocular images, including cardiovascular diseases, dementia, chronic kidney diseases, and anemia. Finally, we also discuss the current predicaments and future directions of these applications.