1
|
Gu Z, Liu S, Ma H, Long Y, Jiao X, Gao X, Du B, Bi X, Shi X. Estimation of Machine Learning-Based Models to Predict Dementia Risk in Patients With Atherosclerotic Cardiovascular Diseases: UK Biobank Study. JMIR Aging 2025; 8:e64148. [PMID: 40009844 DOI: 10.2196/64148] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2024] [Revised: 10/31/2024] [Accepted: 01/20/2025] [Indexed: 02/28/2025] Open
Abstract
BACKGROUND The atherosclerotic cardiovascular disease (ASCVD) is associated with dementia. However, the risk factors of dementia in patients with ASCVD remain unclear, necessitating the development of accurate prediction models. OBJECTIVE The aim of the study is to develop a machine learning model for use in patients with ASCVD to predict dementia risk using available clinical and sociodemographic data. METHODS This prognostic study included patients with ASCVD between 2006 and 2010, with registration of follow-up data ending on April 2023 based on the UK Biobank. We implemented a data-driven strategy, identifying predictors from 316 variables and developing a machine learning model to predict the risk of incident dementia, Alzheimer disease, and vascular dementia within 5, 10, and longer-term follow-up in patients with ASCVD. RESULTS A total of 29,561 patients with ASCVD were included, and 1334 (4.51%) developed dementia during a median follow-up time of 10.3 (IQR 7.6-12.4) years. The best prediction model (UK Biobank ASCVD risk prediction model) was light gradient boosting machine, comprising 10 predictors including age, time to complete pairs matching tasks, mean time to correctly identify matches, mean sphered cell volume, glucose levels, forced expiratory volume in 1 second z score, C-reactive protein, forced vital capacity, time engaging in activities, and age first had sexual intercourse. This model achieved the following performance metrics for all incident dementia: area under the receiver operating characteristic curve: mean 0.866 (SD 0.027), accuracy: mean 0.883 (SD 0.010), sensitivity: mean 0.637 (SD 0.084), specificity: mean 0.914 (SD 0.012), precision: mean 0.479 (SD 0.031), and F1-score: mean 0.546 (SD 0.043). Meanwhile, this model was well-calibrated (Kolmogorov-Smirnov test showed goodness-of-fit P value>.99) and maintained robust performance across different temporal cohorts. Besides, the model had a beneficial potential in clinical practice with a decision curve analysis. CONCLUSIONS The findings of this study suggest that predictive modeling could inform patients and clinicians about ASCVD at risk for dementia.
Collapse
Affiliation(s)
- Zhengsheng Gu
- Department of Neurology, First Affiliated Hospital of Naval Medical University, Shanghai, China
| | - Shuang Liu
- KLATASDS-MOE, Academy of Statistics and Interdisciplinary Sciences, School of Statistics, East China Normal University, Shanghai, China
| | - Huijuan Ma
- KLATASDS-MOE, Academy of Statistics and Interdisciplinary Sciences, School of Statistics, East China Normal University, Shanghai, China
| | - Yifan Long
- KLATASDS-MOE, Academy of Statistics and Interdisciplinary Sciences, School of Statistics, East China Normal University, Shanghai, China
| | - Xuehao Jiao
- Department of Neurology, First Affiliated Hospital of Naval Medical University, Shanghai, China
| | - Xin Gao
- Department of Neurology, First Affiliated Hospital of Naval Medical University, Shanghai, China
| | - Bingying Du
- Department of Neurology, First Affiliated Hospital of Naval Medical University, Shanghai, China
- Institute for Translational Brain Research, Fudan University, Shanghai, China
| | - Xiaoying Bi
- Department of Neurology, First Affiliated Hospital of Naval Medical University, Shanghai, China
| | - Xingjie Shi
- KLATASDS-MOE, Academy of Statistics and Interdisciplinary Sciences, School of Statistics, East China Normal University, Shanghai, China
| |
Collapse
|
2
|
Schoene AM, Garverich S, Ibrahim I, Shah S, Irving B, Dacso CC. Automatically extracting social determinants of health for suicide: a narrative literature review. NPJ MENTAL HEALTH RESEARCH 2024; 3:51. [PMID: 39506139 PMCID: PMC11541747 DOI: 10.1038/s44184-024-00087-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/25/2024] [Accepted: 09/09/2024] [Indexed: 11/08/2024]
Abstract
Suicide is a complex phenomenon that is often not preceded by a diagnosed mental health condition, therefore making it difficult to study and mitigate. Artificial Intelligence has increasingly been used to better understand Social Determinants of Health factors that influence suicide outcomes. In this review we find that many studies use limited SDoH information and minority groups are often underrepresented, thereby omitting important factors that could influence risk of suicide.
Collapse
Affiliation(s)
- Annika M Schoene
- Northeastern University, Institute for Experiential AI, Boston, USA.
| | - Suzanne Garverich
- Northeastern University, Institute for Health Equity and Social Justice Research, Boston, USA
| | - Iman Ibrahim
- Northeastern University, Institute for Health Equity and Social Justice Research, Boston, USA
| | - Sia Shah
- Northeastern University, Institute for Health Equity and Social Justice Research, Boston, USA
| | - Benjamin Irving
- Northeastern University, Institute for Experiential AI, Boston, USA
| | - Clifford C Dacso
- Medicine Baylor College of Medicine, Houston, USA
- Electrical and Computer Engineering Rice University, Houston, USA
- Knox Clinic, Rockland, Maine, USA
| |
Collapse
|
3
|
Tio ES, Misztal MC, Felsky D. Evidence for the biopsychosocial model of suicide: a review of whole person modeling studies using machine learning. Front Psychiatry 2024; 14:1294666. [PMID: 38274429 PMCID: PMC10808719 DOI: 10.3389/fpsyt.2023.1294666] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Accepted: 12/21/2023] [Indexed: 01/27/2024] Open
Abstract
Background Traditional approaches to modeling suicide-related thoughts and behaviors focus on few data types from often-siloed disciplines. While psychosocial aspects of risk for these phenotypes are frequently studied, there is a lack of research assessing their impact in the context of biological factors, which are important in determining an individual's fulsome risk profile. To directly test this biopsychosocial model of suicide and identify the relative importance of predictive measures when considered together, a transdisciplinary, multivariate approach is needed. Here, we systematically review the emerging literature on large-scale studies using machine learning to integrate measures of psychological, social, and biological factors simultaneously in the study of suicide. Methods We conducted a systematic review of studies that used machine learning to model suicide-related outcomes in human populations including at least one predictor from each of biological, psychological, and sociological data domains. Electronic databases MEDLINE, EMBASE, PsychINFO, PubMed, and Web of Science were searched for reports published between August 2013 and August 30, 2023. We evaluated populations studied, features emerging most consistently as risk or resilience factors, methods used, and strength of evidence for or against the biopsychosocial model of suicide. Results Out of 518 full-text articles screened, we identified a total of 20 studies meeting our inclusion criteria, including eight studies conducted in general population samples and 12 in clinical populations. Common important features identified included depressive and anxious symptoms, comorbid psychiatric disorders, social behaviors, lifestyle factors such as exercise, alcohol intake, smoking exposure, and marital and vocational status, and biological factors such as hypothalamic-pituitary-thyroid axis activity markers, sleep-related measures, and selected genetic markers. A minority of studies conducted iterative modeling testing each data type for contribution to model performance, instead of reporting basic measures of relative feature importance. Conclusion Studies combining biopsychosocial measures to predict suicide-related phenotypes are beginning to proliferate. This literature provides some early empirical evidence for the biopsychosocial model of suicide, though it is marred by harmonization challenges. For future studies, more specific definitions of suicide-related outcomes, inclusion of a greater breadth of biological data, and more diversity in study populations will be needed.
Collapse
Affiliation(s)
- Earvin S. Tio
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Institute of Medical Science, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| | - Melissa C. Misztal
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health, Toronto, ON, Canada
| | - Daniel Felsky
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Institute of Medical Science, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- Biostatistics Division, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
4
|
Zhang J, Liu Y, Zhang C, Chen Y, Hu Y, Yang X, Liu W, Zhang W, Liu D, Song H. Predicting suicidal behavior in individuals with depression over 50 years of age: Evidence from the UK biobank. Digit Health 2024; 10:20552076241287450. [PMID: 39411544 PMCID: PMC11475109 DOI: 10.1177/20552076241287450] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2024] [Accepted: 09/10/2024] [Indexed: 10/19/2024] Open
Abstract
Objective To construct applicable models suitable for predicting the risk of suicidal behavior among individuals with depression, particularly on the progression from no history of suicidal behavior to suicide attempts, as well as from suicidal ideation to suicide attempts. Methods Based on a prospective cohort from the UK Biobank, a total of 55,139 individuals aged 50 and above with depression were enrolled in the study, among whom 29,528 exhibited suicidal behavior. Specifically, they were divided into control (25,611), suicidal ideation (24,361), and suicide attempt (5167) groups. Least absolute shrinkage and selection operator (LASSO) regression was used to identify a subset of important features for distinguishing suicidal ideation and suicide attempts. We used the Gradient Boosting Decision Tree (GBDT) algorithm with stratified 10-fold cross-validation and grid-search to construct the prediction models for suicidal ideation or suicide attempts. To address the dataset imbalance in classifying suicide attempts, we used random under-sampling. The SHapley Additive exPlanations (SHAP) were used to estimate the important variables in the GBDT model. Results Significant differences in sociodemographic, economic, lifestyle, and psychological factors were observed across the three groups. Each classifier optimally utilized 8-11 features. Overall, the algorithms predicting suicide attempts demonstrated slightly higher performance than those predicting suicidal ideation. The GBDT classifier achieved the highest accuracy, with AUROC scores of 0.914 for suicide attempts and 0.803 for suicidal ideation. Distinctive predictive factors were identified for each group: while depression's inherent characteristics crucially distinguished the suicidal ideation group from controls, some key predictors, including the age of depression onset and childhood trauma events, were identified for suicide attempts. Conclusions We established applicable machine learning-based models for predicting suicidal behavior, particularly suicide attempts, in individuals with depression, and clarified the differences in predictors between suicidal ideation and suicide attempts.
Collapse
Affiliation(s)
- Jian Zhang
- Mental Health Center, West China Hospital, Sichuan University, Chengdu,
China
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
| | - Yujun Liu
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
- Med-X Center for Informatics, Sichuan University, Chengdu, China
| | - Chao Zhang
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
- Med-X Center for Informatics, Sichuan University, Chengdu, China
| | - Yilong Chen
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
- Med-X Center for Informatics, Sichuan University, Chengdu, China
| | - Yao Hu
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
- Med-X Center for Informatics, Sichuan University, Chengdu, China
| | - Xiujia Yang
- University of Illinois at Urbana and Champaign, Urbana, IL, USA
| | - Wentao Liu
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
- Med-X Center for Informatics, Sichuan University, Chengdu, China
| | - Wei Zhang
- Mental Health Center, West China Hospital, Sichuan University, Chengdu,
China
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
- Med-X Center for Informatics, Sichuan University, Chengdu, China
| | - Di Liu
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
- Med-X Center for Informatics, Sichuan University, Chengdu, China
- Industrial Engineering, Pittsburgh Institute, Sichuan University, Chengdu, China
| | - Huan Song
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
- Med-X Center for Informatics, Sichuan University, Chengdu, China
- Center of Public Health Sciences, Faculty of Medicine, University of Iceland, Reykjavík, Iceland
| |
Collapse
|