Prediction of suicide among 372,813 individuals under medical check-up

Role of machine learning algorithms in suicide risk prediction: a systematic review-meta analysis of clinical studies

OBJECTIVE

Suicide is a complex and multifactorial public health problem. Understanding and addressing the various factors associated with suicide is crucial for prevention and intervention efforts. Machine learning (ML) could enhance the prediction of suicide attempts.

METHOD

A systematic review was performed using PubMed, Scopus, Web of Science and SID databases. We aim to evaluate the performance of ML algorithms and summarize their effects, gather relevant and reliable information to synthesize existing evidence, identify knowledge gaps, and provide a comprehensive list of the suicide risk factors using mixed method approach.

RESULTS

Forty-one studies published between 2011 and 2022, which matched inclusion criteria, were chosen as suitable. We included studies aimed at predicting the suicide risk by machine learning algorithms except natural language processing (NLP) and image processing. The neural network (NN) algorithm exhibited the lowest accuracy at 0.70, whereas the random forest demonstrated the highest accuracy, reaching 0.94. The study assessed the COX and random forest models and observed a minimum area under the curve (AUC) value of 0.54. In contrast, the XGBoost classifier yielded the highest AUC value, reaching 0.97. These specific AUC values emphasize the algorithm-specific performance in capturing the trade-off between sensitivity and specificity for suicide risk prediction. Furthermore, our investigation identified several common suicide risk factors, including age, gender, substance abuse, depression, anxiety, alcohol consumption, marital status, income, education, and occupation. This comprehensive analysis contributes valuable insights into the multifaceted nature of suicide risk, providing a foundation for targeted preventive strategies and intervention efforts.

CONCLUSIONS

The effectiveness of ML algorithms and their application in predicting suicide risk has been controversial. There is a need for more studies on these algorithms in clinical settings, and the related ethical concerns require further clarification.

The use of machine learning on administrative and survey data to predict suicidal thoughts and behaviors: a systematic review

Background

Machine learning is a promising tool in the area of suicide prevention due to its ability to combine the effects of multiple risk factors and complex interactions. The power of machine learning has led to an influx of studies on suicide prediction, as well as a few recent reviews. Our study distinguished between data sources and reported the most important predictors of suicide outcomes identified in the literature.

Objective

Our study aimed to identify studies that applied machine learning techniques to administrative and survey data, summarize performance metrics reported in those studies, and enumerate the important risk factors of suicidal thoughts and behaviors identified.

Methods

A systematic literature search of PubMed, Medline, Embase, PsycINFO, Web of Science, Cumulative Index to Nursing and Allied Health Literature (CINAHL), and Allied and Complementary Medicine Database (AMED) to identify all studies that have used machine learning to predict suicidal thoughts and behaviors using administrative and survey data was performed. The search was conducted for articles published between January 1, 2019 and May 11, 2022. In addition, all articles identified in three recently published systematic reviews (the last of which included studies up until January 1, 2019) were retained if they met our inclusion criteria. The predictive power of machine learning methods in predicting suicidal thoughts and behaviors was explored using box plots to summarize the distribution of the area under the receiver operating characteristic curve (AUC) values by machine learning method and suicide outcome (i.e., suicidal thoughts, suicide attempt, and death by suicide). Mean AUCs with 95% confidence intervals (CIs) were computed for each suicide outcome by study design, data source, total sample size, sample size of cases, and machine learning methods employed. The most important risk factors were listed.

Results

The search strategy identified 2,200 unique records, of which 104 articles met the inclusion criteria. Machine learning algorithms achieved good prediction of suicidal thoughts and behaviors (i.e., an AUC between 0.80 and 0.89); however, their predictive power appears to differ across suicide outcomes. The boosting algorithms achieved good prediction of suicidal thoughts, death by suicide, and all suicide outcomes combined, while neural network algorithms achieved good prediction of suicide attempts. The risk factors for suicidal thoughts and behaviors differed depending on the data source and the population under study.

Conclusion

The predictive utility of machine learning for suicidal thoughts and behaviors largely depends on the approach used. The findings of the current review should prove helpful in preparing future machine learning models using administrative and survey data.

Systematic review registration

https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42022333454 identifier CRD42022333454.

Evidence for the biopsychosocial model of suicide: a review of whole person modeling studies using machine learning

Background

Traditional approaches to modeling suicide-related thoughts and behaviors focus on few data types from often-siloed disciplines. While psychosocial aspects of risk for these phenotypes are frequently studied, there is a lack of research assessing their impact in the context of biological factors, which are important in determining an individual's fulsome risk profile. To directly test this biopsychosocial model of suicide and identify the relative importance of predictive measures when considered together, a transdisciplinary, multivariate approach is needed. Here, we systematically review the emerging literature on large-scale studies using machine learning to integrate measures of psychological, social, and biological factors simultaneously in the study of suicide.

Methods

We conducted a systematic review of studies that used machine learning to model suicide-related outcomes in human populations including at least one predictor from each of biological, psychological, and sociological data domains. Electronic databases MEDLINE, EMBASE, PsychINFO, PubMed, and Web of Science were searched for reports published between August 2013 and August 30, 2023. We evaluated populations studied, features emerging most consistently as risk or resilience factors, methods used, and strength of evidence for or against the biopsychosocial model of suicide.

Results

Out of 518 full-text articles screened, we identified a total of 20 studies meeting our inclusion criteria, including eight studies conducted in general population samples and 12 in clinical populations. Common important features identified included depressive and anxious symptoms, comorbid psychiatric disorders, social behaviors, lifestyle factors such as exercise, alcohol intake, smoking exposure, and marital and vocational status, and biological factors such as hypothalamic-pituitary-thyroid axis activity markers, sleep-related measures, and selected genetic markers. A minority of studies conducted iterative modeling testing each data type for contribution to model performance, instead of reporting basic measures of relative feature importance.

Conclusion

Studies combining biopsychosocial measures to predict suicide-related phenotypes are beginning to proliferate. This literature provides some early empirical evidence for the biopsychosocial model of suicide, though it is marred by harmonization challenges. For future studies, more specific definitions of suicide-related outcomes, inclusion of a greater breadth of biological data, and more diversity in study populations will be needed.

An efficient landmark model for prediction of suicide attempts in multiple clinical settings

Growing evidence has shown that applying machine learning models to large clinical data sources may exceed clinician performance in suicide risk stratification. However, many existing prediction models either suffer from "temporal bias" (a bias that stems from using case-control sampling) or require training on all available patient visit data. Here, we adopt a "landmark model" framework that aligns with clinical practice for prediction of suicide-related behaviors (SRBs) using a large electronic health record database. Using the landmark approach, we developed models for SRB prediction (regularized Cox regression and random survival forest) that establish a time-point (e.g., clinical visit) from which predictions are made over user-specified prediction windows using historical information up to that point. We applied this approach to cohorts from three clinical settings: general outpatient, psychiatric emergency department, and psychiatric inpatients, for varying prediction windows and lengths of historical data. Models achieved high discriminative performance (area under the Receiver Operating Characteristic curve 0.74-0.93 for the Cox model) across different prediction windows and settings, even with relatively short periods of historical data. In short, we developed accurate, dynamic SRB risk prediction models with the landmark approach that reduce bias and enhance the reliability and portability of suicide risk prediction models.

Structured data vs. unstructured data in machine learning prediction models for suicidal behaviors: A systematic review and meta-analysis

Suicide remains a leading cause of preventable death worldwide, despite advances in research and decreases in mental health stigma through government health campaigns. Machine learning (ML), a type of artificial intelligence (AI), is the use of algorithms to simulate and imitate human cognition. Given the lack of improvement in clinician-based suicide prediction over time, advancements in technology have allowed for novel approaches to predicting suicide risk. This systematic review and meta-analysis aimed to synthesize current research regarding data sources in ML prediction of suicide risk, incorporating and comparing outcomes between structured data (human interpretable such as psychometric instruments) and unstructured data (only machine interpretable such as electronic health records). Online databases and gray literature were searched for studies relating to ML and suicide risk prediction. There were 31 eligible studies. The outcome for all studies combined was AUC = 0.860, structured data showed AUC = 0.873, and unstructured data was calculated at AUC = 0.866. There was substantial heterogeneity between the studies, the sources of which were unable to be defined. The studies showed good accuracy levels in the prediction of suicide risk behavior overall. Structured data and unstructured data also showed similar outcome accuracy according to meta-analysis, despite different volumes and types of input data.

A Genomic Information Management System for Maintaining Healthy Genomic States and Application of Genomic Big Data in Clinical Research

Improvements in next-generation sequencing (NGS) technology and computer systems have enabled personalized therapies based on genomic information. Recently, health management strategies using genomics and big data have been developed for application in medicine and public health science. In this review, I first discuss the development of a genomic information management system (GIMS) to maintain a highly detailed health record and detect diseases by collecting the genomic information of one individual over time. Maintaining a health record and detecting abnormal genomic states are important; thus, the development of a GIMS is necessary. Based on the current research status, open public data, and databases, I discuss the possibility of a GIMS for clinical use. I also discuss how the analysis of genomic information as big data can be applied for clinical and research purposes. Tremendous volumes of genomic information are being generated, and the development of methods for the collection, cleansing, storing, indexing, and serving must progress under legal regulation. Genetic information is a type of personal information and is covered under privacy protection; here, I examine the regulations on the use of genetic information in different countries. This review provides useful insights for scientists and clinicians who wish to use genomic information for healthy aging and personalized medicine.

Contributions of health technologies in risk assessment for suicide behavior: an integrative review

OBJECTIVE

to identify how health technologies contribute to risk assessment for suicidal behavior.

METHODS

an integrative review carried out on the MEDLINE, CINAHL, Web of Science, SCOPUS, LILACS and BDENF databases. The sample consisted of 12 primary studies, with no temporal or language delimitation. Analysis of results occurred descriptively.

RESULTS

the technologies included assistance and teaching aspects favorable to data screening, monitoring and navigation, capable of predicting individual, biological, clinical, psychological, environmental and social markers for suicidal behavior. Thus, measurement scale, software and computational algorithms constituted valid and sensitive instruments for improving performance, expanding skills and knowledge, good care practices, effective communication and assistance planning.

CONCLUSION

the identified technologies proved to be effective in identifying risk states for suicidal behavior, representing effective resources for directing care and necessary interventions.