1
|
Wang Z, Chen Y, Tao Z, Yang M, Li D, Jiang L, Zhang W. Quantifying the Importance of Non-Suicidal Self-Injury Characteristics in Predicting Different Clinical Outcomes: Using Random Forest Model. J Youth Adolesc 2024; 53:1615-1629. [PMID: 38300442 DOI: 10.1007/s10964-023-01926-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Accepted: 12/03/2023] [Indexed: 02/02/2024]
Abstract
Existing research on non-suicidal self-injury (NSSI) among adolescents has primarily concentrated on general risk factors, leaving a significant gap in understanding the specific NSSI characteristics that predict diverse psychopathological outcomes. This study aims to address this gap by using Random Forests to discern the significant predictors of different clinical outcomes. The study tracked 348 adolescents (64.7% girls; mean age = 13.31, SD = 0.91) over 6 months. Initially, 46 characteristics of NSSI were evaluated for their potential to predict the repetition of NSSI, as well as depression, anxiety, and suicidal risks at a follow-up (T2). The findings revealed distinct predictors for each psychopathology. Specifically, psychological pain was identified as a significant predictor for depression, anxiety, and suicidal risks, while the perceived effectiveness of NSSI was crucial in forecasting its repetition. These findings imply that it is feasible to identify high-risk individuals by assessing key NSSI characteristics, and also highlight the importance of considering diverse NSSI characteristics when working with self-injurers.
Collapse
Affiliation(s)
- Zhenhai Wang
- Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou, China
| | - Yanrong Chen
- Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou, China
| | - Zhiyuan Tao
- Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou, China
| | - Maomei Yang
- Tangxia No.2 Junior High School, Dongguan, Guangdong, China
| | - Dongjie Li
- Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou, China
| | - Liyun Jiang
- Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou, China
| | - Wei Zhang
- Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou, China.
| |
Collapse
|
2
|
Bao J, Wan J, Li H, Sun F. Psychological pain and sociodemographic factors classified suicide attempt and non-suicidal self-injury in adolescents. Acta Psychol (Amst) 2024; 246:104271. [PMID: 38631150 DOI: 10.1016/j.actpsy.2024.104271] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 04/01/2024] [Accepted: 04/10/2024] [Indexed: 04/19/2024] Open
Abstract
This study aimed to utilize machine learning to explore the psychological similarities and differences between suicide attempt (SA) and non-suicidal self-injury (NSSI), with a particular focus on the role of psychological pain. A total of 2385 middle school students were recruited using cluster sampling. The random forest algorithm was used with 25 predictors to develop classification models of SA and NSSI, respectively, and to estimate the importance scores of each predictor. Based on these scores and related theories, shared risk factors (control feature set) and distinct risk factors (distinction feature set) were selected and tested to distinguish between NSSI and SA. The machine learning algorithm exhibited fair to good performance in classifying SA history [Area Under Curves (AUCs): 0.65-0.87] and poor performance in classifying NSSI history (AUC: 0.61-0.68). The distinction feature set comprised pain avoidance, family togetherness, and deviant peer affiliation, while the control feature set included pain arousal, painful feelings, and crisis events. The distinction feature set slightly but stably outperformed the control feature set in classifying SA from NSSI. The three-dimensional psychological pain model, especially pain avoidance, might play a dominant role in understanding the similarities and differences between SA and NSSI.
Collapse
Affiliation(s)
- Jiamin Bao
- Department of Psychology, Renmin University of China, Beijing 100872, PR China
| | - Jiachen Wan
- Department of Psychology, Renmin University of China, Beijing 100872, PR China
| | - Huanhuan Li
- Department of Psychology, Renmin University of China, Beijing 100872, PR China.
| | - Fang Sun
- Department of Psychology, Renmin University of China, Beijing 100872, PR China
| |
Collapse
|
3
|
Dagani J, Buizza C, Ferrari C, Ghilardi A. Potential suicide risk among the college student population: machine learning approaches for identifying predictors and different students' risk profiles. PSICOLOGIA-REFLEXAO E CRITICA 2024; 37:19. [PMID: 38758421 PMCID: PMC11101401 DOI: 10.1186/s41155-024-00301-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Accepted: 05/02/2024] [Indexed: 05/18/2024] Open
Abstract
BACKGROUND Suicide is one of the leading causes of death among young people and university students. Research has identified numerous socio-demographic, relational, and clinical factors as potential predictors of suicide risk, and machine learning techniques have emerged as promising ways to improve risk assessment. OBJECTIVE This cross-sectional observational study aimed at identifying predictors and college student profiles associated with suicide risk through a machine learning approach. METHODS A total of 3102 students were surveyed regarding potential suicide risk, socio-demographic characteristics, academic career, and physical/mental health and well-being. The classification tree technique and the multiple correspondence analysis were applied to define students' profiles in terms of suicide risk and to detect the main predictors of such a risk. RESULTS Among the participating students, 7% showed high potential suicide risk and 3.8% had a history of suicide attempts. Psychological distress and use of alcohol/substance were prominent predictors of suicide risk contributing to define the profile of high risk of suicide: students with significant psychological distress, and with medium/high-risk use of alcohol and psychoactive substances. Conversely, low psychological distress and low-risk use of alcohol and substances, together with religious practice, represented the profile of students with low risk of suicide. CONCLUSIONS Machine learning techniques could hold promise for assessing suicide risk in college students, potentially leading to the development of more effective prevention programs. These programs should address both risk and protective factors and be tailored to students' needs and to the different categories of risk.
Collapse
Affiliation(s)
- Jessica Dagani
- Department of Clinical and Experimental Sciences, Section of Clinical and Dynamic Psychology, University of Brescia, Viale Europa, 11, 25123, Brescia, Italy.
| | - Chiara Buizza
- Department of Clinical and Experimental Sciences, Section of Clinical and Dynamic Psychology, University of Brescia, Viale Europa, 11, 25123, Brescia, Italy
| | - Clarissa Ferrari
- Istituto Ospedaliero Fondazione Poliambulanza, Via Bissolati, 57, 25124, Brescia, Italy
| | - Alberto Ghilardi
- Department of Clinical and Experimental Sciences, Section of Clinical and Dynamic Psychology, University of Brescia, Viale Europa, 11, 25123, Brescia, Italy
| |
Collapse
|
4
|
Yang C, Huebner ES, Tian L. Prediction of suicidal ideation among preadolescent children with machine learning models: A longitudinal study. J Affect Disord 2024; 352:403-409. [PMID: 38387673 DOI: 10.1016/j.jad.2024.02.070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/19/2023] [Revised: 02/15/2024] [Accepted: 02/19/2024] [Indexed: 02/24/2024]
Abstract
BACKGROUND Machine learning (ML) has been widely used to predict suicidal ideation (SI) in adolescents and adults. Nevertheless, studies of accurate and efficient models of SI prediction with preadolescent children are still needed because SI is surprisingly prevalent during the transition into adolescence. This study aimed to explore the potential of ML models to predict SI among preadolescent children. METHODS A total of 4691 Chinese children (54.89 % boys, Mage = 10.92 at baseline) and their parents completed relevant measures at baseline and the children provided 6-month follow-up data for SI. The current study compared four ML models: Random Forest (RF), Decision Tree (DT), Support Vector Machine (SVM), and Multilayer Perceptron (MLP), to predict SI and to identify variables with predictive value based on the best-performing model among Chinese preadolescent children. RESULTS The RF model achieved the highest discriminant performance with an AUC of 0.92, accuracy of 0.93 (balanced accuracy = 0.88). The factors of internalizing problems, externalizing problems, neuroticism, childhood maltreatment, and subjective well-being in school demonstrated the highest values in predicting SI. CONCLUSION The findings of this study suggested that ML models based on the observation and assessment of children's general characteristics and experiences in everyday life can serve as convenient screening and evaluation tools for suicide risk assessment among Chinese preadolescent children. The findings also provide insights for early intervention.
Collapse
Affiliation(s)
- Chi Yang
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou 510631, People's Republic of China; School of Psychology, South China Normal University, Guangzhou 510631, People's Republic of China
| | - E Scott Huebner
- Department of Psychology, University of South Carolina, Columbia, SC 29208, USA
| | - Lili Tian
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou 510631, People's Republic of China.
| |
Collapse
|
5
|
Tang H, Miri Rekavandi A, Rooprai D, Dwivedi G, Sanfilippo FM, Boussaid F, Bennamoun M. Analysis and evaluation of explainable artificial intelligence on suicide risk assessment. Sci Rep 2024; 14:6163. [PMID: 38485985 PMCID: PMC10940617 DOI: 10.1038/s41598-024-53426-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Accepted: 01/31/2024] [Indexed: 03/18/2024] Open
Abstract
This study explores the effectiveness of Explainable Artificial Intelligence (XAI) for predicting suicide risk from medical tabular data. Given the common challenge of limited datasets in health-related Machine Learning (ML) applications, we use data augmentation in tandem with ML to enhance the identification of individuals at high risk of suicide. We use SHapley Additive exPlanations (SHAP) for XAI and traditional correlation analysis to rank feature importance, pinpointing primary factors influencing suicide risk and preventive measures. Experimental results show the Random Forest (RF) model is excelling in accuracy, F1 score, and AUC (>97% across metrics). According to SHAP, anger issues, depression, and social isolation emerge as top predictors of suicide risk, while individuals with high incomes, esteemed professions, and higher education present the lowest risk. Our findings underscore the effectiveness of ML and XAI in suicide risk assessment, offering valuable insights for psychiatrists and facilitating informed clinical decisions.
Collapse
Affiliation(s)
- Hao Tang
- Department of Computer Science and Software Engineering, The University of Western Australia, Perth, Australia
| | - Aref Miri Rekavandi
- Department of Computer Science and Software Engineering, The University of Western Australia, Perth, Australia
| | - Dharjinder Rooprai
- Armadale Mental Health Service, Perth, Australia.
- Bethesda Clinic, Perth, Australia.
| | - Girish Dwivedi
- Advanced Clinical and Translational Cardiovascular Imaging, Harry Perkins Institute of Medical Research, The University of Western Australia, Perth, Australia
- Department of Cardiology, Fiona Stanley Hospital, Murdoch, WA, Australia
| | - Frank M Sanfilippo
- School of Population and Global Health, University of Western Australia, Perth, Australia
| | - Farid Boussaid
- Department of Electrical, Electronic and Computer Engineering, The University of Western Australia, Perth, Australia
| | - Mohammed Bennamoun
- Department of Computer Science and Software Engineering, The University of Western Australia, Perth, Australia.
| |
Collapse
|
6
|
Somé NH, Noormohammadpour P, Lange S. The use of machine learning on administrative and survey data to predict suicidal thoughts and behaviors: a systematic review. Front Psychiatry 2024; 15:1291362. [PMID: 38501090 PMCID: PMC10944962 DOI: 10.3389/fpsyt.2024.1291362] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/09/2023] [Accepted: 02/12/2024] [Indexed: 03/20/2024] Open
Abstract
Background Machine learning is a promising tool in the area of suicide prevention due to its ability to combine the effects of multiple risk factors and complex interactions. The power of machine learning has led to an influx of studies on suicide prediction, as well as a few recent reviews. Our study distinguished between data sources and reported the most important predictors of suicide outcomes identified in the literature. Objective Our study aimed to identify studies that applied machine learning techniques to administrative and survey data, summarize performance metrics reported in those studies, and enumerate the important risk factors of suicidal thoughts and behaviors identified. Methods A systematic literature search of PubMed, Medline, Embase, PsycINFO, Web of Science, Cumulative Index to Nursing and Allied Health Literature (CINAHL), and Allied and Complementary Medicine Database (AMED) to identify all studies that have used machine learning to predict suicidal thoughts and behaviors using administrative and survey data was performed. The search was conducted for articles published between January 1, 2019 and May 11, 2022. In addition, all articles identified in three recently published systematic reviews (the last of which included studies up until January 1, 2019) were retained if they met our inclusion criteria. The predictive power of machine learning methods in predicting suicidal thoughts and behaviors was explored using box plots to summarize the distribution of the area under the receiver operating characteristic curve (AUC) values by machine learning method and suicide outcome (i.e., suicidal thoughts, suicide attempt, and death by suicide). Mean AUCs with 95% confidence intervals (CIs) were computed for each suicide outcome by study design, data source, total sample size, sample size of cases, and machine learning methods employed. The most important risk factors were listed. Results The search strategy identified 2,200 unique records, of which 104 articles met the inclusion criteria. Machine learning algorithms achieved good prediction of suicidal thoughts and behaviors (i.e., an AUC between 0.80 and 0.89); however, their predictive power appears to differ across suicide outcomes. The boosting algorithms achieved good prediction of suicidal thoughts, death by suicide, and all suicide outcomes combined, while neural network algorithms achieved good prediction of suicide attempts. The risk factors for suicidal thoughts and behaviors differed depending on the data source and the population under study. Conclusion The predictive utility of machine learning for suicidal thoughts and behaviors largely depends on the approach used. The findings of the current review should prove helpful in preparing future machine learning models using administrative and survey data. Systematic review registration https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42022333454 identifier CRD42022333454.
Collapse
Affiliation(s)
- Nibene H. Somé
- Institute for Mental Health Policy Research, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Department of Epidemiology and Biostatistics, Schulich School of Medicine & Dentistry, Western University, London, ON, Canada
- Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
| | - Pardis Noormohammadpour
- Institute for Mental Health Policy Research, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
| | - Shannon Lange
- Institute for Mental Health Policy Research, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Department of Psychiatry, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
7
|
Haghish EF, Czajkowski NO, von Soest T. Predicting suicide attempts among Norwegian adolescents without using suicide-related items: a machine learning approach. Front Psychiatry 2023; 14:1216791. [PMID: 37822798 PMCID: PMC10562596 DOI: 10.3389/fpsyt.2023.1216791] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Accepted: 09/04/2023] [Indexed: 10/13/2023] Open
Abstract
Introduction Research on the classification models of suicide attempts has predominantly depended on the collection of sensitive data related to suicide. Gathering this type of information at the population level can be challenging, especially when it pertains to adolescents. We addressed two main objectives: (1) the feasibility of classifying adolescents at high risk of attempting suicide without relying on specific suicide-related survey items such as history of suicide attempts, suicide plan, or suicide ideation, and (2) identifying the most important predictors of suicide attempts among adolescents. Methods Nationwide survey data from 173,664 Norwegian adolescents (ages 13-18) were utilized to train a binary classification model, using 169 questionnaire items. The Extreme Gradient Boosting (XGBoost) algorithm was fine-tuned to classify adolescent suicide attempts, and the most important predictors were identified. Results XGBoost achieved a sensitivity of 77% with a specificity of 90%, and an AUC of 92.1% and an AUPRC of 47.1%. A coherent set of predictors in the domains of internalizing problems, substance use, interpersonal relationships, and victimization were pinpointed as the most important items related to recent suicide attempts. Conclusion This study underscores the potential of machine learning for screening adolescent suicide attempts on a population scale without requiring sensitive suicide-related survey items. Future research investigating the etiology of suicidal behavior may direct particular attention to internalizing problems, interpersonal relationships, victimization, and substance use.
Collapse
Affiliation(s)
- E. F. Haghish
- Department of Psychology, Faculty of Social Sciences, University of Oslo, Oslo, Norway
| | - Nikolai O. Czajkowski
- Department of Psychology, Faculty of Social Sciences, University of Oslo, Oslo, Norway
- Department of Mental Disorders, Division of Mental and Physical Health, Norwegian Institute of Public Health (NIPH), Oslo, Norway
| | - Tilmann von Soest
- Department of Psychology, Faculty of Social Sciences, University of Oslo, Oslo, Norway
- Norwegian Social Research (NOVA), Oslo Metropolitan University, Oslo, Norway
| |
Collapse
|
8
|
Kapoor S, Freitag S, Bradshaw J, Valencia GT, Lamis DA. The collective impact of childhood abuse, psychache, and interpersonal needs on suicidal ideation among individuals with bipolar disorder: A discriminant analysis. CHILD ABUSE & NEGLECT 2023; 141:106202. [PMID: 37116450 DOI: 10.1016/j.chiabu.2023.106202] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Revised: 03/30/2023] [Accepted: 04/14/2023] [Indexed: 06/05/2023]
Abstract
BACKGROUND Suicide is one of the ten leading causes of death in the United States. Childhood abuse, psychache (intense emotional pain), and interpersonal needs are widely known to be associated with suicidal thoughts and behaviors. However, only a limited number of studies investigate whether these variables, when analyzed collectively, are able to distinguish between a group of individuals who report suicidal ideation and those who deny such thoughts. PARTICIPANTS AND SETTING Data were collected from individuals (N =177) with a diagnosis of bipolar disorder participating in an intensive outpatient program that provides mental health care to indigent, mostly minority patients in Southeast United States. METHODS The dependent variable was item number 9 on the Beck Depression Inventory that asks about any suicidal thoughts in the past two weeks. We utilized discriminant analysis to test whether childhood abuse, interpersonal needs, and psychache were collectively able to accurately identify group membership of the study participants. RESULTS The discriminant model included six independent variables: three different types of childhood abuse (emotional, physical, and sexual), interpersonal needs (perceived burdensomeness and thwarted belongingness), and psychache. Results revealed that the model was able to correctly classify group membership in 75% of the individuals in the study. CONCLUSION In context of bipolar disorder, history of childhood abuse (particularly sexual and emotional abuse), intense psychache, and greater perceived thwarted belongingness and burdensomeness put an individual at a higher risk of suicidal ideation. Gaining insight into the interactions among these variables may lead to formulating early interventions to prevent suicide in patients reporting this constellation of symptoms.
Collapse
Affiliation(s)
- S Kapoor
- Department of Psychiatry and Psychology, Mayo Clinic, Scottsdale, AZ, United States of America
| | - S Freitag
- Department of Psychiatry and Behavioral Sciences, Emory University School of Medicine, Atlanta, GA, United States of America
| | - J Bradshaw
- Department of Psychiatry and Behavioral Sciences, Emory University School of Medicine, Atlanta, GA, United States of America
| | - G T Valencia
- Department of Psychiatry and Behavioral Sciences, Emory University School of Medicine, Atlanta, GA, United States of America
| | - D A Lamis
- Department of Psychiatry and Behavioral Sciences, Emory University School of Medicine, Atlanta, GA, United States of America.
| |
Collapse
|
9
|
Nordin N, Zainol Z, Mohd Noor MH, Chan LF. An explainable predictive model for suicide attempt risk using an ensemble learning and Shapley Additive Explanations (SHAP) approach. Asian J Psychiatr 2023; 79:103316. [PMID: 36395702 DOI: 10.1016/j.ajp.2022.103316] [Citation(s) in RCA: 21] [Impact Index Per Article: 21.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Revised: 10/20/2022] [Accepted: 11/04/2022] [Indexed: 11/09/2022]
Abstract
Machine learning approaches have been used to develop suicide attempt predictive models recently and have been shown to have a good performance. However, those proposed models have difficulty interpreting and understanding why an individual has suicidal attempts. To overcome this issue, the identification of features such as risk factors in predicting suicide attempts is important for clinicians to make decisions. Therefore, the aim of this study is to propose an explainable predictive model to predict and analyse the importance of features for suicide attempts. This model can also provide explanations to improve the clinical understanding of suicide attempts. Two complex ensemble learning models, namely Random Forest and Gradient Boosting with an explanatory model (SHapley Additive exPlanations (SHAP)) have been constructed. The models are used for predictive interpretation and understanding of the importance of the features. The experiment shows that both models with SHAP are able to interpret and understand the nature of an individual's predictions with suicide attempts. However, compared with Random Forest, the results show that Gradient Boosting with SHAP achieves higher accuracy and the analyses found that history of suicide attempts, suicidal ideation, and ethnicity as the main predictors for suicide attempts.
Collapse
Affiliation(s)
- Noratikah Nordin
- School of Computer Sciences, Universiti Sains Malaysia, 11800 USM, Pulau Pinang, Malaysia.
| | - Zurinahni Zainol
- School of Computer Sciences, Universiti Sains Malaysia, 11800 USM, Pulau Pinang, Malaysia.
| | - Mohd Halim Mohd Noor
- School of Computer Sciences, Universiti Sains Malaysia, 11800 USM, Pulau Pinang, Malaysia.
| | - Lai Fong Chan
- Department of Psychiatry, Faculty of Medicine, National University of Malaysia (UKM), 56000 Cheras, Wilayah Persekutuan Kuala Lumpur, Malaysia.
| |
Collapse
|
10
|
Huang Y, Zhu C, Feng Y, Ji Y, Song J, Wang K, Yu F. Comparison of three machine learning models to predict suicidal ideation and depression among Chinese adolescents: A cross-sectional study. J Affect Disord 2022; 319:221-228. [PMID: 36122602 DOI: 10.1016/j.jad.2022.08.123] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Revised: 06/01/2022] [Accepted: 08/28/2022] [Indexed: 11/17/2022]
Abstract
BACKGROUND Machine learning (ML) algorithms based on various clinicodemographic, psychometric, and biographic factors have been used to predict depression, suicidal ideation, and suicide attempt in adolescents, but there is still a need for more accurate and efficient models for screening the general adolescent population. In this study, we compared various ML methods to identify a model that most accurately predicts suicidal ideation and level of depression in a large cohort of school-aged adolescents. METHODS Ten psychological scale scores and 20 sociodemographic parameters were collected from 10,243 Chinese adolescents in the first or second year of middle school and high school. These variables were then included in a random forest (RF) model, support vector machine (SVM) model, and decision tree model for factor screening, dichotomous prediction of suicidal ideation (yes/no), and trichotomous prediction of depression (no depression, mild-moderate depression, or major depression). RESULTS The RF model demonstrated greater accuracy for predicting suicidal ideation (mean accuracy (ACC) = 87.3 %, SD = 3.2 %, area under curve (AUC) = 92.4 %) and depressive status (ACC = 84.0 %, SD = 2.8 %, AUC = 90.1 %) than SVM and decision tree models. We have also used the RF model to predict adolescents with both depression and suicidal ideation with satisfactory results. Significant differences were found in several sociodemographic parameters and scale scores among classification groups and differences in six factors between sexes. CONCLUSIONS This RF model may prove valuable for predicting suicidal ideation, depression, and non-suicidal self-injury among the general population of Chinese adolescents.
Collapse
Affiliation(s)
- Yating Huang
- School of Mental Health and Psychological Sciences, Anhui Medical University, Hefei, China; Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei, China
| | - Chunyan Zhu
- School of Mental Health and Psychological Sciences, Anhui Medical University, Hefei, China; The Second Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Yu Feng
- School of Biomedical Engineering, Anhui Medical University, Hefei, China; Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei, China
| | - Yifu Ji
- Psychiatry Department of Hefei Fourth People's Hospital, Hefei, China
| | - Jingze Song
- Institute of Affective Computing Department of Computer Science and Technology, Hefei University of Technology, Hefei, China
| | - Kai Wang
- School of Mental Health and Psychological Sciences, Anhui Medical University, Hefei, China.
| | - Fengqiong Yu
- School of Mental Health and Psychological Sciences, Anhui Medical University, Hefei, China; The Second Affiliated Hospital of Anhui Medical University, Hefei, China.
| |
Collapse
|
11
|
Fisher S, Rosella LC. Priorities for successful use of artificial intelligence by public health organizations: a literature review. BMC Public Health 2022; 22:2146. [PMID: 36419010 PMCID: PMC9682716 DOI: 10.1186/s12889-022-14422-z] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Accepted: 10/23/2022] [Indexed: 11/24/2022] Open
Abstract
Artificial intelligence (AI) has the potential to improve public health's ability to promote the health of all people in all communities. To successfully realize this potential and use AI for public health functions it is important for public health organizations to thoughtfully develop strategies for AI implementation. Six key priorities for successful use of AI technologies by public health organizations are discussed: 1) Contemporary data governance; 2) Investment in modernized data and analytic infrastructure and procedures; 3) Addressing the skills gap in the workforce; 4) Development of strategic collaborative partnerships; 5) Use of good AI practices for transparency and reproducibility, and; 6) Explicit consideration of equity and bias.
Collapse
Affiliation(s)
- Stacey Fisher
- grid.17063.330000 0001 2157 2938Dalla Lana School of Public Health, University of Toronto, Toronto, ON Canada ,grid.415400.40000 0001 1505 2354Public Health Ontario, Toronto, ON Canada ,grid.494618.6Vector Institute for Artificial Intelligence, Toronto, ON Canada ,grid.418647.80000 0000 8849 1617ICES, Toronto, ON Canada
| | - Laura C. Rosella
- grid.17063.330000 0001 2157 2938Dalla Lana School of Public Health, University of Toronto, Toronto, ON Canada ,grid.494618.6Vector Institute for Artificial Intelligence, Toronto, ON Canada ,grid.418647.80000 0000 8849 1617ICES, Toronto, ON Canada ,grid.417293.a0000 0004 0459 7334Institute for Better Health, Trillium Health Partners, Mississauga, ON Canada ,grid.17063.330000 0001 2157 2938Department of Laboratory Medicine and Pathobiology, Temerty Faculty of Medicine, University of Toronto, Toronto, ON Canada
| |
Collapse
|
12
|
Nordin N, Zainol Z, Mohd Noor MH, Chan LF. Suicidal behaviour prediction models using machine learning techniques: A systematic review. Artif Intell Med 2022; 132:102395. [DOI: 10.1016/j.artmed.2022.102395] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2022] [Revised: 08/12/2022] [Accepted: 08/29/2022] [Indexed: 11/02/2022]
|
13
|
Hopkins D, Rickwood DJ, Hallford DJ, Watsford C. Structured data vs. unstructured data in machine learning prediction models for suicidal behaviors: A systematic review and meta-analysis. Front Digit Health 2022; 4:945006. [PMID: 35983407 PMCID: PMC9378826 DOI: 10.3389/fdgth.2022.945006] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2022] [Accepted: 06/29/2022] [Indexed: 11/23/2022] Open
Abstract
Suicide remains a leading cause of preventable death worldwide, despite advances in research and decreases in mental health stigma through government health campaigns. Machine learning (ML), a type of artificial intelligence (AI), is the use of algorithms to simulate and imitate human cognition. Given the lack of improvement in clinician-based suicide prediction over time, advancements in technology have allowed for novel approaches to predicting suicide risk. This systematic review and meta-analysis aimed to synthesize current research regarding data sources in ML prediction of suicide risk, incorporating and comparing outcomes between structured data (human interpretable such as psychometric instruments) and unstructured data (only machine interpretable such as electronic health records). Online databases and gray literature were searched for studies relating to ML and suicide risk prediction. There were 31 eligible studies. The outcome for all studies combined was AUC = 0.860, structured data showed AUC = 0.873, and unstructured data was calculated at AUC = 0.866. There was substantial heterogeneity between the studies, the sources of which were unable to be defined. The studies showed good accuracy levels in the prediction of suicide risk behavior overall. Structured data and unstructured data also showed similar outcome accuracy according to meta-analysis, despite different volumes and types of input data.
Collapse
Affiliation(s)
- Danielle Hopkins
- Faculty of Health, University of Canberra, Canberra, ACT, Australia
- *Correspondence: Danielle Hopkins
| | | | | | - Clare Watsford
- Faculty of Health, University of Canberra, Canberra, ACT, Australia
| |
Collapse
|
14
|
Peters SJ, Schmitz-Buhl M, Karasch O, Zielasek J, Gouzoulis-Mayfrank E. Determinants of compulsory hospitalisation at admission and in the course of inpatient treatment in people with mental disorders-a retrospective analysis of health records of the four psychiatric hospitals of the city of Cologne. BMC Psychiatry 2022; 22:471. [PMID: 35836146 PMCID: PMC9284734 DOI: 10.1186/s12888-022-04107-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/25/2022] [Accepted: 06/30/2022] [Indexed: 11/23/2022] Open
Abstract
BACKGROUND We aimed to identify differences in predictors of involuntary psychiatric hospitalisation depending on whether the inpatient stay was involuntary right from the beginning since admission or changed from voluntary to involuntary in the course of in-patient treatment. METHODS We conducted an analysis of 1,773 mental health records of all cases treated under the Mental Health Act in the city of Cologne in the year 2011. 79.4% cases were admitted involuntarily and 20.6% were initially admitted on their own will and were detained later during the course of in-patient stay. We compared the clinical, sociodemographic, socioeconomic and environmental socioeconomic data (ESED) of the two groups. Finally, we employed two different machine learning decision-tree algorithms, Chi-squared Automatic Interaction Detection (CHAID) and Random Forest. RESULTS Most of the investigated variables did not differ and those with significant differences showed consistently low effect sizes. In the CHAID analysis, the first node split was determined by the hospital the patient was treated at. The diagnosis of a psychotic disorder, an affective disorder, age, and previous outpatient treatment as well as the purchasing power per 100 inhabitants in the living area of the patients also played a role in the model. In the Random Forest, age and the treating hospital had the highest impact on the accuracy and decrease in Gini of the model. However, both models achieved a poor balanced accuracy. Overall, the decision-tree analyses did not yield a solid, causally interpretable prediction model. CONCLUSION Cases with detention at admission and cases with detention in the course of in-patient treatment were largely similar in respect to the investigated variables. Our findings give no indication for possible differential preventive measures against coercion for the two subgroups. There is no need or rationale to differentiate the two subgroups in future studies.
Collapse
Affiliation(s)
- Sönke Johann Peters
- LVR Institute for Healthcare Research, Wilhelm-Griesinger-Strasse 23, 51109 Cologne, Germany ,grid.411097.a0000 0000 8852 305XUniversity Hospital of Cologne, Cologne, Germany
| | - Mario Schmitz-Buhl
- LVR Clinics Cologne, Wilhelm-Griesinger-Strasse 23, 51109 Cologne, Germany
| | - Olaf Karasch
- LVR Institute for Healthcare Research, Wilhelm-Griesinger-Strasse 23, 51109 Cologne, Germany
| | - Jürgen Zielasek
- LVR Institute for Healthcare Research, Wilhelm-Griesinger-Strasse 23, 51109 Cologne, Germany ,grid.411327.20000 0001 2176 9917Medical Faculty, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Euphrosyne Gouzoulis-Mayfrank
- LVR Institute for Healthcare Research, Wilhelm-Griesinger-Strasse 23, 51109, Cologne, Germany. .,LVR Clinics Cologne, Wilhelm-Griesinger-Strasse 23, 51109, Cologne, Germany.
| |
Collapse
|
15
|
Liu H, Zhang L, Wang W, Huang Y, Li S, Ren Z, Zhou Z. Prediction of Online Psychological Help-Seeking Behavior During the COVID-19 Pandemic: An Interpretable Machine Learning Method. Front Public Health 2022; 10:814366. [PMID: 35309216 PMCID: PMC8929708 DOI: 10.3389/fpubh.2022.814366] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2021] [Accepted: 01/17/2022] [Indexed: 12/02/2022] Open
Abstract
Online mental health service (OMHS) has been named as the best psychological assistance measure during the COVID-19 pandemic. An interpretable, accurate, and early prediction for the demand of OMHS is crucial to local governments and organizations which need to allocate and make the decision in mental health resources. The present study aimed to investigate the influence of the COVID-19 pandemic on the online psychological help-seeking (OPHS) behavior in the OMHS, then propose a machine learning model to predict and interpret the OPHS number in advance. The data was crawled from two Chinese OMHS platforms. Linguistic inquiry and word count (LIWC), neural embedding-based topic modeling, and time series analysis were utilized to build time series feature sets with lagging one, three, seven, and 14 days. Correlation analysis was used to examine the impact of COVID-19 on OPHS behaviors across different OMHS platforms. Machine learning algorithms and Shapley additive explanation (SHAP) were used to build the prediction. The result showed that the massive growth of OPHS behavior during the COVID-19 pandemic was a common phenomenon. The predictive model based on random forest (RF) and feature sets containing temporal features of the OPHS number, mental health topics, LIWC, and COVID-19 cases achieved the best performance. Temporal features of the OPHS number showed the biggest positive and negative predictive power. The topic features had incremental effects on performance of the prediction across different lag days and were more suitable for OPHS prediction compared to the LIWC features. The interpretable model showed that the increase in the OPHS behaviors was impacted by the cumulative confirmed cases and cumulative deaths, while it was not sensitive in the new confirmed cases or new deaths. The present study was the first to predict the demand for OMHS using machine learning during the COVID-19 pandemic. This study suggests an interpretable machine learning method that can facilitate quick, early, and interpretable prediction of the OPHS behavior and to support the operational decision-making; it also demonstrated the power of utilizing the OMHS platforms as an always-on data source to obtain a high-resolution timeline and real-time prediction of the psychological response of the online public.
Collapse
Affiliation(s)
- Hui Liu
- Key Laboratory of Adolescent Cyberpsychology and Behavior, Ministry of Education, Wuhan, China
- Key Laboratory of Human Development and Mental Health of Hubei Province, Wuhan, China
- School of Psychology, Central China Normal University, Wuhan, China
| | - Lin Zhang
- Key Laboratory of Adolescent Cyberpsychology and Behavior, Ministry of Education, Wuhan, China
- Key Laboratory of Human Development and Mental Health of Hubei Province, Wuhan, China
- School of Psychology, Central China Normal University, Wuhan, China
| | - Weijun Wang
- Key Laboratory of Adolescent Cyberpsychology and Behavior, Ministry of Education, Wuhan, China
- Key Laboratory of Human Development and Mental Health of Hubei Province, Wuhan, China
- School of Psychology, Central China Normal University, Wuhan, China
| | - Yinghui Huang
- Key Laboratory of Adolescent Cyberpsychology and Behavior, Ministry of Education, Wuhan, China
- Key Laboratory of Human Development and Mental Health of Hubei Province, Wuhan, China
- School of Psychology, Central China Normal University, Wuhan, China
| | - Shen Li
- Key Laboratory of Adolescent Cyberpsychology and Behavior, Ministry of Education, Wuhan, China
- Key Laboratory of Human Development and Mental Health of Hubei Province, Wuhan, China
- School of Psychology, Central China Normal University, Wuhan, China
| | - Zhihong Ren
- Key Laboratory of Adolescent Cyberpsychology and Behavior, Ministry of Education, Wuhan, China
- Key Laboratory of Human Development and Mental Health of Hubei Province, Wuhan, China
- School of Psychology, Central China Normal University, Wuhan, China
| | - Zongkui Zhou
- Key Laboratory of Adolescent Cyberpsychology and Behavior, Ministry of Education, Wuhan, China
- Key Laboratory of Human Development and Mental Health of Hubei Province, Wuhan, China
- School of Psychology, Central China Normal University, Wuhan, China
| |
Collapse
|
16
|
Wulz AR, Law R, Wang J, Wolkin AF. Leveraging data science to enhance suicide prevention research: a literature review. Inj Prev 2022; 28:74-80. [PMID: 34413072 PMCID: PMC9161307 DOI: 10.1136/injuryprev-2021-044322] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2021] [Accepted: 07/31/2021] [Indexed: 02/03/2023]
Abstract
OBJECTIVE The purpose of this research is to identify how data science is applied in suicide prevention literature, describe the current landscape of this literature and highlight areas where data science may be useful for future injury prevention research. DESIGN We conducted a literature review of injury prevention and data science in April 2020 and January 2021 in three databases. METHODS For the included 99 articles, we extracted the following: (1) author(s) and year; (2) title; (3) study approach (4) reason for applying data science method; (5) data science method type; (6) study description; (7) data source and (8) focus on a disproportionately affected population. RESULTS Results showed the literature on data science and suicide more than doubled from 2019 to 2020, with articles with individual-level approaches more prevalent than population-level approaches. Most population-level articles applied data science methods to describe (n=10) outcomes, while most individual-level articles identified risk factors (n=27). Machine learning was the most common data science method applied in the studies (n=48). A wide array of data sources was used for suicide research, with most articles (n=45) using social media and web-based behaviour data. Eleven studies demonstrated the value of applying data science to suicide prevention literature for disproportionately affected groups. CONCLUSION Data science techniques proved to be effective tools in describing suicidal thoughts or behaviour, identifying individual risk factors and predicting outcomes. Future research should focus on identifying how data science can be applied in other injury-related topics.
Collapse
Affiliation(s)
- Avital Rachelle Wulz
- Oak Ridge Associated Universities (ORAU), Division of Injury Prevention, Centers for Disease Control and Prevention, Atlanta, Georgia, USA
| | - Royal Law
- Division of Injury Prevention, Centers for Disease Control and Prevention, Atlanta, Georgia, USA
| | - Jing Wang
- Division of Injury Prevention, Centers for Disease Control and Prevention, Atlanta, Georgia, USA
| | - Amy Funk Wolkin
- Division of Injury Prevention, Centers for Disease Control and Prevention, Atlanta, Georgia, USA
| |
Collapse
|
17
|
Kim S, Lee HK, Lee K. Detecting suicidal risk using MMPI-2 based on machine learning algorithm. Sci Rep 2021; 11:15310. [PMID: 34321546 PMCID: PMC8319391 DOI: 10.1038/s41598-021-94839-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2021] [Accepted: 07/13/2021] [Indexed: 12/25/2022] Open
Abstract
Minnesota Multiphasic Personality Inventory-2 (MMPI-2) is a widely used tool for early detection of psychological maladjustment and assessing the level of adaptation for a large group in clinical settings, schools, and corporations. This study aims to evaluate the utility of MMPI-2 in assessing suicidal risk using the results of MMPI-2 and suicidal risk evaluation. A total of 7,824 datasets collected from college students were analyzed. The MMPI-2-Resturcutred Clinical Scales (MMPI-2-RF) and the response results for each question of the Mini International Neuropsychiatric Interview (MINI) suicidality module were used. For statistical analysis, random forest and K-Nearest Neighbors (KNN) techniques were used with suicidal ideation and suicide attempt as dependent variables and 50 MMPI-2 scale scores as predictors. On applying the random forest method to suicidal ideation and suicidal attempts, the accuracy was 92.9% and 95%, respectively, and the Area Under the Curves (AUCs) were 0.844 and 0.851, respectively. When the KNN method was applied, the accuracy was 91.6% and 94.7%, respectively, and the AUCs were 0.722 and 0.639, respectively. The study confirmed that machine learning using MMPI-2 for a large group provides reliable accuracy in classifying and predicting the subject's suicidal ideation and past suicidal attempts.
Collapse
Affiliation(s)
- Sunhae Kim
- Department of Psychiatry, Hanyang University Medical Center, 222-1, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Republic of Korea
| | - Hye-Kyung Lee
- Department of Nursing, College of Nursing and Health, Kongju National University, Gongju, Republic of Korea
| | - Kounseok Lee
- Department of Psychiatry, Hanyang University Medical Center, 222-1, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Republic of Korea.
| |
Collapse
|
18
|
Macalli M, Navarro M, Orri M, Tournier M, Thiébaut R, Côté SM, Tzourio C. A machine learning approach for predicting suicidal thoughts and behaviours among college students. Sci Rep 2021; 11:11363. [PMID: 34131161 PMCID: PMC8206419 DOI: 10.1038/s41598-021-90728-z] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2021] [Accepted: 05/12/2021] [Indexed: 12/23/2022] Open
Abstract
Suicidal thoughts and behaviours are prevalent among college students. Yet little is known about screening tools to identify students at higher risk. We aimed to develop a risk algorithm to identify the main predictors of suicidal thoughts and behaviours among college students within one-year of baseline assessment. We used data collected in 2013–2019 from the French i-Share cohort, a longitudinal population-based study including 5066 volunteer students. To predict suicidal thoughts and behaviours at follow-up, we used random forests models with 70 potential predictors measured at baseline, including sociodemographic and familial characteristics, mental health and substance use. Model performance was measured using the area under the receiver operating curve (AUC), sensitivity, and positive predictive value. At follow-up, 17.4% of girls and 16.8% of boys reported suicidal thoughts and behaviours. The models achieved good predictive performance: AUC, 0.8; sensitivity, 79% for girls, 81% for boys; and positive predictive value, 40% for girls and 36% for boys. Among the 70 potential predictors, four showed the highest predictive power: 12-month suicidal thoughts, trait anxiety, depression symptoms, and self-esteem. We identified a parsimonious set of mental health indicators that accurately predicted one-year suicidal thoughts and behaviours in a community sample of college students.
Collapse
Affiliation(s)
- Melissa Macalli
- Inserm, Bordeaux Population Health Research Center, UMR 1219, University of Bordeaux, 146 rue Léo Saignat, 33076, Bordeaux Cedex, Bordeaux, France.
| | - Marie Navarro
- Inserm, Bordeaux Population Health Research Center, UMR 1219, University of Bordeaux, 146 rue Léo Saignat, 33076, Bordeaux Cedex, Bordeaux, France
| | - Massimiliano Orri
- Inserm, Bordeaux Population Health Research Center, UMR 1219, University of Bordeaux, 146 rue Léo Saignat, 33076, Bordeaux Cedex, Bordeaux, France.,McGill Group for Suicide Studies, Douglas Mental Health University Institute and Department of Psychiatry, McGill University, Montreal, QC, Canada
| | - Marie Tournier
- Inserm, Bordeaux Population Health Research Center, UMR 1219, University of Bordeaux, 146 rue Léo Saignat, 33076, Bordeaux Cedex, Bordeaux, France.,Charles Perrens Hospital, 33000, Bordeaux, France
| | - Rodolphe Thiébaut
- Inserm, Bordeaux Population Health Research Center, UMR 1219, University of Bordeaux, 146 rue Léo Saignat, 33076, Bordeaux Cedex, Bordeaux, France.,Inria SISTM, 33000, Bordeaux, France.,CHU de Bordeaux, 33000, Bordeaux, France
| | - Sylvana M Côté
- Inserm, Bordeaux Population Health Research Center, UMR 1219, University of Bordeaux, 146 rue Léo Saignat, 33076, Bordeaux Cedex, Bordeaux, France.,School of Public Health, University of Montreal, Montreal, QC, H3T 1J4, Canada
| | - Christophe Tzourio
- Inserm, Bordeaux Population Health Research Center, UMR 1219, University of Bordeaux, 146 rue Léo Saignat, 33076, Bordeaux Cedex, Bordeaux, France.
| |
Collapse
|
19
|
Mansourian M, Khademi S, Marateb HR. A Comprehensive Review of Computer-Aided Diagnosis of Major Mental and Neurological Disorders and Suicide: A Biostatistical Perspective on Data Mining. Diagnostics (Basel) 2021; 11:393. [PMID: 33669114 PMCID: PMC7996506 DOI: 10.3390/diagnostics11030393] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2021] [Revised: 02/13/2021] [Accepted: 02/17/2021] [Indexed: 02/07/2023] Open
Abstract
The World Health Organization (WHO) suggests that mental disorders, neurological disorders, and suicide are growing causes of morbidity. Depressive disorders, schizophrenia, bipolar disorder, Alzheimer's disease, and other dementias account for 1.84%, 0.60%, 0.33%, and 1.00% of total Disability Adjusted Life Years (DALYs). Furthermore, suicide, the 15th leading cause of death worldwide, could be linked to mental disorders. More than 68 computer-aided diagnosis (CAD) methods published in peer-reviewed journals from 2016 to 2021 were analyzed, among which 75% were published in the year 2018 or later. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) protocol was adopted to select the relevant studies. In addition to the gold standard, the sample size, neuroimaging techniques or biomarkers, validation frameworks, the classifiers, and the performance indices were analyzed. We further discussed how various performance indices are essential based on the biostatistical and data mining perspective. Moreover, critical information related to the Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD) guidelines was analyzed. We discussed how balancing the dataset and not using external validation could hinder the generalization of the CAD methods. We provided the list of the critical issues to consider in such studies.
Collapse
Affiliation(s)
- Mahsa Mansourian
- Department of Medical Physics, School of Medicine, Isfahan University of Medical Sciences, Isfahan 81746-73461, Iran;
| | - Sadaf Khademi
- Biomedical Engineering Department, Faculty of Engineering, University of Isfahan, Isfahan 8174-67344, Iran;
| | - Hamid Reza Marateb
- Biomedical Engineering Department, Faculty of Engineering, University of Isfahan, Isfahan 8174-67344, Iran;
| |
Collapse
|