1
|
Smit AC, Snippe E. Real-time monitoring of increases in restlessness to assess idiographic risk of recurrence of depressive symptoms. Psychol Med 2023; 53:5060-5069. [PMID: 35833374 PMCID: PMC10476069 DOI: 10.1017/s0033291722002069] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Revised: 03/10/2022] [Accepted: 06/16/2022] [Indexed: 11/06/2022]
Abstract
BACKGROUND This confirmatory study aimed to examine whether we can foresee recurrence of depressive symptoms using personalized modeling of rises in restlessness. METHODS Participants were formerly depressed patients (N = 41) in remission who (gradually) discontinued antidepressants. Participants completed five smartphone-based Ecological Momentary Assessments (EMA) a day, for a period of 4 months, yielding a total of 21 180 observations. Statistical Process Control by means of Exponentially Weighted Moving Average (EWMA) control charts was used to detect rises in the EMA item 'I feel restless', for each individual separately. RESULTS An increase in restlessness was detected in 68.3% of the participants with recurring depressive symptoms, and in 26.3% of those who stayed in remission (Fisher's exact test p = 0.01, sensitivity was 68.3%, specificity was 73.7%). In the participants with a recurrence and an increase in restlessness, this increase could be detected in the prodromal phase of depression in 93.3% of the cases and at least a month before the onset of the core symptoms of depression in 66.7% of the cases. CONCLUSIONS Restlessness is a common prodromal symptom of depression. The sensitivity and specificity of the EWMA charts was at least as good as prognostic models based on cross-sectional patient characteristics. An advantage of the current idiographic method is that the EWMA charts provide real-time personalized insight in a within-person increase in early signs of depression, which is key to alert the right patient at the right time.
Collapse
Affiliation(s)
- Arnout C. Smit
- Department of Psychiatry, Interdisciplinary Center Psychopathology and Emotion regulation, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
- Faculty of Behavioral and Movement Sciences, Clinical Psychology, VU Amsterdam, Amsterdam, The Netherlands
| | - Evelien Snippe
- Department of Psychiatry, Interdisciplinary Center Psychopathology and Emotion regulation, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| |
Collapse
|
2
|
Qasrawi R, Vicuna Polo SP, Abu Al-Halawa D, Hallaq S, Abdeen Z. Assessment and Prediction of Depression and Anxiety Risk Factors in Schoolchildren: Machine Learning Techniques Performance Analysis. JMIR Form Res 2022; 6:e32736. [PMID: 35665695 PMCID: PMC9475423 DOI: 10.2196/32736] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2021] [Revised: 02/03/2022] [Accepted: 04/29/2022] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Depression and anxiety symptoms in early childhood have a major effect on children's mental health growth and cognitive development. The effect of mental health problems on cognitive development has been studied by researchers for the last 2 decades. OBJECTIVE In this paper, we sought to use machine learning techniques to predict the risk factors associated with schoolchildren's depression and anxiety. METHODS The study sample consisted of 3984 students in fifth to ninth grades, aged 10-15 years, studying at public and refugee schools in the West Bank. The data were collected using the health behaviors schoolchildren questionnaire in the 2013-2014 academic year and analyzed using machine learning to predict the risk factors associated with student mental health symptoms. We used 5 machine learning techniques (random forest [RF], neural network, decision tree, support vector machine [SVM], and naive Bayes) for prediction. RESULTS The results indicated that the SVM and RF models had the highest accuracy levels for depression (SVM: 92.5%; RF: 76.4%) and anxiety (SVM: 92.4%; RF: 78.6%). Thus, the SVM and RF models had the best performance in classifying and predicting the students' depression and anxiety. The results showed that school violence and bullying, home violence, academic performance, and family income were the most important factors affecting the depression and anxiety scales. CONCLUSIONS Overall, machine learning proved to be an efficient tool for identifying and predicting the associated factors that influence student depression and anxiety. The machine learning techniques seem to be a good model for predicting abnormal depression and anxiety symptoms among schoolchildren, so the deployment of machine learning within the school information systems might facilitate the development of health prevention and intervention programs that will enhance students' mental health and cognitive development.
Collapse
Affiliation(s)
- Radwan Qasrawi
- Department of Computer Science, Al-Quds University, Ramallah, Occupied Palestinian Territory
- Department of Computer Engineering, Istinye University, Istanbul, Turkey
| | - Stephanny Paola Vicuna Polo
- Center for Business Innovation and Technology, Al-Quds University, Jerusalem, Occupied Palestinian Territory
| | - Diala Abu Al-Halawa
- Faculty of Medicine, Al-Quds University, Jerusalem, Occupied Palestinian Territory
| | - Sameh Hallaq
- Al-Quds Bard College for Arts and Sciences, Al-Quds University, Jerusalem, Occupied Palestinian Territory
| | - Ziad Abdeen
- Faculty of Medicine, Al-Quds University, Jerusalem, Occupied Palestinian Territory
| |
Collapse
|
3
|
Moriarty AS, Meader N, Snell KIE, Riley RD, Paton LW, Dawson S, Hendon J, Chew-Graham CA, Gilbody S, Churchill R, Phillips RS, Ali S, McMillan D. Predicting relapse or recurrence of depression: systematic review of prognostic models. Br J Psychiatry 2022; 221:448-458. [PMID: 35048843 DOI: 10.1192/bjp.2021.218] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
BACKGROUND Relapse and recurrence of depression are common, contributing to the overall burden of depression globally. Accurate prediction of relapse or recurrence while patients are well would allow the identification of high-risk individuals and may effectively guide the allocation of interventions to prevent relapse and recurrence. AIMS To review prognostic models developed to predict the risk of relapse, recurrence, sustained remission, or recovery in adults with remitted major depressive disorder. METHOD We searched the Cochrane Library (current issue); Ovid MEDLINE (1946 onwards); Ovid Embase (1980 onwards); Ovid PsycINFO (1806 onwards); and Web of Science (1900 onwards) up to May 2021. We included development and external validation studies of multivariable prognostic models. We assessed risk of bias of included studies using the Prediction model risk of bias assessment tool (PROBAST). RESULTS We identified 12 eligible prognostic model studies (11 unique prognostic models): 8 model development-only studies, 3 model development and external validation studies and 1 external validation-only study. Multiple estimates of performance measures were not available and meta-analysis was therefore not necessary. Eleven out of the 12 included studies were assessed as being at high overall risk of bias and none examined clinical utility. CONCLUSIONS Due to high risk of bias of the included studies, poor predictive performance and limited external validation of the models identified, presently available clinical prediction models for relapse and recurrence of depression are not yet sufficiently developed for deploying in clinical settings. There is a need for improved prognosis research in this clinical area and future studies should conform to best practice methodological and reporting guidelines.
Collapse
Affiliation(s)
- Andrew S Moriarty
- Mental Health and Addiction Research Group, Department of Health Sciences, University of York, UK and Hull York Medical School, University of York, UK
| | - Nicholas Meader
- Centre for Reviews and Dissemination, University of York, UK and Cochrane Common Mental Disorders, University of York, UK
| | - Kym I E Snell
- Centre for Prognosis Research, School of Medicine, Keele University, UK
| | - Richard D Riley
- Centre for Prognosis Research, School of Medicine, Keele University, UK
| | - Lewis W Paton
- Mental Health and Addiction Research Group, Department of Health Sciences, University of York, UK
| | - Sarah Dawson
- Cochrane Common Mental Disorders, University of York, UK and Bristol Medical School, University of Bristol, UK
| | - Jessica Hendon
- Centre for Reviews and Dissemination, University of York, UK and Cochrane Common Mental Disorders, University of York, UK
| | | | - Simon Gilbody
- Mental Health and Addiction Research Group, Department of Health Sciences, University of York, UK and Hull York Medical School, University of York, UK
| | - Rachel Churchill
- Centre for Reviews and Dissemination, University of York, UK and Cochrane Common Mental Disorders, University of York, UK
| | | | - Shehzad Ali
- Mental Health and Addiction Research Group, Department of Health Sciences, University of York, UK and Department of Epidemiology and Biostatistics, Schulich School of Medicine & Dentistry, Western University, Canada
| | - Dean McMillan
- Mental Health and Addiction Research Group, Department of Health Sciences, University of York, UK and Hull York Medical School, University of York, UK
| |
Collapse
|
4
|
Diagnosis of Arrhythmia for Patients with Occult Coronary Heart Disease Guided by Intracavitary Electrocardiogram under Data Mining Algorithm. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:1640870. [PMID: 34552706 PMCID: PMC8452439 DOI: 10.1155/2021/1640870] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/29/2021] [Revised: 08/28/2021] [Accepted: 08/31/2021] [Indexed: 11/17/2022]
Abstract
The objective of this study was to explore the application value of intracavitary electrocardiogram- (IEGM-) guided diagnosis of occult heart disease and conventional electrocardiogram (EGM) in the diagnosis of occult coronary heart disease (CHD) based on the classification and regression tree (CART) mining algorithm, hoping to provide a more effective basis for clinical diagnosis of the occult CHD. In this study, 100 patients with occult CHD admitted to our hospital from February 2016 to December 2020 were selected as the research objects. Based on the random number table method, 100 patients were randomly rolled into two groups, each with 50 cases. The patients diagnosed with conventional ECG were set as the control group, and patients in the experimental group were diagnosed with IEGM under the data mining algorithms. The diagnostic effects of the two groups were compared. The results showed that the processing effect of the CART algorithm (94%) was much better than that of the multiple linear regression algorithm (78%) and the random forest algorithm (69%) (P < 0.05), the agreement between the results of the experimental group and the results of coronary angiography (80%) and Kappa (0.7) was higher than those of the control group (55%, 0.45), and the difference was statistically significant (P < 0.05). In addition, the sensitivity (93%) and accuracy (80%) of the experimental group were obviously higher than those of the control group (62% and 55%), and the differences were remarkably significant (P < 0.05). In conclusion, the consistency ratio of the IEGM examination was higher, showing high accuracy; the intracavitary examination was invasive, so IEGM was not recommended when the diagnosis result of the examination may cause more harm than good.
Collapse
|
5
|
Moriarty AS, Paton LW, Snell KIE, Riley RD, Buckman JEJ, Gilbody S, Chew-Graham CA, Ali S, Pilling S, Meader N, Phillips B, Coventry PA, Delgadillo J, Richards DA, Salisbury C, McMillan D. The development and validation of a prognostic model to PREDICT Relapse of depression in adult patients in primary care: protocol for the PREDICTR study. Diagn Progn Res 2021; 5:12. [PMID: 34215317 PMCID: PMC8254312 DOI: 10.1186/s41512-021-00101-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Accepted: 05/19/2021] [Indexed: 12/23/2022] Open
Abstract
BACKGROUND Most patients who present with depression are treated in primary care by general practitioners (GPs). Relapse of depression is common (at least 50% of patients treated for depression will relapse after a single episode) and leads to considerable morbidity and decreased quality of life for patients. The majority of patients will relapse within 6 months, and those with a history of relapse are more likely to relapse in the future than those with no such history. GPs see a largely undifferentiated case-mix of patients, and once patients with depression reach remission, there is limited guidance to help GPs stratify patients according to risk of relapse. We aim to develop a prognostic model to predict an individual's risk of relapse within 6-8 months of entering remission. The long-term objective is to inform the clinical management of depression after the acute phase. METHODS We will develop a prognostic model using secondary analysis of individual participant data drawn from seven RCTs and one longitudinal cohort study in primary or community care settings. We will use logistic regression to predict the outcome of relapse of depression within 6-8 months. We plan to include the following established relapse predictors in the model: residual depressive symptoms, number of previous depressive episodes, co-morbid anxiety and severity of index episode. We will use a "full model" development approach, including all available predictors. Performance statistics (optimism-adjusted C-statistic, calibration-in-the-large, calibration slope) and calibration plots (with smoothed calibration curves) will be calculated. Generalisability of predictive performance will be assessed through internal-external cross-validation. Clinical utility will be explored through net benefit analysis. DISCUSSION We will derive a statistical model to predict relapse of depression in remitted depressed patients in primary care. Assuming the model has sufficient predictive performance, we outline the next steps including independent external validation and further assessment of clinical utility and impact. STUDY REGISTRATION ClinicalTrials.gov ID: NCT04666662.
Collapse
Affiliation(s)
- Andrew S Moriarty
- Department of Health Sciences, University of York, York, England.
- Hull York Medical School, University of York, York, England.
| | - Lewis W Paton
- Department of Health Sciences, University of York, York, England
| | - Kym I E Snell
- Centre for Prognosis Research, School of Medicine, Keele University, Keele, England
| | - Richard D Riley
- Centre for Prognosis Research, School of Medicine, Keele University, Keele, England
| | - Joshua E J Buckman
- Centre for Outcomes and Research Effectiveness, Research Department of Clinical, Educational and Health Psychology, University College London, London, England
- iCope - Camden and Islington Psychological Therapies Services, Camden & Islington NHS Foundation Trust, London, England
| | - Simon Gilbody
- Department of Health Sciences, University of York, York, England
- Hull York Medical School, University of York, York, England
| | | | - Shehzad Ali
- Department of Health Sciences, University of York, York, England
- Department of Epidemiology and Biostatistics, Schulich School of Medicine & Dentistry, Western University, London, ON, Canada
| | - Stephen Pilling
- Centre for Outcomes and Research Effectiveness, Research Department of Clinical, Educational and Health Psychology, University College London, London, England
- Camden & Islington NHS Foundation Trust, St Pancras Hospital, London, England
| | - Nick Meader
- Centre for Reviews and Dissemination, University of York, York, England
| | - Bob Phillips
- Centre for Reviews and Dissemination, University of York, York, England
| | - Peter A Coventry
- Department of Health Sciences, University of York, York, England
| | - Jaime Delgadillo
- Department of Psychology, University of Sheffield, Sheffield, England
| | - David A Richards
- Institute of Health Research, College of Medicine and Health, University of Exeter, Exeter, England
- Department of Health and Caring Sciences, Western Norway University of Applied Sciences, Inndalsveien 28, 5063 Bergen, Norway, USA
| | - Chris Salisbury
- Centre for Academic Primary Care, University of Bristol, Bristol, England
| | - Dean McMillan
- Department of Health Sciences, University of York, York, England
- Hull York Medical School, University of York, York, England
| |
Collapse
|
6
|
Moriarty AS, Meader N, Snell KI, Riley RD, Paton LW, Chew-Graham CA, Gilbody S, Churchill R, Phillips RS, Ali S, McMillan D. Prognostic models for predicting relapse or recurrence of major depressive disorder in adults. Cochrane Database Syst Rev 2021; 5:CD013491. [PMID: 33956992 PMCID: PMC8102018 DOI: 10.1002/14651858.cd013491.pub2] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
BACKGROUND Relapse (the re-emergence of depressive symptoms after some level of improvement but preceding recovery) and recurrence (onset of a new depressive episode after recovery) are common in depression, lead to worse outcomes and quality of life for patients and exert a high economic cost on society. Outcomes can be predicted by using multivariable prognostic models, which use information about several predictors to produce an individualised risk estimate. The ability to accurately predict relapse or recurrence while patients are well (in remission) would allow the identification of high-risk individuals and may improve overall treatment outcomes for patients by enabling more efficient allocation of interventions to prevent relapse and recurrence. OBJECTIVES To summarise the predictive performance of prognostic models developed to predict the risk of relapse, recurrence, sustained remission or recovery in adults with major depressive disorder who meet criteria for remission or recovery. SEARCH METHODS We searched the Cochrane Library (current issue); Ovid MEDLINE (1946 onwards); Ovid Embase (1980 onwards); Ovid PsycINFO (1806 onwards); and Web of Science (1900 onwards) up to May 2020. We also searched sources of grey literature, screened the reference lists of included studies and performed a forward citation search. There were no restrictions applied to the searches by date, language or publication status . SELECTION CRITERIA We included development and external validation (testing model performance in data separate from the development data) studies of any multivariable prognostic models (including two or more predictors) to predict relapse, recurrence, sustained remission, or recovery in adults (aged 18 years and over) with remitted depression, in any clinical setting. We included all study designs and accepted all definitions of relapse, recurrence and other related outcomes. We did not specify a comparator prognostic model. DATA COLLECTION AND ANALYSIS Two review authors independently screened references; extracted data (using a template based on the CHecklist for critical Appraisal and data extraction for systematic Reviews of prediction Modelling Studies (CHARMS)); and assessed risks of bias of included studies (using the Prediction model Risk Of Bias ASsessment Tool (PROBAST)). We referred any disagreements to a third independent review author. Where we found sufficient (10 or more) external validation studies of an individual model, we planned to perform a meta-analysis of its predictive performance, specifically with respect to its calibration (how well the predicted probabilities match the observed proportions of individuals that experience the outcome) and discrimination (the ability of the model to differentiate between those with and without the outcome). Recommendations could not be qualified using the GRADE system, as guidance is not yet available for prognostic model reviews. MAIN RESULTS We identified 11 eligible prognostic model studies (10 unique prognostic models). Seven were model development studies; three were model development and external validation studies; and one was an external validation-only study. Multiple estimates of performance measures were not available for any of the models and, meta-analysis was therefore not possible. Ten out of the 11 included studies were assessed as being at high overall risk of bias. Common weaknesses included insufficient sample size, inappropriate handling of missing data and lack of information about discrimination and calibration. One paper (Klein 2018) was at low overall risk of bias and presented a prognostic model including the following predictors: number of previous depressive episodes, residual depressive symptoms and severity of the last depressive episode. The external predictive performance of this model was poor (C-statistic 0.59; calibration slope 0.56; confidence intervals not reported). None of the identified studies examined the clinical utility (net benefit) of the developed model. AUTHORS' CONCLUSIONS Of the 10 prognostic models identified (across 11 studies), only four underwent external validation. Most of the studies (n = 10) were assessed as being at high overall risk of bias, and the one study that was at low risk of bias presented a model with poor predictive performance. There is a need for improved prognostic research in this clinical area, with future studies conforming to current best practice recommendations for prognostic model development/validation and reporting findings in line with the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement.
Collapse
Affiliation(s)
- Andrew S Moriarty
- Mental Health and Addiction Research Group, Department of Health Sciences, University of York, York, UK
- Hull York Medical School, University of York, York, UK
| | - Nicholas Meader
- Centre for Reviews and Dissemination, University of York, York, UK
- Cochrane Common Mental Disorders, University of York, York, UK
| | - Kym Ie Snell
- Centre for Prognosis Research, School of Medicine, Keele University, Keele, UK
| | - Richard D Riley
- Centre for Prognosis Research, School of Medicine, Keele University, Keele, UK
| | - Lewis W Paton
- Mental Health and Addiction Research Group, Department of Health Sciences, University of York, York, UK
| | | | - Simon Gilbody
- Mental Health and Addiction Research Group, Department of Health Sciences, University of York, York, UK
- Hull York Medical School, University of York, York, UK
| | - Rachel Churchill
- Centre for Reviews and Dissemination, University of York, York, UK
- Cochrane Common Mental Disorders, University of York, York, UK
| | | | - Shehzad Ali
- Mental Health and Addiction Research Group, Department of Health Sciences, University of York, York, UK
- Department of Epidemiology and Biostatistics, Schulich School of Medicine & Dentistry, Western University, London, Canada
| | - Dean McMillan
- Mental Health and Addiction Research Group, Department of Health Sciences, University of York, York, UK
- Hull York Medical School, University of York, York, UK
| |
Collapse
|