1
|
Karvelis P, Hauke DJ, Wobmann M, Andreou C, Mackintosh A, de Bock R, Borgwardt S, Diaconescu AO. Test-retest reliability of behavioral and computational measures of advice taking under volatility. PLoS One 2024; 19:e0312255. [PMID: 39556555 PMCID: PMC11573178 DOI: 10.1371/journal.pone.0312255] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2023] [Accepted: 10/03/2024] [Indexed: 11/20/2024] Open
Abstract
The development of computational models for studying mental disorders is on the rise. However, their psychometric properties remain understudied, posing a risk of undermining their use in empirical research and clinical translation. Here we investigated test-retest reliability (with a 2-week interval) of a computational assay probing advice-taking under volatility with a Hierarchical Gaussian Filter (HGF) model. In a sample of 39 healthy participants, we found the computational measures to have largely poor reliability (intra-class correlation coefficient or ICC < 0.5), on par with the behavioral measures of task performance. Further analysis revealed that reliability was substantially impacted by intrinsic measurement noise (indicated by parameter recovery analysis) and to a smaller extent by practice effects. However, a large portion of within-subject variance remained unexplained and may be attributable to state-like fluctuations. Despite the poor test-retest reliability, we found the assay to have face validity at the group level. Overall, our work highlights that the different sources of variance affecting test-retest reliability need to be studied in greater detail. A better understanding of these sources would facilitate the design of more psychometrically sound assays, which would improve the quality of future research and increase the probability of clinical translation.
Collapse
Affiliation(s)
- Povilas Karvelis
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, ON, Canada
- Department of Psychiatry, University of Toronto, Toronto, ON, Canada
| | - Daniel J. Hauke
- Centre for Medical Image Computing, Department of Computer Science, University College London, London, United Kingdom
| | - Michelle Wobmann
- Department of Psychiatry (UPK), University of Basel, Basel, Switzerland
| | - Christina Andreou
- Department of Psychiatry and Psychotherapy, Translational Psychiatry, University of Lubeck, Lubeck, Germany
| | - Amatya Mackintosh
- Department of Psychiatry (UPK), University of Basel, Basel, Switzerland
| | - Renate de Bock
- Department of Psychiatry (UPK), University of Basel, Basel, Switzerland
| | - Stefan Borgwardt
- Department of Psychiatry and Psychotherapy, Translational Psychiatry, University of Lubeck, Lubeck, Germany
| | - Andreea O. Diaconescu
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, ON, Canada
- Department of Psychiatry, University of Toronto, Toronto, ON, Canada
- Institute of Medical Sciences, University of Toronto, Toronto, ON, Canada
- Department of Psychology, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
2
|
Zhang S, Liu J, Peng J, Xu C, Shi R. Resistance to Sunk Cost Propensity Moderate Relationship between Negative Life Event and Hopelessness. Psychol Rep 2024; 127:2489-2504. [PMID: 36593113 DOI: 10.1177/00332941221149177] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
Previous research has found that a negative life event is a main risk factor for hopelessness, which in turn is considered to be a proximal cause of major depression disorder and a suicide risk factor. Unfortunately, very little attention has been paid to the role of decision-making constructs between negative life events and hopelessness. To fill this gap, the present study aims to test the moderation role of sunk cost propensity in this relationship, which is an over-generalized tendency to persist, based on past investment. A total of 495 university students completed assessment of their resistance to sunk cost propensity, whereas the negative life events, hopelessness, mental health state (depression, anxiety) and big-five personality traits were measured by various questionnaires. Participants' tendency to resist sunk cost propensity moderated the relationship between negative life events and hopelessness. Individuals who tended to resist sunk cost bias are more vulnerable to the adverse effects of negative life events. This effect is still significant, even after controlling for individuals' psychological well-being (depression, anxiety) and big-five personality traits. The current findings provide preliminary evidence that resistance to sunk cost propensity may be an important characteristic associated with an individual's hopelessness when exposed to a negative life event.
Collapse
Affiliation(s)
- Shilei Zhang
- Psychological Counseling Centre, Chang'an University, Xi'an, China
- School of Psychology, Xinjiang Normal University, Urumqi, China
- Xinjiang Key Laboratory of Mental Development and Learning Science, Urumqi, China
| | - Jingjing Liu
- School of Psychology, Xinjiang Normal University, Urumqi, China
- Xinjiang Key Laboratory of Mental Development and Learning Science, Urumqi, China
| | - Jiaxi Peng
- College of Teachers, Chengdu University, Chengdu, China
| | - Changfeng Xu
- College of Humanities and Social Development, Northwest A&F University, Yang Ling, China
| | - Rui Shi
- College of Humanities and Social Development, Northwest A&F University, Yang Ling, China
| |
Collapse
|
3
|
Charlton CE, Karvelis P, McIntyre RS, Diaconescu AO. Suicide prevention and ketamine: insights from computational modeling. Front Psychiatry 2023; 14:1214018. [PMID: 37457775 PMCID: PMC10342546 DOI: 10.3389/fpsyt.2023.1214018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Accepted: 06/12/2023] [Indexed: 07/18/2023] Open
Abstract
Suicide is a pressing public health issue, with over 700,000 individuals dying each year. Ketamine has emerged as a promising treatment for suicidal thoughts and behaviors (STBs), yet the complex mechanisms underlying ketamine's anti-suicidal effect are not fully understood. Computational psychiatry provides a promising framework for exploring the dynamic interactions underlying suicidality and ketamine's therapeutic action, offering insight into potential biomarkers, treatment targets, and the underlying mechanisms of both. This paper provides an overview of current computational theories of suicidality and ketamine's mechanism of action, and discusses various computational modeling approaches that attempt to explain ketamine's anti-suicidal effect. More specifically, the therapeutic potential of ketamine is explored in the context of the mismatch negativity and the predictive coding framework, by considering neurocircuits involved in learning and decision-making, and investigating altered connectivity strengths and receptor densities targeted by ketamine. Theory-driven computational models offer a promising approach to integrate existing knowledge of suicidality and ketamine, and for the extraction of model-derived mechanistic parameters that can be used to identify patient subgroups and personalized treatment approaches. Future computational studies on ketamine's mechanism of action should optimize task design and modeling approaches to ensure parameter reliability, and external factors such as set and setting, as well as psychedelic-assisted therapy should be evaluated for their additional therapeutic value.
Collapse
Affiliation(s)
- Colleen E. Charlton
- Krembil Center for Neuroinformatics, Center for Addiction and Mental Health (CAMH), Toronto, ON, Canada
| | - Povilas Karvelis
- Krembil Center for Neuroinformatics, Center for Addiction and Mental Health (CAMH), Toronto, ON, Canada
| | - Roger S. McIntyre
- Department of Psychiatry, University of Toronto, Toronto, ON, Canada
- Department of Pharmacology and Toxicology, University of Toronto, Toronto, ON, Canada
| | - Andreea O. Diaconescu
- Krembil Center for Neuroinformatics, Center for Addiction and Mental Health (CAMH), Toronto, ON, Canada
- Department of Psychiatry, University of Toronto, Toronto, ON, Canada
- Institute of Medical Sciences, University of Toronto, Toronto, ON, Canada
- Department of Psychology, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
4
|
Karvelis P, Paulus MP, Diaconescu AO. Individual differences in computational psychiatry: a review of current challenges. Neurosci Biobehav Rev 2023; 148:105137. [PMID: 36940888 DOI: 10.1016/j.neubiorev.2023.105137] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2023] [Revised: 03/04/2023] [Accepted: 03/14/2023] [Indexed: 03/23/2023]
Abstract
Bringing precision to the understanding and treatment of mental disorders requires instruments for studying clinically relevant individual differences. One promising approach is the development of computational assays: integrating computational models with cognitive tasks to infer latent patient-specific disease processes in brain computations. While recent years have seen many methodological advancements in computational modelling and many cross-sectional patient studies, much less attention has been paid to basic psychometric properties (reliability and construct validity) of the computational measures provided by the assays. In this review, we assess the extent of this issue by examining emerging empirical evidence. We find that many computational measures suffer from poor psychometric properties, which poses a risk of invalidating previous findings and undermining ongoing research efforts using computational assays to study individual (and even group) differences. We provide recommendations for how to address these problems and, crucially, embed them within a broader perspective on key developments that are needed for translating computational assays to clinical practice.
Collapse
Affiliation(s)
- Povilas Karvelis
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, ON, Canada.
| | - Martin P Paulus
- Laureate Institute for Brain Research, Tulsa, OK, USA; Oxley College of Health Sciences, The University of Tulsa, Tulsa, OK, USA
| | - Andreea O Diaconescu
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, ON, Canada; Department of Psychiatry, University of Toronto, Toronto, ON, Canada; Institute of Medical Sciences, University of Toronto, Toronto, ON, Canada; Department of Psychology, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
5
|
Liu Q, Zhong R, Ji X, Law S, Xiao F, Wei Y, Fang S, Kong X, Zhang X, Yao S, Wang X. Decision-making biases in suicide attempters with major depressive disorder: A computational modeling study using the balloon analog risk task (BART). Depress Anxiety 2022; 39:845-857. [PMID: 36329675 DOI: 10.1002/da.23291] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Revised: 09/30/2022] [Accepted: 10/22/2022] [Indexed: 11/06/2022] Open
Abstract
BACKGROUND In the last decade, suicidality has been increasingly theorized as a distinct phenomenon from major depressive disorder (MDD), with unique psychological and neural mechanisms, rather than being mostly a severe symptom of MDD. Although decision-making biases have been widely reported in suicide attempters with MDD, little is known regarding what components of these biases can be distinguished from depressiveness itself. METHODS Ninety-three patients with current MDD (40 with suicide attempts [SA group] and 53 without suicide attempts [NS group]) and 65 healthy controls (HCs) completed psychometric assessments and the balloon analog risk task (BART). To analyze and compare decision-making components among the three groups, we applied a five-parameter Bayesian computational modeling. RESULTS Psychological assessments showed that the SA group had greater suicidal ideation and psychological pain avoidance than the NS group. Computational modeling showed that both MDD groups had higher risk preference and lower ability to learn and adapt from within-task observations than HCs, without differences between the SA and NS patient groups. The SA group also had higher loss aversion than the NS and HC groups, which had similar loss aversion. CONCLUSIONS Our BART and computational modeling findings suggest that psychological pain avoidance and loss aversion may be important suicide risk factor that are distinguishable from depression illness itself.
Collapse
Affiliation(s)
- Qinyu Liu
- Medical Psychological Center, The Second Xiangya Hospital, Central South University, Changsha, Hunan, China.,China National Clinical Research Center on Mental Disorders (Xiangya), Changsha, Hunan, China
| | - Runqing Zhong
- Medical Psychological Center, The Second Xiangya Hospital, Central South University, Changsha, Hunan, China.,China National Clinical Research Center on Mental Disorders (Xiangya), Changsha, Hunan, China
| | - Xinlei Ji
- Medical Psychological Center, The Second Xiangya Hospital, Central South University, Changsha, Hunan, China.,China National Clinical Research Center on Mental Disorders (Xiangya), Changsha, Hunan, China
| | - Samuel Law
- Department of Psychiatry, University of Toronto, Ontario, Toronto, Canada
| | - Fan Xiao
- Medical Psychological Center, The Second Xiangya Hospital, Central South University, Changsha, Hunan, China.,China National Clinical Research Center on Mental Disorders (Xiangya), Changsha, Hunan, China
| | - Yiming Wei
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China
| | - Shulin Fang
- Medical Psychological Center, The Second Xiangya Hospital, Central South University, Changsha, Hunan, China.,China National Clinical Research Center on Mental Disorders (Xiangya), Changsha, Hunan, China
| | - Xinyuan Kong
- Medical Psychological Center, The Second Xiangya Hospital, Central South University, Changsha, Hunan, China.,China National Clinical Research Center on Mental Disorders (Xiangya), Changsha, Hunan, China
| | - Xiaocui Zhang
- Medical Psychological Center, The Second Xiangya Hospital, Central South University, Changsha, Hunan, China.,China National Clinical Research Center on Mental Disorders (Xiangya), Changsha, Hunan, China
| | - Shuqiao Yao
- Medical Psychological Center, The Second Xiangya Hospital, Central South University, Changsha, Hunan, China.,China National Clinical Research Center on Mental Disorders (Xiangya), Changsha, Hunan, China
| | - Xiang Wang
- Medical Psychological Center, The Second Xiangya Hospital, Central South University, Changsha, Hunan, China.,China National Clinical Research Center on Mental Disorders (Xiangya), Changsha, Hunan, China
| |
Collapse
|