1
|
Thunberg C, Wiker T, Bundt C, Huster RJ. On the (un)reliability of common behavioral and electrophysiological measures from the stop signal task: Measures of inhibition lack stability over time. Cortex 2024; 175:81-105. [PMID: 38508968 DOI: 10.1016/j.cortex.2024.02.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Revised: 10/31/2023] [Accepted: 02/12/2024] [Indexed: 03/22/2024]
Abstract
Response inhibition, the intentional stopping of planned or initiated actions, is often considered a key facet of control, impulsivity, and self-regulation. The stop signal task is argued to be the purest inhibition task we have, and it is thus central to much work investigating the role of inhibition in areas like development and psychopathology. Most of this work quantifies stopping behavior by calculating the stop signal reaction time as a measure of individual stopping latency. Individual difference studies aiming to investigate why and how stopping latencies differ between people often do this under the assumption that the stop signal reaction time indexes a stable, dispositional trait. However, empirical support for this assumption is lacking, as common measures of inhibition and control tend to show low test-retest reliability and thus appear unstable over time. The reasons for this could be methodological, where low stability is driven by measurement noise, or substantive, where low stability is driven by a larger influence of state-like and situational factors. To investigate this, we characterized the split-half and test-retest reliability of a range of common behavioral and electrophysiological measures derived from the stop signal task. Across three independent studies, different measurement modalities, and a systematic review of the literature, we found a pattern of low temporal stability for inhibition measures and higher stability for measures of manifest behavior and non-inhibitory processing. This pattern could not be explained by measurement noise and low internal consistency. Consequently, response inhibition appears to have mostly state-like and situational determinants, and there is little support for the validity of conceptualizing common inhibition measures as reflecting stable traits.
Collapse
Affiliation(s)
- Christina Thunberg
- Multimodal Imaging and Cognitive Control Lab, Department of Psychology, University of Oslo, Oslo, Norway; Cognitive and Translational Neuroscience Cluster, Department of Psychology, University of Oslo, Oslo, Norway.
| | - Thea Wiker
- Norwegian Centre for Mental Disorders Research, Institute of Clinical Medicine, University of Oslo, Oslo, Norway; Research Center for Developmental Processes and Gradients in Mental Health, Department of Psychology, University of Oslo, Oslo, Norway; Department of Psychiatric Research, Diakonhjemmet Hospital, Oslo, Norway
| | - Carsten Bundt
- Multimodal Imaging and Cognitive Control Lab, Department of Psychology, University of Oslo, Oslo, Norway; Cognitive and Translational Neuroscience Cluster, Department of Psychology, University of Oslo, Oslo, Norway
| | - René J Huster
- Multimodal Imaging and Cognitive Control Lab, Department of Psychology, University of Oslo, Oslo, Norway; Cognitive and Translational Neuroscience Cluster, Department of Psychology, University of Oslo, Oslo, Norway
| |
Collapse
|
2
|
Pezzoli P, Parsons S, Kievit RA, Astle DE, Huys QJM, Steinbeis N, Viding E. Challenges and Solutions to the Measurement of Neurocognitive Mechanisms in Developmental Settings. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2023; 8:815-821. [PMID: 37003410 DOI: 10.1016/j.bpsc.2023.03.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Revised: 03/15/2023] [Accepted: 03/20/2023] [Indexed: 03/31/2023]
Abstract
Identifying early neurocognitive mechanisms that confer risk for mental health problems is one important avenue as we seek to develop successful early interventions. Currently, however, we have limited understanding of the neurocognitive mechanisms involved in shaping mental health trajectories from childhood through young adulthood, and this constrains our ability to develop effective clinical interventions. In particular, there is an urgent need to develop more sensitive, reliable, and scalable measures of individual differences for use in developmental settings. In this review, we outline methodological shortcomings that explain why widely used task-based measures of neurocognition currently tell us little about mental health risk. We discuss specific challenges that arise when studying neurocognitive mechanisms in developmental settings, and we share suggestions for overcoming them. We also propose a novel experimental approach-which we refer to as "cognitive microscopy"-that involves adaptive design optimization, temporally sensitive task administration, and multilevel modeling. This approach addresses some of the methodological shortcomings outlined above and provides measures of stability, variability, and developmental change in neurocognitive mechanisms within a multivariate framework.
Collapse
Affiliation(s)
- Patrizia Pezzoli
- Division of Psychology and Language Sciences, University College London, London, United Kingdom.
| | - Sam Parsons
- Donders Institute for Brain, Cognition and Behavior, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Rogier A Kievit
- Donders Institute for Brain, Cognition and Behavior, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Duncan E Astle
- Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, United Kingdom; Department of Psychiatry, University of Cambridge, Cambridge, United Kingdom
| | - Quentin J M Huys
- Applied Computational Psychiatry Laboratory, Mental Health Neuroscience Department, Division of Psychiatry and Max Planck Centre for Computational Psychiatry and Ageing Research, Queen Square Institute of Neurology, University College London, London, United Kingdom
| | - Nikolaus Steinbeis
- Division of Psychology and Language Sciences, University College London, London, United Kingdom
| | - Essi Viding
- Division of Psychology and Language Sciences, University College London, London, United Kingdom.
| |
Collapse
|
3
|
Karvelis P, Paulus MP, Diaconescu AO. Individual differences in computational psychiatry: a review of current challenges. Neurosci Biobehav Rev 2023; 148:105137. [PMID: 36940888 DOI: 10.1016/j.neubiorev.2023.105137] [Citation(s) in RCA: 14] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2023] [Revised: 03/04/2023] [Accepted: 03/14/2023] [Indexed: 03/23/2023]
Abstract
Bringing precision to the understanding and treatment of mental disorders requires instruments for studying clinically relevant individual differences. One promising approach is the development of computational assays: integrating computational models with cognitive tasks to infer latent patient-specific disease processes in brain computations. While recent years have seen many methodological advancements in computational modelling and many cross-sectional patient studies, much less attention has been paid to basic psychometric properties (reliability and construct validity) of the computational measures provided by the assays. In this review, we assess the extent of this issue by examining emerging empirical evidence. We find that many computational measures suffer from poor psychometric properties, which poses a risk of invalidating previous findings and undermining ongoing research efforts using computational assays to study individual (and even group) differences. We provide recommendations for how to address these problems and, crucially, embed them within a broader perspective on key developments that are needed for translating computational assays to clinical practice.
Collapse
Affiliation(s)
- Povilas Karvelis
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, ON, Canada.
| | - Martin P Paulus
- Laureate Institute for Brain Research, Tulsa, OK, USA; Oxley College of Health Sciences, The University of Tulsa, Tulsa, OK, USA
| | - Andreea O Diaconescu
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, ON, Canada; Department of Psychiatry, University of Toronto, Toronto, ON, Canada; Institute of Medical Sciences, University of Toronto, Toronto, ON, Canada; Department of Psychology, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
4
|
Kaklauskas A, Abraham A, Ubarte I, Kliukas R, Luksaite V, Binkyte-Veliene A, Vetloviene I, Kaklauskiene L. A Review of AI Cloud and Edge Sensors, Methods, and Applications for the Recognition of Emotional, Affective and Physiological States. SENSORS (BASEL, SWITZERLAND) 2022; 22:7824. [PMID: 36298176 PMCID: PMC9611164 DOI: 10.3390/s22207824] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Revised: 09/28/2022] [Accepted: 10/12/2022] [Indexed: 06/16/2023]
Abstract
Affective, emotional, and physiological states (AFFECT) detection and recognition by capturing human signals is a fast-growing area, which has been applied across numerous domains. The research aim is to review publications on how techniques that use brain and biometric sensors can be used for AFFECT recognition, consolidate the findings, provide a rationale for the current methods, compare the effectiveness of existing methods, and quantify how likely they are to address the issues/challenges in the field. In efforts to achieve the key goals of Society 5.0, Industry 5.0, and human-centered design better, the recognition of emotional, affective, and physiological states is progressively becoming an important matter and offers tremendous growth of knowledge and progress in these and other related fields. In this research, a review of AFFECT recognition brain and biometric sensors, methods, and applications was performed, based on Plutchik's wheel of emotions. Due to the immense variety of existing sensors and sensing systems, this study aimed to provide an analysis of the available sensors that can be used to define human AFFECT, and to classify them based on the type of sensing area and their efficiency in real implementations. Based on statistical and multiple criteria analysis across 169 nations, our outcomes introduce a connection between a nation's success, its number of Web of Science articles published, and its frequency of citation on AFFECT recognition. The principal conclusions present how this research contributes to the big picture in the field under analysis and explore forthcoming study trends.
Collapse
Affiliation(s)
- Arturas Kaklauskas
- Department of Construction Management and Real Estate, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Ajith Abraham
- Machine Intelligence Research Labs, Scientific Network for Innovation and Research Excellence, Auburn, WA 98071, USA
| | - Ieva Ubarte
- Institute of Sustainable Construction, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Romualdas Kliukas
- Department of Applied Mechanics, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Vaida Luksaite
- Department of Construction Management and Real Estate, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Arune Binkyte-Veliene
- Institute of Sustainable Construction, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Ingrida Vetloviene
- Department of Construction Management and Real Estate, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Loreta Kaklauskiene
- Department of Construction Management and Real Estate, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| |
Collapse
|
5
|
Sethi A, O'Brien S, Blair J, Viding E, Mehta M, Ecker C, Blackwood N, Doolan M, Catani M, Scott S, Murphy DGM, Craig MC. Selective Amygdala Hypoactivity to Fear in Boys With Persistent Conduct Problems After Parent Training. Biol Psychiatry 2022:S0006-3223(22)01658-4. [PMID: 36642564 DOI: 10.1016/j.biopsych.2022.09.031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Revised: 08/23/2022] [Accepted: 09/30/2022] [Indexed: 01/17/2023]
Abstract
BACKGROUND Parenting interventions reduce antisocial behavior (ASB) in some children with conduct problems (CPs), but not others. Understanding the neural basis for this disparity is important because persistent ASB is associated with lifelong morbidity and places a huge burden on our health and criminal justice systems. One of the most highly replicated neural correlates of ASB is amygdala hypoactivity to another person's fear. We aimed to assess whether amygdala hypoactivity to fear in children with CPs is remediated following reduction in ASB after successful treatment and/or if it is a marker for persistent ASB. METHODS We conducted a prospective, case-control study of boys with CPs and typically developing (TD) boys. Both groups (ages 5-10 years) completed 2 magnetic resonance imaging sessions (18 ± 5.8 weeks apart) with ASB assessed at each visit. Participants included boys with CPs following referral to a parenting intervention group and TD boys recruited from the same schools and geographical regions. Final functional magnetic resonance imaging data were available for 36 TD boys and 57 boys with CPs. Boys with CPs were divided into those whose ASB improved (n = 27) or persisted (n = 30) following the intervention. Functional magnetic resonance imaging data assessing fear reactivity were then analyzed using a longitudinal group (TD/improving CPs/persistent CPs) × time point (pre/post) design. RESULTS Amygdala hypoactivity to fear was observed only in boys with CPs who had persistent ASB and was absent in those whose ASB improved following intervention. CONCLUSIONS Our findings suggest that amygdala hypoactivity to fear is a marker for ASB that is resistant to change following a parenting intervention and a putative target for future treatments.
Collapse
Affiliation(s)
- Arjun Sethi
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Suzanne O'Brien
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom. suzanne.o'
| | - James Blair
- Child and Adolescent Mental Health Centre, Mental Health Services, Copenhagen, Capital Region of Denmark, Denmark
| | - Essi Viding
- Division of Psychology and Language Sciences, University College London, London, United Kingdom
| | - Mitul Mehta
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Christine Ecker
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Nigel Blackwood
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Moira Doolan
- Department of Child and Adolescent Psychiatry, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Marco Catani
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Stephen Scott
- Department of Child and Adolescent Psychiatry, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Declan G M Murphy
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Michael C Craig
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom; National Female Hormone Clinic Maudsley Hospital, London, United Kingdom; National Autism Unit, Bethlem Royal Hospital, London, United Kingdom
| |
Collapse
|
6
|
Griem J, Kolla NJ, Tully J. Key challenges in neurocognitive assessment of individuals with antisocial personality disorder and psychopathy. Front Behav Neurosci 2022; 16:1007121. [PMID: 36119943 PMCID: PMC9478175 DOI: 10.3389/fnbeh.2022.1007121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Accepted: 08/16/2022] [Indexed: 01/10/2023] Open
Affiliation(s)
- Julia Griem
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology, and Neuroscience, King's College London, London, United Kingdom
- *Correspondence: Julia Griem
| | - Nathan J. Kolla
- Department for Psychiatry, University of Toronto, Toronto, ON, Canada
- Research Imaging Centre, Centre for Addiction and Mental Health (CAMH), University of Toronto, Toronto, ON, Canada
- Research and Academics, Division, Waypoint Centre for Mental Health Care, Penetanguishene, ON, Canada
| | - John Tully
- Academic Unit of Mental Health and Clinical Neurosciences, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| |
Collapse
|
7
|
|