1
|
Aster HC, Waltmann M, Busch A, Romanos M, Gamer M, Maria van Noort B, Beck A, Kappel V, Deserno L. Impaired flexible reward learning in ADHD patients is associated with blunted reinforcement sensitivity and neural signals in ventral striatum and parietal cortex. Neuroimage Clin 2024; 42:103588. [PMID: 38471434 PMCID: PMC10943992 DOI: 10.1016/j.nicl.2024.103588] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Revised: 02/06/2024] [Accepted: 02/28/2024] [Indexed: 03/14/2024]
Abstract
Reward-based learning and decision-making are prime candidates to understand symptoms of attention deficit hyperactivity disorder (ADHD). However, only limited evidence is available regarding the neurocomputational underpinnings of the alterations seen in ADHD. This concerns flexible behavioral adaption in dynamically changing environments, which is challenging for individuals with ADHD. One previous study points to elevated choice switching in adolescent ADHD, which was accompanied by disrupted learning signals in medial prefrontal cortex. Here, we investigated young adults with ADHD (n = 17) as compared to age- and sex-matched controls (n = 17) using a probabilistic reversal learning experiment during functional magnetic resonance imaging (fMRI). The task requires continuous learning to guide flexible behavioral adaptation to changing reward contingencies. To disentangle the neurocomputational underpinnings of the behavioral data, we used reinforcement learning (RL) models, which informed the analysis of fMRI data. ADHD patients performed worse than controls particularly in trials before reversals, i.e., when reward contingencies were stable. This pattern resulted from 'noisy' choice switching regardless of previous feedback. RL modelling showed decreased reinforcement sensitivity and enhanced learning rates for negative feedback in ADHD patients. At the neural level, this was reflected in a diminished representation of choice probability in the left posterior parietal cortex in ADHD. Moreover, modelling showed a marginal reduction of learning about the unchosen option, which was paralleled by a marginal reduction in learning signals incorporating the unchosen option in the left ventral striatum. Taken together, we show that impaired flexible behavior in ADHD is due to excessive choice switching ('hyper-flexibility'), which can be detrimental or beneficial depending on the learning environment. Computationally, this resulted from blunted sensitivity to reinforcement of which we detected neural correlates in the attention-control network, specifically in the parietal cortex. These neurocomputational findings remain preliminary due to the relatively small sample size.
Collapse
Affiliation(s)
- Hans-Christoph Aster
- Department of Child and Adolescent Psychiatry, Psychotherapy and Psychosomatics, University Hospital Würzburg, Würzburg, Germany.
| | - Maria Waltmann
- Department of Child and Adolescent Psychiatry, Psychotherapy and Psychosomatics, University Hospital Würzburg, Würzburg, Germany; Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Anika Busch
- Department of Child and Adolescent Psychiatry, Psychotherapy and Psychosomatics, University Hospital Würzburg, Würzburg, Germany
| | - Marcel Romanos
- Department of Child and Adolescent Psychiatry, Psychotherapy and Psychosomatics, University Hospital Würzburg, Würzburg, Germany
| | - Matthias Gamer
- Department of Psychology, University of Würzburg, Würzburg, Germany
| | - Betteke Maria van Noort
- Department of Child and Adolescent Psychiatry, Charité University Medicine, Campus Virchow Klinikum, Berlin, Germany; MSB Medical School Berlin, Department of Psychology, Germany
| | - Anne Beck
- Department of Psychiatry and Neurosciences, Charité University Medicine, Berlin, Germany; Department of Psychology, Faculty of Health, Health and Medical University, Potsdam, Germany
| | - Viola Kappel
- Department of Child and Adolescent Psychiatry, Charité University Medicine, Campus Virchow Klinikum, Berlin, Germany
| | - Lorenz Deserno
- Department of Child and Adolescent Psychiatry, Psychotherapy and Psychosomatics, University Hospital Würzburg, Würzburg, Germany; Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany; Department of Psychiatry and Psychotherapy, Technische Universität Dresden, Dresden, Germany
| |
Collapse
|
2
|
Lage C, Smith ES, Lawson RP. A meta-analysis of cognitive flexibility in autism spectrum disorder. Neurosci Biobehav Rev 2024; 157:105511. [PMID: 38104788 DOI: 10.1016/j.neubiorev.2023.105511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2023] [Revised: 12/04/2023] [Accepted: 12/12/2023] [Indexed: 12/19/2023]
Abstract
Cognitive flexibility is a fundamental process that underlies adaptive behaviour in response to environmental change. Studies examining the profile of cognitive flexibility in autism spectrum disorder (ASD) have reported inconsistent findings. To address whether difficulties with cognitive flexibility are characteristic of autism, we conducted a random-effects meta-analysis and employed subgroup analyses and meta-regression to assess the impact of relevant moderator variables such as task, outcomes, and age. Fifty-nine studies were included and comprised of 2122 autistic individuals without intellectual disabilities and 2036 neurotypical controls, with an age range of 4 to 85 years. The results showed that autistic individuals have greater difficulties with cognitive flexibility, with an overall statistically significant small to moderate effect size. Subgroup analyses revealed a significant difference between task outcomes, with perseverative errors obtaining the largest effect size. In summary, the present meta-analysis highlights the existence of cognitive flexibility difficulties in autistic people, in the absence of learning disabilities, but also that this profile is characterised by substantial heterogeneity. Potential contributing factors are discussed.
Collapse
Affiliation(s)
- Claudia Lage
- Department of Psychology, University of Cambridge, Downing Street, Cambridge CB2 3EB, United Kingdom.
| | - Eleanor S Smith
- Department of Psychology, University of Cambridge, Downing Street, Cambridge CB2 3EB, United Kingdom
| | - Rebecca P Lawson
- Department of Psychology, University of Cambridge, Downing Street, Cambridge CB2 3EB, United Kingdom
| |
Collapse
|
3
|
Melillo R, Leisman G, Machado C, Machado-Ferrer Y, Chinchilla-Acosta M, Melillo T, Carmeli E. The Relationship between Retained Primitive Reflexes and Hemispheric Connectivity in Autism Spectrum Disorders. Brain Sci 2023; 13:1147. [PMID: 37626503 PMCID: PMC10452103 DOI: 10.3390/brainsci13081147] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Revised: 07/20/2023] [Accepted: 07/29/2023] [Indexed: 08/27/2023] Open
Abstract
BACKGROUND Autism Spectrum Disorder (ASD) can be identified by a general tendency toward a reduction in the expression of low-band, widely dispersed integrative activities, which is made up for by an increase in localized, high-frequency, regionally dispersed activity. The study assessed ASD children and adults all possessing retained primitive reflexes (RPRs) compared with a control group that did not attempt to reduce or remove those RPRs and then examined the effects on qEEG and brain network connectivity. METHODS Analysis of qEEG spectral and functional connectivity was performed, to identify associations with the presence or absence of retained primitive reflexes (RPRs), before and after an intervention based on TENS unilateral stimulation. RESULTS The results point to abnormal lateralization in ASD, including long-range underconnectivity, a greater left-over-right qEEG functional connectivity ratio, and short-range overconnectivity in ASD. CONCLUSIONS Clinical improvement and the absence of RPRs may be linked to variations in qEEG frequency bands and more optimized brain networks, resulting in more developmentally appropriate long-range connectivity links, primarily in the right hemisphere.
Collapse
Affiliation(s)
- Robert Melillo
- Movement and Cognition Laboratory, Department of Physical Therapy, University of Haifa, Haifa 3498838, Israel
| | - Gerry Leisman
- Movement and Cognition Laboratory, Department of Physical Therapy, University of Haifa, Haifa 3498838, Israel
- Department of Neurology, University of the Medical Sciences of Havana, Havana 10400, Cuba
| | - Calixto Machado
- Department of Clinical Neurophysiology, Institute for Neurology and Neurosurgery, Havana 10400, Cuba
| | - Yanin Machado-Ferrer
- Department of Clinical Neurophysiology, Institute for Neurology and Neurosurgery, Havana 10400, Cuba
| | | | - Ty Melillo
- Northeast College of the Health Sciences, Seneca Falls, New York, NY 13148, USA
| | - Eli Carmeli
- Movement and Cognition Laboratory, Department of Physical Therapy, University of Haifa, Haifa 3498838, Israel
| |
Collapse
|
4
|
Topel S, Ma I, Sleutels J, van Steenbergen H, de Bruijn ERA, van Duijvenvoorde ACK. Expecting the unexpected: a review of learning under uncertainty across development. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2023:10.3758/s13415-023-01098-0. [PMID: 37237092 PMCID: PMC10390612 DOI: 10.3758/s13415-023-01098-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/28/2023] [Indexed: 05/28/2023]
Abstract
Many of our decisions take place under uncertainty. To successfully navigate the environment, individuals need to estimate the degree of uncertainty and adapt their behaviors accordingly by learning from experiences. However, uncertainty is a broad construct and distinct types of uncertainty may differentially influence our learning. We provide a semi-systematic review to illustrate cognitive and neurobiological processes involved in learning under two types of uncertainty: learning in environments with stochastic outcomes, and with volatile outcomes. We specifically reviewed studies (N = 26 studies) that included an adolescent population, because adolescence is a period in life characterized by heightened exploration and learning, as well as heightened uncertainty due to experiencing many new, often social, environments. Until now, reviews have not comprehensively compared learning under distinct types of uncertainties in this age range. Our main findings show that although the overall developmental patterns were mixed, most studies indicate that learning from stochastic outcomes, as indicated by increased accuracy in performance, improved with age. We also found that adolescents tended to have an advantage compared with adults and children when learning from volatile outcomes. We discuss potential mechanisms explaining these age-related differences and conclude by outlining future research directions.
Collapse
Affiliation(s)
- Selin Topel
- Leiden University, Institute of Psychology, Wassenaarseweg 52, 2333, AK, Leiden, The Netherlands.
- Leiden Institute for Brain and Cognition, Leiden, The Netherlands.
| | - Ili Ma
- Leiden University, Institute of Psychology, Wassenaarseweg 52, 2333, AK, Leiden, The Netherlands
- Leiden Institute for Brain and Cognition, Leiden, The Netherlands
| | - Jan Sleutels
- Leiden University, Institute of Psychology, Wassenaarseweg 52, 2333, AK, Leiden, The Netherlands
- Leiden University, Institute for Philosophy, Leiden, The Netherlands
| | - Henk van Steenbergen
- Leiden University, Institute of Psychology, Wassenaarseweg 52, 2333, AK, Leiden, The Netherlands
- Leiden Institute for Brain and Cognition, Leiden, The Netherlands
| | - Ellen R A de Bruijn
- Leiden University, Institute of Psychology, Wassenaarseweg 52, 2333, AK, Leiden, The Netherlands
- Leiden Institute for Brain and Cognition, Leiden, The Netherlands
| | - Anna C K van Duijvenvoorde
- Leiden University, Institute of Psychology, Wassenaarseweg 52, 2333, AK, Leiden, The Netherlands
- Leiden Institute for Brain and Cognition, Leiden, The Netherlands
| |
Collapse
|
5
|
Wittmann MK, Scheuplein M, Gibbons SG, Noonan MP. Local and global reward learning in the lateral frontal cortex show differential development during human adolescence. PLoS Biol 2023; 21:e3002010. [PMID: 36862726 PMCID: PMC10013901 DOI: 10.1371/journal.pbio.3002010] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Revised: 03/14/2023] [Accepted: 01/20/2023] [Indexed: 03/03/2023] Open
Abstract
Reward-guided choice is fundamental for adaptive behaviour and depends on several component processes supported by prefrontal cortex. Here, across three studies, we show that two such component processes, linking reward to specific choices and estimating the global reward state, develop during human adolescence and are linked to the lateral portions of the prefrontal cortex. These processes reflect the assignment of rewards contingently to local choices, or noncontingently, to choices that make up the global reward history. Using matched experimental tasks and analysis platforms, we show the influence of both mechanisms increase during adolescence (study 1) and that lesions to lateral frontal cortex (that included and/or disconnected both orbitofrontal and insula cortex) in human adult patients (study 2) and macaque monkeys (study 3) impair both local and global reward learning. Developmental effects were distinguishable from the influence of a decision bias on choice behaviour, known to depend on medial prefrontal cortex. Differences in local and global assignments of reward to choices across adolescence, in the context of delayed grey matter maturation of the lateral orbitofrontal and anterior insula cortex, may underlie changes in adaptive behaviour.
Collapse
Affiliation(s)
- Marco K. Wittmann
- Department of Experimental Psychology, University of Oxford, Radcliffe Observatory, Oxford, United Kingdom
- Wellcome Centre for Integrative Neuroimaging, University of Oxford, John Radcliffe Hospital, Headington, Oxford, United Kingdom
- Department of Experimental Psychology, University College London, London, United Kingdom
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, United Kingdom
| | - Maximilian Scheuplein
- Department of Experimental Psychology, University of Oxford, Radcliffe Observatory, Oxford, United Kingdom
- Institute of Education and Child Studies, Leiden University, Leiden, the Netherlands
| | - Sophie G. Gibbons
- Department of Experimental Psychology, University of Oxford, Radcliffe Observatory, Oxford, United Kingdom
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, United Kingdom
| | - MaryAnn P. Noonan
- Department of Experimental Psychology, University of Oxford, Radcliffe Observatory, Oxford, United Kingdom
- Department of Psychology, University of York, York, United Kingdom
- * E-mail:
| |
Collapse
|
6
|
Yurt P, Calapai A, Mundry R, Treue S. Assessing cognitive flexibility in humans and rhesus macaques with visual motion and neutral distractors. Front Psychol 2022; 13:1047292. [PMID: 36605264 PMCID: PMC9807625 DOI: 10.3389/fpsyg.2022.1047292] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2022] [Accepted: 11/29/2022] [Indexed: 12/24/2022] Open
Abstract
Introduction Cognitive flexibility is the ability of an individual to make behavioral adjustments in response to internal and/or external changes. While it has been reported in a wide variety of species, established paradigms to assess cognitive flexibility vary between humans and non-human animals, making systematic comparisons difficult to interpret. Methods We developed a computer-based paradigm to assess cognitive flexibility in humans and non-human primates. Our paradigm (1) uses a classical reversal learning structure in combination with a set-shifting approach (4 stimuli and 3 rules) to assess flexibility at various levels; (2) it employs the use of motion as one of three possible contextual rules; (3) it comprises elements that allow a foraging-like and random interaction, i.e., instances where the animals operate the task without following a strategy, to potentially minimize frustration in favor of a more positive engagement. Results and Discussion We show that motion can be used as a feature dimension (in addition to commonly used shape and color) to assess cognitive flexibility. Due to the way motion is processed in the primate brain, we argue that this dimension is an ideal candidate in situations where a non-binary rule set is needed and where participants might not be able to fully grasp other visual information of the stimulus (e.g., quantity in Wisconsin Card Sorting Test). All participants in our experiment flexibly shifted to and from motion-based rules as well as color- and shape-based rules, but did so with different proficiencies. Overall, we believe that with such approach it is possible to better characterize the evolution of cognitive flexibility in primates, as well as to develop more efficient tools to diagnose and treat various executive function deficits.
Collapse
Affiliation(s)
- Pinar Yurt
- Cognitive Neuroscience Laboratory, German Primate Center, Goettingen, Germany,Georg-August University School of Science, Goettingen, Germany
| | - Antonino Calapai
- Cognitive Neuroscience Laboratory, German Primate Center, Goettingen, Germany,LeibnizScienceCampus Primate Cognition, Goettingen, Germany,*Correspondence: Antonino Calapai,
| | - Roger Mundry
- LeibnizScienceCampus Primate Cognition, Goettingen, Germany,Cognitive Ethology Laboratory, German Primate Center, Leibniz Institute for Primate Research, Goettingen, Germany,Department for Primate Cognition, Georg-August University, Goettingen, Germany
| | - Stefan Treue
- Cognitive Neuroscience Laboratory, German Primate Center, Goettingen, Germany,LeibnizScienceCampus Primate Cognition, Goettingen, Germany
| |
Collapse
|
7
|
Stanton LA, Bridge ES, Huizinga J, Benson-Amram S. Environmental, individual and social traits of free-ranging raccoons influence performance in cognitive testing. J Exp Biol 2022; 225:276535. [PMID: 36137301 PMCID: PMC9637273 DOI: 10.1242/jeb.243726] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Accepted: 07/08/2022] [Indexed: 01/19/2023]
Abstract
Cognitive abilities, such as learning and flexibility, are hypothesized to aid behavioral adaptation to urbanization. Although growing evidence suggests that cognition may indeed facilitate persistence in urban environments, we currently lack knowledge of the cognitive abilities of many urban taxa. Recent methodological advances, including radio frequency identification (RFID), have extended automated cognitive testing into the field but have yet to be applied to a diversity of taxa. Here, we used an RFID-enabled operant conditioning device to assess the habituation, learning and cognitive flexibility of a wild population of raccoons (Procyon lotor). We examined how several biological and behavioral traits influenced participation and performance in testing. We then compared the cognitive performance of wild raccoons tested in natural conditions with that of wild-caught raccoons tested in captivity from a previous study. In natural conditions, juvenile raccoons were more likely to habituate to the testing device, but performed worse in serial reversal learning, compared with adults. We also found that docile raccoons were more likely to learn how to operate the device in natural conditions, which suggests a relationship between emotional reactivity and cognitive ability in raccoons. Although raccoons in both captive and natural conditions demonstrated rapid associative learning and flexibility, raccoons in captive conditions generally performed better, likely owing to the heightened vigilance and social interference experienced by raccoons in natural conditions. Our results have important implications for future research on urban carnivores and cognition in field settings, as well as our understanding of behavioral adaptation to urbanization and coexistence with urban wildlife.
Collapse
Affiliation(s)
- Lauren A Stanton
- Department of Zoology and Physiology, University of Wyoming, Laramie, WY 82071, USA.,Program in Ecology, University of Wyoming, Laramie, WY 82071, USA
| | - Eli S Bridge
- Oklahoma Biological Survey, University of Oklahoma, Norman, OK 73019, USA
| | | | - Sarah Benson-Amram
- Department of Zoology and Physiology, University of Wyoming, Laramie, WY 82071, USA.,Program in Ecology, University of Wyoming, Laramie, WY 82071, USA
| |
Collapse
|
8
|
The Lasting Effects of Early Adversity and Updating Ability on the Tendency to Develop PTSD Symptoms Following Exposure to Trauma in Adulthood. COGNITIVE THERAPY AND RESEARCH 2022. [DOI: 10.1007/s10608-022-10328-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|