Developmental Differences in Probabilistic Reversal Learning: A Computational Modeling Approach

Preschoolers use probabilistic evidence to flexibly change or maintain expectations on an active search task

This study investigated 3- to 5-year-olds' (N = 64, 37 girls, 62.5% White, data collected between 2021-2022) ability to use probabilistic information gleaned through active search to appropriately change or maintain expectations. In an online fishing game, children first learned that one of two ponds was good for catching fish. During a subsequent testing phase, children searched the ponds for fish. Half saw outcomes that were probabilistically consistent with training, and the other half saw outcomes that were probabilistically inconsistent. Children in the Inconsistent condition adapted their search strategies, showing evidence of changing their expectations. Those in the Consistent condition maintained their initial search strategy. Trial-by-trial analyses suggested that children used a combination of heuristic and information integration strategies to guide their search behavior.

A Novel Battery to Assess "Cool" and "Hot" Executive Functions: Sensitivity to Age Differences in Middle Childhood

The main goal of the current work was to assess the age sensitivity of a novel battery of cool and hot Executive Function (EF) tasks developed for the middle childhood period: the Executive Brain Battery (EBB). To this end, we carried out a first study in which the EBB was administered to six age groups ranging from 6 to 11. Additionally, in a second study, we compared children at the end of middle childhood (age 11 years) and adult performance in the EBB. Results showed that tasks included in the EBB were suitable for all age groups, with more age-related changes being found in cool than hot EF tasks. Moreover, at the end of middle childhood, children reach an adult-like performance in most of these cool and hot tasks. The present findings extend previous research suggesting that cool and hot EFs exhibit different patterns of age-related growth in middle childhood. Additionally, the EEB could become a useful tool for research on EFs during middle childhood that could be adapted for a wide range of populations.

Impaired flexible reward learning in ADHD patients is associated with blunted reinforcement sensitivity and neural signals in ventral striatum and parietal cortex

Reward-based learning and decision-making are prime candidates to understand symptoms of attention deficit hyperactivity disorder (ADHD). However, only limited evidence is available regarding the neurocomputational underpinnings of the alterations seen in ADHD. This concerns flexible behavioral adaption in dynamically changing environments, which is challenging for individuals with ADHD. One previous study points to elevated choice switching in adolescent ADHD, which was accompanied by disrupted learning signals in medial prefrontal cortex. Here, we investigated young adults with ADHD (n = 17) as compared to age- and sex-matched controls (n = 17) using a probabilistic reversal learning experiment during functional magnetic resonance imaging (fMRI). The task requires continuous learning to guide flexible behavioral adaptation to changing reward contingencies. To disentangle the neurocomputational underpinnings of the behavioral data, we used reinforcement learning (RL) models, which informed the analysis of fMRI data. ADHD patients performed worse than controls particularly in trials before reversals, i.e., when reward contingencies were stable. This pattern resulted from 'noisy' choice switching regardless of previous feedback. RL modelling showed decreased reinforcement sensitivity and enhanced learning rates for negative feedback in ADHD patients. At the neural level, this was reflected in a diminished representation of choice probability in the left posterior parietal cortex in ADHD. Moreover, modelling showed a marginal reduction of learning about the unchosen option, which was paralleled by a marginal reduction in learning signals incorporating the unchosen option in the left ventral striatum. Taken together, we show that impaired flexible behavior in ADHD is due to excessive choice switching ('hyper-flexibility'), which can be detrimental or beneficial depending on the learning environment. Computationally, this resulted from blunted sensitivity to reinforcement of which we detected neural correlates in the attention-control network, specifically in the parietal cortex. These neurocomputational findings remain preliminary due to the relatively small sample size.

A meta-analysis of cognitive flexibility in autism spectrum disorder

Cognitive flexibility is a fundamental process that underlies adaptive behaviour in response to environmental change. Studies examining the profile of cognitive flexibility in autism spectrum disorder (ASD) have reported inconsistent findings. To address whether difficulties with cognitive flexibility are characteristic of autism, we conducted a random-effects meta-analysis and employed subgroup analyses and meta-regression to assess the impact of relevant moderator variables such as task, outcomes, and age. Fifty-nine studies were included and comprised of 2122 autistic individuals without intellectual disabilities and 2036 neurotypical controls, with an age range of 4 to 85 years. The results showed that autistic individuals have greater difficulties with cognitive flexibility, with an overall statistically significant small to moderate effect size. Subgroup analyses revealed a significant difference between task outcomes, with perseverative errors obtaining the largest effect size. In summary, the present meta-analysis highlights the existence of cognitive flexibility difficulties in autistic people, in the absence of learning disabilities, but also that this profile is characterised by substantial heterogeneity. Potential contributing factors are discussed.

The Relationship between Retained Primitive Reflexes and Hemispheric Connectivity in Autism Spectrum Disorders

BACKGROUND

Autism Spectrum Disorder (ASD) can be identified by a general tendency toward a reduction in the expression of low-band, widely dispersed integrative activities, which is made up for by an increase in localized, high-frequency, regionally dispersed activity. The study assessed ASD children and adults all possessing retained primitive reflexes (RPRs) compared with a control group that did not attempt to reduce or remove those RPRs and then examined the effects on qEEG and brain network connectivity.

METHODS

Analysis of qEEG spectral and functional connectivity was performed, to identify associations with the presence or absence of retained primitive reflexes (RPRs), before and after an intervention based on TENS unilateral stimulation.

RESULTS

The results point to abnormal lateralization in ASD, including long-range underconnectivity, a greater left-over-right qEEG functional connectivity ratio, and short-range overconnectivity in ASD.

CONCLUSIONS

Clinical improvement and the absence of RPRs may be linked to variations in qEEG frequency bands and more optimized brain networks, resulting in more developmentally appropriate long-range connectivity links, primarily in the right hemisphere.

Expecting the unexpected: a review of learning under uncertainty across development

Many of our decisions take place under uncertainty. To successfully navigate the environment, individuals need to estimate the degree of uncertainty and adapt their behaviors accordingly by learning from experiences. However, uncertainty is a broad construct and distinct types of uncertainty may differentially influence our learning. We provide a semi-systematic review to illustrate cognitive and neurobiological processes involved in learning under two types of uncertainty: learning in environments with stochastic outcomes, and with volatile outcomes. We specifically reviewed studies (N = 26 studies) that included an adolescent population, because adolescence is a period in life characterized by heightened exploration and learning, as well as heightened uncertainty due to experiencing many new, often social, environments. Until now, reviews have not comprehensively compared learning under distinct types of uncertainties in this age range. Our main findings show that although the overall developmental patterns were mixed, most studies indicate that learning from stochastic outcomes, as indicated by increased accuracy in performance, improved with age. We also found that adolescents tended to have an advantage compared with adults and children when learning from volatile outcomes. We discuss potential mechanisms explaining these age-related differences and conclude by outlining future research directions.

Local and global reward learning in the lateral frontal cortex show differential development during human adolescence

Reward-guided choice is fundamental for adaptive behaviour and depends on several component processes supported by prefrontal cortex. Here, across three studies, we show that two such component processes, linking reward to specific choices and estimating the global reward state, develop during human adolescence and are linked to the lateral portions of the prefrontal cortex. These processes reflect the assignment of rewards contingently to local choices, or noncontingently, to choices that make up the global reward history. Using matched experimental tasks and analysis platforms, we show the influence of both mechanisms increase during adolescence (study 1) and that lesions to lateral frontal cortex (that included and/or disconnected both orbitofrontal and insula cortex) in human adult patients (study 2) and macaque monkeys (study 3) impair both local and global reward learning. Developmental effects were distinguishable from the influence of a decision bias on choice behaviour, known to depend on medial prefrontal cortex. Differences in local and global assignments of reward to choices across adolescence, in the context of delayed grey matter maturation of the lateral orbitofrontal and anterior insula cortex, may underlie changes in adaptive behaviour.

Assessing cognitive flexibility in humans and rhesus macaques with visual motion and neutral distractors

Introduction

Cognitive flexibility is the ability of an individual to make behavioral adjustments in response to internal and/or external changes. While it has been reported in a wide variety of species, established paradigms to assess cognitive flexibility vary between humans and non-human animals, making systematic comparisons difficult to interpret.

Methods

We developed a computer-based paradigm to assess cognitive flexibility in humans and non-human primates. Our paradigm (1) uses a classical reversal learning structure in combination with a set-shifting approach (4 stimuli and 3 rules) to assess flexibility at various levels; (2) it employs the use of motion as one of three possible contextual rules; (3) it comprises elements that allow a foraging-like and random interaction, i.e., instances where the animals operate the task without following a strategy, to potentially minimize frustration in favor of a more positive engagement.

Results and Discussion

We show that motion can be used as a feature dimension (in addition to commonly used shape and color) to assess cognitive flexibility. Due to the way motion is processed in the primate brain, we argue that this dimension is an ideal candidate in situations where a non-binary rule set is needed and where participants might not be able to fully grasp other visual information of the stimulus (e.g., quantity in Wisconsin Card Sorting Test). All participants in our experiment flexibly shifted to and from motion-based rules as well as color- and shape-based rules, but did so with different proficiencies. Overall, we believe that with such approach it is possible to better characterize the evolution of cognitive flexibility in primates, as well as to develop more efficient tools to diagnose and treat various executive function deficits.

Environmental, individual and social traits of free-ranging raccoons influence performance in cognitive testing

Cognitive abilities, such as learning and flexibility, are hypothesized to aid behavioral adaptation to urbanization. Although growing evidence suggests that cognition may indeed facilitate persistence in urban environments, we currently lack knowledge of the cognitive abilities of many urban taxa. Recent methodological advances, including radio frequency identification (RFID), have extended automated cognitive testing into the field but have yet to be applied to a diversity of taxa. Here, we used an RFID-enabled operant conditioning device to assess the habituation, learning and cognitive flexibility of a wild population of raccoons (Procyon lotor). We examined how several biological and behavioral traits influenced participation and performance in testing. We then compared the cognitive performance of wild raccoons tested in natural conditions with that of wild-caught raccoons tested in captivity from a previous study. In natural conditions, juvenile raccoons were more likely to habituate to the testing device, but performed worse in serial reversal learning, compared with adults. We also found that docile raccoons were more likely to learn how to operate the device in natural conditions, which suggests a relationship between emotional reactivity and cognitive ability in raccoons. Although raccoons in both captive and natural conditions demonstrated rapid associative learning and flexibility, raccoons in captive conditions generally performed better, likely owing to the heightened vigilance and social interference experienced by raccoons in natural conditions. Our results have important implications for future research on urban carnivores and cognition in field settings, as well as our understanding of behavioral adaptation to urbanization and coexistence with urban wildlife.