Task-dependent reversal learning dynamics challenge the reversal paradigm of measuring cognitive flexibility

Social demonstration of colour preference improves the learning of associated demonstrated actions

We studied how different types of social demonstration improve house sparrows' (Passer domesticus) success in solving a foraging task that requires both operant learning (opening covers) and discrimination learning (preferring covers of the rewarding colour). We provided learners with either paired demonstration (of both cover opening and colour preference), action-only demonstration (of opening white covers only), or no demonstration (a companion bird eating without covers). We found that sparrows failed to learn the two tasks with no demonstration, and learned them best with a paired demonstration. Interestingly, the action of cover opening was learned faster with paired rather than action-only demonstration despite being equally demonstrated in both. We also found that only with paired demonstration, the speed of operant (action) learning was related to the demonstrator's level of activity. Colour preference (i.e. discrimination learning) was eventually acquired by all sparrows that learned to open covers, even without social demonstration of colour preference. Thus, adding a demonstration of colour preference was actually more important for operant learning, possibly as a result of increasing the similarity between the demonstrated and the learned tasks, thereby increasing the learner's attention to the actions of the demonstrator. Giving more attention to individuals in similar settings may be an adaptive strategy directing social learners to focus on ecologically relevant behaviours and on tasks that are likely to be learned successfully.

Risk-sensitive learning is a winning strategy for leading an urban invasion

In the unpredictable Anthropocene, a particularly pressing open question is how certain species invade urban environments. Sex-biased dispersal and learning arguably influence movement ecology, but their joint influence remains unexplored empirically, and might vary by space and time. We assayed reinforcement learning in wild-caught, temporarily captive core-, middle-, or edge-range great-tailed grackles-a bird species undergoing urban-tracking rapid range expansion, led by dispersing males. We show, across populations, both sexes initially perform similarly when learning stimulus-reward pairings, but, when reward contingencies reverse, male-versus female-grackles finish 'relearning' faster, making fewer choice-option switches. How do male grackles do this? Bayesian cognitive modelling revealed male grackles' choice behaviour is governed more strongly by the 'weight' of relative differences in recent foraging payoffs-i.e., they show more pronounced risk-sensitive learning. Confirming this mechanism, agent-based forward simulations of reinforcement learning-where we simulate 'birds' based on empirical estimates of our grackles' reinforcement learning-replicate our sex-difference behavioural data. Finally, evolutionary modelling revealed natural selection should favour risk-sensitive learning in hypothesised urban-like environments: stable but stochastic settings. Together, these results imply risk-sensitive learning is a winning strategy for urban-invasion leaders, underscoring the potential for life history and cognition to shape invasion success in human-modified environments.

Artificial selection for reversal learning reveals limited repeatability and no heritability of cognitive flexibility in great tits (Parus major)

Cognitive flexibility controls how animals respond to changing environmental conditions. Individuals within species vary considerably in cognitive flexibility but the micro-evolutionary potential in animal populations remains enigmatic. One prerequisite for cognitive flexibility to be able to evolve is consistent and heritable among-individual variation. Here we determine the repeatability and heritability of cognitive flexibility among great tits (Parus major) by performing an artificial selection experiment on reversal learning performance using a spatial learning paradigm over three generations. We found low, yet significant, repeatability (R = 0.15) of reversal learning performance. Our artificial selection experiment showed no evidence for narrow-sense heritability of associative or reversal learning, while we confirmed the heritability of exploratory behaviour. We observed a phenotypic, but no genetic, correlation between associative and reversal learning, showing the importance of prior information on reversal learning. We found no correlation between cognitive and personality traits. Our findings emphasize that cognitive flexibility is a multi-faceted trait that is affected by memory and prior experience, making it challenging to retrieve reliable values of temporal consistency and assess the contribution of additive genetic variation. Future studies need to identify what cognitive components underlie variation in reversal learning and study their between-individual and additive genetic components.

Increased initial task difficulty drives social foragers to develop sub-optimal conformity instead of adaptive diversity

The extent to which animal societies exhibit social conformity as opposed to behavioural diversity is commonly attributed to adaptive learning strategies. Less attention is given to the possibility that the relative difficulty of learning a task socially as opposed to individually can be critical for social learning dynamics. Here we show that by raising initial task difficulty, house sparrows previously shown to exhibit adaptive social diversity become predominantly conformists. The task we used required opening feeding well covers (easier to learn socially) and to choose the covers with the rewarding cues (easy to learn individually). We replicated a previous study where sparrows exhibited adaptive diversity, but did not pre-train the naive sparrows to open covers, making the task initially more difficult. In sharp contrast to the previous study results, most sparrows continued to conform to the demonstrated cue even after experiencing greater success with the alternative rewarding cue for which competition was less intense. Thus, our study shows that a task's cognitive demands, such as the initial dependency on social demonstration, can change the entire learning dynamics, causing social animals to exhibit sub-optimal social conformity rather than adaptive diversity under otherwise identical conditions.

Assessing cognitive flexibility in humans and rhesus macaques with visual motion and neutral distractors

Introduction

Cognitive flexibility is the ability of an individual to make behavioral adjustments in response to internal and/or external changes. While it has been reported in a wide variety of species, established paradigms to assess cognitive flexibility vary between humans and non-human animals, making systematic comparisons difficult to interpret.

Methods

We developed a computer-based paradigm to assess cognitive flexibility in humans and non-human primates. Our paradigm (1) uses a classical reversal learning structure in combination with a set-shifting approach (4 stimuli and 3 rules) to assess flexibility at various levels; (2) it employs the use of motion as one of three possible contextual rules; (3) it comprises elements that allow a foraging-like and random interaction, i.e., instances where the animals operate the task without following a strategy, to potentially minimize frustration in favor of a more positive engagement.

Results and Discussion

We show that motion can be used as a feature dimension (in addition to commonly used shape and color) to assess cognitive flexibility. Due to the way motion is processed in the primate brain, we argue that this dimension is an ideal candidate in situations where a non-binary rule set is needed and where participants might not be able to fully grasp other visual information of the stimulus (e.g., quantity in Wisconsin Card Sorting Test). All participants in our experiment flexibly shifted to and from motion-based rules as well as color- and shape-based rules, but did so with different proficiencies. Overall, we believe that with such approach it is possible to better characterize the evolution of cognitive flexibility in primates, as well as to develop more efficient tools to diagnose and treat various executive function deficits.

Learning with lacertids: Studying the link between ecology and cognition within a comparative framework

Cognition is an essential tool for animals to deal with environmental challenges. Nonetheless, the ecological forces driving the evolution of cognition throughout the animal kingdom remain enigmatic. Large-scale comparative studies on multiple species and cognitive traits have been advanced as the best way to facilitate our understanding of cognitive evolution, but such studies are rare. Here, we tested 13 species of lacertid lizards (Reptilia: Lacertidae) using a battery of cognitive tests measuring inhibitory control, problem-solving, and spatial and reversal learning. Next, we tested the relationship between species' performance and (a) resource availability (temperature and precipitation), habitat complexity (Normalized Difference Vegetation Index), and habitat variability (seasonality) in their natural habitat and (b) their life history (size at hatching and maturity, clutch size, and frequency). Although species differed markedly in their cognitive abilities, such variation was mostly unrelated to their ecology and life history. Yet, species living in more variable environments exhibited lower behavioral flexibility, likely due to energetic constrains in such habitats. Our standardized protocols provide opportunities for collaborative research, allowing increased sample sizes and replication, essential for moving forward in the field of comparative cognition. Follow-up studies could include more detailed measures of habitat structure and look at other potential selective drivers such as predation.

House sparrows use learned information selectively based on whether reward is hidden or visible

Based on past experience, food-related-cues can help foragers to predict the presence and the expected quality of food. However, when the food is already visible there is no need to predict its presence or its other visible attributes, but only those that are still cryptic, such as expected handling time or taste. Optimal foragers should therefore use only knowledge that is relevant to the current setting. Nevertheless, the extent to which they do so is not clear. In a set of experiments, we examined how a change in setting, from hidden to visible reward, affects the reliance of house sparrows (Passer domesticus) on three previously learned attributes of food-related cues (sand colors): the setting of the cue (e.g., whether the food was hidden or exposed), the expected amount of the reward (number of seeds), and the expected handling time. We found that sparrows used all three attributes when the rewards were hidden but reached decisions mainly based on handling time when the rewards were visible. This selective use of cue-related information suggests that animals do not simply associate cues with their average expected value but rather learn different attributes of a cue and use all, or only some of them, in a context-appropriate manner.