Cognitive test batteries in animal cognition research: evaluating the past, present and future of comparative psychometrics

Sex differences in cognitive performance and style across domains in mosquitofish (Gambusia affinis)

Given that the sexes often differ in their ecological and sexual selection pressures, sex differences in cognitive properties are likely. While research on sexually dimorphic cognition often focuses on performance, it commonly overlooks how sexes diverge across cognitive domains and in behaviors exhibited during a cognitive task (cognitive style). We tested male and female western mosquitofish (Gambusia affinis) in three cognitive tasks: associative learning (numerical discrimination), cognitive flexibility (detour task), and spatio-temporal learning (shuttlebox). We characterized statistical relationships between cognitive performances and cognitive style during the associative learning task with measures of anxiety, boldness, exploration, reaction time, and activity. We found sex differences in performance, cognitive style, and the relationships between cognitive domains. Females outperformed males in the spatio-temporal learning task, while the sexes performed equally in associate learning and cognitive flexibility assays. Females (but not males) exhibited a 'fast-exploratory' cognitive style during associative learning trials. Meanwhile, only males showed a significant positive relationship between domains (associative learning and cognitive flexibility). We propose that these sexually dimorphic cognitive traits result from strong sexual conflict in this taxon; and emphasize the need to explore suites of sex-specific cognitive traits and broader comparative work examining sexual selection and cognition.

Kea show three signatures of domain-general statistical inference

One key aspect of domain-general thought is the ability to integrate information across different cognitive domains. Here, we tested whether kea (Nestor notabilis) can use relative quantities when predicting sampling outcomes, and then integrate both physical information about the presence of a barrier, and social information about the biased sampling of an experimenter, into their predictions. Our results show that kea exhibit three signatures of statistical inference, and therefore can integrate knowledge across different cognitive domains to flexibly adjust their predictions of sampling events. This result provides evidence that true statistical inference is found outside of the great apes, and that aspects of domain-general thinking can convergently evolve in brains with a highly different structure from primates. This has important implications not only for our understanding of how intelligence evolves, but also for research focused on how to create artificial domain-general thought processes.

Social learning within and across predator species reduces attacks on novel aposematic prey

To make adaptive foraging decisions, predators need to gather information about the profitability of prey. As well as learning from prey encounters, recent studies show that predators can learn about prey defences by observing the negative foraging experiences of conspecifics. However, predator communities are complex. While observing heterospecifics may increase learning opportunities, we know little about how social information use varies across predator species. Social transmission of avoidance among predators also has potential consequences for defended prey. Conspicuous aposematic prey are assumed to be an easy target for naïve predators, but this cost may be reduced if multiple predators learn by observing single predation events. Heterospecific information use by predators might further benefit aposematic prey, but this remains untested. Here we test conspecific and heterospecific information use across a predator community with wild-caught blue tits (Cyanistes caeruleus) and great tits (Parus major). We used video playback to manipulate social information about novel aposematic prey and then compared birds' foraging choices in 'a small-scale novel world' that contained novel palatable and aposematic prey items. We expected that blue tits would be less likely to use social information compared to great tits. However, we found that both blue tits and great tits consumed fewer aposematic prey after observing a negative foraging experience of a demonstrator. In fact, this effect was stronger in blue tits compared to great tits. Interestingly, blue tits also learned more efficiently from watching conspecifics, whereas great tits learned similarly regardless of the demonstrator species. Together, our results indicate that social transmission about novel aposematic prey occurs in multiple predator species and across species boundaries. This supports the idea that social interactions among predators can reduce attacks on aposematic prey and therefore influence selection for prey defences.

Insects as models for studying the evolution of animal cognition

Research on the evolution of cognition has long centered on vertebrates. Current research indicates that both complex social behavior and ecology influence the evolution of vertebrate cognition. Insects provide a powerful and underappreciated model system for research on cognitive evolution because they are a large group with multiple evolutionary transitions to complex social behavior as well as extensive ecological variation. Here, we integrate current research on cognitive evolution in vertebrates and insects. We specifically highlight recent advances in vertebrate research that are applicable to insects. We focus on two key topics: 1) The challenges of quantifying cognition 2) What factors contribute to the evolution of cognition? Applying methods like comparative analysis and behavioral cognition measurement to insects are likely to provide key insight into the evolution of animal minds.

Heritabilities and co-variation among cognitive traits in red junglefowl

Natural selection can act on between-individual variation in cognitive abilities, yet evolutionary responses depend on the presence of underlying genetic variation. It is, therefore, crucial to determine the relative extent of genetic versus environmental control of these among-individual differences in cognitive traits to understand their causes and evolutionary potential. We investigated heritability of associative learning performance and of a cognitive judgement bias (optimism), as well as their covariation, in a captive pedigree-bred population of red junglefowl (Gallus gallus, n > 300 chicks over 5 years). We analysed performance in discriminative and reversal learning (two facets of associative learning), and cognitive judgement bias, by conducting animal models to disentangle genetic from environmental contributions. We demonstrate moderate heritability for reversal learning, and weak to no heritability for optimism and discriminative learning, respectively. The two facets of associative learning were weakly negatively correlated, consistent with hypothesized trade-offs underpinning individual cognitive styles. Reversal, but not discriminative learning performance, was associated with judgement bias; less optimistic individuals reversed a previously learnt association faster. Together these results indicate that genetic and environmental contributions differ among traits. While modular models of cognitive abilities predict a lack of common genetic control for different cognitive traits, further investigation is required to fully ascertain the degree of covariation between a broader range of cognitive traits and the extent of any shared genetic control.This article is part of the theme issue 'Causes and consequences of individual differences in cognitive abilities'.

Linking cognition with fitness in a wild primate: fitness correlates of problem-solving performance and spatial learning ability

Linking the cognitive performance of wild animals with fitness consequences is crucial for understanding evolutionary processes that shape individual variation in cognition. However, the few studies that have examined these links revealed differing relationships between various cognitive performance measures and fitness proxies. To contribute additional comparative data to this body of research, we linked individual performance during repeated problem-solving and spatial learning ability in a maze with body condition and survival in wild grey mouse lemurs (Microcebus murinus). All four variables exhibited substantial inter-individual variation. Solving efficiency in the problem-solving task, but not spatial learning performance, predicted the magnitude of change in body condition after the harsh dry season, indicating that the ability to quickly apply a newly discovered motor technique might also facilitate exploitation of new, natural food resources. Survival was not linked with performance in both tasks, however, suggesting that mouse lemurs' survival might not depend on the cognitive performances addressed here. Our study is the first linking cognition with fitness proxies in a wild primate species, and our discussion highlights the importance and challenges of accounting for a species' life history and ecology in choosing meaningful cognitive and fitness variables for a study in the wild.This article is part of the theme issue 'Causes and consequences of individual differences in cognitive abilities'.

How does cognition shape social relationships?

The requirements of living in social groups, and forming and maintaining social relationships are hypothesized to be one of the major drivers behind the evolution of cognitive abilities. Most empirical studies investigating the relationships between sociality and cognition compare cognitive performance between species living in systems that differ in social complexity. In this review, we ask whether and how individuals benefit from cognitive skills in their social interactions. Cognitive abilities, such as perception, attention, learning, memory, and inhibitory control, aid in forming and maintaining social relationships. We investigate whether there is evidence that individual variation in these abilities influences individual variation in social relationships. We then consider the evolutionary consequences of the interaction between sociality and cognitive ability to address whether bi-directional relationships exist between the two, such that cognition can both shape and be shaped by social interactions and the social environment. In doing so, we suggest that social network analysis is emerging as a powerful tool that can be used to test for directional causal relationships between sociality and cognition. Overall, our review highlights the importance of investigating individual variation in cognition to understand how it shapes the patterns of social relationships.This article is part of the theme issue 'Causes and consequences of individual differences in cognitive abilities'.

Measuring and understanding individual differences in cognition

Individuals vary in their cognitive performance. While this variation forms the foundation of the study of human psychometrics, its broader importance is only recently being recognized. Explicitly acknowledging this individual variation found in both humans and non-human animals provides a novel opportunity to understand the mechanisms, development and evolution of cognition. The papers in this special issue highlight the growing emphasis on individual cognitive differences from fields as diverse as neurobiology, experimental psychology and evolutionary biology. Here, we synthesize this body of work. We consider the distinct challenges in quantifying individual differences in cognition and provide concrete methodological recommendations. In particular, future studies would benefit from using multiple task variants to ensure they target specific, clearly defined cognitive traits and from conducting repeated testing to assess individual consistency. We then consider how neural, genetic, developmental and behavioural factors may generate individual differences in cognition. Finally, we discuss the potential fitness consequences of individual cognitive variation and place these into an evolutionary framework with testable hypotheses. We intend for this special issue to stimulate researchers to position individual variation at the centre of the cognitive sciences.This article is part of the theme issue 'Causes and consequences of individual differences in cognitive abilities'.

A single factor explanation for associative learning performance on colour discrimination problems in common pheasants (Phasianus colchicus)

It remains unclear whether performance of non-human animals on cognitive test batteries can be explained by domain general cognitive processes, as is found in humans. The persistence of this dispute is likely to stem from a lack of clarity of the psychological or neural processes involved. One broadly accepted cognitive process, that may predict performance in a range of psychometric tasks, is associative learning. We therefore investigated intra-individual performances on tasks that incorporate processes of associative learning, by assessing the speed of acquisition and reversal learning in up to 187 pheasants (Phasianus colchicus) on four related binary colour discrimination tasks. We found a strong, positive significant bivariate relationship between an individual's acquisition and reversal learning performances on one cue set. Weak, positive significant bivariate relationships were also found between an individual's performance on pairs of reversal tasks and between the acquisition and reversal performances on different cue sets. A single factor, robust to parallel analysis, explained 36% of variation in performance across tasks. Inter-individual variation could not be explained by differential prior experience, age, sex or body condition. We propose that a single factor explanation, which we call 'a', summarises the covariance among scores obtained from these visual discrimination tasks, as they all assess capacities for associative learning. We argue that 'a' may represent an underlying cognitive ability exhibited by an individual, which manifests across a variety of tasks requiring associative processes.

More Than Eggs - Relationship Between Productivity and Learning in Laying Hens

The intense selection of chickens for production traits, such as egg laying, is thought to cause undesirable side effects and changes in behavior. Trade-offs resulting from energy expenditure in productivity may influence other traits: in order to sustain energetic costs for high egg production, energy expenditure may be redirected away from specific behavioral traits. For example, such energetic trade-offs may change the hens' cognitive abilities. Therefore, we hypothesized highly productive laying hens to show reduced learning performance in comparison to moderate productive lines. We examined the learning ability of four chicken lines that differed in laying performance (200 versus 300 eggs/year) and phylogenetic origin (brown/white layer; respectively, within performance). In total 61 hens were tested in semi-automated Skinner boxes in a three-phase learning paradigm (initial learning, reversal learning, extinction). To measure the hens' learning performance within each phase, we compared the number of active decisions needed to fulfill a learning criteria (80% correct choices for learning, 70% no responses at extinction) using linear models. Differences between the proportions of hens per line that reached criterion on each phase of the learning tasks were analyzed by using a Kaplan-Meier (KM) survival analysis. A greater proportion of high productive hens achieved the learning criteria on each phase compared to less productive hens (Chi2 3 = 8.25, p = 0.041). Furthermore, high productive hens accomplished the learning criteria after fewer active decisions in the initial phase (p = 0.012) and in extinction (p = 0.004) compared to the less selected lines. Phylogenetic origin was associated with differences in learning in extinction. Our results contradict our hypothesis and indicate that the selection for productivity traits has led to changes in learning behavior and the high productive laying hens possessed a better learning strategy compared to moderate productive hens in a feeding-rewarding context. This better performance may be a response to constraints resulting from high selection as it may enable these hens to efficiently acquire additional energy resources. Underlying mechanisms for this may be directly related to differences in neuronal structure or indirectly to foraging strategies and changes in personality traits such as fearfulness and sociality.

The relationship between learning speed and personality is age- and task-dependent in red junglefowl

Abstract

Cognition is fundamental to animals’ lives and an important source of phenotypic variation. Nevertheless, research on individual variation in animal cognition is still limited. Further, although individual cognitive abilities have been suggested to be linked to personality (i.e., consistent behavioral differences among individuals), few studies have linked performance across multiple cognitive tasks to personality traits. Thus, the interplays between cognition and personality are still unclear. We therefore investigated the relationships between an important aspect of cognition, learning, and personality, by exposing young and adult red junglefowl (Gallus gallus) to multiple learning tasks (discriminative, reversal, and spatial learning) and personality assays (novel arena, novel object, and tonic immobility). Learning speed was not correlated across learning tasks, and learning speed in discrimination and spatial learning tasks did not co-vary with personality. However, learning speed in reversal tasks was associated with individual variation in exploration, and in an age-dependent manner. More explorative chicks learned the reversal task faster than less explorative ones, while the opposite association was found for adult females (learning speed could not be assayed in adult males). In the same reversal tasks, we also observed a sex difference in learning speed of chicks, with females learning faster than males. Our results suggest that the relationship between cognition and personality is complex, as shown by its task- and age-dependence, and encourage further investigation of the causality and dynamics of this relationship.

Significance statement

In the ancestor of today’s chickens, the red junglefowl, we explored how personality and cognition relate by exposing both chicks and adults to several learning tasks and personality assays. Our birds differed in personality and learning speed, while fast learners in one task did not necessarily learn fast in another (i.e., there were no overall “smarter” birds). Exploration correlated with learning speed in the more complex task of reversal learning: faster exploring chicks, but slower exploring adult females, learned faster, compared to less explorative birds. Other aspects of cognition and personality did not correlate. Our results suggest that cognition and personality are related, and that the relationship can differ depending on task and age of the animal.

Electronic supplementary material

The online version of this article (10.1007/s00265-018-2579-2) contains supplementary material, which is available to authorized users.

Comparative psychometrics: establishing what differs is central to understanding what evolves

Cognitive abilities cannot be measured directly. What we can measure is individual variation in task performance. In this paper, we first make the case for why we should be interested in mapping individual differences in task performance onto particular cognitive abilities: we suggest that it is crucial for examining the causes and consequences of variation both within and between species. As a case study, we examine whether multiple measures of inhibitory control for non-human animals do indeed produce correlated task performance; however, no clear pattern emerges that would support the notion of a common cognitive ability underpinning individual differences in performance. We advocate a psychometric approach involving a three-step programme to make theoretical and empirical progress: first, we need tasks that reveal signature limits in performance. Second, we need to assess the reliability of individual differences in task performance. Third, multi-trait multi-method test batteries will be instrumental in validating cognitive abilities. Together, these steps will help us to establish what varies between individuals that could impact their fitness and ultimately shape the course of the evolution of animal minds. Finally, we propose executive functions, including working memory, inhibitory control and attentional shifting, as a sensible starting point for this endeavour.This article is part of the theme issue 'Causes and consequences of individual differences in cognitive abilities'.

Are some individuals generally more behaviorally plastic than others? An experiment with sailfin mollies

Individuals within the same population generally differ among each other not only in their behavioral traits but also in their level of behavioral plasticity (i.e., in their propensity to modify their behavior in response to changing conditions). If the proximate factors underlying individual differences in behavioral plasticity were the same for any measure of plasticity, as commonly assumed, one would expect plasticity to be repeatable across behaviors and contexts. However, this assumption remains largely untested. Here, we conducted an experiment with sailfin mollies (Poecilia latipinna) whose behavioral plasticity was estimated both as the change in their personality traits or mating behavior across a social gradient and using their performance on a reversal-learning task. We found that the correlations between pairwise measures of plasticity were weak and non-significant, thus indicating that the most plastic individuals were not the same in all the tests. This finding might arise because either individuals adjust the magnitude of their behavioral responses depending on the benefits of plasticity, and/or individuals expressing high behavioral plasticity in one context are limited by neural and/or physiological constraints in the amount of plasticity they can express in other contexts. Because the repeatability of behavioral plasticity may have important evolutionary consequences, additional studies are needed to assess the importance of trade-offs between conflicting selection pressures on the maintenance of intra-individual variation in behavioral plasticity.

Intra-individual variation in performance on novel variants of similar tasks influences single factor explanations of general cognitive processes

Intra-individual variation in performance within and across cognitive domains may confound interpretations of both domain-general and domain-specific abilities. Such variation is rarely considered in animal test batteries. We investigate individual consistency in performance by presenting pheasant chicks (n = 31), raised under standardized conditions, with nine different cognitive tasks. Among these tasks were two replicated novel variants of colour learning and colour reversal problems, tests of positional learning and memory, as well as two different tasks that captured multiple putative measures of inhibitory control and motor-related performance. These task variants were also used to compare subjects' performance on alternative test batteries comprised of different task combinations. Subjects' performance improved with experience, yet we found relatively little consistency in their performance, both within similar tasks using different paradigms and across different tasks. Parallel analysis revealed non-significant factors when all nine tasks were included in a principal axis factor analysis. However, when different combinations of six of the nine tasks were included in principal axis factoring, 14 of 84 combinations revealed significant main factors, explaining between 28 and 35% of the variance in task performance. While comparable findings have been suggested to reflect domain-general intelligence in other species, we found no evidence to suggest that a single factor encompassed a diverse range of cognitive abilities in pheasants. Instead, we reveal how single factor explanations of cognitive processes can be influenced by test battery composition and intra-individual variation in performance across tasks. Our findings highlight the importance of conducting multiple tests within specific domains to ensure robust cognitive measures are obtained.

Self-Control in Chimpanzees Relates to General Intelligence

For humans, there appears to be a clear link between general intelligence and self-control behavior, such as sustained delay of gratification [1-9]. Chimpanzees also delay gratification [10-12] and can be given tests of general intelligence (g) [13-15], but these two constructs have never been compared within the same sample of nonhuman animals. We presented 40 chimpanzees with the hybrid delay task (HDT) [16, 17], which measures inter-temporal choices and the capacity for sustained delay of gratification, and the primate cognitive test battery (PCTB), which measures g in chimpanzees [13-15]. Importantly, none of the sub-tasks in the PCTB directly assesses self-control or other forms of behavioral inhibition. Rather, they assess areas of physical cognition (e.g., quantity discrimination) or social cognition (e.g., gaze following). In three phases of testing, we consistently found that the strongest relation was between chimpanzee g scores and efficiency in the HDT. Chimpanzee g was not most closely related to the proportion of trials the chimpanzees chose to try to wait for delayed rewards, but rather most closely related to how good they were at waiting for those rewards when they chose to do so. We also found the same strong relation between HDT efficiency and those factors in the PCTB that loaded most strongly on chimpanzee g. These results highlight that, as with humans, there is a strong relation between chimpanzees' self-control and overall intelligence-a relation that likely reflects the role of successful inhibitory control during cognitive processing of information and intelligent decision-making.