Cooperation in animals: toward a game theory within the framework of social competence

Determinants of hyena participation in risky collective action

Collective action problems arise when cooperating individuals suffer costs of cooperation, while the benefits of cooperation are received by both cooperators and defectors. We address this problem using data from spotted hyenas fighting with lions. Lions are much larger and kill many hyenas, so these fights require cooperative mobbing by hyenas for them to succeed. We identify factors that predict when hyena groups engage in cooperative fights with lions, which individuals choose to participate and how the benefits of victory are distributed among cooperators and non-cooperators. We find that cooperative mobbing is better predicted by lower costs (no male lions, more hyenas) than higher benefits (need for food). Individual participation is facilitated by social factors, both over the long term (close kin, social bond strength) and the short term (greeting interactions prior to cooperation). Finally, we find some direct benefits of participation: after cooperation, participants were more likely to feed at contested carcasses than non-participants. Overall, these results are consistent with the hypothesis that, when animals face dangerous cooperative dilemmas, selection favours flexible strategies that are sensitive to dynamic factors emerging over multiple time scales.

Game Theory in Defence Applications: A Review

This paper presents a succinct review of attempts in the literature to use game theory to model decision-making scenarios relevant to defence applications. Game theory has been proven as a very effective tool in modelling the decision-making processes of intelligent agents, entities, and players. It has been used to model scenarios from diverse fields such as economics, evolutionary biology, and computer science. In defence applications, there is often a need to model and predict the actions of hostile actors, and players who try to evade or out-smart each other. Modelling how the actions of competitive players shape the decision making of each other is the forte of game theory. In past decades, there have been several studies that applied different branches of game theory to model a range of defence-related scenarios. This paper provides a structured review of such attempts, and classifies existing literature in terms of the kind of warfare modelled, the types of games used, and the players involved. After careful selection, a total of 29 directly relevant papers are discussed and classified. In terms of the warfares modelled, we recognise that most papers that apply game theory in defence settings are concerned with Command and Control Warfare, and can be further classified into papers dealing with (i) Resource Allocation Warfare (ii) Information Warfare (iii) Weapons Control Warfare, and (iv) Adversary Monitoring Warfare. We also observe that most of the reviewed papers are concerned with sensing, tracking, and large sensor networks, and the studied problems have parallels in sensor network analysis in the civilian domain. In terms of the games used, we classify the reviewed papers into papers that use non-cooperative or cooperative games, simultaneous or sequential games, discrete or continuous games, and non-zero-sum or zero-sum games. Similarly, papers are also classified into two-player, three-player or multi-player game based papers. We also explore the nature of players and the construction of payoff functions in each scenario. Finally, we also identify gaps in literature where game theory could be fruitfully applied in scenarios hitherto unexplored using game theory. The presented analysis provides a concise summary of the state-of-the-art with regards to the use of game theory in defence applications and highlights the benefits and limitations of game theory in the considered scenarios.

Social partner cooperativeness influences brain oxytocin transcription in Trinidadian guppies (Poecilia reticulata)

For non-kin cooperation to be maintained, individuals need to respond adaptively to the cooperative behaviour of their social partners. Currently, however, little is known about the biological responses of individuals to experiencing cooperation. Here, we quantify the neuroregulatory response of Trinidadian guppies (Poecilia reticulata) experiencing cooperation or defection by examining the transcriptional response of the oxytocin gene (oxt; also known as isotocin), which has been implicated in cooperative decision-making. We exposed wild-caught females to social environments where partners either cooperated or defected during predator inspection, or to a control (non-predator inspection) context, and quantified the relative transcription of the oxt gene. We tested an experimental group, originating from a site where individuals are under high predation threat and have previous experience of large aquatic predators (HP), and a control group, where individuals are under low predation threat and naïve to large aquatic predators (LP). LP, but not HP, fish showed different behavioural responses to the behaviour of their social environment, cooperating with cooperative partners and defecting when paired with defecting ones. In HP, but not LP, fish brain mid-section oxt relative transcription varied depending on social partner behaviour. HP fish experiencing cooperation during predator inspection had lower oxt transcription than those experiencing defection. This effect was not present in the control population or in the control context, where the behaviour of social partners did not affect oxt transcription. Our findings provide insight into the neuromodulation underpinning behavioural responses to social experiences, and ultimately to the proximate mechanisms underlying social decision-making.

Social isolation and group size are associated with divergent gene expression in the brain of ant queens

Social life and isolation pose a complex suite of challenges to organisms prompting significant changes in neural state. However, plasticity in how brains respond to social challenges remains largely unexplored. The fire ants Solenopsis invicta provide an ideal scenario for examining this. Fire ant queens may found colonies individually or in groups of up to 30 queens, depending on key factors such as density of newly mated queens and availability of nesting sites. We artificially manipulated availability of nesting sites to test how the brain responds to social versus solitary colony founding at two key timepoints (early vs. late colony founding) and to group size (large vs. small groups). We adopted a powerful neurogenomic approach to identify even subtle differences of gene expression between treatment groups, and we built a global gene co-expression network of the fire ant brain to identify gene modules specifically associated with the different components of the social environment. The difference between group and single founding queens involves only one gene when founding behavior is still plastic and queens can switch from one modality to another, while hundreds of genes are involved later in the process, when behaviors have lost the initial plasticity and are more canalized. Furthermore, we find that large groups are associated with greater changes in gene expression than small groups, showing that even potentially subtle differences in the social environment can be linked to different neurogenomic states.

Shifts in Ecological Dominance between Two Lepidopteran Species in Refuge Areas of Bt Cotton

Simple Summary

Understanding the reasons that substantiate competitive strategies as a result of selective pressure and their consequences for the dynamics of competitors under specific conditions is one of the key issues in Game Theory. Here, we discuss how the adoption of insecticide control in refuge areas and the occurrence of Spodoptera frugiperda and Helicoverpa armigera resistance to insecticides could impact the large-scale production of individuals in refuge areas of Bt cotton in the context of competition dynamics. In view of our results, we emphasize the necessity of carefully managing refuge areas of Bt cotton in agroecosystems that have both S. frugiperda and H. armigera.

Abstract

Competition behavior involving agricultural pest species has long been viewed as a powerful selective force that drives ecological and phenotypic diversity. In this context, a Game Theory-based approach may be useful to describe the decision-making dilemma of a competitor with impacts to guarantee its superiority in terms of ecological dominance or sharing of the food resource with its competitor. In an attempt to elucidate the consequences of competitive dynamics for the ecological dominance of these species in refuge areas of Bt cotton, we conducted a study that was divided into two parts. The first study consisted of an evaluation of interactions involving Spodoptera frugiperda (JE Smith, 1797) and Helicoverpa armigera (Hübner, 1808) on non-Bt cotton plants in a field trial. In the second study, we explored the data matrix collected in the field to parameterize a model of Cellular Automata (CA) with update rules inspired by Game Theory. Computer simulations were analyzed in hypothetical scenarios involving the application (or not) of insecticides in the refuge areas in combination with the resistance factor of one or both pest species to the insecticides used in the refuge areas. H. armigera had superior competitive performance in relation to S. frugiperda only at high densities. According to the density-mediated shift in dominance of the species, the resistance of S. frugiperda to insecticides is seen as a risk factor for the production of susceptible individuals of H. armigera on a large scale in the refuge areas. Additionally, S. frugiperda insecticide resistance may potentially impact the resistance evolution of the H. armigera population to Bt cotton. Thus, ecological dominance could diverge by the presence of a resistance allele to insecticides with interspecific competition perhaps subordinate to evolutionary processes.

Brain morphology predicts social intelligence in wild cleaner fish

It is generally agreed that variation in social and/or environmental complexity yields variation in selective pressures on brain anatomy, where more complex brains should yield increased intelligence. While these insights are based on many evolutionary studies, it remains unclear how ecology impacts brain plasticity and subsequently cognitive performance within a species. Here, we show that in wild cleaner fish (Labroides dimidiatus), forebrain size of high-performing individuals tested in an ephemeral reward task covaried positively with cleaner density, while cerebellum size covaried negatively with cleaner density. This unexpected relationship may be explained if we consider that performance in this task reflects the decision rules that individuals use in nature rather than learning abilities: cleaners with relatively larger forebrains used decision-rules that appeared to be locally optimal. Thus, social competence seems to be a suitable proxy of intelligence to understand individual differences under natural conditions.

Comparing measures of social complexity: larger mountain gorilla groups do not have a greater diversity of relationships

Social complexity reflects the intricate patterns of social interactions in societies. Understanding social complexity is fundamental for studying the evolution of diverse social systems and the cognitive innovations used to cope with the demands of social life. Social complexity has been predominantly quantified by social unit size, but newer measures of social complexity reflect the diversity of relationships. However, the association between these two sets of measures remains unclear. We used 12 years of data on 13 gorilla groups to investigate how measures of social complexity relate to each other. We found that group size was a poor proxy for relationship diversity and that the social complexity individuals experienced within the same group varied greatly. Our findings demonstrate two fundamental takeaways: first, that the number of relationships and the diversity of those relationships represent separate components of social complexity, both of which should be accounted for; and second, that social complexity measured at the group level may not represent the social complexity experienced by individuals in those groups. These findings suggest that comprehensive studies of social complexity, particularly those relating to the social demands faced by individuals, may require fine-scale social data to allow accurate comparisons across populations and species.

Cooperation with closely bonded individuals reduces cortisol levels in long-tailed macaques

Many animal species cooperate with conspecifics in various social contexts. While ultimate causes of cooperation are being studied extensively, its proximate causes, particularly endocrine mechanisms, have received comparatively little attention. Here, we present a study investigating the link between the hormone cortisol, cooperation and social bonds in long-tailed macaques (Macaca fascicularis). We tested 14 macaques in a dyadic cooperation task (loose-string paradigm), each with two partners of different social bond strength and measured their salivary cortisol before and after the task. We found no strong link between the macaques' cortisol level before the task and subsequent cooperative success. By contrast, we did find that the act of cooperating in itself led to a subsequent decrease in cortisol levels, but only when cooperating with closely bonded individuals. Two control conditions showed that this effect was not due to the mere presence of such an individual or the pulling task itself. Consequently, our study shows an intricate way in which the hypothalamic-pituitary-adrenal axis is involved in cooperation. Future studies should reveal whether and how our findings are driven by the anxiolytic effect of oxytocin, which has been associated with social bonding.

Testosterone causes pleiotropic effects on cleanerfish behaviour

Mathematical modelling regarding evolutionary theory typically assumes that optimal strategies are not constrained through mechanistic processes. In contrast, recent studies on brain anatomy and neurobiology suggest that flexibility in social behaviour is rather constrained by the physiological state of the social decision-making network. Changing its state may yield selective advantages in some social contexts but neutral or even detrimental effects in others. Here we provide field evidence for such physiological trade-offs. We subjected wild female cleaner wrasse to injections of testosterone or of saline solution (control) and then observed both intraspecific interactions and interspecific cleaning behaviour with other reef fish, referred to as clients. Testosterone-treated females intensified intraspecific social interactions, showing more aggression towards smaller females and tendencies of increased aggressive and affiliative contacts with dominant males. Such testosterone-mediated changes fit the hypothesis that an increase in testosterone mediates female's focus on status in this protogynous hermaphrodite species, where females eventually change sex to become males. Moreover, we also identified other effects on interspecific social interactions: testosterone-treated females interacted less with client reef fishes and hence obtained less food. Most importantly, they selectively reduced service quality for species that were less likely to punish after being cheated. Overall, our findings suggest that testosterone causes pleiotropic effects on intra and interspecific social behaviour by broadly influencing female cleaners' decision-making.

Female vervet monkeys fine-tune decisions on tolerance versus conflict in a communication network

Group living promotes opportunities for both cooperation and competition. Selection on the ability to cope with such opposing social opportunities has been proposed as a driving force in the evolution of large brains in primates and other social species. However, we still know little about the degree of complexity involved in such social strategies. Here, we report advanced social strategies in wild vervet monkeys. Building on recent experimental evidence that subordinate females trade grooming for tolerance from higher-ranking individuals during foraging activities, we show that the audience composition strongly affects this trade. First, tolerance was lower if the audience contained individuals that outranked the subordinate partner, independently of audience size and kinship relationships. Second, we found a significant interaction between previous grooming and relative rank of bystanders: dominant subjects valued recent grooming by subordinates while intermediate ranked subjects valued the option to aggress subordinate partners in the presence of a dominant audience. Aggressors were also more likely to emit coalition recruitment calls if the audience contained individuals that outranked the subordinate partner. In conclusion, vervet monkeys include both recent grooming and knowledge about third-party relationships to make complex decisions when trading grooming for tolerance, leading to a finely balanced trade-off between reciprocation and opportunities to reinforce rank relationships.

Divergence of developmental trajectories is triggered interactively by early social and ecological experience in a cooperative breeder

Cooperative breeders feature the highest level of social complexity among vertebrates. Environmental constraints foster the evolution of this form of social organization, selecting for both well-developed social and ecological competences. Cooperative breeders pursue one of two alternative social trajectories: delaying reproduction to care for the offspring of dominant breeders or dispersing early to breed independently. It is yet unclear which ecological and social triggers determine the choice between these alternatives and whether diverging developmental trajectories exist in cooperative vertebrates predisposing them to dispersal or philopatry. Here we experimentally reared juveniles of cooperatively breeding cichlid fish by varying the social environment and simulated predation threat in a two-by-two factorial long-term experiment. First, we show that individuals develop specialized behavioral competences, originating already in the early postnatal phase. Second, these specializations predisposed individuals to pursue different developmental trajectories and either to disperse early or to extend philopatry in adulthood. Thus, our results contrast with the proposition that social specializations in early ontogeny should be restricted to eusocial species. Importantly, social and ecological triggers were both required for the generation of divergent life histories. Our results thus confirm recent predictions from theoretical models that organisms should combine relevant information from different environmental cues to develop integrated phenotypes.

Genetics and developmental biology of cooperation

Despite essential progress towards understanding the evolution of cooperative behaviour, we still lack detailed knowledge about its underlying molecular mechanisms, genetic basis, evolutionary dynamics and ontogeny. An international workshop "Genetics and Development of Cooperation," organized by the University of Bern (Switzerland), aimed at discussing the current progress in this research field and suggesting avenues for future research. This review uses the major themes of the meeting as a springboard to synthesize the concepts of genetic and nongenetic inheritance of cooperation, and to review a quantitative genetic framework that allows for the inclusion of indirect genetic effects. Furthermore, we argue that including nongenetic inheritance, such as transgenerational epigenetic effects, parental effects, ecological and cultural inheritance, provides a more nuanced view of the evolution of cooperation. We summarize those genes and molecular pathways in a range of species that seem promising candidates for mechanisms underlying cooperative behaviours. Concerning the neurobiological substrate of cooperation, we suggest three cognitive skills necessary for the ability to cooperate: (i) event memory, (ii) synchrony with others and (iii) responsiveness to others. Taking a closer look at the developmental trajectories that lead to the expression of cooperative behaviours, we discuss the dichotomy between early morphological specialization in social insects and more flexible behavioural specialization in cooperatively breeding vertebrates. Finally, we provide recommendations for which biological systems and species may be particularly suitable, which specific traits and parameters should be measured, what type of approaches should be followed, and which methods should be employed in studies of cooperation to better understand how cooperation evolves and manifests in nature.

Social Decision-Making and the Brain: A Comparative Perspective

The capacity and motivation to be social is a key component of the human adaptive behavioral repertoire. Recent research has identified social behaviors remarkably similar to our own in other animals, including empathy, consolation, cooperation, and strategic deception. Moreover, neurobiological studies in humans, nonhuman primates, and rodents have identified shared brain structures (the so-called 'social brain') apparently specialized to mediate such functions. Neuromodulators may regulate social interactions by 'tuning' the social brain, with important implications for treating social impairments. Here, we survey recent findings in social neuroscience from a comparative perspective, and conclude that the very social behaviors that make us human emerge from mechanisms shared widely with other animals, as well as some that appear to be unique to humans and other primates.

Clark's Nutcrackers (Nucifraga columbiana) Flexibly Adapt Caching Behavior to a Cooperative Context

Corvids recognize when their caches are at risk of being stolen by others and have developed strategies to protect these caches from pilferage. For instance, Clark's nutcrackers will suppress the number of caches they make if being observed by a potential thief. However, cache protection has most often been studied using competitive contexts, so it is unclear whether corvids can adjust their caching in beneficial ways to accommodate non-competitive situations. Therefore, we examined whether Clark's nutcrackers, a non-social corvid, would flexibly adapt their caching behaviors to a cooperative context. To do so, birds were given a caching task during which caches made by one individual were reciprocally exchanged for the caches of a partner bird over repeated trials. In this scenario, if caching behaviors can be flexibly deployed, then the birds should recognize the cooperative nature of the task and maintain or increase caching levels over time. However, if cache protection strategies are applied independent of social context and simply in response to cache theft, then cache suppression should occur. In the current experiment, we found that the birds maintained caching throughout the experiment. We report that males increased caching in response to a manipulation in which caches were artificially added, suggesting the birds could adapt to the cooperative nature of the task. Additionally, we show that caching decisions were not solely due to motivational factors, instead showing an additional influence attributed to the behavior of the partner bird.

Adaptations for social cognition in the primate brain

Studies of the factors affecting reproductive success in group-living monkeys have traditionally focused on competitive traits, like the acquisition of high dominance rank. Recent research, however, indicates that the ability to form cooperative social bonds has an equally strong effect on fitness. Two implications follow. First, strong social bonds make individuals' fitness interdependent and the 'free-rider' problem disappears. Second, individuals must make adaptive choices that balance competition and cooperation-often with the same partners. The proximate mechanisms underlying these behaviours are only just beginning to be understood. Recent results from cognitive and systems neuroscience provide us some evidence that many social and non-social decisions are mediated ultimately by abstract, domain-general neural mechanisms. However, other populations of neurons in the orbitofrontal cortex, striatum, amygdala and parietal cortex specifically encode the type, importance and value of social information. Whether these specialized populations of neurons arise by selection or through developmental plasticity in response to the challenges of social life remains unknown. Many brain areas are homologous and show similar patterns of activity in human and non-human primates. In both groups, cortical activity is modulated by hormones like oxytocin and by the action of certain genes that may affect individual differences in behaviour. Taken together, results suggest that differences in cooperation between the two groups are a matter of degree rather than constituting a fundamental, qualitative distinction.

Social Information Transmission in Animals: Lessons from Studies of Diffusion

The capacity to use information provided by others to guide behavior is a widespread phenomenon in animal societies. A standard paradigm to test if and/or how animals use and transfer social information is through social diffusion experiments, by which researchers observe how information spreads within a group, sometimes by seeding new behavior in the population. In this article, we review the context, methodology and products of such social diffusion experiments. Our major focus is the transmission of information from an individual (or group thereof) to another, and the factors that can enhance or, more interestingly, inhibit it. We therefore also discuss reasons why social transmission sometimes does not occur despite being expected to. We span a full range of mechanisms and processes, from the nature of social information itself and the cognitive abilities of various species, to the idea of social competency and the constraints imposed by the social networks in which animals are embedded. We ultimately aim at a broad reflection on practical and theoretical issues arising when studying how social information spreads within animal groups.

Dopamine disruption increases negotiation for cooperative interactions in a fish

Humans and other animals use previous experiences to make behavioural decisions, balancing the probabilities of receiving rewards or punishments with alternative actions. The dopaminergic system plays a key role in this assessment: for instance, a decrease in dopamine transmission, which is signalled by the failure of an expected reward, may elicit a distinct behavioural response. Here, we tested the effect of exogenously administered dopaminergic compounds on a cooperative vertebrate's decision-making process, in a natural setting. We show, in the Indo-Pacific bluestreak cleaner wrasse Labroides dimidiatus, that blocking dopamine receptors in the wild induces cleaners to initiate more interactions with and to provide greater amounts of physical contact to their client fish partners. This costly form of tactile stimulation using their fins is typically used to prolong interactions and to reconcile with clients after cheating. Interestingly, client jolt rate, a correlate of cheating by cleaners, remained unaffected. Thus, in low effective dopaminergic transmission conditions cleaners may renegotiate the occurrence and duration of the interaction with a costly offer. Our results provide first evidence for a prominent role of the dopaminergic system in decision-making in the context of cooperation in fish.

Why mutual helping in most natural systems is neither conflict-free nor based on maximal conflict

Mutual helping for direct benefits can be explained by various game theoretical models, which differ mainly in terms of the underlying conflict of interest between two partners. Conflict is minimal if helping is self-serving and the partner benefits as a by-product. In contrast, conflict is maximal if partners are in a prisoner's dilemma with both having the pay-off-dominant option of not returning the other's investment. Here, we provide evolutionary and ecological arguments for why these two extremes are often unstable under natural conditions and propose that interactions with intermediate levels of conflict are frequent evolutionary endpoints. We argue that by-product helping is prone to becoming an asymmetric investment game since even small variation in by-product benefits will lead to the evolution of partner choice, leading to investments by the chosen class. Second, iterated prisoner's dilemmas tend to take place in stable social groups where the fitness of partners is interdependent, with the effect that a certain level of helping is self-serving. In sum, intermediate levels of mutual helping are expected in nature, while efficient partner monitoring may allow reaching higher levels.

Tolerance and reward equity predict cooperation in ravens (Corvus corax)

Cooperative decision rules have so far been shown experimentally mainly in mammal species that have variable and complex social networks. However, these traits should not necessarily be restricted to mammals. Therefore, we tested cooperative problem solving in ravens. We showed that, without training, nine ravens spontaneously cooperated in a loose-string task. Corroborating findings in several species, ravens’ cooperative success increased with increasing inter-individual tolerance levels. Importantly, we found this in both a forced dyadic setting, and in a group setting where individuals had an open choice to cooperate with whomever. The ravens, moreover, also paid attention to the resulting reward distribution and ceased cooperation when being cheated upon. Nevertheless, the ravens did not seem to pay attention to the behavior of their partners while cooperating, and future research should reveal whether this is task specific or a general pattern. Given their natural propensity to cooperate and the results we present here, we consider ravens as an interesting model species to study the evolution of, and the mechanisms underlying cooperation.