Cooperation in alternating interactions with memory constraints

A geometric process of evolutionary game dynamics

Many evolutionary processes occur in phenotype spaces which are continuous. It is therefore of interest to explore how selection operates in continuous spaces. One approach is adaptive dynamics, which assumes that mutants are local. Here we study a different process which also allows non-local mutants. We assume that a resident population is challenged by an invader who uses a strategy chosen from a random distribution on the space of all strategies. We study the repeated donation game of direct reciprocity. We consider reactive strategies given by two probabilities, denoting respectively the probability to cooperate after the co-player has cooperated or defected. The strategy space is the unit square. We derive analytic formulae for the stationary distribution of evolutionary dynamics and for the average cooperation rate as function of the cost-to-benefit ratio. For positive reactive strategies, we prove that cooperation is more abundant than defection if the area of the cooperative region is greater than 1/2 which is equivalent to benefit, b, divided by cost, c, exceeding [Formula: see text]. We introduce the concept of strategies that are stable with probability one. We also study an extended process and discuss other games.

Adaptive dynamics of memory-one strategies in the repeated donation game

Human interactions can take the form of social dilemmas: collectively, people fare best if all cooperate but each individual is tempted to free ride. Social dilemmas can be resolved when individuals interact repeatedly. Repetition allows them to adopt reciprocal strategies which incentivize cooperation. The most basic model for direct reciprocity is the repeated donation game, a variant of the prisoner's dilemma. Two players interact over many rounds; in each round they decide whether to cooperate or to defect. Strategies take into account the history of the play. Memory-one strategies depend only on the previous round. Even though they are among the most elementary strategies of direct reciprocity, their evolutionary dynamics has been difficult to study analytically. As a result, much previous work has relied on simulations. Here, we derive and analyze their adaptive dynamics. We show that the four-dimensional space of memory-one strategies has an invariant three-dimensional subspace, generated by the memory-one counting strategies. Counting strategies record how many players cooperated in the previous round, without considering who cooperated. We give a partial characterization of adaptive dynamics for memory-one strategies and a full characterization for memory-one counting strategies.

Mutation enhances cooperation in direct reciprocity

Direct reciprocity is a powerful mechanism for the evolution of cooperation based on repeated interactions between the same individuals. But high levels of cooperation evolve only if the benefit-to-cost ratio exceeds a certain threshold that depends on memory length. For the best-explored case of one-round memory, that threshold is two. Here, we report that intermediate mutation rates lead to high levels of cooperation, even if the benefit-to-cost ratio is only marginally above one, and even if individuals only use a minimum of past information. This surprising observation is caused by two effects. First, mutation generates diversity which undermines the evolutionary stability of defectors. Second, mutation leads to diverse communities of cooperators that are more resilient than homogeneous ones. This finding is relevant because many real-world opportunities for cooperation have small benefit-to-cost ratios, which are between one and two, and we describe how direct reciprocity can attain cooperation in such settings. Our result can be interpreted as showing that diversity, rather than uniformity, promotes evolution of cooperation.

Complex evolutionary interactions in multiple populations

In competitive settings that entail several populations, individuals often engage in intra- and interpopulation interactions that determine their fitness and evolutionary success. With this simple motivation, we here study a multipopulation model where individuals engage in group interactions within their own population and in pairwise interactions with individuals from different populations. We use the evolutionary public goods game and the prisoner's dilemma game to describe these group and pairwise interactions, respectively. We also take into account asymmetry in the extent to which group and pairwise interactions determine the fitness of individuals. We find that interactions across multiple populations reveal new mechanisms through which the evolution of cooperation can be promoted, but this depends on the level of interaction asymmetry. If inter- and intrapopulation interactions are symmetric, the sole presence of multiple populations promotes the evolution of cooperation. Asymmetry in the interactions can further promote cooperation at the expense of the coexistence of the competing strategies. An in-depth analysis of the spatiotemporal dynamics reveals loop-dominated structures and pattern formation that can explain the various evolutionary outcomes. Thus, complex evolutionary interactions in multiple populations reveal an intricate interplay between cooperation and coexistence, and they also open up the path toward further explorations of multipopulation games and biodiversity.

Evolutionary dynamics under partner preferences

The fact that people often have preference rankings for their partners is a distinctive aspect of human behavior. Little is known, however, about how this talent as a powerful force shapes human behavioral traits, including those which should not have been favored by selection, such as cooperation in social dilemma situations. Here we propose a dynamic model in which network-structured individuals can switch their interaction partners within neighborhoods based on their preferences. For the partner switching, we propose two interruption regimes: dictatorial regime and negotiating regime. In the dictatorial regime, focal individuals are able to suspend interactions out of preferences unilaterally. In the negotiating regime, either focal individuals or the associated partners agree to suspend, then these interactions can be successfully suspended. We investigate the evolution of cooperation under both preference-driven partner switching regimes in the context of both the weakened variant of the donation game and the standard one. Specifically, we theoretically approximate the critical conditions for cooperation to be favored by weak selection in the weakened donation game where cooperators bear a unit cost to provide a benefit for each active neighbor and simulate the evolutionary dynamics of cooperation in the standard donation game to test the robustness of the analytical results. Under dictatorial regime, selection of cooperation becomes harder when individuals have preferences for either cooperator or defector partners, implying that the expulsion of defectors by cooperators is overwhelmed by the chasing of defectors towards cooperators. Under negotiating regime, both preferences for cooperator and defector partners can significantly favor the evolution of cooperation, yet underlying mechanisms differ greatly. For preferences over cooperator partners, cooperator-cooperator interaction relationships are reinforced and the associated mutual reciprocity can resist and assimilate defectors. For preferences over defector partners, defector-defector interaction relationships are anchored, weakening defectors' exploitation over cooperators. Cooperators are thus offered much time space to interact among cospecies and spread. Our work may help better understand the critical role of preference-based adaptive partner switching in promoting the evolution of cooperation.

Cooperation in alternating interactions with memory constraints

In repeated social interactions, individuals often employ reciprocal strategies to maintain cooperation. To explore the emergence of reciprocity, many theoretical models assume synchronized decision making. In each round, individuals decide simultaneously whether to cooperate or not. Yet many manifestations of reciprocity in nature are asynchronous. Individuals provide help at one time and receive help at another. Here, we explore such alternating games in which players take turns. We mathematically characterize all Nash equilibria among memory-one strategies. Moreover, we use evolutionary simulations to explore various model extensions, exploring the effect of discounted games, irregular alternation patterns, and higher memory. In all cases, we observe that mutual cooperation still evolves for a wide range of parameter values. However, compared to simultaneous games, alternating games require different strategies to maintain cooperation in noisy environments. Moreover, none of the respective strategies are evolutionarily stable.

In many instances of reciprocity, individuals cooperate in turns. Here, the authors analyze the equilibria and the dynamics of such alternating games, and in particular describe all strategies with one-round memory that maintain cooperation.