Direct reciprocity on graphs

Evolution of reciprocity with limited payoff memory

Direct reciprocity is a mechanism for the evolution of cooperation in repeated social interactions. According to the literature, individuals naturally learn to adopt conditionally cooperative strategies if they have multiple encounters with their partner. Corresponding models have greatly facilitated our understanding of cooperation, yet they often make strong assumptions on how individuals remember and process payoff information. For example, when strategies are updated through social learning, it is commonly assumed that individuals compare their average payoffs. This would require them to compute (or remember) their payoffs against everyone else in the population. To understand how more realistic constraints influence direct reciprocity, we consider the evolution of conditional behaviours when individuals learn based on more recent experiences. Even in the most extreme case that they only take into account their very last interaction, we find that cooperation can still evolve. However, such individuals adopt less generous strategies, and they cooperate less often than in the classical setup with average payoffs. Interestingly, once individuals remember the payoffs of two or three recent interactions, cooperation rates quickly approach the classical limit. These findings contribute to a literature that explores which kind of cognitive capabilities are required for reciprocal cooperation. While our results suggest that some rudimentary form of payoff memory is necessary, it suffices to remember a few interactions.

Grouping promotes both partnership and rivalry with long memory in direct reciprocity

Biological and social scientists have long been interested in understanding how to reconcile individual and collective interests in the iterated Prisoner's Dilemma. Many effective strategies have been proposed, and they are often categorized into one of two classes, 'partners' and 'rivals.' More recently, another class, 'friendly rivals,' has been identified in longer-memory strategy spaces. Friendly rivals qualify as both partners and rivals: They fully cooperate with themselves, like partners, but never allow their co-players to earn higher payoffs, like rivals. Although they have appealing theoretical properties, it is unclear whether they would emerge in an evolving population because most previous works focus on the memory-one strategy space, where no friendly rival strategy exists. To investigate this issue, we have conducted evolutionary simulations in well-mixed and group-structured populations and compared the evolutionary dynamics between memory-one and longer-memory strategy spaces. In a well-mixed population, the memory length does not make a major difference, and the key factors are the population size and the benefit of cooperation. Friendly rivals play a minor role because being a partner or a rival is often good enough in a given environment. It is in a group-structured population that memory length makes a stark difference: When longer-memory strategies are available, friendly rivals become dominant, and the cooperation level nearly reaches a maximum, even when the benefit of cooperation is so low that cooperation would not be achieved in a well-mixed population. This result highlights the important interaction between group structure and memory lengths that drive the evolution of cooperation.

The evolution of indirect reciprocity under action and assessment generosity

Indirect reciprocity is a mechanism for the evolution of cooperation based on social norms. This mechanism requires that individuals in a population observe and judge each other's behaviors. Individuals with a good reputation are more likely to receive help from others. Previous work suggests that indirect reciprocity is only effective when all relevant information is reliable and publicly available. Otherwise, individuals may disagree on how to assess others, even if they all apply the same social norm. Such disagreements can lead to a breakdown of cooperation. Here we explore whether the predominantly studied 'leading eight' social norms of indirect reciprocity can be made more robust by equipping them with an element of generosity. To this end, we distinguish between two kinds of generosity. According to assessment generosity, individuals occasionally assign a good reputation to group members who would usually be regarded as bad. According to action generosity, individuals occasionally cooperate with group members with whom they would usually defect. Using individual-based simulations, we show that the two kinds of generosity have a very different effect on the resulting reputation dynamics. Assessment generosity tends to add to the overall noise and allows defectors to invade. In contrast, a limited amount of action generosity can be beneficial in a few cases. However, even when action generosity is beneficial, the respective simulations do not result in full cooperation. Our results suggest that while generosity can favor cooperation when individuals use the most simple strategies of reciprocity, it is disadvantageous when individuals use more complex social norms.

A game-theoretical dynamic imitation model on networks

A game-theoretical model is constructed to capture the effect of imitation on the evolution of cooperation. This imitation describes the case where successful individuals are more likely to be imitated by newcomers who will employ their strategies and social networks. Two classical repeated strategies 'always defect (ALLD)' and 'tit-for-tat (TFT)' are adopted. Mathematical analyses are mainly conducted by the method of coalescence theory. Under the assumption of a large population size and weak selection, the results show that the evolution of cooperation is promoted in this dynamic network. As we observed that the critical benefit-to-cost ratio is smaller compared to that in well-mixed populations. The critical benefit-to-cost ratio approaches a specific value which depends on three parameters, the repeated rounds of the game, the effective strategy mutation rate, and the effective link mutation rate. Specifically, for a very high value of the effective link mutation rate, the critical benefit-to-cost ratio approaches 1. Remarkably, for a low value of the effective link mutation rate, by letting the effective strategy mutation is nearly equal to zero, the critical benefit-to-cost ratio approaches [Formula: see text] for the resulting highly connected networks, which allows TFT to be evolutionary stable. It illustrates that dominance of TFTs is associated with more connected networks. This research can enrich the theory of the coevolution of game strategy and network structure with dynamic imitation.

Trinidadian guppies use a social heuristic that can support cooperation among non-kin

Cooperation among non-kin is well documented in humans and widespread in non-human animals, but explaining the occurrence of cooperation in the absence of inclusive fitness benefits has proven a significant challenge. Current theoretical explanations converge on a single point: cooperators can prevail when they cluster in social space. However, we know very little about the real-world mechanisms that drive such clustering, particularly in systems where cognitive limitations make it unlikely that mechanisms such as score keeping and reputation are at play. Here, we show that Trinidadian guppies (Poecilia reticulata) use a 'walk away' strategy, a simple social heuristic by which assortment by cooperativeness can come about among mobile agents. Guppies cooperate during predator inspection and we found that when experiencing defection in this context, individuals prefer to move to a new social environment, despite having no prior information about this new social group. Our results provide evidence in non-human animals that individuals use a simple social partner updating strategy in response to defection, supporting theoretical work applying heuristics to understanding the proximate mechanisms underpinning the evolution of cooperation among non-kin.

A Review of Theoretical Studies on Indirect Reciprocity

Despite the accumulation of research on indirect reciprocity over the past 30 years and the publication of over 100,000 related papers, there are still many issues to be addressed. Here, we look back on the research that has been done on indirect reciprocity and identify the issues that have been resolved and the ones that remain to be resolved. This manuscript introduces indirect reciprocity in the context of the evolution of cooperation, basic models of social dilemma situations, the path taken in the elaboration of mathematical analysis using evolutionary game theory, the discovery of image scoring norms, and the breakthroughs brought about by the analysis of the evolutionary instability of the norms. Moreover, it presents key results obtained by refining the assessment function, resolving the punishment dilemma, and presenting a complete solution to the social dilemma problem. Finally, it discusses the application of indirect reciprocity in various disciplines.

Direct Reciprocity and Model-Predictive Strategy Update Explain the Network Reciprocity Observed in Socioeconomic Networks

Network reciprocity has been successfully put forward (since M. A. Nowak and R. May’s, 1992, influential paper) as the simplest mechanism—requiring no strategical complexity—supporting the evolution of cooperation in biological and socioeconomic systems. The mechanism is actually the network, which makes agents’ interactions localized, while network reciprocity is the property of the underlying evolutionary process to favor cooperation in sparse rather than dense networks. In theoretical models, the property holds under imitative evolutionary processes, whereas cooperation disappears in any network if imitation is replaced by the more rational best-response rule of strategy update. In social experiments, network reciprocity has been observed, although the imitative behavior did not emerge. What did emerge is a form of conditional cooperation based on direct reciprocity—the propensity to cooperate with neighbors who previously cooperated. To resolve this inconsistency, network reciprocity has been recently shown in a model that rationally confronts the two main behaviors emerging in experiments—reciprocal cooperation and unconditional defection—with rationality introduced by extending the best-response rule to a multi-step predictive horizon. However, direct reciprocity was implemented in a non-standard way, by allowing cooperative agents to temporarily cut the interaction with defecting neighbors. Here, we make this result robust to the way cooperators reciprocate, by implementing direct reciprocity with the standard tit-for-tat strategy and deriving similar results.

Direct reciprocity and model-predictive rationality explain network reciprocity over social ties

Since M. A. Nowak & R. May’s (1992) influential paper, limiting each agent’s interactions to a few neighbors in a network of contacts has been proposed as the simplest mechanism to support the evolution of cooperation in biological and socio-economic systems. The network allows cooperative agents to self-assort into clusters, within which they reciprocate cooperation. This (induced) network reciprocity has been observed in several theoreticalmodels and shown to predict the fixation of cooperation under a simple rule: the benefit produced by an act of cooperation must outweigh the cost of cooperating with all neighbors. However, the experimental evidence among humans is controversial: though the rule seems to be confirmed, the underlying modeling assumptions are not. Specifically, models assume that agents update their strategies by imitating better performing neighbors, even though imitation lacks rationality when interactions are far from all-to-all. Indeed, imitation did not emerge in experiments. What did emerge is that humans are conditioned by their own mood and that, when in a cooperative mood, they reciprocate cooperation. To help resolve the controversy, we design a model in which we rationally confront the two main behaviors emerging from experiments—reciprocal cooperation and unconditional defection—in a networked prisoner’s dilemma. Rationality is introduced by means of a predictive rule for strategy update and is bounded by the assumed model society. We show that both reciprocity and a multi-step predictive horizon are necessary to stabilize cooperation, and sufficient for its fixation, provided the game benefit-to-cost ratio is larger than a measure of network connectivity. We hence rediscover the rule of network reciprocity, underpinned however by a different evolutionary mechanism.

Dynamics of multiplayer games on complex networks using territorial interactions

The modeling of evolution in structured populations has been significantly advanced by evolutionary graph theory, which incorporates pairwise relationships between individuals on a network. More recently, a new framework has been developed to allow for multiplayer interactions of variable size in more flexible and potentially changing population structures. While the theory within this framework has been developed and simple structures considered, there has been no systematic consideration of a large range of different population structures, which is the subject of this paper. We consider a large range of underlying graphical structures for the territorial raider model, the most commonly used model in the new structure, and consider a variety of important properties of our structures with the aim of finding factors that determine the fixation probability of mutants. We find that the graphical temperature and the average group size, as previously defined, are strong predictors of fixation probability, while all other properties considered are poor predictors, although the clustering coefficient is a useful secondary predictor when combined with either temperature or group size. The relationship between temperature or average group size and fixation probability is sometimes, however, nonmonotonic, with a directional reverse occurring around the temperature associated with what we term "completely mixed" populations in the case of the hawk-dove game, but not the public goods game.

Intermediate-Range Migration Furnishes a Narrow Margin of Efficiency in the Two-Strategy Competition

It is well-known that the effects of spatial selection on the two-strategy competition can be quantified by the structural coefficient σ under weak selection. We here calculate the accurate value of σ in group-structured populations of any finite size. In previous similar models, the large population size has been explicitly required for obtaining σ, and here we analyze quantitatively how large the population should be. Unlike previous models which have only involved the influences of the longest and the shortest migration rang on σ, we consider all migration ranges together. The new phenomena are that an intermediate range maximizes σ for medium migration probabilities which are of the tiny minority and the maximum value is slightly larger than those for other ranges. Furthermore, we find the ways that migration or mutation changes σ can vary significantly through determining analytically how the high-frequency steady states (distributions of either strategy over all groups) impact the expression of σ obtained before. Our findings can be directly used to resolve the dilemma of cooperation and provide a more intuitive understanding of spatial selection.

The evolution of generalized reciprocity in social interaction networks

Generalized reciprocity has been proposed as a mechanism for enabling continued cooperation between unrelated individuals. It can be described by the simple rule "help somebody if you received help from someone", and as it does not require individual recognition, complex cognition or extended memory capacities, it has the potential to explain cooperation in a large number of organisms. In a panmictic population this mechanism is vulnerable to defection by individuals who readily accept help but do not help themselves. Here, I investigate to what extent the limitation of social interactions to a social neighborhood can lead to conditions that favor generalized reciprocity in the absence of population structuring. It can be shown that cooperation is likely to evolve if one assumes certain sparse interaction graphs, if strategies are discrete, and if spontaneous helping and reciprocating are independently inherited.

Payoff components and their effects in a spatial three-strategy evolutionary social dilemma

We study a three-strategy spatial evolutionary prisoner's dilemma game with imitation and logit update rules. Players can follow the always-cooperating, always-defecting or the win-stay-lose-shift (WSLS) strategies and gain their payoff from games with their direct neighbors on a square lattice. The friendliness parameter of the WSLS strategy-characterizing its cooperation probability in the first round-tunes the cyclic component of the game determining whether the game can be characterized by a potential. We measured and calculated the phase diagrams of the system for a wide range of parameters. When the game is a potential game and the logit rule is applied, the theoretically predicted phase diagram agrees very well with the simulation results. Surprisingly, this phase diagram can be accurate even in the nonpotential case if there are only two surviving strategies in the stationary state; this result harmonizes with the fact that all 2×2 games are potential games. For the imitation dynamics, we found that the effects of spatiality combined with the presence of two cooperative strategies are so strong that they suppress even substantial changes in the payoff matrix, thus the phase diagrams are independent of the cyclic component's intensity. At the same time, this type of strategy update mechanism supports the formation of cooperative clusters that results in a cooperative society in a wider parameter range compared to the logit dynamics.

How insurance affects altruistic provision in threshold public goods games

The occurrence and maintenance of cooperative behaviors in public goods systems have attracted great research attention across multiple disciplines. A threshold public goods game requires a minimum amount of contributions to be collected from a group of individuals for provision to occur. Here we extend the common binary-strategy combination of cooperation and defection by adding a third strategy, called insured cooperation, which corresponds to buying an insurance covering the potential loss resulted from the unsuccessful public goods game. Particularly, only the contributing agents can opt to be insured, which is an effort decreasing the amount of the potential loss occurring. Theoretical computations suggest that when agents face the potential aggregate risk in threshold public goods games, more contributions occur with increasing compensation from insurance. Moreover, permitting the adoption of insurance significantly enhances individual contributions and facilitates provision, especially when the required threshold is high. This work also relates the strategy competition outcomes to different allocation rules once the resulted contributions exceed the threshold point in populations nested within a dilemma.

Evolutionary prisoner's dilemma game on graphs and social networks with external constraint

A game-theoretical model is constructed to capture the effect of external constraint on the evolution of cooperation. External constraint describes the case where individuals are forced to cooperate with a given probability in a society. Mathematical analyses are conducted via pair approximation and diffusion approximation methods. The results show that the condition for cooperation to be favored on graphs with constraint is b¯/c¯>k/A¯ (A¯=1+kp/(1-p)), where b¯ and c¯ represent the altruistic benefit and cost, respectively, k is the average degree of the graph and p is the probability of compulsory cooperation by external enforcement. Moreover, numerical simulations are also performed on a repeated game with three strategies, always defect (ALLD), tit-for-tat (TFT) and always cooperate (ALLC). These simulations demonstrate that a slight enforcement of ALLC can only promote cooperation when there is weak network reciprocity, while the catalyst effect of TFT on cooperation is verified. In addition, the interesting phenomenon of stable coexistence of the three strategies can be observed. Our model can represent evolutionary dynamics on a network structure which is disturbed by a specified external constraint.

Direct reciprocity in structured populations

Reciprocity and repeated games have been at the center of attention when studying the evolution of human cooperation. Direct reciprocity is considered to be a powerful mechanism for the evolution of cooperation, and it is generally assumed that it can lead to high levels of cooperation. Here we explore an open-ended, infinite strategy space, where every strategy that can be encoded by a finite state automaton is a possible mutant. Surprisingly, we find that direct reciprocity alone does not lead to high levels of cooperation. Instead we observe perpetual oscillations between cooperation and defection, with defection being substantially more frequent than cooperation. The reason for this is that "indirect invasions" remove equilibrium strategies: every strategy has neutral mutants, which in turn can be invaded by other strategies. However, reciprocity is not the only way to promote cooperation. Another mechanism for the evolution of cooperation, which has received as much attention, is assortment because of population structure. Here we develop a theory that allows us to study the synergistic interaction between direct reciprocity and assortment. This framework is particularly well suited for understanding human interactions, which are typically repeated and occur in relatively fluid but not unstructured populations. We show that if repeated games are combined with only a small amount of assortment, then natural selection favors the behavior typically observed among humans: high levels of cooperation implemented using conditional strategies.

Limited memory can be beneficial for the evolution of cooperation

In this study we analyze the effect of working memory capacity on the evolution of cooperation and show a case in which societies with strongly limited memory achieve higher levels of cooperation than societies with larger memory. Agents in our evolutionary model are arranged on a network and interact in a prisoner's dilemma with their neighbors. They learn from their own experience and that of their neighbors in the network about the past behavior of others and use this information when making their choices. Each agent can only process information from her last h interactions. We show that if memory (h) is too short, cooperation does not emerge in the long run. A slight increase of memory length to around 5-10 periods, though, can lead to largely cooperative societies. Longer memory, on the other hand, is detrimental to cooperation in our model.

Special agents can promote cooperation in the population

Cooperation is ubiquitous in our real life but everyone would like to maximize her own profits. How does cooperation occur in the group of self-interested agents without centralized control? Furthermore, in a hostile scenario, for example, cooperation is unlikely to emerge. Is there any mechanism to promote cooperation if populations are given and play rules are not allowed to change? In this paper, numerical experiments show that complete population interaction is unfriendly to cooperation in the finite but end-unknown Repeated Prisoner's Dilemma (RPD). Then a mechanism called soft control is proposed to promote cooperation. According to the basic idea of soft control, a number of special agents are introduced to intervene in the evolution of cooperation. They comply with play rules in the original group so that they are always treated as normal agents. For our purpose, these special agents have their own strategies and share knowledge. The capability of the mechanism is studied under different settings. We find that soft control can promote cooperation and is robust to noise. Meanwhile simulation results demonstrate the applicability of the mechanism in other scenarios. Besides, the analytical proof also illustrates the effectiveness of soft control and validates simulation results. As a way of intervention in collective behaviors, soft control provides a possible direction for the study of reciprocal behaviors.

A review of evolutionary graph theory with applications to game theory

Evolutionary graph theory (EGT), studies the ability of a mutant gene to overtake a finite structured population. In this review, we describe the original framework for EGT and the major work that has followed it. This review looks at the calculation of the "fixation probability" - the probability of a mutant taking over a population and focuses on game-theoretic applications. We look at varying topics such as alternate evolutionary dynamics, time to fixation, special topological cases, and game theoretic results. Throughout the review, we examine several interesting open problems that warrant further research.

Multiple strategies in structured populations

Many specific models have been proposed to study evolutionary game dynamics in structured populations, but most analytical results so far describe the competition of only two strategies. Here we derive a general result that holds for any number of strategies, for a large class of population structures under weak selection. We show that for the purpose of strategy selection any evolutionary process can be characterized by two key parameters that are coefficients in a linear inequality containing the payoff values. These structural coefficients, σ(1) and σ(2), depend on the particular process that is being studied, but not on the number of strategies, n, or the payoff matrix. For calculating these structural coefficients one has to investigate games with three strategies, but more are not needed. Therefore, n = 3 is the general case. Our main result has a geometric interpretation: Strategy selection is determined by the sum of two terms, the first one describing competition on the edges of the simplex and the second one in the center. Our formula includes all known weak selection criteria of evolutionary games as special cases. As a specific example we calculate games on sets and explore the synergistic interaction between direct reciprocity and spatial selection. We show that for certain parameter values both repetition and space are needed to promote evolution of cooperation.

Evolution of cooperation on stochastic dynamical networks

Cooperative behavior that increases the fitness of others at a cost to oneself can be promoted by natural selection only in the presence of an additional mechanism. One such mechanism is based on population structure, which can lead to clustering of cooperating agents. Recently, the focus has turned to complex dynamical population structures such as social networks, where the nodes represent individuals and links represent social relationships. We investigate how the dynamics of a social network can change the level of cooperation in the network. Individuals either update their strategies by imitating their partners or adjust their social ties. For the dynamics of the network structure, a random link is selected and breaks with a probability determined by the adjacent individuals. Once it is broken, a new one is established. This linking dynamics can be conveniently characterized by a Markov chain in the configuration space of an ever-changing network of interacting agents. Our model can be analytically solved provided the dynamics of links proceeds much faster than the dynamics of strategies. This leads to a simple rule for the evolution of cooperation: The more fragile links between cooperating players and non-cooperating players are (or the more robust links between cooperators are), the more likely cooperation prevails. Our approach may pave the way for analytically investigating coevolution of strategy and structure.

A mechanism of dynamical interactions for two-person social dilemmas

We propose a new mechanism of interactions between game-theoretical agents in which the weights of the connections between interacting individuals are dynamical, payoff-dependent variables. Their evolution depends on the difference between the payoff of the agents from a given type of encounter and their average payoff. The mechanism is studied in the frame of two models: agents distributed on a random graph, and a mean field model. Symmetric and asymmetric connections between the agents are introduced. Long time behavior of both systems is discussed for the Prisoner's Dilemma and the Snow Drift games.

Strategy selection in structured populations

Evolutionary game theory studies frequency dependent selection. The fitness of a strategy is not constant, but depends on the relative frequencies of strategies in the population. This type of evolutionary dynamics occurs in many settings of ecology, infectious disease dynamics, animal behavior and social interactions of humans. Traditionally evolutionary game dynamics are studied in well-mixed populations, where the interaction between any two individuals is equally likely. There have also been several approaches to study evolutionary games in structured populations. In this paper we present a simple result that holds for a large variety of population structures. We consider the game between two strategies, A and B, described by the payoff matrix(abcd). We study a mutation and selection process. For weak selection strategy A is favored over B if and only if sigma a+b>c+sigma d. This means the effect of population structure on strategy selection can be described by a single parameter, sigma. We present the values of sigma for various examples including the well-mixed population, games on graphs, games in phenotype space and games on sets. We give a proof for the existence of such a sigma, which holds for all population structures and update rules that have certain (natural) properties. We assume weak selection, but allow any mutation rate. We discuss the relationship between sigma and the critical benefit to cost ratio for the evolution of cooperation. The single parameter, sigma, allows us to quantify the ability of a population structure to promote the evolution of cooperation or to choose efficient equilibria in coordination games.

Effect of the presence of empty sites on the evolution of cooperation by costly punishment in spatial games

Cooperation and spiteful behavior are still evolutionary puzzles. Costly punishment, for which the game payoff is the same as that of spiteful behavior, is one mechanism for promoting the evolution of cooperation. A spatially structured population facilitates the evolution of either cooperation or spite/punishment if cooperation is linked explicitly or implicitly with spite/punishment; a cooperator cooperates with another cooperator and punishes/spites the other type of player. Different updating rules in the evolutionary game produce different evolutionary outcomes: with one updating rule-the score-dependent viability model, in which a player dies with a probability inversely proportional to the game score and the resulting unoccupied site is colonized by one player chosen randomly-the evolution of spite/punishment is promoted more than with the other updating rule-the score-dependent fertility model, in which, after a player dies randomly, the site is colonized by a player with a higher game score. If the population has empty sites, spiteful players or punishers should have less chance to interact with others and then spite/punish others. Thus the presence of empty sites would affect the evolutionary dynamics of spite/punishment. Here, we investigated whether the presence of empty sites discourages the evolution of spite/punishment in both a lattice-structured population and a completely mixing population where players interact with others randomly, especially when the score-dependent viability model is adopted. In the lattice-structured population adopting this viability model, the presence of empty sites promoted the evolution of cooperation and did not reduce the effect of spite/punishment. In the completely mixing population, the presence of empty sites did not promote evolution of cooperation by punishment. The evolutionary dynamics of the score-dependent viability model with empty sites were close to those of the score-dependent fertility model.

Analytical results for individual and group selection of any intensity

The idea of evolutionary game theory is to relate the payoff of a game to reproductive success (= fitness). An underlying assumption in most models is that fitness is a linear function of the payoff. For stochastic evolutionary dynamics in finite populations, this leads to analytical results in the limit of weak selection, where the game has a small effect on overall fitness. But this linear function makes the analysis of strong selection difficult. Here, we show that analytical results can be obtained for any intensity of selection, if fitness is defined as an exponential function of payoff. This approach also works for group selection (= multi-level selection). We discuss the difference between our approach and that of inclusive fitness theory.

Repeated games and direct reciprocity under active linking

Direct reciprocity relies on repeated encounters between the same two individuals. Here we examine the evolution of cooperation under direct reciprocity in dynamically structured populations. Individuals occupy the vertices of a graph, undergoing repeated interactions with their partners via the edges of the graph. Unlike the traditional approach to evolutionary game theory, where individuals meet at random and have no control over the frequency or duration of interactions, we consider a model in which individuals differ in the rate at which they seek new interactions. Moreover, once a link between two individuals has formed, the productivity of this link is evaluated. Links can be broken off at different rates. Whenever the active dynamics of links is sufficiently fast, population structure leads to a simple transformation of the payoff matrix, effectively changing the game under consideration, and hence paving the way for reciprocators to dominate defectors. We derive analytical conditions for evolutionary stability.