The evolution of antisocial punishment in optional public goods games

Experimental subjects are not different

Experiments using economic games are becoming a major source for the study of human social behavior. These experiments are usually conducted with university students who voluntarily choose to participate. Across the natural and social sciences, there is some concern about how this “particular” subject pool may systematically produce biased results. Focusing on social preferences, this study employs data from a survey-experiment conducted with a representative sample of a city's population (N = 765). We report behavioral data from five experimental decisions in three canonical games: dictator, ultimatum and trust games. The dataset includes students and non-students as well as volunteers and non-volunteers. We separately examine the effects of being a student and being a volunteer on behavior, which allows a ceteris paribus comparison between self-selected students (students*volunteers) and the representative population. Our results suggest that self-selected students are an appropriate subject pool for the study of social behavior.

The Evolution of Cooperation Through Institutional Incentives and Optional Participation

Rewards and penalties are common practical tools that can be used to promote cooperation in social institutions. The evolution of cooperation under reward and punishment incentives in joint enterprises has been formalized and investigated, mostly by using compulsory public good games. Recently, Sasaki et al. (2012, Proc Natl Acad Sci USA 109:1165-1169) considered optional participation as well as institutional incentives and described how the interplay between these mechanisms affects the evolution of cooperation in public good games. Here, we present a full classification of these cases of evolutionary dynamics. Specifically, whenever penalties are large enough to cause the bi-stability of both cooperation and defection in cases in which participation in the public good game is compulsory, these penalties will ultimately result in cooperation if participation in the public good game is optional. The global stability of coercion-based cooperation in this optional case contrasts strikingly with the bi-stability that is observed in the compulsory case. We also argue that optional participation is not as effective under rewards as under punishment.

Overpunishing is not necessary to fix cooperation in voluntary public goods games

The fixation of cooperation among unrelated individuals is one of the fundamental problems in biology and social sciences. It is investigated by means of public goods games, the generalization of the prisoner's dilemma to more than two players. In compulsory public goods games, defect is the dominant strategy, while voluntary participation overcomes the social dilemma by allowing a cyclic coexistence of cooperators, defectors, and non-participants. Experimental and theoretical research has shown how the combination of voluntary participation and altruistic punishment-punishing antisocial behaviors at a personal cost-provides a solution to the problem, as long as antisocial punishment-the punishing of cooperators-is not allowed. Altruistic punishment can invade at low participation and pave the way to the fixation of cooperation. Specifically, defectors are overpunished, in the sense that their payoff is reduced by a sanction proportional to the number of punishers in the game. Here we show that qualitatively equivalent results can be achieved with a milder punishing mechanism, where defectors only risk a fixed penalty per round-as in many real situations-and the cost of punishment is shared among the punishers. The payoffs for the four strategies-cooperate, defect, abstain, and cooperate-&-punish-are derived and the corresponding replicator dynamics analyzed in full detail.

When hawks give rise to doves: the evolution and transition of enforcement strategies

The question of how altruism can evolve despite its local disadvantage to selfishness has produced a wealth of theoretical and empirical research capturing the attention of scientists across disciplines for decades. One feature that has remained consistent through this outpouring of knowledge has been that researchers have looked to the altruists themselves for mechanisms by which altruism can curtail selfishness. An alternative perspective may be that just as altruists want to limit selfishness in the population, so may the selfish individuals themselves. These alternative perspectives have been most evident in the fairly recent development of enforcement strategies. Punishment can effectively limit selfishness in the population, but it is not free. Thus, when punishment evolves among altruists, the double costs of exploitation from cheaters and punishment make the evolution of punishment problematic. Here we show that punishment can more readily invade selfish populations when associated with selfishness, whereas altruistic punishers cannot. Thereafter, the establishment of altruism because of enforcement by selfish punishers provides the ideal invasion conditions for altruistic punishment, effectively creating a transition of punishment from selfishness to altruistic. Thus, from chaotic beginnings, a little hypocrisy may go a long way in the evolution and maintenance of altruism.

If cooperation is likely punish mildly: insights from economic experiments based on the snowdrift game

Punishment may deter antisocial behavior. Yet to punish is costly, and the costs often do not offset the gains that are due to elevated levels of cooperation. However, the effectiveness of punishment depends not only on how costly it is, but also on the circumstances defining the social dilemma. Using the snowdrift game as the basis, we have conducted a series of economic experiments to determine whether severe punishment is more effective than mild punishment. We have observed that severe punishment is not necessarily more effective, even if the cost of punishment is identical in both cases. The benefits of severe punishment become evident only under extremely adverse conditions, when to cooperate is highly improbable in the absence of sanctions. If cooperation is likely, mild punishment is not less effective and leads to higher average payoffs, and is thus the much preferred alternative. Presented results suggest that the positive effects of punishment stem not only from imposed fines, but may also have a psychological background. Small fines can do wonders in motivating us to chose cooperation over defection, but without the paralyzing effect that may be brought about by large fines. The later should be utilized only when absolutely necessary.

Mixed strategy under generalized public goods games

The relationship between group's contribution and public goods produced often exhibits nonlinearity, which constitutes the generalized public goods game. Far less attention has been paid to how the mixed strategy evolves in such generalized games. Here, we study the effects of nonlinear production functions on the evolution of the mixed strategy in finite populations for the first time. When the group size and the population size are comparable, cooperation is doomed irrespective of the production function. Otherwise, nonlinear production functions may induce a convergent evolutionary stable strategy (CESS) or a repeller, but cannot yield the evolutionary branching. Moreover, we particularly consider three representative families of production functions, intriguingly which all display the hysteresis effect. For two families of production functions including concave and convex curves, a unique CESS or a unique repeller may occur even if the group size is two. Whereas for the third class encompassing symmetrically sigmoidal and inverse sigmoidal curves, the coexistence of a CESS and a repeller only occurs if group size is above two, and two saddle-node bifurcations appear. Our work includes some evidently different results by comparing with the evolution of continuous investment or binary strategy.

Are virtuous people happy all around the world? Civic virtue, antisocial punishment, and subjective well-being across cultures

Psychological research postulates a positive relationship between virtue and happiness. This article investigates whether this relationship holds in cultures where virtue is not socially appreciated. We specifically focus on civic virtue, which is conceptualized as citizens' honesty in interactions with state institutions (e.g., tax compliance). Two indicators served as measures of the degree to which civic virtue is a part of a country's normative climate: These were each country's mean level of punishment directed at above-average cooperative players in public good experiments and the extent to which citizens justify fraud and free-riding. The results of two studies with data from 13 and 73 countries demonstrate that a positive relationship between civic virtue and happiness/life satisfaction is not universal: In countries where antisocial punishment is common and the level of justification of dishonest behaviors is high, virtuous individuals are no longer happier and more satisfied with life than selfish individuals.

Strict or graduated punishment? Effect of punishment strictness on the evolution of cooperation in continuous public goods games

Whether costly punishment encourages cooperation is one of the principal questions in studies on the evolution of cooperation and social sciences. In society, punishment helps deter people from flouting rules in institutions. Specifically, graduated punishment is a design principle for long-enduring common-pool resource institutions. In this study, we investigate whether graduated punishment can promote a higher cooperation level when each individual plays the public goods game and has the opportunity to punish others whose cooperation levels fall below the punisher's threshold. We then examine how spatial structure affects evolutionary dynamics when each individual dies inversely proportional to the game score resulting from the social interaction and another player is randomly chosen from the population to produce offspring to fill the empty site created after a player's death. Our evolutionary simulation outcomes demonstrate that stricter punishment promotes increased cooperation more than graduated punishment in a spatially structured population, whereas graduated punishment increases cooperation more than strict punishment when players interact with randomly chosen opponents from the population. The mathematical analysis also supports the results.

Evolutionary dynamics of group interactions on structured populations: a review

Interactions among living organisms, from bacteria colonies to human societies, are inherently more complex than interactions among particles and non-living matter. Group interactions are a particularly important and widespread class, representative of which is the public goods game. In addition, methods of statistical physics have proved valuable for studying pattern formation, equilibrium selection and self-organization in evolutionary games. Here, we review recent advances in the study of evolutionary dynamics of group interactions on top of structured populations, including lattices, complex networks and coevolutionary models. We also compare these results with those obtained on well-mixed populations. The review particularly highlights that the study of the dynamics of group interactions, like several other important equilibrium and non-equilibrium dynamical processes in biological, economical and social sciences, benefits from the synergy between statistical physics, network science and evolutionary game theory.

Evolution of fairness in the one-shot anonymous Ultimatum Game

Classical economic models assume that people are fully rational and selfish, while experiments often point to different conclusions. A canonical example is the Ultimatum Game: one player proposes a division of a sum of money between herself and a second player, who either accepts or rejects. Based on rational self-interest, responders should accept any nonzero offer and proposers should offer the smallest possible amount. Traditional, deterministic models of evolutionary game theory agree: in the one-shot anonymous Ultimatum Game, natural selection favors low offers and demands. Experiments instead show a preference for fairness: often responders reject low offers and proposers make higher offers than needed to avoid rejection. Here we show that using stochastic evolutionary game theory, where agents make mistakes when judging the payoffs and strategies of others, natural selection favors fairness. Across a range of parameters, the average strategy matches the observed behavior: proposers offer between 30% and 50%, and responders demand between 25% and 40%. Rejecting low offers increases relative payoff in pairwise competition between two strategies and is favored when selection is sufficiently weak. Offering more than you demand increases payoff when many strategies are present simultaneously and is favored when mutation is sufficiently high. We also perform a behavioral experiment and find empirical support for these theoretical findings: uncertainty about the success of others is associated with higher demands and offers; and inconsistency in the behavior of others is associated with higher offers but not predictive of demands. In an uncertain world, fairness finishes first.

Reward from punishment does not emerge at all costs

The conundrum of cooperation has received increasing attention during the last decade. In this quest, the role of altruistic punishment has been identified as a mechanism promoting cooperation. Here we investigate the role of altruistic punishment on the emergence and maintenance of cooperation in structured populations exhibiting connectivity patterns recently identified as key elements of social networks. We do so in the framework of Evolutionary Game Theory, employing the Prisoner's Dilemma and the Stag-Hunt metaphors to model the conflict between individual and collective interests regarding cooperation. We find that the impact of altruistic punishment strongly depends on the ratio q/p between the cost of punishing a defecting partner (q) and the actual punishment incurred by the partner (p). We show that whenever q/p<1, altruistic punishment turns out to be detrimental for cooperation for a wide range of payoff parameters, when compared to the scenario without punishment. The results imply that while locally, the introduction of peer punishment may seem to reduce the chances of free-riding, realistic population structure may drive the population towards the opposite scenario. Hence, structured populations effectively reduce the expected beneficial contribution of punishment to the emergence of cooperation which, if not carefully dosed, may in fact hinder the chances of widespread cooperation.

Altruistic punishment — when a cooperative individual pays a cost to punish her defective partner — has been described as one of the mechanisms that help to explain cooperation's ubiquity in nature. Here, we investigate a model population where individuals interact with each other along the links of a network. The network is built so that it contains the relevant features of real social and biological interaction webs. Individuals engage in cooperation dilemmas with each other and have the possibility to punish defective partners in order to enforce higher cooperation levels. However, it turns out that the introduction of altruistic punishment not always promotes cooperation – in fact, it can actually hinder the spread of cooperation in a variety of cases that we are able to characterize. Effects acting at “micro”, individual level, such as softening the dilemma and reducing the pressure originating from the fear from being cheated and/or the temptation to cheat, can result in lower overall cooperation at a “macro”, population-wide level, due to the complex interference of the social dilemma and the heterogeneous interaction network.

I dare you to punish me-vendettas in games of cooperation

Everybody has heard of neighbours, who have been fighting over some minor topic for years. The fight goes back and forth, giving the neighbours a hard time. These kind of reciprocal punishments are known as vendettas and they are a cross-cultural phenomenon. In evolutionary biology, punishment is seen as a mechanism for maintaining cooperative behaviour. However, this notion of punishment excludes vendettas. Vendettas pose a special kind of evolutionary problem: they incur high costs on individuals, i.e. costs of punishing and costs of being punished, without any benefits. Theoretically speaking, punishment should be rare in dyadic relationships and vendettas would not evolve under natural selection. In contrast, punishment is assumed to be more efficient in group environments which then can pave the way for vendettas. Accordingly, we found that under the experimental conditions of a prisoner's dilemma game, human participants punished only rarely and vendettas are scarce. In contrast, we found that participants retaliated frequently in the group environment of a public goods game. They even engaged in cost-intense vendettas (i.e. continuous retaliation), especially when the first punishment was unjustified or ambiguous. Here, punishment was mainly targeted at defectors in the beginning, but provocations led to mushrooming of counter-punishments. Despite the counter-punishing behaviour, participants were able to enhance cooperation levels in the public goods game. Few participants even seemed to anticipate the outbreak of costly vendettas and delayed their punishment to the last possible moment. Overall, our results highlight the importance of different social environments while studying punishment as a cooperation-enhancing mechanism.

Measuring the distribution of spitefulness

Spiteful, antisocial behavior may undermine the moral and institutional fabric of society, producing disorder, fear, and mistrust. Previous research demonstrates the willingness of individuals to harm others, but little is understood about how far people are willing to go in being spiteful (relative to how far they could have gone) or their consistency in spitefulness across repeated trials. Our experiment is the first to provide individuals with repeated opportunities to spitefully harm anonymous others when the decision entails zero cost to the spiter and cannot be observed as such by the object of spite. This method reveals that the majority of individuals exhibit consistent (non-)spitefulness over time and that the distribution of spitefulness is bipolar: when choosing whether to be spiteful, most individuals either avoid spite altogether or impose the maximum possible harm on their unwitting victims.

Punishment can promote defection in group-structured populations

Pro-social punishment, whereby cooperators punish defectors, is often suggested as a mechanism that maintains cooperation in large human groups. Importantly, models that support this idea have to date only allowed defectors to be the target of punishment. However, recent empirical work has demonstrated the existence of anti-social punishment in public goods games. That is, individuals that defect have been found to also punish cooperators. Some recent theoretical studies have found that such anti-social punishment can prevent the evolution of pro-social punishment and cooperation. However, the evolution of anti-social punishment in group-structured populations has not been formally addressed. Previous work has informally argued that group-structure must favour pro-social punishment. Here we formally investigate how two demographic factors, group size and dispersal frequency, affect selection pressures on pro- and anti-social punishment. Contrary to the suggestions of previous work, we find that anti-social punishment can prevent the evolution of pro-social punishment and cooperation under a range of group structures. Given that anti-social punishment has now been found in all studied extant human cultures, the claims of previous models showing the co-evolution of pro-social punishment and cooperation in group-structured populations should be re-evaluated.

Retaliation and antisocial punishment are overlooked in many theoretical models as well as behavioral experiments

Guala argues that there is a mismatch between most laboratory experiments on costly punishment and behavior in the field. In the lab, experimental designs typically suppress retaliation. The same is true for most theoretical models of the co-evolution of costly punishment and cooperation, which a priori exclude the possibility of defectors punishing cooperators.

Emergence of responsible sanctions without second order free riders, antisocial punishment or spite

While empirical evidence highlights the importance of punishment for cooperation in collective action, it remains disputed how responsible sanctions targeted predominantly at uncooperative subjects can evolve. Punishment is costly; in order to spread it typically requires local interactions, voluntary participation, or rewards. Moreover, theory and experiments indicate that some subjects abuse sanctioning opportunities by engaging in antisocial punishment (which harms cooperators), spiteful acts (harming everyone) or revenge (as a response to being punished). These arguments have led to the conclusion that punishment is maladaptive. Here, we use evolutionary game theory to show that this conclusion is premature: If interactions are non-anonymous, cooperation and punishment evolve even if initially rare, and sanctions are directed towards non-cooperators only. Thus, our willingness to punish free riders is ultimately a selfish decision rather than an altruistic act; punishment serves as a warning, showing that one is not willing to accept unfair treatments.

Leaving the loners alone: evolution of cooperation in the presence of antisocial punishment

The idea that voluntary participation may promote the evolution of cooperation and punishment in public good games has been recently called into question based on the study of the complete strategy set in which anyone can punish anyone else. If punishment actions are detached from contribution and participation in the game, the combination of punishment and voluntary participation no longer leads to high levels of cooperation. We show that this result crucially depends on specific details of the role of those who abstain from the collective endeavour, and only holds for a small subset of assumptions. If these loners are truly alone, cooperators who punish only defectors prevail, even when antisocial punishment is available.

The structure of mutations and the evolution of cooperation

Evolutionary game dynamics in finite populations assumes that all mutations are equally likely, i.e., if there are n strategies a single mutation can result in any strategy with probability 1/n. However, in biological systems it seems natural that not all mutations can arise from a given state. Certain mutations may be far away, or even be unreachable given the current composition of an evolving population. These distances between strategies (or genotypes) define a topology of mutations that so far has been neglected in evolutionary game theory. In this paper we re-evaluate classic results in the evolution of cooperation departing from the assumption of uniform mutations. We examine two cases: the evolution of reciprocal strategies in a repeated prisoner's dilemma, and the evolution of altruistic punishment in a public goods game. In both cases, alternative but reasonable mutation kernels shift known results in the direction of less cooperation. We therefore show that assuming uniform mutations has a substantial impact on the fate of an evolving population. Our results call for a reassessment of the "model-less" approach to mutations in evolutionary dynamics.

Sustainable institutionalized punishment requires elimination of second-order free-riders

Although empirical and theoretical studies affirm that punishment can elevate collaborative efforts, its emergence and stability remain elusive. By peer-punishment the sanctioning is something an individual elects to do depending on the strategies in its neighborhood. The consequences of unsustainable efforts are therefore local. By pool-punishment, on the other hand, where resources for sanctioning are committed in advance and at large, the notion of sustainability has greater significance. In a population with free-riders, punishers must be strong in numbers to keep the "punishment pool" from emptying. Failure to do so renders the concept of institutionalized sanctioning futile. We show that pool-punishment in structured populations is sustainable, but only if second-order free-riders are sanctioned as well, and to a such degree that they cannot prevail. A discontinuous phase transition leads to an outbreak of sustainability when punishers subvert second-order free-riders in the competition against defectors.

Stochastic evolutionary dynamics resolve the Traveler's Dilemma

Behavior in social dilemmas is often inconsistent with the predictions of classical game theory: people (and a wide variety of other organisms) are more cooperative than might be expected. Here we consider behavior in one such social dilemma, the Traveler's Dilemma, that has received considerable attention in the economics literature but is little known among theoretical biologists. The rules of the game are as follows. Two players each choose a value between R and M, where 0<R<M. If the players choose the same value, both receive that amount. If the players choose different values v(1) and v(2), where v(1)<v(2), then the player choosing v(1) receives v(1)+R and the player choosing v(2) receives v(1)-R. While the players would maximize their payoffs by both choosing the largest allowed value, M, the Nash equilibrium is to choose the smallest allowed value, R. In behavioral experiments, however, people generally choose values much larger than the minimum and the deviation from the expected equilibrium decreases with R. In this paper, we show that the cooperative behavior observed in the Traveler's Dilemma can be explained in an evolutionary framework. We study stochastic evolutionary dynamics in finite populations with varying intensity of selection and varying mutation rate. We derive analytic results showing that strategies choosing high values can be favored when selection is weak. More generally, selection favors strategies that choose high values if R is small (relative to M) and strategies that choose low values if R is large. Finally, we show that a two-parameter model involving the intensity of selection and the mutation rate can quantitatively reproduce data that from a Traveler's Dilemma experiment. These results demonstrate the power of evolutionary game theory for explaining human behavior in contexts that are challenging for standard economic game theory.

Economic games on the internet: the effect of $1 stakes

Online labor markets such as Amazon Mechanical Turk (MTurk) offer an unprecedented opportunity to run economic game experiments quickly and inexpensively. Using Mturk, we recruited 756 subjects and examined their behavior in four canonical economic games, with two payoff conditions each: a stakes condition, in which subjects' earnings were based on the outcome of the game (maximum earnings of $1); and a no-stakes condition, in which subjects' earnings are unaffected by the outcome of the game. Our results demonstrate that economic game experiments run on MTurk are comparable to those run in laboratory settings, even when using very low stakes.

Evolutionary dynamics in finite populations can explain the full range of cooperative behaviors observed in the centipede game

Classical economic models make behavioral predictions based on the assumption that people are fully rational and care only about maximizing their own payoffs. Although this approach successfully explains human behavior in many situations, there is a wealth of experimental evidence demonstrating conditions where people deviate from the predictions of these models. One setting that has received particular attention is fixed length repeated games. Iterating a social dilemma can promote cooperation through direct reciprocity, even if it is common knowledge that all players are rational and self-interested. However, this is not the case if the length of the game is known to the players. In the final round, a rational player will defect, because there is no future to be concerned with. But if you know the other player will defect in the last round, then you should defect in the second to last round, and so on. This logic of backwards induction leads to immediate defection as the only rational (sub-game perfect Nash equilibrium) strategy. When people actually play such games, however, immediate defection is rare. Here we use evolutionary dynamics in finite populations to study the centipede game, which is designed to explore this issue of backwards induction. We make the following observation: since full cooperation can risk-dominate immediate defection in the centipede game, stochastic evolutionary dynamics can favor both delayed defection and even full cooperation. Furthermore, our evolutionary model can quantitatively reproduce human behavior from two experiments by fitting a single free parameter, which is the product of population size and selection intensity. Thus we provide evidence that people's cooperative behavior in fixed length games, which is often called 'irrational', may in fact be the favored outcome of natural selection.

Dynamic social networks promote cooperation in experiments with humans

Human populations are both highly cooperative and highly organized. Human interactions are not random but rather are structured in social networks. Importantly, ties in these networks often are dynamic, changing in response to the behavior of one's social partners. This dynamic structure permits an important form of conditional action that has been explored theoretically but has received little empirical attention: People can respond to the cooperation and defection of those around them by making or breaking network links. Here, we present experimental evidence of the power of using strategic link formation and dissolution, and the network modification it entails, to stabilize cooperation in sizable groups. Our experiments explore large-scale cooperation, where subjects' cooperative actions are equally beneficial to all those with whom they interact. Consistent with previous research, we find that cooperation decays over time when social networks are shuffled randomly every round or are fixed across all rounds. We also find that, when networks are dynamic but are updated only infrequently, cooperation again fails. However, when subjects can update their network connections frequently, we see a qualitatively different outcome: Cooperation is maintained at a high level through network rewiring. Subjects preferentially break links with defectors and form new links with cooperators, creating an incentive to cooperate and leading to substantial changes in network structure. Our experiments confirm the predictions of a set of evolutionary game theoretic models and demonstrate the important role that dynamic social networks can play in supporting large-scale human cooperation.

Violating social norms when choosing friends: how rule-breakers affect social networks

Social networks rely on basic rules of conduct to yield functioning societies in both human and animal populations. As individuals follow established rules, their behavioral decisions shape the social network and give it structure. Using dynamic, self-organizing social network models we demonstrate that defying conventions in a social system can affect multiple levels of social and organizational success independently. Such actions primarily affect actors' own positions within the network, but individuals can also affect the overall structure of a network even without immediately affecting themselves or others. These results indicate that defying the established social norms can help individuals to change the properties of a social system via seemingly neutral behaviors, highlighting the power of rule-breaking behavior to transform convention-based societies, even before direct impacts on individuals can be measured.

Learning dynamics in public goods games

We extend recent analyses of stochastic effects in game dynamical learning to cases of multiplayer games and to games defined on networked structures. By means of an expansion in the noise strength we consider the weak-noise limit and present an analytical computation of spectral properties of fluctuations in multiplayer public goods games. This extends existing work on two-player games. In particular we show that coherent cycles may emerge driven by noise in the adaptation dynamics. These phenomena are not too dissimilar from cyclic strategy switching observed in experiments of behavioral game theory.