Benefits of tolerance in public goods games

Emergence of cooperation under punishment: A reinforcement learning perspective

Punishment is a common tactic to sustain cooperation and has been extensively studied for a long time. While most of previous game-theoretic work adopt the imitation learning framework where players imitate the strategies of those who are better off, the learning logic in the real world is often much more complex. In this work, we turn to the reinforcement learning paradigm, where individuals make their decisions based upon their experience and long-term returns. Specifically, we investigate the prisoners' dilemma game with a Q-learning algorithm, and cooperators probabilistically pose punishment on defectors in their neighborhood. Unexpectedly, we find that punishment could lead to either continuous or discontinuous cooperation phase transitions, and the nucleation process of cooperation clusters is reminiscent of the liquid-gas transition. The analysis of a Q-table reveals the evolution of the underlying "psychologic" changes, which explains the nucleation process and different levels of cooperation. The uncovered first-order phase transition indicates that great care needs to be taken when implementing the punishment compared to the continuous scenario.

Quantal response equilibrium for the Prisoner's Dilemma game in Markov strategies

Within the studies of human cooperation, there are gaps that require further investigation. One possible area for growth is developing theoretical concepts which describe high levels of cooperation. In this paper, we present a symmetrical quantal response equilibrium (QRE) in Prisoner's Dilemma game (PD) constructed in Markov strategies (tolerance to defection and mutual cooperation). To prove the adequacy of the resulting equilibrium, we compare it with the previously found Nash equilibrium in PD in Markov strategies: the QRE converges with the Nash equilibrium that corresponds with the theory. Next, we investigate the properties of QRE in PD in Markov strategies by testing it against experimental data. For low levels of rationality, the found equilibrium manages to describe high cooperation. We derive the levels of rationality under which the intersection between Nash and QRE occurs. Lastly, our experimental data suggest that QRE serves as a dividing line between behavior with low and high cooperation.

Combination of institutional incentives for cooperative governance of risky commons

Finding appropriate incentives to enforce collaborative efforts for governing the commons in risky situations is a long-lasting challenge. Previous works have demonstrated that both punishing free-riders and rewarding cooperators could be potential tools to reach this goal. Despite weak theoretical foundations, policy makers frequently impose a punishment-reward combination. Here, we consider the emergence of positive and negative incentives and analyze their simultaneous impact on sustaining risky commons. Importantly, we consider institutions with fixed and flexible incentives. We find that a local sanctioning scheme with pure reward is the optimal incentive strategy. It can drive the entire population toward a highly cooperative state in a broad range of parameters, independently of the type of institutions. We show that our finding is also valid for flexible incentives in the global sanctioning scheme, although the local arrangement works more effectively.

•

Pure reward in a local scheme is more effective both for fixed and flexible incentives

•

It can drive the entire population toward a highly cooperative state

•

Increasing the efficiency of the institution can induce the success of pure reward

•

A local scheme promotes group success more effectively than a global scheme

The evolution of cooperation in spatial public goods game with conditional peer exclusion

Social exclusion can prevent free riders from participating in social activities and deprive them of sharing cooperative benefits, which is an effective mechanism for the evolution of cooperation. However, traditional peer-exclusion strategies are unconditional, and as long as there are defectors in the group, they will pay a cost to exclude the defectors. In reality, one of the reasons for the complexity of these strategies is that individuals may react differently depending on the environment in which they are located. Based on this consideration, we introduce a kind of conditional peer-exclusion strategy in the spatial public goods game model. Specifically, the behavior of conditional exclusion depends on the number of defectors in the group and can be adjusted by a tolerance parameter. Only if the number of defectors in the group exceeds the tolerance threshold, conditional exclusion can be triggered to exclude defectors. We explore the effects of parameters such as tolerance, exclusion cost, and probability of exclusion success on the evolution of cooperation. Simulation results confirmed that conditional exclusion can greatly reduce the threshold values of the synergy factor above which cooperation can emerge. Especially, when the tolerance is low, very small synergy factors can promote the population to achieve a high level of cooperation. Moreover, even if the probability of exclusion success is low, or the unit exclusion cost is relatively high, conditional exclusion is effective in promoting cooperation. These results allow us to better understand the role of exclusion strategies in the emergence of cooperation.

The public goods game with shared punishment cost in well-mixed and structured populations

Both experimental and theoretical studies have shown that punishment plays an important role in promoting cooperation. Various forms of punishment are proposed to explain why costly punishment could be maintained in the population and stabilize cooperation. Here we consider an altruistic behavior that cooperators perform cooperation and punishment simultaneously and share the punishment cost. We investigate the role of punishment cost shared among cooperators in the evolution of cooperation in public goods game. We show that the punishment can promote and stabilize cooperation when the penalty imposed on defectors is large enough compared to the punishment cost incurred by cooperators in well-mixed populations. In structured populations, cooperation could emerge under lower fine threshold and coexist with defection. However, as the penalty increases, cooperation will have a larger basin of attraction in the well-mixed population than that in the structured population. Our analytical and simulated results indicate that punishment indeed can effectively promote the evolution of cooperation. We also find that population structure can promote the coexistence of cooperation and defection but not always be beneficial to cooperation.

Reciprocity-based cooperative phalanx maintained by overconfident players

According to the evolutionary game theory principle, a strategy representing a higher payoff can spread among competitors. But there are cases when a player consistently overestimates or underestimates her own payoff, which undermines proper comparison. Interestingly, both underconfident and overconfident individuals are capable of elevating the cooperation level significantly. While former players stimulate a local coordination of strategies, the presence of overconfident individuals enhances the spatial reciprocity mechanism. In both cases the propagations of competing strategies are influenced in a biased way resulting in a cooperation supporting environment. These effects are strongly related to the nonlinear character of invasion probabilities which is a common and frequently observed feature of microscopic dynamics.

An optimal strategy to solve the Prisoner's Dilemma

Cooperation is a central mechanism for evolution. It consists of an individual paying a cost in order to benefit another individual. However, natural selection describes individuals as being selfish and in competition among themselves. Therefore explaining the origin of cooperation within the context of natural selection is a problem that has been puzzling researchers for a long time. In the paradigmatic case of the Prisoner's Dilemma (PD), several schemes for the evolution of cooperation have been proposed. Here we introduce an extension of the Replicator Equation (RE), called the Optimal Replicator Equation (ORE), motivated by the fact that evolution acts not only at the level of individuals of a population, but also among competing populations, and we show that this new model for natural selection directly leads to a simple and natural rule for the emergence of cooperation in the most basic version of the PD. Contrary to common belief, our results reveal that cooperation can emerge among selfish individuals because of selfishness itself: if the final reward for being part of a society is sufficiently appealing, players spontaneously decide to cooperate.

Conditional punishment is a double-edged sword in promoting cooperation

Punishment is widely recognized as an effective approach for averting from exploitation by free-riders in human society. However, punishment is costly, and thus rational individuals are unwilling to take the punishing action, resulting in the second-order free-rider problem. Recent experimental study evidences that individuals prefer conditional punishment, and their punishing decision depends on other members' punishing decisions. In this work, we thus propose a theoretical model for conditional punishment and investigate how such conditional punishment influences cooperation in the public goods game. Considering conditional punishers only take the punishing action when the number of unconditional punishers exceeds a threshold number, we demonstrate that such conditional punishment induces the effect of a double-edged sword on the evolution of cooperation both in well-mixed and structured populations. Specifically, when it is relatively easy for conditional punishers to engage in the punishment activity corresponding to a low threshold value, cooperation can be promoted in comparison with the case without conditional punishment. Whereas when it is relatively difficult for conditional punishers to engage in the punishment activity corresponding to a high threshold value, cooperation is inhibited in comparison with the case without conditional punishment. Moreover, we verify that such double-edged sword effect exists in a wide range of model parameters and can be still observed in other different punishment regimes.

Divide-and-conquer Tournament on Social Networks

In social gaming networks, previous studies extensively investigated the influence of a variety of strategies on reciprocal behaviors in the prisoner's dilemma game. The studied frameworks range from the case that an individual uniformly cooperates or defects with all social contacts, to the recently reported divide-and-conquer games, where an individual can choose a particular move to play with each neighbor. In this paper, we investigate a divide-and-conquer tournament among 14 well-known strategies on social gaming networks. In the tournament, an individual's fitness is measured by accumulated and average payoff aggregated for a certain number of rounds. On the base of their fitness, the evolution of the population follows a local learning mechanism. Our observation indicates that the distribution of individuals adopting a strategy in degree ranking fundamentally changes the frequency of the strategy. In the divide-and-conquer gaming networks, our result suggests that the connectivity in social networks and strategy are two key factors that govern the evolution of the population.

Competing opinion diffusion on social networks

Opinion competition is a common phenomenon in real life, such as with opinions on controversial issues or political candidates; however, modelling this competition remains largely unexplored. To bridge this gap, we propose a model of competing opinion diffusion on social networks taking into account degree-dependent fitness or persuasiveness. We study the combined influence of social networks, individual fitnesses and attributes, as well as mass media on people's opinions, and find that both social networks and mass media act as amplifiers in opinion diffusion, the amplifying effect of which can be quantitatively characterized. We analytically obtain the probability that each opinion will ultimately pervade the whole society when there are no committed people in networks, and the final proportion of each opinion at the steady state when there are committed people in networks. The results of numerical simulations show good agreement with those obtained through an analytical approach. This study provides insight into the collective influence of individual attributes, local social networks and global media on opinion diffusion, and contributes to a comprehensive understanding of competing diffusion behaviours in the real world.

Cooperation driven by success-driven group formation

In the traditional setup of the public goods game all players are involved in every available group and the mutual benefit is shared among competing cooperator and defector strategies. However, in real life situations the group formation of players could be more sophisticated because not all players are attractive enough for others to participate in a joint venture. What if only those players who are successful enough to the neighbors can initiate a group formation and establish a game? To elaborate this idea we employ a modified protocol and demonstrate that a carefully chosen threshold to establish a joint venture could efficiently improve the cooperation level even if the synergy factor would suggest a full defector state otherwise. The microscopic mechanism that is responsible for this effect is based on the asymmetric consequences of competing strategies: while the success of a cooperator provides a long-time well-being for the neighborhood, the temporary advantage of defection cannot be maintained if the protocol is based on the success of leaders.

Culture and cooperation in a spatial public goods game

We study the coevolution of culture and cooperation by combining the Axelrod model of cultural dissemination with a spatial public goods game, incorporating both noise and social influence. Both participation and cooperation in public goods games are conditional on cultural similarity. We find that a larger "scope of cultural possibilities" in the model leads to the survival of cooperation, when noise is not present, and a higher probability of a multicultural state evolving, for low noise rates. High noise rates, however, lead to both rapid extinction of cooperation and collapse into cultural "anomie," in which stable cultural regions fail to form. These results suggest that cultural diversity can actually be beneficial for the evolution of cooperation, but that cultural information needs to be transmitted accurately in order to maintain both coherent cultural groups and cooperation.