Impact of social punishment on cooperative behavior in complex networks

Time delays shape the eco-evolutionary dynamics of cooperation

We study the intricate interplay between ecological and evolutionary processes through the lens of the prisoner's dilemma game. But while previous studies on cooperation amongst selfish individuals often assume instantaneous interactions, we take into consideration delays to investigate how these might affect the causes underlying prosocial behavior. Through analytical calculations and numerical simulations, we demonstrate that delays can lead to oscillations, and by incorporating also the ecological variable of altruistic free space and the evolutionary strategy of punishment, we explore how these factors impact population and community dynamics. Depending on the parameter values and the initial fraction of each strategy, the studied eco-evolutionary model can mimic a cyclic dominance system and even exhibit chaotic behavior, thereby highlighting the importance of complex dynamics for the effective management and conservation of ecological communities. Our research thus contributes to the broader understanding of group decision-making and the emergence of moral behavior in multidimensional social systems.

Costly incentives design from an institutional perspective: cooperation, sustainability and affluence

Incentives are usually introduced by the regulator entity (third-party), to promote cooperation in a market. The implementation of incentives is always costly and thus might fail to be enforced sustainably. This work aims at exploring the effects of incentives from an institutional perspective, while coping with the scenario where the third-party is part of the system but not composed by players. The evolutionary game theory (EGT) framework is applied to identify the incentives that lead to pure cooperation. In contrast to traditional EGT, this paper introduces an elimination mechanism that can reduce the market size. The incentives identified in the EGT analysis are further examined in simulation experiments which measure the market size, affluence and sustainability. The findings show: (1) light punishment leads to a reduction of the market size, yet heavier punishment is beneficial to the market size and wealth; (2) mixed incentives will generally lead to different wealth of the third party and of the participants. While under moderate strength, the wealth of both parties is the same and their overall wealth is maximal; (3) for sustainability, pure punishment (resp. reward) is sustainable (resp. unsustainable), the sustainability of mixed incentives depends on both their strength and agents’ rationality level.

An fMRI investigation of the intention-outcome interactions in second- and third-party punishment

Second-party punishment (SPP) and third-party punishment (TPP) are two basic forms of costly punishment that play an essential role in maintaining social orders. Despite scientific breakthroughs in understanding that costly punishment is driven by an integration of the wrongdoers' intention and the outcome of their actions, so far, few studies have compared the neurocognitive processes associated with the intention-outcome integration between SPP and TPP. Here, we combined economic exchange games measuring SPP and TPP with functional magnetic resonance imaging (fMRI) to compare the neuropsychological architectures underlying the intention-outcome integration during one-shot interactions with anonymous partners across four types of norm violations (no norm, accidental, attempted, and intentional violations). Our behavioral findings showed that third-parties punished only attempted norm violations less frequently than second-parties. Our neuroimaging findings revealed higher activities in the right temporoparietal junction (TPJ) and dorsolateral prefrontal cortex (dlPFC) for attempted norm violations during TPP relative to SPP; more activities in these regions with less punishment frequency; and enhancement of functional connectivity of the right TPJ with the right dlPFC and dorsomedial PFC. Our findings demonstrated specific psychological and neural mechanisms of intention-outcome interactions between SPP and TPP -helping to unravel the complex neurocognitive processes of costly punishment.

Collective behavior in a two-layer neuronal network with time-varying chemical connections that are controlled by a Petri net

In this paper, we propose and study a two-layer network composed of a Petri net in the first layer and a ring of coupled Hindmarsh-Rose neurons in the second layer. Petri nets are appropriate platforms not only for describing sequential processes but also for modeling information circulation in complex systems. Networks of neurons, on the other hand, are commonly used to study synchronization and other forms of collective behavior. Thus, merging both frameworks into a single model promises fascinating new insights into neuronal collective behavior that is subject to changes in network connectivity. In our case, the Petri net in the first layer manages the existence of excitatory and inhibitory links among the neurons in the second layer, thereby making the chemical connections time-varying. We focus on the emergence of different types of collective behavior in the model, such as synchronization, chimeras, and solitary states, by considering different inhibitory and excitatory tokens in the Petri net. We find that the existence of only inhibitory or excitatory tokens disturbs the synchronization of electrically coupled neurons and leads toward chimera and solitary states.

Eco-evolutionary dynamics of cooperation in the presence of policing

Ecology and evolution are inherently linked, and studying a mathematical model that considers both holds promise of insightful discoveries related to the dynamics of cooperation. In the present article, we use the prisoner's dilemma (PD) game as a basis for long-term apprehension of the essential social dilemma related to cooperation among unrelated individuals. We upgrade the contemporary PD game with an inclusion of evolution-induced act of punishment as a third competing strategy in addition to the traditional cooperators and defectors. In a population structure, the abundance of ecologically-viable free space often regulates the reproductive opportunities of the constituents. Hence, additionally, we consider the availability of free space as an ecological footprint, thus arriving at a simple eco-evolutionary model, which displays fascinating complex dynamics. As possible outcomes, we report the individual dominance of cooperators and defectors as well as a plethora of mixed states, where different strategies coexist followed by maintaining the diversity in a socio-ecological framework. These states can either be steady or oscillating, whereby oscillations are sustained by cyclic dominance among different combinations of cooperators, defectors, and punishers. We also observe a novel route to cyclic dominance where cooperators, punishers, and defectors enter a coexistence via an inverse Hopf bifurcation that is followed by an inverse period doubling route.

Exit rights open complex pathways to cooperation

We study the evolutionary dynamics of the Prisoner's Dilemma game in which cooperators and defectors interact with another actor type called exiters. Rather than being exploited by defectors, exiters exit the game in favour of a small pay-off. We find that this simple extension of the game allows cooperation to flourish in well-mixed populations when iterations or reputation are added. In networked populations, however, the exit option is less conducive to cooperation. Instead, it enables the coexistence of cooperators, defectors, and exiters through cyclic dominance. Other outcomes are also possible as the exit pay-off increases or the network structure changes, including network-wide oscillations in actor abundances that may cause the extinction of exiters and the domination of defectors, although game parameters should favour exiting. The complex dynamics that emerges in the wake of a simple option to exit the game implies that nuances matter even if our analyses are restricted to incentives for rational behaviour.

Complex networks identification using Bayesian model with independent Laplace prior

Identification of complex networks from limited and noise contaminated data is an important yet challenging task, which has attracted researchers from different disciplines recently. In this paper, the underlying feature of a complex network identification problem was analyzed and translated into a sparse linear programming problem. Then, a general framework based on the Bayesian model with independent Laplace prior was proposed to guarantee the sparseness and accuracy of identification results after analyzing influences of different prior distributions. At the same time, a three-stage hierarchical method was designed to resolve the puzzle that the Laplace distribution is not conjugated to the normal distribution. Last, the variational Bayesian was introduced to improve the efficiency of the network reconstruction task. The high accuracy and robust properties of the proposed method were verified by conducting both general synthetic network and real network identification tasks based on the evolutionary game dynamic. Compared with other five classical algorithms, the numerical experiments indicate that the proposed model can outperform these methods in both accuracy and robustness.

Evolutionary dynamics of cooperation with the celebrity effect in complex networks

How long-term cooperation is maintained in a society is an important and interesting question. The evolutionary game theory is often used as the basic framework to study this topic. The social status of game participants has an important influence on individual decision-making. Enlightened by this thought, we present a classification imitation model where the mechanisms of the celebrity effect and incomplete egoism are presented. The celebrity effect is reflected in each strategy update process to probe how individual decision-making is dynamically adjusted by comparing the social status of both parties in the game. The incomplete egoism refers to the irrational imitation of celebrities while self-interest is ignored. With this model, the group cooperation decision-making mechanism led by celebrities is revealed. Large-scale Monte Carlo simulations show that the incomplete egoism of individuals cannot stimulate cooperation but guarantee the stable existence of cooperation. Furthermore, the scale-free and community structure of the network enables cooperation to spread widely and maintains long-term survival. Our conclusion might provide practically new insight into the understanding and controlling of cooperation in the complex social systems.

Effect of memory, intolerance, and second-order reputation on cooperation

The understanding of cooperative behavior in social systems has been the subject of intense research over the past few decades. In this regard, the theoretical models used to explain cooperation in human societies have been complemented with a growing interest in experimental studies to validate the proposed mechanisms. In this work, we rely on previous experimental findings to build a theoretical model based on two cooperation driving mechanisms: second-order reputation and memory. Specifically, taking the donation game as a starting point, the agents are distributed among three strategies, namely, unconditional cooperators, unconditional defectors, and discriminators, where the latter follow a second-order assessment rule: shunning, stern judging, image scoring, or simple standing. A discriminator will cooperate if the evaluation of the recipient's last actions contained in his memory is above a threshold of (in)tolerance. In addition to the dynamics inherent to the game, another imitation dynamics, involving much longer times (generations), is introduced. The model is approached through a mean-field approximation that predicts the macroscopic behavior observed in Monte Carlo simulations. We found that, while in most second-order assessment rules, intolerance hinders cooperation, it has the opposite (positive) effect under the simple standing rule. Furthermore, we show that, when considering memory, the stern judging rule shows the lowest values of cooperation, while stricter rules show higher cooperation levels.

Individual diversity between interdependent networks promotes the evolution of cooperation by means of mixed coupling

Along with the rapid development of network-based information technology, such as cloud computing, big data, the IoT, and so on, human society has stepped into a new era of complex networks. People's life and production activities depend more and more on various complex networks to ensure security and reliability. The complex interrelationships between human and nature establish a link to explain the cooperation of individual behaviour, especially for individual diversity. However, existing researches mostly ignore the influence of individual diversity on networks involved in individual behaviour to strategy selection. Therefore, it needs further research on how to consider both individual diversity and independent networks in the evolution of cooperative behaviour. To address this issue, we extend a simple game model into the interdependent networks through the mixed coupling (i.e., utility and probability) in this work. Also, we divide the kinds of strategic behaviour of a player in one layer concerning individual diversity. Moreover, there exists an optimal region of mixed coupling between networks such that cooperation can be promoted. Finally, experimental results can open the path to understanding the emergence and maintenance of cooperation within various interconnected and interrelated real-world systems newly.

Synergistic third-party rewarding and punishment in the public goods game

We study the evolution of cooperation in the spatial public goods game in the presence of third-party rewarding and punishment. The third party executes public intervention, punishing groups where cooperation is weak and rewarding groups where cooperation is strong. We consider four different scenarios to determine what works best for cooperation, in particular, neither rewarding nor punishment, only rewarding, only punishment or both rewarding and punishment. We observe strong synergistic effects when rewarding and punishment are simultaneously applied, which are absent if neither of the two incentives or just each individual incentive is applied by the third party. We find that public cooperation can be sustained at comparatively low third-party costs under adverse conditions, which is impossible if just positive or negative incentives are applied. We also examine the impact of defection tolerance and application frequency, showing that the higher the tolerance and the frequency of rewarding and punishment, the more cooperation thrives. Phase diagrams and characteristic spatial distributions of strategies are presented to corroborate these results, which will hopefully prove useful for more efficient public policies in support of cooperation in social dilemmas.

Benefits of asynchronous exclusion for the evolution of cooperation in stochastic evolutionary optional public goods games

Mechanisms and conditions for the spontaneous emergence of cooperation in multi-player social dilemma games remain an open question. This paper focuses on stochastic evolutionary optional public goods games with different exclusion strategies. We introduce four strategy types in the population, namely, cooperation, defection, loner and exclusion. Synchronous and asynchronous exclusion forms have been compared in finite-sized, well-mixed and structured populations. In addition, we verify that the asynchronous exclusion mechanism is indeed better than the synchronous exclusion mechanism in all cases. The benefits of the asynchronous exclusion are measured by comparing the probability that the system chooses the cooperative states in the two situations. In the well-mixed population cases, only when the investment amplification factor is small and the probability of exclusion success is high will the asynchronous exclusion mechanism have a relatively large advantage in promoting cooperation. However, in the structured population cases, the range of the investment amplification factor, in which the asynchronous exclusion mechanism has relatively large advantages in promoting cooperation, is somewhat different and is mainly in the middle of the interval under our parameters. Our study further corroborated that when non-participation and exclusion strategies exist, a structured population does not necessarily promote cooperation compared with a well-mixed population for some parameter combinations. Thus, we acquire a good understanding of the emergence of cooperation under different exclusion mechanisms.

Heterogeneous indirect reciprocity promotes the evolution of cooperation in structured populations

A fundamental aspect of all biological system is cooperation. Human society is based to a large extent on mechanisms that favor cooperation. Indirect reciprocity is a crucial factor for the emergence and maintenance of cooperation in evolutionary games. In this work, we introduce a mechanism of heterogeneous indirect reciprocity in the prisoner's dilemma game, where an altruistic attribute is considered. The so-called altruistic attribute refers to the trait that when an altruistic individual cooperates, its neighbors, regardless of their strategies, can gain additional benefits. Intuitively, altruistic cooperative agents seem to do only what is beneficial for others, but in fact, their neighbors tend to cooperate in order to maintain the cooperative strategies of altruistic individuals. In this way, the neighbors of cooperative altruistic individuals not only guarantee their own additional benefits, but also indirectly protect the income of altruistic individuals, which strengthens the links between cooperative individuals, thus promoting the evolution of cooperation. The robustness of the results is verified on homogeneous and heterogeneous networks. Moreover, the results of individual heterogeneity corroborate the existing evidence that heterogeneity, almost irrespective of its origin, promotes cooperative actions. Our conclusions might provide additional insights into understanding the roots of cooperation in social systems.

Environment-based preference selection promotes cooperation in spatial prisoner's dilemma game

The impact of environment on individuals is particularly critical. In evolutionary games, adopting the strategy of the neighbor who performs better is nontrivial for the survival and maintenance of cooperation, in that such an action may help the agents to obtain higher benefit and more obvious evolutionary advantages. Inspired by this idea, we investigate the effect of the environment-based preference selection on the evolution of cooperation in spatial prisoner’s dilemma. A simple rule, incorporating individual preference selection via an adjustable parameter α to explore how the selection of the potential strategy sources influences individual behavior traits, is considered. Because social interaction may not be the only way of generating payoffs, we assume that the individual’s income is also affected by the environment. Besides, taking into account individual differences, we introduce the heterogeneity of the environment. Through numerous computing simulations, we find that environment-based preference selection, which accelerates the microscopic organization of cooperator clusters to resist the aggression of defectors, can truly promote cooperation within a large range of parameters. Our study indicates that the combination of heterogeneity and preference selection may be key for the sustainability of cooperation in structured populations.

Evolutionary dynamics in the public goods games with switching between punishment and exclusion

Pro-social punishment and exclusion are common means to elevate the level of cooperation among unrelated individuals. Indeed, it is worth pointing out that the combined use of these two strategies is quite common across human societies. However, it is still not known how a combined strategy where punishment and exclusion are switched can promote cooperation from the theoretical perspective. In this paper, we thus propose two different switching strategies, namely, peer switching that is based on peer punishment and peer exclusion, and pool switching that is based on pool punishment and pool exclusion. Individuals adopting the switching strategy will punish defectors when their numbers are below a threshold and exclude them otherwise. We study how the two switching strategies influence the evolutionary dynamics in the public goods game. We show that an intermediate value of the threshold leads to a stable coexistence of cooperators, defectors, and players adopting the switching strategy in a well-mixed population, and this regardless of whether the pool-based or the peer-based switching strategy is introduced. Moreover, we show that the pure exclusion strategy alone is able to evoke a limit cycle attractor in the evolutionary dynamics, such that cooperation can coexist with other strategies.

Coevolution of teaching ability and cooperation in spatial evolutionary games

Individuals with higher reputation are able to spread their social strategies easily. At the same time, one’s reputation is changing according to his previous behaviors, which leads to completely different teaching abilities for players. To explore the effect of the teaching ability influenced by reputation, we consider a coevolutionary model in which the reputation score affects the updating rule in spatial evolutionary games. More precisely, the updating probability becomes bigger if his/her partner has a positive reputation. Otherwise, the updating probability becomes smaller. This simple design describes the influence of teaching ability on strategy adoption effectively. Numerical results focus on the proportion of cooperation under different levels of the amplitude of change of reputation and the range of reputation. For this dynamics, the fraction of cooperators presents a growth trend within a wide range of parameters. In addition, to validate the generality of this mechanism, we also employ the snowdrift game. Moreover, the evolution of cooperation on Erdős-Rényi random graph is studied for the prisoner’s dilemma game. Our results may be conducive to understanding the emergence and sustainability of cooperation during the strategy adoptions in reality.

Identifying influential nodes in complex networks: A node information dimension approach

In the field of complex networks, how to identify influential nodes is a significant issue in analyzing the structure of a network. In the existing method proposed to identify influential nodes based on the local dimension, the global structure information in complex networks is not taken into consideration. In this paper, a node information dimension is proposed by synthesizing the local dimensions at different topological distance scales. A case study of the Netscience network is used to illustrate the efficiency and practicability of the proposed method.

On the long-run efficacy of punishments and recommendations in a laboratory public goods game

We use decision-making experiments with human participants to study cooperation in a laboratory public goods game. Such games pose a conflict between cooperating, which is socially optimal and free-riding, which promotes individual self-interest. Prior research emphasizes the need for de-centralized peer-to-peer punishments as an evolutionarily stable response to the problem of free-riding, especially where interactions occur over long horizons. We show that a simple exhortative message appealing to participants’ goodwill can achieve high rates of cooperation in social dilemmas played over many rounds, even in the absence of punishments for free-riding.

Plasmonic band structures in doped graphene tubes

We present theoretically the transport of plasmonic waves in doped graphene tube, which is made by rolling planar graphene sheet into a cylinder and periodic doping is applied on it. It is shown that periodic modulation of the Fermi level along the tube can open gaps in the dispersion relations of graphene plasmons and eventually create plasmonic band structures. The propagation of graphene plasmons is forbidden within the bandgaps; while within the band, the plasmonic waves present axially-extended field distributions and propagate along the tubes, yet well confined around the curved graphene surface. Furthermore, the bandgaps, propagation constants and propagation lengths of the modes in plasmonic band structures are significantly tuned by varying the Fermi level of graphene, which provides active controls over the plasmonic waves. Our proposed structures here may provide an approach to dynamically control the plasmonic waves in graphene-based subwavelength waveguides.

Structural power and the evolution of collective fairness in social networks

From work contracts and group buying platforms to political coalitions and international climate and economical summits, often individuals assemble in groups that must collectively reach decisions that may favor each part unequally. Here we quantify to which extent our network ties promote the evolution of collective fairness in group interactions, modeled by means of Multiplayer Ultimatum Games (MUG). We show that a single topological feature of social networks—which we call structural power—has a profound impact on the tendency of individuals to take decisions that favor each part equally. Increased fair outcomes are attained whenever structural power is high, such that the networks that tie individuals allow them to meet the same partners in different groups, thus providing the opportunity to strongly influence each other. On the other hand, the absence of such close peer-influence relationships dismisses any positive effect created by the network. Interestingly, we show that increasing the structural power of a network leads to the appearance of well-defined modules—as found in human social networks that often exhibit community structure—providing an interaction environment that maximizes collective fairness.

Social rank and social cooperation: Impact of social comparison processes on cooperative decision-making

Successful navigation of our complex social world requires the capability to recognize and judge the relative status of others. Hence, social comparison processes are of great importance in our interactions, informing us of our relative standing and in turn potentially motivating our behavior. However, so far few studies have examined in detail how social comparison can influence interpersonal decision-making. One aspect of social decision-making that is of particular importance is cooperative behavior, and identifying means of maintaining and promoting cooperation in the provision of public goods is of vital interest to society. Here, we manipulated social comparison by grading performance rankings on a reaction time task, and then measured cooperative decisions via a modified Public Goods Game (PGG). Findings revealed that individuals ranked highest tended to be more cooperative as compared to those who placed in the bottom rank. Interestingly, this effect was regardless of whether the comparison group members were the subsequent players in the PGG or not, and this effect was stronger in those with higher social orientation. In summary, the present research shows how different social comparison processes (assessed via social rankings) can operate in our daily interaction with others, demonstrating an important effect on cooperative behavior.

The promotion of cooperation by the poor in dynamic chicken games

The evolution of cooperative behavior is one of the most important issues in game theory. Previous studies have shown that cooperation can evolve only under highly limited conditions, and various modifications have been introduced to games to explain the evolution of cooperation. Recently, a utility function basic to game theory was shown to be dependent on current wealth as a conditional (state) variable in a dynamic version of utility theory. Here, we introduce this dynamic utility function to several games. Under certain conditions, poor players exhibit cooperative behavior in two types of chicken games (the hawk-dove game and the snowdrift game) but not in the prisoner’s dilemma game and the stag hunt game. This result indicates that cooperation can be exhibited by the poor in some chicken games. Thus, the evolution of cooperation may not be as limited as has been suggested in previous studies.

Human punishment is not primarily motivated by inequality

Previous theorizing about punishment has suggested that humans desire to punish inequality per se. However, the research supporting such an interpretation contains important methodological confounds. The main objective of the current experiment was to remove those confounds in order to test whether generating inequality per se is punished. Participants were recruited from an online market to take part in a wealth-alteration game with an ostensible second player. The participants were given an option to deduct from the other player’s payment as punishment for their behavior during the game. The results suggest that human punishment does not appear to be motivated by inequality per se, as inequality that was generated without inflicting costs on others was not reliably punished. Instead, punishment seems to respond primarily to the infliction of costs, with inequality only becoming relevant as a secondary input for punishment decisions. The theoretical significance of this finding is discussed in the context of its possible adaptive value.

Impact of Social Reward on the Evolution of the Cooperation Behavior in Complex Networks

Social reward, as a significant mechanism explaining the evolution of cooperation, has attracted great attention both theoretically and experimentally. In this paper, we study the evolution of cooperation by proposing a reward model in network population, where a third strategy, reward, as an independent yet particular type of cooperation is introduced in 2-person evolutionary games. Specifically, a new kind of role corresponding to reward strategy, reward agents, is defined, which is aimed at increasing the income of cooperators by applying to them a social reward. Results from numerical simulations show that consideration of social reward greatly promotes the evolution of cooperation, which is confirmed for different network topologies and two evolutionary games. Moreover, we explore the microscopic mechanisms for the promotion of cooperation in the three-strategy model. As expected, the reward agents play a vital role in the formation of cooperative clusters, thus resisting the aggression of defectors. Our research might provide valuable insights into further exploring the nature of cooperation in the real world.

What Is True Halving in the Payoff Matrix of Game Theory?

In game theory, there are two social interpretations of rewards (payoffs) for decision-making strategies: (1) the interpretation based on the utility criterion derived from expected utility theory and (2) the interpretation based on the quantitative criterion (amount of gain) derived from validity in the empirical context. A dynamic decision theory has recently been developed in which dynamic utility is a conditional (state) variable that is a function of the current wealth of a decision maker. We applied dynamic utility to the equal division in dove-dove contests in the hawk-dove game. Our results indicate that under the utility criterion, the half-share of utility becomes proportional to a player's current wealth. Our results are consistent with studies of the sense of fairness in animals, which indicate that the quantitative criterion has greater validity than the utility criterion. We also find that traditional analyses of repeated games must be reevaluated.

Local Patterns to Global Architectures: Influences of Network Topology on Human Learning

A core question in cognitive science concerns how humans acquire and represent knowledge about their environments. To this end, quantitative theories of learning processes have been formalized in an attempt to explain and predict changes in brain and behavior. We connect here statistical learning approaches in cognitive science, which are rooted in the sensitivity of learners to local distributional regularities, and network science approaches to characterizing global patterns and their emergent properties. We focus on innovative work that describes how learning is influenced by the topological properties underlying sensory input. The confluence of these theoretical approaches and this recent empirical evidence motivate the importance of scaling-up quantitative approaches to learning at both the behavioral and neural levels.

Solving Potential Games With Dynamical Constraint

We solve N -player potential games with dynamical constraint in this paper. Potential games with stable dynamics are first considered followed by one type of potential games without inherently stable dynamics. Different from most of the existing Nash seeking methods, we provide an extremum seeking-based method that does not require explicit information on the game dynamics or the payoff functions. Only measurements of the payoff functions are needed in the game strategy synthesis. Lie bracket approximation is used for the analysis of the proposed Nash seeking scheme. A singularly semi-globally practically uniformly asymptotically stable result is presented for potential games with stable dynamics and an ultimately bounded result is provided for potential games without inherently stable dynamics. For first-order perturbed integrator-type dynamics, we employ an extended-state observer to deal with the disturbance such that better convergence is achievable. Stability of the closed-loop system is proven and the ultimate bound is quantified. Numerical examples are presented to verify the effectiveness of the proposed methods.

A novel framework of classical and quantum prisoner's dilemma games on coupled networks

Evolutionary games on multilayer networks are attracting growing interest. While among previous studies, the role of quantum games in such a infrastructure is still virgin and may become a fascinating issue across a myriad of research realms. To mimick two kinds of different interactive environments and mechanisms, in this paper a new framework of classical and quantum prisoner's dilemma games on two-layer coupled networks is considered. Within the proposed model, the impact of coupling factor of networks and entanglement degree in quantum games on the evolutionary process has been studied. Simulation results show that the entanglement has no impact on the evolution of the classical prisoner's dilemma, while the rise of the coupling factor obviously impedes cooperation in this game, and the evolution of quantum prisoner's dilemma is greatly impacted by the combined effect of entanglement and coupling.

Experience Replay for Optimal Control of Nonzero-Sum Game Systems With Unknown Dynamics

In this paper, an approximate online equilibrium solution is developed for an N -player nonzero-sum (NZS) game systems with completely unknown dynamics. First, a model identifier based on a three-layer neural network (NN) is established to reconstruct the unknown NZS games systems. Moreover, the identifier weight vector is updated based on experience replay technique which can relax the traditional persistence of excitation condition to a simplified condition on recorded data. Then, the single-network adaptive dynamic programming (ADP) with experience replay algorithm is proposed for each player to solve the coupled nonlinear Hamilton- (HJ) equations, where only the critic NN weight vectors are required to tune for each player. The feedback Nash equilibrium is provided by the solution of the coupled HJ equations. Based on the experience replay technique, a novel critic NN weights tuning law is proposed to guarantee the stability of the closed-loop system and the convergence of the value functions. Furthermore, a Lyapunov-based stability analysis shows that the uniform ultimate boundedness of the closed-loop system is achieved. Finally, two simulation examples are given to verify the effectiveness of the proposed control scheme.

Understanding Cooperative Behavior Based on the Coevolution of Game Strategy and Link Weight

In reality, the dependency relationship among individuals is heterogeneous and time-varying. Based on this fact, we present a new mechanism of coevolution of game strategy and link weight when analyzing the evolution of cooperation. In detail, we model the population on a regular network, on which the relationship between players is depicted by a weighted link, and prisoner's dilemma has been applied to describe the interaction of players. Further, the impact of this mechanism on the cooperative behavior has been outlined. By conducting large-scale Monte Carlo simulations, we can easily draw a conclusion that this mechanism can promote cooperation efficiently. Compared with the traditional case, when the temptation of defection b is large, the fraction of cooperation is still able to keep in a high level. With a comprehensive examination of the distribution of stable link weight, it is evident that the coevolution mechanism would deviate the initial distribution. This mechanism induces the heterogeneity of players, which enhances the fraction of cooperation. Numerical simulations also indicate that an intermediate value of Δ/δ warrants an optimal resolution of prisoner's dilemma. The mechanism of coevolution of game strategy and link weight has a practical significance and will provide new insight for the further research.

Heterogeneous Coupling between Interdependent Lattices Promotes the Cooperation in the Prisoner's Dilemma Game

In the research realm of game theory, interdependent networks have extended the content of spatial reciprocity, which needs the suitable coupling between networks. However, thus far, the vast majority of existing works just assume that the coupling strength between networks is symmetric. This hypothesis, to some extent, seems inconsistent with the ubiquitous observation of heterogeneity. Here, we study how the heterogeneous coupling strength, which characterizes the interdependency of utility between corresponding players of both networks, affects the evolution of cooperation in the prisoner's dilemma game with two types of coupling schemes (symmetric and asymmetric ones). Compared with the traditional case, we show that heterogeneous coupling greatly promotes the collective cooperation. The symmetric scheme seems much better than the asymmetric case. Moreover, the role of varying amplitude of coupling strength is also studied on these two interdependent ways. Current findings are helpful for us to understand the evolution of cooperation within many real-world systems, in particular for the interconnected and interrelated systems.

Modelling and computation in the valuation of carbon derivatives with stochastic convenience yields

The anthropogenic greenhouse gas (GHG) emission has risen dramatically during the last few decades, which mainstream researchers believe to be the main cause of climate change, especially the global warming. The mechanism of market-based carbon emission trading is regarded as a policy instrument to deal with global climate change. Although several empirical researches about the carbon allowance and its derivatives price have been made, theoretical results seem to be sparse. In this paper, we theoretically develop a mathematical model to price the CO₂ emission allowance derivatives with stochastic convenience yields by the principle of absence of arbitrage opportunities. In the case of American options, we formulate the pricing problem to a linear parabolic variational inequality (VI) in two spatial dimensions and develop a power penalty method to solve it. Then, a fitted finite volume method is designed to solve the nonlinear partial differential equation (PDE) resulting from the power penalty method and governing the futures, European and American option valuation. Moreover, some numerical results are performed to illustrate the efficiency and usefulness of this method. We find that the stochastic convenience yield does effect the valuation of carbon emission derivatives. In addition, some sensitivity analyses are also made to examine the effects of some parameters on the valuation results.

Universal scaling for the dilemma strength in evolutionary games

Why would natural selection favor the prevalence of cooperation within the groups of selfish individuals? A fruitful framework to address this question is evolutionary game theory, the essence of which is captured in the so-called social dilemmas. Such dilemmas have sparked the development of a variety of mathematical approaches to assess the conditions under which cooperation evolves. Furthermore, borrowing from statistical physics and network science, the research of the evolutionary game dynamics has been enriched with phenomena such as pattern formation, equilibrium selection, and self-organization. Numerous advances in understanding the evolution of cooperative behavior over the last few decades have recently been distilled into five reciprocity mechanisms: direct reciprocity, indirect reciprocity, kin selection, group selection, and network reciprocity. However, when social viscosity is introduced into a population via any of the reciprocity mechanisms, the existing scaling parameters for the dilemma strength do not yield a unique answer as to how the evolutionary dynamics should unfold. Motivated by this problem, we review the developments that led to the present state of affairs, highlight the accompanying pitfalls, and propose new universal scaling parameters for the dilemma strength. We prove universality by showing that the conditions for an ESS and the expressions for the internal equilibriums in an infinite, well-mixed population subjected to any of the five reciprocity mechanisms depend only on the new scaling parameters. A similar result is shown to hold for the fixation probability of the different strategies in a finite, well-mixed population. Furthermore, by means of numerical simulations, the same scaling parameters are shown to be effective even if the evolution of cooperation is considered on the spatial networks (with the exception of highly heterogeneous setups). We close the discussion by suggesting promising directions for future research including (i) how to handle the dilemma strength in the context of co-evolution and (ii) where to seek opportunities for applying the game theoretical approach with meaningful impact.

Multiagent reinforcement learning with unshared value functions

One important approach of multiagent reinforcement learning (MARL) is equilibrium-based MARL, which is a combination of reinforcement learning and game theory. Most existing algorithms involve computationally expensive calculation of mixed strategy equilibria and require agents to replicate the other agents' value functions for equilibrium computing in each state. This is unrealistic since agents may not be willing to share such information due to privacy or safety concerns. This paper aims to develop novel and efficient MARL algorithms without the need for agents to share value functions. First, we adopt pure strategy equilibrium solution concepts instead of mixed strategy equilibria given that a mixed strategy equilibrium is often computationally expensive. In this paper, three types of pure strategy profiles are utilized as equilibrium solution concepts: pure strategy Nash equilibrium, equilibrium-dominating strategy profile, and nonstrict equilibrium-dominating strategy profile. The latter two solution concepts are strategy profiles from which agents can gain higher payoffs than one or more pure strategy Nash equilibria. Theoretical analysis shows that these strategy profiles are symmetric meta equilibria. Second, we propose a multistep negotiation process for finding pure strategy equilibria since value functions are not shared among agents. By putting these together, we propose a novel MARL algorithm called negotiation-based Q-learning (NegoQ). Experiments are first conducted in grid-world games, which are widely used to evaluate MARL algorithms. In these games, NegoQ learns equilibrium policies and runs significantly faster than existing MARL algorithms (correlated Q-learning and Nash Q-learning). Surprisingly, we find that NegoQ also performs well in team Markov games such as pursuit games, as compared with team-task-oriented MARL algorithms (such as friend Q-learning and distributed Q-learning).

Punishment as a means of competition: implications for strong reciprocity theory

Strong negative reciprocity, that is, sanctions imposed on norm violators at the punisher's own expense, has powerful cooperation-enhancing effects in both real-life and experimental game situations. However, it is plausible that punishment may obtain alternative roles depending on social context and the personality characteristics of participants. We examined the occurrence of punishing behavior among 80 subjects in a strongly competitive Public Goods game setting. Despite the punishment condition, the amount of the contributions decreased steadily during the game. The amount of contributions had no significant effect on received and imposed punishments. The results indicate that certain social contexts (in this case, intensive competition) exert modifying effects on the role that punishment takes on. Subjects punished each other in order to achieve a higher rank and a financially better outcome. Punishment primarily functioned as a means of rivalry, instead of as a way of second-order cooperation, as strong reciprocity suggests. These results indicate the need for the possible modification of the social conditions of punishment mechanisms described by the strong reciprocity theory as an evolutionary explanation of human cooperation.

Dependency links can hinder the evolution of cooperation in the prisoner's dilemma game on lattices and networks

Networks with dependency links are more vulnerable when facing the attacks. Recent research also has demonstrated that the interdependent groups support the spreading of cooperation. We study the prisoner's dilemma games on spatial networks with dependency links, in which a fraction of individual pairs is selected to depend on each other. The dependency individuals can gain an extra payoff whose value is between the payoff of mutual cooperation and the value of temptation to defect. Thus, this mechanism reflects that the dependency relation is stronger than the relation of ordinary mutual cooperation, but it is not large enough to cause the defection of the dependency pair. We show that the dependence of individuals hinders, promotes and never affects the cooperation on regular ring networks, square lattice, random and scale-free networks, respectively. The results for the square lattice and regular ring networks are demonstrated by the pair approximation.

Impact of small groups with heterogeneous preference on behavioral evolution in population evacuation

Up to now, there have been a great number of mechanisms to explain the individual behavior and population traits, which seem of particular significance in evolutionary biology and social behavior analysis. Among them, small groups and heterogeneity are two useful frameworks to the above issue. However, vast majority of existing works separately consider both scenarios, which is inconsistent with realistic cases in our life. Here we propose the evolutionary games of heterogeneous small groups (namely, different small groups possess different preferences to dilemma) to study the collective behavior in population evacuation. Importantly, players usually face completely different dilemmas inside and outside the small groups. By means of numerous computation simulations, it is unveiled that the ratio of players in one certain small group directly decides the final behavior of the whole population. Moreover, it can also be concluded that heterogeneous degree of preference for different small groups plays a key role in the behavior traits of the system, which may validate some realistic social observations. The proposed framework is thus universally applicable and may shed new light into the solution of social dilemmas.

Effect of heterogeneous investments on the evolution of cooperation in spatial public goods game

Understanding the emergence of cooperation in spatial public goods game remains a grand challenge across disciplines. In most previous studies, it is assumed that the investments of all the cooperators are identical, and often equal to 1. However, it is worth mentioning that players are diverse and heterogeneous when choosing actions in the rapidly developing modern society and researchers have shown more interest to the heterogeneity of players recently. For modeling the heterogeneous players without loss of generality, it is assumed in this work that the investment of a cooperator is a random variable with uniform distribution, the mean value of which is equal to 1. The results of extensive numerical simulations convincingly indicate that heterogeneous investments can promote cooperation. Specifically, a large value of the variance of the random variable can decrease the two critical values for the result of behavioral evolution effectively. Moreover, the larger the variance is, the better the promotion effect will be. In addition, this article has discussed the impact of heterogeneous investments when the coevolution of both strategy and investment is taken into account. Comparing the promotion effect of coevolution of strategy and investment with that of strategy imitation only, we can conclude that the coevolution of strategy and investment decreases the asymptotic fraction of cooperators by weakening the heterogeneity of investments, which further demonstrates that heterogeneous investments can promote cooperation in spatial public goods game.

Multi-frequency complex network from time series for uncovering oil-water flow structure

Uncovering complex oil-water flow structure represents a challenge in diverse scientific disciplines. This challenge stimulates us to develop a new distributed conductance sensor for measuring local flow signals at different positions and then propose a novel approach based on multi-frequency complex network to uncover the flow structures from experimental multivariate measurements. In particular, based on the Fast Fourier transform, we demonstrate how to derive multi-frequency complex network from multivariate time series. We construct complex networks at different frequencies and then detect community structures. Our results indicate that the community structures faithfully represent the structural features of oil-water flow patterns. Furthermore, we investigate the network statistic at different frequencies for each derived network and find that the frequency clustering coefficient enables to uncover the evolution of flow patterns and yield deep insights into the formation of flow structures. Current results present a first step towards a network visualization of complex flow patterns from a community structure perspective.

Intergroup conflict and rational decision making

The literature has been relatively silent about post-conflict processes. However, understanding the way humans deal with post-conflict situations is a challenge in our societies. With this in mind, we focus the present study on the rationality of cooperative decision making after an intergroup conflict, i.e., the extent to which groups take advantage of post-conflict situations to obtain benefits from collaborating with the other group involved in the conflict. Based on dual-process theories of thinking and affect heuristic, we propose that intergroup conflict hinders the rationality of cooperative decision making. We also hypothesize that this rationality improves when groups are involved in an in-group deliberative discussion. Results of a laboratory experiment support the idea that intergroup conflict –associated with indicators of the activation of negative feelings (negative affect state and heart rate)– has a negative effect on the aforementioned rationality over time and on both group and individual decision making. Although intergroup conflict leads to sub-optimal decision making, rationality improves when groups and individuals subjected to intergroup conflict make decisions after an in-group deliberative discussion. Additionally, the increased rationality of the group decision making after the deliberative discussion is transferred to subsequent individual decision making.

Impact of roles assignation on heterogeneous populations in evolutionary dictator game

The evolution of cooperation is a hot and challenging topic in the field of evolutionary game theory. Altruistic behavior, as a particular form of cooperation, has been widely studied by the ultimatum game but not by the dictator game, which provides a more elegant way to identify the altruistic component of behaviors. In this paper, the evolutionary dictator game is applied to model the real motivations of altruism. A degree-based regime is utilized to assess the impact of the assignation of roles on evolutionary outcome in populations of heterogeneous structure with two kinds of strategic updating mechanisms, which are based on Darwin's theory of evolution and punctuated equilibrium, respectively. The results show that the evolutionary outcome is affected by the role assignation and that this impact also depends on the strategic updating mechanisms, the function used to evaluate players' success, and the structure of populations.

Personal trust increases cooperation beyond general trust

In this paper we present a new methodology which, while allowing for anonymous interaction, it also makes possible to compare decisions of cooperating or defecting when playing games within a group, according to whether or not players personally trust each other. The design thus goes beyond standard approaches to the role of trust in fostering cooperation, which is restricted to general trust. It also allows considering the role of the topology of the social network involved may play in the level of cooperation found. The results of this work support the idea that personal trust promotes cooperation beyond the level of general trust. We also found that this effect carries over to the whole group, making it more cohesive, but that higher levels of cohesion rely on a particular topology. As a conclusion, we hypothesize that personal trust is a psychological mechanism evolved to make human social life possible in the small groups our ancestors lived in, and that this mechanism persists and plays a role in sustaining cooperation and social cohesion.

Punishment based on public benefit fund significantly promotes cooperation

In prisoner's dilemma game (shortly, PD game), punishment is most frequently used to promote cooperation. However, outcome varies when different punishment approaches are applied. Here the PD game is studied on a square lattice when different punishment patterns are adopted. As is known to all, tax system, a common tool to adjust the temperature of the economy, is widely used in human society. Inspired by this philosophy, players in this study would pay corresponding taxes in accordance with their payoff level. In this way, public benefit fund is established consequently and it would be utilized to punish defectors. There are two main methods for punishing: slight intensity of punishment (shortly, SLP) and severe intensity of punishment (shortly, SEP). When the totaling of public benefit fund keeps relatively fixed, SLP extends further, which means more defectors would be punished; by contrast, SEP has a smaller coverage. It is of interest to verify whether these two measures can promote cooperation and which one is more efficient. Simulate results reveal that both of them can promote cooperation remarkably. Specifically speaking, SLP shows constant advantage from the point of view either of fractions of cooperation or average payoff.

Relative accuracy evaluation

The quality of data plays an important role in business analysis and decision making, and data accuracy is an important aspect in data quality. Thus one necessary task for data quality management is to evaluate the accuracy of the data. And in order to solve the problem that the accuracy of the whole data set is low while a useful part may be high, it is also necessary to evaluate the accuracy of the query results, called relative accuracy. However, as far as we know, neither measure nor effective methods for the accuracy evaluation methods are proposed. Motivated by this, for relative accuracy evaluation, we propose a systematic method. We design a relative accuracy evaluation framework for relational databases based on a new metric to measure the accuracy using statistics. We apply the methods to evaluate the precision and recall of basic queries, which show the result's relative accuracy. We also propose the method to handle data update and to improve accuracy evaluation using functional dependencies. Extensive experimental results show the effectiveness and efficiency of our proposed framework and algorithms.

Swarm intelligence inspired shills and the evolution of cooperation

Many hostile scenarios exist in real-life situations, where cooperation is disfavored and the collective behavior needs intervention for system efficiency improvement. Towards this end, the framework of soft control provides a powerful tool by introducing controllable agents called shills, who are allowed to follow well-designed updating rules for varying missions. Inspired by swarm intelligence emerging from flocks of birds, we explore here the dependence of the evolution of cooperation on soft control by an evolutionary iterated prisoner's dilemma (IPD) game staged on square lattices, where the shills adopt a particle swarm optimization (PSO) mechanism for strategy updating. We demonstrate that not only can cooperation be promoted by shills effectively seeking for potentially better strategies and spreading them to others, but also the frequency of cooperation could be arbitrarily controlled by choosing appropriate parameter settings. Moreover, we show that adding more shills does not contribute to further cooperation promotion, while assigning higher weights to the collective knowledge for strategy updating proves a efficient way to induce cooperative behavior. Our research provides insights into cooperation evolution in the presence of PSO-inspired shills and we hope it will be inspirational for future studies focusing on swarm intelligence based soft control.