Cyclic dominance in evolutionary games: a review

Effects of conservative-militant defection strategies on the evolution of cooperation in social dilemma

Competition in the international arena and business realm offers avenues for individual growth and advancement. Individuals using different means of competition can obtain unequal rewards. This paper claims that when no consensus is reached in business activities, defectors will choose conservative or militant defection strategies during market competition. Conservative defectors, who are in a comparatively weak position, need to pay the costs brought by market share losses. However, their personal abilities cannot be ignored, which prompts them to bravely choose the conservative defection strategy. This brings rewards to conservative defectors. Militant defectors, typically in stronger positions, also receive greater rewards. Research results establish an evolutionary game model of three strategies, the cooperation strategy, the conservative defection strategy, and the militant defection strategy. After the system is stable, this model displays two stable states. Through numerical simulation, it can be found that the personal abilities of conservative defectors play a decisive role in promoting cooperation. However, the market share losses of conservative defectors have periodical impacts on cooperation. Moreover, the threats of militant defectors to cooperation should be comprehensively considered in combination with the personal abilities of conservative defectors.

How combined pairwise and higher-order interactions shape transient dynamics

Understanding how species interactions shape biodiversity is a core challenge in ecology. While much focus has been on long-term stability, there is rising interest in transient dynamics-the short-lived periods when ecosystems respond to disturbances and adjust toward stability. These transitions are crucial for predicting ecosystem reactions and guiding effective conservation. Our study introduces a model that uses convex combinations to blend pairwise and higher-order interactions (HOIs), offering a more realistic view of natural ecosystems. We find that pairwise interactions slow the journey to stability, while HOIs speed it up. Employing global stability analysis and numerical simulations, we establish that as the proportion of HOIs increases, mean transient times exhibit a significant reduction, thereby underscoring the essential role of HOIs in enhancing biodiversity stabilization. Our results reveal a robust correlation between the most negative real part of the eigenvalues of the Jacobian matrix associated with the linearized system at the coexistence equilibrium and the mean transient times. This indicates that a more negative leading eigenvalue correlates with accelerated convergence to stable coexistence abundances. This insight is vital for comprehending ecosystem resilience and recovery, emphasizing the key role of HOIs in promoting stabilization. Amid growing interest in transient dynamics and its implications for biodiversity and ecological stability, our study enhances the understanding of how species interactions affect both transient and long-term ecosystem behavior. By addressing a critical gap in ecological theory and offering a practical framework for ecosystem management, our work advances knowledge of transient dynamics, ultimately informing effective conservation strategies.

Evolution of trust in N-player trust games with loss assessment

Trust plays a crucial role in social and economic interactions, serving as the foundation for social stability and human cooperation. Previous studies have explored the evolution of trust between investors and trustees by constructing trust game models, incorporating factors such as network structure, reputation, and incentives. However, these studies often assume that investors consistently maintain their investment behavior, neglecting the potential influence of the investment environment on investment behavior. To address this gap, we introduce a loss assessment mechanism and construct a trust game model. Specifically, investors first allocate their investment amount to an assessment agency, which divides the amount into two parts according to a certain allocation ratio. One part is used for investment assessment, and the results are fed back to the investors. If the payoff from this portion exceeds the investors' expected value, the remaining amount is invested; otherwise, it is returned to the investors. The results indicate that investors with moderate expectations are more likely to form alliances with trustworthy trustees, thereby effectively promoting the evolution of trust. Conversely, lower or higher expectations yield opposite results. Additionally, we find that as investors' expected values increase, the corresponding allocation ratio should also increase to achieve higher payoffs.

Cycling and spiral-wave modes in an active cyclic Potts model

We studied the nonequilibrium dynamics of a cycling three-state Potts model using simulations and theory. This model can be tuned from thermal-equilibrium to far-from-equilibrium conditions. At low cycling energy, the homogeneous dominant state cycles via nucleation and growth, while spiral waves are formed at high energy. For large systems, a discontinuous transition occurs from these cyclic homogeneous phases to spiral waves, while the opposite transition is absent. Conversely, these two modes can coexist for small systems. The waves can be reproduced by a continuum theory, and the transition can be understood from the competition between nucleation and growth.

Diffusion and pattern formation in spatial games

Diffusion plays an important role in a wide variety of phenomena, from bacterial quorum sensing to the dynamics of traffic flow. While it generally tends to level out gradients and inhomogeneities, diffusion has nonetheless been shown to promote pattern formation in certain classes of systems. Formation of stable structures often serves as a key factor in promoting the emergence and persistence of cooperative behavior in otherwise competitive environments, however, an in-depth analysis on the impact of diffusion on such systems is lacking. We therefore investigate the effects of diffusion on cooperative behavior using a cellular automaton (CA) model of the noisy spatial iterated prisoner's dilemma (IPD), physical extension, and stochasticity being unavoidable characteristics of several natural phenomena. We further derive a mean-field (MF) model that captures the three-species predation dynamics from the CA model and highlight how pattern formation arises in this new model, then characterize how including diffusion by interchange similarly enables the emergence of large scale structures in the CA model as well. We investigate how these emerging patterns favors cooperative behavior for parameter space regions where IPD error rates classically forbid such dynamics. We thus demonstrate how the coupling of diffusion with nonlinear dynamics can, counterintuitively, promote large-scale structure formation and in return establish new grounds for cooperation to take hold in stochastic spatial systems.

Tripartite evolutionary game and simulation analysis of agricultural non-point source pollution control

Agricultural non-point source pollution control (ANSPC) is a complex, long-term and dynamic environmental protection process. In order to motivate multiple subjects to participate in ANSPC, this paper constructs a tripartite evolutionary game model of local government, village collectives and farmers, which explores the strategic choices and influencing factors of different subjects through simulation analysis. The results indicate that: There are five stable strategy points in the ANSPC game system, which can be divided into four stages based on subject interactions. Village collectives should play an intermediary role in ANSPC and try to coordinate the behaviour of different subjects. The ideal and stable evolution state is "weak supervise, positive response, and active participate", but it cannot be realized at present. The strategy selection of subjects is determined by relative net income. Providing penalties requires considering the heterogeneity of subjects, but incentives are beneficial for achieving tripartite governance. This study provides new evidence for understanding the role of multi-agency participation in agricultural non-point source pollution control, and provides theoretical guidance for the government to formulate differentiated intervention mechanisms, which is an important reference for achieving sustainable development goals.

Evolutionary dynamics of any multiplayer game on regular graphs

Multiplayer games on graphs are at the heart of theoretical descriptions of key evolutionary processes that govern vital social and natural systems. However, a comprehensive theoretical framework for solving multiplayer games with an arbitrary number of strategies on graphs is still missing. Here, we solve this by drawing an analogy with the Balls-and-Boxes problem, based on which we show that the local configuration of multiplayer games on graphs is equivalent to distributing k identical co-players among n distinct strategies. We use this to derive the replicator equation for any n-strategy multiplayer game under weak selection, which can be solved in polynomial time. As an example, we revisit the second-order free-riding problem, where costly punishment cannot truly resolve social dilemmas in a well-mixed population. Yet, in structured populations, we derive an accurate threshold for the punishment strength, beyond which punishment can either lead to the extinction of defection or transform the system into a rock-paper-scissors-like cycle. The analytical solution also qualitatively agrees with the phase diagrams that were previously obtained for non-marginal selection strengths. Our framework thus allows an exploration of any multi-strategy multiplayer game on regular graphs.

Spatial structure could explain the maintenance of alternative reproductive tactics in tree cricket males

Trait polymorphisms are widespread in nature, and explaining their stable co-existence is a central problem in ecology and evolution. Alternative reproductive tactics, in which individuals of one or more sex exhibit discrete, discontinuous traits in response to reproductive competition, represent a special case of trait polymorphism in which the traits are often complex, behavioural, and dynamic. Thus, studying how alternative reproductive tactics are maintained may provide general insights into how complex trait polymorphisms are maintained in populations. We construct a spatially explicit individual-based model inspired from extensively collected empirical data to address the mechanisms behind the co-existence of three behavioural alternative reproductive tactics in males of a tree cricket (Oecanthus henryi). Our results show that the co-existence of these tactics over ecological time scales is facilitated by the spatial structure of the landscape they inhabit, which serves to equalise the otherwise unequal mating benefits of the three tactics. We also show that this co-existence is unlikely if spatial aspects of the system are not considered. Our findings highlight the importance of spatial dynamics in understanding ecological and evolutionary processes and underscore the power of integrative approaches that combine models with empirical data.

Ambush strategy enhances organisms' performance in rock-paper-scissors games

We study a five-species cyclic system wherein individuals of one species strategically adapt their movements to enhance their performance in the spatial rock-paper-scissors game. Environmental cues enable the awareness of the presence of organisms targeted for elimination in the cyclic game. If the local density of target organisms is sufficiently high, individuals move towards concentrated areas for direct attack; otherwise, they employ an ambush tactic, maximising the chances of success by targeting regions likely to be dominated by opponents. Running stochastic simulations, we discover that the ambush strategy enhances the likelihood of individual success compared to direct attacks alone, leading to uneven spatial patterns characterised by spiral waves. We compute the autocorrelation function and measure how the ambush tactic unbalances the organisms' spatial organisation by calculating the characteristic length scale of typical spatial domains of each species. We demonstrate that the threshold for local species density influences the ambush strategy's effectiveness, while the neighbourhood perception range significantly impacts decision-making accuracy. The outcomes show that long-range perception improves performance by over 60%, although there is potential interference in decision-making under high attack triggers. Understanding how organisms' adaptation their environment enhances their performance may be helpful not only for ecologists, but also for data scientists, aiming to improve artificial intelligence systems.

Predicting rock-paper-scissors choices based on single-trial EEG signals

Decision prediction based on neurophysiological signals is of great application value in many real-life situations, especially in human-AI collaboration or counteraction. Single-trial analysis of electroencephalogram (EEG) signals is a very valuable step in the development of an online decision-prediction system. However, previous EEG-based decision-prediction methods focused mainly on averaged EEG signals of all decision-making trials to predict an individual's general decision tendency (e.g., risk seeking or aversion) over a period rather than on a specific decision response in a single trial. In the present study, we used a rock-paper-scissors game, which is a common multichoice decision-making task, to explore how to predict participants' single-trial choice with EEG signals. Forty participants, comprising 20 females and 20 males, played the game with a computer player for 330 trials. Considering that the decision-making process of this game involves multiple brain regions and neural networks, we proposed a new algorithm named common spatial pattern-attractor metagene (CSP-AM) to extract CSP features from different frequency bands of EEG signals that occurred during decision making. The results showed that a multilayer perceptron classifier achieved an accuracy significantly exceeding the chance level among 88.57% (31 of 35) of participants, verifying the classification ability of CSP features in multichoice decision-making prediction. We believe that the CSP-AM algorithm could be used in the development of proactive AI systems.

Antisocial peer exclusion does not eliminate the effectiveness of prosocial peer exclusion in structured populations

While prosocial exclusion has been proposed as a mechanism to maintain cooperation in one-shot social dilemma games, the evolution of prosocial peer exclusion in response to the threat of antisocial peer exclusion, particularly in structured populations, remains insufficiently understood. In this study, we employ an extended spatial public goods game to investigate the evolution of prosocial peer exclusion and its impact on cooperation in the presence of both prosocial and antisocial peer exclusion. Our model encompasses four primary strategies: traditional cooperation and defection, prosocial peer exclusion targeting defectors, and antisocial peer exclusion targeting cooperators. Our findings illuminate that the presence of antisocial peer exclusion significantly disrupts network reciprocity and suppresses cooperation. However, when coexisting with prosocial peer exclusion, it does not undermine the latter's efficacy in upholding cooperation, except in scenarios with low exclusion costs Unlike the cooperation-sustaining cyclic dominance pattern observed in the exclusive presence of prosocial peer exclusion, the co-presence of prosocial and antisocial peer exclusion gives rise to more intricate pathways for maintaining cooperation. These pathways include cyclic dominance involving traditional cooperation, prosocial peer exclusion, and antisocial peer exclusion, or a similar pattern involving traditional defection and the two exclusion strategies, or even cyclic dominance among all four strategies. In essence, our study enhances the theoretical framework concerning the effectiveness of the prosocial exclusion strategy, contributing to a more comprehensive understanding of its dynamics.

High order sliding mode control for restoration of a population of predators in a Lotka-Volterra system

Human-induced extinction and rapid ecological changes require the development of techniques that can help avoid extinction of endangered species. The most used strategy to avoid extinction is reintroduction of the endangered species, but only 31% of these attempts are successful and they require up to 15 years for their results to be evaluated. In this research, we propose a novel strategy that improves the chances of survival of endangered predators, like lynx, by controlling only the availability of prey. To simulate the prey-predator relationship we used a Lotka-Volterra model to analyze the effects of varying prey availability on the size of the predator population. We calculate the number of prey necessary to support the predator population using a high-order sliding mode control (HOSMC) that maintains the predator population at the desired level. In the wild, nature introduces significant and complex uncertainties that affect species' survival. This complexity suggests that HOSMC is a good choice of controller because it is robust to variability and does not require prior knowledge of system parameters. These parameters can also be time varying. The output measurement required by the HOSMC is the number of predators. It can be obtained using continuous monitoring of environmental DNA that measures the number of lynxes and prey in a specific geographic area. The controller efficiency in the presence of these parametric uncertainties was demonstrated with a numerical simulation, where random perturbations were forced in all four model parameters at each simulation step, and the controller provides the specific prey input that will maintain the predator population. The simulation demonstrates how HOSMC can increase and maintain an endangered population (lynx) in just 21-26 months by regulating the food supply (hares), with an acceptable maximal steady-state error of 3%.

Response of a three-species cyclic ecosystem to a short-lived elevation of death rate

A balanced ecosystem with coexisting constituent species is often perturbed by different natural events that persist only for a finite duration of time. What becomes important is whether, in the aftermath, the ecosystem recovers its balance or not. Here we study the fate of an ecosystem by monitoring the dynamics of a particular species that encounters a sudden increase in death rate. For exploration of the fate of the species, we use Monte-Carlo simulation on a three-species cyclic rock-paper-scissor model. The density of the affected (by perturbation) species is found to drop exponentially immediately after the pulse is applied. In spite of showing this exponential decay as a short-time behavior, there exists a region in parameter space where this species surprisingly remains as a single survivor, wiping out the other two which had not been directly affected by the perturbation. Numerical simulations using stochastic differential equations of the species give consistency to our results.

Evaluation of industrial ecology in the π-shaped curve area of China's Yellow River based on the grey Lotka-Volterra model

Industrial ecology (IE) is the process of constructing industrial-ecological systems (IES) with the realization of the mutual benefits for industrial system (IS) and ecological system (ES). Therefore, the IE level depends on the IES development and the relationship between IS and ES. This paper calculated the development index of ES and IS to account for IES development and adopted the grey Lotka-Volterra to analyze the relationship between IS and ES. Choosing the π-shaped curve area in the Yellow River basin of China as the study area, this paper analyzed its IE level and influence factors from 2005 to 2019. Findings include: (1) The development level of IES in the Area presented significant spatial differentiation and could be classified into three levels. (2) IS and ES remained in the stage of isolated development or mutual restriction. (3) IE was found to be positively correlated with scientific innovation, economic development, openness degree, pollution control, and industrial structure while negatively correlated with urbanization, resource consumption, and government influence.

On relaxation times of heteroclinic dynamics

Heteroclinic dynamics provide a suitable framework for describing transient dynamics such as cognitive processes in the brain. It is appreciated for being well reproducible and at the same time highly sensitive to external input. It is supposed to capture features of switching statistics between metastable states in the brain. Beyond the high sensitivity, a further desirable feature of these dynamics is to enable a fast adaptation to new external input. In view of this, we analyze relaxation times of heteroclinic motion toward a new resting state, when oscillations in heteroclinic networks are arrested by a quench of a bifurcation parameter from a parameter regime of oscillations to a regime of equilibrium states. As it turns out, the relaxation is underdamped and depends on the nesting of the attractor space, the size of the attractor's basin of attraction, the depth of the quench, and the level of noise. In the case of coupled heteroclinic units, it depends on the coupling strength, the coupling type, and synchronization between different units. Depending on how these factors are combined, finite relaxation times may support or impede a fast switching to new external input. Our results also shed some light on the discussion of how the stability of a system changes with its complexity.

Evolution of conditional cooperation in collective-risk social dilemma with repeated group interactions

The evolution and long-term sustenance of cooperation has consistently piqued scholarly interest across the disciplines of evolutionary biology and social sciences. Previous theoretical and experimental studies on collective risk social dilemma games have revealed that the risk of collective failure will affect the evolution of cooperation. In the real world, individuals usually adjust their decisions based on environmental factors such as risk intensity and cooperation level. However, it is still not well understood how such conditional behaviours affect the evolution of cooperation in repeated group interactions scenario from a theoretical perspective. Here, we construct an evolutionary game model with repeated interactions, in which defectors decide whether to cooperate in subsequent rounds of the game based on whether the risk exceeds their tolerance threshold and whether the number of cooperators exceeds the collective goal in the early rounds of the game. We find that the introduction of conditional cooperation strategy can effectively promote the emergence of cooperation, especially when the risk is low. In addition, the risk threshold significantly affects the evolutionary outcomes, with a high risk promoting the emergence of cooperation. Importantly, when the risk of failure to reach collective goals exceeds a certain threshold, the timely transition from a defective strategy to a cooperative strategy by conditional cooperators is beneficial for maintaining high-level cooperation.

Reputation and reciprocity

Reputation and reciprocity are key mechanisms for cooperation in human societies, often going hand in hand to favor prosocial behavior over selfish actions. Here we review recent researches at the interface of physics and evolutionary game theory that explored these two mechanisms. We focus on image scoring as the bearer of reputation, as well as on various types of reciprocity, including direct, indirect, and network reciprocity. We review different definitions of reputation and reciprocity dynamics, and we show how these affect the evolution of cooperation in social dilemmas. We consider first-order, second-order, as well as higher-order models in well-mixed and structured populations, and we review experimental works that support and inform the results of mathematical modeling and simulations. We also provide a synthesis of the reviewed researches along with an outlook in terms of six directions that seem particularly promising to explore in the future.

Influence of physical interactions on spatiotemporal patterns

Spatiotemporal patterns are often modeled using reaction-diffusion equations, which combine complex reactions between constituents with ideal diffusive motion. Such descriptions neglect physical interactions between constituents, which might affect resulting patterns. To overcome this, we study how physical interactions affect cyclic dominant reactions, like the seminal rock-paper-scissors game, which exhibits spiral waves for ideal diffusion. Generalizing diffusion to incorporate physical interactions, we find that weak interactions change the length- and time scales of spiral waves, consistent with a mapping to the complex Ginzburg-Landau equation. In contrast, strong repulsive interactions typically generate oscillating lattices, and strong attraction leads to an interplay of phase separation and chemical oscillations, like droplets co-locating with cores of spiral waves. Our work suggests that physical interactions are relevant for forming spatiotemporal patterns in nature, and it might shed light on how biodiversity is maintained in ecological settings.

Time delays shape the eco-evolutionary dynamics of cooperation

We study the intricate interplay between ecological and evolutionary processes through the lens of the prisoner's dilemma game. But while previous studies on cooperation amongst selfish individuals often assume instantaneous interactions, we take into consideration delays to investigate how these might affect the causes underlying prosocial behavior. Through analytical calculations and numerical simulations, we demonstrate that delays can lead to oscillations, and by incorporating also the ecological variable of altruistic free space and the evolutionary strategy of punishment, we explore how these factors impact population and community dynamics. Depending on the parameter values and the initial fraction of each strategy, the studied eco-evolutionary model can mimic a cyclic dominance system and even exhibit chaotic behavior, thereby highlighting the importance of complex dynamics for the effective management and conservation of ecological communities. Our research thus contributes to the broader understanding of group decision-making and the emergence of moral behavior in multidimensional social systems.

Exploring inbreeding dynamics by considering reproductive bound and polygyny

Inbreeding is a clinically significant measure of a population dependent on human social structures including the population size or the cultural traits. Here, we propose an expanded and elaborate model to analyze the inbreeding within a population where explicit polygyny and inbreeding bounds are taken into account. Unlike the models presented so far, we implemented biologically realistic assumptions that there is the disproportionate probability of males to reproduce (polygyny) and female reproduction is bounded. Using the proposed model equations, we changed the parameters that represent the polygyny degree, the female reproductive bound correlated to the mutation rate, and the total population size. The disappearance of the polygyny that numerous human societies experienced results in the long-lasting effect of the decreasing inbreeding coefficient. Decreased female reproductive bound correlated with a higher mutation rate reveals similar results. After the effect of each factor is analyzed, we modeled the dynamics of the inbreeding coefficient throughout an imaginary human population where polygyny disappears and late marriage becomes prevalent. In this group, the population size gradually and exponentially increases reflecting the traits of prehistoric human society and rising agricultural productivity. To observe how late and less marriage, the feature of the modern developed society, affects the inbreeding dynamics, the female reproductive bound and the population size were assumed to decrease after the population upsurge. The model can explain the decreasing trend of the prehistoric inbreeding coefficient of the actual human population and predict how the trend will be shifted when traits of modern societies continue.

Influence and influenceability: global directionality in directed complex networks

Knowing which nodes are influential in a complex network and whether the network can be influenced by a small subset of nodes is a key part of network analysis. However, many traditional measures of importance focus on node level information without considering the global network architecture. We use the method of trophic analysis to study directed networks and show that both 'influence' and 'influenceability' in directed networks depend on the hierarchical structure and the global directionality, as measured by the trophic levels and trophic coherence, respectively. We show that in directed networks trophic hierarchy can explain: the nodes that can reach the most others; where the eigenvector centrality localizes; which nodes shape the behaviour in opinion or oscillator dynamics; and which strategies will be successful in generalized rock-paper-scissors games. We show, moreover, that these phenomena are mediated by the global directionality. We also highlight other structural properties of real networks related to influenceability, such as the pseudospectra, which depend on trophic coherence. These results apply to any directed network and the principles highlighted-that node hierarchy is essential for understanding network influence, mediated by global directionality-are applicable to many real-world dynamics.

Dynamics of a linearly perturbed May-Leonard competition model

The May-Leonard model was introduced to examine the behavior of three competing populations where rich dynamics, such as limit cycles and nonperiodic cyclic solutions, arise. In this work, we perturb the system by adding the capability of global mutations, allowing one species to evolve to the other two in a linear manner. We find that for small mutation rates, the perturbed system not only retains some of the dynamics seen in the classical model, such as the three-species equal-population equilibrium bifurcating to a limit cycle, but also exhibits new behavior. For instance, we capture curves of fold bifurcations where pairs of equilibria emerge and then coalesce. As a result, we uncover parameter regimes with new types of stable fixed points that are distinct from the single- and dual-population equilibria characteristic of the original model. On the contrary, the linearly perturbed system fails to maintain heteroclinic connections that exist in the original system. In short, a linear perturbation proves to be significant enough to substantially influence the dynamics, even with small mutation rates.

Emerging solutions from the battle of defensive alliances

Competing strategies in an evolutionary game model, or species in a biosystem, can easily form a larger unit which protects them from the invasion of an external actor. Such a defensive alliance may have two, three, four or even more members. But how effective can be such formation against an alternative group composed by other competitors? To address this question we study a minimal model where a two-member and a four-member alliances fight in a symmetric and balanced way. By presenting representative phase diagrams, we systematically explore the whole parameter range which characterizes the inner dynamics of the alliances and the intensity of their interactions. The group formed by a pair, who can exchange their neighboring positions, prevail in the majority of the parameter region. The rival quartet can only win if their inner cyclic invasion rate is significant while the mixing rate of the pair is extremely low. At specific parameter values, when neither of the alliances is strong enough, new four-member solutions emerge where a rock-paper-scissors-like trio is extended by the other member of the pair. These new solutions coexist hence all six competitors can survive. The evolutionary process is accompanied by serious finite-size effects which can be mitigated by appropriately chosen prepared initial states.

Nutrients and flow shape the cyclic dominance games between Escherichia coli strains

Evolutionary game theory has provided various models to explain the coexistence of competing strategies, one of which is the rock-paper-scissors (RPS) game. A system of three Escherichia coli strains-a toxin-producer, a resistant and a sensitive-has become a classic experimental model for studying RPS games. Previous experimental and theoretical studies, however, often ignored the influence of ecological factors such as nutrients and toxin dynamics on the evolutionary game dynamics. In this work, we combine experiments and modelling to study how these factors affect competition dynamics. Using three-dimensional printed mini-bioreactors, we tracked the frequency of the three strains in different culturing media and under different flow regimes. Although our experimental system fulfilled the requirements of cyclic dominance, we did not observe clear cycles or long-term coexistence between strains. We found that both nutrients and flow rates strongly impacted population dynamics. In our simulations, we explicitly modelled the release, removal and diffusion of toxin. We showed that the amount of toxin that is retained in the system is a simple indicator that can predict competition outcomes across broad parameter space. Moreover, our simulation results suggest that high rates of toxin diffusion might have prevented cyclic patterns from emerging in our experimental system. This article is part of the theme issue 'Half a century of evolutionary games: a synthesis of theory, application and future directions'.

Eco-evolutionary cyclic dominance among predators, prey, and parasites

Predator-prey interactions are one of ecology's central research themes, but with many interdisciplinary implications across the social and natural sciences. Here we consider an often-overlooked species in these interactions, namely parasites. We first show that a simple predator-prey-parasite model, inspired by the classical Lotka-Volterra equations, fails to produce a stable coexistence of all three species, thus failing to provide a biologically realistic outcome. To improve this, we introduce free space as a relevant eco-evolutionary component in a new mathematical model that uses a game-theoretical payoff matrix to describe a more realistic setup. We then show that the consideration of free space stabilizes the dynamics by means of cyclic dominance that emerges between the three species. We determine the parameter regions of coexistence as well as the types of bifurcations leading to it by means of analytical derivations as well as by means of numerical simulations. We conclude that the consideration of free space as a finite resource reveals the limits of biodiversity in predator-prey-parasite interactions, and it may also help us in the determination of factors that promote a healthy biota.

Locally adaptive aggregation of organisms under death risk in rock-paper-scissors models

We run stochastic simulations of the spatial version of the rock-paper-scissors game, considering that individuals use sensory abilities to scan the environment to detect the presence of enemies. If the local dangerousness level is above a tolerable threshold, individuals aggregate instead of moving randomly on the lattice. We study the impact of the locally adaptive aggregation on the organisms' spatial organisation by measuring the characteristic length scale of the spatial domains occupied by organisms of a single species. Our results reveal that aggregation is beneficial if triggered when the local density of opponents does not exceed 30%; otherwise, the behavioural strategy may harm individuals by increasing the average death risk. We show that if organisms can perceive further distances, they can accurately scan and interpret the signals from the neighbourhood, maximising the effects of the locally adaptive aggregation on the death risk. Finally, we show that the locally adaptive aggregation behaviour promotes biodiversity independently of the organism's mobility. The coexistence probability rises if organisms join conspecifics, even in the presence of a small number of enemies. We verify that our conclusions hold for more complex systems by simulating the generalised rock-paper-scissors models with five and seven species. Our discoveries may be helpful to ecologists in understanding systems where organisms' self-defence behaviour adapts to local environmental cues.

Complex evolutionary interactions in multiple populations

In competitive settings that entail several populations, individuals often engage in intra- and interpopulation interactions that determine their fitness and evolutionary success. With this simple motivation, we here study a multipopulation model where individuals engage in group interactions within their own population and in pairwise interactions with individuals from different populations. We use the evolutionary public goods game and the prisoner's dilemma game to describe these group and pairwise interactions, respectively. We also take into account asymmetry in the extent to which group and pairwise interactions determine the fitness of individuals. We find that interactions across multiple populations reveal new mechanisms through which the evolution of cooperation can be promoted, but this depends on the level of interaction asymmetry. If inter- and intrapopulation interactions are symmetric, the sole presence of multiple populations promotes the evolution of cooperation. Asymmetry in the interactions can further promote cooperation at the expense of the coexistence of the competing strategies. An in-depth analysis of the spatiotemporal dynamics reveals loop-dominated structures and pattern formation that can explain the various evolutionary outcomes. Thus, complex evolutionary interactions in multiple populations reveal an intricate interplay between cooperation and coexistence, and they also open up the path toward further explorations of multipopulation games and biodiversity.

How local antipredator response unbalances the rock-paper-scissors model

Antipredator behavior is a self-preservation strategy present in many biological systems, where individuals join the effort in a collective reaction to avoid being caught by an approaching predator. We study a nonhierarchical tritrophic system, whose predator-prey interactions are described by the rock-paper-scissors game rules. We perform a set of spatial stochastic simulations where organisms of one out of the species can resist predation in a collective strategy. The drop in predation capacity is local, which means that each predator faces a particular opposition depending on the prey group size surrounding it. Considering that the interference in a predator action depends on the prey's physical and cognitive ability, we explore the role of a conditioning factor that indicates the fraction of the species apt to perform the antipredator strategy. Because of the local unbalancing of the cyclic predator-prey interactions, departed spatial domains mainly occupied by a single species emerge. Unlike the rock-paper-scissors model with a weak species because of a nonlocal reason, our findings show that if the predation probability of one species is reduced because individuals face local antipredator response, the species does not predominate. Instead, the local unbalancing of the rock-paper-scissors model results in the prevalence of the weak species' prey. Finally, the outcomes show that local unevenness may jeopardize biodiversity, with the coexistence being more threatened for high mobility.

Shifts in evolutionary balance of phenotypes under environmental changes

Environments shape communities by driving individual interactions and the evolutionary outcome of competition. In static, homogeneous environments a robust, evolutionary stable, outcome is sometimes reachable. However, inherently stochastic, this evolutionary process need not stabilize, resulting in a dynamic ecological state, often observed in microbial communities. We use evolutionary games to study the evolution of phenotypic competition in dynamic environments. Under the assumption that phenotypic expression depends on the environmental shifts, existing periodic relationships may break or result in formation of new periodicity in phenotypic interactions. The exact outcome depends on the environmental shift itself, indicating the importance of understanding how environments influence affected systems. Under periodic environmental fluctuations, a stable state preserving dominant phenotypes may exist. However, rapid environmental shifts can lead to critical shifts in the phenotypic evolutionary balance. This might lead to environmentally favoured phenotypes dominating making the system vulnerable. We suggest that understanding of the robustness of the system's current state is necessary to anticipate when it will shift to a new equilibrium via understanding what level of perturbations the system can take before its equilibrium changes. Our results provide insights in how microbial communities can be steered to states where they are dominated by desired phenotypes.

Social norms of fairness with reputation-based role assignment in the dictator game

A vast body of experiments share the view that social norms are major factors for the emergence of fairness in a population of individuals playing the dictator game (DG). Recently, to explore which social norms are conducive to sustaining cooperation has obtained considerable concern. However, thus, far few studies have investigated how social norms influence the evolution of fairness by means of indirect reciprocity. In this study, we propose an indirect reciprocal model of the DG and consider that an individual can be assigned as the dictator due to its good reputation. We investigate the "leading eight" norms and all second-order social norms by a two-timescale theoretical analysis. We show that when role assignment is based on reputation, four of the "leading eight" norms, including stern judging and simple standing, lead to a high level of fairness, which increases with the selection intensity. Our work also reveals that not only the correct treatment of making a fair split with good recipients but also distinguishing unjustified unfair split from justified unfair split matters in elevating the level of fairness.

Emerging diversity in a population of evolving intransitive dice

Exploiting the mathematical curiosity of intransitive dice, we present a simple theoretical model for coevolution that captures scales ranging from the genome of the individual to the system-wide emergence of species diversity. We study a set of evolving agents that interact competitively in a closed system, in which both the dynamics of mutations and competitive advantage emerge directly from interpreting a genome as the sides of a die. The model demonstrates sympatric speciation where new species evolve from existing ones while in contact with the entire ecosystem. Allowing free mutations both in the genomes and the mutation rates, we find, in contrast to hierarchical models of fitness, the emergence of a metastable state of finite mutation rate and diversity.

Spatial organisation plasticity reduces disease infection risk in rock-paper-scissors models

We study a three-species cyclic game system where organisms face a contagious disease whose virulence may change by a pathogen mutation. As a responsive defence strategy, organisms' mobility is restricted to reduce disease dissemination in the system. The impact of the collective self-preservation strategy on the disease infection risk is investigated by performing stochastic simulations of the spatial version of the rock-paper-scissors game. Our outcomes show that the mobility control strategy induces plasticity in the spatial patterns with groups of organisms of the same species inhabiting spatial domains whose characteristic length scales depend on the level of dispersal restrictions. The spatial organisation plasticity allows the ecosystems to adapt to minimise the individuals' disease contamination risk if an eventual pathogen alters the disease virulence. We discover that if a pathogen mutation makes the disease more transmissible or less lethal, the organisms benefit more if the mobility is not strongly restricted, thus forming large spatial domains. Conversely, the benefits of protecting against a pathogen causing a less contagious or deadlier disease are maximised if the average size of groups of individuals of the same species is significantly limited, reducing the dimensions of groups of organisms significantly. Our findings may help biologists understand the effects of dispersal control as a conservation strategy in ecosystems affected by epidemic outbreaks.

Community formation in wealth-mediated thermodynamic strategy evolution

We study a dynamical system defined by a repeated game on a 1D lattice, in which the players keep track of their gross payoffs over time in a bank. Strategy updates are governed by a Boltzmann distribution, which depends on the neighborhood bank values associated with each strategy, relative to a temperature scale, which defines the random fluctuations. Players with higher bank values are, thus, less likely to change strategy than players with a lower bank value. For a parameterized rock-paper-scissors game, we derive a condition under which communities of a given strategy form with either fixed or drifting boundaries. We show the effect of a temperature increase on the underlying system and identify surprising properties of this model through numerical simulations.

Controlling species densities in structurally perturbed intransitive cycles with higher-order interactions

The persistence of biodiversity of species is a challenging proposition in ecological communities in the face of Darwinian selection. The present article investigates beyond the pairwise competitive interactions and provides a novel perspective for understanding the influence of higher-order interactions on the evolution of social phenotypes. Our simple model yields a prosperous outlook to demonstrate the impact of perturbations on intransitive competitive higher-order interactions. Using a mathematical technique, we show how alone the perturbed interaction network can quickly determine the coexistence equilibrium of competing species instead of solving a large system of ordinary differential equations. It is possible to split the system into multiple feasible cluster states depending on the number of perturbations. Our analysis also reveals that the ratio between the unperturbed and perturbed species is inversely proportional to the amount of employed perturbation. Our results suggest that nonlinear dynamical systems and interaction topologies can be interplayed to comprehend species' coexistence under adverse conditions. Particularly, our findings signify that less competition between two species increases their abundance and outperforms others.

Correlation between the formation of new competing group and spatial scale for biodiversity in the evolutionary dynamics of cyclic competition

Securing space for species breeding is important in the evolution and maintenance of life in ecological sciences, and an increase in the number of competing species may cause frequent competition and conflict among the population in securing such spaces in a given area. In particular, for cyclically competing species, which can be described by the metaphor of rock-paper-scissors game, most of the previous works in microscopic frameworks have been studied with the initially given three species without any formation of additional competing species, and the phase transition of biodiversity via mobility from coexistence to extinction has never been changed by a change of spatial scale. In this regard, we investigate the relationship between spatial scales and species coexistence in the spatial cyclic game by considering the emergence of a new competing group by mutation. For different spatial scales, our computations reveal that coexistence can be more sensitive to spatial scales and may require larger spaces for frequencies of interactions. By exploiting the calculation of the coexistence probability from Monte-Carlo simulations, we obtain that certain interaction ranges for coexistence can be affected by both spatial scales and mobility, and spatial patterns for coexistence can appear in different ways. Since the issue of spatial scale is important for species survival as competing populations increase, we expect our results to have broad applications in the fields of social and ecological sciences.

Indirect exclusion can promote cooperation in repeated group interactions

Social exclusion has been regarded as one of the most effective measures to promote the evolution of cooperation. In real society, the way in which social exclusion works can be direct or indirect. However, thus far there is no related work to explore how indirect exclusion influences the evolution of cooperation from a theoretical perspective. Here, we introduce indirect exclusion into the repeated public goods game where the game organizer probabilistically selects cooperators after the first game round to participate in the following possible game interactions. We then investigate the evolutionary dynamics of cooperation both in infinite and finite well-mixed populations. Through theoretical analysis and numerical calculations, we find that the introduction of indirect exclusion can induce the stable coexistence of cooperators and defectors or the dominance of cooperators, which thus effectively promotes the evolution of cooperation. Besides, we show that the identifying probability of the organizer has a nonlinear effect on public cooperation when its value is lower than an intermediate value, while the higher identifying probability can maintain a high level of cooperation. Furthermore, our results show that increasing the average rounds of game interactions can effectively promote the evolution of cooperation.

Emerging spatiotemporal patterns in cyclic predator-prey systems with habitats

Three-species cyclic predator-prey systems are known to establish spiral waves that allow species to coexist. In this study, we analyze a structured heterogeneous system which gives one species an advantage to escape predation in an area that we refer to as a habitat and study the effect on species coexistence and emerging spatiotemporal patterns. Counterintuitively, the predator of the advantaged species emerges as dominant species with the highest average density inside the habitat. The species given the advantage in the form of an escape rate has the lowest average density until some threshold value for the escape rate is exceeded, after which the density of the species with the advantage overtakes that of its prey. Numerical analysis of the spatial density of each species as well as of the spatial two-point correlation function for both inside and outside the habitats allow a detailed quantitative discussion. Our analysis is extended to a six-species game that exhibits spontaneous spiral waves, which displays similar but more complicated results.

Enhanced cooperation in multiplayer snowdrift games with random and dynamic groupings

An analytically tractable generalization of the N-person snowdrift (NSG) game that illustrates how cooperation can be enhanced is proposed and studied. The number of players competing within a NSG varies from one time step to another. Exact equations governing the frequency of cooperation f_{c}(r) as a function of the cost-to-benefit ratio r within an imitation strategy updating scheme are presented. For group sizes g uniformly distributed within the range g∈[1,g_{m}], an analytic formula for the critical value r_{c}(g_{m}), below which the system evolves into a totally cooperative (AllC) state, is derived. In contrast, a fixed group size NSG does not support an AllC state. The result r_{c}(g_{m}) requires the presence of sole-player groups and involves the inverse of the harmonic numbers and, more generally, the inverse first moment of the group size distribution. For r>r_{c}(g_{m}), the equation that determines the dynamical mixed states f_{c}(r) is given, with exact solutions existing for g_{m}≤5. The exact treatment allows the study of the phase boundary between the AllC state and the mixed states. The analytic results are checked against simulation results and exact agreements are demonstrated. The analytic form of the critical r_{c}(g_{m}) illustrates the necessity of having groups of a sole player in the evolutionary process. This result is supported by simulations with group sizes excluding the sole groups for which no AllC state emerges. A physically transparent picture of the importance of the sole players in inducing an AllC state is further presented based on the last surviving pattern before the AllC state is attained. The exact expression r_{c}(g_{m}) turns out to remain valid for nonuniform group-size distributions. Our analytical tractable generalization, therefore, sheds light on how a competing environment with variable group sizes could enhance cooperation and induce an AllC state.

Dynamics on higher-order networks: a review

Network science has evolved into an indispensable platform for studying complex systems. But recent research has identified limits of classical networks, where links connect pairs of nodes, to comprehensively describe group interactions. Higher-order networks, where a link can connect more than two nodes, have therefore emerged as a new frontier in network science. Since group interactions are common in social, biological and technological systems, higher-order networks have recently led to important new discoveries across many fields of research. Here, we review these works, focusing in particular on the novel aspects of the dynamics that emerges on higher-order networks. We cover a variety of dynamical processes that have thus far been studied, including different synchronization phenomena, contagion processes, the evolution of cooperation and consensus formation. We also outline open challenges and promising directions for future research.

Multi-strategy evolutionary games: A Markov chain approach

Interacting strategies in evolutionary games is studied analytically in a well-mixed population using a Markov chain method. By establishing a correspondence between an evolutionary game and Markov chain dynamics, we show that results obtained from the fundamental matrix method in Markov chain dynamics are equivalent to corresponding ones in the evolutionary game. In the conventional fundamental matrix method, quantities like fixation probability and fixation time are calculable. Using a theorem in the fundamental matrix method, conditional fixation time in the absorbing Markov chain is calculable. Also, in the ergodic Markov chain, the stationary probability distribution that describes the Markov chain’s stationary state is calculable analytically. Finally, the Rock, scissor, paper evolutionary game are evaluated as an example, and the results of the analytical method and simulations are compared. Using this analytical method saves time and computational facility compared to prevalent simulation methods.

Lotka-Volterra versus May-Leonard formulations of the spatial stochastic rock-paper-scissors model: The missing link

The rock-paper-scissors (RPS) model successfully reproduces some of the main features of simple cyclic predator-prey systems with interspecific competition observed in nature. Still, lattice-based simulations of the spatial stochastic RPS model are known to give rise to significantly different results, depending on whether the three-state Lotka-Volterra or the four-state May-Leonard formulation is employed. This is true independently of the values of the model parameters and of the use of either a von Neumann or a Moore neighborhood. In this paper, we introduce a simple modification to the standard spatial stochastic RPS model in which the range of the search of the nearest neighbor may be extended up to a maximum Euclidean radius R. We show that, with this adjustment, the Lotka-Volterra and May-Leonard formulations can be designed to produce similar results, both in terms of dynamical properties and spatial features, by means of an appropriate parameter choice. In particular, we show that this modified spatial stochastic RPS model naturally leads to the emergence of spiral patterns in both its three- and four-state formulations.

Non-Hermitian topology in rock-paper-scissors games

Non-Hermitian topology is a recent hot topic in condensed matters. In this paper, we propose a novel platform drawing interdisciplinary attention: rock–paper–scissors (RPS) cycles described by the evolutionary game theory. Specifically, we demonstrate the emergence of an exceptional point and a skin effect by analyzing topological properties of their payoff matrix. Furthermore, we discover striking dynamical properties in an RPS chain: the directive propagation of the population density in the bulk and the enhancement of the population density only around the right edge. Our results open new avenues of the non-Hermitian topology and the evolutionary game theory.

Higher-order effects, continuous species interactions, and trait evolution shape microbial spatial dynamics

Persistently diverse microbial communities are one of biology’s great puzzles. Using a modeling framework that accommodates high mutation rates and a continuum of species traits, we studied microbial communities in which antagonistic interactions occur via the production of, inhibition of, and vulnerability to toxins (e.g., antibiotics). Mutation size and mobility enhanced microbial diversity and temporal persistence to extraordinarily high levels. These findings—including the discovery that the duration of the transient phase in community assembly provides a guide to equilibrial diversity—highlight the potentially critical role that antagonistic interactions play in promoting the diversity of bacterial systems. Such interactions, together with resource-driven interactions and spatial structure, may drive the enigmatic levels of biodiversity seen in microbial systems.

The assembly and maintenance of microbial diversity in natural communities, despite the abundance of toxin-based antagonistic interactions, presents major challenges for biological understanding. A common framework for investigating such antagonistic interactions involves cyclic dominance games with pairwise interactions. The incorporation of higher-order interactions in such models permits increased levels of microbial diversity, especially in communities in which antibiotic-producing, sensitive, and resistant strains coexist. However, most such models involve a small number of discrete species, assume a notion of pure cyclic dominance, and focus on low mutation rate regimes, none of which well represent the highly interlinked, quickly evolving, and continuous nature of microbial phenotypic space. Here, we present an alternative vision of spatial dynamics for microbial communities based on antagonistic interactions—one in which a large number of species interact in continuous phenotypic space, are capable of rapid mutation, and engage in both direct and higher-order interactions mediated by production of and resistance to antibiotics. Focusing on toxin production, vulnerability, and inhibition among species, we observe highly divergent patterns of diversity and spatial community dynamics. We find that species interaction constraints (rather than mobility) best predict spatiotemporal disturbance regimes, whereas community formation time, mobility, and mutation size best explain patterns of diversity. We also report an intriguing relationship among community formation time, spatial disturbance regimes, and diversity dynamics. This relationship, which suggests that both higher-order interactions and rapid evolution are critical for the origin and maintenance of microbial diversity, has broad-ranging links to the maintenance of diversity in other systems.

Effect of mobility in the rock-paper-scissor dynamics with high mortality

In the evolutionary dynamics of a rock-paper-scissor model, the effect of natural death plays a major role in determining the fate of the system. Coexistence, being an unstable fixed point of the model, becomes very sensitive toward this parameter. In order to study the effect of mobility in such a system which has explicit dependence on mortality, we perform Monte Carlo simulation on a two-dimensional lattice having three cyclically competing species. The spatiotemporal dynamics has been studied along with the two-site correlation function. Spatial distribution exhibits emergence of spiral patterns in the presence of mobility. It reveals that the joint effect of death rate and mobility (diffusion) leads to new coexistence and extinction scenarios.

Mobility-limiting antipredator response in the rock-paper-scissors model

Antipredator behavior is present in many biological systems where individuals collectively react to an imminent attack. The antipredator response may influence spatial pattern formation and ecosystem stability but requires an organism's cost to contribute to the collective effort. We investigate a nonhierarchical tritrophic system, whose predator-prey interactions are described by the rock-paper-scissors game rules. In our spatial stochastic simulations, the radius of antipredator response defines the maximum prey group size that disturbs the predator's action, determining the individual cost to participate in antipredator strategies. We consider that each organism contributes equally to the collective effort, having its mobility limited by the proportion of energy devoted to the antipredator reaction. Our outcomes show that the antipredator response leads to spiral patterns, with the segregation of organisms of the same species occupying departed spatial domains. We found that a less localized antipredator response increases the average size of the single-species patches, improving the protection of individuals against predation. Finally, our findings show that although the increase of the predation risk for a more localized antipredator response, the high mobility constraining benefits species coexistence. Our results may help ecologists understand the mechanisms leading to the stability of biological systems where locality is crucial to behavioral interactions among species.