A neural network model for the evolution of learning in changing environments

Learning from past experience is an important adaptation and theoretical models may help to understand its evolution. Many of the existing models study simple phenotypes and do not consider the mechanisms underlying learning while the more complex neural network models often make biologically unrealistic assumptions and rarely consider evolutionary questions. Here, we present a novel way of modelling learning using small neural networks and a simple, biology-inspired learning algorithm. Learning affects only part of the network, and it is governed by the difference between expectations and reality. We use this model to study the evolution of learning under various environmental conditions and different scenarios for the trade-off between exploration (learning) and exploitation (foraging). Efficient learning readily evolves in our individual-based simulations. However, in line with previous studies, the evolution of learning is less likely in relatively constant environments, where genetic adaptation alone can lead to efficient foraging, or in short-lived organisms that cannot afford to spend much of their lifetime on exploration. Once learning does evolve, the characteristics of the learning strategy (i.e. the duration of the learning period and the learning rate) and the average performance after learning are surprisingly little affected by the frequency and/or magnitude of environmental change. In contrast, an organism's lifespan and the distribution of resources in the environment have a clear effect on the evolved learning strategy: a shorter lifespan or a broader resource distribution lead to fewer learning episodes and larger learning rates. Interestingly, a longer learning period does not always lead to better performance, indicating that the evolved neural networks differ in the effectiveness of learning. Overall, however, we show that a biologically inspired, yet relatively simple, learning mechanism can evolve to lead to an efficient adaptation in a changing environment.

Unravelling the many facets of human cooperation in an experimental study

Humans readily cooperate, even with strangers and without prospects of reciprocation. Despite thousands of studies, this finding is not well understood. Most studies focussed on a single aspect of cooperation and were conducted under anonymous conditions. However, cooperation is a multi-faceted phenomenon, involving generosity, readiness to share, fairness, trust, trustworthiness, and willingness to take cooperative risks. Here, we report findings of an experiment where subjects had to make decisions in ten situations representing different aspects of cooperation, both under anonymous and 'personalised' conditions. In an anonymous setting, we found considerable individual variation in each decision situation, while individuals were consistent both within and across situations. Prosocial tendencies such as generosity, trust, and trustworthiness were positively correlated, constituting a 'cooperativeness syndrome', but the tendency to punish non-cooperative individuals is not part of this syndrome. In a personalised setting, information on the appearance of the interaction partner systematically affected cooperation-related behaviour. Subjects were more cooperative toward interaction partners whose facial photographs were judged 'generous', 'trustworthy', 'not greedy', 'happy', 'attractive', and 'not angry' by a separate panel. However, individuals eliciting more cooperation were not more cooperative themselves in our experiment. Our study shows that a multi-faceted approach can reveal general behavioural tendencies underlying cooperation, but it also uncovers new puzzling features of human cooperation.

The sex-specific factor SOA controls dosage compensation in Anopheles mosquitoes

The Anopheles mosquito is one of thousands of species in which sex differences play a central part in their biology, as only females need a blood meal to produce eggs. Sex differentiation is regulated by sex chromosomes, but their presence creates a dosage imbalance between males (XY) and females (XX). Dosage compensation (DC) can re-equilibrate the expression of sex chromosomal genes. However, because DC mechanisms have only been fully characterized in a few model organisms, key questions about its evolutionary diversity and functional necessity remain unresolved1. Here we report the discovery of a previously uncharacterized gene (sex chromosome activation (SOA)) as a master regulator of DC in the malaria mosquito Anopheles gambiae. Sex-specific alternative splicing prevents functional SOA protein expression in females. The male isoform encodes a DNA-binding protein that binds the promoters of active X chromosomal genes. Expressing male SOA is sufficient to induce DC in female cells. Male mosquitoes lacking SOA or female mosquitoes ectopically expressing the male isoform exhibit X chromosome misregulation, which is compatible with viability but causes developmental delay. Thus, our molecular analyses of a DC master regulator in a non-model organism elucidates the evolutionary steps that lead to the establishment of a chromosome-specific fine-tuning mechanism.

Transient polymorphisms in parental care strategies drive divergence of sex roles

The parental roles of males and females differ considerably between and within species. By means of individual-based evolutionary simulations, we strive to explain this diversity. We show that the conflict between the sexes creates a sex bias (towards maternal or paternal care), even if the two sexes are initially identical. When including sexual selection, there are two outcomes: either female mate choice and maternal care or no mate choice and paternal care. Interestingly, the care pattern drives sexual selection and not vice versa. Longer-term simulations exhibit rapid switches between alternative parental care patterns, even in constant environments. Hence, the evolutionary lability of sex roles observed in phylogenetic studies is not necessarily caused by external changes. Overall, our findings are in striking contrast to the predictions of mathematical models. We show that the discrepancies are caused by transient within-sex polymorphisms in parental strategies, a factor largely neglected in current sex-role theory.

Human genomic data have different statistical properties than the data of randomised controlled trials

Madole & Harden argue that the Mendelian reshuffling of genes and genomes is analogous to randomised controlled trials. We are not convinced by their arguments. First, their recipe for meeting the demands on randomised experiments is inherently inconsistent. Second, disequilibrium across chromosomes conflicts with their assumption of statistical independence. Third, the genome-wide association study (GWAS) method has many pitfalls, including low repeatability.

The Joint Evolution of Animal Movement and Competition Strategies

AbstractCompetition typically takes place in a spatial context, but eco-evolutionary models rarely address the joint evolution of movement and competition strategies. Here we investigate a spatially explicit forager-kleptoparasite model where consumers can either forage on a heterogeneous resource landscape or steal resource items from conspecifics (kleptoparasitism). We consider three scenarios: (1) foragers without kleptoparasites, (2) consumers specializing as foragers or as kleptoparasites, and (3) consumers that can switch between foraging and kleptoparasitism depending on local conditions. We model movement strategies as individual-specific combinations of preferences for environmental cues, similar to step-selection coefficients. Using mechanistic, individual-based simulations, we study the joint evolution of movement and competition strategies, and we investigate the implications for the distribution of consumers over this landscape. Movement and competition strategies evolve rapidly and consistently across scenarios, with marked differences among scenarios, leading to differences in resource exploitation patterns. In scenario 1, foragers evolve considerable individual variation in movement strategies, while in scenario 2, movement strategies show a swift divergence between foragers and kleptoparasites. In scenario 3, where individuals' competition strategies are conditional on local cues, movement strategies facilitate kleptoparasitism, and individual consistency in competition strategy also emerges. Even in the absence of kleptoparasitism (scenario 1), the distribution of consumers deviates considerably from predictions of ideal free distribution models because of the intrinsic difficulty of moving effectively on a depleted resource landscape with few reliable cues. Our study emphasizes the advantages of a mechanistic approach when studying competition in a spatial context and suggests how evolutionary modeling can be integrated with current work in animal movement ecology.

Effects of season length and uniparental care efficacy on the evolution of parental care

Parental care patterns differ enormously among and even within species. This is exemplified by Chinese penduline tits Remiz consobrinus, where biparental care, female-only care, male-only care and biparental desertion all occur in the same population; moreover, the distribution of these care patterns differs systematically between populations. The eco-evolutionary determinants of this diversity are largely unknown. We developed an individual-based model that allows us to investigate the effects of season length and offspring needs (expressed by the efficacy with which a clutch can be raised by a single parent) on the evolution of parental care patterns. The model is largely conceptual, aiming at general conclusions. However, to keep the model realistic, its set-up and the choice of parameters are motivated by field studies on Chinese penduline tits. Exploring a wide range of parameters, we investigate how parental care patterns are affected by season length and offspring needs and whether and under what conditions diverse parental care patterns can stably coexist. We report five main findings. First, under a broad range of conditions, different care patterns (e.g. male care and biparental care) coexist at equilibrium. Second, for the same parameters, alternative evolutionary equilibria are possible; this can explain differences in care patterns across populations. Third, rapid evolutionary transitions can occur between alternative equilibria; this can explain the often-reported evolutionary lability of parental care patterns. Fourth, season length has a strong but nonmonotonic effect on the evolved care patterns. Fifth, when uniparental care efficacy is low, biparental care tends to evolve; however, in many scenarios uniparental care is still common at equilibrium. In addition, our study sheds new light on Trivers' hypothesis that the sex with the highest prezygotic investment is predestined to invest more postzygotically as well. Our study highlights that diversity in parental care can readily evolve and it shows that even in the absence of environmental change parental care patterns can be evolutionary labile. In the presence of directional environmental change, systematic shifts in care patterns are to be expected.

The estimation of reproductive values from pedigrees

Quantifying fitness is important to understand adaptive evolution. Reproductive values are useful for making fitness comparisons involving different categories of individuals, like males and females. By definition, the reproductive value of a category is the expected per capita contribution of the members of that category to the gene pool of future generations. Life history theory reveals how reproductive values can be determined via the estimation of life-history parameters, but this requires an adequate life-history model and intricate algebraic calculations. Recently, an alternative pedigree-based method has become popular, which estimates the expected genetic contribution of individuals to future generations by tracking their descendants down the pedigree. This method is versatile and intuitively appealing, but it is unknown if the method produces estimates of reproductive values that are accurate and precise. To investigate this, we implement various life-history scenarios (for which the "true" reproductive values can be calculated) in individual-based simulations, use the simulation data to estimate reproductive values with the pedigree method, and compare the results with the true target values. We show that the pedigree-based estimation of reproductive values is either biased (in the short term) or imprecise (in the long term). This holds even for simple life histories and under idealized conditions. We conclude that the pedigree method is not a good substitute for the traditional method to quantify reproductive values.

Novel pathogen introduction triggers rapid evolution in animal social movement strategies

Animal sociality emerges from individual decisions on how to balance the costs and benefits of being sociable. Novel pathogens introduced into wildlife populations should increase the costs of sociality, selecting against gregariousness. Using an individual-based model that captures essential features of pathogen transmission among social hosts, we show how novel pathogen introduction provokes the rapid evolutionary emergence and coexistence of distinct social movement strategies. These strategies differ in how they trade the benefits of social information against the risk of infection. Overall, pathogen-risk-adapted populations move more and have fewer associations with other individuals than their pathogen-risk-naive ancestors, reducing disease spread. Host evolution to be less social can be sufficient to cause a pathogen to be eliminated from a population, which is followed by a rapid recovery in social tendency. Our conceptual model is broadly applicable to a wide range of potential host-pathogen introductions and offers initial predictions for the eco-evolutionary consequences of wildlife pathogen spillover scenarios and a template for the development of theory in the ecology and evolution of animals' movement decisions.

Mesocosm experiment reveals scale dependence of movement tendencies in sticklebacks

Habitat fragmentation can have negative impacts on migratory organisms that rely on the functional connectivity between growing and breeding grounds. Quantifying the population-level phenotypic consequences of such fragmentation requires fine-scaled tracking of individual behaviour and movements across relevant scales. Here we make use of a natural experiment where some populations of 'migrant' three-spined sticklebacks (Gasterosteus aculeatus) became 'residents', following habitat fragmentation five decades ago. To test whether residents have a lower movement tendency than migrants, we developed a novel experimental platform that allows the automated tracking of individual movements via RFID technology in a semi-natural mesocosm where spatio-temporal scales and environmental conditions can be manipulated. We found that residents moved significantly less than migrants at large but not at small spatial scale. This pattern was consistent across time and contexts (water flow and group size). Our study substantiates prior literature on rapid phenotypic divergence in sticklebacks in response to human-induced isolation and highlights the importance of observing behaviour in ecologically relevant set-ups that bridge the gap between laboratory and field studies.

Effects of sex and sex-related facial traits on trust and trustworthiness: An experimental study

The ability to trust others, including strangers, is a prerequisite for human cooperation. Economically it is not rational to trust strangers, as trust can be easily exploited. Still, generally, the level of trust toward strangers is relatively high. Trust is closely related to trustworthiness: when trusting others, one expects them to reciprocate. Some individuals elicit more trust than others. Apparently, humans use subtle cues for judging the trustworthiness of their interaction partners. Here, we report on an experiment that investigates trust and trustworthiness in a population of 176 mainly Dutch students. The aims of our study were: (1) to investigate how the sex of interaction partners and their facial appearance (femininity/masculinity) affect the degree of trust and trustworthiness, compared to fully anonymous conditions; (2) to test whether individuals who elicit trust in their interaction partners are trustworthy themselves. Each subject of our experiment played five one-shot Trust Games: one with an anonymous interaction partner, and four "personalized" games after seeing a 20 s silent video of their interaction partner (twice same-sex, and twice opposite-sex). The degree of facial sexual dimorphism was investigated with geometric morphometrics based on full-face photographs. Our results revealed that, despite the already high level of trust in the anonymous setting, the personalization of interactions had a clear effect on behavior. Females elicited more trust in partners of both sexes. Interestingly, females with more feminine faces elicited less trust in both male and female partners, while males with more masculine facial shape were more trusted by females, but less trusted by males. Neither sex nor facial femininity/masculinity predicted trustworthiness. Our results demonstrate that (1) sex and sex-related facial traits of interaction partners have a clear effect on eliciting trust in strangers. However, (2) these cues are not reliable predictors of actual trustworthiness.

Assortative Mating in an Ecological Context: Effects of Mate Choice Errors and Relative Species Abundance on the Frequency and Asymmetry of Hybridization

AbstractThe frequency and asymmetry of mixed-species mating set the initial stage for the ecological and evolutionary implications of hybridization. How such patterns of mixed-species mating, in turn, are influenced by the combination of mate choice errors and relative species abundance remains largely unknown. We develop a mathematical model that generates predictions for how relative species abundances and mate choice errors affect hybridization patterns. When mate choice errors are small (<5%), the highest frequency of hybridization occurs when one of the hybridizing species is at low abundance, but when mate choice errors are high (>5%), the highest hybridization frequency occurs when species occur in equal proportions. Furthermore, females of the less abundant species are overrepresented in mixed-species matings. We compare our theoretical predictions with empirical data on naturally hybridizing Ficedula flycatchers and find that hybridization is highest when the two species occur in equal abundance, implying rather high mate choice errors. We discuss ecological and evolutionary implications of our findings and encourage future work on hybrid zone dynamics that take demographic aspects, such as relative species abundance, into account.

Adult sex ratios: causes of variation and implications for animal and human societies

Converging lines of inquiry from across the social and biological sciences target the adult sex ratio (ASR; the proportion of males in the adult population) as a fundamental population-level determinant of behavior. The ASR, which indicates the relative number of potential mates to competitors in a population, frames the selective arena for competition, mate choice, and social interactions. Here we review a growing literature, focusing on methodological developments that sharpen knowledge of the demographic variables underlying ASR variation, experiments that enhance understanding of the consequences of ASR imbalance across societies, and phylogenetic analyses that provide novel insights into social evolution. We additionally highlight areas where research advances are expected to make accelerating contributions across the social sciences, evolutionary biology, and biodiversity conservation.

Structural equation modeling reveals determinants of fitness in a cooperatively breeding bird

Even in well-studied organisms, it is often challenging to uncover the social and environmental determinants of fitness. Typically, fitness is determined by a variety of factors that act in concert, thus forming complex networks of causal relationships. Moreover, even strong correlations between social and environmental conditions and fitness components may not be indicative of direct causal links, as the measured variables may be driven by unmeasured (or unmeasurable) causal factors. Standard statistical approaches, like multiple regression analyses, are not suited for disentangling such complex causal relationships. Here, we apply structural equation modeling (SEM), a technique that is specifically designed to reveal causal relationships between variables, and which also allows to include hypothetical causal factors. Therefore, SEM seems ideally suited for comparing alternative hypotheses on how fitness differences arise from differences in social and environmental factors. We apply SEM to a rich data set collected in a long-term study on the Seychelles warbler (Acrocephalus sechellensis), a bird species with facultatively cooperative breeding and a high rate of extra-group paternity. Our analysis reveals that the presence of helpers has a positive effect on the reproductive output of both female and male breeders. In contrast, per capita food availability does not affect reproductive output. Our analysis does not confirm earlier suggestions on other species that the presence of helpers has a negative effect on the reproductive output of male breeders. As such, both female and male breeders should tolerate helpers in their territories, irrespective of food availability.

Habitat fragmentation induces rapid divergence of migratory and isolated sticklebacks

The adaptive capacity of many organisms is seriously challenged by human-imposed environmental change, which currently happens at unprecedented rates and magnitudes. For migratory fish, habitat fragmentation is a major challenge that can compromise their survival and reproduction. Therefore, it is important to study if fish populations can adapt to such modifications of their habitat. Here, we study whether originally anadromous three-spined stickleback populations (Gasterosteus aculeatus; “migrants”) changed in behavior and morphology in response to human-induced isolation. We made use of a natural field-experiment, where the construction of pumping stations and sluices in the 1970s unintendedly created replicates of land-locked stickleback populations (“resident”) in the Netherlands. For two years, we systematically tested populations of residents and migrants for differences in morphology and behavioral traits (activity, aggressiveness, exploration, boldness, and shoaling) in lab-based assays. We detected differences between migrant and resident populations in virtually all phenotypic traits studied: compared with the ancestral migrants, residents were smaller in size, had fewer and smaller plates and were significantly more active, aggressive, exploratory and bolder, and shoaled less. Despite large ecological differences between 2018 and 2019, results were largely consistent across the two years. Our study shows that human-induced environmental change has led to the rapid and consistent morphological and behavioral divergence of stickleback populations in about 50 generations. Such changes may be adaptive but this remains to be tested.

Complex eco-evolutionary dynamics induced by the coevolution of predator–prey movement strategies

The coevolution of predators and prey has been the subject of much empirical and theoretical research that produced intriguing insights into the interplay of ecology and evolution. To allow for mathematical analysis, models of predator–prey coevolution are often coarse-grained, focussing on population-level processes and largely neglecting individual-level behaviour. As selection is acting on individual-level properties, we here present a more mechanistic approach: an individual-based simulation model for the coevolution of predators and prey on a fine-grained resource landscape, where features relevant for ecology (like changes in local densities) and evolution (like differences in survival and reproduction) emerge naturally from interactions between individuals. Our focus is on predator–prey movement behaviour, and we present a new method for implementing evolving movement strategies in an efficient and intuitively appealing manner. Throughout their lifetime, predators and prey make repeated movement decisions on the basis of their movement strategies. Over the generations, the movement strategies evolve, as individuals that successfully survive and reproduce leave their strategy to more descendants. We show that the movement strategies in our model evolve rapidly, thereby inducing characteristic spatial patterns like spiral waves and static spots. Transitions between these patterns occur frequently, induced by antagonistic coevolution rather than by external events. Regularly, evolution leads to the emergence and stable coexistence of qualitatively different movement strategies within the same population. Although the strategy space of our model is continuous, we often observe the evolution of discrete movement types. We argue that rapid evolution, coexistent movement types, and phase shifts between different ecological regimes are not a peculiarity of our model but a result of more realistic assumptions on eco-evolutionary feedbacks and the number of evolutionary degrees of freedom.

Underappreciated features of cultural evolution

Cultural evolution theory has long been inspired by evolutionary biology. Conceptual analogies between biological and cultural evolution have led to the adoption of a range of formal theoretical approaches from population dynamics and genetics. However, this has resulted in a research programme with a strong focus on cultural transmission. Here, we contrast biological with cultural evolution, and highlight aspects of cultural evolution that have not received sufficient attention previously. We outline possible implications for evolutionary dynamics and argue that not taking them into account will limit our understanding of cultural systems. We propose 12 key questions for future research, among which are calls to improve our understanding of the combinatorial properties of cultural innovation, and the role of development and life history in cultural dynamics. Finally, we discuss how this vibrant research field can make progress by embracing its multidisciplinary nature. This article is part of the theme issue 'Foundations of cultural evolution'.

Phenotypic plasticity explains apparent reverse evolution of fat synthesis in parasitic wasps

Numerous cases of evolutionary trait loss and regain have been reported over the years. Here, we argue that such reverse evolution can also become apparent when trait expression is plastic in response to the environment. We tested this idea for the loss and regain of fat synthesis in parasitic wasps. We first show experimentally that the wasp Leptopilina heterotoma switches lipogenesis on in a fat-poor environment, and completely off in a fat-rich environment. Plasticity suggests that this species did not regain fat synthesis, but that it can be switched off in some environmental settings. We then compared DNA sequence variation and protein domains of several more distantly related parasitoid species thought to have lost lipogenesis, and found no evidence for non-functionality of key lipogenesis genes. This suggests that other parasitoids may also show plasticity of fat synthesis. Last, we used individual-based simulations to show that a switch for plastic expression can remain functional in the genome for thousands of generations, even if it is only used sporadically. The evolution of plasticity could thus also explain other examples of apparent reverse evolution.

Understanding 'Non-genetic' Inheritance: Insights from Molecular-Evolutionary Crosstalk

Understanding the evolutionary and ecological roles of 'non-genetic' inheritance (NGI) is daunting due to the complexity and diversity of epigenetic mechanisms. We draw on insights from molecular and evolutionary biology perspectives to identify three general features of 'non-genetic' inheritance systems: (i) they are functionally interdependent with, rather than separate from, DNA sequence; (ii) precise mechanisms vary phylogenetically and operationally; and (iii) epigenetic elements are probabilistic, interactive regulatory factors and not deterministic 'epialleles' with defined genomic locations and effects. We discuss each of these features and offer recommendations for future empirical and theoretical research that implements a unifying inherited gene regulation (IGR) approach to studies of 'non-genetic' inheritance.

Sex differences in cooperativeness-An experiment with Buryats in Southern Siberia

We report on an experimental study that was set up to reveal differences in the tendencies of men and women to cooperate in same-sex interactions. Former studies on this subject were mostly conducted in industrialized modern societies. In contrast, we tested the cooperation tendency among Buryats, a people from Southern Siberia of Mongolian origin. All subjects participated in (1) one iterated Public Goods Game in a group of four individuals of the same sex and (2) four one-shot Prisoner’s Dilemma games with different partners of the same sex. The interactions were in a face-to-face setting, but any intentional communication during the experiments was prohibited. We found that Buryat men were more cooperative than Buryat women in both types of same-sex interactions. In particular, the fraction of men employing a strategy of unconditional cooperation in the iterated Public Goods Game was much higher (36%) than the fraction of unconditional cooperators among women (21%). In general, the behavior of men was less context dependent than the behavior of women. In both sexes, individuals who were more cooperative in one type of game tended to be more cooperative in the other type of game. Although direct communication was prohibited, the interaction partners in the Prisoner’s Dilemma games employed the same strategy much more frequently than expected by chance. We conclude that, even among strangers, the exchange of subtle signals is sufficient to coordinate strategic decisions.

The evolution of social philopatry in female primates

The transition from solitary life to sociality is considered one of the major transitions in evolution. In primates, this transition is currently not well understood. Traditional verbal models appear insufficient to unravel the complex interplay of environmental and demographic factors involved in the evolution of primate sociality, and recent phylogenetic reconstructions have produced conflicting results. We therefore analyze a theoretical model for the evolution of female social philopatry that sheds new light on the question why most primates live in groups. In individual-based simulations, we study the evolution of dispersal strategies of both resident females and their offspring. The model reveals that social philopatry can evolve through kin selection, even if retention of offspring is costly in terms of within-group resource competition and provides no direct benefits. Our model supports the role of predator avoidance as a selective pressure for group-living in primates, but it also suggests that a second benefit of group-living, communal resource defense, might be required to trigger the evolution of sizable groups. Lastly, our model reveals that seemingly small differences in demographic parameters can have profound effects on primate social evolution.

Acculturation orientations affect the evolution of a multicultural society

The migration of people between different cultures has affected cultural change throughout history. To understand this process, cross-cultural psychologists have used the 'acculturation' framework, classifying 'acculturation orientations' along two dimensions: the willingness to interact with culturally different individuals, and the inclination to retain the own cultural identity ('cultural conservatism'). Here, using a cultural evolution approach, we construct a dynamically explicit model of acculturation. We show that the evolution of a multicultural society, where immigrant and resident culture stably coexist, is more likely if individuals readily engage in cross-cultural interactions, and if resident individuals are more culturally conservative than immigrants. This result holds if some cultural traits pay off better than others, and individuals use social learning to adopt more advantageous cultural traits. Our study demonstrates that formal dynamic models can help us understand how individual orientations towards immigration eventually determine the population-level distribution of cultural traits.

The evolution of costly mate choice against segregation distorters

The evolution of female preference for male genetic quality remains a controversial topic in sexual selection research. One well-known problem, known as the lek paradox, lies in understanding how variation in genetic quality is maintained in spite of natural selection and sexual selection against low-quality alleles. Here, we theoretically investigate a scenario where females pay a direct fitness cost to avoid males carrying an autosomal segregation distorter. We show that preference evolution is greatly facilitated under such circumstances. Because the distorter is transmitted in a non-Mendelian fashion, it can be maintained in the population despite directional sexual selection. The preference helps females avoid fitness costs associated with the distorter. Interestingly, we find that preference evolution is limited if the choice allele induces a very strong preference or if distortion is very strong. Moreover, the preference can only persist in the presence of a signal that reliably indicates a male's distorter genotype. Hence, even in a system where the lek paradox does not play a major role, costly preferences can only spread under specific circumstances. We discuss the importance of distorter systems for the evolution of costly female choice and potential implications for the use of artificial distorters in pest control.

Assortment, but not knowledge of assortment, affects cooperation and individual success in human groups

The success or failure of human collective action often depends on the cooperation tendencies of individuals in groups, and on the information that individuals have about each other's cooperativeness. However, it is unclear whether these two factors have an interactive effect on cooperation dynamics. Using a decision-making experiment, we confirm that groups comprising individuals with higher cooperation tendencies cooperate at a higher level than groups comprising individuals with low cooperation tendencies. Moreover, assorting individuals with similar cooperation tendency together affected behaviour so that the most cooperative individuals tended to cooperate more and the least cooperative individuals cooperated less, compared to their behaviour in randomly formed groups. In line with predictions of evolutionary models of cooperation, there was a strong positive association between individuals' cooperation tendency and success when groups were formed assortatively, whereas such association did not exist when groups were formed randomly. Surprisingly, information about group members' cooperativeness in assorted groups had no effect on cooperation levels. We discuss potential explanations for why information about cooperativeness of others may be disregarded in certain circumstances.

Fixation of competing strategies when interacting agents differ in the time scale of strategy updating

A commonly used assumption in evolutionary game theory is that natural selection acts on individuals in the same time scale; e.g., players use the same frequency to update their strategies. Variation in learning rates within populations suggests that evolutionary game theory may not necessarily be restricted to uniform time scales associated with the game interaction and strategy adaption evolution. In this study, we remove this restricting assumption by dividing the population into fast and slow groups according to the players' strategy updating frequencies and investigate how different strategy compositions of one group influence the evolutionary outcome of the other's fixation probabilities of strategies within its own group. Analytical analysis and numerical calculations are performed to study the evolutionary dynamics of strategies in typical classes of two-player games (prisoner's dilemma game, snowdrift game, and stag-hunt game). The introduction of the heterogeneity in strategy-update time scales leads to substantial changes in the evolution dynamics of strategies. We provide an approximation formula for the fixation probability of mutant types in finite populations and study the outcome of strategy evolution under the weak selection. We find that although heterogeneity in time scales makes the collective evolutionary dynamics more complicated, the possible long-run evolutionary outcome can be effectively predicted under technical assumptions when knowing the population composition and payoff parameters.

Lifespan divergence between social insect castes: challenges and opportunities for evolutionary theories of aging

The extraordinarily long lifespans of queens (and kings) in eusocial insects and the strikingly large differences in life expectancy between workers and queens challenge our understanding of the evolution of aging and provide unique opportunities for studying the causes underlying adaptive variation in lifespan within species. Here we review the major evolutionary theories of aging, focusing on their scope and limitations when applied to social insects. We show that reproductive division of labor, interactions between kin, caste-specific gene regulation networks, and the integration of colony-level trade-offs with individual-level trade-offs provide challenges to the classical theories We briefly indicate how these challenges could be met in future models of adaptive phenotypic plasticity in lifespan between and within different castes.

Steady states and stability in metabolic networks without regulation

Metabolic networks are often extremely complex. Despite intensive efforts many details of these networks, e.g., exact kinetic rates and parameters of metabolic reactions, are not known, making it difficult to derive their properties. Considerable effort has been made to develop theory about properties of steady states in metabolic networks that are valid for any values of parameters. General results on uniqueness of steady states and their stability have been derived with specific assumptions on reaction kinetics, stoichiometry and network topology. For example, deep results have been obtained under the assumptions of mass-action reaction kinetics, continuous flow stirred tank reactors (CFSTR), concordant reaction networks and others. Nevertheless, a general theory about properties of steady states in metabolic networks is still missing. Here we make a step further in the quest for such a theory. Specifically, we study properties of steady states in metabolic networks with monotonic kinetics in relation to their stoichiometry (simple and general) and the number of metabolites participating in every reaction (single or many). Our approach is based on the investigation of properties of the Jacobian matrix. We show that stoichiometry, network topology, and the number of metabolites that participate in every reaction have a large influence on the number of steady states and their stability in metabolic networks. Specifically, metabolic networks with single-substrate-single-product reactions have disconnected steady states, whereas in metabolic networks with multiple-substrates-multiple-product reactions manifolds of steady states arise. Metabolic networks with simple stoichiometry have either a unique globally asymptotically stable steady state or asymptotically stable manifolds of steady states. In metabolic networks with general stoichiometry the steady states are not always stable and we provide conditions for their stability. In order to demonstrate the biological relevance we illustrate the results on the examples of the TCA cycle, the mevalonate pathway and the Calvin cycle.

The importance of mechanisms for the evolution of cooperation

Studies aimed at explaining the evolution of phenotypic traits have often solely focused on fitness considerations, ignoring underlying mechanisms. In recent years, there has been an increasing call for integrating mechanistic perspectives in evolutionary considerations, but it is not clear whether and how mechanisms affect the course and outcome of evolution. To study this, we compare four mechanistic implementations of two well-studied models for the evolution of cooperation, the Iterated Prisoner's Dilemma (IPD) game and the Iterated Snowdrift (ISD) game. Behavioural strategies are either implemented by a 1 : 1 genotype-phenotype mapping or by a simple neural network. Moreover, we consider two different scenarios for the effect of mutations. The same set of strategies is feasible in all four implementations, but the probability that a given strategy arises owing to mutation is largely dependent on the behavioural and genetic architecture. Our individual-based simulations show that this has major implications for the evolutionary outcome. In the ISD, different evolutionarily stable strategies are predominant in the four implementations, while in the IPD each implementation creates a characteristic dynamical pattern. As a consequence, the evolved average level of cooperation is also strongly dependent on the underlying mechanism. We argue that our findings are of general relevance for the evolution of social behaviour, pleading for the integration of a mechanistic perspective in models of social evolution.

Regulatory mechanisms link phenotypic plasticity to evolvability

Organisms have a remarkable capacity to respond to environmental change. They can either respond directly, by means of phenotypic plasticity, or they can slowly adapt through evolution. Yet, how phenotypic plasticity links to evolutionary adaptability is largely unknown. Current studies of plasticity tend to adopt a phenomenological reaction norm (RN) approach, which neglects the mechanisms underlying plasticity. Focusing on a concrete question - the optimal timing of bacterial sporulation - we here also consider a mechanistic approach, the evolution of a gene regulatory network (GRN) underlying plasticity. Using individual-based simulations, we compare the RN and GRN approach and find a number of striking differences. Most importantly, the GRN model results in a much higher diversity of responsive strategies than the RN model. We show that each of the evolved strategies is pre-adapted to a unique set of unseen environmental conditions. The regulatory mechanisms that control plasticity therefore critically link phenotypic plasticity to the adaptive potential of biological populations.

Evolutionary Dynamics of Homophily and Heterophily

Most social interactions do not take place at random. In many situations, individuals choose their interaction partners on the basis of phenotypic cues. When this happens, individuals are often homophilic, that is, they tend to interact with individuals that are similar to them. Here we investigate the joint evolution of phenotypic cues and cue-dependent interaction strategies. By a combination of individual-based simulations and analytical arguments, we show that homophily evolves less easily than earlier studies suggest. The evolutionary interplay of cues and cue-based behaviour is intricate and has many interesting facets. For example, an interaction strategy like heterophily may stably persist in the population even if it is selected against in association with any particular cue. Homophily persisted for extensive periods of time just in those simulations where homophilic interactions provide a lower (rather than a higher) payoff than heterophilic interactions. Our results indicate that even the simplest cue-based social interactions can have rich dynamics and a surprising diversity of evolutionary outcomes.

Negotiation and appeasement can be more effective drivers of sociality than kin selection

Two alternative frameworks explain the evolution of cooperation in the face of conflicting interests. Conflicts can be alleviated by kinship, the alignment of interests by virtue of shared genes, or by negotiation strategies, allowing mutually beneficial trading of services or commodities. Although negotiation often occurs in kin-structured populations, the interplay of kin- and negotiation-based mechanisms in the evolution of cooperation remains an unresolved issue. Inspired by the biology of a cooperatively breeding fish, we developed an individual-based simulation model to study the evolution of negotiation-based cooperation in relation to different levels of genetic relatedness. We show that the evolution of negotiation strategies leads to an equilibrium where subordinates appease dominants by conditional cooperation, resulting in high levels of help and low levels of aggression. This negotiation-based equilibrium can be reached both in the absence of relatedness and in a kin-structured population. However, when relatedness is high, evolution often ends up in an alternative equilibrium where subordinates help their kin unconditionally. The level of help at this kin-selected equilibrium is considerably lower than at the negotiation-based equilibrium, and it corresponds to a level reached when responsiveness is prevented from evolving in the simulations. A mathematical invasion analysis reveals that, quite generally, the alignment of payoffs due to the relatedness of interaction partners tends to impede selection for harsh but effective punishment of defectors. Hence kin structure will often hamper rather than facilitate the evolution of productive cooperation.

Human cooperation in groups: variation begets variation

Many experiments on human cooperation have revealed that individuals differ systematically in their tendency to cooperate with others. It has also been shown that individuals condition their behaviour on the overall cooperation level of their peers. Yet, little is known about how individuals respond to heterogeneity in cooperativeness in their neighbourhood. Here, we present an experimental study investigating whether and how people respond to heterogeneous behaviour in a public goods game. We find that a large majority of subjects does respond to heterogeneity in their group, but they respond in quite different ways. Most subjects contribute less to the public good when the contributions of their peers are more heterogeneous, but a substantial fraction of individuals consistently contributes more in this case. In addition, we find that individuals that respond positively to heterogeneity have a higher general cooperation tendency. The finding that social responsiveness occurs in different forms and is correlated with cooperativeness may have important implications for the outcome of cooperative interactions.

Crucial role of strategy updating for coexistence of strategies in interaction networks

Network models are useful tools for studying the dynamics of social interactions in a structured population. After a round of interactions with the players in their local neighborhood, players update their strategy based on the comparison of their own payoff with the payoff of one of their neighbors. Here we show that the assumptions made on strategy updating are of crucial importance for the strategy dynamics. In the first step, we demonstrate that seemingly small deviations from the standard assumptions on updating have major implications for the evolutionary outcome of two cooperation games: cooperation can more easily persist in a Prisoner's Dilemma game, while it can go more easily extinct in a Snowdrift game. To explain these outcomes, we develop a general model for the updating of states in a network that allows us to derive conditions for the steady-state coexistence of states (or strategies). The analysis reveals that coexistence crucially depends on the number of agents consulted for updating. We conclude that updating rules are as important for evolution on a network as network structure and the nature of the interaction.

Focus on the success of others leads to selfish behavior

It has often been argued that the spectacular cognitive capacities of humans are the result of selection for the ability to gather, process, and use information about other people. Recent studies show that humans strongly and consistently differ in what type of social information they are interested in. Although some individuals mainly attend to what the majority is doing (frequency-based learning), others focus on the success that their peers achieve with their behavior (success-based learning). Here, we show that such differences in social learning have important consequences for the outcome of social interactions. We report on a decision-making experiment in which individuals were first classified as frequency- and success-based learners and subsequently grouped according to their learning strategy. When confronted with a social dilemma situation, groups of frequency-based learners cooperated considerably more than groups of success-based learners. A detailed analysis of the decision-making process reveals that these differences in cooperation are a direct result of the differences in information use. Our results show that individual differences in social learning strategies are crucial for understanding social behavior.

Competition and facilitation between the marine nitrogen-fixing cyanobacterium Cyanothece and its associated bacterial community

N2-fixing cyanobacteria represent a major source of new nitrogen and carbon for marine microbial communities, but little is known about their ecological interactions with associated microbiota. In this study we investigated the interactions between the unicellular N2-fixing cyanobacterium Cyanothece sp. Miami BG043511 and its associated free-living chemotrophic bacteria at different concentrations of nitrate and dissolved organic carbon and different temperatures. High temperature strongly stimulated the growth of Cyanothece, but had less effect on the growth and community composition of the chemotrophic bacteria. Conversely, nitrate and carbon addition did not significantly increase the abundance of Cyanothece, but strongly affected the abundance and species composition of the associated chemotrophic bacteria. In nitrate-free medium the associated bacterial community was co-dominated by the putative diazotroph Mesorhizobium and the putative aerobic anoxygenic phototroph Erythrobacter and after addition of organic carbon also by the Flavobacterium Muricauda. Addition of nitrate shifted the composition toward co-dominance by Erythrobacter and the Gammaproteobacterium Marinobacter. Our results indicate that Cyanothece modified the species composition of its associated bacteria through a combination of competition and facilitation. Furthermore, within the bacterial community, niche differentiation appeared to play an important role, contributing to the coexistence of a variety of different functional groups. An important implication of these findings is that changes in nitrogen and carbon availability due to, e.g., eutrophication and climate change are likely to have a major impact on the species composition of the bacterial community associated with N2-fixing cyanobacteria.

Density of founder cells affects spatial pattern formation and cooperation in Bacillus subtilis biofilms

In nature, most bacteria live in surface-attached sedentary communities known as biofilms. Biofilms are often studied with respect to bacterial interactions. Many cells inhabiting biofilms are assumed to express 'cooperative traits', like the secretion of extracellular polysaccharides (EPS). These traits can enhance biofilm-related properties, such as stress resilience or colony expansion, while being costly to the cells that express them. In well-mixed populations cooperation is difficult to achieve, because non-cooperative individuals can reap the benefits of cooperation without having to pay the costs. The physical process of biofilm growth can, however, result in the spatial segregation of cooperative from non-cooperative individuals. This segregation can prevent non-cooperative cells from exploiting cooperative neighbors. Here we examine the interaction between spatial pattern formation and cooperation in Bacillus subtilis biofilms. We show, experimentally and by mathematical modeling, that the density of cells at the onset of biofilm growth affects pattern formation during biofilm growth. At low initial cell densities, co-cultured strains strongly segregate in space, whereas spatial segregation does not occur at high initial cell densities. As a consequence, EPS-producing cells have a competitive advantage over non-cooperative mutants when biofilms are initiated at a low density of founder cells, whereas EPS-deficient cells have an advantage at high cell densities. These results underline the importance of spatial pattern formation for competition among bacterial strains and the evolution of microbial cooperation.

Consistent individual differences in human social learning strategies

Social learning has allowed humans to build up extensive cultural repertoires, enabling them to adapt to a wide variety of environmental and social conditions. However, it is unclear which social learning strategies people use, especially in social contexts where their payoffs depend on the behaviour of others. Here we show experimentally that individuals differ in their social learning strategies and that they tend to employ the same learning strategy irrespective of the interaction context. Payoff-based learners focus on their peers' success, while decision-based learners disregard payoffs and exclusively focus on their peers' past behaviour. These individual differences may be of considerable importance for cultural evolution. By means of a simple model, we demonstrate that groups harbouring individuals with different learning strategies may be faster in adopting technological innovations and can be more efficient through successful role differentiation. Our study highlights the importance of individual variation for human interactions and sheds new light on the dynamics of cultural evolution.

Cooperation in networks where the learning environment differs from the interaction environment

We study the evolution of cooperation in a structured population, combining insights from evolutionary game theory and the study of interaction networks. In earlier studies it has been shown that cooperation is difficult to achieve in homogeneous networks, but that cooperation can get established relatively easily when individuals differ largely concerning the number of their interaction partners, such as in scale-free networks. Most of these studies do, however, assume that individuals change their behaviour in response to information they receive on the payoffs of their interaction partners. In real-world situations, subjects do not only learn from their interaction partners, but also from other individuals (e.g. teachers, parents, or friends). Here we investigate the implications of such incongruences between the ‘interaction network’ and the ‘learning network’ for the evolution of cooperation in two paradigm examples, the Prisoner's Dilemma game (PDG) and the Snowdrift game (SDG). Individual-based simulations and an analysis based on pair approximation both reveal that cooperation will be severely inhibited if the learning network is very different from the interaction network. If the two networks overlap, however, cooperation can get established even in case of considerable incongruence between the networks. The simulations confirm that cooperation gets established much more easily if the interaction network is scale-free rather than random-regular. The structure of the learning network has a similar but much weaker effect. Overall we conclude that the distinction between interaction and learning networks deserves more attention since incongruences between these networks can strongly affect both the course and outcome of the evolution of cooperation.

How superdiffusion gets arrested: ecological encounters explain shift from Lévy to Brownian movement

Ecological theory uses Brownian motion as a default template for describing ecological movement, despite limited mechanistic underpinning. The generality of Brownian motion has recently been challenged by empirical studies that highlight alternative movement patterns of animals, especially when foraging in resource-poor environments. Yet, empirical studies reveal animals moving in a Brownian fashion when resources are abundant. We demonstrate that Einstein's original theory of collision-induced Brownian motion in physics provides a parsimonious, mechanistic explanation for these observations. Here, Brownian motion results from frequent encounters between organisms in dense environments. In density-controlled experiments, movement patterns of mussels shifted from Lévy towards Brownian motion with increasing density. When the analysis was restricted to moves not truncated by encounters, this shift did not occur. Using a theoretical argument, we explain that any movement pattern approximates Brownian motion at high-resource densities, provided that movement is interrupted upon encounters. Hence, the observed shift to Brownian motion does not indicate a density-dependent change in movement strategy but rather results from frequent collisions. Our results emphasize the need for a more mechanistic use of Brownian motion in ecology, highlighting that especially in rich environments, Brownian motion emerges from ecological interactions, rather than being a default movement pattern.

Effects of conformism on the cultural evolution of social behaviour

Models of cultural evolution study how the distribution of cultural traits changes over time. The dynamics of cultural evolution strongly depends on the way these traits are transmitted between individuals by social learning. Two prominent forms of social learning are payoff-based learning (imitating others that have higher payoffs) and conformist learning (imitating locally common behaviours). How payoff-based and conformist learning affect the cultural evolution of cooperation is currently a matter of lively debate, but few studies systematically analyse the interplay of these forms of social learning. Here we perform such a study by investigating how the interaction of payoff-based and conformist learning affects the outcome of cultural evolution in three social contexts. First, we develop a simple argument that provides insights into how the outcome of cultural evolution will change when more and more conformist learning is added to payoff-based learning. In a social dilemma (e.g. a Prisoner’s Dilemma), conformism can turn cooperation into a stable equilibrium; in an evasion game (e.g. a Hawk-Dove game or a Snowdrift game) conformism tends to destabilize the polymorphic equilibrium; and in a coordination game (e.g. a Stag Hunt game), conformism changes the basin of attraction of the two equilibria. Second, we analyse a stochastic event-based model, revealing that conformism increases the speed of cultural evolution towards pure equilibria. Individual-based simulations as well as the analysis of the diffusion approximation of the stochastic model by and large confirm our findings. Third, we investigate the effect of an increasing degree of conformism on cultural group selection in a group-structured population. We conclude that, in contrast to statements in the literature, conformism hinders rather than promotes the evolution of cooperation.

A Guide to Sexual Selection Theory

Mathematical models have played an important role in the development of sexual selection theory. These models come in different flavors and they differ in their assumptions, often in a subtle way. Similar questions can be addressed by modeling frameworks from population genetics, quantitative genetics, evolutionary game theory, or adaptive dynamics, or by individual-based simulations. Confronted with such diversity, nonspecialists may have difficulties judging the scope and limitations of the various approaches. Here we review the major modeling frameworks, highlighting their pros and cons when applied to different research questions. We also discuss recent developments, where classical models are enriched by including more detail regarding genetics, behavior, demography, and population dynamics. It turns out that some seemingly well-established conclusions of sexual selection theory are less general than previously thought. Linking sexual selection to other processes such as sex-ratio evolution or speciation also reveals that enriching the theory can lead to surprising new insights.

Reproduction and dispersal in an ant-associated root aphid community

Clonal organisms with occasional sex are important for our general understanding of the costs and benefits that maintain sexual reproduction. Cyclically parthenogenetic aphids are highly variable in their frequency of sexual reproduction. However, studies have mostly focused on free-living aphids above ground, whereas dispersal constraints and dependence on ant-tending may differentially affect the costs and benefits of sex in subterranean aphids. Here, we studied reproductive mode and dispersal in a community of root aphids that are obligately associated with the ant Lasius flavus. We assessed the genetic population structure of four species (Geoica utricularia, Tetraneura ulmi, Forda marginata and Forda formicaria) in a Dutch population and found that all species reproduce predominantly if not exclusively asexually, so that populations consist of multiple clonal lineages. We show that population viscosity is high and winged aphids rare, consistent with infrequent horizontal transmission between ant host colonies. The absence of the primary host shrub (Pistacia) may explain the absence of sex in three of the studied species, but elm trees (Ulmus) that are primary hosts of the fourth species (T. ulmi) occurred within a few km of the study population. We discuss the extent to which obligate ant-tending and absence of primary hosts may have affected selection for permanent parthenogenesis, and we highlight the need for further study of these aphids in Southern Europe where primary hosts may occur close to L. flavus populations, so that all four root aphid species would have realistic opportunities for completing their sexual life cycle.