Conflict of interest and signal interference lead to the breakdown of honest signaling

Microbial interactions from a new perspective: reinforcement learning reveals new insights into microbiome evolution

MOTIVATION

Microbes are essential part of all ecosystems, influencing material flow and shaping their surroundings. Metabolic modeling has been a useful tool and provided tremendous insights into microbial community metabolism. However, current methods based on flux balance analysis (FBA) usually fail to predict metabolic and regulatory strategies that lead to long-term survival and stability especially in heterogenous communities.

RESULTS

Here, we introduce a novel reinforcement learning algorithm, Self-Playing Microbes in Dynamic FBA, which treats microbial metabolism as a decision-making process, allowing individual microbial agents to evolve by learning and adapting metabolic strategies for enhanced long-term fitness. This algorithm predicts what microbial flux regulation policies will stabilize in the dynamic ecosystem of interest in the presence of other microbes with minimal reliance on predefined strategies. Throughout this article, we present several scenarios wherein our algorithm outperforms existing methods in reproducing outcomes, and we explore the biological significance of these predictions.

AVAILABILITY AND IMPLEMENTATION

The source code for this article is available at: https://github.com/chan-csu/SPAM-DFBA.

Challenges and opportunities for cheat therapy in the control of bacterial infections

Covering: 1999 to 2021Bacterial pathogens can be highly social, communicating and cooperating within multi-cellular groups to make us sick. The requirement for collective action in pathogens presents novel therapeutic avenues that seek to undermine cooperative behavior, what we call here 'cheat therapies'. We review two broad avenues of cheat therapy: first, the introduction of genetically engineered 'cheat' strains (bio-control cheats), and second the chemical induction of 'cheat' behavior in the infecting pathogens (chemical-control cheats). Both genetically engineered and chemically induced cheats can socially exploit the cooperative wildtype infection, reducing pathogen burden and the severity of disease. We review the costs and benefits of cheat therapies, highlighting advantages of evolutionary robustness and also the challenges of low to moderate efficacy, compared to conventional antibiotic treatments. We end with a summary of what we see as the most valuable next steps, focusing on adjuvant treatments and use as alternate therapies for mild, self-resolving infections - allowing the reservation of current and highly effective antibiotics for more critical patient needs.

Commensal inter-bacterial interactions shaping the microbiota

The gut microbiota, a complex ecosystem of microorganisms of different kingdoms, impacts host physiology and disease. Within this ecosystem, inter-bacterial interactions and their impacts on microbiota community structure and the eukaryotic host remain insufficiently explored. Microbiota-related inter-bacterial interactions range from symbiotic interactions, involving exchange of nutrients, enzymes, and genetic material; competition for nutrients and space, mediated by biophysical alterations and secretion of toxins and anti-microbials; to predation of overpopulating bacteria. Collectively, these understudied interactions hold important clues as to forces shaping microbiota diversity, niche formation, and responses to signals perceived from the host, incoming pathogens and the environment. In this review, we highlight the roles and mechanisms of selected inter-bacterial interactions in the microbiota, and their potential impacts on the host and pathogenic infection. We discuss challenges in mechanistically decoding these complex interactions, and prospects of harnessing them as future targets for rational microbiota modification in a variety of diseases.

Quorum sensing provides a molecular mechanism for evolution to tune and maintain investment in cooperation

As selection frequently favors noncooperating defectors in mixed populations with cooperators, mechanisms that promote cooperation stability clearly exist. One potential mechanism is bacterial cell-to-cell communication, quorum sensing (QS), which can allow cooperators to prevent invasion by defectors. However, the impact of QS on widespread maintenance of cooperation in well-mixed conditions has not been experimentally demonstrated over extended evolutionary timescales. Here, we use wild-type (WT) Vibrio campbellii that regulates cooperation with QS and an unconditional cooperating (UC) mutant to examine the evolutionary origins and dynamics of novel defectors during a long-term evolution experiment. We found that UC lineages were completely outcompeted by defectors, whereas functioning QS enabled the maintenance of cooperative variants in most WT populations. Sequencing evolved populations revealed multiple luxR mutations that swept the UC lineages. However, the evolution of mutant lineages with reduced levels of bioluminescence (dims) occurred in many WT lineages. These dim variants also decreased other cooperative phenotypes regulated by QS, including protease production, indicating they result from changes to QS regulation. This diminished investment phenotype optimizes a tradeoff between cooperative input and growth output and suggests that decreasing the cost of QS could be a favorable strategy for maintaining the cooperative behaviors it regulates.

New dimensions for animal communication networks: space and time

Communication is a social process and usually occurs in a network of signalers and receivers. While social network analysis has received enormous recent attention from animal behaviorists, there have been relatively few attempts to apply these techniques to communication networks. Communication networks have the potential to offer novel insights into social network studies, and yet are especially challenging subjects, largely because of their unique spatiotemporal characteristics. Namely, signals propagate through the environment, often dissociating from the body of the signaler, to influence receiver behavior. The speed of signal propagation and the signal's active space will affect the congruence of communication networks and other types of social network; in extreme cases the signal may persist and only first be detected long after the signaler has left the area. Other signals move more rapidly and over greater distances than the signaler could possibly move to reach receivers. We discuss the spatial and temporal consequences of signaling in networks and highlight the distinction between the physical location of the signaler and the spread of influence of its signals, the effects of signal modality and receiver sensitivity on communication network properties, the potential for feedbacks between network layers, and approaches to analyzing spatial and temporal change in communication networks in conjunction with other network layers.

Cultivable microbiota associated with Aurelia aurita and Mnemiopsis leidyi

The associated microbiota of marine invertebrates plays an important role to the host in relation to fitness, health, and homeostasis. Cooperative and competitive interactions between bacteria, due to release of, for example, antibacterial substances and quorum sensing (QS)/quorum quenching (QQ) molecules, ultimately affect the establishment and dynamics of the associated microbial community. Aiming to address interspecies competition of cultivable microbes associated with emerging model species of the basal animal phyla Cnidaria (Aurelia aurita) and Ctenophora (Mnemiopsis leidyi), we performed a classical isolation approach. Overall, 84 bacteria were isolated from A. aurita medusae and polyps, 64 bacteria from M. leidyi, and 83 bacteria from ambient seawater, followed by taxonomically classification by 16S rRNA gene analysis. The results show that A. aurita and M. leidyi harbor a cultivable core microbiome consisting of typical marine ubiquitous bacteria also found in the ambient seawater. However, several bacteria were restricted to one host suggesting host‐specific microbial community patterns. Interbacterial interactions were assessed by (a) a growth inhibition assay and (b) QS interference screening assay. Out of 231 isolates, 4 bacterial isolates inhibited growth of 17 isolates on agar plates. Moreover, 121 of the 231 isolates showed QS‐interfering activities. They interfered with the acyl‐homoserine lactone (AHL)‐based communication, of which 21 showed simultaneous interference with autoinducer 2. Overall, this study provides insights into the cultivable part of the microbiota associated with two environmentally important marine non‐model organisms and into interbacterial interactions, which are most likely considerably involved in shaping a healthy and resilient microbiota.

Combinatorial quorum sensing in Pseudomonas aeruginosa allows for novel cheating strategies

In the opportunistic pathogen Pseudomonas aeruginosa, quorum sensing (QS) is a social trait that is exploitable by non-cooperating cheats. Previously it has been shown that by linking QS to the production of both public and private goods, cheats can be prevented from invading populations of cooperators and this was described by Dandekar et al. (Science 2012;338:264-266) as 'a metabolic incentive to cooperate'. We hypothesized that P. aeruginosa could evolve novel cheating strategies to circumvent private goods metabolism by rewiring its combinatorial response to two QS signals (3O-C12-HSL and C4-HSL). We performed a selection experiment that cycled P. aeruginosa between public and private goods growth media and evolved an isolate that rewired its control of cooperative protease expression from a synergistic (AND-gate) response to dual-signal input to a 3O-C12-HSL-only response. We show that this isolate circumvents metabolic incentives to cooperate and acts as a combinatorial signalling cheat, with higher fitness in competition with its ancestor. Our results show three important principles: first, combinatorial QS allows for diverse social strategies to emerge; second, restrictions levied by private goods are not sufficient to explain the maintenance of cooperation in natural populations; and third, modifying combinatorial QS responses could result in important physiological outcomes in bacterial populations.

In silico bacteria evolve robust cooperaion via complex quorum-sensing strategies

Many species of bacteria collectively sense and respond to their social and physical environment via 'quorum sensing' (QS), a communication system controlling extracellular cooperative traits. Despite detailed understanding of the mechanisms of signal production and response, there remains considerable debate over the functional role(s) of QS: in short, what is it for? Experimental studies have found support for diverse functional roles: density sensing, mass-transfer sensing, genotype sensing, etc. While consistent with theory, these results cannot separate whether these functions were drivers of QS adaption, or simply artifacts or 'spandrels' of systems shaped by distinct ecological pressures. The challenge of separating spandrels from drivers of adaptation is particularly hard to address using extant bacterial species with poorly understood current ecologies (let alone their ecological histories). To understand the relationship between defined ecological challenges and trajectories of QS evolution, we used an agent-based simulation modeling approach. Given genetic mixing, our simulations produce behaviors that recapitulate features of diverse microbial QS systems, including coercive (high signal/low response) and generalized reciprocity (signal auto-regulation) strategists - that separately and in combination contribute to QS-dependent resilience of QS-controlled cooperation in the face of diverse cheats. We contrast our in silico results given defined ecological challenges with bacterial QS architectures that have evolved under largely unknown ecological contexts, highlighting the critical role of genetic constraints in shaping the shorter term (experimental evolution) dynamics of QS. More broadly, we see experimental evolution of digital organisms as a complementary tool in the search to understand the emergence of complex QS architectures and functions.

Allelic polymorphism shapes community function in evolving Pseudomonas aeruginosa populations

Pseudomonas aeruginosa is an opportunistic pathogen that chronically infects the lungs of individuals with cystic fibrosis (CF) by forming antibiotic-resistant biofilms. Emergence of phenotypically diverse isolates within CF P. aeruginosa populations has previously been reported; however, the impact of heterogeneity on social behaviors and community function is poorly understood. Here we describe how this heterogeneity impacts on behavioral traits by evolving the strain PAO1 in biofilms grown in a synthetic sputum medium for 50 days. We measured social trait production and antibiotic tolerance, and used a metagenomic approach to analyze and assess genomic changes over the duration of the evolution experiment. We found that (i) evolutionary trajectories were reproducible in independently evolving populations; (ii) over 60% of genomic diversity occurred within the first 10 days of selection. We then focused on quorum sensing (QS), a well-studied P. aeruginosa trait that is commonly mutated in strains isolated from CF lungs. We found that at the population level, (i) evolution in sputum medium selected for decreased the production of QS and QS-dependent traits; (ii) there was a significant correlation between lasR mutant frequency, the loss of protease, and the 3O-C12-HSL signal, and an increase in resistance to clinically relevant β-lactam antibiotics, despite no previous antibiotic exposure. Overall, our findings provide insights into the effect of allelic polymorphism on community functions in diverse P. aeruginosa populations. Further, we demonstrate that P. aeruginosa population and evolutionary dynamics can impact on traits important for virulence and can lead to increased tolerance to β-lactam antibiotics.

Honest signaling and the double counting of inclusive fitness

Inclusive fitness requires a careful accounting of all the fitness effects of a particular behavior. Verbal arguments can potentially exaggerate the inclusive fitness consequences of a behavior by including the fitness of relatives that was not caused by that behavior, leading to error. We show how this “double‐counting” error can arise, with a recent example from the signaling literature. In particular, we examine the recent debate over whether parental divorce increases parent–offspring conflict, selecting for less honest signaling. We found that, when all the inclusive fitness consequences are accounted for, parental divorce increases conflict between siblings, in a way that they can select for less honest signaling. This prediction is consistent with the empirical data. More generally, our results illustrate how verbal arguments can be misleading, emphasizing the advantage of formal mathematical models.

Bacterial Quorum Sensing and Microbial Community Interactions

Many bacteria use a cell-cell communication system called quorum sensing to coordinate population density-dependent changes in behavior. Quorum sensing involves production of and response to diffusible or secreted signals, which can vary substantially across different types of bacteria. In many species, quorum sensing modulates virulence functions and is important for pathogenesis. Over the past half-century, there has been a significant accumulation of knowledge of the molecular mechanisms, signal structures, gene regulons, and behavioral responses associated with quorum-sensing systems in diverse bacteria. More recent studies have focused on understanding quorum sensing in the context of bacterial sociality. Studies of the role of quorum sensing in cooperative and competitive microbial interactions have revealed how quorum sensing coordinates interactions both within a species and between species. Such studies of quorum sensing as a social behavior have relied on the development of "synthetic ecological" models that use nonclonal bacterial populations. In this review, we discuss some of these models and recent advances in understanding how microbes might interact with one another using quorum sensing. The knowledge gained from these lines of investigation has the potential to guide studies of microbial sociality in natural settings and the design of new medicines and therapies to treat bacterial infections.

Environmental modification via a quorum sensing molecule influences the social landscape of siderophore production

Bacteria produce a wide variety of exoproducts that favourably modify their environment and increase their fitness. These are often termed ‘public goods’ because they are costly for individuals to produce and can be exploited by non-producers (cheats). The outcome of conflict over public goods is dependent upon the prevailing environment and the phenotype of the individuals in competition. Many bacterial species use quorum sensing (QS) signalling molecules to regulate the production of public goods. QS, therefore, determines the cooperative phenotype of individuals, and influences conflict over public goods. In addition to their regulatory functions, many QS molecules have additional properties that directly modify the prevailing environment. This leads to the possibility that QS molecules could influence conflict over public goods indirectly through non-signalling effects, and the impact of this on social competition has not previously been explored. The Pseudomonas aeruginosa QS signal molecule PQS is a powerful chelator of iron which can cause an iron starvation response. Here, we show that PQS stimulates a concentration-dependent increase in the cooperative production of iron scavenging siderophores, resulting in an increase in the relative fitness of non-producing siderophore cheats. This is likely due to an increased cost of siderophore output by producing cells and a concurrent increase in the shared benefits, which accrue to both producers and cheats. Although PQS can be a beneficial signalling molecule for P. aeruginosa, our data suggest that it can also render a siderophore-producing population vulnerable to competition from cheating strains. More generally, our results indicate that the production of one social trait can indirectly affect the costs and benefits of another social trait.

The Fitness of Pseudomonas aeruginosa Quorum Sensing Signal Cheats Is Influenced by the Diffusivity of the Environment

Experiments examining the social dynamics of bacterial quorum sensing (QS) have focused on mutants which do not respond to signals and the role of QS-regulated exoproducts as public goods. The potential for QS signal molecules to themselves be social public goods has received much less attention. Here, we analyze how signal-deficient (lasI) mutants of the opportunistic pathogen Pseudomonas aeruginosa interact with wild-type cells in an environment where QS is required for growth. We show that when growth requires a "private" intracellular metabolic mechanism activated by the presence of QS signal, lasI mutants act as social cheats and outcompete signal-producing wild-type bacteria in mixed cultures, because they can exploit the signals produced by wild-type cells. However, reducing the ability of signal molecules to diffuse through the growth medium results in signal molecules becoming less accessible to mutants, leading to reduced cheating. Our results indicate that QS signal molecules can be considered social public goods in a way that has been previously described for other exoproducts but that spatial structuring of populations reduces exploitation by noncooperative signal cheats.IMPORTANCE Bacteria communicate via signaling molecules to regulate the expression of a whole range of genes. This process, termed quorum sensing (QS), moderates bacterial metabolism under many environmental conditions, from soil and water (where QS-regulated genes influence nutrient cycling) to animal hosts (where QS-regulated genes determine pathogen virulence). Understanding the ecology of QS could therefore yield vital clues to how we might modify bacterial behavior for environmental or clinical gains. Here, we demonstrate that QS signals act as shareable public goods. This means that their evolution, and therefore population-level responses to interference with QS, will be constrained by population structure. Further, we show that environmental structure (constraints on signal diffusion) alters the accessibility of QS signals and demonstrates that we need to consider population and environmental structure to help us further our understanding of QS signaling systems.

Social interactions in bacterial cell-cell signaling

Cooperation and conflict in microorganisms is being recognized as an important factor in the organization and function of microbial communities. Many of the cooperative behaviors described in bacteria are governed through a cell-cell signaling process generally termed quorum sensing. Communication and cooperation in diverse microorganisms exhibit predictable trends that behave according to social evolutionary theory, notably that public goods dilemmas produce selective pressures for divergence in social phenotypes including cheating. In this review, we relate the general features of quorum sensing and social adaptation in microorganisms to established evolutionary theory. We then describe physiological and molecular mechanisms that have been shown to stabilize cooperation in microbes, thereby preventing a tragedy of the commons. Continued study of the role of communication and cooperation in microbial ecology and evolution is important to clinical treatment of pathogens, as well as to our fundamental understanding of cooperative selection at all levels of life.

The fitness burden imposed by synthesising quorum sensing signals

It is now well established that bacterial populations utilize cell-to-cell signaling (quorum-sensing, QS) to control the production of public goods and other co-operative behaviours. Evolutionary theory predicts that both the cost of signal production and the response to signals should incur fitness costs for producing cells. Although costs imposed by the downstream consequences of QS have been shown, the cost of QS signal molecule (QSSM) production and its impact on fitness has not been examined. We measured the fitness cost to cells of synthesising QSSMs by quantifying metabolite levels in the presence of QSSM synthases. We found that: (i) bacteria making certain QSSMs have a growth defect that exerts an evolutionary cost, (ii) production of QSSMs negatively correlates with intracellular concentrations of QSSM precursors, (iii) the production of heterologous QSSMs negatively impacts the production of a native QSSM that shares common substrates, and (iv) supplementation with exogenously added metabolites partially rescued growth defects imposed by QSSM synthesis. These data identify the sources of the fitness costs incurred by QSSM producer cells, and indicate that there may be metabolic trade-offs associated with QS signaling that could exert selection on how signaling evolves.

The evolutionary ecology of molecular replicators

By reasonable criteria, life on the Earth consists mainly of molecular replicators. These include viruses, transposons, transpovirons, coviruses and many more, with continuous new discoveries like Sputnik Virophage. Their study is inherently multidisciplinary, spanning microbiology, genetics, immunology and evolutionary theory, and the current view is that taking a unified approach has great power and promise. We support this with a new, unified, model of their evolutionary ecology, using contemporary evolutionary theory coupling the Price equation with game theory, studying the consequences of the molecular replicators' promiscuous use of each others' gene products for their natural history and evolutionary ecology. Even at this simple expository level, we can make a firm prediction of a new class of replicators exploiting viruses such as lentiviruses like SIVs, a family which includes HIV: these have been explicitly stated in the primary literature to be non-existent. Closely connected to this departure is the view that multicellular organism immunology is more about the management of chronic infections rather than the elimination of acute ones and new understandings emerging are changing our view of the kind of theatre we ourselves provide for the evolutionary play of molecular replicators. This study adds molecular replicators to bacteria in the emerging field of sociomicrobiology.

Quorum sensing protects bacterial co-operation from exploitation by cheats

Quorum sensing (QS) is a cell–cell communication system found in many bacterial species, commonly controlling secreted co-operative traits, including extracellular digestive enzymes. We show that the canonical QS regulatory architecture allows bacteria to sense the genotypic composition of high-density populations, and limit co-operative investments to social environments enriched for co-operators. Using high-density populations of the opportunistic pathogen Pseudomonas aeruginosa we map per-capita signal and co-operative enzyme investment in the wild type as a function of the frequency of non-responder cheats. We demonstrate mathematically and experimentally that the observed response rule of ‘co-operate when surrounded by co-operators' allows bacteria to match their investment in co-operation to the composition of the group, therefore allowing the maintenance of co-operation at lower levels of population structuring (that is, lower relatedness). Similar behavioural responses have been described in vertebrates under the banner of ‘generalised reciprocity'. Our results suggest that mechanisms of reciprocity are not confined to taxa with advanced cognition, and can be implemented at the cellular level via positive feedback circuits.