The evolution of phenotypic correlations and "developmental memory"

Natural Induction: Spontaneous Adaptive Organisation without Natural Selection

Evolution by natural selection is believed to be the only possible source of spontaneous adaptive organisation in the natural world. This places strict limits on the kinds of systems that can exhibit adaptation spontaneously, i.e., without design. Physical systems can show some properties relevant to adaptation without natural selection or design. (1) The relaxation, or local energy minimisation, of a physical system constitutes a natural form of optimisation insomuch as it finds locally optimal solutions to the frustrated forces acting on it or between its components. (2) When internal structure 'gives way' or accommodates a pattern of forcing on a system, this constitutes learning insomuch, as it can store, recall, and generalise past configurations. Both these effects are quite natural and general, but in themselves insufficient to constitute non-trivial adaptation. However, here we show that the recurrent interaction of physical optimisation and physical learning together results in significant spontaneous adaptive organisation. We call this adaptation by natural induction. The effect occurs in dynamical systems described by a network of viscoelastic connections subject to occasional disturbances. When the internal structure of such a system accommodates slowly across many disturbances and relaxations, it spontaneously learns to preferentially visit solutions of increasingly greater quality (exceptionally low energy). We show that adaptation by natural induction thus produces network organisations that improve problem-solving competency with experience (without supervised training or system-level reward). We note that the conditions for adaptation by natural induction, and its adaptive competency, are different from those of natural selection. We therefore suggest that natural selection is not the only possible source of spontaneous adaptive organisation in the natural world.

Evolutionary Implications of Self-Assembling Cybernetic Materials with Collective Problem-Solving Intelligence at Multiple Scales

In recent years, the scientific community has increasingly recognized the complex multi-scale competency architecture (MCA) of biology, comprising nested layers of active homeostatic agents, each forming the self-orchestrated substrate for the layer above, and, in turn, relying on the structural and functional plasticity of the layer(s) below. The question of how natural selection could give rise to this MCA has been the focus of intense research. Here, we instead investigate the effects of such decision-making competencies of MCA agential components on the process of evolution itself, using in silico neuroevolution experiments of simulated, minimal developmental biology. We specifically model the process of morphogenesis with neural cellular automata (NCAs) and utilize an evolutionary algorithm to optimize the corresponding model parameters with the objective of collectively self-assembling a two-dimensional spatial target pattern (reliable morphogenesis). Furthermore, we systematically vary the accuracy with which the uni-cellular agents of an NCA can regulate their cell states (simulating stochastic processes and noise during development). This allows us to continuously scale the agents' competency levels from a direct encoding scheme (no competency) to an MCA (with perfect reliability in cell decision executions). We demonstrate that an evolutionary process proceeds much more rapidly when evolving the functional parameters of an MCA compared to evolving the target pattern directly. Moreover, the evolved MCAs generalize well toward system parameter changes and even modified objective functions of the evolutionary process. Thus, the adaptive problem-solving competencies of the agential parts in our NCA-based in silico morphogenesis model strongly affect the evolutionary process, suggesting significant functional implications of the near-ubiquitous competency seen in living matter.

Vertically inherited microbiota and environment modifying behaviours conceal genetic variation in dung beetle life history

Diverse organisms actively manipulate their (sym)biotic and physical environment in ways that feed back on their own development. However, the degree to which these processes affect microevolution remains poorly understood. The gazelle dung beetle both physically modifies its ontogenetic environment and structures its biotic interactions through vertical symbiont transmission. By experimentally eliminating (i) physical environmental modifications and (ii) the vertical inheritance of microbes, we assess how environment modifying behaviour and microbiome transmission shape heritable variation and evolutionary potential. We found that depriving larvae of symbionts and environment modifying behaviours increased additive genetic variance and heritability for development time but not body size. This suggests that larvae's ability to manipulate their environment has the potential to modify heritable variation and to facilitate the accumulation of cryptic genetic variation. This cryptic variation may become released and selectable when organisms encounter environments that are less amenable to organismal manipulation or restructuring. Our findings also suggest that intact microbiomes, which are commonly thought to increase genetic variation of their hosts, may instead reduce and conceal heritable variation. More broadly, our findings highlight that the ability of organisms to actively manipulate their environment may affect the potential of populations to evolve when encountering novel, stressful conditions.

Plasticity-led and mutation-led evolutions are different modes of the same developmental gene regulatory network

The standard theory of evolution proposes that mutations cause heritable variations, which are naturally selected, leading to evolution. However, this mutation-led evolution (MLE) is being questioned by an alternative theory called plasticity-led evolution (PLE). PLE suggests that an environmental change induces adaptive phenotypes, which are later genetically accommodated. According to PLE, developmental systems should be able to respond to environmental changes adaptively. However, developmental systems are known to be robust against environmental and mutational perturbations. Thus, we expect a transition from a robust state to a plastic one. To test this hypothesis, we constructed a gene regulatory network (GRN) model that integrates developmental processes, hierarchical regulation, and environmental cues. We then simulated its evolution over different magnitudes of environmental changes. Our findings indicate that this GRN model exhibits PLE under large environmental changes and MLE under small environmental changes. Furthermore, we observed that the GRN model is susceptible to environmental or genetic fluctuations under large environmental changes but is robust under small environmental changes. This indicates a breakdown of robustness due to large environmental changes. Before the breakdown of robustness, the distribution of phenotypes is biased and aligned to the environmental changes, which would facilitate rapid adaptation should a large environmental change occur. These observations suggest that the evolutionary transition from mutation-led to plasticity-led evolution is due to a developmental transition from robust to susceptible regimes over increasing magnitudes of environmental change. Thus, the GRN model can reconcile these conflicting theories of evolution.

A neural network-based model framework for cell-fate decisions and development

Gene regulatory networks (GRNs) fulfill the essential function of maintaining the stability of cellular differentiation states by sustaining lineage-specific gene expression, while driving the progression of development. However, accounting for the relative stability of intermediate differentiation stages and their divergent trajectories remains a major challenge for models of developmental biology. Here, we develop an empirical data-based associative GRN model (AGRN) in which regulatory networks store multilineage stage-specific gene expression profiles as associative memory patterns. These networks are capable of responding to multiple instructive signals and, depending on signal timing and identity, can dynamically drive the differentiation of multipotent cells toward different cell state attractors. The AGRN dynamics can thus generate diverse lineage-committed cell populations in a robust yet flexible manner, providing an attractor-based explanation for signal-driven cell fate decisions during differentiation and offering a readily generalizable modelling tool that can be applied to a wide variety of cell specification systems.

A mathematical framework for evo-devo dynamics

Natural selection acts on phenotypes constructed over development, which raises the question of how development affects evolution. Classic evolutionary theory indicates that development affects evolution by modulating the genetic covariation upon which selection acts, thus affecting genetic constraints. However, whether genetic constraints are relative, thus diverting adaptation from the direction of steepest fitness ascent, or absolute, thus blocking adaptation in certain directions, remains uncertain. This limits understanding of long-term evolution of developmentally constructed phenotypes. Here we formulate a general, tractable mathematical framework that integrates age progression, explicit development (i.e., the construction of the phenotype across life subject to developmental constraints), and evolutionary dynamics, thus describing the evolutionary and developmental (evo-devo) dynamics. The framework yields simple equations that can be arranged in a layered structure that we call the evo-devo process, whereby five core elementary components generate all equations including those mechanistically describing genetic covariation and the evo-devo dynamics. The framework recovers evolutionary dynamic equations in gradient form and describes the evolution of genetic covariation from the evolution of genotype, phenotype, environment, and mutational covariation. This shows that genotypic and phenotypic evolution must be followed simultaneously to yield a dynamically sufficient description of long-term phenotypic evolution in gradient form, such that evolution described as the climbing of a fitness landscape occurs in "geno-phenotype" space. Genetic constraints in geno-phenotype space are necessarily absolute because the phenotype is related to the genotype by development. Thus, the long-term evolutionary dynamics of developed phenotypes is strongly non-standard: (1) evolutionary equilibria are either absent or infinite in number and depend on genetic covariation and hence on development; (2) developmental constraints determine the admissible evolutionary path and hence which evolutionary equilibria are admissible; and (3) evolutionary outcomes occur at admissible evolutionary equilibria, which do not generally occur at fitness landscape peaks in geno-phenotype space, but at peaks in the admissible evolutionary path where "total genotypic selection" vanishes if exogenous plastic response vanishes and mutational variation exists in all directions of genotype space. Hence, selection and development jointly define the evolutionary outcomes if absolute mutational constraints and exogenous plastic response are absent, rather than the outcomes being defined only by selection. Moreover, our framework provides formulas for the sensitivities of a recurrence and an alternative method to dynamic optimization (i.e., dynamic programming or optimal control) to identify evolutionary outcomes in models with developmentally dynamic traits. These results show that development has major evolutionary effects.

Evolution of biological cooperation: an algorithmic approach

This manuscript presents an algorithmic approach to cooperation in biological systems, drawing on fundamental ideas from statistical mechanics and probability theory. Fisher's geometric model of adaptation suggests that the evolution of organisms well adapted to multiple constraints comes at a significant complexity cost. By utilizing combinatorial models of fitness, we demonstrate that the probability of adapting to all constraints decreases exponentially with the number of constraints, thereby generalizing Fisher's result. Our main focus is understanding how cooperation can overcome this adaptivity barrier. Through these combinatorial models, we demonstrate that when an organism needs to adapt to a multitude of environmental variables, division of labor emerges as the only viable evolutionary strategy.

Plasticity-led evolution as an intrinsic property of developmental gene regulatory networks

The modern evolutionary synthesis seemingly fails to explain how a population can survive a large environmental change: the pre-existence of heritable variants adapted to the novel environment is too opportunistic, whereas the search for new adaptive mutations after the environmental change is so slow that the population may go extinct. Plasticity-led evolution, the initial environmental induction of a novel adaptive phenotype followed by genetic accommodation, has been proposed to solve this problem. However, the mechanism enabling plasticity-led evolution remains unclear. Here, we present computational models that exhibit behaviors compatible with plasticity-led evolution by extending the Wagner model of gene regulatory networks. The models show adaptive plastic response and the uncovering of cryptic mutations under large environmental changes, followed by genetic accommodation. Moreover, these behaviors are consistently observed over distinct novel environments. We further show that environmental cues, developmental processes, and hierarchical regulation cooperatively amplify the above behaviors and accelerate evolution. These observations suggest plasticity-led evolution is a universal property of complex developmental systems independent of particular mutations.

Agency, Goal-Directed Behavior, and Part-Whole Relationships in Biological Systems

In this essay we aim to present some considerations regarding a minimal but concrete notion of agency and goal-directed behavior that are useful for characterizing biological systems at different scales. These considerations are a particular perspective, bringing together concepts from dynamical systems, combinatorial problem-solving, and connectionist learning with an emphasis on the relationship between parts and wholes. This perspective affords some ways to think about agents that are concrete and quantifiable, and relevant to some important biological issues. Instead of advocating for a strict definition of minimally agential characteristics, we focus on how (even for a modest notion of agency) the agency of a system can be more than the sum of the agency of its parts. We quantify this in terms of the problem-solving competency of a system with respect to resolution of the frustrations between its parts. This requires goal-directed behavior in the sense of delayed gratification, i.e., taking dynamical trajectories that forego short-term gains (or sustain short-term stress or frustration) in favor of long-term gains. In order for this competency to belong to the system (rather than to its parts or given by its construction or design), it can involve distributed systemic knowledge that is acquired through experience, i.e., changes in the organization of the relationships among its parts (without presupposing a system-level reward function for such changes). This conception of agency helps us think about the ways in which cells, organisms, and perhaps other biological scales, can be agential (i.e., more agential than their parts) in a quantifiable sense, without denying that the behavior of the whole depends on the behaviors of the parts in their current organization.

Rules of teeth development align microevolution with macroevolution in extant and extinct primates

Macroevolutionary biologists have classically rejected the notion that higher-level patterns of divergence arise through microevolutionary processes acting within populations. For morphology, this consensus partly derives from the inability of quantitative genetics models to correctly predict the behaviour of evolutionary processes at the scale of millions of years. Developmental studies (evo-devo) have been proposed to reconcile micro- and macroevolution. However, there has been little progress in establishing a formal framework to apply evo-devo models of phenotypic diversification. Here we reframe this issue by asking whether using evo-devo models to quantify biological variation can improve the explanatory power of comparative models, thus helping us bridge the gap between micro- and macroevolution. We test this prediction by evaluating the evolution of primate lower molars in a comprehensive dataset densely sampled across living and extinct taxa. Our results suggest that biologically informed morphospaces alongside quantitative genetics models allow a seamless transition between the micro- and macroscales, whereas biologically uninformed spaces do not. We show that the adaptive landscape for primate teeth is corridor like, with changes in morphology within the corridor being nearly neutral. Overall, our framework provides a basis for integrating evo-devo into the modern synthesis, allowing an operational way to evaluate the ultimate causes of macroevolution.

From autopoiesis to self-optimization: Toward an enactive model of biological regulation

The theory of autopoiesis has been influential in many areas of theoretical biology, especially in the fields of artificial life and origins of life. However, it has not managed to productively connect with mainstream biology, partly for theoretical reasons, but arguably mainly because deriving specific working hypotheses has been challenging. The theory has recently undergone significant conceptual development in the enactive approach to life and mind. Hidden complexity in the original conception of autopoiesis has been explicated in the service of other operationalizable concepts related to self-individuation: precariousness, adaptivity, and agency. Here we advance these developments by highlighting the interplay of these concepts with considerations from thermodynamics: reversibility, irreversibility, and path-dependence. We interpret this interplay in terms of the self-optimization model, and present modeling results that illustrate how these minimal conditions enable a system to re-organize itself such that it tends toward coordinated constraint satisfaction at the system level. Although the model is still very abstract, these results point in a direction where the enactive approach could productively connect with cell biology.

Darwin's agential materials: evolutionary implications of multiscale competency in developmental biology

A critical aspect of evolution is the layer of developmental physiology that operates between the genotype and the anatomical phenotype. While much work has addressed the evolution of developmental mechanisms and the evolvability of specific genetic architectures with emergent complexity, one aspect has not been sufficiently explored: the implications of morphogenetic problem-solving competencies for the evolutionary process itself. The cells that evolution works with are not passive components: rather, they have numerous capabilities for behavior because they derive from ancestral unicellular organisms with rich repertoires. In multicellular organisms, these capabilities must be tamed, and can be exploited, by the evolutionary process. Specifically, biological structures have a multiscale competency architecture where cells, tissues, and organs exhibit regulative plasticity-the ability to adjust to perturbations such as external injury or internal modifications and still accomplish specific adaptive tasks across metabolic, transcriptional, physiological, and anatomical problem spaces. Here, I review examples illustrating how physiological circuits guiding cellular collective behavior impart computational properties to the agential material that serves as substrate for the evolutionary process. I then explore the ways in which the collective intelligence of cells during morphogenesis affect evolution, providing a new perspective on the evolutionary search process. This key feature of the physiological software of life helps explain the remarkable speed and robustness of biological evolution, and sheds new light on the relationship between genomes and functional anatomical phenotypes.

How development affects evolution

Natural selection acts on developmentally constructed phenotypes, but how does development affect evolution? This question prompts a simultaneous consideration of development and evolution. However, there has been a lack of general mathematical frameworks mechanistically integrating the two, which may have inhibited progress on the question. Here, we use a new mathematical framework that mechanistically integrates development into evolution to analyse how development affects evolution. We show that, while selection pushes genotypic and phenotypic evolution up the fitness landscape, development determines the admissible evolutionary pathway, such that evolutionary outcomes occur at path peaks rather than landscape peaks. Changes in development can generate path peaks, triggering genotypic or phenotypic diversification, even on constant, single-peak landscapes. Phenotypic plasticity, niche construction, extra-genetic inheritance, and developmental bias alter the evolutionary path and hence the outcome. Thus, extra-genetic inheritance can have permanent evolutionary effects by changing the developmental constraints, even if extra-genetically acquired elements are not transmitted to future generations. Selective development, whereby phenotype construction points in the adaptive direction, may induce adaptive or maladaptive evolution depending on the developmental constraints. Moreover, developmental propagation of phenotypic effects over age enables the evolution of negative senescence. Overall, we find that development plays a major evolutionary role.

Biotic Interactions and the Future of Fishes on Coral Reefs: The Importance of Trait-Based Approaches

Biotic interactions govern the structure and function of coral reef ecosystems. As environmental conditions change, reef-associated fish populations can persist by tracking their preferred niche or adapting to new conditions. Biotic interactions will affect how these responses proceed and whether they are successful. Yet, our understanding of these effects is currently limited. Ecological and evolutionary theories make explicit predictions about the effects of biotic interactions, but many remain untested. Here, we argue that large-scale functional trait datasets enable us to investigate how biotic interactions have shaped the assembly of contemporary reef fish communities and the evolution of species within them, thus improving our ability to predict future changes. Importantly, the effects of biotic interactions on these processes have occurred simultaneously within dynamic environments. Functional traits provide a means to integrate the effects of both ecological and evolutionary processes, as well as a way to overcome some of the challenges of studying biotic interactions. Moreover, functional trait data can enhance predictive modeling of future reef fish distributions and evolvability. We hope that our vision for an integrative approach, focused on quantifying functionally relevant traits and how they mediate biotic interactions in different environmental contexts, will catalyze new research on the future of reef fishes in a changing environment.

Learning in Transcriptional Network Models: Computational Discovery of Pathway-Level Memory and Effective Interventions

Trainability, in any substrate, refers to the ability to change future behavior based on past experiences. An understanding of such capacity within biological cells and tissues would enable a particularly powerful set of methods for prediction and control of their behavior through specific patterns of stimuli. This top-down mode of control (as an alternative to bottom-up modification of hardware) has been extensively exploited by computer science and the behavioral sciences; in biology however, it is usually reserved for organism-level behavior in animals with brains, such as training animals towards a desired response. Exciting work in the field of basal cognition has begun to reveal degrees and forms of unconventional memory in non-neural tissues and even in subcellular biochemical dynamics. Here, we characterize biological gene regulatory circuit models and protein pathways and find them capable of several different kinds of memory. We extend prior results on learning in binary transcriptional networks to continuous models and identify specific interventions (regimes of stimulation, as opposed to network rewiring) that abolish undesirable network behavior such as drug pharmacoresistance and drug sensitization. We also explore the stability of created memories by assessing their long-term behavior and find that most memories do not decay over long time periods. Additionally, we find that the memory properties are quite robust to noise; surprisingly, in many cases noise actually increases memory potential. We examine various network properties associated with these behaviors and find that no one network property is indicative of memory. Random networks do not show similar memory behavior as models of biological processes, indicating that generic network dynamics are not solely responsible for trainability. Rational control of dynamic pathway function using stimuli derived from computational models opens the door to empirical studies of proto-cognitive capacities in unconventional embodiments and suggests numerous possible applications in biomedicine, where behavior shaping of pathway responses stand as a potential alternative to gene therapy.

Computational modelling of plasticity-led evolution

Plasticity-led evolution is a form of evolution where a change in the environment induces novel traits via phenotypic plasticity, after which the novel traits are genetically accommodated over generations under the novel environment. This mode of evolution is expected to resolve the problem of gradualism (i.e., evolution by the slow accumulation of mutations that induce phenotypic variation) implied by the Modern Evolutionary Synthesis, in the face of a large environmental change. While experimental works are essential for validating that plasticity-led evolution indeed happened, we need computational models to gain insight into its underlying mechanisms and make qualitative predictions. Such computational models should include the developmental process and gene-environment interactions in addition to genetics and natural selection. We point out that gene regulatory network models can incorporate all the above notions. In this review, we highlight results from computational modelling of gene regulatory networks that consolidate the criteria of plasticity-led evolution. Since gene regulatory networks are mathematically equivalent to artificial recurrent neural networks, we also discuss their analogies and discrepancies, which may help further understand the mechanisms underlying plasticity-led evolution.

Phenotype-first hypotheses, spandrels and early metazoan evolution

Against the neo-Darwinian assumption that genetic factors are the principal source of variation upon which natural selection operates, a phenotype-first hypothesis strikes us as revolutionary because development would seem to constitute an independent source of variability. Richard Watson and his co-authors have argued that developmental memory constitutes one such variety of phenotypic variability. While this version of the phenotype-first hypothesis is especially well-suited for the late metazoan context, where animals have a sufficient history of selection from which to draw, appeals to developmental memory seem less plausible in the evolutionary context of the early metazoans. I provide an interpretation of Stuart Newman's account of deep metazoan phylogenesis that suggests that spandrels are, in addition to developmental memory, an important reservoir of phenotypic variability. I conclude by arguing that Gerd Müller's "side-effect hypothesis" is an illuminating generalization of the proposed non-Watsonian version of the phenotype-first hypothesis.

Genetic influences on dentognathic morphology in the Jirel population of Nepal

Patterns of genetic variation and covariation impact the evolution of the craniofacial complex and contribute to clinically significant malocclusions in modern human populations. Previous quantitative genetic studies have estimated the heritabilities and genetic correlations of skeletal and dental traits in humans and nonhuman primates, but none have estimated these quantitative genetic parameters across the dentognathic complex. A large and powerful pedigree from the Jirel population of Nepal was leveraged to estimate heritabilities and genetic correlations in 62 maxillary and mandibular arch dimensions, incisor and canine lengths, and post-canine tooth crown areas (N ≥ 739). Quantitative genetic parameter estimation was performed using maximum likelihood-based variance decomposition. Residual heritability estimates were significant for all traits, ranging from 0.269 to 0.898. Genetic correlations were positive for all trait pairs. Principal components analyses of the phenotypic and genetic correlation matrices indicate an overall size effect across all measurements on the first principal component. Additional principal components demonstrate positive relationships between post-canine tooth crown areas and arch lengths and negative relationships between post-canine tooth crown areas and arch widths, and between arch lengths and arch widths. Based on these findings, morphological variation in the human dentognathic complex may be constrained by genetic relationships between dental dimensions and arch lengths, with weaker genetic correlations between these traits and arch widths allowing for variation in arch shape. The patterns identified are expected to have impacted the evolution of the dentognathic complex and its genetic architecture as well as the prevalence of dental crowding in modern human populations.

Endless forms most beautiful 2.0: teleonomy and the bioengineering of chimaeric and synthetic organisms

The rich variety of biological forms and behaviours results from one evolutionary history on Earth, via frozen accidents and selection in specific environments. This ubiquitous baggage in natural, familiar model species obscures the plasticity and swarm intelligence of cellular collectives. Significant gaps exist in our understanding of the origin of anatomical novelty, of the relationship between genome and form, and of strategies for control of large-scale structure and function in regenerative medicine and bioengineering. Analysis of living forms that have never existed before is necessary to reveal deep design principles of life as it can be. We briefly review existing examples of chimaeras, cyborgs, hybrots and other beings along the spectrum containing evolved and designed systems. To drive experimental progress in multicellular synthetic morphology, we propose teleonomic (goal-seeking, problem-solving) behaviour in diverse problem spaces as a powerful invariant across possible beings regardless of composition or origin. Cybernetic perspectives on chimaeric morphogenesis erase artificial distinctions established by past limitations of technology and imagination. We suggest that a multi-scale competency architecture facilitates evolution of robust problem-solving, living machines. Creation and analysis of novel living forms will be an essential testbed for the emerging field of diverse intelligence, with numerous implications across regenerative medicine, robotics and ethics.

Competency in Navigating Arbitrary Spaces as an Invariant for Analyzing Cognition in Diverse Embodiments

One of the most salient features of life is its capacity to handle novelty and namely to thrive and adapt to new circumstances and changes in both the environment and internal components. An understanding of this capacity is central to several fields: the evolution of form and function, the design of effective strategies for biomedicine, and the creation of novel life forms via chimeric and bioengineering technologies. Here, we review instructive examples of living organisms solving diverse problems and propose competent navigation in arbitrary spaces as an invariant for thinking about the scaling of cognition during evolution. We argue that our innate capacity to recognize agency and intelligence in unfamiliar guises lags far behind our ability to detect it in familiar behavioral contexts. The multi-scale competency of life is essential to adaptive function, potentiating evolution and providing strategies for top-down control (not micromanagement) to address complex disease and injury. We propose an observer-focused viewpoint that is agnostic about scale and implementation, illustrating how evolution pivoted similar strategies to explore and exploit metabolic, transcriptional, morphological, and finally 3D motion spaces. By generalizing the concept of behavior, we gain novel perspectives on evolution, strategies for system-level biomedical interventions, and the construction of bioengineered intelligences. This framework is a first step toward relating to intelligence in highly unfamiliar embodiments, which will be essential for progress in artificial intelligence and regenerative medicine and for thriving in a world increasingly populated by synthetic, bio-robotic, and hybrid beings.

Design for an Individual: Connectionist Approaches to the Evolutionary Transitions in Individuality

The truly surprising thing about evolution is not how it makes individuals better adapted to their environment, but how it makes individuals. All individuals are made of parts that used to be individuals themselves, e.g., multicellular organisms from unicellular organisms. In such evolutionary transitions in individuality, the organised structure of relationships between component parts causes them to work together, creating a new organismic entity and a new evolutionary unit on which selection can act. However, the principles of these transitions remain poorly understood. In particular, the process of transition must be explained by “bottom-up” selection, i.e., on the existing lower-level evolutionary units, without presupposing the higher-level evolutionary unit we are trying to explain. In this hypothesis and theory manuscript we address the conditions for evolutionary transitions in individuality by exploiting adaptive principles already known in learning systems. Connectionist learning models, well-studied in neural networks, demonstrate how networks of organised functional relationships between components, sufficient to exhibit information integration and collective action, can be produced via fully-distributed and unsupervised learning principles, i.e., without centralised control or an external teacher. Evolutionary connectionism translates these distributed learning principles into the domain of natural selection, and suggests how relationships among evolutionary units could become adaptively organised by selection from below without presupposing genetic relatedness or selection on collectives. In this manuscript, we address how connectionist models with a particular interaction structure might explain transitions in individuality. We explore the relationship between the interaction structures necessary for (a) evolutionary individuality (where the evolution of the whole is a non-decomposable function of the evolution of the parts), (b) organismic individuality (where the development and behaviour of the whole is a non-decomposable function of the behaviour of component parts) and (c) non-linearly separable functions, familiar in connectionist models (where the output of the network is a non-decomposable function of the inputs). Specifically, we hypothesise that the conditions necessary to evolve a new level of individuality are described by the conditions necessary to learn non-decomposable functions of this type (or deep model induction) familiar in connectionist models of cognition and learning.

Technological Approach to Mind Everywhere: An Experimentally-Grounded Framework for Understanding Diverse Bodies and Minds

Synthetic biology and bioengineering provide the opportunity to create novel embodied cognitive systems (otherwise known as minds) in a very wide variety of chimeric architectures combining evolved and designed material and software. These advances are disrupting familiar concepts in the philosophy of mind, and require new ways of thinking about and comparing truly diverse intelligences, whose composition and origin are not like any of the available natural model species. In this Perspective, I introduce TAME-Technological Approach to Mind Everywhere-a framework for understanding and manipulating cognition in unconventional substrates. TAME formalizes a non-binary (continuous), empirically-based approach to strongly embodied agency. TAME provides a natural way to think about animal sentience as an instance of collective intelligence of cell groups, arising from dynamics that manifest in similar ways in numerous other substrates. When applied to regenerating/developmental systems, TAME suggests a perspective on morphogenesis as an example of basal cognition. The deep symmetry between problem-solving in anatomical, physiological, transcriptional, and 3D (traditional behavioral) spaces drives specific hypotheses by which cognitive capacities can increase during evolution. An important medium exploited by evolution for joining active subunits into greater agents is developmental bioelectricity, implemented by pre-neural use of ion channels and gap junctions to scale up cell-level feedback loops into anatomical homeostasis. This architecture of multi-scale competency of biological systems has important implications for plasticity of bodies and minds, greatly potentiating evolvability. Considering classical and recent data from the perspectives of computational science, evolutionary biology, and basal cognition, reveals a rich research program with many implications for cognitive science, evolutionary biology, regenerative medicine, and artificial intelligence.

Cancer progression as a learning process

Drug resistance and metastasis-the major complications in cancer-both entail adaptation of cancer cells to stress, whether a drug or a lethal new environment. Intriguingly, these adaptive processes share similar features that cannot be explained by a pure Darwinian scheme, including dormancy, increased heterogeneity, and stress-induced plasticity. Here, we propose that learning theory offers a framework to explain these features and may shed light on these two intricate processes. In this framework, learning is performed at the single-cell level, by stress-driven exploratory trial-and-error. Such a process is not contingent on pre-existing pathways but on a random search for a state that diminishes the stress. We review underlying mechanisms that may support this search, and show by using a learning model that such exploratory learning is feasible in a high-dimensional system as the cell. At the population level, we view the tissue as a network of exploring agents that communicate, restraining cancer formation in health. In this view, disease results from the breakdown of homeostasis between cellular exploratory drive and tissue homeostasis.

Minimal Developmental Computation: A Causal Network Approach to Understand Morphogenetic Pattern Formation

What information-processing strategies and general principles are sufficient to enable self-organized morphogenesis in embryogenesis and regeneration? We designed and analyzed a minimal model of self-scaling axial patterning consisting of a cellular network that develops activity patterns within implicitly set bounds. The properties of the cells are determined by internal 'genetic' networks with an architecture shared across all cells. We used machine-learning to identify models that enable this virtual mini-embryo to pattern a typical axial gradient while simultaneously sensing the set boundaries within which to develop it from homogeneous conditions-a setting that captures the essence of early embryogenesis. Interestingly, the model revealed several features (such as planar polarity and regenerative re-scaling capacity) for which it was not directly selected, showing how these common biological design principles can emerge as a consequence of simple patterning modes. A novel "causal network" analysis of the best model furthermore revealed that the originally symmetric model dynamically integrates into intercellular causal networks characterized by broken-symmetry, long-range influence and modularity, offering an interpretable macroscale-circuit-based explanation for phenotypic patterning. This work shows how computation could occur in biological development and how machine learning approaches can generate hypotheses and deepen our understanding of how featureless tissues might develop sophisticated patterns-an essential step towards predictive control of morphogenesis in regenerative medicine or synthetic bioengineering contexts. The tools developed here also have the potential to benefit machine learning via new forms of backpropagation and by leveraging the novel distributed self-representation mechanisms to improve robustness and generalization.

Development and selective grain make plasticity 'take the lead' in adaptive evolution

BACKGROUND

Biological evolution exhibits an extraordinary capability to adapt organisms to their environments. The explanation for this often takes for granted that random genetic variation produces at least some beneficial phenotypic variation in which natural selection can act. Such genetic evolvability could itself be a product of evolution, but it is widely acknowledged that the immediate selective gains of evolvability are small on short timescales. So how do biological systems come to exhibit such extraordinary capacity to evolve? One suggestion is that adaptive phenotypic plasticity makes genetic evolution find adaptations faster. However, the need to explain the origin of adaptive plasticity puts genetic evolution back in the driving seat, and genetic evolvability remains unexplained.

RESULTS

To better understand the interaction between plasticity and genetic evolvability, we simulate the evolution of phenotypes produced by gene-regulation network-based models of development. First, we show that the phenotypic variation resulting from genetic and environmental perturbation are highly concordant. This is because phenotypic variation, regardless of its cause, occurs within the relatively specific space of possibilities allowed by development. Second, we show that selection for genetic evolvability results in the evolution of adaptive plasticity and vice versa. This linkage is essentially symmetric but, unlike genetic evolvability, the selective gains of plasticity are often substantial on short, including within-lifetime, timescales. Accordingly, we show that selection for phenotypic plasticity can be effective in promoting the evolution of high genetic evolvability.

CONCLUSIONS

Without overlooking the fact that adaptive plasticity is itself a product of genetic evolution, we show how past selection for plasticity can exercise a disproportionate effect on genetic evolvability and, in turn, influence the course of adaptive evolution.

Using phenotypic plasticity to understand the structure and evolution of the genotype-phenotype map

Deciphering the genotype-phenotype map necessitates relating variation at the genetic level to variation at the phenotypic level. This endeavour is inherently limited by the availability of standing genetic variation, the rate of spontaneous mutation to novo genetic variants, and possible biases associated with induced mutagenesis. An interesting alternative is to instead rely on the environment as a source of variation. Many phenotypic traits change plastically in response to the environment, and these changes are generally underlain by changes in gene expression. Relating gene expression plasticity to the phenotypic plasticity of more integrated organismal traits thus provides useful information about which genes influence the development and expression of which traits, even in the absence of genetic variation. We here appraise the prospects and limits of such an environment-for-gene substitution for investigating the genotype-phenotype map. We review models of gene regulatory networks, and discuss the different ways in which they can incorporate the environment to mechanistically model phenotypic plasticity and its evolution. We suggest that substantial progress can be made in deciphering this genotype-environment-phenotype map, by connecting theory on gene regulatory network to empirical patterns of gene co-expression, and by more explicitly relating gene expression to the expression and development of phenotypes, both theoretically and empirically.

The evolutionary ecology of fatty-acid variation: Implications for consumer adaptation and diversification

The nutritional diversity of resources can affect the adaptive evolution of consumer metabolism and consumer diversification. The omega-3 long-chain polyunsaturated fatty acids eicosapentaenoic acid (EPA; 20:5n-3) and docosahexaenoic acid (DHA; 22:6n-3) have a high potential to affect consumer fitness, through their widespread effects on reproduction, growth and survival. However, few studies consider the evolution of fatty acid metabolism within an ecological context. In this review, we first document the extensive diversity in both primary producer and consumer fatty acid distributions amongst major ecosystems, between habitats and amongst species within habitats. We highlight some of the key nutritional contrasts that can shape behavioural and/or metabolic adaptation in consumers, discussing how consumers can evolve in response to the spatial, seasonal and community-level variation of resource quality. We propose a hierarchical trait-based approach for studying the evolution of consumers' metabolic networks and review the evolutionary genetic mechanisms underpinning consumer adaptation to EPA and DHA distributions. In doing so, we consider how the metabolic traits of consumers are hierarchically structured, from cell membrane function to maternal investment, and have strongly environment-dependent expression. Finally, we conclude with an outlook on how studying the metabolic adaptation of consumers within the context of nutritional landscapes can open up new opportunities for understanding evolutionary diversification.

Gene regulatory networks exhibit several kinds of memory: quantification of memory in biological and random transcriptional networks

Gene regulatory networks (GRNs) process important information in developmental biology and biomedicine. A key knowledge gap concerns how their responses change over time. Hypothesizing long-term changes of dynamics induced by transient prior events, we created a computational framework for defining and identifying diverse types of memory in candidate GRNs. We show that GRNs from a wide range of model systems are predicted to possess several types of memory, including Pavlovian conditioning. Associative memory offers an alternative strategy for the biomedical use of powerful drugs with undesirable side effects, and a novel approach to understanding the variability and time-dependent changes of drug action. We find evidence of natural selection favoring GRN memory. Vertebrate GRNs overall exhibit more memory than invertebrate GRNs, and memory is most prevalent in differentiated metazoan cell networks compared with undifferentiated cells. Timed stimuli are a powerful alternative for biomedical control of complex in vivo dynamics without genomic editing or transgenes.

•

Gene regulatory networks' dynamics are modified by transient stimuli

•

GRNs have several different types of memory, including associative conditioning

•

Evolution favored GRN memory, and differentiated cells have the most memory capacity

•

Training GRNs offers a novel biomedical strategy not dependent on genetic rewiring

Evolution of the locomotor skeleton in Anolis lizards reflects the interplay between ecological opportunity and phylogenetic inertia

Anolis lizards originated in continental America but have colonized the Greater Antillean islands and recolonized the mainland, resulting in three major groups (Primary and Secondary Mainland and Greater Antillean). The adaptive radiation in the Greater Antilles has famously resulted in the repeated evolution of ecomorphs. Yet, it remains poorly understood to what extent this island radiation differs from diversification on the mainland. Here, we demonstrate that the evolutionary modularity between girdles and limbs is fundamentally different in the Greater Antillean and Primary Mainland Anolis. This is consistent with ecological opportunities on islands driving the adaptive radiation along distinct evolutionary trajectories. However, Greater Antillean Anolis share evolutionary modularity with the group that recolonized the mainland, demonstrating a persistent phylogenetic inertia. A comparison of these two groups support an increased morphological diversity and faster and more variable evolutionary rates on islands. These macroevolutionary trends of the locomotor skeleton in Anolis illustrate that ecological opportunities on islands can have lasting effects on morphological diversification.

Differences in developmental potential predict the contrasting patterns of dental diversification in characiform and cypriniform fishes

Morphological diversification during adaptive radiation may depend on factors external or internal to the lineage. We provide evidence for the latter in characiform fishes (tetras and piranhas), which exhibit extensive dental diversity. Phylogenetic character mapping supported regain of lost teeth as contributing to this diversity. To test for latent potential for dentition that would facilitate its evolutionary expansion, we overexpressed a tooth initiation signal, the tumour necrosis factor pathway ligand ectodysplasin, in a model characiform, the Mexican tetra (Astyanax mexicanus). This manipulation resulted in extensive ectopic dentition, in contrast with its previously reported limited effect in the zebrafish (Danio rerio). Tooth location in the order Cypriniformes, to which the zebrafish belongs, is much more restricted than in characiforms, a pattern that may be explained by differences in the retention of ancestral developmental potential. Our results suggest that differences in evolvability between lineages may lead to contrasting patterns of diversification.

Evolvability and evolutionary rescue

The survival prospects of threatened species or populations can sometimes be improved by adaptive change. Such evolutionary rescue is particularly relevant when the threat comes from changing environments, or when long-term population persistence requires range expansion into new habitats. Conservation biologists are therefore often interested in whether or not populations or lineages show a disposition for adaptive evolution, that is, if they are evolvable. Here, we discuss four alternative perspectives that target different causes of evolvability and outline some of the key challenges those perspectives are designed to address. Standing genetic variation provides one familiar estimate of evolvability. Yet, the mere presence of genetic variation is often insufficient to predict if a population will adapt, or how it will adapt. The reason is that adaptive change not only depends on genetic variation, but also on the extent to which this genetic variation can be realized as adaptive phenotypic variation. This requires attention to developmental systems and how plasticity influences evolutionary potential. Finally, we discuss how a better understanding of the different factors that contribute to evolvability can be exploited in conservation practice.

Phenotypes to remember: Evolutionary developmental memory capacity and robustness

There is increased awareness of the possibility of developmental memories resulting from evolutionary learning. Genetic regulatory and neural networks can be modelled by analogous formalism raising the important question of productive analogies in principles, processes and performance. We investigate the formation and persistence of various developmental memories of past phenotypes asking how the number of remembered past phenotypes scales with network size, to what extent memories stored form by Hebbian-like rules, and how robust these developmental "devo-engrams" are against networks perturbations (graceful degradation). The analogy between neural and genetic regulatory networks is not superficial in that it allows knowledge transfer between fields that used to be developed separately from each other. Known examples of spectacular phenotypic radiations could partly be accounted for in such terms.

How to fit in: The learning principles of cell differentiation

Cell differentiation in multicellular organisms requires cells to respond to complex combinations of extracellular cues, such as morphogen concentrations. Some models of phenotypic plasticity conceptualise the response as a relatively simple function of a single environmental cues (e.g. a linear function of one cue), which facilitates rigorous analysis. Conversely, more mechanistic models such those implementing GRNs allows for a more general class of response functions but makes analysis more difficult. Therefore, a general theory describing how cells integrate multi-dimensional signals is lacking. In this work, we propose a theoretical framework for understanding the relationships between environmental cues (inputs) and phenotypic responses (outputs) underlying cell plasticity. We describe the relationship between environment and cell phenotype using logical functions, making the evolution of cell plasticity equivalent to a simple categorisation learning task. This abstraction allows us to apply principles derived from learning theory to understand the evolution of multi-dimensional plasticity. Our results show that natural selection is capable of discovering adaptive forms of cell plasticity associated with complex logical functions. However, developmental dynamics cause simpler functions to evolve more readily than complex ones. By using conceptual tools derived from learning theory we show that this developmental bias can be interpreted as a learning bias in the acquisition of plasticity functions. Because of that bias, the evolution of plasticity enables cells, under some circumstances, to display appropriate plastic responses to environmental conditions that they have not experienced in their evolutionary past. This is possible when the selective environment mirrors the bias of the developmental dynamics favouring the acquisition of simple plasticity functions–an example of the necessary conditions for generalisation in learning systems. These results illustrate the functional parallelisms between learning in neural networks and the action of natural selection on environmentally sensitive gene regulatory networks. This offers a theoretical framework for the evolution of plastic responses that integrate information from multiple cues, a phenomenon that underpins the evolution of multicellularity and developmental robustness.

In organisms composed of many cell types, the differentiation of cells relies on their ability to respond to complex extracellular cues, such as morphogen concentrations, a phenomenon known as cell plasticity. Although cell plasticity plays a crucial role in development and evolution, it is not clear how, and if, cell plasticity can enhance adaptation to a novel environment and/or facilitate robust developmental processes. In some models, the relationships between the environmental cues (inputs) and the phenotypic responses (outputs) are conceptualised as one-to-one (i.e. simple ‘reaction norms’); whereas the phenotype of plastic cells commonly depends on several simultaneous inputs (i.e. many-to-one, multi-dimensional reaction norms). One alternative is the use of a gene-regulatory network (GRN) models that allow for much more general responses; but this can make analysis difficult. In this work we use a theoretical framework based on logical functions and learning theory to characterize such multi-dimensional reaction norms produced by GRNs. This allows us to reveal a strong and previously unnoticed bias towards the acquisition of simple forms of cell plasticity, which increases their ability to adapt to novel environments. Recognising this bias helps us to understand when the evolution of cell plasticity will increase the ability of plastic cells to adapt to novel environments, to respond appropriately to complex extracellular cues and to enhance developmental robustness. Since this set of properties are required for the evolution of multicellularity, our approach can also contribute to our understanding of this evolutionary transition.

Different perspectives on non-genetic inheritance illustrate the versatile utility of the Price equation in evolutionary biology

The diversity of genetic and non-genetic processes that make offspring resemble their parents are increasingly well understood. In addition to genetic inheritance, parent-offspring similarity is affected by epigenetic, behavioural and cultural mechanisms that collectively can be referred to as non-genetic inheritance. Given the generality of the Price equation as a description of evolutionary change, is it not surprising that the Price equation has been adopted to model the evolutionary implications of non-genetic inheritance. In this paper, we briefly introduce the heredity perspectives on which those models rely, discuss the extent to which these perspectives make different assumptions and place different emphases on the roles of heredity and development in evolution, and the types of empirical research programmes they motivate. The existence of multiple perspectives and explanatory aims highlight, on the one hand, the versatility of the Price equation and, on the other hand, the importance of understanding how heredity and development can be conceptualized in evolutionary studies. This article is part of the theme issue 'Fifty years of the Price equation'.

Modeling somatic computation with non-neural bioelectric networks

The field of basal cognition seeks to understand how adaptive, context-specific behavior occurs in non-neural biological systems. Embryogenesis and regeneration require plasticity in many tissue types to achieve structural and functional goals in diverse circumstances. Thus, advances in both evolutionary cell biology and regenerative medicine require an understanding of how non-neural tissues could process information. Neurons evolved from ancient cell types that used bioelectric signaling to perform computation. However, it has not been shown whether or how non-neural bioelectric cell networks can support computation. We generalize connectionist methods to non-neural tissue architectures, showing that a minimal non-neural Bio-Electric Network (BEN) model that utilizes the general principles of bioelectricity (electrodiffusion and gating) can compute. We characterize BEN behaviors ranging from elementary logic gates to pattern detectors, using both fixed and transient inputs to recapitulate various biological scenarios. We characterize the mechanisms of such networks using dynamical-systems and information-theory tools, demonstrating that logic can manifest in bidirectional, continuous, and relatively slow bioelectrical systems, complementing conventional neural-centric architectures. Our results reveal a variety of non-neural decision-making processes as manifestations of general cellular biophysical mechanisms and suggest novel bioengineering approaches to construct functional tissues for regenerative medicine and synthetic biology as well as new machine learning architectures.

Adaptation, fitness landscape learning and fast evolution

We consider evolution of a large population, where fitness of each organism is defined by many phenotypical traits. These traits result from expression of many genes. Under some assumptions on  fitness we prove that such model organisms  are capable, to some extent, to recognize the fitness landscape. That fitness landscape learning sharply reduces the number of mutations needed for adaptation. Moreover, this learning increases phenotype robustness with respect to mutations, i.e., canalizes the phenotype.  We show that learning and canalization work only when evolution is gradual. Organisms can be adapted to  many constraints associated with a hard environment, if that environment becomes harder step by step. Our results explain why evolution can involve genetic changes of a relatively large effect and why the total number of changes are surprisingly small.

The Role of Mutation Bias in Adaptive Evolution

Mutational input is the ultimate source of genetic variation, but mutations are not thought to affect the direction of adaptive evolution. Recently, critics of standard evolutionary theory have questioned the random and non-directional nature of mutations, claiming that the mutational process can be adaptive in its own right. We discuss here mutation bias in adaptive evolution. We find little support for mutation bias as an independent force in adaptive evolution, although it can interact with selection under conditions of small population size and when standing genetic variation is limited, entirely consistent with standard evolutionary theory. We further emphasize that natural selection can shape the phenotypic effects of mutations, giving the false impression that directed mutations are driving adaptive evolution.

Developmental bias in the fossil record

The role of developmental bias and plasticity in evolution is a central research interest in evolutionary biology. Studies of these concepts and related processes are usually conducted on extant systems and have seen limited investigation in the fossil record. Here, I identify plasticity-led evolution (PLE) as a form of developmental bias accessible through scrutiny of paleontological material. I summarize the process of PLE and describe it in terms of the environmentally mediated accumulation and release of cryptic genetic variation. Given this structure, I then predict its manifestation in the fossil record, discuss its similarity to quantum evolution and punctuated equilibrium, and argue that these describe macroevolutionary patterns concordant with PLE. Finally, I suggest methods and directions towards providing evidence of PLE in the fossil record and conclude that such endeavors are likely to be highly rewarding.

Plastic responses to novel environments are biased towards phenotype dimensions with high additive genetic variation

Environmentally induced phenotypes have been proposed to initiate and bias adaptive evolutionary change toward particular directions. The potential for this to happen depends in part on how well plastic responses are aligned with the additive genetic variance and covariance in traits. Using meta-analysis, we demonstrate that plastic responses to novel environments tend to occur along phenotype dimensions that harbor substantial amounts of additive genetic variation. This suggests that selection for or against environmentally induced phenotypes typically will be effective. One interpretation of the alignment between the direction of plasticity and the main axis of additive genetic variation is that developmental systems tend to respond to environmental novelty as they do to genetic mutation. This makes it challenging to distinguish if the direction of evolution is biased by plasticity or genetic "constraint." Our results therefore highlight a need for new theoretical and empirical approaches to address the role of plasticity in evolution.

The Cognitive Lens: a primer on conceptual tools for analysing information processing in developmental and regenerative morphogenesis

Brains exhibit plasticity, multi-scale integration of information, computation and memory, having evolved by specialization of non-neural cells that already possessed many of the same molecular components and functions. The emerging field of basal cognition provides many examples of decision-making throughout a wide range of non-neural systems. How can biological information processing across scales of size and complexity be quantitatively characterized and exploited in biomedical settings? We use pattern regulation as a context in which to introduce the Cognitive Lens-a strategy using well-established concepts from cognitive and computer science to complement mechanistic investigation in biology. To facilitate the assimilation and application of these approaches across biology, we review tools from various quantitative disciplines, including dynamical systems, information theory and least-action principles. We propose that these tools can be extended beyond neural settings to predict and control systems-level outcomes, and to understand biological patterning as a form of primitive cognition. We hypothesize that a cognitive-level information-processing view of the functions of living systems can complement reductive perspectives, improving efficient top-down control of organism-level outcomes. Exploration of the deep parallels across diverse quantitative paradigms will drive integrative advances in evolutionary biology, regenerative medicine, synthetic bioengineering, cognitive neuroscience and artificial intelligence. This article is part of the theme issue 'Liquid brains, solid brains: How distributed cognitive architectures process information'.

The Extended Evolutionary Synthesis: what is the debate about, and what might success for the extenders look like?

Debate over the Extended Evolutionary Synthesis (EES) ranges over three quite different domains of enquiry. Protagonists are committed to substantive positions regarding (1) empirical questions concerning (for example) the properties and prevalence of systems of epigenetic inheritance; (2) historical characterizations of the modern synthesis; and (3) conceptual/philosophical matters concerning (among other things) the nature of evolutionary processes, and the relationship between selection and adaptation. With these different aspects of the debate in view, it is possible to demonstrate the range of cross-cutting positions on offer when well-informed evolutionists consider their stance on the EES. This overview of the multiple dimensions of debate also enables clarification of two philosophical elements of the EES debate, regarding the status of niche-construction and the role of selection in explaining adaptation. Finally, it points the way to a possible resolution of the EES debate, via a pragmatic approach to evolutionary enquiry.

Adaptation, fitness landscape learning and fast evolution

We consider evolution of a large population, where fitness of each organism is defined by many phenotypical traits. These traits result from expression of many genes. Under some assumptions on  fitness we prove that such model organisms  are capable, to some extent, to recognize the fitness landscape. That fitness landscape learning sharply reduces the number of mutations needed for adaptation. Moreover, this learning increases phenotype robustness with respect to mutations, i.e., canalizes the phenotype.  We show that learning and canalization work only when evolution is gradual. Organisms can be adapted to  many constraints associated with a hard environment, if that environment becomes harder step by step. Our results explain why evolution can involve genetic changes of a relatively large effect and why the total number of changes are surprisingly small.

How adaptive plasticity evolves when selected against

Adaptive plasticity allows organisms to cope with environmental change, thereby increasing the population's long-term fitness. However, individual selection can only compare the fitness of individuals within each generation: if the environment changes more slowly than the generation time (i.e., a coarse-grained environment) a population will not experience selection for plasticity even if it is adaptive in the long-term. How does adaptive plasticity then evolve? One explanation is that, if competing alleles conferring different degrees of plasticity persist across multiple environments, natural selection between genetic lineages could select for adaptive plasticity (lineage selection). We show that adaptive plasticity can evolve even in the absence of such lineage selection. Instead, we propose that adaptive plasticity in coarse-grained environments evolves as a by-product of inefficient short-term natural selection: populations that rapidly evolve their phenotypes in response to selective pressures follow short-term optima, with the result that they have reduced long-term fitness across environments. Conversely, populations that accumulate limited genetic change within each environment evolve long-term adaptive plasticity even when plasticity incurs short-term costs. These results remain qualitatively similar regardless of whether we decrease the efficiency of natural selection by increasing the rate of environmental change or decreasing mutation rate, demonstrating that both factors act via the same mechanism. We demonstrate how this mechanism can be understood through the concept of learning rate. Our work shows how plastic responses that are costly in the short term, yet adaptive in the long term, can evolve as a by-product of inefficient short-term selection, without selection for plasticity at either the individual or lineage level.

Artificial Gene Regulatory Networks-A Review

In nature, gene regulatory networks are a key mediator between the information stored in the DNA of living organisms (their genotype) and the structural and behavioral expression this finds in their bodies, surviving in the world (their phenotype). They integrate environmental signals, steer development, buffer stochasticity, and allow evolution to proceed. In engineering, modeling and implementations of artificial gene regulatory networks have been an expanding field of research and development over the past few decades. This review discusses the concept of gene regulation, describes the current state of the art in gene regulatory networks, including modeling and simulation, and reviews their use in artificial evolutionary settings. We provide evidence for the benefits of this concept in natural and the engineering domains.

Developmental Bias and Evolution: A Regulatory Network Perspective

Phenotypic variation is generated by the processes of development, with some variants arising more readily than others-a phenomenon known as "developmental bias." Developmental bias and natural selection have often been portrayed as alternative explanations, but this is a false dichotomy: developmental bias can evolve through natural selection, and bias and selection jointly influence phenotypic evolution. Here, we briefly review the evidence for developmental bias and illustrate how it is studied empirically. We describe recent theory on regulatory networks that explains why the influence of genetic and environmental perturbation on phenotypes is typically not uniform, and may even be biased toward adaptive phenotypic variation. We show how bias produced by developmental processes constitutes an evolving property able to impose direction on adaptive evolution and influence patterns of taxonomic and phenotypic diversity. Taking these considerations together, we argue that it is not sufficient to accommodate developmental bias into evolutionary theory merely as a constraint on evolutionary adaptation. The influence of natural selection in shaping developmental bias, and conversely, the influence of developmental bias in shaping subsequent opportunities for adaptation, requires mechanistic models of development to be expanded and incorporated into evolutionary theory. A regulatory network perspective on phenotypic evolution thus helps to integrate the generation of phenotypic variation with natural selection, leaving evolutionary biology better placed to explain how organisms adapt and diversify.