Predicting embryonic patterning using mutual entropy fitness and in silico evolution

Deriving a genetic regulatory network from an optimization principle

Many biological systems operate near the physical limits to their performance, suggesting that aspects of their behavior and underlying mechanisms could be derived from optimization principles. However, such principles have often been applied only in simplified models. Here, we explore a detailed mechanistic model of the gap gene network in the Drosophila embryo, optimizing its 50+ parameters to maximize the information that gene expression levels provide about nuclear positions. This optimization is conducted under realistic constraints, such as limits on the number of available molecules. Remarkably, the optimal networks we derive closely match the architecture and spatial gene expression profiles observed in the real organism. Our framework quantifies the tradeoffs involved in maximizing functional performance and allows for the exploration of alternative network configurations, addressing the question of which features are necessary and which are contingent. Our results suggest that multiple solutions to the optimization problem might exist across closely related organisms, offering insights into the evolution of gene regulatory networks.

Morphogens in the evolution of size, shape and patterning

Much of the striking diversity of life on Earth has arisen from variations in the way that the same molecules and networks operate during development to shape and pattern tissues and organs into different morphologies. However, we still understand very little about the potential for diversification exhibited by different, highly conserved mechanisms during evolution, or, conversely, the constraints that they place on evolution. With the aim of steering the field in new directions, we focus on morphogen-mediated patterning and growth as a case study to demonstrate how conserved developmental mechanisms can adapt during evolution to drive morphological diversification and optimise functionality, and to illustrate how evolution algorithms and computational tools can be used alongside experiments to provide insights into how these conserved mechanisms can evolve. We first introduce key conserved properties of morphogen-driven patterning mechanisms, before summarising comparative studies that exemplify how changes in the spatiotemporal expression and signalling levels of morphogens impact the diversification of organ size, shape and patterning in nature. Finally, we detail how theoretical frameworks can be used in conjunction with experiments to probe the role of morphogen-driven patterning mechanisms in evolution. We conclude that morphogen-mediated patterning is an excellent model system and offers a generally applicable framework to investigate the evolution of developmental mechanisms.

Information content and optimization of self-organized developmental systems

A key feature of many developmental systems is their ability to self-organize spatial patterns of functionally distinct cell fates. To ensure proper biological function, such patterns must be established reproducibly, by controlling and even harnessing intrinsic and extrinsic fluctuations. While the relevant molecular processes are increasingly well understood, we lack a principled framework to quantify the performance of such stochastic self-organizing systems. To that end, we introduce an information-theoretic measure for self-organized fate specification during embryonic development. We show that the proposed measure assesses the total information content of fate patterns and decomposes it into interpretable contributions corresponding to the positional and correlational information. By optimizing the proposed measure, our framework provides a normative theory for developmental circuits, which we demonstrate on lateral inhibition, cell type proportioning, and reaction-diffusion models of self-organization. This paves a way toward a classification of developmental systems based on a common information-theoretic language, thereby organizing the zoo of implicated chemical and mechanical signaling processes.

Mechanistic regulation of planarian shape during growth and degrowth

Adult planarians can grow when fed and degrow (shrink) when starved while maintaining their whole-body shape. It is unknown how the morphogens patterning the planarian axes are coordinated during feeding and starvation or how they modulate the necessary differential tissue growth or degrowth. Here, we investigate the dynamics of planarian shape together with a theoretical study of the mechanisms regulating whole-body proportions and shape. We found that the planarian body proportions scale isometrically following similar linear rates during growth and degrowth, but that fed worms are significantly wider than starved worms. By combining a descriptive model of planarian shape and size with a mechanistic model of anterior-posterior and medio-lateral signaling calibrated with a novel parameter optimization methodology, we theoretically demonstrate that the feedback loop between these positional information signals and the shape they control can regulate the planarian whole-body shape during growth. Furthermore, the computational model produced the correct shape and size dynamics during degrowth as a result of a predicted increase in apoptosis rate and pole signal during starvation. These results offer mechanistic insights into the dynamic regulation of whole-body morphologies.

Automatic design of gene regulatory mechanisms for spatial pattern formation

Gene regulatory mechanisms (GRMs) control the formation of spatial and temporal expression patterns that can serve as regulatory signals for the development of complex shapes. Synthetic developmental biology aims to engineer such genetic circuits for understanding and producing desired multicellular spatial patterns. However, designing synthetic GRMs for complex, multi-dimensional spatial patterns is a current challenge due to the nonlinear interactions and feedback loops in genetic circuits. Here we present a methodology to automatically design GRMs that can produce any given two-dimensional spatial pattern. The proposed approach uses two orthogonal morphogen gradients acting as positional information signals in a multicellular tissue area or culture, which constitutes a continuous field of engineered cells implementing the same designed GRM. To efficiently design both the circuit network and the interaction mechanisms-including the number of genes necessary for the formation of the target spatial pattern-we developed an automated algorithm based on high-performance evolutionary computation. The tolerance of the algorithm can be configured to design GRMs that are either simple to produce approximate patterns or complex to produce precise patterns. We demonstrate the approach by automatically designing GRMs that can produce a diverse set of synthetic spatial expression patterns by interpreting just two orthogonal morphogen gradients. The proposed framework offers a versatile approach to systematically design and discover complex genetic circuits producing spatial patterns.

Automatic design of gene regulatory mechanisms for spatial pattern formation

Synthetic developmental biology aims to engineer gene regulatory mechanisms (GRMs) for understanding and producing desired multicellular patterns and shapes. However, designing GRMs for spatial patterns is a current challenge due to the nonlinear interactions and feedback loops in genetic circuits. Here we present a methodology to automatically design GRMs that can produce any given spatial pattern. The proposed approach uses two orthogonal morphogen gradients acting as positional information signals in a multicellular tissue area or culture, which constitutes a continuous field of engineered cells implementing the same designed GRM. To efficiently design both the circuit network and the interaction mechanisms-including the number of genes necessary for the formation of the target pattern-we developed an automated algorithm based on high-performance evolutionary computation. The tolerance of the algorithm can be configured to design GRMs that are either simple to produce approximate patterns or complex to produce precise patterns. We demonstrate the approach by automatically designing GRMs that can produce a diverse set of synthetic spatial expression patterns by interpreting just two orthogonal morphogen gradients. The proposed framework offers a versatile approach to systematically design and discover pattern-producing genetic circuits.

Trading bits in the readout from a genetic network

In the regulation of gene expression, information of relevance to the organism is represented by the concentrations of transcription factor molecules. To extract this information the cell must effectively "measure" these concentrations, but there are physical limits to the precision of these measurements. We use the gap gene network in the early fly embryo as an example of the tradeoff between the precision of concentration measurements and the transmission of relevant information. For thresholded measurements we find that lower thresholds are more important, and fine tuning is not required for near-optimal information transmission. We then consider general sensors, constrained only by a limit on their information capacity, and find that thresholded sensors can approach true information theoretic optima. The information theoretic approach allows us to identify the optimal sensor for the entire gap gene network and to argue that the physical limitations of sensing necessitate the observed multiplicity of enhancer elements, with sensitivities to combinations rather than single transcription factors.

Patterning with clocks and genetic cascades: Segmentation and regionalization of vertebrate versus insect body plans

Oscillatory and sequential processes have been implicated in the spatial patterning of many embryonic tissues. For example, molecular clocks delimit segmental boundaries in vertebrates and insects and mediate lateral root formation in plants, whereas sequential gene activities are involved in the specification of regional identities of insect neuroblasts, vertebrate neural tube, vertebrate limb, and insect and vertebrate body axes. These processes take place in various tissues and organisms, and, hence, raise the question of what common themes and strategies they share. In this article, we review 2 processes that rely on the spatial regulation of periodic and sequential gene activities: segmentation and regionalization of the anterior-posterior (AP) axis of animal body plans. We study these processes in species that belong to 2 different phyla: vertebrates and insects. By contrasting 2 different processes (segmentation and regionalization) in species that belong to 2 distantly related phyla (arthropods and vertebrates), we elucidate the deep logic of patterning by oscillatory and sequential gene activities. Furthermore, in some of these organisms (e.g., the fruit fly Drosophila), a mode of AP patterning has evolved that seems not to overtly rely on oscillations or sequential gene activities, providing an opportunity to study the evolution of pattern formation mechanisms.

Inference of dynamic spatial GRN models with multi-GPU evolutionary computation

Reverse engineering mechanistic gene regulatory network (GRN) models with a specific dynamic spatial behavior is an inverse problem without analytical solutions in general. Instead, heuristic machine learning algorithms have been proposed to infer the structure and parameters of a system of equations able to recapitulate a given gene expression pattern. However, these algorithms are computationally intensive as they need to simulate millions of candidate models, which limits their applicability and requires high computational resources. Graphics processing unit (GPU) computing is an affordable alternative for accelerating large-scale scientific computation, yet no method is currently available to exploit GPU technology for the reverse engineering of mechanistic GRNs from spatial phenotypes. Here we present an efficient methodology to parallelize evolutionary algorithms using GPU computing for the inference of mechanistic GRNs that can develop a given gene expression pattern in a multicellular tissue area or cell culture. The proposed approach is based on multi-CPU threads running the lightweight crossover, mutation and selection operators and launching GPU kernels asynchronously. Kernels can run in parallel in a single or multiple GPUs and each kernel simulates and scores the error of a model using the thread parallelism of the GPU. We tested this methodology for the inference of spatiotemporal mechanistic gene regulatory networks (GRNs)-including topology and parameters-that can develop a given 2D gene expression pattern. The results show a 700-fold speedup with respect to a single CPU implementation. This approach can streamline the extraction of knowledge from biological and medical datasets and accelerate the automatic design of GRNs for synthetic biology applications.

Sharing of Phosphatases Promotes Response Plasticity in Phosphorylation Cascades

Sharing of positive or negative regulators between multiple targets is frequently observed in cellular signaling cascades. For instance, phosphatase sharing between multiple kinases is ubiquitous within the MAPK pathway. Here we investigate how such phosphatase sharing could shape robustness and evolvability of the phosphorylation cascade. Through modeling and evolutionary simulations, we demonstrate that 1) phosphatase sharing dramatically increases robustness of a bistable MAPK response, and 2) phosphatase-sharing cascades evolve faster than nonsharing cascades. This faster evolution is particularly pronounced when evolving from a monostable toward a bistable phenotype, whereas the transition speed of a population from a bistable to monostable response is not affected by phosphatase sharing. This property may enable the phosphatase-sharing design to adapt better in a changing environment. Analysis of the respective mutational landscapes reveal that phosphatase sharing reduces the number of limiting mutations required for transition from monostable to bistable responses, hence facilitating a faster transition to such response types. Taken together, using MAPK cascade as an example, our study offers a general theoretical framework to explore robustness and evolutionary plasticity of signal transduction cascades.

Feed-forward regulation adaptively evolves via dynamics rather than topology when there is intrinsic noise

In transcriptional regulatory networks (TRNs), a canonical 3-node feed-forward loop (FFL) is hypothesized to evolve to filter out short spurious signals. We test this adaptive hypothesis against a novel null evolutionary model. Our mutational model captures the intrinsically high prevalence of weak affinity transcription factor binding sites. We also capture stochasticity and delays in gene expression that distort external signals and intrinsically generate noise. Functional FFLs evolve readily under selection for the hypothesized function but not in negative controls. Interestingly, a 4-node “diamond” motif also emerges as a short spurious signal filter. The diamond uses expression dynamics rather than path length to provide fast and slow pathways. When there is no idealized external spurious signal to filter out, but only internally generated noise, only the diamond and not the FFL evolves. While our results support the adaptive hypothesis, we also show that non-adaptive factors, including the intrinsic expression dynamics, matter.

Feed‐forward loops (FFLs) can filter out noise, but whether their overrepresentation in GRNs reflects adaptive evolution for this function is debated. Here, the authors develop a null model of regulatory evolution and find that FFLs evolve readily under selection for the noise filtering function.

In Silico Evolution of Biochemical Log-Response

Numerous biological systems are known to harbor a form of logarithmic behavior, from Weber's law to bacterial chemotaxis. Such a log-response allows for sensitivity to small relative variations of biochemical inputs over a large range of concentration values. Here we use a genetic algorithm to evolve biochemical networks displaying a logarithmic response. A quasi-perfect log-response implemented by the same core network evolves in a convergent way across our different in silico replications. The best network is able to fit a logarithm over 4 orders of magnitude with an accuracy of the order of 1%. At the heart of this network, we show that a logarithmic approximation may be implemented with one single nonlinear interaction, that can be interpreted either as multisite phosphorylations or as a ligand induced multimerization. We provide an analytical explanation for the effect and exhibit constraints on parameters. Biological log-response might thus be easier to implement than usually assumed.

A re-inducible gap gene cascade patterns the anterior-posterior axis of insects in a threshold-free fashion

Gap genes mediate the division of the anterior-posterior axis of insects into different fates through regulating downstream hox genes. Decades of tinkering the segmentation gene network of Drosophila melanogaster led to the conclusion that gap genes are regulated (at least initially) through a threshold-based mechanism, guided by both anteriorly- and posteriorly-localized morphogen gradients. In this paper, we show that the response of the gap gene network in the beetle Tribolium castaneum upon perturbation is consistent with a threshold-free ‘Speed Regulation’ mechanism, in which the speed of a genetic cascade of gap genes is regulated by a posterior morphogen gradient. We show this by re-inducing the leading gap gene (namely, hunchback) resulting in the re-induction of the gap gene cascade at arbitrary points in time. This demonstrates that the gap gene network is self-regulatory and is primarily under the control of a posterior regulator in Tribolium and possibly other short/intermediate-germ insects.

φ-evo: A program to evolve phenotypic models of biological networks

Molecular networks are at the core of most cellular decisions, but are often difficult to comprehend. Reverse engineering of network architecture from their functions has proved fruitful to classify and predict the structure and function of molecular networks, suggesting new experimental tests and biological predictions. We present φ-evo, an open-source program to evolve in silico phenotypic networks performing a given biological function. We include implementations for evolution of biochemical adaptation, adaptive sorting for immune recognition, metazoan development (somitogenesis, hox patterning), as well as Pareto evolution. We detail the program architecture based on C, Python 3, and a Jupyter interface for project configuration and network analysis. We illustrate the predictive power of φ-evo by first recovering the asymmetrical structure of the lac operon regulation from an objective function with symmetrical constraints. Second, we use the problem of hox-like embryonic patterning to show how a single effective fitness can emerge from multi-objective (Pareto) evolution. φ-evo provides an efficient approach and user-friendly interface for the phenotypic prediction of networks and the numerical study of evolution itself.

Untangling the Hairball: Fitness-Based Asymptotic Reduction of Biological Networks

Complex mathematical models of interaction networks are routinely used for prediction in systems biology. However, it is difficult to reconcile network complexities with a formal understanding of their behavior. Here, we propose a simple procedure (called ϕ¯) to reduce biological models to functional submodules, using statistical mechanics of complex systems combined with a fitness-based approach inspired by in silico evolution. The ϕ¯ algorithm works by putting parameters or combination of parameters to some asymptotic limit, while keeping (or slightly improving) the model performance, and requires parameter symmetry breaking for more complex models. We illustrate ϕ¯ on biochemical adaptation and on different models of immune recognition by T cells. An intractable model of immune recognition with close to a hundred individual transition rates is reduced to a simple two-parameter model. The ϕ¯ algorithm extracts three different mechanisms for early immune recognition, and automatically discovers similar functional modules in different models of the same process, allowing for model classification and comparison. Our procedure can be applied to biological networks based on rate equations using a fitness function that quantifies phenotypic performance.

Speed regulation of genetic cascades allows for evolvability in the body plan specification of insects

During the anterior-posterior fate specification of insects, anterior fates arise in a nonelongating tissue (called the "blastoderm"), and posterior fates arise in an elongating tissue (called the "germband"). However, insects differ widely in the extent to which anterior-posterior fates are specified in the blastoderm versus the germband. Here we present a model in which patterning in both the blastoderm and germband of the beetle Tribolium castaneum is based on the same flexible mechanism: a gradient that modulates the speed of a genetic cascade of gap genes, resulting in the induction of sequential kinematic waves of gap gene expression. The mechanism is flexible and capable of patterning both elongating and nonelongating tissues, and hence converting blastodermal to germband fates and vice versa. Using RNAi perturbations, we found that blastodermal fates could be shifted to the germband, and germband fates could be generated in a blastoderm-like morphology. We also suggest a molecular mechanism underlying our model, in which gradient levels regulate the switch between two enhancers: One enhancer is responsible for sequential gene activation, and the other is responsible for freezing temporal rhythms into spatial patterns. This model is consistent with findings in Drosophila melanogaster, where gap genes were found to be regulated by two nonredundant "shadow" enhancers.

Keeping up with the Red Queen: the pace of aging as an adaptation

For decades, a vast majority of biogerontologists assumed that aging is not and cannot be an adaptation. In recent years, however, several authors opposed this predominant view and repeatedly suggested that not only is aging an adaptation but that it is the result of a specific aging program. This issue almost instantaneously became somewhat controversial and many important authors produced substantial works refuting the notion of the aging program. In this article we review the current state of the debate and list the most important arguments proposed by both sides. Furthermore, although classical interpretations of the evolution of aging are in sharp contrast with the idea of programmed aging, we suggest that the truth might in fact very well lie somewhere in between. We also propose our own interpretation which states that although aging is in essence inevitable and results from damage accumulation rather than from a specific program, the actual rate of aging in nature may still be adaptive to some extent.

Using Sub-Network Combinations to Scale Up an Enumeration Method for Determining the Network Structures of Biological Functions

Deduction of biological regulatory networks from their functions is one of the focus areas of systems biology. Among the different techniques used in this reverse-engineering task, one powerful method is to enumerate all candidate network structures to find suitable ones. However, this method is severely limited by calculation capability: due to the brute-force approach, it is infeasible for networks with large number of nodes to be studied using traditional enumeration method because of the combinatorial explosion. In this study, we propose a new reverse-engineering technique based on the enumerating method: sub-network combinations. First, a complex biological function is divided into several sub-functions. Next, the three-node-network enumerating method is applied to search for sub-networks that are able to realize each of the sub-functions. Finally, complex whole networks are constructed by enumerating all possible combinations of sub-networks. The optimal ones are selected and analyzed. To demonstrate the effectiveness of this new method, we used it to deduct the network structures of a Pavlovian-like function. The whole Pavlovian-like network was successfully constructed by combining robust sub-networks, and the results were analyzed. With sub-network combination, the complexity has been largely reduced. Our method also provides a functional modular view of biological systems.

Intrinsic Noise Profoundly Alters the Dynamics and Steady State of Morphogen-Controlled Bistable Genetic Switches

During tissue development, patterns of gene expression determine the spatial arrangement of cell types. In many cases, gradients of secreted signalling molecules—morphogens—guide this process by controlling downstream transcriptional networks. A mechanism commonly used in these networks to convert the continuous information provided by the gradient into discrete transitions between adjacent cell types is the genetic toggle switch, composed of cross-repressing transcriptional determinants. Previous analyses have emphasised the steady state output of these mechanisms. Here, we explore the dynamics of the toggle switch and use exact numerical simulations of the kinetic reactions, the corresponding Chemical Langevin Equation, and Minimum Action Path theory to establish a framework for studying the effect of gene expression noise on patterning time and boundary position. This provides insight into the time scale, gene expression trajectories and directionality of stochastic switching events between cell states. Taking gene expression noise into account predicts that the final boundary position of a morphogen-induced toggle switch, although robust to changes in the details of the noise, is distinct from that of the deterministic system. Moreover, the dramatic increase in patterning time close to the boundary predicted from the deterministic case is substantially reduced. The resulting stochastic switching introduces differences in patterning time along the morphogen gradient that result in a patterning wave propagating away from the morphogen source with a velocity determined by the intrinsic noise. The wave sharpens and slows as it advances and may never reach steady state in a biologically relevant time. This could explain experimentally observed dynamics of pattern formation. Together the analysis reveals the importance of dynamical transients for understanding morphogen-driven transcriptional networks and indicates that gene expression noise can qualitatively alter developmental patterning.

The bistable switch, a common regulatory sub-network, is found in many biological processes. It consists of cross-repressing components that generate a switch-like transition between two possible states. In developing tissues, bistable switches, created by cross-repressing transcriptional determinants, are often controlled by gradients of secreted signalling molecules—morphogens. These provide a mechanism to convert a morphogen gradient into stripes of gene expression that determine the arrangement of distinct cell types. Here we use mathematical models to analyse the temporal response of such a system. We find that the behaviour is highly dependent on the intrinsic fluctuations that result from the stochastic nature of gene expression. This noise has a marked effect on both patterning time and the location of the stripe boundary. One of the techniques we use, Minimum Action Path theory, identifies key features of the switch without computationally expensive calculations. The results reveal a noise driven switching wave that propels the stripe boundary away from the morphogen source to eventually settle, at steady state, further from the morphogen source than in the deterministic description. Together the analysis highlights the importance dynamics in patterning and demonstrates a set of mathematical tools for studying this problem.

Critical Timing without a Timer for Embryonic Development

Timing of embryonic development is precisely controlled, but the mechanisms underlying biological timers are still unclear. Here, a validated model for timing under control of Sonic Hedgehog is revisited and generalized to an arbitrary number of genes. The developmental dynamics where a temporal sequence of gene expression recapitulates a steady-state spatial pattern can be realized through a simple network close to criticality, controlled by the duration of exposure to a morphogen. Criticality simultaneously accounts for many observed biological properties, such as timing, multistability, and canalization of genetic expression. This process can be parsimoniously generalized in many dimensions with a minimum number of genes, all repressing each other with asymmetrical strengths, which also explains sequential activation of different fates. Separation of timescales allows for a simple analytical interpretation. Finally, it is shown that even in the presence of noise, coupling between cells preserves criticality and robust patterning. The model offers a simple theoretical framework for the study of emergent developmental timers.

Positional information from oscillatory phase shifts : insights from in silico evolution

Complex cellular decisions are based on temporal dynamics of pathways, including genetic oscillators. In development, recent works on vertebrae formation have suggested that relative phase of genetic oscillators encode positional information, including differentiation front defining vertebrae positions. Precise mechanisms for this are still unknown. Here, we use computational evolution to find gene network topologies that can compute the phase difference between oscillators and convert it into a decoder morphogen concentration. Two types of networks are discovered, based on symmetry properties of the decoder gene. So called asymmetric networks are studied, and two submodules are identified converting phase information into an amplitude variable. Those networks naturally display a 'shock' for a well defined phase difference, that can be used to define a wavefront of differentiation. We show how implementation of these ideas reproduce experimental features of vertebrate segmentation.

Predicting Ancestral Segmentation Phenotypes from Drosophila to Anopheles Using In Silico Evolution

Molecular evolution is an established technique for inferring gene homology but regulatory DNA turns over so rapidly that inference of ancestral networks is often impossible. In silico evolution is used to compute the most parsimonious path in regulatory space for anterior-posterior patterning linking two Dipterian species. The expression pattern of gap genes has evolved between Drosophila (fly) and Anopheles (mosquito), yet one of their targets, eve, has remained invariant. Our model predicts that stripe 5 in fly disappears and a new posterior stripe is created in mosquito, thus eve stripe modules 3+7 and 4+6 in fly are homologous to 3+6 and 4+5 in mosquito. We can place Clogmia on this evolutionary pathway and it shares the mosquito homologies. To account for the evolution of the other pair-rule genes in the posterior we have to assume that the ancestral Dipterian utilized a dynamic method to phase those genes in relation to eve.

The last common ancestor of the fruit fly (Drosophila) and mosquito (Anopheles) lived more than 200 Million years ago. Can we use available data on insects alive today to infer what their ancestor looked like? In this manuscript, we focus on early embryonic development, when stripes of genetic expression appear and define the location of insect segments (“segmentation”). We use an evolutionary algorithm to reconstruct and predict dynamics of genes controlling stripes in the last common ancestor of fly and mosquito. We predict a new and different combinatorial logic of stripe formation in mosquito compared to fly, which is fully consistent with development of intermediate species such as moth-fly (Clogmia). Our simulations further suggest that the dynamics of gene expression in this last common ancestor were similar to other insects, such as wasps (Nasonia). Our method illustrates how computational methods inspired by machine learning and non-linear physics can be used to infer gene dynamics in species that disappeared millions of years ago.

Enzyme Sequestration as a Tuning Point in Controlling Response Dynamics of Signalling Networks

Signalling networks result from combinatorial interactions among many enzymes and scaffolding proteins. These complex systems generate response dynamics that are often essential for correct decision-making in cells. Uncovering biochemical design principles that underpin such response dynamics is a prerequisite to understand evolved signalling networks and to design synthetic ones. Here, we use in silico evolution to explore the possible biochemical design space for signalling networks displaying ultrasensitive and adaptive response dynamics. By running evolutionary simulations mimicking different biochemical scenarios, we find that enzyme sequestration emerges as a key mechanism for enabling such dynamics. Inspired by these findings, and to test the role of sequestration, we design a generic, minimalist model of a signalling cycle, featuring two enzymes and a single scaffolding protein. We show that this simple system is capable of displaying both ultrasensitive and adaptive response dynamics. Furthermore, we find that tuning the concentration or kinetics of the sequestering protein can shift system dynamics between these two response types. These empirical results suggest that enzyme sequestration through scaffolding proteins is exploited by evolution to generate diverse response dynamics in signalling networks and could provide an engineering point in synthetic biology applications.

Evolution-development congruence in pattern formation dynamics: Bifurcations in gene expression and regulation of networks structures

Search for possible relationships between phylogeny and ontogeny is important in evolutionary-developmental biology. Here we uncover such relationships by numerical evolution and unveil their origin in terms of dynamical systems theory. By representing developmental dynamics of spatially located cells with gene expression dynamics with cell-to-cell interaction under external morphogen gradient, gene regulation networks are evolved under mutation and selection with the fitness to approach a prescribed spatial pattern of expressed genes. For most numerical evolution experiments, evolution of pattern over generations and development of pattern by an evolved network exhibit remarkable congruence. Both in the evolution and development pattern changes consist of several epochs where stripes are formed in a short time, while for other temporal regimes, pattern hardly changes. In evolution, these quasi-stationary regimes are generations needed to hit relevant mutations, while in development, they are due to some gene expression that varies slowly and controls the pattern change. The morphogenesis is regulated by combinations of feedback or feedforward regulations, where the upstream feedforward network reads the external morphogen gradient, and generates a pattern used as a boundary condition for the later patterns. The ordering from up to downstream is common in evolution and development, while the successive epochal changes in development and evolution are represented as common bifurcations in dynamical-systems theory, which lead to the evolution-development congruence. Mechanism of exceptional violation of the congruence is also unveiled. Our results provide a new look on developmental stages, punctuated equilibrium, developmental bottlenecks, and evolutionary acquisition of novelty in morphogenesis.

Morphogen rules: design principles of gradient-mediated embryo patterning

The Drosophila blastoderm and the vertebrate neural tube are archetypal examples of morphogen-patterned tissues that create precise spatial patterns of different cell types. In both tissues, pattern formation is dependent on molecular gradients that emanate from opposite poles. Despite distinct evolutionary origins and differences in time scales, cell biology and molecular players, both tissues exhibit striking similarities in the regulatory systems that establish gene expression patterns that foreshadow the arrangement of cell types. First, signaling gradients establish initial conditions that polarize the tissue, but there is no strict correspondence between specific morphogen thresholds and boundary positions. Second, gradients initiate transcriptional networks that integrate broadly distributed activators and localized repressors to generate patterns of gene expression. Third, the correct positioning of boundaries depends on the temporal and spatial dynamics of the transcriptional networks. These similarities reveal design principles that are likely to be broadly applicable to morphogen-patterned tissues.

BioJazz: in silico evolution of cellular networks with unbounded complexity using rule-based modeling

Systems biologists aim to decipher the structure and dynamics of signaling and regulatory networks underpinning cellular responses; synthetic biologists can use this insight to alter existing networks or engineer de novo ones. Both tasks will benefit from an understanding of which structural and dynamic features of networks can emerge from evolutionary processes, through which intermediary steps these arise, and whether they embody general design principles. As natural evolution at the level of network dynamics is difficult to study, in silico evolution of network models can provide important insights. However, current tools used for in silico evolution of network dynamics are limited to ad hoc computer simulations and models. Here we introduce BioJazz, an extendable, user-friendly tool for simulating the evolution of dynamic biochemical networks. Unlike previous tools for in silico evolution, BioJazz allows for the evolution of cellular networks with unbounded complexity by combining rule-based modeling with an encoding of networks that is akin to a genome. We show that BioJazz can be used to implement biologically realistic selective pressures and allows exploration of the space of network architectures and dynamics that implement prescribed physiological functions. BioJazz is provided as an open-source tool to facilitate its further development and use. Source code and user manuals are available at: http://oss-lab.github.io/biojazz and http://osslab.lifesci.warwick.ac.uk/BioJazz.aspx.

The Comet Cometh: Evolving Developmental Systems

In a recent opinion piece, Denis Duboule has claimed that the increasing shift towards systems biology is driving evolutionary and developmental biology apart, and that a true reunification of these two disciplines within the framework of evolutionary developmental biology (EvoDevo) may easily take another 100 years. He identifies methodological, epistemological, and social differences as causes for this supposed separation. Our article provides a contrasting view. We argue that Duboule’s prediction is based on a one-sided understanding of systems biology as a science that is only interested in functional, not evolutionary, aspects of biological processes. Instead, we propose a research program for an evolutionary systems biology, which is based on local exploration of the configuration space in evolving developmental systems. We call this approach—which is based on reverse engineering, simulation, and mathematical analysis—the natural history of configuration space. We discuss a number of illustrative examples that demonstrate the past success of local exploration, as opposed to global mapping, in different biological contexts. We argue that this pragmatic mode of inquiry can be extended and applied to the mathematical analysis of the developmental repertoire and evolutionary potential of evolving developmental mechanisms and that evolutionary systems biology so conceived provides a pragmatic epistemological framework for the EvoDevo synthesis.

Evolving phenotypic networks in silico

Evolved gene networks are constrained by natural selection. Their structures and functions are consequently far from being random, as exemplified by the multiple instances of parallel/convergent evolution. One can thus ask if features of actual gene networks can be recovered from evolutionary first principles. I review a method for in silico evolution of small models of gene networks aiming at performing predefined biological functions. I summarize the current implementation of the algorithm, insisting on the construction of a proper "fitness" function. I illustrate the approach on three examples: biochemical adaptation, ligand discrimination and vertebrate segmentation (somitogenesis). While the structure of the evolved networks is variable, dynamics of our evolved networks are usually constrained and present many similar features to actual gene networks, including properties that were not explicitly selected for. In silico evolution can thus be used to predict biological behaviours without a detailed knowledge of the mapping between genotype and phenotype.

Modeling the evolution of molecular systems from a mechanistic perspective

Systems biology-inspired genotype-phenotype mapping models are increasingly being used to study the evolutionary properties of molecular biological systems, in particular the general emergent properties of evolving systems, such as modularity, robustness, and evolvability. However, the level of abstraction at which many of these models operate might not be sufficient to capture all relevant intricacies of biological evolution in sufficient detail. Here, we argue that in particular gene and genome duplications, both evolutionary mechanisms of potentially major importance for the evolution of molecular systems and of special relevance to plant evolution, are not adequately accounted for in most GPM modeling frameworks, and that more fine-grained mechanistic models may significantly advance understanding of how gen(om)e duplication impacts molecular systems evolution.

Noise minimisation in gene expression switches

Gene expression is subject to stochastic variation which leads to fluctuations in the rate of protein production. Recently, a study in yeast at a genomic scale showed that, in some cases, gene expression variability alters phenotypes while, in other cases, these remain unchanged despite fluctuations in the expression of other genes. These studies suggested that noise in gene expression is a physiologically relevant trait and, to prevent harmful stochastic variation in the expression levels of some genes, it can be subject to minimisation. However, the mechanisms for noise minimisation are still unclear. In the present work, we analysed how noise expression depends on the architecture of the cis-regulatory system, in particular on the number of regulatory binding sites. Using analytical calculations and stochastic simulations, we found that the fluctuation level in noise expression decreased with the number of regulatory sites when regulatory transcription factors interacted with only one other bound transcription factor. In contrast, we observed that there was an optimal number of binding sites when transcription factors interacted with many bound transcription factors. This finding suggested a new mechanism for preventing large fluctuations in the expression of genes which are sensitive to the concentration of regulators.

Systems approach to developmental biology--designs for robust patterning

Patterning is an important step in animal development that generates spatially non-uniform gene expression patterns or spatially heterogeneous cellular responses. Patterning is realised by the generation and reading of positional information provided by spatial gradients of morphogens, diffusive chemicals in the extracellular environment. To achieve normal development, accurate patterning that is robust against noise is necessary. Here the authors describe how morphogen gradient formation and gradient interpretation processes are designed to achieve highly reproducible patterning. Furthermore, recent advancements in measurement and imaging techniques have enabled researchers to obtain quantitative dynamic and multi-physical data, not only for chemical events, but also for the geometrical and mechanical properties of cells in vivo. The authors briefly review some recent studies on the effects of such non-chemical events on patterning.

Using evolutionary computations to understand the design and evolution of gene and cell regulatory networks

This paper surveys modeling approaches for studying the evolution of gene regulatory networks (GRNs). Modeling of the design or 'wiring' of GRNs has become increasingly common in developmental and medical biology, as a means of quantifying gene-gene interactions, the response to perturbations, and the overall dynamic motifs of networks. Drawing from developments in GRN 'design' modeling, a number of groups are now using simulations to study how GRNs evolve, both for comparative genomics and to uncover general principles of evolutionary processes. Such work can generally be termed evolution in silico. Complementary to these biologically-focused approaches, a now well-established field of computer science is Evolutionary Computations (ECs), in which highly efficient optimization techniques are inspired from evolutionary principles. In surveying biological simulation approaches, we discuss the considerations that must be taken with respect to: (a) the precision and completeness of the data (e.g. are the simulations for very close matches to anatomical data, or are they for more general exploration of evolutionary principles); (b) the level of detail to model (we proceed from 'coarse-grained' evolution of simple gene-gene interactions to 'fine-grained' evolution at the DNA sequence level); (c) to what degree is it important to include the genome's cellular context; and (d) the efficiency of computation. With respect to the latter, we argue that developments in computer science EC offer the means to perform more complete simulation searches, and will lead to more comprehensive biological predictions.

Evolutionary systems biology: what it is and why it matters

Evolutionary systems biology (ESB) is a rapidly growing integrative approach that has the core aim of generating mechanistic and evolutionary understanding of genotype-phenotype relationships at multiple levels. ESB's more specific objectives include extending knowledge gained from model organisms to non-model organisms, predicting the effects of mutations, and defining the core network structures and dynamics that have evolved to cause particular intracellular and intercellular responses. By combining mathematical, molecular, and cellular approaches to evolution, ESB adds new insights and methods to the modern evolutionary synthesis, and offers ways in which to enhance its explanatory and predictive capacities. This combination of prediction and explanation marks ESB out as a research manifesto that goes further than its two contributing fields. Here, we summarize ESB via an analysis of characteristic research examples and exploratory questions, while also making a case for why these integrative efforts are worth pursuing.

Mechanisms and constraints shaping the evolution of body plan segmentation

Segmentation of the major body axis into repeating units is arguably one of the major inventions in the evolution of animal body plan pattering. It is found in current day vertebrates, annelids and arthropods. Most segmented animals seem to use a clock-and-wavefront type mechanism in which oscillations emanating from a posterior growth zone become transformed into an anterior posterior sequence of segments. In contrast, few animals such as Drosophila use a complex gene regulatory hierarchy to simultaneously subdivide their entire body axis into segments. Here I discuss how in silico models simulating the evolution of developmental patterning can be used to investigate the forces and constraints that helped shape these two developmental modes. I perform an analysis of a series of previous simulation studies, exploiting the similarities and differences in their outcomes in relation to model characteristics to elucidate the circumstances and constraints likely to have been important for the evolution of sequential and simultaneous segmentation modes. The analysis suggests that constraints arising from the involved growth process and spatial patterning signal--posterior elongation producing a propagating wavefront versus a tissue wide morphogen gradient--and the evolutionary history--ancestral versus derived segmentation mode--strongly shaped both segmentation mechanisms. Furthermore, this implies that these patterning types are to be expected rather than random evolutionary outcomes and supports the likelihood of multiple parallel evolutionary origins.

Design principles of regulatory networks: searching for the molecular algorithms of the cell

A challenge in biology is to understand how complex molecular networks in the cell execute sophisticated regulatory functions. Here we explore the idea that there are common and general principles that link network structures to biological functions, principles that constrain the design solutions that evolution can converge upon for accomplishing a given cellular task. We describe approaches for classifying networks based on abstract architectures and functions, rather than on the specific molecular components of the networks. For any common regulatory task, can we define the space of all possible molecular solutions? Such inverse approaches might ultimately allow the assembly of a design table of core molecular algorithms that could serve as a guide for building synthetic networks and modulating disease networks.

Encoding and decoding of positional information in morphogen-dependent patterning

Patterning during organogenesis is fundamentally realized through the interpretation of morphogen gradients by particular types of gene regulatory networks (GRNs). However, as quantitative studies have reported, spatial profiles of morphogen gradients include intra-embryo and inter-embryo variability, which could lead to errors in spatial recognition by cells and variations in patterning. By mathematically modeling the processes of generation and readout of spatial information - information encoding and decoding, by an analogy to computer communication - and maximizing the reproducibility of patterning against noise, the general designs of gradient profiles and their interpretation have been clarified. Furthermore, over the past few years, basic studies on patterning in more dynamic situations, that is, patterning in growing tissues with time-variant gradients, have been initiated. Here we provide an overview of patterning studies, pattern generating GRNs, concepts of information coding design for robust patterning, and patterning in growing tissues.

Developmental pattern formation: insights from physics and biology

The spatial organization of cell fates during development involves the interpretation of morphogen gradients by cellular signaling cascades and transcriptional networks. Recent studies use biophysical models, genetics, and quantitative imaging to unravel how tissue-level morphogen behavior arises from subcellular events. Moreover, data from several systems show that morphogen gradients, downstream signaling, and the activity of cell-intrinsic transcriptional networks change dynamically during pattern formation. Studies from Drosophila and now also vertebrates suggest that transcriptional network dynamics are central to the generation of gene expression patterns. Together, this leads to the view that pattern formation is an emergent behavior that results from the coordination of events occurring across molecular, cellular, and tissue scales. The development of novel approaches to study this complex process remains a challenge.

Phenotypic models of evolution and development: geometry as destiny

Quantitative models of development that consider all relevant genes typically are difficult to fit to embryonic data alone and have many redundant parameters. Computational evolution supplies models of phenotype with relatively few variables and parameters that allows the patterning dynamics to be reduced to a geometrical picture for how the state of a cell moves. The clock and wavefront model, that defines the phenotype of somitogenesis, can be represented as a sequence of two discrete dynamical transitions (bifurcations). The expression-time to space map for Hox genes and the posterior dominance rule are phenotypes that naturally follow from computational evolution without considering the genetics of Hox regulation.

Pareto evolution of gene networks: an algorithm to optimize multiple fitness objectives

The computational evolution of gene networks functions like a forward genetic screen to generate, without preconceptions, all networks that can be assembled from a defined list of parts to implement a given function. Frequently networks are subject to multiple design criteria that cannot all be optimized simultaneously. To explore how these tradeoffs interact with evolution, we implement Pareto optimization in the context of gene network evolution. In response to a temporal pulse of a signal, we evolve networks whose output turns on slowly after the pulse begins, and shuts down rapidly when the pulse terminates. The best performing networks under our conditions do not fall into categories such as feed forward and negative feedback that also encode the input-output relation we used for selection. Pareto evolution can more efficiently search the space of networks than optimization based on a single ad hoc combination of the design criteria.

Adaptive temperature compensation in circadian oscillations

A temperature independent period and temperature entrainment are two defining features of circadian oscillators. A default model of distributed temperature compensation satisfies these basic facts yet is not easily reconciled with other properties of circadian clocks, such as many mutants with altered but temperature compensated periods. The default model also suggests that the shape of the circadian limit cycle and the associated phase response curves (PRC) will vary since the average concentrations of clock proteins change with temperature. We propose an alternative class of models where the twin properties of a fixed period and entrainment are structural and arise from an underlying adaptive system that buffers temperature changes. These models are distinguished by a PRC whose shape is temperature independent and orbits whose extrema are temperature independent. They are readily evolved by local, hill climbing, optimization of gene networks for a common quality measure of biological clocks, phase anticipation. Interestingly a standard realization of the Goodwin model for temperature compensation displays properties of adaptive rather than distributed temperature compensation.

Different cell fates from cell-cell interactions: core architectures of two-cell bistable networks

The acquisition of different fates by cells that are initially in the same state is central to development. Here, we investigate the possible structures of bistable genetic networks that can allow two identical cells to acquire different fates through cell-cell interactions. Cell-autonomous bistable networks have been previously sampled using an evolutionary algorithm. We extend this evolutionary procedure to take into account interactions between cells. We obtain a variety of simple bistable networks that we classify into major subtypes. Some have long been proposed in the context of lateral inhibition through the Notch-Delta pathway, some have been more recently considered and others appear to be new and based on mechanisms not previously considered. The results highlight the role of posttranscriptional interactions and particularly of protein complexation and sequestration, which can replace cooperativity in transcriptional interactions. Some bistable networks are entirely based on posttranscriptional interactions and the simplest of these is found to lead, upon a single parameter change, to oscillations in the two cells with opposite phases. We provide qualitative explanations as well as mathematical analyses of the dynamical behaviors of various created networks. The results should help to identify and understand genetic structures implicated in cell-cell interactions and differentiation.

Evolution of networks for body plan patterning; interplay of modularity, robustness and evolvability

A major goal of evolutionary developmental biology (evo-devo) is to understand how multicellular body plans of increasing complexity have evolved, and how the corresponding developmental programs are genetically encoded. It has been repeatedly argued that key to the evolution of increased body plan complexity is the modularity of the underlying developmental gene regulatory networks (GRNs). This modularity is considered essential for network robustness and evolvability. In our opinion, these ideas, appealing as they may sound, have not been sufficiently tested. Here we use computer simulations to study the evolution of GRNs' underlying body plan patterning. We select for body plan segmentation and differentiation, as these are considered to be major innovations in metazoan evolution. To allow modular networks to evolve, we independently select for segmentation and differentiation. We study both the occurrence and relation of robustness, evolvability and modularity of evolved networks. Interestingly, we observed two distinct evolutionary strategies to evolve a segmented, differentiated body plan. In the first strategy, first segments and then differentiation domains evolve (SF strategy). In the second scenario segments and domains evolve simultaneously (SS strategy). We demonstrate that under indirect selection for robustness the SF strategy becomes dominant. In addition, as a byproduct of this larger robustness, the SF strategy is also more evolvable. Finally, using a combined functional and architectural approach, we determine network modularity. We find that while SS networks generate segments and domains in an integrated manner, SF networks use largely independent modules to produce segments and domains. Surprisingly, we find that widely used, purely architectural methods for determining network modularity completely fail to establish this higher modularity of SF networks. Finally, we observe that, as a free side effect of evolving segmentation and differentiation in combination, we obtained in-silico developmental mechanisms resembling mechanisms used in vertebrate development.

Physical forces may cause Hox gene collinearity in the primary and secondary axes of the developing vertebrates

The features of spatial and temporal Hox gene collinearity along the anteroposterior and secondary axes of vertebrate development have been extensively studied. However, the understanding of these features remains problematic. Some genetic engineering experiments were performed and the consequent modifications of the Hoxd gene expressions in the vertebrate limb and trunk were presented. A two-phases model was proposed to describe the above results but still many data cannot be explained. In the present work a different mechanism is put forward in order to deal with the above experiments. This alternative mechanism (coined biophysical model), is based on the hypothesis that physical forces decondense and 'loop out' the chromatin fiber causing the observed Hox gene collinearity phenomena at the early stages of axonal development. The two models are compared in detail. The biophysical model adequately explains the data even in cases where the results are characterized as unexpected. Furthermore, the biophysical model predicts that the Hox gene expressions are entangled in space and time and this coupling is compatible with the data of the early developmental stages. Additional experiments are proposed for a direct test of this model.

Information transmission in genetic regulatory networks: a review

Genetic regulatory networks enable cells to respond to changes in internal and external conditions by dynamically coordinating their gene expression profiles. Our ability to make quantitative measurements in these biochemical circuits has deepened our understanding of what kinds of computations genetic regulatory networks can perform, and with what reliability. These advances have motivated researchers to look for connections between the architecture and function of genetic regulatory networks. Transmitting information between a network's inputs and outputs has been proposed as one such possible measure of function, relevant in certain biological contexts. Here we summarize recent developments in the application of information theory to gene regulatory networks. We first review basic concepts in information theory necessary for understanding recent work. We then discuss the functional complexity of gene regulation, which arises from the molecular nature of the regulatory interactions. We end by reviewing some experiments that support the view that genetic networks responsible for early development of multicellular organisms might be maximizing transmitted 'positional information'.