Multicriteria global optimization for biocircuit design

Automatic design of gene regulatory mechanisms for spatial pattern formation

Gene regulatory mechanisms (GRMs) control the formation of spatial and temporal expression patterns that can serve as regulatory signals for the development of complex shapes. Synthetic developmental biology aims to engineer such genetic circuits for understanding and producing desired multicellular spatial patterns. However, designing synthetic GRMs for complex, multi-dimensional spatial patterns is a current challenge due to the nonlinear interactions and feedback loops in genetic circuits. Here we present a methodology to automatically design GRMs that can produce any given two-dimensional spatial pattern. The proposed approach uses two orthogonal morphogen gradients acting as positional information signals in a multicellular tissue area or culture, which constitutes a continuous field of engineered cells implementing the same designed GRM. To efficiently design both the circuit network and the interaction mechanisms-including the number of genes necessary for the formation of the target spatial pattern-we developed an automated algorithm based on high-performance evolutionary computation. The tolerance of the algorithm can be configured to design GRMs that are either simple to produce approximate patterns or complex to produce precise patterns. We demonstrate the approach by automatically designing GRMs that can produce a diverse set of synthetic spatial expression patterns by interpreting just two orthogonal morphogen gradients. The proposed framework offers a versatile approach to systematically design and discover complex genetic circuits producing spatial patterns.

On biological networks capable of robust adaptation in the presence of uncertainties: A linear systems-theoretic approach

Biological adaptation, the tendency of every living organism to regulate its essential activities in environmental fluctuations, is a well-studied functionality in systems and synthetic biology. In this work, we present a generic methodology inspired by systems theory to discover the design principles for robust adaptation, perfect and imperfect, in two different contexts: (1) in the presence of deterministic external and parametric disturbances and (2) in a stochastic setting. In all the cases, firstly, we translate the necessary qualitative conditions for adaptation to mathematical constraints using the language of systems theory, which we then map back as design requirements for the underlying networks. Thus, contrary to the existing approaches, the proposed methodologies provide an exhaustive set of admissible network structures without resorting to computationally burdensome brute-force techniques. Further, the proposed frameworks do not assume prior knowledge about the particular rate kinetics, thereby validating the conclusions for a large class of biological networks. In the deterministic setting, we show that unlike the incoherent feed-forward network structures (IFFLP or opposer modules), the modules containing negative feedback with buffer action (NFBLB or balancer modules) are robust to parametric fluctuations when a specific part of the network is assumed to remain unaffected. To this end, we propose a sufficient condition for imperfect adaptation and show that adding negative feedback in an IFFLP topology improves the robustness concerning parametric fluctuations. Further, we propose a stricter set of necessary conditions for imperfect adaptation. Turning to the stochastic scenario, we adopt a Wiener-Kolmogorov filter strategy to tune the parameters of a given network structure towards minimum output variance. We show that both NFBLB and IFFLP can be used as a reduced-order W-K filter. Further, we define the notion of nearest neighboring motifs to compare the output variances across different network structures. We argue that the NFBLB achieves adaptation at the cost of a variance higher than its nearest neighboring motifs whereas the IFFLP topology produces locally minimum variance while compared with its nearest neighboring motifs. We present numerical simulations to support the theoretical results. Overall, our results present a generic, systematic, and robust framework for advancing the understanding of complex biological networks.

Automated Biocircuit Design with SYNBADm

SYNBADm is a Matlab toolbox for the automated design of biocircuits using a model-based optimization approach. It enables the design of biocircuits with pre-defined functions starting from libraries of biological parts. SYNBADm makes use of mixed integer global optimization and allows both single and multi-objective design problems. Here we describe a basic protocol for the design of synthetic gene regulatory circuits. We illustrate step-by-step how to solve two different problems: (1) the (single objective) design of a synthetic oscillator and (2) the (multi-objective) design of a circuit with switch-like behavior upon induction, with a good compromise between performance and protein production cost.

Using optimal control to understand complex metabolic pathways

BACKGROUND

Optimality principles have been used to explain the structure and behavior of living matter at different levels of organization, from basic phenomena at the molecular level, up to complex dynamics in whole populations. Most of these studies have assumed a single-criteria approach. Such optimality principles have been justified from an evolutionary perspective. In the context of the cell, previous studies have shown how dynamics of gene expression in small metabolic models can be explained assuming that cells have developed optimal adaptation strategies. Most of these works have considered rather simplified representations, such as small linear pathways, or reduced networks with a single branching point, and a single objective for the optimality criteria.

RESULTS

Here we consider the extension of this approach to more realistic scenarios, i.e. biochemical pathways of arbitrary size and structure. We first show that exploiting optimality principles for these networks poses great challenges due to the complexity of the associated optimal control problems. Second, in order to surmount such challenges, we present a computational framework which has been designed with scalability and efficiency in mind, including mechanisms to avoid the most common pitfalls. Third, we illustrate its performance with several case studies considering the central carbon metabolism of S. cerevisiae and B. subtilis. In particular, we consider metabolic dynamics during nutrient shift experiments.

CONCLUSIONS

We show how multi-objective optimal control can be used to predict temporal profiles of enzyme activation and metabolite concentrations in complex metabolic pathways. Further, we also show how to consider general cost/benefit trade-offs. In this study we have considered metabolic pathways, but this computational framework can also be applied to analyze the dynamics of other complex pathways, such as signal transduction or gene regulatory networks.

Distilling Robust Design Principles of Biocircuits Using Mixed Integer Dynamic Optimization

A major challenge in model-based design of synthetic biochemical circuits is how to address uncertainty in the parameters. A circuit whose behavior is robust to variations in the parameters will have more chances to behave as predicted when implemented in practice, and also to function reliably in presence of fluctuations and noise. Here, we extend our recent work on automated-design based on mixed-integer multi-criteria dynamic optimization to take into account parametric uncertainty. We exploit the intensive sampling of the design space performed by a global optimization algorithm to obtain the robustness of the topologies without significant additional computational effort. Our procedure provides automatically topologies that best trade-off performance and robustness against parameter fluctuations. We illustrate our approach considering the automated design of gene circuits achieving adaptation.

Designing synthetic networks in silico: a generalised evolutionary algorithm approach

Background

Evolution has led to the development of biological networks that are shaped by environmental signals. Elucidating, understanding and then reconstructing important network motifs is one of the principal aims of Systems & Synthetic Biology. Consequently, previous research has focused on finding optimal network structures and reaction rates that respond to pulses or produce stable oscillations. In this work we present a generalised in silico evolutionary algorithm that simultaneously finds network structures and reaction rates (genotypes) that can satisfy multiple defined objectives (phenotypes).

Results

The key step to our approach is to translate a schema/binary-based description of biological networks into systems of ordinary differential equations (ODEs). The ODEs can then be solved numerically to provide dynamic information about an evolved networks functionality. Initially we benchmark algorithm performance by finding optimal networks that can recapitulate concentration time-series data and perform parameter optimisation on oscillatory dynamics of the Repressilator. We go on to show the utility of our algorithm by finding new designs for robust synthetic oscillators, and by performing multi-objective optimisation to find a set of oscillators and feed-forward loops that are optimal at balancing different system properties. In sum, our results not only confirm and build on previous observations but we also provide new designs of synthetic oscillators for experimental construction.

Conclusions

In this work we have presented and tested an evolutionary algorithm that can design a biological network to produce desired output. Given that previous designs of synthetic networks have been limited to subregions of network- and parameter-space, the use of our evolutionary optimisation algorithm will enable Synthetic Biologists to construct new systems with the potential to display a wider range of complex responses.

Electronic supplementary material

The online version of this article (doi:10.1186/s12918-017-0499-9) contains supplementary material, which is available to authorized users.

A parallel metaheuristic for large mixed-integer dynamic optimization problems, with applications in computational biology

Background

We consider a general class of global optimization problems dealing with nonlinear dynamic models. Although this class is relevant to many areas of science and engineering, here we are interested in applying this framework to the reverse engineering problem in computational systems biology, which yields very large mixed-integer dynamic optimization (MIDO) problems. In particular, we consider the framework of logic-based ordinary differential equations (ODEs).

Methods

We present saCeSS2, a parallel method for the solution of this class of problems. This method is based on an parallel cooperative scatter search metaheuristic, with new mechanisms of self-adaptation and specific extensions to handle large mixed-integer problems. We have paid special attention to the avoidance of convergence stagnation using adaptive cooperation strategies tailored to this class of problems.

Results

We illustrate its performance with a set of three very challenging case studies from the domain of dynamic modelling of cell signaling. The simpler case study considers a synthetic signaling pathway and has 84 continuous and 34 binary decision variables. A second case study considers the dynamic modeling of signaling in liver cancer using high-throughput data, and has 135 continuous and 109 binaries decision variables. The third case study is an extremely difficult problem related with breast cancer, involving 690 continuous and 138 binary decision variables. We report computational results obtained in different infrastructures, including a local cluster, a large supercomputer and a public cloud platform. Interestingly, the results show how the cooperation of individual parallel searches modifies the systemic properties of the sequential algorithm, achieving superlinear speedups compared to an individual search (e.g. speedups of 15 with 10 cores), and significantly improving (above a 60%) the performance with respect to a non-cooperative parallel scheme. The scalability of the method is also good (tests were performed using up to 300 cores).

Conclusions

These results demonstrate that saCeSS2 can be used to successfully reverse engineer large dynamic models of complex biological pathways. Further, these results open up new possibilities for other MIDO-based large-scale applications in the life sciences such as metabolic engineering, synthetic biology, drug scheduling.

Understanding Robust Adaptation Dynamics of Gene Regulatory Network

Robust adaptation is a critical attribute for gene regulatory network (GRN), understanding the relationship between adaptation and the GRN topology, and corresponding parameters is a challenging issue. The work in this paper includes: first, seven constraint multiobjective optimization algorithms are used to find sufficient solutions to get more reliable statistic rules. Meanwhile, the algorithms are compared to facilitate the future algorithm selection; second, a fuzzy c-mean algorithm is used to analyze solutions and to classify the solutions into different groups; third, the histogram analysis for all satisfactory solutions shows the preferred parameter range, i.e., parameter motif. The contributions of this paper includes: 1) Two new adaptation indices i.e., peak time and settle down time, are proposed for the first time to give more accurate description of the robust adaptation. Our conclusion is that some solutions even with satisfactory sensitivity and precision are not practically of robust adaptation because of too long time needed. 2) The relationship between topology, parameter set, and robust adaptation of GRN is discovered in the sense of both preferred topology and parameter motif. Our conclusion is that the robust adaptation depends more on the GRN topology than the model parameter set in two feasible topologies.

Automated Design Framework for Synthetic Biology Exploiting Pareto Optimality

In this work we consider Pareto optimality for automated design in synthetic biology. We present a generalized framework based on a mixed-integer dynamic optimization formulation that, given design specifications, allows the computation of Pareto optimal sets of designs, that is, the set of best trade-offs for the metrics of interest. We show how this framework can be used for (i) forward design, that is, finding the Pareto optimal set of synthetic designs for implementation, and (ii) reverse design, that is, analyzing and inferring motifs and/or design principles of gene regulatory networks from the Pareto set of optimal circuits. Finally, we illustrate the capabilities and performance of this framework considering four case studies. In the first problem we consider the forward design of an oscillator. In the remaining problems, we illustrate how to apply the reverse design approach to find motifs for stripe formation, rapid adaption, and fold-change detection, respectively.

Optimisation of an exemplar oculomotor model using multi-objective genetic algorithms executed on a GPU-CPU combination

BACKGROUND

Parameter optimisation is a critical step in the construction of computational biology models. In eye movement research, computational models are increasingly important to understanding the mechanistic basis of normal and abnormal behaviour. In this study, we considered an existing neurobiological model of fast eye movements (saccades), capable of generating realistic simulations of: (i) normal horizontal saccades; and (ii) infantile nystagmus - pathological ocular oscillations that can be subdivided into different waveform classes. By developing appropriate fitness functions, we optimised the model to existing experimental saccade and nystagmus data, using a well-established multi-objective genetic algorithm. This algorithm required the model to be numerically integrated for very large numbers of parameter combinations. To address this computational bottleneck, we implemented a master-slave parallelisation, in which the model integrations were distributed across the compute units of a GPU, under the control of a CPU.

RESULTS

While previous nystagmus fitting has been based on reproducing qualitative waveform characteristics, our optimisation protocol enabled us to perform the first direct fits of a model to experimental recordings. The fits to normal eye movements showed that although saccades of different amplitudes can be accurately simulated by individual parameter sets, a single set capable of fitting all amplitudes simultaneously cannot be determined. The fits to nystagmus oscillations systematically identified the parameter regimes in which the model can reproduce a number of canonical nystagmus waveforms to a high accuracy, whilst also identifying some waveforms that the model cannot simulate. Using a GPU to perform the model integrations yielded a speedup of around 20 compared to a high-end CPU.

CONCLUSIONS

The results of both optimisation problems enabled us to quantify the predictive capacity of the model, suggesting specific modifications that could expand its repertoire of simulated behaviours. In addition, the optimal parameter distributions we obtained were consistent with previous computational studies that had proposed the saccadic braking signal to be the origin of the instability preceding the development of infantile nystagmus oscillations. Finally, the master-slave parallelisation method we developed to accelerate the optimisation process can be readily adapted to fit other highly parametrised computational biology models to experimental data.

JuPOETs: a constrained multiobjective optimization approach to estimate biochemical model ensembles in the Julia programming language

Background

Ensemble modeling is a promising approach for obtaining robust predictions and coarse grained population behavior in deterministic mathematical models. Ensemble approaches address model uncertainty by using parameter or model families instead of single best-fit parameters or fixed model structures. Parameter ensembles can be selected based upon simulation error, along with other criteria such as diversity or steady-state performance. Simulations using parameter ensembles can estimate confidence intervals on model variables, and robustly constrain model predictions, despite having many poorly constrained parameters.

Results

In this software note, we present a multiobjective based technique to estimate parameter or models ensembles, the Pareto Optimal Ensemble Technique in the Julia programming language (JuPOETs). JuPOETs integrates simulated annealing with Pareto optimality to estimate ensembles on or near the optimal tradeoff surface between competing training objectives. We demonstrate JuPOETs on a suite of multiobjective problems, including test functions with parameter bounds and system constraints as well as for the identification of a proof-of-concept biochemical model with four conflicting training objectives. JuPOETs identified optimal or near optimal solutions approximately six-fold faster than a corresponding implementation in Octave for the suite of test functions. For the proof-of-concept biochemical model, JuPOETs produced an ensemble of parameters that gave both the mean of the training data for conflicting data sets, while simultaneously estimating parameter sets that performed well on each of the individual objective functions.

Conclusions

JuPOETs is a promising approach for the estimation of parameter and model ensembles using multiobjective optimization. JuPOETs can be adapted to solve many problem types, including mixed binary and continuous variable types, bilevel optimization problems and constrained problems without altering the base algorithm. JuPOETs is open source, available under an MIT license, and can be installed using the Julia package manager from the JuPOETs GitHub repository

Design Principles of Biological Oscillators through Optimization: Forward and Reverse Analysis

From cyanobacteria to human, sustained oscillations coordinate important biological functions. Although much has been learned concerning the sophisticated molecular mechanisms underlying biological oscillators, design principles linking structure and functional behavior are not yet fully understood. Here we explore design principles of biological oscillators from a multiobjective optimization perspective, taking into account the trade-offs between conflicting performance goals or demands. We develop a comprehensive tool for automated design of oscillators, based on multicriteria global optimization that allows two modes: (i) the automatic design (forward problem) and (ii) the inference of design principles (reverse analysis problem). From the perspective of synthetic biology, the forward mode allows the solution of design problems that mimic some of the desirable properties appearing in natural oscillators. The reverse analysis mode facilitates a systematic exploration of the design space based on Pareto optimality concepts. The method is illustrated with two case studies: the automatic design of synthetic oscillators from a library of biological parts, and the exploration of design principles in 3-gene oscillatory systems.

A computational method for the investigation of multistable systems and its application to genetic switches

Background

Genetic switches exhibit multistability, form the basis of epigenetic memory, and are found in natural decision making systems, such as cell fate determination in developmental pathways. Synthetic genetic switches can be used for recording the presence of different environmental signals, for changing phenotype using synthetic inputs and as building blocks for higher-level sequential logic circuits. Understanding how multistable switches can be constructed and how they function within larger biological systems is therefore key to synthetic biology.

Results

Here we present a new computational tool, called StabilityFinder, that takes advantage of sequential Monte Carlo methods to identify regions of parameter space capable of producing multistable behaviour, while handling uncertainty in biochemical rate constants and initial conditions. The algorithm works by clustering trajectories in phase space, and iteratively minimizing a distance metric. Here we examine a collection of models of genetic switches, ranging from the deterministic Gardner toggle switch to stochastic models containing different positive feedback connections. We uncover the design principles behind making bistable, tristable and quadristable switches, and find that rate of gene expression is a key parameter. We demonstrate the ability of the framework to examine more complex systems and examine the design principles of a three gene switch. Our framework allows us to relax the assumptions that are often used in genetic switch models and we show that more complex abstractions are still capable of multistable behaviour.

Conclusions

Our results suggest many ways in which genetic switches can be enhanced and offer designs for the construction of novel switches. Our analysis also highlights subtle changes in correlation of experimentally tunable parameters that can lead to bifurcations in deterministic and stochastic systems. Overall we demonstrate that StabilityFinder will be a valuable tool in the future design and construction of novel gene networks.

Electronic supplementary material

The online version of this article (doi:10.1186/s12918-016-0375-z) contains supplementary material, which is available to authorized users.

Process-based design of dynamical biological systems

The computational design of dynamical systems is an important emerging task in synthetic biology. Given desired properties of the behaviour of a dynamical system, the task of design is to build an in-silico model of a system whose simulated be- haviour meets these properties. We introduce a new, process-based, design methodology for addressing this task. The new methodology combines a flexible process-based formalism for specifying the space of candidate designs with multi-objective optimization approaches for selecting the most appropriate among these candidates. We demonstrate that the methodology is general enough to both formulate and solve tasks of designing deterministic and stochastic systems, successfully reproducing plausible designs reported in previous studies and proposing new designs that meet the design criteria, but have not been previously considered.

SYNBADm: a tool for optimization-based automated design of synthetic gene circuits

MOTIVATION

The design of de novo circuits with predefined performance specifications is a challenging problem in Synthetic Biology. Computational models and tools have proved to be crucial for a successful wet lab implementation. Natural gene circuits are complex, subject to evolutionary tradeoffs and playing multiple roles. However, most synthetic designs implemented to date are simple and perform a single task. As the field progresses, advanced computational tools are needed in order to handle greater levels of circuit complexity in a more flexible way and considering multiple design criteria.

RESULTS

This works presents SYNBADm (SYNthetic Biology Automated optimal Design in Matlab), a software toolbox for the automatic optimal design of gene circuits with targeted functions from libraries of components. This tool makes use of global optimization to simultaneously search the space of structures and kinetic parameters. SYNBADm can efficiently handle high levels of circuit complexity and can consider multiple design criteria through multiobjective optimization. Further, it provides flexible design capabilities, i.e. the user can define the modeling framework, library of components and target performance function(s).

AVAILABILITY AND IMPLEMENTATION

SYNBADm runs under the popular MATLAB computational environment, and is available under GPLv3 license at https://sites.google.com/site/synbadm CONTACT: ireneotero@iim.csic.es or julio@iim.csic.es.

Multi-objective optimization framework to obtain model-based guidelines for tuning biological synthetic devices: an adaptive network case

Background

Model based design plays a fundamental role in synthetic biology. Exploiting modularity, i.e. using biological parts and interconnecting them to build new and more complex biological circuits is one of the key issues. In this context, mathematical models have been used to generate predictions of the behavior of the designed device. Designers not only want the ability to predict the circuit behavior once all its components have been determined, but also to help on the design and selection of its biological parts, i.e. to provide guidelines for the experimental implementation. This is tantamount to obtaining proper values of the model parameters, for the circuit behavior results from the interplay between model structure and parameters tuning. However, determining crisp values for parameters of the involved parts is not a realistic approach. Uncertainty is ubiquitous to biology, and the characterization of biological parts is not exempt from it. Moreover, the desired dynamical behavior for the designed circuit usually results from a trade-off among several goals to be optimized.

Results

We propose the use of a multi-objective optimization tuning framework to get a model-based set of guidelines for the selection of the kinetic parameters required to build a biological device with desired behavior. The design criteria are encoded in the formulation of the objectives and optimization problem itself. As a result, on the one hand the designer obtains qualitative regions/intervals of values of the circuit parameters giving rise to the predefined circuit behavior; on the other hand, he obtains useful information for its guidance in the implementation process. These parameters are chosen so that they can effectively be tuned at the wet-lab, i.e. they are effective biological tuning knobs. To show the proposed approach, the methodology is applied to the design of a well known biological circuit: a genetic incoherent feed-forward circuit showing adaptive behavior.

Conclusion

The proposed multi-objective optimization design framework is able to provide effective guidelines to tune biological parameters so as to achieve a desired circuit behavior. Moreover, it is easy to analyze the impact of the context on the synthetic device to be designed. That is, one can analyze how the presence of a downstream load influences the performance of the designed circuit, and take it into account.

Electronic supplementary material

The online version of this article (doi:10.1186/s12918-016-0269-0) contains supplementary material, which is available to authorized users.