Iterative experiment design guides the characterization of a light-inducible gene expression circuit

Iterative design of training data to control intricate enzymatic reaction networks

Kinetic modeling of in vitro enzymatic reaction networks is vital to understand and control the complex behaviors emerging from the nonlinear interactions inside. However, modeling is severely hampered by the lack of training data. Here, we introduce a methodology that combines an active learning-like approach and flow chemistry to efficiently create optimized datasets for a highly interconnected enzymatic reactions network with multiple sub-pathways. The optimal experimental design (OED) algorithm designs a sequence of out-of-equilibrium perturbations to maximize the information about the reaction kinetics, yielding a descriptive model that allows control of the output of the network towards any cost function. We experimentally validate the model by forcing the network to produce different product ratios while maintaining a minimum level of overall conversion efficiency. Our workflow scales with the complexity of the system and enables the optimization of previously unobtainable network outputs.

Repeated Decision Stumping Distils Simple Rules from Single-Cell Data

Single-cell data afford unprecedented insights into molecular processes. But the complexity and size of these data sets have proved challenging and given rise to a large armory of statistical and machine learning approaches. The majority of approaches focuses on either describing features of these data, or making predictions and classifying unlabeled samples. In this study, we introduce repeated decision stumping (ReDX) as a method to distill simple models from single-cell data. We develop decision trees of depth one-hence "stumps"-to identify in an inductive manner, gene products involved in driving cell fate transitions, and in applications to published data we are able to discover the key players involved in these processes in an unbiased manner without prior knowledge. Our algorithm is deliberately targeting the simplest possible candidate hypotheses that can be extracted from complex high-dimensional data. There are three reasons for this: (1) the predictions become straightforwardly testable hypotheses; (2) the identified candidates form the basis for further mechanistic model development, for example, for engineering and synthetic biology interventions; and (3) this approach complements existing descriptive modeling approaches and frameworks. The approach is computationally efficient, has remarkable predictive power, including in simulation studies where the ground truth is known, and yields robust and statistically stable predictors; the same set of candidates is generated by applying the algorithm to different subsamples of experimental data.

Analysis and design of single-cell experiments to harvest fluctuation information while rejecting measurement noise

Introduction: Despite continued technological improvements, measurement errors always reduce or distort the information that any real experiment can provide to quantify cellular dynamics. This problem is particularly serious for cell signaling studies to quantify heterogeneity in single-cell gene regulation, where important RNA and protein copy numbers are themselves subject to the inherently random fluctuations of biochemical reactions. Until now, it has not been clear how measurement noise should be managed in addition to other experiment design variables (e.g., sampling size, measurement times, or perturbation levels) to ensure that collected data will provide useful insights on signaling or gene expression mechanisms of interest. Methods: We propose a computational framework that takes explicit consideration of measurement errors to analyze single-cell observations, and we derive Fisher Information Matrix (FIM)-based criteria to quantify the information value of distorted experiments. Results and Discussion: We apply this framework to analyze multiple models in the context of simulated and experimental single-cell data for a reporter gene controlled by an HIV promoter. We show that the proposed approach quantitatively predicts how different types of measurement distortions affect the accuracy and precision of model identification, and we demonstrate that the effects of these distortions can be mitigated through explicit consideration during model inference. We conclude that this reformulation of the FIM could be used effectively to design single-cell experiments to optimally harvest fluctuation information while mitigating the effects of image distortion.

Recent advances, opportunities and challenges in cybergenetic identification and control of biomolecular networks

Cybergenetics is a new area of research aimed at developing digital and biological controllers for living systems. Synthetic biologists have begun exploiting cybergenetic tools and platforms to both accelerate the development of mathematical models and develop control strategies for complex biological phenomena. Here, we review the state of the art in cybergenetic identification and control. Our aim is to lower the entry barrier to this field and foster the adoption of methods and technologies that will accelerate the pace at which Synthetic Biology progresses toward applications.

NLoed: A Python Package for Nonlinear Optimal Experimental Design in Systems Biology

Modeling in systems and synthetic biology relies on accurate parameter estimates and predictions. Accurate model calibration relies, in turn, on data and on how well suited the available data are to a particular modeling task. Optimal experimental design (OED) techniques can be used to identify experiments and data collection procedures that will most efficiently contribute to a given modeling objective. However, implementation of OED is limited by currently available software tools that are not well suited for the diversity of nonlinear models and non-normal data commonly encountered in biological research. Moreover, existing OED tools do not make use of the state-of-the-art numerical tools, resulting in inefficient computation. Here, we present the NLoed software package and demonstrate its use with in vivo data from an optogenetic system in Escherichia coli. NLoed is an open-source Python library providing convenient access to OED methods, with particular emphasis on experimental design for systems biology research. NLoed supports a wide variety of nonlinear, multi-input/output, and dynamic models and facilitates modeling and design of experiments over a wide variety of data types. To support OED investigations, the NLoed package implements maximum likelihood fitting and diagnostic tools, providing a comprehensive modeling workflow. NLoed offers an accessible, modular, and flexible OED tool set suited to the wide variety of experimental scenarios encountered in systems biology research. We demonstrate NLoed's capabilities by applying it to experimental design for characterization of a bacterial optogenetic system.

Platforms for Optogenetic Stimulation and Feedback Control

Harnessing the potential of optogenetics in biology requires methodologies from different disciplines ranging from biology, to mechatronics engineering, to control engineering. Light stimulation of a synthetic optogenetic construct in a given biological species can only be achieved via a suitable light stimulation platform. Emerging optogenetic applications entail a consistent, reproducible, and regulated delivery of light adapted to the application requirement. In this review, we explore the evolution of light-induction hardware-software platforms from simple illumination set-ups to sophisticated microscopy, microtiter plate and bioreactor designs, and discuss their respective advantages and disadvantages. Here, we examine design approaches followed in performing optogenetic experiments spanning different cell types and culture volumes, with induction capabilities ranging from single cell stimulation to entire cell culture illumination. The development of automated measurement and stimulation schemes on these platforms has enabled researchers to implement various in silico feedback control strategies to achieve computer-controlled living systems—a theme we briefly discuss in the last part of this review.

A microfluidic optimal experimental design platform for forward design of cell-free genetic networks

Cell-free protein synthesis has been widely used as a “breadboard” for design of synthetic genetic networks. However, due to a severe lack of modularity, forward engineering of genetic networks remains challenging. Here, we demonstrate how a combination of optimal experimental design and microfluidics allows us to devise dynamic cell-free gene expression experiments providing maximum information content for subsequent non-linear model identification. Importantly, we reveal that applying this methodology to a library of genetic circuits, that share common elements, further increases the information content of the data resulting in higher accuracy of model parameters. To show modularity of model parameters, we design a pulse decoder and bistable switch, and predict their behaviour both qualitatively and quantitatively. Finally, we update the parameter database and indicate that network topology affects parameter estimation accuracy. Utilizing our methodology provides us with more accurate model parameters, a necessity for forward engineering of complex genetic networks.

Characterization of cell-free genetic networks is inherently difficult. Here the authors use optimal experimental design and microfluidics to improve characterization, demonstrating modularity and predictability of parts in applied test cases.

Parameter estimation and uncertainty quantification using information geometry

In this work, we: (i) review likelihood-based inference for parameter estimation and the construction of confidence regions; and (ii) explore the use of techniques from information geometry, including geodesic curves and Riemann scalar curvature, to supplement typical techniques for uncertainty quantification, such as Bayesian methods, profile likelihood, asymptotic analysis and bootstrapping. These techniques from information geometry provide data-independent insights into uncertainty and identifiability, and can be used to inform data collection decisions. All code used in this work to implement the inference and information geometry techniques is available on GitHub.

Parameter inference for stochastic biochemical models from perturbation experiments parallelised at the single cell level

Understanding and characterising biochemical processes inside single cells requires experimental platforms that allow one to perturb and observe the dynamics of such processes as well as computational methods to build and parameterise models from the collected data. Recent progress with experimental platforms and optogenetics has made it possible to expose each cell in an experiment to an individualised input and automatically record cellular responses over days with fine time resolution. However, methods to infer parameters of stochastic kinetic models from single-cell longitudinal data have generally been developed under the assumption that experimental data is sparse and that responses of cells to at most a few different input perturbations can be observed. Here, we investigate and compare different approaches for calculating parameter likelihoods of single-cell longitudinal data based on approximations of the chemical master equation (CME) with a particular focus on coupling the linear noise approximation (LNA) or moment closure methods to a Kalman filter. We show that, as long as cells are measured sufficiently frequently, coupling the LNA to a Kalman filter allows one to accurately approximate likelihoods and to infer model parameters from data even in cases where the LNA provides poor approximations of the CME. Furthermore, the computational cost of filtering-based iterative likelihood evaluation scales advantageously in the number of measurement times and different input perturbations and is thus ideally suited for data obtained from modern experimental platforms. To demonstrate the practical usefulness of these results, we perform an experiment in which single cells, equipped with an optogenetic gene expression system, are exposed to various different light-input sequences and measured at several hundred time points and use parameter inference based on iterative likelihood evaluation to parameterise a stochastic model of the system.

A common result for the modelling of cellular processes is that available data is not sufficiently rich to uniquely determine the biological mechanism or even just to ensure identifiability of parameters of a given model. Perturbing cellular processes with informative input stimuli and measuring dynamical responses may alleviate this problem. With the development of novel experimental platforms, we are now in a position to parallelise such perturbation experiments at the single cell level. This raises a plethora of new questions. Is it more informative to diversify input perturbations but to observe only few cells for each input or should we rather ensure that many cells are observed for only few inputs? How can we calculate likelihoods and infer parameters of stochastic kinetic models from data sets in which each cell receives a different input perturbation? How does the computational efficiency of parameter inference methods scale with the number of inputs and the number of measurement times? Are there approaches that are particularly well-suited for such data sets? In this paper, we investigate these questions using the CcaS/CcaR optogenetic system driving the expression of a fluorescent reporter protein as primary case study.

Optogenetics in plants

The last two decades have witnessed the emergence of optogenetics; a field that has given researchers the ability to use light to control biological processes at high spatiotemporal and quantitative resolutions, in a reversible manner with minimal side-effects. Optogenetics has revolutionized the neurosciences, increased our understanding of cellular signalling and metabolic networks and resulted in variety of applications in biotechnology and biomedicine. However, implementing optogenetics in plants has been less straightforward, given their dependency on light for their life cycle. Here, we highlight some of the widely used technologies in microorganisms and animal systems derived from plant photoreceptor proteins and discuss strategies recently implemented to overcome the challenges for using optogenetics in plants.

Real-Time Optogenetics System for Controlling Gene Expression Using a Model-Based Design

Optimization of engineered biological systems requires precise control over the rates and timing of gene expression. Optogenetics is used to dynamically control gene expression as an alternative to conventional chemical-based methods since it provides a more convenient interface between digital control software and microbial culture. Here, we describe the construction of a real-time optogenetics platform, which performs closed-loop control over the CcaR-CcaS two-plasmid system in Escherichia coli. We showed the first model-based design approach by constructing a nonlinear representation of the CcaR-CcaS system, tuned the model through open-loop experimentation to capture the experimental behavior, and applied the model in silico to inform the necessary changes to build a closed-loop optogenetic control system. Our system periodically induces and represses the CcaR-CcaS system while recording optical density and fluorescence using image processing techniques. We highlight the facile nature of constructing our system and how our model-based design approach will potentially be used to model other systems requiring closed-loop optogenetic control.

The rise and shine of yeast optogenetics

Optogenetics refers to the control of biological processes with light. The activation of cellular phenomena by defined wavelengths has several advantages compared with traditional chemically inducible systems, such as spatiotemporal resolution, dose-response regulation, low cost, and moderate toxic effects. Optogenetics has been successfully implemented in yeast, a remarkable biological platform that is not only a model organism for cellular and molecular biology studies, but also a microorganism with diverse biotechnological applications. In this review, we summarize the main optogenetic systems implemented in the budding yeast Saccharomyces cerevisiae, which allow orthogonal control (by light) of gene expression, protein subcellular localization, reconstitution of protein activity, and protein sequestration by oligomerization. Furthermore, we review the application of optogenetic systems in the control of metabolic pathways, heterologous protein production and flocculation. We then revise an example of a previously described yeast optogenetic switch, named FUN-LOV, which allows precise and strong activation of the target gene. Finally, we describe optogenetic systems that have not yet been implemented in yeast, which could therefore be used to expand the panel of available tools in this biological chassis. In conclusion, a wide repertoire of optogenetic systems can be used to address fundamental biological questions and broaden the biotechnological toolkit in yeast.

Optimally Designed Model Selection for Synthetic Biology

Modeling parts and circuits represents a significant roadblock to automating the Design-Build-Test-Learn cycle in synthetic biology. Once models are developed, discriminating among them requires informative data, computational resources, and skills that might not be readily available. The high cost entailed in model discrimination frequently leads to subjective choices on the selected structures and, in turn, to suboptimal models. Here, we outline frequentist and Bayesian approaches to model discrimination. We ranked three candidate models of a genetic toggle switch, which was adopted as a test case, according to the support from in vivo data. We show that, in each framework, efficient model discrimination can be achieved via optimally designed experiments. We offer a dynamical-systems interpretation of our optimization results and investigate their sensitivity to key parameters in the characterization of synthetic circuits. Our approach suggests that optimal experimental design is an effective strategy to discriminate between competing models of a gene regulatory network. Independent of the adopted framework, optimally designed perturbations exploit regions in the input space that maximally distinguish predictions from the competing models.

Accelerated knowledge discovery from omics data by optimal experimental design

How to design experiments that accelerate knowledge discovery on complex biological landscapes remains a tantalizing question. We present an optimal experimental design method (coined OPEX) to identify informative omics experiments using machine learning models for both experimental space exploration and model training. OPEX-guided exploration of Escherichia coli’s populations exposed to biocide and antibiotic combinations lead to more accurate predictive models of gene expression with 44% less data. Analysis of the proposed experiments shows that broad exploration of the experimental space followed by fine-tuning emerges as the optimal strategy. Additionally, analysis of the experimental data reveals 29 cases of cross-stress protection and 4 cases of cross-stress vulnerability. Further validation reveals the central role of chaperones, stress response proteins and transport pumps in cross-stress exposure. This work demonstrates how active learning can be used to guide omics data collection for training predictive models, making evidence-driven decisions and accelerating knowledge discovery in life sciences.

How to design experiments that accelerate knowledge discovery on complex biological landscapes remains a tantalizing question. Here, the authors present OPEX, an optimal experimental design method to identify informative omics experiments for both experimental space exploration and model training.

In situ characterisation and manipulation of biological systems with Chi.Bio

The precision and repeatability of in vivo biological studies is predicated upon methods for isolating a targeted subsystem from external sources of noise and variability. However, in many experimental frameworks, this is made challenging by nonstatic environments during host cell growth, as well as variability introduced by manual sampling and measurement protocols. To address these challenges, we developed Chi.Bio, a parallelised open-source platform that represents a new experimental paradigm in which all measurement and control actions can be applied to a bulk culture in situ. In addition to continuous-culturing capabilities, it incorporates tunable light outputs, spectrometry, and advanced automation features. We demonstrate its application to studies of cell growth and biofilm formation, automated in silico control of optogenetic systems, and readout of multiple orthogonal fluorescent proteins in situ. By integrating precise measurement and actuation hardware into a single low-cost platform, Chi.Bio facilitates novel experimental methods for synthetic, systems, and evolutionary biology and broadens access to cutting-edge research capabilities.

Optimal Design of Single-Cell Experiments within Temporally Fluctuating Environments

Modern biological experiments are becoming increasingly complex, and designing these experiments to yield the greatest possible quantitative insight is an open challenge. Increasingly, computational models of complex stochastic biological systems are being used to understand and predict biological behaviors or to infer biological parameters. Such quantitative analyses can also help to improve experiment designs for particular goals, such as to learn more about specific model mechanisms or to reduce prediction errors in certain situations. A classic approach to experiment design is to use the Fisher information matrix (FIM), which quantifies the expected information a particular experiment will reveal about model parameters. The Finite State Projection based FIM (FSP-FIM) was recently developed to compute the FIM for discrete stochastic gene regulatory systems, whose complex response distributions do not satisfy standard assumptions of Gaussian variations. In this work, we develop the FSP-FIM analysis for a stochastic model of stress response genes in S. cerevisae under time-varying MAPK induction. We verify this FSP-FIM analysis and use it to optimize the number of cells that should be quantified at particular times to learn as much as possible about the model parameters. We then extend the FSP-FIM approach to explore how different measurement times or genetic modifications help to minimize uncertainty in the sensing of extracellular environments, and we experimentally validate the FSP-FIM to rank single-cell experiments for their abilities to minimize estimation uncertainty of NaCl concentrations during yeast osmotic shock. This work demonstrates the potential of quantitative models to not only make sense of modern biological data sets, but to close the loop between quantitative modeling and experimental data collection.

Simulation and inference algorithms for stochastic biochemical reaction networks: from basic concepts to state-of-the-art

Stochasticity is a key characteristic of intracellular processes such as gene regulation and chemical signalling. Therefore, characterizing stochastic effects in biochemical systems is essential to understand the complex dynamics of living things. Mathematical idealizations of biochemically reacting systems must be able to capture stochastic phenomena. While robust theory exists to describe such stochastic models, the computational challenges in exploring these models can be a significant burden in practice since realistic models are analytically intractable. Determining the expected behaviour and variability of a stochastic biochemical reaction network requires many probabilistic simulations of its evolution. Using a biochemical reaction network model to assist in the interpretation of time-course data from a biological experiment is an even greater challenge due to the intractability of the likelihood function for determining observation probabilities. These computational challenges have been subjects of active research for over four decades. In this review, we present an accessible discussion of the major historical developments and state-of-the-art computational techniques relevant to simulation and inference problems for stochastic biochemical reaction network models. Detailed algorithms for particularly important methods are described and complemented with Matlab^® implementations. As a result, this review provides a practical and accessible introduction to computational methods for stochastic models within the life sciences community.

Cell-machine interfaces for characterizing gene regulatory network dynamics

Gene regulatory networks and the dynamic responses they produce offer a wealth of information about how biological systems process information about their environment. Recently, researchers interested in dissecting these networks have been outsourcing various parts of their experimental workflow to computers. Here we review how, using microfluidic or optogenetic tools coupled with fluorescence imaging, it is now possible to interface cells and computers. These platforms enable scientists to perform informative dynamic stimulations of genetic pathways and monitor their reaction. It is also possible to close the loop and regulate genes in real time, providing an unprecedented view of how signals propagate through the network. Finally, we outline new tools that can be used within the framework of cell-machine interfaces.

Component Characterization in a Growth-Dependent Physiological Context: Optimal Experimental Design

Synthetic biology design challenges have driven the use of mathematical models to characterize genetic components and to explore complex design spaces. Traditional approaches to characterization have largely ignored the effect of strain and growth conditions on the dynamics of synthetic genetic circuits, and have thus confounded intrinsic features of the circuit components with cell-level context effects. We present a model that distinguishes an activated gene’s intrinsic kinetics from its physiological context. We then demonstrate an optimal experimental design approach to identify dynamic induction experiments for efficient estimation of the component’s intrinsic parameters. Maximally informative experiments are chosen by formulating the design as an optimal control problem; direct multiple-shooting is used to identify the optimum. Our numerical results suggest that the intrinsic parameters of a genetic component can be more accurately estimated using optimal experimental designs, and that the choice of growth rates, sampling schedule, and input profile each play an important role. The proposed approach to coupled component–host modelling can support gene circuit design across a range of physiological conditions.

The finite state projection based Fisher information matrix approach to estimate information and optimize single-cell experiments

Modern optical imaging experiments not only measure single-cell and single-molecule dynamics with high precision, but they can also perturb the cellular environment in myriad controlled and novel settings. Techniques, such as single-molecule fluorescence in-situ hybridization, microfluidics, and optogenetics, have opened the door to a large number of potential experiments, which begs the question of how to choose the best possible experiment. The Fisher information matrix (FIM) estimates how well potential experiments will constrain model parameters and can be used to design optimal experiments. Here, we introduce the finite state projection (FSP) based FIM, which uses the formalism of the chemical master equation to derive and compute the FIM. The FSP-FIM makes no assumptions about the distribution shapes of single-cell data, and it does not require precise measurements of higher order moments of such distributions. We validate the FSP-FIM against well-known Fisher information results for the simple case of constitutive gene expression. We then use numerical simulations to demonstrate the use of the FSP-FIM to optimize the timing of single-cell experiments with more complex, non-Gaussian fluctuations. We validate optimal simulated experiments determined using the FSP-FIM with Monte-Carlo approaches and contrast these to experiment designs chosen by traditional analyses that assume Gaussian fluctuations or use the central limit theorem. By systematically designing experiments to use all of the measurable fluctuations, our method enables a key step to improve co-design of experiments and quantitative models.

On-Line Optimal Input Design Increases the Efficiency and Accuracy of the Modelling of an Inducible Synthetic Promoter

Synthetic biology seeks to design biological parts and circuits that implement new functions in cells. Major accomplishments have been reported in this field, yet predicting a priori the in vivo behaviour of synthetic gene circuits is major a challenge. Mathematical models offer a means to address this bottleneck. However, in biology, modelling is perceived as an expensive, time-consuming task. Indeed, the quality of predictions depends on the accuracy of parameters, which are traditionally inferred from poorly informative data. How much can parameter accuracy be improved by using model-based optimal experimental design (MBOED)? To tackle this question, we considered an inducible promoter in the yeast S. cerevisiae. Using in vivo data, we re-fit a dynamic model for this component and then compared the performance of standard (e.g., step inputs) and optimally designed experiments for parameter inference. We found that MBOED improves the quality of model calibration by ∼60%. Results further improve up to 84 % when considering on-line optimal experimental design (OED). Our in silico results suggest that MBOED provides a significant advantage in the identification of models of biological parts and should thus be integrated into their characterisation.

"Do It Yourself" Microbial Cultivation Techniques for Synthetic and Systems Biology: Cheap, Fun, and Flexible

With the emergence of inexpensive 3D printing technology, open-source platforms for electronic prototyping and single-board computers, "Do it Yourself" (DIY) approaches to the cultivation of microbial cultures are becoming more feasible, user-friendly, and thus wider spread. In this perspective, we survey some of these approaches, as well as add-on solutions to commercial instruments for synthetic and system biology applications. We discuss different cultivation designs, including capabilities and limitations. Our intention is to encourage the reader to consider the DIY solutions. Overall, custom cultivation devices offer controlled growth environments with in-line monitoring of, for example, optical density, fluorescence, pH, and dissolved oxygen, all at affordable prices. Moreover, they offer a great degree of flexibility for different applications and requirements and are fun to design and construct. We include several illustrative examples, such as gaining optogenetic control and adaptive laboratory evolution experiments.

Selected-node stochastic simulation algorithm

Stochastic simulations of biochemical networks are of vital importance for understanding complex dynamics in cells and tissues. However, existing methods to perform such simulations are associated with computational difficulties and addressing those remains a daunting challenge to the present. Here we introduce the selected-node stochastic simulation algorithm (snSSA), which allows us to exclusively simulate an arbitrary, selected subset of molecular species of a possibly large and complex reaction network. The algorithm is based on an analytical elimination of chemical species, thereby avoiding explicit simulation of the associated chemical events. These species are instead described continuously in terms of statistical moments derived from a stochastic filtering equation, resulting in a substantial speedup when compared to Gillespie's stochastic simulation algorithm (SSA). Moreover, we show that statistics obtained via snSSA profit from a variance reduction, which can significantly lower the number of Monte Carlo samples needed to achieve a certain performance. We demonstrate the algorithm using several biological case studies for which the simulation time could be reduced by orders of magnitude.

Shaping bacterial population behavior through computer-interfaced control of individual cells

Bacteria in groups vary individually, and interact with other bacteria and the environment to produce population-level patterns of gene expression. Investigating such behavior in detail requires measuring and controlling populations at the single-cell level alongside precisely specified interactions and environmental characteristics. Here we present an automated, programmable platform that combines image-based gene expression and growth measurements with on-line optogenetic expression control for hundreds of individual Escherichia coli cells over days, in a dynamically adjustable environment. This integrated platform broadly enables experiments that bridge individual and population behaviors. We demonstrate: (i) population structuring by independent closed-loop control of gene expression in many individual cells, (ii) cell–cell variation control during antibiotic perturbation, (iii) hybrid bio-digital circuits in single cells, and freely specifiable digital communication between individual bacteria. These examples showcase the potential for real-time integration of theoretical models with measurement and control of many individual cells to investigate and engineer microbial population behavior.

Individual bacteria interact with each other and their environment to produce population-level patterns of gene expression. Here the authors use an automated platform combined with optogenetic feedback to manipulate population behaviors through dynamic control of individual cells.

Taking control over microbial populations: Current approaches for exploiting biological noise in bioprocesses

Phenotypic plasticity of microbial cells has attracted much attention and several research efforts have been dedicated to the description of methods aiming at characterizing phenotypic heterogeneity and its impact on microbial populations. However, different approaches have also been suggested in order to take benefit from noise in a bioprocess perspective, e.g. by increasing the robustness or productivity of a microbial population. This review is dedicated to outline these controlling methods. A common issue, that has still to be addressed, is the experimental identification and the mathematical expression of noise. Indeed, the effective interfacing of microbial physiology with external parameters that can be used for controlling physiology depends on the acquisition of reliable signals. Latest technologies, like single cell microfluidics and advanced flow cytometric approaches, enable linking physiology, noise, heterogeneity in productive microbes with environmental cues and hence allow correctly mapping and predicting biological behavior via mathematical representations. However, like in the field of electronics, signals are perpetually subjected to noise. If appropriately interpreted, this noise can give an additional insight into the behavior of the individual cells within a microbial population of interest. This review focuses on recent progress made at describing, treating and exploiting biological noise in the context of microbial populations used in various bioprocess applications.

Sensitivity estimation for stochastic models of biochemical reaction networks in the presence of extrinsic variability

Determining the sensitivity of certain system states or outputs to variations in parameters facilitates our understanding of the inner working of that system and is an essential design tool for the de novo construction of robust systems. In cell biology, the output of interest is often the response of a certain reaction network to some input (e.g., stressors or nutrients) and one aims to quantify the sensitivity of this response in the presence of parameter heterogeneity. We argue that for such applications, parametric sensitivities in their standard form do not paint a complete picture of a system's robustness since one assumes that all cells in the population have the same parameters and are perturbed in the same way. Here, we consider stochasticreaction networks in which the parameters are randomly distributed over the population and propose a new sensitivity index that captures the robustness of system outputs upon changes in the characteristics of the parameter distribution, rather than the parameters themselves. Subsequently, we make use of Girsanov's likelihood ratio method to construct a Monte Carlo estimator of this sensitivity index. However, it turns out that this estimator has an exceedingly large variance. To overcome this problem, we propose a novel estimation algorithm that makes use of a marginalization of the path distribution of stochasticreaction networks and leads to Rao-Blackwellized estimators with reduced variance.

Accelerated search for BaTiO3-based piezoelectrics with vertical morphotropic phase boundary using Bayesian learning

An outstanding challenge in the nascent field of materials informatics is to incorporate materials knowledge in a robust Bayesian approach to guide the discovery of new materials. Utilizing inputs from known phase diagrams, features or material descriptors that are known to affect the ferroelectric response, and Landau-Devonshire theory, we demonstrate our approach for BaTiO₃-based piezoelectrics with the desired target of a vertical morphotropic phase boundary. We predict, synthesize, and characterize a solid solution, (Ba_0.5Ca_0.5)TiO₃-Ba(Ti_0.7Zr_0.3)O₃, with piezoelectric properties that show better temperature reliability than other BaTiO₃-based piezoelectrics in our initial training data.

Experimental Design for Stochastic Models of Nonlinear Signaling Pathways Using an Interval-Wise Linear Noise Approximation and State Estimation

BACKGROUND

Computational modeling is a key technique for analyzing models in systems biology. There are well established methods for the estimation of the kinetic parameters in models of ordinary differential equations (ODE). Experimental design techniques aim at devising experiments that maximize the information encoded in the data. For ODE models there are well established approaches for experimental design and even software tools. However, data from single cell experiments on signaling pathways in systems biology often shows intrinsic stochastic effects prompting the development of specialized methods. While simulation methods have been developed for decades and parameter estimation has been targeted for the last years, only very few articles focus on experimental design for stochastic models.

METHODS

The Fisher information matrix is the central measure for experimental design as it evaluates the information an experiment provides for parameter estimation. This article suggest an approach to calculate a Fisher information matrix for models containing intrinsic stochasticity and high nonlinearity. The approach makes use of a recently suggested multiple shooting for stochastic systems (MSS) objective function. The Fisher information matrix is calculated by evaluating pseudo data with the MSS technique.

RESULTS

The performance of the approach is evaluated with simulation studies on an Immigration-Death, a Lotka-Volterra, and a Calcium oscillation model. The Calcium oscillation model is a particularly appropriate case study as it contains the challenges inherent to signaling pathways: high nonlinearity, intrinsic stochasticity, a qualitatively different behavior from an ODE solution, and partial observability. The computational speed of the MSS approach for the Fisher information matrix allows for an application in realistic size models.

A population-based temporal logic gate for timing and recording chemical events

Engineered bacterial sensors have potential applications in human health monitoring, environmental chemical detection, and materials biosynthesis. While such bacterial devices have long been engineered to differentiate between combinations of inputs, their potential to process signal timing and duration has been overlooked. In this work, we present a two‐input temporal logic gate that can sense and record the order of the inputs, the timing between inputs, and the duration of input pulses. Our temporal logic gate design relies on unidirectional DNA recombination mediated by bacteriophage integrases to detect and encode sequences of input events. For an E. coli strain engineered to contain our temporal logic gate, we compare predictions of Markov model simulations with laboratory measurements of final population distributions for both step and pulse inputs. Although single cells were engineered to have digital outputs, stochastic noise created heterogeneous single‐cell responses that translated into analog population responses. Furthermore, when single‐cell genetic states were aggregated into population‐level distributions, these distributions contained unique information not encoded in individual cells. Thus, final differentiated sub‐populations could be used to deduce order, timing, and duration of transient chemical events.

Minimal moment equations for stochastic models of biochemical reaction networks with partially finite state space

Many stochastic models of biochemical reaction networks contain some chemical species for which the number of molecules that are present in the system can only be finite (for instance due to conservation laws), but also other species that can be present in arbitrarily large amounts. The prime example of such networks are models of gene expression, which typically contain a small and finite number of possible states for the promoter but an infinite number of possible states for the amount of mRNA and protein. One of the main approaches to analyze such models is through the use of equations for the time evolution of moments of the chemical species. Recently, a new approach based on conditional moments of the species with infinite state space given all the different possible states of the finite species has been proposed. It was argued that this approach allows one to capture more details about the full underlying probability distribution with a smaller number of equations. Here, I show that the result that less moments provide more information can only stem from an unnecessarily complicated description of the system in the classical formulation. The foundation of this argument will be the derivation of moment equations that describe the complete probability distribution over the finite state space but only low-order moments over the infinite state space. I will show that the number of equations that is needed is always less than what was previously claimed and always less than the number of conditional moment equations up to the same order. To support these arguments, a symbolic algorithm is provided that can be used to derive minimal systems of unconditional moment equations for models with partially finite state space.