Constraints on Fluctuations in Sparsely Characterized Biological Systems

Assessing Markovian and Delay Models for Single-Nucleus RNA Sequencing

The serial nature of reactions involved in the RNA life-cycle motivates the incorporation of delays in models of transcriptional dynamics. The models couple a transcriptional process to a fairly general set of delayed monomolecular reactions with no feedback. We provide numerical strategies for calculating the RNA copy number distributions induced by these models, and solve several systems with splicing, degradation, and catalysis. An analysis of single-cell and single-nucleus RNA sequencing data using these models reveals that the kinetics of nuclear export do not appear to require invocation of a non-Markovian waiting time.

Noise properties of adaptation-conferring biochemical control modules

A key goal of synthetic biology is to develop functional biochemical modules with network-independent properties. Antithetic integral feedback (AIF) is a recently developed control module in which two control species perfectly annihilate each other's biological activity. The AIF module confers robust perfect adaptation to the steady-state average level of a controlled intracellular component when subjected to sustained perturbations. Recent work has suggested that such robustness comes at the unavoidable price of increased stochastic fluctuations around average levels. We present theoretical results that support and quantify this trade-off for the commonly analyzed AIF variant in the idealized limit with perfect annihilation. However, we also show that this trade-off is a singular limit of the control module: Even minute deviations from perfect adaptation allow systems to achieve effective noise suppression as long as cells can pay the corresponding energetic cost. We further show that a variant of the AIF control module can achieve significant noise suppression even in the idealized limit with perfect adaptation. This atypical configuration may thus be preferable in synthetic biology applications.

Inference on autoregulation in gene expression with variance-to-mean ratio

Some genes can promote or repress their own expressions, which is called autoregulation. Although gene regulation is a central topic in biology, autoregulation is much less studied. In general, it is extremely difficult to determine the existence of autoregulation with direct biochemical approaches. Nevertheless, some papers have observed that certain types of autoregulations are linked to noise levels in gene expression. We generalize these results by two propositions on discrete-state continuous-time Markov chains. These two propositions form a simple but robust method to infer the existence of autoregulation from gene expression data. This method only needs to compare the mean and variance of the gene expression level. Compared to other methods for inferring autoregulation, our method only requires non-interventional one-time data, and does not need to estimate parameters. Besides, our method has few restrictions on the model. We apply this method to four groups of experimental data and find some genes that might have autoregulation. Some inferred autoregulations have been verified by experiments or other theoretical works.

Using Fano factors to determine certain types of gene autoregulation

The expression of one gene might be regulated by its corresponding protein, which is called autoregulation. Although gene regulation is a central topic in biology, autoregulation is much less studied. In general, it is extremely difficult to determine the existence of autoregulation with direct biochemical approaches. Nevertheless, some papers have observed that certain types of autoregulations are linked to noise levels in gene expression. We generalize these results by two propositions on discrete-state continuous-time Markov chains. These two propositions form a simple but robust method to infer the existence of autoregulation in certain scenarios from gene expression data. This method only depends on the Fano factor, namely the ratio of variance and mean of the gene expression level. Compared to other methods for inferring autoregulation, our method only requires non-interventional one-time data, and does not need to estimate parameters. Besides, our method has few restrictions on the model. We apply this method to four groups of experimental data and find some genes that might have autoregulation. Some inferred autoregulations have been verified by experiments or other theoretical works.

The effect of microRNA on protein variability and gene expression fidelity

Small regulatory RNA molecules such as microRNA modulate gene expression through inhibiting the translation of messenger RNA (mRNA). Such posttranscriptional regulation has been recently hypothesized to reduce the stochastic variability of gene expression around average levels. Here, we quantify noise in stochastic gene expression models with and without such regulation. Our results suggest that silencing mRNA posttranscriptionally will always increase, rather than decrease, gene expression noise when the silencing of mRNA also increases its degradation, as is expected for microRNA interactions with mRNA. In that regime, we also find that silencing mRNA generally reduces the fidelity of signal transmission from deterministically varying upstream factors to protein levels. These findings suggest that microRNA binding to mRNA does not generically confer precision to protein expression.

Quantifying biochemical reaction rates from static population variability within incompletely observed complex networks

Quantifying biochemical reaction rates within complex cellular processes remains a key challenge of systems biology even as high-throughput single-cell data have become available to characterize snapshots of population variability. That is because complex systems with stochastic and non-linear interactions are difficult to analyze when not all components can be observed simultaneously and systems cannot be followed over time. Instead of using descriptive statistical models, we show that incompletely specified mechanistic models can be used to translate qualitative knowledge of interactions into reaction rate functions from covariability data between pairs of components. This promises to turn a globally intractable problem into a sequence of solvable inference problems to quantify complex interaction networks from incomplete snapshots of their stochastic fluctuations.

Inferring gene regulation dynamics from static snapshots of gene expression variability

Inferring functional relationships within complex networks from static snapshots of a subset of variables is a ubiquitous problem in science. For example, a key challenge of systems biology is to translate cellular heterogeneity data obtained from single-cell sequencing or flow-cytometry experiments into regulatory dynamics. We show how static population snapshots of covariability can be exploited to rigorously infer properties of gene expression dynamics when gene expression reporters probe their upstream dynamics on separate timescales. This can be experimentally exploited in dual-reporter experiments with fluorescent proteins of unequal maturation times, thus turning an experimental bug into an analysis feature. We derive correlation conditions that detect the presence of closed-loop feedback regulation in gene regulatory networks. Furthermore, we show how genes with cell-cycle-dependent transcription rates can be identified from the variability of coregulated fluorescent proteins. Similar correlation constraints might prove useful in other areas of science in which static correlation snapshots are used to infer causal connections between dynamically interacting components.

Data-driven network models for genetic circuits from time-series data with incomplete measurements

Synthetic gene networks are frequently conceptualized and visualized as static graphs. This view of biological programming stands in stark contrast to the transient nature of biomolecular interaction, which is frequently enacted by labile molecules that are often unmeasured. Thus, the network topology and dynamics of synthetic gene networks can be difficult to verify in vivo or in vitro, due to the presence of unmeasured biological states. Here we introduce the dynamical structure function as a new mesoscopic, data-driven class of models to describe gene networks with incomplete measurements of state dynamics. We develop a network reconstruction algorithm and a code base for reconstructing the dynamical structure function from data, to enable discovery and visualization of graphical relationships in a genetic circuit diagram as time-dependent functions rather than static, unknown weights. We prove a theorem, showing that dynamical structure functions can provide a data-driven estimate of the size of crosstalk fluctuations from an idealized model. We illustrate this idea with numerical examples. Finally, we show how data-driven estimation of dynamical structure functions can explain failure modes in two experimentally implemented genetic circuits, a previously reported in vitro genetic circuit and a new E. coli-based transcriptional event detector.

Angular Precision of Radical Pair Compass Magnetoreceptors

The light-dependent magnetic compass sense of night-migratory songbirds is thought to rely on magnetically sensitive chemical reactions of radical pairs in cryptochrome proteins located in the birds' eyes. Recently, an information theory approach was developed that provides a strict lower bound on the precision with which a bird could estimate its head direction using only geomagnetic cues and a cryptochrome-based radical pair sensor. By means of this lower bound, we show here how the performance of the compass sense could be optimized by adjusting the orientation of cryptochrome molecules within photoreceptor cells, the distribution of cells around the retina, and the effects of the geomagnetic field on the photochemistry of the radical pair.

Using Models to (Re-)Design Synthetic Circuits

Mathematical models play an important role in the design of synthetic gene circuits, by guiding the choice of biological components and their assembly into novel gene networks. Here, we present a guide for biologists to build and utilize models of gene networks (synthetic or natural) to analyze dynamical properties of these networks while considering the low numbers of molecules inside cells that results in stochastic gene expression. We start by describing how to write down a model and discussing the level of details to include. We then briefly demonstrate how to simulate a network's dynamics using deterministic differential equations that assume high numbers of molecules. To consider the role of stochastic gene expression in single cells, we provide a detailed tutorial on running stochastic Gillespie simulations of a network, including instructions on coding the Gillespie algorithm with example code. Finally, we illustrate how using a combination of quantitative experimental characterization of a synthetic circuit and mathematical modeling can guide the iterative redesign of a synthetic circuit to achieve the desired properties. This is shown using a classic synthetic oscillator, the repressilator, which we recently redesigned into the most precise and robust synthetic oscillator to date. We thus provide a toolkit for synthetic biologists to build more precise and robust synthetic circuits, which should lead to a deeper understanding of the dynamics of gene regulatory networks.

Coupled membrane transporters reduce noise

Molecular systems are inherently probabilistic and operate in a noisy environment, yet, despite all these uncertainties, molecular functions are surprisingly reliable and robust. The principles used by natural systems to deal with noise are still not well understood, especially in a nonhomogeneous environment where molecules can diffuse across different compartments. In this paper we show that membrane transport mechanisms have very effective properties of noise reduction. In particular, we show that active transport mechanisms (those that can transport against a gradient of concentration by using energy or by means of the concentration gradient of other substances), such as symporters and antiporters, have surprising efficiency in noise reduction, which outperforms passive diffusion mechanisms and are well below Poisson levels. We link our results to the coupled transport of potassium, sodium, and glucose to show that the noise in internal glucose level can be greatly reduced. Our results show that compartmentalization can be a highly effective mechanism of noise reduction and suggests that membrane transport could give this extra benefit, contributing to the emergence of complex compartmentalization in eukaryotes.

Navigating at night: fundamental limits on the sensitivity of radical pair magnetoreception under dim light

Night-migratory songbirds appear to sense the direction of the Earth's magnetic field via radical pair intermediates formed photochemically in cryptochrome flavoproteins contained in photoreceptor cells in their retinas. It is an open question whether this light-dependent mechanism could be sufficiently sensitive given the low-light levels experienced by nocturnal migrants. The scarcity of available photons results in significant uncertainty in the signal generated by the magnetoreceptors distributed around the retina. Here we use results from Information Theory to obtain a lower bound estimate of the precision with which a bird could orient itself using only geomagnetic cues. Our approach bypasses the current lack of knowledge about magnetic signal transduction and processing in vivo by computing the best-case compass precision under conditions where photons are in short supply. We use this method to assess the performance of three plausible cryptochrome-derived flavin-containing radical pairs as potential magnetoreceptors.

Kinetic Uncertainty Relations for the Control of Stochastic Reaction Networks

Nonequilibrium stochastic reaction networks are commonly found in both biological and nonbiological systems, but have remained hard to analyze because small differences in rate functions or topology can change the dynamics drastically. Here, we conjecture exact quantitative inequalities that relate the extent of fluctuations in connected components, for various network topologies. Specifically, we find that regardless of how two components affect each other's production rates, it is impossible to suppress fluctuations below the uncontrolled equivalents for both components: one must increase its fluctuations for the other to be suppressed. For systems in which components control each other in ringlike structures, it appears that fluctuations can only be suppressed in one component if all other components instead increase fluctuations, compared to the case without control. Even the general N-component system-with arbitrary connections and parameters-must have at least one component with increased fluctuations to reduce fluctuations in others. In connected reaction networks it thus appears impossible to reduce the statistical uncertainty in all components, regardless of the control mechanisms or energy dissipation.

A universal biomolecular integral feedback controller for robust perfect adaptation

Homeostasis is a recurring theme in biology that ensures that regulated variables robustly-and in some systems, completely-adapt to environmental perturbations. This robust perfect adaptation feature is achieved in natural circuits by using integral control, a negative feedback strategy that performs mathematical integration to achieve structurally robust regulation^1,2. Despite its benefits, the synthetic realization of integral feedback in living cells has remained elusive owing to the complexity of the required biological computations. Here we prove mathematically that there is a single fundamental biomolecular controller topology³ that realizes integral feedback and achieves robust perfect adaptation in arbitrary intracellular networks with noisy dynamics. This adaptation property is guaranteed both for the population-average and for the time-average of single cells. On the basis of this concept, we genetically engineer a synthetic integral feedback controller in living cells⁴ and demonstrate its tunability and adaptation properties. A growth-rate control application in Escherichia coli shows the intrinsic capacity of our integral controller to deliver robustness and highlights its potential use as a versatile controller for regulation of biological variables in uncertain networks. Our results provide conceptual and practical tools in the area of cybergenetics^3,5, for engineering synthetic controllers that steer the dynamics of living systems^3-9.

Investigating epithelial-to-mesenchymal transition with integrated computational and experimental approaches

The transition between epithelial and mesenchymal (EMT) is a fundamental cellular process that plays critical roles in development, cancer metastasis, and tissue wound healing. EMT is not a binary process but involves multiple partial EMT states that give rise to a high degree of cell state plasticity. Here, we first reviewed several studies on theoretical predictions and experimental verification of these intermediate states, the role of partial EMT on kidney fibrosis development, and how quantitative signaling information controls cell commitment to partial or full EMT upon transient signals. Next, we summarized existing knowledge and open questions on the coupling between EMT and other biological processes, such as the cell cycle, epigenetic regulation, stemness, and apoptosis. Taken together, EMT is a model system that has attracted increasing interests for quantitative experimental and theoretical studies.

Complexity-aware simple modeling

Mathematical models continue to be essential for deepening our understanding of biology. On one extreme, simple or small-scale models help delineate general biological principles. However, the parsimony of detail in these models as well as their assumption of modularity and insulation make them inaccurate for describing quantitative features. On the other extreme, large-scale and detailed models can quantitatively recapitulate a phenotype of interest, but have to rely on many unknown parameters, making them often difficult to parse mechanistically and to use for extracting general principles. We discuss some examples of a new approach-complexity-aware simple modeling-that can bridge the gap between the small-scale and large-scale approaches.

The Chemical Fluctuation Theorem governing gene expression

Gene expression is a complex stochastic process composed of numerous enzymatic reactions with rates coupled to hidden cell-state variables. Despite advances in single-cell technologies, the lack of a theory accurately describing the gene expression process has restricted a robust, quantitative understanding of gene expression variability among cells. Here we present the Chemical Fluctuation Theorem (CFT), providing an accurate relationship between the environment-coupled chemical dynamics of gene expression and gene expression variability. Combined with a general, accurate model of environment-coupled transcription processes, the CFT provides a unified explanation of mRNA variability for various experimental systems. From this analysis, we construct a quantitative model of transcription dynamics enabling analytic predictions for the dependence of mRNA noise on the mRNA lifetime distribution, confirmed against stochastic simulation. This work suggests promising new directions for quantitative investigation into cellular control over biological functions by making complex dynamics of intracellular reactions accessible to rigorous mathematical deductions.

A unified framework to understand gene expression noise is still lacking. Here the authors derive a universal theorem relating the biological noise with dynamics of birth and death processes and present a model of transcription dynamics, allowing analytical prediction of the dependence of mRNA noise on mRNA lifetime variability.

Phenotypic diversity and temporal variability in a bacterial signaling network revealed by single-cell FRET

We present in vivo single-cell FRET measurements in the Escherichia coli chemotaxis system that reveal pervasive signaling variability, both across cells in isogenic populations and within individual cells over time. We quantify cell-to-cell variability of adaptation, ligand response, as well as steady-state output level, and analyze the role of network design in shaping this diversity from gene expression noise. In the absence of changes in gene expression, we find that single cells demonstrate strong temporal fluctuations. We provide evidence that such signaling noise can arise from at least two sources: (i) stochastic activities of adaptation enzymes, and (ii) receptor-kinase dynamics in the absence of adaptation. We demonstrate that under certain conditions, (ii) can generate giant fluctuations that drive signaling activity of the entire cell into a stochastic two-state switching regime. Our findings underscore the importance of molecular noise, arising not only in gene expression but also in protein networks.

Stochastic fluctuations can reveal the feedback signs of gene regulatory networks at the single-molecule level

Understanding the relationship between spontaneous stochastic fluctuations and the topology of the underlying gene regulatory network is of fundamental importance for the study of single-cell stochastic gene expression. Here by solving the analytical steady-state distribution of the protein copy number in a general kinetic model of stochastic gene expression with nonlinear feedback regulation, we reveal the relationship between stochastic fluctuations and feedback topology at the single-molecule level, which provides novel insights into how and to what extent a feedback loop can enhance or suppress molecular fluctuations. Based on such relationship, we also develop an effective method to extract the topological information of a gene regulatory network from single-cell gene expression data. The theory is demonstrated by numerical simulations and, more importantly, validated quantitatively by single-cell data analysis of a synthetic gene circuit integrated in human kidney cells.

An engineering design approach to systems biology

Measuring and modeling the integrated behavior of biomolecular-cellular networks is central to systems biology. Over several decades, systems biology has been shaped by quantitative biologists, physicists, mathematicians, and engineers in different ways. However, the basic and applied versions of systems biology are not typically distinguished, which blurs the separate aspirations of the field and its potential for real-world impact. Here, we articulate an engineering approach to systems biology, which applies educational philosophy, engineering design, and predictive models to solve contemporary problems in an age of biomedical Big Data. A concerted effort to train systems bioengineers will provide a versatile workforce capable of tackling the diverse challenges faced by the biotechnological and pharmaceutical sectors in a modern, information-dense economy.

Staying Clear of the Dragons

A new, game-changing approach makes it possible to rigorously disprove models without making assumptions about the unknown parts of the biological system.

Exploiting Natural Fluctuations to Identify Kinetic Mechanisms in Sparsely Characterized Systems

From biochemistry to ecology, many biological systems are stochastic, complex, and sparsely characterized. In such systems, each component may respond to changes in any directly or indirectly connected components, thus requiring knowledge of the whole to predict the dynamics of the parts. Here, we address this challenge by deriving relations between properties of fluctuations that only reflect local interactions between a subset of components but are invariant to all indirectly connected dynamics. This greatly reduces the number of assumptions when evaluating dynamic models experimentally. We illustrate the approach by revisiting systematic single-cell gene expression data, and we show that the observed fluctuations contradict the assumptions made in most published models of stochastic gene expression, even when accounting for the possibility of systematic experimental artifacts.