Optimal signal processing in small stochastic biochemical networks

Nonequilibrium Effects on Information Recoverability of the Noisy Channels

We investigated the impact of nonequilibrium conditions on the transmission and recovery of information through noisy channels. By measuring the recoverability of messages from an information source, we demonstrate that the ability to recover information is connected to the nonequilibrium behavior of the information flow, particularly in terms of sequential information transfer. We discovered that the mathematical equivalence of information recoverability and entropy production characterizes the dissipative nature of information transfer. Our findings show that both entropy production (or recoverability) and mutual information increase monotonically with the nonequilibrium strength of information dynamics. These results suggest that the nonequilibrium dissipation cost can enhance the recoverability of noise messages and improve the quality of information transfer. Finally, we propose a simple model to test our conclusions and found that the numerical results support our findings.

Trade-offs between cost and information in cellular prediction

Living cells can leverage correlations in environmental fluctuations to predict the future environment and mount a response ahead of time. To this end, cells need to encode the past signal into the output of the intracellular network from which the future input is predicted. Yet, storing information is costly while not all features of the past signal are equally informative on the future input signal. Here, we show for two classes of input signals that cellular networks can reach the fundamental bound on the predictive information as set by the information extracted from the past signal: Push-pull networks can reach this information bound for Markovian signals, while networks that take a temporal derivative can reach the bound for predicting the future derivative of non-Markovian signals. However, the bits of past information that are most informative about the future signal are also prohibitively costly. As a result, the optimal system that maximizes the predictive information for a given resource cost is, in general, not at the information bound. Applying our theory to the chemotaxis network of Escherichia coli reveals that its adaptive kernel is optimal for predicting future concentration changes over a broad range of background concentrations, and that the system has been tailored to predicting these changes in shallow gradients.

Pathway-resolved decomposition demonstrates correlation and noise dependencies of redundant information processing in recurrent feed-forward topologies

In a biochemical assay that converts fan-in networks into feed-forward loops (FFLs), we show that the inter-regulator redundant information about the output gene product can be decomposed into finer components, mediated by the constituent pathways. Variance-based information within the linear noise regime facilitates quantifying these submodular redundancies. Contrary to the conventional wisdom on information decomposition, we report that information redundancy depends nontrivially on inter-regulator correlation. For the type-1 coherent (C1) and incoherent (I1) FFLs, the direct regulatory path-mediated redundancy is certainly correlation independent. However, components induced by the indirect regulatory path and interpathway interference are correlation dependent in (non)linear fashion. The trade-off between information redundancy and similarly decomposable extrinsic noise from input to output node has been demonstrated for the pathways and full motifs. Our analyses suggest that the interpathway cross redundancy positively and negatively influences the superposition of elementary redundancies in the C1- and I1-FFLs, respectively. Their corresponding total extrinsic noise is produced by the weighted sum and difference of the pathway-specific components. We find that the I1-FFL is able to manufacture more varied redundancy and extrinsic noise responses compared to the C1-FFL. Underlying the differing characteristics of the composite metrics across FFL variants, there exist uniformly behaving pathway-dependent elements. The decomposition framework has been meticulously explored in biologically rational parametric realizations through analytical estimates and stochastic simulations.

Periodic synchronization of isolated network elements facilitates simulating and inferring gene regulatory networks including stochastic molecular kinetics

Background

The temporal progression of many fundamental processes in cells and organisms, including homeostasis, differentiation and development, are governed by gene regulatory networks (GRNs). GRNs balance fluctuations in the output of their genes, which trace back to the stochasticity of molecular interactions. Although highly desirable to understand life processes, predicting the temporal progression of gene products within a GRN is challenging when considering stochastic events such as transcription factor–DNA interactions or protein production and degradation.

Results

We report a method to simulate and infer GRNs including genes and biochemical reactions at molecular detail. In our approach, we consider each network element to be isolated from other elements during small time intervals, after which we synchronize molecule numbers across all network elements. Thereby, the temporal behaviour of network elements is decoupled and can be treated by local stochastic or deterministic solutions. We demonstrate the working principle of this modular approach with a repressive gene cascade comprising four genes. By considering a deterministic time evolution within each time interval for all elements, our method approaches the solution of the system of deterministic differential equations associated with the GRN. By allowing genes to stochastically switch between on and off states or by considering stochastic production of gene outputs, we are able to include increasing levels of stochastic detail and approximate the solution of a Gillespie simulation. Thereby, CaiNet is able to reproduce noise-induced bi-stability and oscillations in dynamically complex GRNs. Notably, our modular approach further allows for a simple consideration of deterministic delays. We further infer relevant regulatory connections and steady-state parameters of a GRN of up to ten genes from steady-state measurements by identifying each gene of the network with a single perceptron in an artificial neuronal network and using a gradient decent method originally designed to train recurrent neural networks. To facilitate setting up GRNs and using our simulation and inference method, we provide a fast computer-aided interactive network simulation environment, CaiNet.

Conclusion

We developed a method to simulate GRNs at molecular detail and to infer the topology and steady-state parameters of GRNs. Our method and associated user-friendly framework CaiNet should prove helpful to analyze or predict the temporal progression of reaction networks or GRNs in cellular and organismic biology. CaiNet is freely available at https://gitlab.com/GebhardtLab/CaiNet.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12859-021-04541-6.

Information transmission in a two-step cascade: interplay of activation and repression

We present an information-theoretic formalism to study signal transduction in four architectural variants of a model two-step cascade with increasing input population. Our results categorize these four types into two classes depending upon the effect of activation and repression on mutual information, net synergy, and signal-to-noise ratio. Using the Gaussian framework and linear noise approximation, we derive the analytic expressions for these metrics to establish their underlying relationships in terms of the biochemical parameters. We also verify our approximations through stochastic simulations.

First-principles prediction of the information processing capacity of a simple genetic circuit

Given the stochastic nature of gene expression, genetically identical cells exposed to the same environmental inputs will produce different outputs. This heterogeneity has been hypothesized to have consequences for how cells are able to survive in changing environments. Recent work has explored the use of information theory as a framework to understand the accuracy with which cells can ascertain the state of their surroundings. Yet the predictive power of these approaches is limited and has not been rigorously tested using precision measurements. To that end, we generate a minimal model for a simple genetic circuit in which all parameter values for the model come from independently published data sets. We then predict the information processing capacity of the genetic circuit for a suite of biophysical parameters such as protein copy number and protein-DNA affinity. We compare these parameter-free predictions with an experimental determination of protein expression distributions and the resulting information processing capacity of E. coli cells. We find that our minimal model captures the scaling of the cell-to-cell variability in the data and the inferred information processing capacity of our simple genetic circuit up to a systematic deviation.

Extrinsic noise of the target gene governs abundance pattern of feed-forward loop motifs

Feed-forward loop (FFL) is found to be a recurrent structure in bacterial and yeast gene transcription regulatory networks. In a generic FFL, transcription factor (TF) S regulates production of another TF X while both of these TFs regulate production of final gene-product Y. Depending upon the regulatory programs (activation or repression), FFLs are grouped into two broad classes: coherent (C) and incoherent (I), each class containing four distinct types (C1-C4 and I1-I4). These FFL types are experimentally observed to occur with varied frequencies, C1 and I1 being the abundant ones. Here we present a stochastic framework singling out the absolute value of the normalized covariance of X and Y to be the determining factor behind the abundance of FFLs while considering differential promoter activities of X and Y. Our theoretical construct employs two possible signal integration mechanisms (additive and multiplicative) to synthesize Y while steady-state population level of S remains fixed or becomes tunable reflecting two possible environmental signaling scenarios. Our model categorically points out that abundant FFLs exhibit higher amount of the designated metric which has a biophysical connotation of extrinsic noise for the target gene Y. Our predictions emanating from an overarching analytical expression utilizing biologically plausible parametric conditions are substantiated by stochastic simulation.

Role of integrated noise in pathway-specific signal propagation in feed-forward loops

Cells impose optimal noise control mechanism in diverse situations to cope with distinct environmental cues. Sometimes, it is desirable for the cell to utilize fluctuations for noise-driven processes. In other cases, noise can be harmful to the cell to show optimal fitness. It is, therefore, important to unravel the noise propagation mechanism inside the cell. Such noise controlling mechanism is accomplished by using gene transcription regulatory networks. One such gene regulatory network is feed-forward loop, having three regulatory nodes S, X and Y. Here, we consider the most abundant type 1 of coherent and incoherent feed-forward loops with both OR and AND logic functions, forming four different architectures. In OR logic function, the functions representing S and X act additively for the regulation of Y, while in AND logic function, the same functions (S and X) act multiplicatively for the regulation of Y. Measurement of susceptibility of the signal at output Y is done using elasticity of each regulation in FFLs. Using susceptibility, we demonstrate the nature of pathway integration by which one-step and two-step pathways get overlapped. The integration type is competitive for motifs having OR gate, while it is noncompetitive for the same with AND gate. The pathway integration property explains the output noise behavior of the motifs properly but cannot infer about the mechanism by which the upstream noise propagates to output. To account this, the total output noise is decomposed, which results in integrated noise as an additional noise source along with pathway-specific noise components. The integrated noise is found to appear as a consequence of integration between the pathways and has different functional characteristics explaining noise amplification and noise attenuation property of coherent and incoherent feed-forward loops, respectively. The noise decomposition also quantifies the contribution of different noise sources toward total noise. Finally, the noise propagation is being tuned as a function of input signal noise and its time scale of fluctuations, which shows considerable intrinsic noise strength and relatively slow relaxation time scale causes a higher degree of noise propagation in FFLs.

Theory for the optimal detection of time-varying signals in cellular sensing systems

Living cells often need to measure chemical concentrations that vary in time, yet how accurately they can do so is poorly understood. Here, we present a theory that fully specifies, without any adjustable parameters, the optimal design of a canonical sensing system in terms of two elementary design principles: (1) there exists an optimal integration time, which is determined by the input statistics and the number of receptors; and (2) in the optimally designed system, the number of independent concentration measurements as set by the number of receptors and the optimal integration time equals the number of readout molecules that store these measurements and equals the work to store these measurements reliably; no resource is then in excess and hence wasted. Applying our theory to the Escherichia coli chemotaxis system indicates that its integration time is not only optimal for sensing shallow gradients but also necessary to enable navigation in these gradients.

The many bits of positional information

Half a century after Lewis Wolpert's seminal conceptual advance on how cellular fates distribute in space, we provide a brief historical perspective on how the concept of positional information emerged and influenced the field of developmental biology and beyond. We focus on a modern interpretation of this concept in terms of information theory, largely centered on its application to cell specification in the early Drosophila embryo. We argue that a true physical variable (position) is encoded in local concentrations of patterning molecules, that this mapping is stochastic, and that the processes by which positions and corresponding cell fates are determined based on these concentrations need to take such stochasticity into account. With this approach, we shift the focus from biological mechanisms, molecules, genes and pathways to quantitative systems-level questions: where does positional information reside, how it is transformed and accessed during development, and what fundamental limits it is subject to?

Information transmission from NFkB signaling dynamics to gene expression

The dynamic signal encoding paradigm suggests that information flows from the extracellular environment into specific signaling patterns (encoding) that are then read by downstream effectors to control cellular behavior. Previous work empirically quantified the information content of dynamic signaling patterns. However, whether this information can be faithfully transmitted to the gene expression level is unclear. Here we used NFkB signaling as a model to understand the accuracy of information transmission from signaling dynamics into gene expression. Using a detailed mathematical model, we simulated realistic NFkB signaling patterns with different degrees of variability. The NFkB patterns were used as an input to a simple gene expression model. Analysis of information transmission between ligand and NFkB and ligand and gene expression allows us to determine information loss in transmission between receptors to dynamic signaling patterns and between signaling dynamics to gene expression. Information loss could occur due to biochemical noise or due to a lack of specificity. We found that noise-free gene expression has very little information loss suggesting that gene expression can preserve specificity in NFkB patterns. As expected, the addition of noise to the gene expression model results in information loss. Interestingly, this effect can be mitigated by a specific choice of parameters that can substantially reduce information loss due to biochemical noise during gene expression. Overall our results show that the cellular capacity for information transmission from dynamic signaling patterns to gene expression can be high enough to preserve ligand specificity and thereby the accuracy of cellular response to environmental cues.

Organ System Network Disruption Is Associated With Poor Prognosis in Patients With Chronic Liver Failure

BACKGROUND

A healthy individual has a high degree of functional connectivity between organ systems, which can be represented graphically in a network map. Disruption of this system connectivity is associated with mortality in life-threatening acute illnesses, demonstrated by a network approach. However, this approach has not been applied to chronic multisystem diseases and may be more reliable than conventional individual organ prognostic scoring methods. Cirrhosis is a chronic disease of the liver with multisystem involvement. Development of an efficient model for prediction of mortality in cirrhosis requires a profound understanding of the pathophysiologic processes that lead to poor prognosis. In the present study, we use a network approach to evaluate the differences in organ system connectivity between survivors and non-survivors in a group of well-characterized patients with cirrhosis.

METHODS

201 patients with cirrhosis originally referred to the Clinic five at the University Hospital of Padova, with 13 clinical variables available representing hepatic, metabolic, haematopoietic, immune, neural and renal organ systems were retrospectively enrolled and followed up for 3, 6, and 12 months. Software was designed to compute the correlation network maps of organ system interaction in survivors and non-survivors using analysis indices: A. Bonferroni corrected Pearson's correlation coefficient and B. Mutual Information. Network structure was quantitatively evaluated using the measures of edges, average degree of connectivity and closeness, and qualitatively using clinical significance. Pair-matching was also implemented as a further step after initial general analysis to control for sample size and Model for End-Stage Liver Disease (MELD-Na) score between the groups.

RESULTS

There was a higher number of significant correlations in survivors, as indicated by both the analysis indices of Bonferroni corrected Pearson's correlation coefficient and the Mutual Information analysis. The number of edges, average degree of connectivity and closeness were significantly higher in survivors compared to non-survivors group. Pair-matching for MELD-Na was also associated with increased connectivity in survivors compared to non-survivors over 3 and 6 months follow up.

CONCLUSION

This study demonstrates the application of a network approach in evaluating functional connectivity of organ systems in liver cirrhosis, demonstrating a significant degree of network disruption in organ systems in non-survivors. Network analysis of organ systems may provide insight in developing novel prognostic models for organ allocation in patients with cirrhosis.

Binary Expression Enhances Reliability of Messaging in Gene Networks

The promoter state of a gene and its expression levels are modulated by the amounts of transcription factors interacting with its regulatory regions. Hence, one may interpret a gene network as a communicating system in which the state of the promoter of a gene (the source) is communicated by the amounts of transcription factors that it expresses (the message) to modulate the state of the promoter and expression levels of another gene (the receptor). The reliability of the gene network dynamics can be quantified by Shannon's entropy of the message and the mutual information between the message and the promoter state. Here we consider a stochastic model for a binary gene and use its exact steady state solutions to calculate the entropy and mutual information. We show that a slow switching promoter with long and equally standing ON and OFF states maximizes the mutual information and reduces entropy. That is a binary gene expression regime generating a high variance message governed by a bimodal probability distribution with peaks of the same height. Our results indicate that Shannon's theory can be a powerful framework for understanding how bursty gene expression conciliates with the striking spatio-temporal precision exhibited in pattern formation of developing organisms.

Restricted information in a two-step cascade

A cell must sense extracellular and intracellular fluctuations and respond appropriately to survive for optimal cellular functioning. Accordingly, a cell builds up biochemical networks which can transduce information of extracellular and intracellular fluctuations accurately. We consider a generic two-step cascade as a model gene regulatory network containing three regulatory proteins S, X, and Y connected as S→X→Y. The intermediate node X is a stochastic variable, acts as an obstacle, and impedes the information flow from S to Y. We quantify the information that is restricted by X using the tools of information theory and term this as restricted information. In this context, we further propose two measurable quantities, restricted efficiency and information transfer efficiency. The former determines how efficiently X restricts the upstream information coming from S, while the latter computes the efficiency of X to pass the upstream information toward Y. We also quantify the information that is being uniquely transferred from X to Y, which determines the extent of the ability of X to act as a source of information. Our analysis shows that when the signal strength (or mean population of S, 〈s〉) is low, the intermediate X can carry forward the upstream information reliably as well, as it acts as a better source of information, thereby increasing the fidelity of the network. But at the high signal strength, X restricts most of the upstream information, and its ability to act as a source of information gets reduced. This leads to a loss of fidelity of the network.

Information processing by endoplasmic reticulum stress sensors

The unfolded protein response (UPR) is a collection of cellular feedback mechanisms that seek to maintain protein folding homeostasis in the endoplasmic reticulum (ER). When the ER is 'stressed', through either high protein folding demand or undersupply of chaperones and foldases, stress sensing proteins in the ER membrane initiate the UPR. Recently, experiments have indicated that these signalling molecules detect stress by being both sequestered by free chaperones and activated by free unfolded proteins. However, it remains unclear what advantage this bidirectional sensor control offers stressed cells. Here, we show that combining positive regulation of sensor activity by unfolded proteins with negative regulation by chaperones allows the sensor to make a more informative measurement of ER stress. The increase in the information capacity of the combined sensing mechanism stems from stretching of the active range of the sensor, at the cost of increased uncertainty due to the integration of multiple signals. These results provide a possible rationale for the evolution of the observed stress-sensing mechanism.

Optimal entrainment of circadian clocks in the presence of noise

Circadian clocks are biochemical oscillators that allow organisms to estimate the time of the day. These oscillators are inherently noisy due to the discrete nature of the reactants and the stochastic character of their interactions. To keep these oscillators in sync with the daily day-night rhythm in the presence of noise, circadian clocks must be coupled to the dark-light cycle. In this paper, we study the entrainment of phase oscillators as a function of the intrinsic noise in the system. Using stochastic simulations, we compute the optimal coupling strength, intrinsic frequency, and shape of the phase-response curve, that maximize the mutual information between the phase of the clock and time. We show that the optimal coupling strength and intrinsic frequency increase with the noise, but that the shape of the phase-response curve varies nonmonotonically with the noise: in the low-noise regime, it features a dead zone that increases in width as the noise increases, while in the high-noise regime, the width decreases with the noise. These results arise from a tradeoff between maximizing stability-noise suppression-and maximizing linearity of the input-output, i.e., time-phase, relation. We also show that three analytic approximations-the linear-noise approximation, the phase-averaging method, and linear-response theory-accurately describe different regimes of the coupling strength and the noise.

Interplay of synergy and redundancy in diamond motif

The formalism of partial information decomposition provides a number of independent components which altogether constitute the total information provided by the source variable(s) about the target variable(s). These non-overlapping terms are recognized as unique information, synergistic information, and redundant information. The metric of net synergy conceived as the difference between synergistic and redundant information is capable of detecting effective synergy, effective redundancy, and information independence among stochastic variables. The net synergy can be quantified using appropriate combinations of different Shannon mutual information terms. The utilization of the net synergy in network motifs with the nodes representing different biochemical species, involved in information sharing, uncovers rich store for exciting results. In the current study, we use this formalism to obtain a comprehensive understanding of the relative information processing mechanism in a diamond motif and two of its sub-motifs, namely, bifurcation and integration motif embedded within the diamond motif. The emerging patterns of effective synergy and effective redundancy and their contribution toward ensuring high fidelity information transmission are duly compared in the sub-motifs. Investigation on the metric of net synergy in independent bifurcation and integration motifs are also executed. In all of these computations, the crucial roles played by various systemic time scales, activation coefficients, and signal integration mechanisms at the output of the network topologies are especially emphasized. Following this plan of action, we become confident that the origin of effective synergy and effective redundancy can be architecturally justified by decomposing a diamond motif into bifurcation and integration motif. According to our conjecture, the presence of a common source of fluctuations creates effective redundancy. Our calculations reveal that effective redundancy empowers signal fidelity. Moreover, to achieve this, input signaling species avoids strong interaction with downstream intermediates. This strategy is capable of making the diamond motif noise-tolerant. Apart from the topological features, our study also puts forward the active contribution of additive and multiplicative signal integration mechanisms to nurture effective redundancy and effective synergy.

Statistics of optimal information flow in ensembles of regulatory motifs

Genetic regulatory circuits universally cope with different sources of noise that limit their ability to coordinate input and output signals. In many cases, optimal regulatory performance can be thought to correspond to configurations of variables and parameters that maximize the mutual information between inputs and outputs. Since the mid-2000s, such optima have been well characterized in several biologically relevant cases. Here we use methods of statistical field theory to calculate the statistics of the maximal mutual information (the "capacity") achievable by tuning the input variable only in an ensemble of regulatory motifs, such that a single controller regulates N targets. Assuming (i) sufficiently large N, (ii) quenched random kinetic parameters, and (iii) small noise affecting the input-output channels, we can accurately reproduce numerical simulations both for the mean capacity and for the whole distribution. Our results provide insight into the inherent variability in effectiveness occurring in regulatory systems with heterogeneous kinetic parameters.

Optimal information transfer in enzymatic networks: A field theoretic formulation

Signaling in enzymatic networks is typically triggered by environmental fluctuations, resulting in a series of stochastic chemical reactions, leading to corruption of the signal by noise. For example, information flow is initiated by binding of extracellular ligands to receptors, which is transmitted through a cascade involving kinase-phosphatase stochastic chemical reactions. For a class of such networks, we develop a general field-theoretic approach to calculate the error in signal transmission as a function of an appropriate control variable. Application of the theory to a simple push-pull network, a module in the kinase-phosphatase cascade, recovers the exact results for error in signal transmission previously obtained using umbral calculus [Hinczewski and Thirumalai, Phys. Rev. X 4, 041017 (2014)2160-330810.1103/PhysRevX.4.041017]. We illustrate the generality of the theory by studying the minimal errors in noise reduction in a reaction cascade with two connected push-pull modules. Such a cascade behaves as an effective three-species network with a pseudointermediate. In this case, optimal information transfer, resulting in the smallest square of the error between the input and output, occurs with a time delay, which is given by the inverse of the decay rate of the pseudointermediate. Surprisingly, in these examples the minimum error computed using simulations that take nonlinearities and discrete nature of molecules into account coincides with the predictions of a linear theory. In contrast, there are substantial deviations between simulations and predictions of the linear theory in error in signal propagation in an enzymatic push-pull network for a certain range of parameters. Inclusion of second-order perturbative corrections shows that differences between simulations and theoretical predictions are minimized. Our study establishes that a field theoretic formulation of stochastic biological signaling offers a systematic way to understand error propagation in networks of arbitrary complexity.

On the role of topology in regulating transcriptional cascades

Topology of interactions in a transcriptional cascade determines the behavior of its signal-response profile and the activation states of genes.

Beyond the French Flag Model: Exploiting Spatial and Gene Regulatory Interactions for Positional Information

A crucial step in the early development of multicellular organisms involves the establishment of spatial patterns of gene expression which later direct proliferating cells to take on different cell fates. These patterns enable the cells to infer their global position within a tissue or an organism by reading out local gene expression levels. The patterning system is thus said to encode positional information, a concept that was formalized recently in the framework of information theory. Here we introduce a toy model of patterning in one spatial dimension, which can be seen as an extension of Wolpert’s paradigmatic “French Flag” model, to patterning by several interacting, spatially coupled genes subject to intrinsic and extrinsic noise. Our model, a variant of an Ising spin system, allows us to systematically explore expression patterns that optimally encode positional information. We find that optimal patterning systems use positional cues, as in the French Flag model, together with gene-gene interactions to generate combinatorial codes for position which we call “Counter” patterns. Counter patterns can also be stabilized against noise and variations in system size or morphogen dosage by longer-range spatial interactions of the type invoked in the Turing model. The simple setup proposed here qualitatively captures many of the experimentally observed properties of biological patterning systems and allows them to be studied in a single, theoretically consistent framework.

Fluctuation sensitivity of a transcriptional signaling cascade

The internal biochemical state of a cell is regulated by a vast transcriptional network that kinetically correlates the concentrations of numerous proteins. Fluctuations in protein concentration that encode crucial information about this changing state must compete with fluctuations caused by the noisy cellular environment in order to successfully transmit information across the network. Oftentimes, one protein must regulate another through a sequence of intermediaries, and conventional wisdom, derived from the data processing inequality of information theory, leads us to expect that longer sequences should lose more information to noise. Using the metric of mutual information to characterize the fluctuation sensitivity of transcriptional signaling cascades, we find, counter to this expectation, that longer chains of regulatory interactions can instead lead to enhanced informational efficiency. We derive an analytic expression for the mutual information from a generalized chemical kinetics model that we reduce to simple, mass-action kinetics by linearizing for small fluctuations about the basal biological steady state, and we find that at long times this expression depends only on a simple ratio of protein production to destruction rates and the length of the cascade. We place bounds on the values of these parameters by requiring that the mutual information be at least one bit-otherwise, any received signal would be indistinguishable from noise-and we find not only that nature has devised a way to circumvent the data processing inequality, but that it must be circumvented to attain this one-bit threshold. We demonstrate how this result places informational and biochemical efficiency at odds with one another by correlating high transcription factor binding affinities with low informational output, and we conclude with an analysis of the validity of our assumptions and propose how they might be tested experimentally.

Effects of receptor correlations on molecular information transmission

Cells measure concentrations of external ligands by capturing ligand molecules with cell surface receptors. The numbers of molecules captured by different receptors co-vary because they depend on the same extrinsic ligand fluctuations. However, these numbers also counter-vary due to the intrinsic stochasticity of chemical processes because a single molecule randomly captured by a receptor cannot be captured by another. Such structure of receptor correlations is generally believed to lead to an increase in information about the external signal compared to the case of independent receptors. We analyze a solvable model of two molecular receptors and show that, contrary to this widespread expectation, the correlations have a small and negative effect on the information about the ligand concentration. Further, we show that measurements that average over multiple receptors are almost as informative as those that track the states of every individual one.

Information processing by simple molecular motifs and susceptibility to noise

Biological organisms rely on their ability to sense and respond appropriately to their environment. The molecular mechanisms that facilitate these essential processes are however subject to a range of random effects and stochastic processes, which jointly affect the reliability of information transmission between receptors and, for example, the physiological downstream response. Information is mathematically defined in terms of the entropy; and the extent of information flowing across an information channel or signalling system is typically measured by the 'mutual information', or the reduction in the uncertainty about the output once the input signal is known. Here, we quantify how extrinsic and intrinsic noise affects the transmission of simple signals along simple motifs of molecular interaction networks. Even for very simple systems, the effects of the different sources of variability alone and in combination can give rise to bewildering complexity. In particular, extrinsic variability is apt to generate 'apparent' information that can, in extreme cases, mask the actual information that for a single system would flow between the different molecular components making up cellular signalling pathways. We show how this artificial inflation in apparent information arises and how the effects of different types of noise alone and in combination can be understood.

Redundancy in information transmission in a two-step cascade

We present a stochastic framework to study signal transmission in a generic two-step cascade S→X→Y. Starting from a set of Langevin equations obeying Gaussian noise processes we calculate the variance and covariance while considering both linear and nonlinear production terms for different biochemical species of the cascade. These quantities are then used to calculate the net synergy within the purview of partial information decomposition. We show that redundancy in information transmission is essentially an important consequence of Markovian property of the two-step cascade motif. We also show that redundancy increases fidelity of the signaling pathway.

Information processing in bacteria: memory, computation, and statistical physics: a key issues review

Living systems have to constantly sense their external environment and adjust their internal state in order to survive and reproduce. Biological systems, from as complex as the brain to a single E. coli cell, have to process these data in order to make appropriate decisions. How do biological systems sense external signals? How do they process the information? How do they respond to signals? Through years of intense study by biologists, many key molecular players and their interactions have been identified in different biological machineries that carry out these signaling functions. However, an integrated, quantitative understanding of the whole system is still lacking for most cellular signaling pathways, not to say the more complicated neural circuits. To study signaling processes in biology, the key thing to measure is the input-output relationship. The input is the signal itself, such as chemical concentration, external temperature, light (intensity and frequency), and more complex signals such as the face of a cat. The output can be protein conformational changes and covalent modifications (phosphorylation, methylation, etc), gene expression, cell growth and motility, as well as more complex output such as neuron firing patterns and behaviors of higher animals. Due to the inherent noise in biological systems, the measured input-output dependence is often noisy. These noisy data can be analysed by using powerful tools and concepts from information theory such as mutual information, channel capacity, and the maximum entropy hypothesis. This information theory approach has been successfully used to reveal the underlying correlations between key components of biological networks, to set bounds for network performance, and to understand possible network architecture in generating observed correlations. Although the information theory approach provides a general tool in analysing noisy biological data and may be used to suggest possible network architectures in preserving information, it does not reveal the underlying mechanism that leads to the observed input-output relationship, nor does it tell us much about which information is important for the organism and how biological systems use information to carry out specific functions. To do that, we need to develop models of the biological machineries, e.g. biochemical networks and neural networks, to understand the dynamics of biological information processes. This is a much more difficult task. It requires deep knowledge of the underlying biological network-the main players (nodes) and their interactions (links)-in sufficient detail to build a model with predictive power, as well as quantitative input-output measurements of the system under different perturbations (both genetic variations and different external conditions) to test the model predictions to guide further development of the model. Due to the recent growth of biological knowledge thanks in part to high throughput methods (sequencing, gene expression microarray, etc) and development of quantitative in vivo techniques such as various florescence technology, these requirements are starting to be realized in different biological systems. The possible close interaction between quantitative experimentation and theoretical modeling has made systems biology an attractive field for physicists interested in quantitative biology. In this review, we describe some of the recent work in developing a quantitative predictive model of bacterial chemotaxis, which can be considered as the hydrogen atom of systems biology. Using statistical physics approaches, such as the Ising model and Langevin equation, we study how bacteria, such as E. coli, sense and amplify external signals, how they keep a working memory of the stimuli, and how they use these data to compute the chemical gradient. In particular, we will describe how E. coli cells avoid cross-talk in a heterogeneous receptor cluster to keep a ligand-specific memory. We will also study the thermodynamic costs of adaptation for cells to maintain an accurate memory. The statistical physics based approach described here should be useful in understanding design principles for cellular biochemical circuits in general.

Extending the dynamic range of transcription factor action by translational regulation

A crucial step in the regulation of gene expression is binding of transcription factor (TF) proteins to regulatory sites along the DNA. But transcription factors act at nanomolar concentrations, and noise due to random arrival of these molecules at their binding sites can severely limit the precision of regulation. Recent work on the optimization of information flow through regulatory networks indicates that the lower end of the dynamic range of concentrations is simply inaccessible, overwhelmed by the impact of this noise. Motivated by the behavior of homeodomain proteins, such as the maternal morphogen Bicoid in the fruit fly embryo, we suggest a scheme in which transcription factors also act as indirect translational regulators, binding to the mRNA of other regulatory proteins. Intuitively, each mRNA molecule acts as an independent sensor of the input concentration, and averaging over these multiple sensors reduces the noise. We analyze information flow through this scheme and identify conditions under which it outperforms direct transcriptional regulation. Our results suggest that the dual role of homeodomain proteins is not just a historical accident, but a solution to a crucial physics problem in the regulation of gene expression.

Optimal Prediction by Cellular Signaling Networks

Living cells can enhance their fitness by anticipating environmental change. We study how accurately linear signaling networks in cells can predict future signals. We find that maximal predictive power results from a combination of input-noise suppression, linear extrapolation, and selective readout of correlated past signal values. Single-layer networks generate exponential response kernels, which suffice to predict Markovian signals optimally. Multilayer networks allow oscillatory kernels that can optimally predict non-Markovian signals. At low noise, these kernels exploit the signal derivative for extrapolation, while at high noise, they capitalize on signal values in the past that are strongly correlated with the future signal. We show how the common motifs of negative feedback and incoherent feed-forward can implement these optimal response functions. Simulations reveal that E. coli can reliably predict concentration changes for chemotaxis, and that the integration time of its response kernel arises from a trade-off between rapid response and noise suppression.

The Impact of Different Sources of Fluctuations on Mutual Information in Biochemical Networks

Stochastic fluctuations in signaling and gene expression limit the ability of cells to sense the state of their environment, transfer this information along cellular pathways, and respond to it with high precision. Mutual information is now often used to quantify the fidelity with which information is transmitted along a cellular pathway. Mutual information calculations from experimental data have mostly generated low values, suggesting that cells might have relatively low signal transmission fidelity. In this work, we demonstrate that mutual information calculations might be artificially lowered by cell-to-cell variability in both initial conditions and slowly fluctuating global factors across the population. We carry out our analysis computationally using a simple signaling pathway and demonstrate that in the presence of slow global fluctuations, every cell might have its own high information transmission capacity but that population averaging underestimates this value. We also construct a simple synthetic transcriptional network and demonstrate using experimental measurements coupled to computational modeling that its operation is dominated by slow global variability, and hence that its mutual information is underestimated by a population averaged calculation.

This work demonstrates how different sources of variability within biochemical networks impact the interpretation of information transmission. These sources are the intrinsic noise generated within the pathway of a single cell, variability due to initial conditions and/or global parameters across the population. A theoretical analysis of a simple signaling pathway and experimental exploration of a synthetic circuit are used to discuss the contributions of these sources of variability to information transmission using mutual information as a metric.

Limits on information transduction through amplitude and frequency regulation of transcription factor activity

Signaling pathways often transmit multiple signals through a single shared transcription factor (TF) and encode signal information by differentially regulating TF dynamics. However, signal information will be lost unless it can be reliably decoded by downstream genes. To understand the limits on dynamic information transduction, we apply information theory to quantify how much gene expression information the yeast TF Msn2 can transduce to target genes in the amplitude or frequency of its activation dynamics. We find that although the amount of information transmitted by Msn2 to single target genes is limited, information transduction can be increased by modulating promoter cis-elements or by integrating information from multiple genes. By correcting for extrinsic noise, we estimate an upper bound on information transduction. Overall, we find that information transduction through amplitude and frequency regulation of Msn2 is limited to error-free transduction of signal identity, but not signal intensity information.

Modelling the heart as a communication system

Electrical communication between cardiomyocytes can be perturbed during arrhythmia, but these perturbations are not captured by conventional electrocardiographic metrics. We developed a theoretical framework to quantify electrical communication using information theory metrics in two-dimensional cell lattice models of cardiac excitation propagation. The time series generated by each cell was coarse-grained to 1 when excited or 0 when resting. The Shannon entropy for each cell was calculated from the time series during four clinically important heart rhythms: normal heartbeat, anatomical reentry, spiral reentry and multiple reentry. We also used mutual information to perform spatial profiling of communication during these cardiac arrhythmias. We found that information sharing between cells was spatially heterogeneous. In addition, cardiac arrhythmia significantly impacted information sharing within the heart. Entropy localized the path of the drifting core of spiral reentry, which could be an optimal target of therapeutic ablation. We conclude that information theory metrics can quantitatively assess electrical communication among cardiomyocytes. The traditional concept of the heart as a functional syncytium sharing electrical information cannot predict altered entropy and information sharing during complex arrhythmia. Information theory metrics may find clinical application in the identification of rhythm-specific treatments which are currently unmet by traditional electrocardiographic techniques.

Energy dissipation and noise correlations in biochemical sensing

To measure chemical concentrations, cells need to extract information from stochastic receptor signals via signaling networks which are also inherently stochastic. Here, we study how the accuracy of sensing depends on the correlations between these extrinsic and intrinsic sources of noise. We find that the sensing precision of signaling networks that are not driven out of equilibrium is fundamentally limited by the fluctuation-dissipation theorem, which generates a tradeoff between the removal of extrinsic and intrinsic noise. As a result, the sensing precision of equilibrium systems is limited by the number of receptors; the downstream network can never improve sensing. To lift the tradeoff, energy dissipation is essential. This allows the receptor to transduce the signal as a catalyst and enables time integration of the receptor state. To beat the sensing limit of equilibrium systems, a canonical nonequilibrium signaling network based on the push-pull motif needs to dissipate at least 1k_{B}T per receptor.

Noise and information transmission in promoters with multiple internal States

Based on the measurements of noise in gene expression performed during the past decade, it has become customary to think of gene regulation in terms of a two-state model, where the promoter of a gene can stochastically switch between an ON and an OFF state. As experiments are becoming increasingly precise and the deviations from the two-state model start to be observable, we ask about the experimental signatures of complex multistate promoters, as well as the functional consequences of this additional complexity. In detail, we i), extend the calculations for noise in gene expression to promoters described by state transition diagrams with multiple states, ii), systematically compute the experimentally accessible noise characteristics for these complex promoters, and iii), use information theory to evaluate the channel capacities of complex promoter architectures and compare them with the baseline provided by the two-state model. We find that adding internal states to the promoter generically decreases channel capacity, except in certain cases, three of which (cooperativity, dual-role regulation, promoter cycling) we analyze in detail.

Information theory and signal transduction systems: from molecular information processing to network inference

Sensing and responding to the environment are two essential functions that all biological organisms need to master for survival and successful reproduction. Developmental processes are marshalled by a diverse set of signalling and control systems, ranging from systems with simple chemical inputs and outputs to complex molecular and cellular networks with non-linear dynamics. Information theory provides a powerful and convenient framework in which such systems can be studied; but it also provides the means to reconstruct the structure and dynamics of molecular interaction networks underlying physiological and developmental processes. Here we supply a brief description of its basic concepts and introduce some useful tools for systems and developmental biologists. Along with a brief but thorough theoretical primer, we demonstrate the wide applicability and biological application-specific nuances by way of different illustrative vignettes. In particular, we focus on the characterisation of biological information processing efficiency, examining cell-fate decision making processes, gene regulatory network reconstruction, and efficient signal transduction experimental design.

Cellular noise and information transmission

The technological revolution in biological research, and in particular the use of molecular fluorescent labels, has allowed investigation of heterogeneity of cellular responses to stimuli on the single cell level. Computational, theoretical, and synthetic biology advances have allowed predicting and manipulating this heterogeneity with an exquisite precision previously reserved only for physical sciences. Functionally, this cell-to-cell variability can compromise cellular responses to environmental signals, and it can also enlarge the repertoire of possible cellular responses and hence increase the adaptive nature of cellular behaviors. And yet quantification of the functional importance of this response heterogeneity remained elusive. Recently the mathematical language of information theory has been proposed to address this problem. This opinion reviews the recent advances and discusses the broader implications of using information-theoretic tools to characterize heterogeneity of cellular behaviors.

Multiplexing oscillatory biochemical signals

In recent years it has been increasingly recognized that biochemical signals are not necessarily constant in time and that the temporal dynamics of a signal can be the information carrier. Moreover, it is now well established that the protein signaling network of living cells has a bow-tie structure and that components are often shared between different signaling pathways. Here we show by mathematical modeling that living cells can multiplex a constant and an oscillatory signal: they can transmit these two signals simultaneously through a common signaling pathway, and yet respond to them specifically and reliably. We find that information transmission is reduced not only by noise arising from the intrinsic stochasticity of biochemical reactions, but also by crosstalk between the different channels. Yet, under biologically relevant conditions more than 2 bits of information can be transmitted per channel, even when the two signals are transmitted simultaneously. These observations suggest that oscillatory signals are ideal for multiplexing signals.

A network characteristic that correlates environmental and genetic robustness

As scientific advances in perturbing biological systems and technological advances in data acquisition allow the large-scale quantitative analysis of biological function, the robustness of organisms to both transient environmental stresses and inter-generational genetic changes is a fundamental impediment to the identifiability of mathematical models of these functions. An approach to overcoming this impediment is to reduce the space of possible models to take into account both types of robustness. However, the relationship between the two is still controversial. This work uncovers a network characteristic, transient responsiveness, for a specific function that correlates environmental imperturbability and genetic robustness. We test this characteristic extensively for dynamic networks of ordinary differential equations ranging up to 30 interacting nodes and find that there is a power-law relating environmental imperturbability and genetic robustness that tends to linearity as the number of nodes increases. Using our methods, we refine the classification of known 3-node motifs in terms of their environmental and genetic robustness. We demonstrate our approach by applying it to the chemotaxis signaling network. In particular, we investigate plausible models for the role of CheV protein in biochemical adaptation via a phosphorylation pathway, testing modifications that could improve the robustness of the system to environmental and/or genetic perturbation.

Advances in the ways that living systems can be perturbed in order to study how they function and sharp reductions in the cost of computer resources have allowed the collection of large amounts of data. The aim of biological system modeling is to analyze this data in order to pin down the precise interactions of molecules that underlie the observed functions. This is made difficult due to two features of biological systems: (1) Living things do not show an appreciable loss of function across large ranges of environmental factors. (2) Their function is inherited from parent to child more or less unchanged in spite of random mutations in genetic sequences. We find that these two features are more correlated in a specific subset of networks and show how to use this observation to find networks in which these two features appear together. Working within this smaller space of networks may make it easier to find suitable underlying models from data.

Noise in biology

Noise permeates biology on all levels, from the most basic molecular, sub-cellular processes to the dynamics of tissues, organs, organisms and populations. The functional roles of noise in biological processes can vary greatly. Along with standard, entropy-increasing effects of producing random mutations, diversifying phenotypes in isogenic populations, limiting information capacity of signaling relays, it occasionally plays more surprising constructive roles by accelerating the pace of evolution, providing selective advantage in dynamic environments, enhancing intracellular transport of biomolecules and increasing information capacity of signaling pathways. This short review covers the recent progress in understanding mechanisms and effects of fluctuations in biological systems of different scales and the basic approaches to their mathematical modeling.

Positional information, in bits

Cells in a developing embryo have no direct way of "measuring" their physical position. Through a variety of processes, however, the expression levels of multiple genes come to be correlated with position, and these expression levels thus form a code for "positional information." We show how to measure this information, in bits, using the gap genes in the Drosophila embryo as an example. Individual genes carry nearly two bits of information, twice as much as would be expected if the expression patterns consisted only of on/off domains separated by sharp boundaries. Taken together, four gap genes carry enough information to define a cell's location with an error bar of ~1 along the anterior/posterior axis of the embryo. This precision is nearly enough for each cell to have a unique identity, which is the maximum information the system can use, and is nearly constant along the length of the embryo. We argue that this constancy is a signature of optimality in the transmission of information from primary morphogen inputs to the output of the gap gene network.

The impact of age on oncogenic potential: tumor-initiating cells and the brain microenvironment

Paradoxically, aging leads to both decreased regenerative capacity in the brain and an increased risk of tumorigenesis, particularly the most common adult-onset brain tumor, glioma. A shared factor contributing to both phenomena is thought to be age-related alterations in neural progenitor cells (NPCs), which function normally to produce new neurons and glia, but are also considered likely cells of origin for malignant glioma. Upon oncogenic transformation, cells acquire characteristics known as the hallmarks of cancer, including unlimited replication, altered responses to growth and anti-growth factors, increased capacity for angiogenesis, potential for invasion, genetic instability, apoptotic evasion, escape from immune surveillance, and an adaptive metabolic phenotype. The precise molecular pathogenesis and temporal acquisition of these malignant characteristics is largely a mystery. Recent studies characterizing NPCs during normal aging, however, have begun to elucidate mechanisms underlying the age-associated increase in their malignant potential. Aging cells are dependent upon multiple compensatory pathways to maintain cell cycle control, normal niche interactions, genetic stability, programmed cell death, and oxidative metabolism. A few multi-functional proteins act as 'critical nodes' in the coordination of these various cellular activities, although both intracellular signaling and elements within the brain environment are critical to maintaining a balance between senescence and tumorigenesis. Here, we provide an overview of recent progress in our understanding of how mechanisms underlying cellular aging inform on glioma pathogenesis and malignancy.

Decisions on the fly in cellular sensory systems

Cells send and receive signals through pathways that have been defined in great detail biochemically, and it is often presumed that the signals convey only level information. Cell signaling in the presence of noise is extensively studied but only rarely is the speed required to make a decision considered. However, in the immune system, rapidly developing embryos, and cellular response to stress, fast and accurate actions are required. Statistical theory under the rubric of "exploit-explore" quantifies trade-offs between decision speed and accuracy and supplies rigorous performance bounds and algorithms that realize them. We show that common protein phosphorylation networks can implement optimal decision theory algorithms and speculate that the ubiquitous chemical modifications to receptors during signaling actually perform analog computations. We quantify performance trade-offs when the cellular system has incomplete knowledge of the data model. For the problem of sensing the time when the composition of a ligand mixture changes, we find a nonanalytic dependence on relative concentrations and specify the number of parameters needed for near-optimal performance and how to adjust them. The algorithms specify the minimal computation that has to take place on a single receptor before the information is pooled across the cell.

Evolution of transcription networks in response to temporal fluctuations

Organisms respond to changes in their environment over a wide range of biological and temporal scales. Such phenotypic plasticity can involve developmental, behavioral, physiological, and genetic shifts. The adaptive value of a plastic response is known to depend on the nature of the information that is available to the organism as well as the direct and indirect costs of the plastic response. We modeled the dynamic process of simple gene regulatory networks as they responded to temporal fluctuations in environmental conditions. We simulated the evolution of networks to determine when genes that function solely as transcription factors, with no direct function of their own, are beneficial to the function of the network. When there is perfect information about the environment and there is no timing information to be extracted then there is no advantage to adding pure transcription factor genes to the network. In contrast, when there is either timing information that can be extracted or only indirect information about the current state of the environment then additional transcription factor genes improve the evolved network fitness.

Fundamental limits on sensing chemical concentrations with linear biochemical networks

Living cells often need to extract information from biochemical signals that are noisy. We study how accurately cells can measure chemical concentrations with signaling networks that are linear. For stationary signals of long duration, they can reach, but not beat, the Berg-Purcell limit, which relies on uniformly averaging in time the fluctuations in the input signal. For short times or nonstationary signals, however, they can beat the Berg-Purcell limit, by nonuniformly time averaging the input. We derive the optimal weighting function for time averaging and use it to provide the fundamental limit of measuring chemical concentrations with linear signaling networks.

Systems biology. How information theory handles cell signaling and uncertainty

Information theory allows analyses of cell signaling capabilities without necessarily requiring detailed knowledge of the signaling networks.

Observations of calcium dynamics in cortical secretory vesicles

Calcium (Ca(2+)) dynamics were evaluated in fluorescently labeled sea urchin secretory vesicles using confocal microscopy. 71% of the vesicles examined exhibited one or more transient increases in the fluorescence signal that was damped in time. The detection of transient increases in signal was dependent upon the affinity of the fluorescence indicator; the free Ca(2+) concentration in the secretory vesicles was estimated to be in the range of ∼10 to 100 μM. Non-linear stochastic analysis revealed the presence of extra variance in the Ca(2+) dependent fluorescence signal. This noise process increased linearly with the amplitude of the Ca(2+) signal. Both the magnitude and spatial properties of this noise process were dependent upon the activity of vesicle p-type (Ca(v)2.1) Ca(2+) channels. Blocking the p-type Ca(2+) channels with ω-agatoxin decreased signal variance, and altered the spatial noise pattern within the vesicle. These fluorescence signal properties are consistent with vesicle Ca(2+) dynamics and not simply due to obvious physical properties such as gross movement artifacts or pH driven changes in Ca(2+) indicator fluorescence. The results suggest that the free Ca(2+) content of cortical secretory vesicles is dynamic; this property may modulate the exocytotic fusion process.

Feed-forward loops and diamond motifs lead to tunable transmission of information in the frequency domain

Using a Gaussian model, we study the transmission of time-varying biochemical signals through feed-forward motifs and diamond motifs. To this end, we compute the frequency dependence of the gain, the noise, as well as their ratio, the gain-to-noise ratio, which measures how reliably a network transmits signals at different frequencies. We find that both coherent and incoherent feed-forward motifs can either act as low-pass or high-pass filters for information: The frequency dependence of the gain-to-noise ratio increases or decreases with increasing frequency, respectively. Our analysis of diamond motifs reveals that cooperative activation of the output component can increase the gain-to-noise ratio. This means that from the perspective of information transmission, it can be beneficial to split the input signal in two and recombine the two propagated signals at the output. Cooperative activation can be implemented via the formation of homo- or heteromultimers that then bind and activate the output component or via the binding of individual molecules of the intermediate species to the output component.

The slow-scale linear noise approximation: an accurate, reduced stochastic description of biochemical networks under timescale separation conditions

BACKGROUND

It is well known that the deterministic dynamics of biochemical reaction networks can be more easily studied if timescale separation conditions are invoked (the quasi-steady-state assumption). In this case the deterministic dynamics of a large network of elementary reactions are well described by the dynamics of a smaller network of effective reactions. Each of the latter represents a group of elementary reactions in the large network and has associated with it an effective macroscopic rate law. A popular method to achieve model reduction in the presence of intrinsic noise consists of using the effective macroscopic rate laws to heuristically deduce effective probabilities for the effective reactions which then enables simulation via the stochastic simulation algorithm (SSA). The validity of this heuristic SSA method is a priori doubtful because the reaction probabilities for the SSA have only been rigorously derived from microscopic physics arguments for elementary reactions.

RESULTS

We here obtain, by rigorous means and in closed-form, a reduced linear Langevin equation description of the stochastic dynamics of monostable biochemical networks in conditions characterized by small intrinsic noise and timescale separation. The slow-scale linear noise approximation (ssLNA), as the new method is called, is used to calculate the intrinsic noise statistics of enzyme and gene networks. The results agree very well with SSA simulations of the non-reduced network of elementary reactions. In contrast the conventional heuristic SSA is shown to overestimate the size of noise for Michaelis-Menten kinetics, considerably under-estimate the size of noise for Hill-type kinetics and in some cases even miss the prediction of noise-induced oscillations.

CONCLUSIONS

A new general method, the ssLNA, is derived and shown to correctly describe the statistics of intrinsic noise about the macroscopic concentrations under timescale separation conditions. The ssLNA provides a simple and accurate means of performing stochastic model reduction and hence it is expected to be of widespread utility in studying the dynamics of large noisy reaction networks, as is common in computational and systems biology.