Feed-forward loops and diamond motifs lead to tunable transmission of information in the frequency domain

Information content and optimization of self-organized developmental systems

A key feature of many developmental systems is their ability to self-organize spatial patterns of functionally distinct cell fates. To ensure proper biological function, such patterns must be established reproducibly, by controlling and even harnessing intrinsic and extrinsic fluctuations. While the relevant molecular processes are increasingly well understood, we lack a principled framework to quantify the performance of such stochastic self-organizing systems. To that end, we introduce an information-theoretic measure for self-organized fate specification during embryonic development. We show that the proposed measure assesses the total information content of fate patterns and decomposes it into interpretable contributions corresponding to the positional and correlational information. By optimizing the proposed measure, our framework provides a normative theory for developmental circuits, which we demonstrate on lateral inhibition, cell type proportioning, and reaction-diffusion models of self-organization. This paves a way toward a classification of developmental systems based on a common information-theoretic language, thereby organizing the zoo of implicated chemical and mechanical signaling processes.

Synthetic gene networks recapitulate dynamic signal decoding and differential gene expression

Cells live in constantly changing environments and employ dynamic signaling pathways to transduce information about the signals they encounter. However, the mechanisms by which dynamic signals are decoded into appropriate gene expression patterns remain poorly understood. Here, we devise networked optogenetic pathways that achieve dynamic signal processing functions that recapitulate cellular information processing. Exploiting light-responsive transcriptional regulators with differing response kinetics, we build a falling edge pulse detector and show that this circuit can be employed to demultiplex dynamically encoded signals. We combine this demultiplexer with dCas9-based gene networks to construct pulsatile signal filters and decoders. Applying information theory, we show that dynamic multiplexing significantly increases the information transmission capacity from signal to gene expression state. Finally, we use dynamic multiplexing for precise multidimensional regulation of a heterologous metabolic pathway. Our results elucidate design principles of dynamic information processing and provide original synthetic systems capable of decoding complex signals for biotechnological applications.

Information transmission in a two-step cascade: interplay of activation and repression

We present an information-theoretic formalism to study signal transduction in four architectural variants of a model two-step cascade with increasing input population. Our results categorize these four types into two classes depending upon the effect of activation and repression on mutual information, net synergy, and signal-to-noise ratio. Using the Gaussian framework and linear noise approximation, we derive the analytic expressions for these metrics to establish their underlying relationships in terms of the biochemical parameters. We also verify our approximations through stochastic simulations.

Extrinsic noise of the target gene governs abundance pattern of feed-forward loop motifs

Feed-forward loop (FFL) is found to be a recurrent structure in bacterial and yeast gene transcription regulatory networks. In a generic FFL, transcription factor (TF) S regulates production of another TF X while both of these TFs regulate production of final gene-product Y. Depending upon the regulatory programs (activation or repression), FFLs are grouped into two broad classes: coherent (C) and incoherent (I), each class containing four distinct types (C1-C4 and I1-I4). These FFL types are experimentally observed to occur with varied frequencies, C1 and I1 being the abundant ones. Here we present a stochastic framework singling out the absolute value of the normalized covariance of X and Y to be the determining factor behind the abundance of FFLs while considering differential promoter activities of X and Y. Our theoretical construct employs two possible signal integration mechanisms (additive and multiplicative) to synthesize Y while steady-state population level of S remains fixed or becomes tunable reflecting two possible environmental signaling scenarios. Our model categorically points out that abundant FFLs exhibit higher amount of the designated metric which has a biophysical connotation of extrinsic noise for the target gene Y. Our predictions emanating from an overarching analytical expression utilizing biologically plausible parametric conditions are substantiated by stochastic simulation.

Role of integrated noise in pathway-specific signal propagation in feed-forward loops

Cells impose optimal noise control mechanism in diverse situations to cope with distinct environmental cues. Sometimes, it is desirable for the cell to utilize fluctuations for noise-driven processes. In other cases, noise can be harmful to the cell to show optimal fitness. It is, therefore, important to unravel the noise propagation mechanism inside the cell. Such noise controlling mechanism is accomplished by using gene transcription regulatory networks. One such gene regulatory network is feed-forward loop, having three regulatory nodes S, X and Y. Here, we consider the most abundant type 1 of coherent and incoherent feed-forward loops with both OR and AND logic functions, forming four different architectures. In OR logic function, the functions representing S and X act additively for the regulation of Y, while in AND logic function, the same functions (S and X) act multiplicatively for the regulation of Y. Measurement of susceptibility of the signal at output Y is done using elasticity of each regulation in FFLs. Using susceptibility, we demonstrate the nature of pathway integration by which one-step and two-step pathways get overlapped. The integration type is competitive for motifs having OR gate, while it is noncompetitive for the same with AND gate. The pathway integration property explains the output noise behavior of the motifs properly but cannot infer about the mechanism by which the upstream noise propagates to output. To account this, the total output noise is decomposed, which results in integrated noise as an additional noise source along with pathway-specific noise components. The integrated noise is found to appear as a consequence of integration between the pathways and has different functional characteristics explaining noise amplification and noise attenuation property of coherent and incoherent feed-forward loops, respectively. The noise decomposition also quantifies the contribution of different noise sources toward total noise. Finally, the noise propagation is being tuned as a function of input signal noise and its time scale of fluctuations, which shows considerable intrinsic noise strength and relatively slow relaxation time scale causes a higher degree of noise propagation in FFLs.

Coherent feed-forward loop acts as an efficient information transmitting motif

We present a theoretical formalism to study steady-state information transmission in a coherent type-1 feed-forward loop motif with an additive signal integration mechanism. Our construct allows a two-step cascade to be slowly transformed into a bifurcation network via a feed-forward loop, which is a prominent network motif. Using a Gaussian framework, we show that among these three network patterns, the feed-forward loop motif harnesses the maximum amount of Shannon mutual information fractions constructed between the final gene-product and each of the master and coregulators of the target gene. We also show that this feed-forward loop motif provides a substantially lower amount of noise in target gene expression, compared with the other two network structures. Our theoretical predictions, which remain invariant for a couple of parametric transformations, point out that the coherent type-1 feed-forward loop motif may qualify as a better decoder of environmental signals when compared with the other two network patterns in perspective.

Hierarchical and Dynamic Regulation of Defense-Responsive Specialized Metabolism by WRKY and MYB Transcription Factors

The plant kingdom produces hundreds of thousands of specialized bioactive metabolites, some with pharmaceutical and biotechnological importance. Their biosynthesis and function have been studied for decades, but comparatively less is known about how transcription factors with overlapping functions and contrasting regulatory activities coordinately control the dynamics and output of plant specialized metabolism. Here, we performed temporal studies on pathogen-infected intact host plants with perturbed transcription factors. We identified WRKY33 as the condition-dependent master regulator and MYB51 as the dual functional regulator in a hierarchical gene network likely responsible for the gene expression dynamics and metabolic fluxes in the camalexin and 4-hydroxy-indole-3-carbonylnitrile (4OH-ICN) pathways. This network may have also facilitated the regulatory capture of the newly evolved 4OH-ICN pathway in Arabidopsis thaliana by the more-conserved transcription factor MYB51. It has long been held that the plasticity of plant specialized metabolism and the canalization of development should be differently regulated; our findings imply a common hierarchical regulatory architecture orchestrated by transcription factors for specialized metabolism and development, making it an attractive target for metabolic engineering.

Dissipation in Non-Steady State Regulatory Circuits

In order to respond to environmental signals, cells often use small molecular circuits to transmit information about their surroundings. Recently, motivated by specific examples in signaling and gene regulation, a body of work has focused on the properties of circuits that function out of equilibrium and dissipate energy. We briefly review the probabilistic measures of information and dissipation and use simple models to discuss and illustrate trade-offs between information and dissipation in biological circuits. We find that circuits with non-steady state initial conditions can transmit more information at small readout delays than steady state circuits. The dissipative cost of this additional information proves marginal compared to the steady state dissipation. Feedback does not significantly increase the transmitted information for out of steady state circuits but does decrease dissipative costs. Lastly, we discuss the case of bursty gene regulatory circuits that, even in the fast switching limit, function out of equilibrium.

Multivariate information processing characterizes fitness of a cascaded gene-transcription machinery

We report that a genetic two-step activation cascade processes diverse flavors of information, e.g., synergy, redundancy, and unique information. Our computations measuring reduction in Shannon entropies and reduction in variances produce differently behaving absolute magnitudes of these informational flavors. We find that similarity can be brought in if these terms are evaluated in fractions with respect to corresponding total information. Each of the input signal and final gene-product is found to generate common or redundant information fractions (mostly) to predict each other, whereas they also complement one another to harness synergistic information fraction, predicting the intermediate biochemical species. For an optimally growing signal to maintain fixed steady-state abundance of activated downstream gene-products, the interaction information fractions for this cascade module shift from net-redundancy to information-independence.

Molecular Communications With Molecular Circuit-Based Transmitters and Receivers

The performance of a communication link can be improved by maximizing the mutual information between the input and output signals. This paper considers this maximization problem in a molecular communication link where both the transmitter and the receiver are molecular circuit. This general optimization is hard to solve. We simplify the problem by limiting to reactions with linear reaction rates and molecular circuits with a limited number of species. We derive an expression of mutual information and use it for numerical maximization. We show that our parameterized transmitter circuit is able to give mutual information that is close to upper bound obtained in our earlier work.

Optimal entrainment of circadian clocks in the presence of noise

Circadian clocks are biochemical oscillators that allow organisms to estimate the time of the day. These oscillators are inherently noisy due to the discrete nature of the reactants and the stochastic character of their interactions. To keep these oscillators in sync with the daily day-night rhythm in the presence of noise, circadian clocks must be coupled to the dark-light cycle. In this paper, we study the entrainment of phase oscillators as a function of the intrinsic noise in the system. Using stochastic simulations, we compute the optimal coupling strength, intrinsic frequency, and shape of the phase-response curve, that maximize the mutual information between the phase of the clock and time. We show that the optimal coupling strength and intrinsic frequency increase with the noise, but that the shape of the phase-response curve varies nonmonotonically with the noise: in the low-noise regime, it features a dead zone that increases in width as the noise increases, while in the high-noise regime, the width decreases with the noise. These results arise from a tradeoff between maximizing stability-noise suppression-and maximizing linearity of the input-output, i.e., time-phase, relation. We also show that three analytic approximations-the linear-noise approximation, the phase-averaging method, and linear-response theory-accurately describe different regimes of the coupling strength and the noise.

Interplay of synergy and redundancy in diamond motif

The formalism of partial information decomposition provides a number of independent components which altogether constitute the total information provided by the source variable(s) about the target variable(s). These non-overlapping terms are recognized as unique information, synergistic information, and redundant information. The metric of net synergy conceived as the difference between synergistic and redundant information is capable of detecting effective synergy, effective redundancy, and information independence among stochastic variables. The net synergy can be quantified using appropriate combinations of different Shannon mutual information terms. The utilization of the net synergy in network motifs with the nodes representing different biochemical species, involved in information sharing, uncovers rich store for exciting results. In the current study, we use this formalism to obtain a comprehensive understanding of the relative information processing mechanism in a diamond motif and two of its sub-motifs, namely, bifurcation and integration motif embedded within the diamond motif. The emerging patterns of effective synergy and effective redundancy and their contribution toward ensuring high fidelity information transmission are duly compared in the sub-motifs. Investigation on the metric of net synergy in independent bifurcation and integration motifs are also executed. In all of these computations, the crucial roles played by various systemic time scales, activation coefficients, and signal integration mechanisms at the output of the network topologies are especially emphasized. Following this plan of action, we become confident that the origin of effective synergy and effective redundancy can be architecturally justified by decomposing a diamond motif into bifurcation and integration motif. According to our conjecture, the presence of a common source of fluctuations creates effective redundancy. Our calculations reveal that effective redundancy empowers signal fidelity. Moreover, to achieve this, input signaling species avoids strong interaction with downstream intermediates. This strategy is capable of making the diamond motif noise-tolerant. Apart from the topological features, our study also puts forward the active contribution of additive and multiplicative signal integration mechanisms to nurture effective redundancy and effective synergy.

Improving the Capacity of Molecular Communication Using Enzymatic Reaction Cycles

This paper considers the capacity of a diffusion-based molecular communication link assuming the receiver uses chemical reactions. The key contribution is we show that enzymatic reaction cycles, which is a class of chemical reactions commonly found in cells consisting of a forward and a backward enzymatic reaction, can improve the capacity of the communication link. The technical difficulty in analyzing enzymatic reaction cycles is that their reaction rates are nonlinear. We deal with this by assuming that the amount of certain chemicals in the enzymatic reaction cycle is large. In order to simplify the problem further, we use singular perturbation to study a particular operating regime of the enzymatic reaction cycles. This allows us to derive a closed-form expression of the channel gain. This expression suggests that we can improve the channel gain by increasing the total amount of substrate in the enzymatic reaction cycle. By using numerical calculations, we show that the effect of the enzymatic reaction cycle is to increase the channel gain and to reduce the noise, which results in a better signal-to-noise ratio and in turn a higher communication capacity. Furthermore, we show that we can increase the capacity by increasing the total amount of substrate in the enzymatic reaction cycle.

Fluctuation sensitivity of a transcriptional signaling cascade

The internal biochemical state of a cell is regulated by a vast transcriptional network that kinetically correlates the concentrations of numerous proteins. Fluctuations in protein concentration that encode crucial information about this changing state must compete with fluctuations caused by the noisy cellular environment in order to successfully transmit information across the network. Oftentimes, one protein must regulate another through a sequence of intermediaries, and conventional wisdom, derived from the data processing inequality of information theory, leads us to expect that longer sequences should lose more information to noise. Using the metric of mutual information to characterize the fluctuation sensitivity of transcriptional signaling cascades, we find, counter to this expectation, that longer chains of regulatory interactions can instead lead to enhanced informational efficiency. We derive an analytic expression for the mutual information from a generalized chemical kinetics model that we reduce to simple, mass-action kinetics by linearizing for small fluctuations about the basal biological steady state, and we find that at long times this expression depends only on a simple ratio of protein production to destruction rates and the length of the cascade. We place bounds on the values of these parameters by requiring that the mutual information be at least one bit-otherwise, any received signal would be indistinguishable from noise-and we find not only that nature has devised a way to circumvent the data processing inequality, but that it must be circumvented to attain this one-bit threshold. We demonstrate how this result places informational and biochemical efficiency at odds with one another by correlating high transcription factor binding affinities with low informational output, and we conclude with an analysis of the validity of our assumptions and propose how they might be tested experimentally.

Redundancy in information transmission in a two-step cascade

We present a stochastic framework to study signal transmission in a generic two-step cascade S→X→Y. Starting from a set of Langevin equations obeying Gaussian noise processes we calculate the variance and covariance while considering both linear and nonlinear production terms for different biochemical species of the cascade. These quantities are then used to calculate the net synergy within the purview of partial information decomposition. We show that redundancy in information transmission is essentially an important consequence of Markovian property of the two-step cascade motif. We also show that redundancy increases fidelity of the signaling pathway.

Noise propagation with interlinked feed-forward pathways

Functionally similar pathways are often seen in biological systems, forming feed-forward controls. The robustness in network motifs such as feed-forward loops (FFLs) has been reported previously. In this work, we studied noise propagation in a development network that has multiple interlinked FFLs. A FFL has the potential of asymmetric noise-filtering (i.e., it works at either the “ON” or the “OFF” state in the target gene). With multiple, interlinked FFLs, we show that the propagated noises are largely filtered regardless of the states in the input genes. The noise-filtering property of an interlinked FFL can be largely derived from that of the individual FFLs, and with interlinked FFLs, it is possible to filter noises in both “ON” and “OFF” states in the output. We demonstrated the noise filtering effect in the developmental regulatory network of Caenorhabditis elegans that controls the timing of distal tip cell (DTC) migration. The roles of positive feedback loops involving blmp-1 and the degradation regulation of DRE-1 also studied. Our analyses allow for better inference from network structures to noise-filtering properties, and provide insights into the mechanisms behind the precise DTC migration controls in space and time.

Extending the dynamic range of transcription factor action by translational regulation

A crucial step in the regulation of gene expression is binding of transcription factor (TF) proteins to regulatory sites along the DNA. But transcription factors act at nanomolar concentrations, and noise due to random arrival of these molecules at their binding sites can severely limit the precision of regulation. Recent work on the optimization of information flow through regulatory networks indicates that the lower end of the dynamic range of concentrations is simply inaccessible, overwhelmed by the impact of this noise. Motivated by the behavior of homeodomain proteins, such as the maternal morphogen Bicoid in the fruit fly embryo, we suggest a scheme in which transcription factors also act as indirect translational regulators, binding to the mRNA of other regulatory proteins. Intuitively, each mRNA molecule acts as an independent sensor of the input concentration, and averaging over these multiple sensors reduces the noise. We analyze information flow through this scheme and identify conditions under which it outperforms direct transcriptional regulation. Our results suggest that the dual role of homeodomain proteins is not just a historical accident, but a solution to a crucial physics problem in the regulation of gene expression.

Non-monotonic dynamics and crosstalk in signaling pathways and their implications for pharmacology

Currently, drug discovery approaches commonly assume a monotonic dose-response relationship. However, the assumption of monotonicity is increasingly being challenged. Here we show that for two simple interacting linear signaling pathways that carry two different signals with different physiological responses, a non-monotonic input-output relation can arise with simple network topologies including coherent and incoherent feed-forward loops. We show that non-monotonicity of the response functions has severe implications for pharmacological treatment. Fundamental constraints are imposed on the effectiveness and toxicity of any drug independent of its chemical nature and selectivity due to the specific network structure.

Role of relaxation time scale in noisy signal transduction

Intra-cellular fluctuations, mainly triggered by gene expression, are an inevitable phenomenon observed in living cells. It influences generation of phenotypic diversity in genetically identical cells. Such variation of cellular components is beneficial in some contexts but detrimental in others. To quantify the fluctuations in a gene product, we undertake an analytical scheme for studying few naturally abundant linear as well as branched chain network motifs. We solve the Langevin equations associated with each motif under the purview of linear noise approximation and derive the expressions for Fano factor and mutual information in close analytical form. Both quantifiable expressions exclusively depend on the relaxation time (decay rate constant) and steady state population of the network components. We investigate the effect of relaxation time constraints on Fano factor and mutual information to indentify a time scale domain where a network can recognize the fluctuations associated with the input signal more reliably. We also show how input population affects both quantities. We extend our calculation to long chain linear motif and show that with increasing chain length, the Fano factor value increases but the mutual information processing capability decreases. In this type of motif, the intermediate components act as a noise filter that tune up input fluctuations and maintain optimum fluctuations in the output. For branched chain motifs, both quantities vary within a large scale due to their network architecture and facilitate survival of living system in diverse environmental conditions.

Systems biology. Accurate information transmission through dynamic biochemical signaling networks

Stochasticity inherent to biochemical reactions (intrinsic noise) and variability in cellular states (extrinsic noise) degrade information transmitted through signaling networks. We analyzed the ability of temporal signal modulation--that is, dynamics--to reduce noise-induced information loss. In the extracellular signal-regulated kinase (ERK), calcium (Ca(2+)), and nuclear factor kappa-B (NF-κB) pathways, response dynamics resulted in significantly greater information transmission capacities compared to nondynamic responses. Theoretical analysis demonstrated that signaling dynamics has a key role in overcoming extrinsic noise. Experimental measurements of information transmission in the ERK network under varying signal-to-noise levels confirmed our predictions and showed that signaling dynamics mitigate, and can potentially eliminate, extrinsic noise-induced information loss. By curbing the information-degrading effects of cell-to-cell variability, dynamic responses substantially increase the accuracy of biochemical signaling networks.

Noise and information transmission in promoters with multiple internal States

Based on the measurements of noise in gene expression performed during the past decade, it has become customary to think of gene regulation in terms of a two-state model, where the promoter of a gene can stochastically switch between an ON and an OFF state. As experiments are becoming increasingly precise and the deviations from the two-state model start to be observable, we ask about the experimental signatures of complex multistate promoters, as well as the functional consequences of this additional complexity. In detail, we i), extend the calculations for noise in gene expression to promoters described by state transition diagrams with multiple states, ii), systematically compute the experimentally accessible noise characteristics for these complex promoters, and iii), use information theory to evaluate the channel capacities of complex promoter architectures and compare them with the baseline provided by the two-state model. We find that adding internal states to the promoter generically decreases channel capacity, except in certain cases, three of which (cooperativity, dual-role regulation, promoter cycling) we analyze in detail.

Multiplexing oscillatory biochemical signals

In recent years it has been increasingly recognized that biochemical signals are not necessarily constant in time and that the temporal dynamics of a signal can be the information carrier. Moreover, it is now well established that the protein signaling network of living cells has a bow-tie structure and that components are often shared between different signaling pathways. Here we show by mathematical modeling that living cells can multiplex a constant and an oscillatory signal: they can transmit these two signals simultaneously through a common signaling pathway, and yet respond to them specifically and reliably. We find that information transmission is reduced not only by noise arising from the intrinsic stochasticity of biochemical reactions, but also by crosstalk between the different channels. Yet, under biologically relevant conditions more than 2 bits of information can be transmitted per channel, even when the two signals are transmitted simultaneously. These observations suggest that oscillatory signals are ideal for multiplexing signals.

Cross talk and interference enhance information capacity of a signaling pathway

A recurring motif in gene regulatory networks is transcription factors (TFs) that regulate each other and then bind to overlapping sites on DNA, where they interact and synergistically control transcription of a target gene. Here, we suggest that this motif maximizes information flow in a noisy network. Gene expression is an inherently noisy process due to thermal fluctuations and the small number of molecules involved. A consequence of multiple TFs interacting at overlapping binding sites is that their binding noise becomes correlated. Using concepts from information theory, we show that in general a signaling pathway transmits more information if 1), noise of one input is correlated with that of the other; and 2), input signals are not chosen independently. In the case of TFs, the latter criterion hints at upstream cross-regulation. We demonstrate these ideas for competing TFs and feed-forward gene-regulatory modules, and discuss generalizations to other signaling pathways. Our results challenge the conventional approach of treating biological noise as uncorrelated fluctuations, and present a systematic method for understanding TF cross-regulation networks either from direct measurements of binding noise or from bioinformatic analysis of overlapping binding sites.

Time-dependent information transmission in a model regulatory circuit

Many biological regulatory systems respond with a physiological delay when processing signals. A simple model of regulation which respects these features shows how the ability of a delayed output to transmit information is limited: at short times by the time scale of the dynamic input, at long times by that of the dynamic output. We find that topologies of maximally informative networks correspond to commonly occurring biological circuits linked to stress response and that circuits functioning out of steady state may exploit absorbing states to transmit information optimally.