The application of information theory to biochemical signaling systems

Dynamical and combinatorial coding by MAPK p38 and NFκB in the inflammatory response of macrophages

Macrophages sense pathogens and orchestrate specific immune responses. Stimulus specificity is thought to be achieved through combinatorial and dynamical coding by signaling pathways. While NFκB dynamics are known to encode stimulus information, dynamical coding in other signaling pathways and their combinatorial coordination remain unclear. Here, we established live-cell microscopy to investigate how NFκB and p38 dynamics interface in stimulated macrophages. Information theory and machine learning revealed that p38 dynamics distinguish cytokine TNF from pathogen-associated molecular patterns and high doses from low, but contributed little to information-rich NFκB dynamics when both pathways are considered. This suggests that immune response genes benefit from decoding immune signaling dynamics or combinatorics, but not both. We found that the heterogeneity of the two pathways is surprisingly uncorrelated. Mathematical modeling revealed potential sources of uncorrelated heterogeneity in the branched pathway network topology and predicted it to drive gene expression variability. Indeed, genes dependent on both p38 and NFκB showed high scRNAseq variability and bimodality. These results identify combinatorial signaling as a mechanism to restrict NFκB-AND-p38-responsive inflammatory cytokine expression to few cells.

The ability to sense the environment is heterogeneously distributed in cell populations

Channel capacity of signaling networks quantifies their fidelity in sensing extracellular inputs. Low estimates of channel capacities for several mammalian signaling networks suggest that cells can barely detect the presence/absence of environmental signals. However, given the extensive heterogeneity and temporal stability of cell state variables, we hypothesize that the sensing ability itself may depend on the state of the cells. In this work, we present an information-theoretic framework to quantify the distribution of sensing abilities from single-cell data. Using data on two mammalian pathways, we show that sensing abilities are widely distributed in the population and most cells achieve better resolution of inputs compared to an 'average cell'. We verify these predictions using live-cell imaging data on the IGFR/FoxO pathway. Importantly, we identify cell state variables that correlate with cells' sensing abilities. This information-theoretic framework will significantly improve our understanding of how cells sense in their environment.

Information Transmission via Molecular Communication in Astrobiological Environments

The ubiquity of information transmission via molecular communication between cells is comprehensively documented on Earth; this phenomenon might even have played a vital role in the origin(s) and early evolution of life. Motivated by these considerations, a simple model for molecular communication entailing the diffusion of signaling molecules from transmitter to receiver is elucidated. The channel capacity C (maximal rate of information transmission) and an optimistic heuristic estimate of the actual information transmission rate ℐ are derived for this communication system; the two quantities, especially the latter, are demonstrated to be broadly consistent with laboratory experiments and more sophisticated theoretical models. The channel capacity exhibits a potentially weak dependence on environmental parameters, whereas the actual information transmission rate may scale with the intercellular distance d as ℐ ∝ d-4 and could vary substantially across settings. These two variables are roughly calculated for diverse astrobiological environments, ranging from Earth's upper oceans (C ∼ 3.1 × 103 bits/s; ℐ ∼ 4.7 × 10-2 bits/s) and deep sea hydrothermal vents (C ∼ 4.2 × 103 bits/s; ℐ ∼ 1.2 × 10-1 bits/s) to the hydrocarbon lakes and seas of Titan (C ∼ 3.8 × 103 bits/s; ℐ ∼ 2.6 × 10-1 bits/s).

Information-Theoretic Analysis of a Model of CAR-4-1BB-Mediated NFκB Activation

Systems biology utilizes computational approaches to examine an array of biological processes, such as cell signaling, metabolomics and pharmacology. This includes mathematical modeling of CAR T cells, a modality of cancer therapy by which genetically engineered immune cells recognize and combat a cancerous target. While successful against hematologic malignancies, CAR T cells have shown limited success against other cancer types. Thus, more research is needed to understand their mechanisms of action and leverage their full potential. In our work, we set out to apply information theory on a mathematical model of NFκB signaling initiated by the CAR following antigen encounter. First, we estimated channel capacity for CAR-4-1BB-mediated NFκB signal transduction. Next, we evaluated the pathway's ability to distinguish contrasting "low" and "high" antigen concentration levels, depending on the amount of variability in protein concentrations. Finally, we assessed the fidelity by which NFκB activation reflects the encountered antigen concentration, depending on the prevalence of antigen-positive targets in tumor population. We found that in most scenarios, fold change in the nuclear concentration of NFκB carries a higher channel capacity for the pathway than NFκB's absolute response. Additionally, we found that most errors in transducing the antigen signal through the pathway skew towards underestimating the concentration of encountered antigen. Finally, we found that disabling IKKβ deactivation could increase signaling fidelity against targets with antigen-negative cells. Our information-theoretic analysis of signal transduction can provide novel perspectives on biological signaling, as well as enable a more informed path to cell engineering.Kindly check and confirm whether the corresponding affiliation is correctly identified.this is correct.

The ability to sense the environment is heterogeneously distributed in cell populations

Channel capacity of signaling networks quantifies their fidelity in sensing extracellular inputs. Low estimates of channel capacities for several mammalian signaling networks suggest that cells can barely detect the presence/absence of environmental signals. However, given the extensive heterogeneity and temporal stability of cell state variables, we hypothesize that the sensing ability itself may depend on the state of the cells. In this work, we present an information theoretic framework to quantify the distribution of sensing abilities from single cell data. Using data on two mammalian pathways, we show that sensing abilities are widely distributed in the population and most cells achieve better resolution of inputs compared to an " average cell ". We verify these predictions using live cell imaging data on the IGFR/FoxO pathway. Importantly, we identify cell state variables that correlate with cells' sensing abilities. This information theoretic framework will significantly improve our understanding of how cells sense in their environment.

PI3K signaling through a biochemical systems lens

Following 3 decades of extensive research into PI3K signaling, it is now evidently clear that the underlying network does not equate to a simple ON/OFF switch. This is best illustrated by the multifaceted nature of the many diseases associated with aberrant PI3K signaling, including common cancers, metabolic disease, and rare developmental disorders. However, we are still far from a complete understanding of the fundamental control principles that govern the numerous phenotypic outputs that are elicited by activation of this well-characterized biochemical signaling network, downstream of an equally diverse set of extrinsic inputs. At its core, this is a question on the role of PI3K signaling in cellular information processing and decision making. Here, we review the determinants of accurate encoding and decoding of growth factor signals and discuss outstanding questions in the PI3K signal relay network. We emphasize the importance of quantitative biochemistry, in close integration with advances in single-cell time-resolved signaling measurements and mathematical modeling.

Information-theoretic analysis of a model of CAR-4-1BB-mediated NFκB activation

Systems biology utilizes computational approaches to examine an array of biological processes, such as cell signaling, metabolomics and pharmacology. This includes mathematical modeling of CAR T cells, a modality of cancer therapy by which genetically engineered immune cells recognize and combat a cancerous target. While successful against hematologic malignancies, CAR T cells have shown limited success against other cancer types. Thus, more research is needed to understand their mechanisms of action and leverage their full potential. In our work, we set out to apply information theory on a mathematical model of cell signaling of CAR-mediated activation following antigen encounter. First, we estimated channel capacity for CAR-4-1BB-mediated NFκB signal transduction. Next, we evaluated the pathway's ability to distinguish contrasting "low" and "high" antigen concentration levels, depending on the amount of intrinsic noise. Finally, we assessed the fidelity by which NFκB activation reflects the encountered antigen concentration, depending on the prevalence of antigen-positive targets in tumor population. We found that in most scenarios, fold change in the nuclear concentration of NFκB carries a higher channel capacity for the pathway than NFκB's absolute response. Additionally, we found that most errors in transducing the antigen signal through the pathway skew towards underestimating the concentration of encountered antigen. Finally, we found that disabling IKKβ deactivation could increase signaling fidelity against targets with antigen-negative cells. Our information-theoretic analysis of signal transduction can provide novel perspectives on biological signaling, as well as enable a more informed path to cell engineering.

Epigenetics as a mediator of plasticity in cancer

The concept of an epigenetic landscape describing potential cellular fates arising from pluripotent cells, first advanced by Conrad Waddington, has evolved in light of experiments showing nondeterministic outcomes of regulatory processes and mathematical methods for quantifying stochasticity. In this Review, we discuss modern approaches to epigenetic and gene regulation landscapes and the associated ideas of entropy and attractor states, illustrating how their definitions are both more precise and relevant to understanding cancer etiology and the plasticity of cancerous states. We address the interplay between different types of regulatory landscapes and how their changes underlie cancer progression. We also consider the roles of cellular aging and intrinsic and extrinsic stimuli in modulating cellular states and how landscape alterations can be quantitatively mapped onto phenotypic outcomes and thereby used in therapy development.

Quantifying information of intracellular signaling: progress with machine learning

Cells convey information about their extracellular environment to their core functional machineries. Studying the capacity of intracellular signaling pathways to transmit information addresses fundamental questions about living systems. Here, we review how information-theoretic approaches have been used to quantify information transmission by signaling pathways that are functionally pleiotropic and subject to molecular stochasticity. We describe how recent advances in machine learning have been leveraged to address the challenges of complex temporal trajectory datasets and how these have contributed to our understanding of how cells employ temporal coding to appropriately adapt to environmental perturbations.

Electrogenetic Signal Transmission and Propagation in Coculture to Guide Production of a Small Molecule, Tyrosine

There are many strategies to actuate and control genetic circuits, including providing stimuli like exogenous chemical inducers, light, magnetic fields, and even applied voltage, that are orthogonal to metabolic activity. Their use enables actuation of gene expression for the production of small molecules and proteins in many contexts. Additionally, there are a growing number of reports wherein cocultures, consortia, or even complex microbiomes are employed for the production of biologics, taking advantage of an expanded array of biological function. Combining stimuli-responsive engineered cell populations enhances design space but increases complexity. In this work, we co-opt nature's redox networks and electrogenetically route control signals into a consortium of microbial cells engineered to produce a model small molecule, tyrosine. In particular, we show how electronically programmed short-lived signals (i.e., hydrogen peroxide) can be transformed by one population and propagated into sustained longer-distance signals that, in turn, guide tyrosine production in a second population building on bacterial quorum sensing that coordinates their collective behavior. Two design methodologies are demonstrated. First, we use electrogenetics to transform redox signals into the quorum sensing autoinducer, AI-1, that, in turn, induces a tyrosine biosynthesis pathway transformed into a second population. Second, we use the electrogenetically stimulated AI-1 to actuate expression of ptsH, boosting the growth rate of tyrosine-producing cells, augmenting both their number and metabolic activity. In both cases, we show how signal propagation within the coculture helps to ensure tyrosine production. We suggest that this work lays a foundation for employing electrochemical stimuli and engineered cocultures for production of molecular products in biomanufacturing environments.

Cellular Signaling beyond the Wiener-Kolmogorov Limit

Accurate propagation of signals through stochastic biochemical networks involves significant expenditure of cellular resources. The same is true for regulatory mechanisms that suppress fluctuations in biomolecular populations. Wiener-Kolmogorov (WK) optimal noise filter theory, originally developed for engineering problems, has recently emerged as a valuable tool to estimate the maximum performance achievable in such biological systems for a given metabolic cost. However, WK theory has one assumption that potentially limits its applicability: it relies on a linear, continuum description of the reaction dynamics. Despite this, up to now no explicit test of the theory in nonlinear signaling systems with discrete molecular populations has ever seen performance beyond the WK bound. Here we report the first direct evidence of the bound being broken. To accomplish this, we develop a theoretical framework for multilevel signaling cascades, including the possibility of feedback interactions between input and output. In the absence of feedback, we introduce an analytical approach that allows us to calculate exact moments of the stationary distribution for a nonlinear system. With feedback, we rely on numerical solutions of the system's master equation. The results show WK violations in two common network motifs: a two-level signaling cascade and a negative feedback loop. However, the magnitude of the violation is biologically negligible, particularly in the parameter regime where signaling is most effective. The results demonstrate that while WK theory does not provide strict bounds, its predictions for performance limits are excellent approximations, even for nonlinear systems.

Optimal ligand discrimination by asymmetric dimerization and turnover of interferon receptors

In multicellular organisms, antiviral defense mechanisms evoke a reliable collective immune response despite the noisy nature of biochemical communication between tissue cells. A molecular hub of this response, the interferon I receptor (IFNAR), discriminates between ligand types by their affinity regardless of concentration. To understand how ligand type can be decoded robustly by a single receptor, we frame ligand discrimination as an information-theoretic problem and systematically compare the major classes of receptor architectures: allosteric, homodimerizing, and heterodimerizing. We demonstrate that asymmetric heterodimers achieve the best discrimination power over the entire physiological range of local ligand concentrations. This design enables sensing of ligand presence and type, and it buffers against moderate concentration fluctuations. In addition, receptor turnover, which drives the receptor system out of thermodynamic equilibrium, allows alignment of activation points for ligands of different affinities and thereby makes ligand discrimination practically independent of concentration. IFNAR exhibits this optimal architecture, and our findings thus suggest that this specialized receptor can robustly decode digital messages carried by its different ligands.

First-principles prediction of the information processing capacity of a simple genetic circuit

Given the stochastic nature of gene expression, genetically identical cells exposed to the same environmental inputs will produce different outputs. This heterogeneity has been hypothesized to have consequences for how cells are able to survive in changing environments. Recent work has explored the use of information theory as a framework to understand the accuracy with which cells can ascertain the state of their surroundings. Yet the predictive power of these approaches is limited and has not been rigorously tested using precision measurements. To that end, we generate a minimal model for a simple genetic circuit in which all parameter values for the model come from independently published data sets. We then predict the information processing capacity of the genetic circuit for a suite of biophysical parameters such as protein copy number and protein-DNA affinity. We compare these parameter-free predictions with an experimental determination of protein expression distributions and the resulting information processing capacity of E. coli cells. We find that our minimal model captures the scaling of the cell-to-cell variability in the data and the inferred information processing capacity of our simple genetic circuit up to a systematic deviation.

Concepts and Applications of Information Theory to Immuno-Oncology

Recent successes of immune-modulating therapies for cancer have stimulated research on information flow within the immune system and, in turn, clinical applications of concepts from information theory. Through information theory, one can describe and formalize, in a mathematically rigorous fashion, the function of interconnected components of the immune system in health and disease. Specifically, using concepts including entropy, mutual information, and channel capacity, one can quantify the storage, transmission, encoding, and flow of information within and between cellular components of the immune system on multiple temporal and spatial scales. To understand, at the quantitative level, immune signaling function and dysfunction in cancer, we present a methodology-oriented review of information-theoretic treatment of biochemical signal transduction and transmission coupled with mathematical modeling.

Informational architecture across non-living and living collectives

Collective behavior is widely regarded as a hallmark property of living and intelligent systems. Yet, many examples are known of simple physical systems that are not alive, which nonetheless display collective behavior too, prompting simple physical models to often be adopted to explain living collective behaviors. To understand collective behavior as it occurs in living examples, it is important to determine whether or not there exist fundamental differences in how non-living and living systems act collectively, as well as the limits of the intuition that can be built from simpler, physical examples in explaining biological phenomenon. Here, we propose a framework for comparing non-living and living collectives as a continuum based on their information architecture: that is, how information is stored and processed across different degrees of freedom. We review diverse examples of collective phenomena, characterized from an information-theoretic perspective, and offer views on future directions for quantifying living collective behaviors based on their informational structure.

Fitness value of information with delayed phenotype switching: Optimal performance with imperfect sensing

The ability of organisms to accurately sense their environment and respond accordingly is critical for evolutionary success. However, exactly how the sensory ability influences fitness is a topic of active research, while the necessity of a time delay between when unreliable environmental cues are sensed and when organisms can mount a response has yet to be explored at any length. Accounting for this delay in phenotype response in models of population growth, we find that a critical error probability can exist under certain environmental conditions: An organism with a sensory system with any error probability less than the critical value can achieve the same long-term growth rate as an organism with a perfect sensing system. We also observe a tradeoff between the evolutionary value of sensory information and robustness to error, mediated by the rate at which the phenotype distribution relaxes to steady state. The existence of the critical error probability could have several important evolutionary consequences, primarily that sensory systems operating at the nonzero critical error probability may be evolutionarily optimal.

Signaling pathways have an inherent need for noise to acquire information

BACKGROUND

All living systems acquire information about their environment. At the cellular level, they do so through signaling pathways. Such pathways rely on reversible binding interactions between molecules that detect and transmit the presence of an extracellular cue or signal to the cell's interior. These interactions are inherently stochastic and thus noisy. On the one hand, noise can cause a signaling pathway to produce the same response for different stimuli, which reduces the amount of information a pathway acquires. On the other hand, in processes such as stochastic resonance, noise can improve the detection of weak stimuli and thus the acquisition of information. It is not clear whether the kinetic parameters that determine a pathway's operation cause noise to reduce or increase the acquisition of information.

RESULTS

We analyze how the kinetic properties of the reversible binding interactions used by signaling pathways affect the relationship between noise, the response to a signal, and information acquisition. Our results show that, under a wide range of biologically sensible parameter values, a noisy dynamic of reversible binding interactions is necessary to produce distinct responses to different stimuli. As a consequence, noise is indispensable for the acquisition of information in signaling pathways.

CONCLUSIONS

Our observations go beyond previous work by showing that noise plays a positive role in signaling pathways, demonstrating that noise is essential when such pathways acquire information.

Redox Electrochemistry to Interrogate and Control Biomolecular Communication

Cells often communicate by the secretion, transport, and perception of molecules. Information conveyed by molecules is encoded, transmitted, and decoded by cells within the context of the prevailing microenvironments. Conversely, in electronics, transmission reliability and message validation are predictable, robust, and less context dependent. In turn, many transformative advances have resulted by the formal consideration of information transfer. One way to explore this potential for biological systems is to create bio-device interfaces that facilitate bidirectional information transfer between biology and electronics. Redox reactions enable this linkage because reduction and oxidation mediate communication within biology and can be coupled with electronics. By manipulating redox reactions, one is able to combine the programmable features of electronics with the ability to interrogate and modulate biological function. In this review, we examine methods to electrochemically interrogate the various components of molecular communication using redox chemistry and to electronically control cell communication using redox electrogenetics.

Organ System Network Disruption Is Associated With Poor Prognosis in Patients With Chronic Liver Failure

BACKGROUND

A healthy individual has a high degree of functional connectivity between organ systems, which can be represented graphically in a network map. Disruption of this system connectivity is associated with mortality in life-threatening acute illnesses, demonstrated by a network approach. However, this approach has not been applied to chronic multisystem diseases and may be more reliable than conventional individual organ prognostic scoring methods. Cirrhosis is a chronic disease of the liver with multisystem involvement. Development of an efficient model for prediction of mortality in cirrhosis requires a profound understanding of the pathophysiologic processes that lead to poor prognosis. In the present study, we use a network approach to evaluate the differences in organ system connectivity between survivors and non-survivors in a group of well-characterized patients with cirrhosis.

METHODS

201 patients with cirrhosis originally referred to the Clinic five at the University Hospital of Padova, with 13 clinical variables available representing hepatic, metabolic, haematopoietic, immune, neural and renal organ systems were retrospectively enrolled and followed up for 3, 6, and 12 months. Software was designed to compute the correlation network maps of organ system interaction in survivors and non-survivors using analysis indices: A. Bonferroni corrected Pearson's correlation coefficient and B. Mutual Information. Network structure was quantitatively evaluated using the measures of edges, average degree of connectivity and closeness, and qualitatively using clinical significance. Pair-matching was also implemented as a further step after initial general analysis to control for sample size and Model for End-Stage Liver Disease (MELD-Na) score between the groups.

RESULTS

There was a higher number of significant correlations in survivors, as indicated by both the analysis indices of Bonferroni corrected Pearson's correlation coefficient and the Mutual Information analysis. The number of edges, average degree of connectivity and closeness were significantly higher in survivors compared to non-survivors group. Pair-matching for MELD-Na was also associated with increased connectivity in survivors compared to non-survivors over 3 and 6 months follow up.

CONCLUSION

This study demonstrates the application of a network approach in evaluating functional connectivity of organ systems in liver cirrhosis, demonstrating a significant degree of network disruption in organ systems in non-survivors. Network analysis of organ systems may provide insight in developing novel prognostic models for organ allocation in patients with cirrhosis.

p53: 800 million years of evolution and 40 years of discovery

The evolutionarily conserved p53 protein and its cellular pathways mediate tumour suppression through an informed, regulated and integrated set of responses to environmental perturbations resulting in either cellular death or the maintenance of cellular homeostasis. The p53 and MDM2 proteins form a central hub in this pathway that receives stressful inputs via MDM2 and respond via p53 by informing and altering a great many other pathways and functions in the cell. The MDM2-p53 hub is one of the hubs most highly connected to other signalling pathways in the cell, and this may be why TP53 is the most commonly mutated gene in human cancers. Initial or truncal TP53 gene mutations (the first mutations in a stem cell) are selected for early in cancer development inectodermal and mesodermal-derived tissue-specific stem and progenitor cells and then, following additional mutations, produce tumours from those tissue types. In endodermal-derived tissue-specific stem or progenitor cells, TP53 mutations are functionally selected as late mutations transitioning the mutated cell into a malignant tumour. The order in which oncogenes or tumour suppressor genes are functionally selected for in a stem cell impacts the timing and development of a tumour.

Sparse estimation of mutual information landscapes quantifies information transmission through cellular biochemical reaction networks

Measuring information transmission from stimulus to response is useful for evaluating the signaling fidelity of biochemical reaction networks (BRNs) in cells. Quantification of information transmission can reveal the optimal input stimuli environment for a BRN and the rate at which the signaling fidelity decreases for non-optimal input probability distributions. Here we present sparse estimation of mutual information landscapes (SEMIL), a method to quantify information transmission through cellular BRNs using commonly available data for single-cell gene expression output, across a design space of possible input distributions. We validate SEMIL and use it to analyze several engineered cellular sensing systems to demonstrate the impact of reaction pathways and rate constants on mutual information landscapes.

Sarkar et al. present a method called sparse estimation of mutual information landscapes (SEMIL) that quantifies information transmission landscapes through cellular biochemical reaction networks across a space of input distributions using single-cell gene expression data. This study suggests that mutual information landscapes can be used as a performance metric for biochemical reaction networks.

Short Residence Times of DNA-Bound Transcription Factors Can Reduce Gene Expression Noise and Increase the Transmission of Information in a Gene Regulation System

Gene expression noise is not just ubiquitous but also variable, and we still do not understand some of the most elementary factors that affect it. Among them is the residence time of a transcription factor (TF) on DNA, the mean time that a DNA-bound TF remains bound. Here, we use a stochastic model of transcriptional regulation to study how residence time affects the gene expression noise that arises when a TF induces gene expression. We find that the effect of residence time on gene expression noise depends on the TF’s concentration and its affinity to DNA, which determine the level of induction of the gene. At high levels of induction, residence time has no effect on gene expression noise. However, as the level of induction decreases, short residence times reduce gene expression noise. The reason is that fast on-off TF binding dynamics prevent long periods where proteins are predominantly synthesized or degraded, which can cause excessive fluctuations in gene expression. As a consequence, short residence times can help a gene regulation system acquire information about the cellular environment it operates in. Our predictions are consistent with the observation that experimentally measured residence times are usually modest and lie between seconds to minutes.

Limitations to Estimating Mutual Information in Large Neural Populations

Information theory provides a powerful framework to analyse the representation of sensory stimuli in neural population activity. However, estimating the quantities involved such as entropy and mutual information from finite samples is notoriously hard and any direct estimate is known to be heavily biased. This is especially true when considering large neural populations. We study a simple model of sensory processing and show through a combinatorial argument that, with high probability, for large neural populations any finite number of samples of neural activity in response to a set of stimuli is mutually distinct. As a consequence, the mutual information when estimated directly from empirical histograms will be equal to the stimulus entropy. Importantly, this is the case irrespective of the precise relation between stimulus and neural activity and corresponds to a maximal bias. This argument is general and applies to any application of information theory, where the state space is large and one relies on empirical histograms. Overall, this work highlights the need for alternative approaches for an information theoretic analysis when dealing with large neural populations.

Information-Theoretic Model and Analysis of Molecular Signaling in Targeted Drug Delivery

Targeted drug delivery (TDD) modality promises a smart localization of appropriate dose of therapeutic drugs to the targeted part of the body at reduced system toxicity. To achieve the desired goals of TDD, accurate analysis of the system is important. Recent advances in molecular communication (MC) present prospects to analyzing the TDD process using engineering concepts and tools. Specifically, the MC platform supports the abstraction of TDD process as a communication engineering problem in which the injection and transportation of drug particles in the human body and the delivery to a specific tissue or organ can be analyzed using communication engineering tools. In this paper we stand on the MC platform to present the information-theoretic model and analysis of the TDD systems. We present a modular structure of the TDD system and the probabilistic models of the MC-abstracted modules in an intuitive manner. Simulated results of information-theoretic measures such as the mutual information are employed to analyze the performance of the TDD system. Results indicate that uncertainties in drug injection/release systems, nanoparticles propagation channel and nanoreceiver systems influence the mutual information of the system, which is relative to the system's bioequivalence measure.

Computation capacities of a broad class of signaling networks are higher than their communication capacities

Due to structural and functional abnormalities or genetic variations and mutations, there may be dysfunctional molecules within an intracellular signaling network that do not allow the network to correctly regulate its output molecules, such as transcription factors. This disruption in signaling interrupts normal cellular functions and may eventually develop some pathological conditions. In this paper, computation capacity of signaling networks is introduced as a fundamental limit on signaling capability and performance of such networks. In simple terms, the computation capacity measures the maximum number of computable inputs, that is, the maximum number of input values for which the correct functional output values can be recovered from the erroneous network outputs, when the network contains some dysfunctional molecules. This contrasts with the conventional communication capacity that measures instead the maximum number of input values that can be correctly distinguished based on the erroneous network outputs. The computation capacity is higher than the communication capacity whenever the network response function is not a one-to-one function of the input signals, and, unlike the communication capacity, it takes into account the input-output functional relationships of the network. By explicitly incorporating the effect of signaling errors that result in the network dysfunction, the computation capacity provides more information about the network and its malfunction. Two examples of signaling networks are considered in the paper, one regulating caspase3 and another regulating NFκB, for which computation and communication capacities are investigated. Higher computation capacities are observed for both networks. One biological implication of this finding is that signaling networks may have more 'capacity' than that specified by the conventional communication capacity metric. The effect of feedback is studied as well. In summary, this paper reports findings on a new fundamental feature of the signaling capability of cell signaling networks.

On Information Extraction and Decoding Mechanisms Improved by Noisy Amplification in Signaling Pathways

The cells need to process information about extracellular stimuli. They encode, transmit and decode the information to elicit an appropriate response. Studies aimed at understanding how such information is decoded in the signaling pathways to generate a specific cellular response have become essential. Eukaryotic cells decode information through two different mechanisms: the feed-forward loop and the promoter affinity. Here, we investigate how these two mechanisms improve information transmission. A detailed comparison is made between the stochastic model of the MAPK/ERK pathway and a stochastic minimal decoding model. The maximal amount of transmittable information was computed. The results suggest that the decoding mechanism of the MAPK/ERK pathway improve the channel capacity because it behaves as a noisy amplifier. We show a positive dependence between the noisy amplification and the amount of information extracted. Additionally, we show that the extrinsic noise can be tuned to improve information transmission. This investigation has revealed that the feed-forward loop and the promoter affinity motifs extract information thanks to processes of amplification and noise addition. Moreover, the channel capacity is enhanced when both decoding mechanisms are coupled. Altogether, these findings suggest novel characteristics in how decoding mechanisms improve information transmission.

On signalling and estimation limits for molecular birth-processes

Understanding and uncovering the mechanisms or motifs that molecular networks employ to regulate noise is a key problem in cell biology. As it is often difficult to obtain direct and detailed insight into these mechanisms, many studies instead focus on assessing the best precision attainable on the signalling pathways that compose these networks. Molecules signal one another over such pathways to solve noise regulating estimation and control problems. Quantifying the maximum precision of these solutions delimits what is achievable and allows hypotheses about underlying motifs to be tested without requiring detailed biological knowledge. The pathway capacity, which defines the maximum rate of transmitting information along it, is a widely used proxy for precision. Here it is shown, for estimation problems involving elementary yet biologically relevant birth-process networks, that capacity can be surprisingly misleading. A time-optimal signalling motif, called birth-following, is derived and proven to better the precision expected from the capacity, provided the maximum signalling rate constraint is large and the mean one above a certain threshold. When the maximum constraint is relaxed, perfect estimation is predicted by the capacity. However, the true achievable precision is found highly variable and sensitive to the mean constraint. Since the same capacity can map to different combinations of rate constraints, it can only equivocally measure precision. Deciphering the rate constraints on a signalling pathway may therefore be more important than computing its capacity.

Exploring the information transmission properties of noise-induced dynamics: application to glioma differentiation

Background

Cells operate in an uncertain environment, where critical cell decisions must be enacted in the presence of biochemical noise. Information theory can measure the extent to which such noise perturbs normal cellular function, in which cells must perceive environmental cues and relay signals accurately to make timely and informed decisions. Using multivariate response data can greatly improve estimates of the latent information content underlying important cell fates, like differentiation.

Results

We undertake an information theoretic analysis of two stochastic models concerning glioma differentiation therapy, an alternative cancer treatment modality whose underlying intracellular mechanisms remain poorly understood. Discernible changes in response dynamics, as captured by summary measures, were observed at low noise levels. Mitigating certain feedback mechanisms present in the signaling network improved information transmission overall, as did targeted subsampling and clustering of response dynamics.

Conclusion

Computing the channel capacity of noisy signaling pathways present great probative value in uncovering the prevalent trends in noise-induced dynamics. Areas of high dynamical variation can provide concise snapshots of informative system behavior that may otherwise be overlooked. Through this approach, we can examine the delicate interplay between noise and information, from signal to response, through the observed behavior of relevant system components.

Electronic supplementary material

The online version of this article (10.1186/s12859-019-2970-7) contains supplementary material, which is available to authorized users.

Functional Epithelium Remodeling in Response to Applied Stress under In Vitro Conditions

Mathematical modeling is often used in tissue engineering in order to overcome one of its major challenges: transformation of complex biological and rheological behaviors of cells and tissue in a mathematically predictive and physically manipulative engineering process. The successive accomplishment of this task will greatly help in quantifying and optimizing clinical application of the tissue engineering products. One of the problems emerging in this area is the relation between resting and migrating cell groups, as well as between different configurations of migrating cells and viscoelasticity. A deeper comprehension of the relation between various configurations of migrating cells and viscoelasticity at the supracellular level represents the prerequisite for optimization of the performance of the artificial epithelium. Since resting and migrating cell groups have a considerable difference in stiffness, a change in their mutual volume ratio and distribution may affect the viscoelasticity of multicellular surfaces. If those cell groups are treated as different phases, then an analogous model may be applied to represent such systems. In this work, a two-step Eyring model is developed in order to demonstrate the main mechanical and biochemical factors that influence configurations of migrating cells. This model could be also used for considering the long-time cell rearrangement under various types of applied stress. The results of this theoretical analysis point out the cause-consequence relationship between the configuration of migrating cells and rheological behavior of multicellular surfaces. Configuration of migrating cells is influenced by mechanical and biochemical perturbations, difficult to measure experimentally, which lead to uncorrelated motility. Uncorrelated motility results in (1) decrease of the volume fraction of migrating cells, (2) change of their configuration, and (3) softening of multicellular surfaces.

Multivariate information processing characterizes fitness of a cascaded gene-transcription machinery

We report that a genetic two-step activation cascade processes diverse flavors of information, e.g., synergy, redundancy, and unique information. Our computations measuring reduction in Shannon entropies and reduction in variances produce differently behaving absolute magnitudes of these informational flavors. We find that similarity can be brought in if these terms are evaluated in fractions with respect to corresponding total information. Each of the input signal and final gene-product is found to generate common or redundant information fractions (mostly) to predict each other, whereas they also complement one another to harness synergistic information fraction, predicting the intermediate biochemical species. For an optimally growing signal to maintain fixed steady-state abundance of activated downstream gene-products, the interaction information fractions for this cascade module shift from net-redundancy to information-independence.

Robustness and Information Transfer within IL-6-induced JAK/STAT Signalling

Cellular communication via intracellular signalling pathways is crucial. Expression and activation of signalling proteins is heterogenous between isogenic cells of the same cell-type. However, mechanisms evolved to enable sufficient communication and to ensure cellular functions. We use information theory to clarify mechanisms facilitating IL-6-induced JAK/STAT signalling despite cell-to-cell variability. We show that different mechanisms enabling robustness against variability complement each other. Early STAT3 activation is robust as long as cytokine concentrations are low. Robustness at high cytokine concentrations is ensured by high STAT3 expression or serine phosphorylation. Later the feedback-inhibitor SOCS3 increases robustness. Channel Capacity of JAK/STAT signalling is limited by cell-to-cell variability in STAT3 expression and is affected by the same mechanisms governing robustness. Increasing STAT3 amount increases Channel Capacity and robustness, whereas increasing STAT3 tyrosine phosphorylation reduces robustness but increases Channel Capacity. In summary, we elucidate mechanisms preventing dysregulated signalling by enabling reliable JAK/STAT signalling despite cell-to-cell heterogeneity.

The Limited Information Capacity of Cross-Reactive Sensors Drives the Evolutionary Expansion of Signaling

Signaling systems expand by duplications of various components, be it receptors or downstream effectors. However, whether and how duplicated components contribute to higher signaling capacity is unclear, especially because in most cases, their specificities overlap. Using information theory, we found that augmentation of capacity by an increase in the copy number is strongly limited by logarithmic diminishing returns. Moreover, counter to conventional biochemical wisdom, refinements of the response mechanism, e.g., by cooperativity or allostery, do not increase the overall signaling capacity. However, signaling capacity nearly doubles when a promiscuous, non-cognate ligand becomes explicitly recognized via duplication and partial divergence of signaling components. Our findings suggest that expansion of signaling components via duplication and enlistment of promiscuously acting cues is virtually the only accessible evolutionary strategy to achieve overall high-signaling capacity despite overlapping specificities and molecular noise. This mode of expansion also explains the highly cross-wired architecture of signaling pathways.

Genetically Encoded Fluorescent Biosensors Illuminate the Spatiotemporal Regulation of Signaling Networks

Cellular signaling networks are the foundation which determines the fate and function of cells as they respond to various cues and stimuli. The discovery of fluorescent proteins over 25 years ago enabled the development of a diverse array of genetically encodable fluorescent biosensors that are capable of measuring the spatiotemporal dynamics of signal transduction pathways in live cells. In an effort to encapsulate the breadth over which fluorescent biosensors have expanded, we endeavored to assemble a comprehensive list of published engineered biosensors, and we discuss many of the molecular designs utilized in their development. Then, we review how the high temporal and spatial resolution afforded by fluorescent biosensors has aided our understanding of the spatiotemporal regulation of signaling networks at the cellular and subcellular level. Finally, we highlight some emerging areas of research in both biosensor design and applications that are on the forefront of biosensor development.

Interplay of synergy and redundancy in diamond motif

The formalism of partial information decomposition provides a number of independent components which altogether constitute the total information provided by the source variable(s) about the target variable(s). These non-overlapping terms are recognized as unique information, synergistic information, and redundant information. The metric of net synergy conceived as the difference between synergistic and redundant information is capable of detecting effective synergy, effective redundancy, and information independence among stochastic variables. The net synergy can be quantified using appropriate combinations of different Shannon mutual information terms. The utilization of the net synergy in network motifs with the nodes representing different biochemical species, involved in information sharing, uncovers rich store for exciting results. In the current study, we use this formalism to obtain a comprehensive understanding of the relative information processing mechanism in a diamond motif and two of its sub-motifs, namely, bifurcation and integration motif embedded within the diamond motif. The emerging patterns of effective synergy and effective redundancy and their contribution toward ensuring high fidelity information transmission are duly compared in the sub-motifs. Investigation on the metric of net synergy in independent bifurcation and integration motifs are also executed. In all of these computations, the crucial roles played by various systemic time scales, activation coefficients, and signal integration mechanisms at the output of the network topologies are especially emphasized. Following this plan of action, we become confident that the origin of effective synergy and effective redundancy can be architecturally justified by decomposing a diamond motif into bifurcation and integration motif. According to our conjecture, the presence of a common source of fluctuations creates effective redundancy. Our calculations reveal that effective redundancy empowers signal fidelity. Moreover, to achieve this, input signaling species avoids strong interaction with downstream intermediates. This strategy is capable of making the diamond motif noise-tolerant. Apart from the topological features, our study also puts forward the active contribution of additive and multiplicative signal integration mechanisms to nurture effective redundancy and effective synergy.

Heritable stress response dynamics revealed by single-cell genealogy

Cells often respond to environmental stimuli by activating specific transcription factors. Upon exposure to glucose limitation stress, it is known that yeast Saccharomyces cerevisiae cells dephosphorylate the general stress response factor Msn2, leading to its nuclear localization, which in turn activates the expression of many genes. However, the precise dynamics of Msn2 nucleocytoplasmic translocations and whether they are inherited over multiple generations in a stress-dependent manner are not well understood. Tracking Msn2 localization events in yeast lineages grown on a microfluidic chip, here we report how cells modulate the amplitude, duration, frequency, and dynamic pattern of the localization events in response to glucose limitation stress. Single yeast cells were found to modulate the amplitude and frequency of Msn2 nuclear localization, but not its duration. Moreover, the Msn2 localization frequency was epigenetically inherited in descendants of mother cells, leading to a decrease in cell-to-cell variation in localization frequency. An analysis of the time dynamic patterns of nuclear localizations between genealogically related cell pairs using an information theory approach found that the magnitude of pattern similarity increased with stress intensity and was strongly inherited by the descendant cells at the highest stress level. By dissecting how general stress response dynamics is contributed by different modulation schemes over long time scales, our work provides insight into which scheme evolution might have acted on to optimize fitness in stressful environments.

Gonadotropin-releasing hormone signaling: An information theoretic approach

Gonadotropin-releasing hormone (GnRH) is a peptide hormone that mediates central control of reproduction, acting via G-protein coupled receptors that are primarily G_q coupled and mediate GnRH effects on the synthesis and secretion of luteinizing hormone and follicle-stimulating hormone. A great deal is known about the GnRH receptor signaling network but GnRH is secreted in short pulses and much less is known about how gonadotropes decode this pulsatile signal. Similarly, single cell measures reveal considerable cell-cell heterogeneity in responses to GnRH but the impact of this variability on signaling is largely unknown. Ordinary differential equation-based mathematical models have been used to explore the decoding of pulse dynamics and information theory-derived statistical measures are increasingly used to address the influence of cell-cell variability on the amount of information transferred by signaling pathways. Here, we describe both approaches for GnRH signaling, with emphasis on novel insights gained from the information theoretic approach and on the fundamental question of why GnRH is secreted in pulses.

Exploring Dynamics and Noise in Gonadotropin-Releasing Hormone (GnRH) Signaling

Gonadotropin-releasing hormone (GnRH) acts via G-protein coupled receptors on pituitary gonadotropes. These are G_q-coupled receptors that mediate acute effects of GnRH on the exocytotic secretion of luteinizing hormone (LH) and follicle-stimulating hormone (FSH), as well as the chronic regulation of their synthesis. FSH and LH control steroidogenesis and gametogenesis in the gonads so GnRH mediates control of reproduction by the central nervous system. GnRH is secreted in short pulses and the effects of GnRH on its target cells are dependent on the dynamics of these pulses. Here we provide a brief overview of the signaling network activated by GnRH with emphasis on the use of high content imaging for their examination. We also describe computational approaches that we have used to simulate GnRH signaling in order to explore dynamics, noise, and information transfer in this system.

Linear Integration of ERK Activity Predominates over Persistence Detection in Fra-1 Regulation

ERK signaling regulates the expression of target genes, but it is unclear how ERK activity dynamics are interpreted. Here, we investigate this question using simultaneous, live, single-cell imaging of two ERK activity reporters and expression of Fra-1, a target gene controlling epithelial cell identity. We find that Fra-1 is expressed in proportion to the amplitude and duration of ERK activity. In contrast to previous "persistence detector" and "selective filter" models in which Fra-1 expression only occurs when ERK activity persists beyond a threshold duration, our observations demonstrate that the network regulating Fra-1 expression integrates total ERK activity and responds to it linearly. However, exploration of a generalized mathematical model of the Fra-1 coherent feedforward loop demonstrates that it can perform either linear integration or persistence detection, depending on the basal mRNA production rate and protein production delays. Our data indicate that significant basal expression and short delays cause Fra-1 to respond linearly to integrated ERK activity.

'Molecular habituation' as a potential mechanism of gradual homeostatic loss with age

•

Constitutive signals indicate homeostatic dysregulation but their effect on signal transduction remains largely unexplored.

•

A theoretical approach is undertaken to examine how oxidative stress may affect redox signal transduction.

•

Constitutive signals can result in a ‘molecular habituation’ effect that interferes with information transmission.

•

The robustness of such a theoretical observation to the underlying methodology hints at the generality of this principle.

The ability of reactive oxygen species (ROS) to cause molecular damage has meant that chronic oxidative stress has been mostly studied from the point of view of being a source of toxicity to the cell. However, the known duality of ROS molecules as both damaging agents and cellular redox signals implies another perspective in the study of sustained oxidative stress. This is a perspective of studying oxidative stress as a constitutive signal within the cell. In this work, we adopt a theoretical perspective as an exploratory and explanatory approach to examine how chronic oxidative stress can interfere with signal processing by redox signalling pathways in the cell. We report that constitutive signals can give rise to a ‘molecular habituation’ effect that can prime for a gradual loss of biological function. This is because a constitutive signal in the environment has the potential to reduce the responsiveness of a signalling pathway through the prolonged activation of negative regulators. Additionally, we demonstrate how this phenomenon is likely to occur in different signalling pathways exposed to persistent signals and furthermore at different levels of biological organisation.

Determining the Limitations and Benefits of Noise in Gene Regulation and Signal Transduction through Single Cell, Microscopy-Based Analysis

Stochastic fluctuations, termed "noise," in the level of biological molecules can greatly impact cellular functions. While biological noise can sometimes be detrimental, recent studies have provided an increasing number of examples in which biological noise can be functionally beneficial. Rather than provide an exhaustive review of the growing literature in this field, in this review, we focus on single-cell studies based on quantitative microscopy that have generated a deeper understanding of the sources, characteristics, limitations, and benefits of biological noise. Specifically, we highlight studies showing how noise can help coordinate the expression of multiple downstream target genes, impact the channel capacity of signaling networks, and interact synergistically with oscillatory dynamics to enhance the sensitivity of signal processing. We conclude with a discussion of current challenges and future opportunities.

Reversals and collisions optimize protein exchange in bacterial swarms

Swarming groups of bacteria coordinate their behavior by self-organizing as a population to move over surfaces in search of nutrients and optimal niches for colonization. Many open questions remain about the cues used by swarming bacteria to achieve this self-organization. While chemical cue signaling known as quorum sensing is well-described, swarming bacteria often act and coordinate on time scales that could not be achieved via these extracellular quorum sensing cues. Here, cell-cell contact-dependent protein exchange is explored as a mechanism of intercellular signaling for the bacterium Myxococcus xanthus. A detailed biologically calibrated computational model is used to study how M. xanthus optimizes the connection rate between cells and maximizes the spread of an extracellular protein within the population. The maximum rate of protein spreading is observed for cells that reverse direction optimally for swarming. Cells that reverse too slowly or too fast fail to spread extracellular protein efficiently. In particular, a specific range of cell reversal frequencies was observed to maximize the cell-cell connection rate and minimize the time of protein spreading. Furthermore, our findings suggest that predesigned motion reversal can be employed to enhance the collective behavior of biological synthetic active systems.

Information processing by simple molecular motifs and susceptibility to noise

Biological organisms rely on their ability to sense and respond appropriately to their environment. The molecular mechanisms that facilitate these essential processes are however subject to a range of random effects and stochastic processes, which jointly affect the reliability of information transmission between receptors and, for example, the physiological downstream response. Information is mathematically defined in terms of the entropy; and the extent of information flowing across an information channel or signalling system is typically measured by the 'mutual information', or the reduction in the uncertainty about the output once the input signal is known. Here, we quantify how extrinsic and intrinsic noise affects the transmission of simple signals along simple motifs of molecular interaction networks. Even for very simple systems, the effects of the different sources of variability alone and in combination can give rise to bewildering complexity. In particular, extrinsic variability is apt to generate 'apparent' information that can, in extreme cases, mask the actual information that for a single system would flow between the different molecular components making up cellular signalling pathways. We show how this artificial inflation in apparent information arises and how the effects of different types of noise alone and in combination can be understood.

Information theory in systems biology. Part I: Gene regulatory and metabolic networks

"A Mathematical Theory of Communication", was published in 1948 by Claude Shannon to establish a framework that is now known as information theory. In recent decades, information theory has gained much attention in the area of systems biology. The aim of this paper is to provide a systematic review of those contributions that have applied information theory in inferring or understanding of biological systems. Based on the type of system components and the interactions between them, we classify the biological systems into 4 main classes: gene regulatory, metabolic, protein-protein interaction and signaling networks. In the first part of this review, we attempt to introduce most of the existing studies on two types of biological networks, including gene regulatory and metabolic networks, which are founded on the concepts of information theory.

Information theory in systems biology. Part II: protein-protein interaction and signaling networks

By the development of information theory in 1948 by Claude Shannon to address the problems in the field of data storage and data communication over (noisy) communication channel, it has been successfully applied in many other research areas such as bioinformatics and systems biology. In this manuscript, we attempt to review some of the existing literatures in systems biology, which are using the information theory measures in their calculations. As we have reviewed most of the existing information-theoretic methods in gene regulatory and metabolic networks in the first part of the review, so in the second part of our study, the application of information theory in other types of biological networks including protein-protein interaction and signaling networks will be surveyed.

Limits on information transduction through amplitude and frequency regulation of transcription factor activity

Signaling pathways often transmit multiple signals through a single shared transcription factor (TF) and encode signal information by differentially regulating TF dynamics. However, signal information will be lost unless it can be reliably decoded by downstream genes. To understand the limits on dynamic information transduction, we apply information theory to quantify how much gene expression information the yeast TF Msn2 can transduce to target genes in the amplitude or frequency of its activation dynamics. We find that although the amount of information transmitted by Msn2 to single target genes is limited, information transduction can be increased by modulating promoter cis-elements or by integrating information from multiple genes. By correcting for extrinsic noise, we estimate an upper bound on information transduction. Overall, we find that information transduction through amplitude and frequency regulation of Msn2 is limited to error-free transduction of signal identity, but not signal intensity information.