Separating intrinsic from extrinsic fluctuations in dynamic biological systems

Immune quorum sensing dictates IFN-I response dynamics in human plasmacytoid dendritic cells

Type I interferons (IFN-Is) are key in fighting viral infections, but also serve major roles beyond antiviral immunity. Crucial is the tight regulation of IFN-I responses, while excessive levels are harmful to the cells. In essence, immune responses are generated by single cells making their own decisions, which are based on the signals they perceive. Additionally, immune cells must anticipate the future state of their environment, thereby weighing the costs and benefits of each possible outcome, in the presence of other potentially competitive decision makers (i.e., IFN-I producing cells). A rather new cellular communication mechanism called quorum sensing describes the effect of cell density on cellular secretory behaviors, which fits well with matching the right amount of IFN-Is produced to fight an infection. More competitive decision makers must contribute relatively less and vice versa. Intrigued by this concept, we assessed the effects of immune quorum sensing in pDCs, specialized immune cells known for their ability to mass produce IFN-Is. Using conventional microwell assays and droplet-based microfluidics assays, we were able the characterize the effect of quorum sensing in human primary immune cells in vitro. These insights open new avenues to manipulate IFN-I response dynamics in pathological conditions affected by aberrant IFN-I signaling.

Analysis of a detailed multi-stage model of stochastic gene expression using queueing theory and model reduction

We introduce a biologically detailed, stochastic model of gene expression describing the multiple rate-limiting steps of transcription, nuclear pre-mRNA processing, nuclear mRNA export, cytoplasmic mRNA degradation and translation of mRNA into protein. The processes in sub-cellular compartments are described by an arbitrary number of processing stages, thus accounting for a significantly finer molecular description of gene expression than conventional models such as the telegraph, two-stage and three-stage models of gene expression. We use two distinct tools, queueing theory and model reduction using the slow-scale linear-noise approximation, to derive exact or approximate analytic expressions for the moments or distributions of nuclear mRNA, cytoplasmic mRNA and protein fluctuations, as well as lower bounds for their Fano factors in steady-state conditions. We use these to study the phase diagram of the stochastic model; in particular we derive parametric conditions determining three types of transitions in the properties of mRNA fluctuations: from sub-Poissonian to super-Poissonian noise, from high noise in the nucleus to high noise in the cytoplasm, and from a monotonic increase to a monotonic decrease of the Fano factor with the number of processing stages. In contrast, protein fluctuations are always super-Poissonian and show weak dependence on the number of mRNA processing stages. Our results delineate the region of parameter space where conventional models give qualitatively incorrect results and provide insight into how the number of processing stages, e.g. the number of rate-limiting steps in initiation, splicing and mRNA degradation, shape stochastic gene expression by modulation of molecular memory.

Advanced methods for gene network identification and noise decomposition from single-cell data

Central to analyzing noisy gene expression systems is solving the Chemical Master Equation (CME), which characterizes the probability evolution of the reacting species' copy numbers. Solving CMEs for high-dimensional systems suffers from the curse of dimensionality. Here, we propose a computational method for improved scalability through a divide-and-conquer strategy that optimally decomposes the whole system into a leader system and several conditionally independent follower subsystems. The CME is solved by combining Monte Carlo estimation for the leader system with stochastic filtering procedures for the follower subsystems. We demonstrate this method with high-dimensional numerical examples and apply it to identify a yeast transcription system at the single-cell resolution, leveraging mRNA time-course experimental data. The identification results enable an accurate examination of the heterogeneity in rate parameters among isogenic cells. To validate this result, we develop a noise decomposition technique exploiting time-course data but requiring no supplementary components, e.g., dual-reporters.

Noise Reduction in Resource-Coupled Multi-Module Gene Circuits through Antithetic Feedback Control

Gene circuits within the same host cell often experience coupling, stemming from the competition for limited resources during transcriptional and translational processes. This resource competition introduces an additional layer of noise to gene expression. Here we present three multi-module antithetic control strategies: negatively competitive regulation (NCR) controller, alongside local and global controllers, aimed at reducing the gene expression noise within the context of resource competition. Through stochastic simulations and fluctuation-dissipation theorem (FDT) analysis, our findings highlight the superior performance of the NCR antithetic controller in reducing noise levels. Our research provides an effective control strategy for attenuating resource-driven noise and offers insight into the development of robust gene circuits.

Unraveling IFN-I response dynamics and TNF crosstalk in the pathophysiology of systemic lupus erythematosus

Introduction

The innate immune system serves the crucial first line of defense against a wide variety of potential threats, during which the production of pro-inflammatory cytokines IFN-I and TNFα are key. This astonishing power to fight invaders, however, comes at the cost of risking IFN-I-related pathologies, such as observed during autoimmune diseases, during which IFN-I and TNFα response dynamics are dysregulated. Therefore, these response dynamics must be tightly regulated, and precisely matched with the potential threat. This regulation is currently far from understood.

Methods

Using droplet-based microfluidics and ODE modeling, we studied the fundamentals of single-cell decision-making upon TLR signaling in human primary immune cells (n = 23). Next, using biologicals used for treating autoimmune diseases [i.e., anti-TNFα, and JAK inhibitors], we unraveled the crosstalk between IFN-I and TNFα signaling dynamics. Finally, we studied primary immune cells isolated from SLE patients (n = 8) to provide insights into SLE pathophysiology.

Results

single-cell IFN-I and TNFα response dynamics display remarkable differences, yet both being highly heterogeneous. Blocking TNFα signaling increases the percentage of IFN-I-producing cells, while blocking IFN-I signaling decreases the percentage of TNFα-producing cells. Single-cell decision-making in SLE patients is dysregulated, pointing towards a dysregulated crosstalk between IFN-I and TNFα response dynamics.

Discussion

We provide a solid droplet-based microfluidic platform to study inherent immune secretory behaviors, substantiated by ODE modeling, which can challenge the conceptualization within and between different immune signaling systems. These insights will build towards an improved fundamental understanding on single-cell decision-making in health and disease.

Gene expression flux analysis reveals specific regulatory modalities of gene expression

The level of a given protein is determined by the synthesis and degradation rates of its mRNA and protein. While several studies have quantified the contribution of different gene expression steps in regulating protein levels, these are limited by using equilibrium approximations in out-of-equilibrium biological systems. Here, we introduce gene expression flux analysis to quantitatively dissect the dynamics of the expression level for specific proteins and use it to analyze published transcriptomics and proteomics datasets. Our analysis reveals distinct regulatory modalities shared by sets of genes with clear functional signatures. We also find that protein degradation plays a stronger role than expected in the adaptation of protein levels. These findings suggest that shared regulatory strategies can lead to versatile responses at the protein level and highlight the importance of going beyond equilibrium approximations to dissect the quantitative contribution of different steps of gene expression to protein dynamics.

Studying stochastic systems biology of the cell with single-cell genomics data

Recent experimental developments in genome-wide RNA quantification hold considerable promise for systems biology. However, rigorously probing the biology of living cells requires a unified mathematical framework that accounts for single-molecule biological stochasticity in the context of technical variation associated with genomics assays. We review models for a variety of RNA transcription processes, as well as the encapsulation and library construction steps of microfluidics-based single-cell RNA sequencing, and present a framework to integrate these phenomena by the manipulation of generating functions. Finally, we use simulated scenarios and biological data to illustrate the implications and applications of the approach.

Theoretical and computational tools to model multistable gene regulatory networks

The last decade has witnessed a surge of theoretical and computational models to describe the dynamics of complex gene regulatory networks, and how these interactions can give rise to multistable and heterogeneous cell populations. As the use of theoretical modeling to describe genetic and biochemical circuits becomes more widespread, theoreticians with mathematical and physical backgrounds routinely apply concepts from statistical physics, non-linear dynamics, and network theory to biological systems. This review aims at providing a clear overview of the most important methodologies applied in the field while highlighting current and future challenges. It also includes hands-on tutorials to solve and simulate some of the archetypical biological system models used in the field. Furthermore, we provide concrete examples from the existing literature for theoreticians that wish to explore this fast-developing field. Whenever possible, we highlight the similarities and differences between biochemical and regulatory networks and 'classical' systems typically studied in non-equilibrium statistical and quantum mechanics.

Out-of-equilibrium gene expression fluctuations in the presence of extrinsic noise

Cell-to-cell variability in protein concentrations is strongly affected by extrinsic noise, especially for highly expressed genes. Extrinsic noise can be due to fluctuations of several possible cellular factors connected to cell physiology and to the level of key enzymes in the expression process. However, how to identify the predominant sources of extrinsic noise in a biological system is still an open question. This work considers a general stochastic model of gene expression with extrinsic noise represented as fluctuations of the different model rates, and focuses on the out-of-equilibrium expression dynamics. Combining analytical calculations with stochastic simulations, we characterize how extrinsic noise shapes the protein variability during gene activation or inactivation, depending on the prevailing source of extrinsic variability, on its intensity and timescale. In particular, we show that qualitatively different noise profiles can be identified depending on which are the fluctuating parameters. This indicates an experimentally accessible way to pinpoint the dominant sources of extrinsic noise using time-coarse experiments.

A Noise-Tolerating Gene Association Network Uncovering an Oncogenic Regulatory Motif in Lymphoma Transcriptomics

In cancer genomics research, gene expressions provide clues to gene regulations implicating patients' risk of survival. Gene expressions, however, fluctuate due to noises arising internally and externally, making their use to infer gene associations, hence regulation mechanisms, problematic. Here, we develop a new regression approach to model gene association networks while considering uncertain biological noises. In a series of simulation experiments accounting for varying levels of biological noises, the new method was shown to be robust and perform better than conventional regression methods, as judged by a number of statistical measures on unbiasedness, consistency and accuracy. Application to infer gene associations in germinal-center B cells led to the discovery of a three-by-two regulatory motif gene expression and a three-gene prognostic signature for diffuse large B-cell lymphoma.

Studying stochastic systems biology of the cell with single-cell genomics data

Recent experimental developments in genome-wide RNA quantification hold considerable promise for systems biology. However, rigorously probing the biology of living cells requires a unified mathematical framework that accounts for single-molecule biological stochasticity in the context of technical variation associated with genomics assays. We review models for a variety of RNA transcription processes, as well as the encapsulation and library construction steps of microfluidics-based single-cell RNA sequencing, and present a framework to integrate these phenomena by the manipulation of generating functions. Finally, we use simulated scenarios and biological data to illustrate the implications and applications of the approach.

Interpretable and tractable models of transcriptional noise for the rational design of single-molecule quantification experiments

The question of how cell-to-cell differences in transcription rate affect RNA count distributions is fundamental for understanding biological processes underlying transcription. Answering this question requires quantitative models that are both interpretable (describing concrete biophysical phenomena) and tractable (amenable to mathematical analysis). This enables the identification of experiments which best discriminate between competing hypotheses. As a proof of principle, we introduce a simple but flexible class of models involving a continuous stochastic transcription rate driving a discrete RNA transcription and splicing process, and compare and contrast two biologically plausible hypotheses about transcription rate variation. One assumes variation is due to DNA experiencing mechanical strain, while the other assumes it is due to regulator number fluctuations. We introduce a framework for numerically and analytically studying such models, and apply Bayesian model selection to identify candidate genes that show signatures of each model in single-cell transcriptomic data from mouse glutamatergic neurons.

Synthetic biology by controller design

Natural biological systems display complex regulation and synthetic biomolecular systems have been used to understand their natural counterparts and to parse sophisticated regulations into core design principles. At the same time, the engineering of biomolecular systems has unarguable potential to transform current and to enable new, yet-to-be-imagined, biotechnology applications. In this review, we discuss the progression of control systems design in synthetic biology, from the purpose of understanding the function of naturally occurring regulatory motifs to that of creating genetic circuits whose function is sufficiently robust for biotechnology applications.

Molecular Origins of Transcriptional Heterogeneity in Diazotrophic Klebsiella oxytoca

Phenotypic heterogeneity in clonal bacterial batch cultures has been shown for a range of bacterial systems; however, the molecular origins of such heterogeneity and its magnitude are not well understood. Under conditions of extreme low-nitrogen stress in the model diazotroph Klebsiella oxytoca, we found remarkably high heterogeneity of nifHDK gene expression, which codes for the structural genes of nitrogenase, one key enzyme of the global nitrogen cycle. This heterogeneity limited the bulk observed nitrogen-fixing capacity of the population. Using dual-probe, single-cell RNA fluorescent in situ hybridization, we correlated nifHDK expression with that of nifLA and glnK-amtB, which code for the main upstream regulatory components. Through stochastic transcription models and mutual information analysis, we revealed likely molecular origins for heterogeneity in nitrogenase expression. In the wild type and regulatory variants, we found that nifHDK transcription was inherently bursty, but we established that noise propagation through signaling was also significant. The regulatory gene glnK had the highest discernible effect on nifHDK variance, while noise from factors outside the regulatory pathway were negligible. Understanding the basis of inherent heterogeneity of nitrogenase expression and its origins can inform biotechnology strategies seeking to enhance biological nitrogen fixation. Finally, we speculate on potential benefits of diazotrophic heterogeneity in natural soil environments. IMPORTANCE Nitrogen is an essential micronutrient for both plant and animal life and naturally exists in both reactive and inert chemical forms. Modern agriculture is heavily reliant on nitrogen that has been "fixed" into a reactive form via the energetically expensive Haber-Bosch process, with significant environmental consequences. Nitrogen-fixing bacteria provide an alternative source of fixed nitrogen for use in both biotechnological and agricultural settings, but this relies on a firm understanding of how the fixation process is regulated within individual bacterial cells. We examined the cell-to-cell variability in the nitrogen-fixing behavior of Klebsiella oxytoca, a free-living bacterium. The significance of our research is in identifying not only the presence of marked variability but also the specific mechanisms that give rise to it. This understanding gives insight into both the evolutionary advantages of variable behavior as well as strategies for biotechnological applications.

The chemical Langevin equation for biochemical systems in dynamic environments

Modelling and simulation of complex biochemical reaction networks form cornerstones of modern biophysics. Many of the approaches developed so far capture temporal fluctuations due to the inherent stochasticity of the biophysical processes, referred to as intrinsic noise. Stochastic fluctuations, however, predominantly stem from the interplay of the network with many other - and mostly unknown - fluctuating processes, as well as with various random signals arising from the extracellular world; these sources contribute extrinsic noise. Here we provide a computational simulation method to probe the stochastic dynamics of biochemical systems subject to both intrinsic and extrinsic noise. We develop an extrinsic chemical Langevin equation-a physically motivated extension of the chemical Langevin equation- to model intrinsically noisy reaction networks embedded in a stochastically fluctuating environment. The extrinsic CLE is a continuous approximation to the Chemical Master Equation (CME) with time-varying propensities. In our approach, noise is incorporated at the level of the CME, and can account for the full dynamics of the exogenous noise process, irrespective of timescales and their mismatches. We show that our method accurately captures the first two moments of the stationary probability density when compared with exact stochastic simulation methods, while reducing the computational runtime by several orders of magnitude. Our approach provides a method that is practical, computationally efficient and physically accurate to study systems that are simultaneously subject to a variety of noise sources.

Mutual information in changing environments: Nonlinear interactions, out-of-equilibrium systems, and continuously varying diffusivities

Biochemistry, ecology, and neuroscience are examples of prominent fields aiming at describing interacting systems that exhibit nontrivial couplings to complex, ever-changing environments. We have recently shown that linear interactions and a switching environment are encoded separately in the mutual information of the overall system. Here we first generalize these findings to a broad class of nonlinear interacting models. We find that a new term in the mutual information appears, quantifying the interplay between nonlinear interactions and environmental changes, and leading to either constructive or destructive information interference. Furthermore, we show that a higher mutual information emerges in out-of-equilibrium environments with respect to an equilibrium scenario. Finally, we generalize our framework to the case of continuously varying environments. We find that environmental changes can be mapped exactly into an effective spatially varying diffusion coefficient, shedding light on modeling of biophysical systems in inhomogeneous media.

Using network synchrony to identify drivers of social dynamics

Social animals frequently show dynamic social network patterns, the consequences of which are felt at the individual and group level. It is often difficult, however, to identify what drivers are responsible for changes in these networks. We suggest that patterns of network synchronization across multiple social groups can be used to better understand the relative contributions of extrinsic and intrinsic drivers. When groups are socially separated, but share similar physical environments, the extent to which network measures across multiple groups covary (i.e. network synchrony) can provide an estimate of the relative roles of extrinsic and intrinsic drivers. As a case example, we use allogrooming data from three adjacent vervet monkey groups to generate dynamic social networks. We found that network strength was strongly synchronized across the three groups, pointing to shared extrinsic environmental conditions as the driver. We also found low to moderate levels of synchrony in network modularity, suggesting that intrinsic social processes may be more important in driving changes in subgroup formation in this population. We conclude that patterns of network synchronization can help guide future research in identifying the proximate mechanisms behind observed social dynamics in animal groups.

Intrinsic entropy model for feature selection of scRNA-seq data

Recent advances of single-cell RNA sequencing (scRNA-seq) technologies have led to extensive study of cellular heterogeneity and cell-to-cell variation. However, the high frequency of dropout events and noise in scRNA-seq data confounds the accuracy of the downstream analysis, i.e. clustering analysis, whose accuracy depends heavily on the selected feature genes. Here, by deriving an entropy decomposition formula, we propose a feature selection method, i.e. an intrinsic entropy (IE) model, to identify the informative genes for accurately clustering analysis. Specifically, by eliminating the 'noisy' fluctuation or extrinsic entropy (EE), we extract the IE of each gene from the total entropy (TE), i.e. TE = IE + EE. We show that the IE of each gene actually reflects the regulatory fluctuation of this gene in a cellular process, and thus high-IE genes provide rich information on cell type or state analysis. To validate the performance of the high-IE genes, we conduct computational analysis on both simulated datasets and real single-cell datasets by comparing with other representative methods. The results show that our IE model is not only broadly applicable and robust for different clustering and classification methods, but also sensitive for novel cell types. Our results also demonstrate that the intrinsic entropy/fluctuation of a gene serves as information rather than noise in contrast to its total entropy/fluctuation.

Receptor time integration via discrete sampling

Living cells can measure chemical concentrations with remarkable accuracy, even though these measurements are inherently noisy due to the stochastic binding of the ligand to the receptor. A widely used mechanism for reducing the sensing error is to increase the effective number of measurements via receptor time integration. This mechanism is implemented via the signaling network downstream of the receptor, yet how it is implemented optimally given constraints on cellular resources such as protein copies and time remains unknown. To address this question, we employ our sampling framework [Govern and ten Wolde, Proc. Natl. Acad. Sci. USA 111, 17486 (2014)PNASA60027-842410.1073/pnas.1411524111] and extend it here to time-varying ligand concentrations. This framework starts from the observation that the signaling network implements the mechanism of time integration by discretely sampling the ligand-binding state of the receptor and storing these states into chemical modification states of the readout molecules downstream. It reveals that the sensing error has two distinct contributions: a sampling error, which is determined by the number of samples, their independence, and their accuracy, and a dynamical error, which depends on the timescale that these samples are generated. We test our previously identified design principle, which states that in an optimally designed system the number of receptors and their integration time, which determine the number of independent concentration measurements at the receptor level, equals the number of readout proteins, which store these measurements. We show that this principle is robust to the dynamics of the input and the relative costs of the receptor and readout proteins: these resources are fundamental and cannot compensate each other.

Scalable and flexible inference framework for stochastic dynamic single-cell models

Understanding the inherited nature of how biological processes dynamically change over time and exhibit intra- and inter-individual variability, due to the different responses to environmental stimuli and when interacting with other processes, has been a major focus of systems biology. The rise of single-cell fluorescent microscopy has enabled the study of those phenomena. The analysis of single-cell data with mechanistic models offers an invaluable tool to describe dynamic cellular processes and to rationalise cell-to-cell variability within the population. However, extracting mechanistic information from single-cell data has proven difficult. This requires statistical methods to infer unknown model parameters from dynamic, multi-individual data accounting for heterogeneity caused by both intrinsic (e.g. variations in chemical reactions) and extrinsic (e.g. variability in protein concentrations) noise. Although several inference methods exist, the availability of efficient, general and accessible methods that facilitate modelling of single-cell data, remains lacking. Here we present a scalable and flexible framework for Bayesian inference in state-space mixed-effects single-cell models with stochastic dynamic. Our approach infers model parameters when intrinsic noise is modelled by either exact or approximate stochastic simulators, and when extrinsic noise is modelled by either time-varying, or time-constant parameters that vary between cells. We demonstrate the relevance of our approach by studying how cell-to-cell variation in carbon source utilisation affects heterogeneity in the budding yeast Saccharomyces cerevisiae SNF1 nutrient sensing pathway. We identify hexokinase activity as a source of extrinsic noise and deduce that sugar availability dictates cell-to-cell variability.

Epigenetic fluctuations underlie gene expression timescales and variability

Isogenic populations of mammalian cells exhibit significant gene expression variability. This variability can be separated into two sources, cis, or allele-specific sources, and trans and global processes. Furthermore, each source of variability has its own timescale. Fast timescales will result in rapid fluctuation of gene expression whereas slow timescales will result in longer persistence of gene expression levels over time. Here we investigated sources of gene expression that are intrinsic, i.e. coming from cis-regulatory factors and follow slow timescales. To do so, we developed a reporter system that isolates allele-specific variability and measures its persistence in imaging and long-term fluctuation analysis experiments. Our results identify a new source of gene expression variability that is allele-specific but that is fluctuating on timescales of days. We hypothesized that allele-specific fluctuations of epigenetic regulatory factors are responsible for the newly discovered allele-specific and slow source of gene expression variability. Using mathematical modeling we showed that the addition of this effect to the two-state model is sufficient to account for all empirical observation. Furthermore, using direct assays of chromatin markers we find fluctuation in H3K4me3 levels that match the observed changes in gene expression levels providing direct experimental support of our model. Collectively, our work shows that slow fluctuations of regulatory chromatin modifications contribute to the variability in gene expression.

Double-edged role of resource competition in gene expression noise and control

Despite extensive investigation demonstrating that resource competition can significantly alter the deterministic behaviors of synthetic gene circuits, it remains unclear how resource competition contributes to the gene expression noise and how this noise can be controlled. Utilizing a two-gene circuit as a prototypical system, we uncover a surprising double-edged role of resource competition in gene expression noise: competition decreases noise through introducing a resource constraint but generates its own type of noise which we name as "resource competitive noise." Utilization of orthogonal resources enables retainment of the noise reduction conferred by resource constraint while removing the added resource competitive noise. The noise reduction effects are studied using three negative feedback types: negatively competitive regulation (NCR), local, and global controllers, each having four placement architectures in the protein biosynthesis pathway (mRNA or protein inhibition on transcription or translation). Our results show that both local and NCR controllers with mRNA-mediated inhibition are efficacious at reducing noise, with NCR controllers demonstrating a superior noise-reduction capability. We also find that combining feedback controllers with orthogonal resources can improve the local controllers. This work provides deep insights into the origin of stochasticity in gene circuits with resource competition and guidance for developing effective noise control strategies.

Kel1 is a phosphorylation-regulated noise suppressor of the pheromone signaling pathway

Mechanisms have evolved that allow cells to detect signals and generate an appropriate response. The accuracy of these responses relies on the ability of cells to discriminate between signal and noise. How cells filter noise in signaling pathways is not well understood. Here, we analyze noise suppression in the yeast pheromone signaling pathway and show that the poorly characterized protein Kel1 serves as a major noise suppressor and prevents cell death. At the molecular level, Kel1 prevents spontaneous activation of the pheromone response by inhibiting membrane recruitment of Ste5 and Far1. Only a hypophosphorylated form of Kel1 suppresses signaling, reduces noise, and prevents pheromone-associated cell death, and our data indicate that the MAPK Fus3 contributes to Kel1 phosphorylation. Taken together, Kel1 serves as a phospho-regulated suppressor of the pheromone pathway to reduce noise, inhibit spontaneous activation of the pathway, regulate mating efficiency, and prevent pheromone-associated cell death.

A single-cell resolved cell-cell communication model explains lineage commitment in hematopoiesis

Cells do not make fate decisions independently. Arguably, every cell-fate decision occurs in response to environmental signals. In many cases, cell-cell communication alters the dynamics of the internal gene regulatory network of a cell to initiate cell-fate transitions, yet models rarely take this into account. Here, we have developed a multiscale perspective to study the granulocyte-monocyte versus megakaryocyte-erythrocyte fate decisions. This transition is dictated by the GATA1-PU.1 network: a classical example of a bistable cell-fate system. We show that, for a wide range of cell communication topologies, even subtle changes in signaling can have pronounced effects on cell-fate decisions. We go on to show how cell-cell coupling through signaling can spontaneously break the symmetry of a homogenous cell population. Noise, both intrinsic and extrinsic, shapes the decision landscape profoundly, and affects the transcriptional dynamics underlying this important hematopoietic cell-fate decision-making system.

This article has an associated ‘The people behind the papers’ interview.

Summary: Through theory and computational modeling, cell-cell communication is revealed to be a crucial and under-appreciated determinant of cell-fate decision-making during hematopoiesis.

Mutual Information Disentangles Interactions from Changing Environments

Real-world systems are characterized by complex interactions of their internal degrees of freedom, while living in ever-changing environments whose net effect is to act as additional couplings. Here, we introduce a paradigmatic interacting model in a switching, but unobserved, environment. We show that the limiting properties of the mutual information of the system allow for a disentangling of these two sources of couplings. Further, our approach might stand as a general method to discriminate complex internal interactions from equally complex changing environments.

Inferring gene regulation dynamics from static snapshots of gene expression variability

Inferring functional relationships within complex networks from static snapshots of a subset of variables is a ubiquitous problem in science. For example, a key challenge of systems biology is to translate cellular heterogeneity data obtained from single-cell sequencing or flow-cytometry experiments into regulatory dynamics. We show how static population snapshots of covariability can be exploited to rigorously infer properties of gene expression dynamics when gene expression reporters probe their upstream dynamics on separate timescales. This can be experimentally exploited in dual-reporter experiments with fluorescent proteins of unequal maturation times, thus turning an experimental bug into an analysis feature. We derive correlation conditions that detect the presence of closed-loop feedback regulation in gene regulatory networks. Furthermore, we show how genes with cell-cycle-dependent transcription rates can be identified from the variability of coregulated fluorescent proteins. Similar correlation constraints might prove useful in other areas of science in which static correlation snapshots are used to infer causal connections between dynamically interacting components.

Pathway dynamics can delineate the sources of transcriptional noise in gene expression

Single-cell expression profiling opens up new vistas on cellular processes. Extensive cell-to-cell variability at the transcriptomic and proteomic level has been one of the stand-out observations. Because most experimental analyses are destructive we only have access to snapshot data of cellular states. This loss of temporal information presents significant challenges for inferring dynamics, as well as causes of cell-to-cell variability. In particular, we typically cannot separate dynamic variability from within cells ('intrinsic noise') from variability across the population ('extrinsic noise'). Here, we make this non-identifiability mathematically precise, allowing us to identify new experimental set-ups that can assist in resolving this non-identifiability. We show that multiple generic reporters from the same biochemical pathways (e.g. mRNA and protein) can infer magnitudes of intrinsic and extrinsic transcriptional noise, identifying sources of heterogeneity. Stochastic simulations support our theory, and demonstrate that 'pathway-reporters' compare favourably to the well-known, but often difficult to implement, dual-reporter method.

Noise distorts the epigenetic landscape and shapes cell-fate decisions

The Waddington epigenetic landscape has become an iconic representation of the cellular differentiation process. Recent single-cell transcriptomic data provide new opportunities for quantifying this originally conceptual tool, offering insight into the gene regulatory networks underlying cellular development. While many methods for constructing the landscape have been proposed, by far the most commonly employed approach is based on computing the landscape as the negative logarithm of the steady-state probability distribution. Here, we use simple models to highlight the complexities and limitations that arise when reconstructing the potential landscape in the presence of stochastic fluctuations. We consider how the landscape changes in accordance with different stochastic systems and show that it is the subtle interplay between the deterministic and stochastic components of the system that ultimately shapes the landscape. We further discuss how the presence of noise has important implications for the identifiability of the regulatory dynamics from experimental data. A record of this paper's transparent peer review process is included in the supplemental information.

Mechanobiological conceptual framework for assessing stem cell bioprocess effectiveness

Fully realizing the enormous potential of stem cells requires developing efficient bioprocesses and optimizations founded in mechanobiological considerations. Here, we emphasize the importance of mechanotransduction as one of the governing principles of stem cell bioprocesses, underscoring the need to further explore the behavioral mechanisms involved in sensing mechanical cues and coordinating transcriptional responses. We identify the sources of intrinsic, extrinsic, and external noise in bioprocesses requiring further study, and discuss the criteria and indicators that may be used to assess and predict cell-to-cell variability resulting from environmental fluctuations. Specifically, we propose a conceptual framework to explain the impact of mechanical forces within the cellular environment, identify key cell state determinants in bioprocesses, and discuss downstream implementation challenges.

Quantitative imaging of RNA polymerase II activity in plants reveals the single-cell basis of tissue-wide transcriptional dynamics

The responses of plants to their environment are often dependent on the spatiotemporal dynamics of transcriptional regulation. While live-imaging tools have been used extensively to quantitatively capture rapid transcriptional dynamics in living animal cells, the lack of implementation of these technologies in plants has limited concomitant quantitative studies in this kingdom. Here, we applied the PP7 and MS2 RNA-labelling technologies for the quantitative imaging of RNA polymerase II activity dynamics in single cells of living plants as they respond to experimental treatments. Using this technology, we counted nascent RNA transcripts in real time in Nicotiana benthamiana (tobacco) and Arabidopsis thaliana. Examination of heat shock reporters revealed that plant tissues respond to external signals by modulating the proportion of cells that switch from an undetectable basal state to a high-transcription state, instead of modulating the rate of transcription across all cells in a graded fashion. This switch-like behaviour, combined with cell-to-cell variability in transcription rate, results in mRNA production variability spanning three orders of magnitude. We determined that cellular heterogeneity stems mainly from stochasticity intrinsic to individual alleles instead of variability in cellular composition. Together, our results demonstrate that it is now possible to quantitatively study the dynamics of transcriptional programs in single cells of living plants.

Noise suppression in stochastic genetic circuits using PID controllers

Inside individual cells, protein population counts are subject to molecular noise due to low copy numbers and the inherent probabilistic nature of biochemical processes. We investigate the effectiveness of proportional, integral and derivative (PID) based feedback controllers to suppress protein count fluctuations originating from two noise sources: bursty expression of the protein, and external disturbance in protein synthesis. Designs of biochemical reactions that function as PID controllers are discussed, with particular focus on individual controllers separately, and the corresponding closed-loop system is analyzed for stochastic controller realizations. Our results show that proportional controllers are effective in buffering protein copy number fluctuations from both noise sources, but this noise suppression comes at the cost of reduced static sensitivity of the output to the input signal. In contrast, integral feedback has no effect on the protein noise level from stochastic expression, but significantly minimizes the impact of external disturbances, particularly when the disturbance comes at low frequencies. Counter-intuitively, integral feedback is found to amplify external disturbances at intermediate frequencies. Next, we discuss the design of a coupled feedforward-feedback biochemical circuit that approximately functions as a derivate controller. Analysis using both analytical methods and Monte Carlo simulations reveals that this derivative controller effectively buffers output fluctuations from bursty stochastic expression, while maintaining the static input-output sensitivity of the open-loop system. In summary, this study provides a systematic stochastic analysis of biochemical controllers, and paves the way for their synthetic design and implementation to minimize deleterious fluctuations in gene product levels.

In the noisy cellular environment, biochemical species such as genes, RNAs and proteins that often occur at low molecular counts, are subject to considerable stochastic fluctuations in copy numbers over time. How cellular biochemical processes function reliably in the face of such randomness is an intriguing fundamental problem. Increasing evidence suggests that random fluctuations (noise) in protein copy numbers play important functional roles, such as driving genetically identical cells to different cell fates. Moreover, many disease states have been attributed to elevated noise levels in specific proteins. Here we systematically investigate design of biochemical systems that function as proportional, integral and derivative-based feedback controllers to suppress protein count fluctuations arising from bursty expression of the protein and external disturbance in protein synthesis. Our results show that different controllers are effective in buffering different noise components, and identify ranges of feedback gain for minimizing deleterious fluctuations in protein levels.

Maximization of information transmission influences selection of native phosphorelay architectures

Phosphorelays are signal transduction circuits that sense environmental changes and adjust cellular metabolism. Five different circuit architectures account for 99% of all phosphorelay operons annotated in over 9,000 fully sequenced genomes. Here we asked what biological design principles, if any, could explain selection among those architectures in nature. We began by studying kinetically well characterized phosphorelays (Spo0 of Bacillus subtilis and Sln1 of Saccharomyces cerevisiae). We find that natural circuit architecture maximizes information transmission in both cases. We use mathematical models to compare information transmission among the architectures for a realistic range of concentration and parameter values. Mapping experimentally determined phosphorelay protein concentrations onto that range reveals that the native architecture maximizes information transmission in sixteen out of seventeen analyzed phosphorelays. These results suggest that maximization of information transmission is important in the selection of native phosphorelay architectures, parameter values and protein concentrations.

Single-molecule imaging of LexA degradation in Escherichia coli elucidates regulatory mechanisms and heterogeneity of the SOS response

The bacterial SOS response stands as a paradigm of gene networks controlled by a master transcriptional regulator. Self-cleavage of the SOS repressor, LexA, induces a wide range of cell functions that are critical for survival and adaptation when bacteria experience stress conditions¹, including DNA repair², mutagenesis^3,4, horizontal gene transfer^5–7, filamentous growth, and the induction of bacterial toxins^8–12, toxin-antitoxin systems¹³, virulence factors^6,14, and prophages^15–17. SOS induction is also implicated in biofilm formation and antibiotic persistence^11,18–20. Considering the fitness burden of these functions, it is surprising that the expression of LexA-regulated genes is highly variable across cells^10,21–23 and that cell subpopulations induce the SOS response spontaneously even in the absence of stress exposure^{9,11,12,16,24,25}. Whether this reflects a population survival strategy or a regulatory inaccuracy is unclear, as are the mechanisms underlying SOS heterogeneity. Here, we developed a single-molecule imaging approach based on a HaloTag fusion to directly monitor LexA inside live Escherichia coli cells, demonstrating the existence of 3 main states of LexA: DNA-bound stationary molecules, free LexA and degraded LexA species. These analyses elucidate the mechanisms by which DNA-binding and degradation of LexA regulate the SOS response in vivo. We show that self-cleavage of LexA occurs frequently throughout the population during unperturbed growth, rather than being restricted to a subpopulation of cells, which causes substantial cell-to-cell variation in LexA abundances. LexA variability underlies SOS gene expression heterogeneity and triggers spontaneous SOS pulses, which enhance bacterial survival in anticipation of stress.

Bivalent chromatin as a therapeutic target in cancer: An in silico predictive approach for combining epigenetic drugs

Tumour cell heterogeneity is a major barrier for efficient design of targeted anti-cancer therapies. A diverse distribution of phenotypically distinct tumour-cell subpopulations prior to drug treatment predisposes to non-uniform responses, leading to the elimination of sensitive cancer cells whilst leaving resistant subpopulations unharmed. Few strategies have been proposed for quantifying the variability associated to individual cancer-cell heterogeneity and minimizing its undesirable impact on clinical outcomes. Here, we report a computational approach that allows the rational design of combinatorial therapies involving epigenetic drugs against chromatin modifiers. We have formulated a stochastic model of a bivalent transcription factor that allows us to characterise three different qualitative behaviours, namely: bistable, high- and low-gene expression. Comparison between analytical results and experimental data determined that the so-called bistable and high-gene expression behaviours can be identified with undifferentiated and differentiated cell types, respectively. Since undifferentiated cells with an aberrant self-renewing potential might exhibit a cancer/metastasis-initiating phenotype, we analysed the efficiency of combining epigenetic drugs against the background of heterogeneity within the bistable sub-ensemble. Whereas single-targeted approaches mostly failed to circumvent the therapeutic problems represented by tumour heterogeneity, combinatorial strategies fared much better. Specifically, the more successful combinations were predicted to involve modulators of the histone H3K4 and H3K27 demethylases KDM5 and KDM6A/UTX. Those strategies involving the H3K4 and H3K27 methyltransferases MLL2 and EZH2, however, were predicted to be less effective. Our theoretical framework provides a coherent basis for the development of an in silico platform capable of identifying the epigenetic drugs combinations best-suited to therapeutically manage non-uniform responses of heterogenous cancer cell populations.

An in vitro model of tumor heterogeneity resolves genetic, epigenetic, and stochastic sources of cell state variability

Tumor heterogeneity is a primary cause of treatment failure and acquired resistance in cancer patients. Even in cancers driven by a single mutated oncogene, variability in response to targeted therapies is well known. The existence of additional genomic alterations among tumor cells can only partially explain this variability. As such, nongenetic factors are increasingly seen as critical contributors to tumor relapse and acquired resistance in cancer. Here, we show that both genetic and nongenetic factors contribute to targeted drug response variability in an experimental model of tumor heterogeneity. We observe significant variability to epidermal growth factor receptor (EGFR) inhibition among and within multiple versions and clonal sublines of PC9, a commonly used EGFR mutant nonsmall cell lung cancer (NSCLC) cell line. We resolve genetic, epigenetic, and stochastic components of this variability using a theoretical framework in which distinct genetic states give rise to multiple epigenetic "basins of attraction," across which cells can transition driven by stochastic noise. Using mutational impact analysis, single-cell differential gene expression, and correlations among Gene Ontology (GO) terms to connect genomics to transcriptomics, we establish a baseline for genetic differences driving drug response variability among PC9 cell line versions. Applying the same approach to clonal sublines, we conclude that drug response variability in all but one of the sublines is due to epigenetic differences; in the other, it is due to genetic alterations. Finally, using a clonal drug response assay together with stochastic simulations, we attribute subclonal drug response variability within sublines to stochastic cell fate decisions and confirm that one subline likely contains genetic resistance mutations that emerged in the absence of drug treatment.

Coordination of gene expression noise with cell size: analytical results for agent-based models of growing cell populations

The chemical master equation and the Gillespie algorithm are widely used to model the reaction kinetics inside living cells. It is thereby assumed that cell growth and division can be modelled through effective dilution reactions and extrinsic noise sources. We here re-examine these paradigms through developing an analytical agent-based framework of growing and dividing cells accompanied by an exact simulation algorithm, which allows us to quantify the dynamics of virtually any intracellular reaction network affected by stochastic cell size control and division noise. We find that the solution of the chemical master equation-including static extrinsic noise-exactly agrees with the agent-based formulation when the network under study exhibits stochastic concentration homeostasis, a novel condition that generalizes concentration homeostasis in deterministic systems to higher order moments and distributions. We illustrate stochastic concentration homeostasis for a range of common gene expression networks. When this condition is not met, we demonstrate by extending the linear noise approximation to agent-based models that the dependence of gene expression noise on cell size can qualitatively deviate from the chemical master equation. Surprisingly, the total noise of the agent-based approach can still be well approximated by extrinsic noise models.

Extrinsic noise of the target gene governs abundance pattern of feed-forward loop motifs

Feed-forward loop (FFL) is found to be a recurrent structure in bacterial and yeast gene transcription regulatory networks. In a generic FFL, transcription factor (TF) S regulates production of another TF X while both of these TFs regulate production of final gene-product Y. Depending upon the regulatory programs (activation or repression), FFLs are grouped into two broad classes: coherent (C) and incoherent (I), each class containing four distinct types (C1-C4 and I1-I4). These FFL types are experimentally observed to occur with varied frequencies, C1 and I1 being the abundant ones. Here we present a stochastic framework singling out the absolute value of the normalized covariance of X and Y to be the determining factor behind the abundance of FFLs while considering differential promoter activities of X and Y. Our theoretical construct employs two possible signal integration mechanisms (additive and multiplicative) to synthesize Y while steady-state population level of S remains fixed or becomes tunable reflecting two possible environmental signaling scenarios. Our model categorically points out that abundant FFLs exhibit higher amount of the designated metric which has a biophysical connotation of extrinsic noise for the target gene Y. Our predictions emanating from an overarching analytical expression utilizing biologically plausible parametric conditions are substantiated by stochastic simulation.

Analysis of biological noise in the flagellar length control system

Any proposed mechanism for organelle size control should be able to account not only for average size but also for the variation in size. We analyzed cell-to-cell variation and within-cell variation of length for the two flagella in Chlamydomonas, finding that cell-to-cell variation is dominated by cell size, whereas within-cell variation results from dynamic fluctuations. Fluctuation analysis suggests tubulin assembly is not directly coupled with intraflagellar transport (IFT) and that the observed length fluctuations reflect tubulin assembly and disassembly events involving large numbers of tubulin dimers. Length variation is increased in long-flagella mutants, an effect consistent with theoretical models for flagellar length regulation. Cells with unequal flagellar lengths show impaired swimming but improved gliding, raising the possibility that cells have evolved mechanisms to tune biological noise in flagellar length. Analysis of noise at the level of organelle size provides a way to probe the mechanisms determining cell geometry.

Challenges of analysing stochastic gene expression in bacteria using single-cell time-lapse experiments

Stochastic gene expression causes phenotypic heterogeneity in a population of genetically identical bacterial cells. Such non-genetic heterogeneity can have important consequences for the population fitness, and therefore cells implement regulation strategies to either suppress or exploit such heterogeneity to adapt to their circumstances. By employing time-lapse microscopy of single cells, the fluctuation dynamics of gene expression may be analysed, and their regulatory mechanisms thus deciphered. However, a careful consideration of the experimental design and data-analysis is needed to produce useful data for deriving meaningful insights from them. In the present paper, the individual steps and challenges involved in a time-lapse experiment are discussed, and a rigorous framework for designing, performing, and extracting single-cell gene expression dynamics data from such experiments is outlined.

Stochastic Differential Equations for Practical Simulation of Gene Circuits

The Chemical Langevin Equation approach allows simple stochastic simulation of gene circuits under many practical situations where the number of molecules of the species involved is not extremely low. Here, we describe methods and a computational framework to simulate a population of cells containing gene circuits of interest. These methods account for both intrinsic and extrinsic noise sources, and allow us to have both individual cell-related species and population-related ones. The protocol covers aspects related to proper description of the system and setting the software tools. It also helps to deal with the optimization of data storage and the simulation precision versus computational time issue. Finally, it also gives practical tests to assess the validity of the underlying technical assumptions.

Theory for the optimal detection of time-varying signals in cellular sensing systems

Living cells often need to measure chemical concentrations that vary in time, yet how accurately they can do so is poorly understood. Here, we present a theory that fully specifies, without any adjustable parameters, the optimal design of a canonical sensing system in terms of two elementary design principles: (1) there exists an optimal integration time, which is determined by the input statistics and the number of receptors; and (2) in the optimally designed system, the number of independent concentration measurements as set by the number of receptors and the optimal integration time equals the number of readout molecules that store these measurements and equals the work to store these measurements reliably; no resource is then in excess and hence wasted. Applying our theory to the Escherichia coli chemotaxis system indicates that its integration time is not only optimal for sensing shallow gradients but also necessary to enable navigation in these gradients.

Likelihood-free nested sampling for parameter inference of biochemical reaction networks

The development of mechanistic models of biological systems is a central part of Systems Biology. One major challenge in developing these models is the accurate inference of model parameters. In recent years, nested sampling methods have gained increased attention in the Systems Biology community due to the fact that they are parallelizable and provide error estimates with no additional computations. One drawback that severely limits the usability of these methods, however, is that they require the likelihood function to be available, and thus cannot be applied to systems with intractable likelihoods, such as stochastic models. Here we present a likelihood-free nested sampling method for parameter inference which overcomes these drawbacks. This method gives an unbiased estimator of the Bayesian evidence as well as samples from the posterior. We derive a lower bound on the estimators variance which we use to formulate a novel termination criterion for nested sampling. The presented method enables not only the reliable inference of the posterior of parameters for stochastic systems of a size and complexity that is challenging for traditional methods, but it also provides an estimate of the obtained variance. We illustrate our approach by applying it to several realistically sized models with simulated data as well as recently published biological data. We also compare our developed method with the two most popular other likeliood-free approaches: pMCMC and ABC-SMC. The C++ code of the proposed methods, together with test data, is available at the github web page https://github.com/Mijan/LFNS_paper.

The behaviour of mathematical models of biochemical reactions is governed by model parameters encoding for various reaction rates, molecule concentrations and other biochemical quantities. As the general purpose of these models is to reproduce and predict the true biological response to different stimuli, the inference of these parameters, given experimental observations, is a crucial part of Systems Biology. While plenty of methods have been published for the inference of model parameters, most of them require the availability of the likelihood function and thus cannot be applied to models that do not allow for the computation of the likelihood. Further, most established methods do not provide an estimate of the variance of the obtained estimator. In this paper, we present a novel inference method that accurately approximates the posterior distribution of parameters and does not require the evaluation of the likelihood function. Our method is based on the nested sampling algorithm and approximates the likelihood with a particle filter. We show that the resulting posterior estimates are unbiased and provide a way to estimate not just the posterior distribution, but also an error estimate of the final estimator. We illustrate our method on several stochastic models with simulated data as well as one model of transcription with real biological data.

Identifying and characterising the impact of excitability in a mathematical model of tumour-immune interactions

We study a five-compartment mathematical model originally proposed by Kuznetsov et al. (1994) to investigate the effect of nonlinear interactions between tumour and immune cells in the tumour microenvironment, whereby immune cells may induce tumour cell death, and tumour cells may inactivate immune cells. Exploiting a separation of timescales in the model, we use the method of matched asymptotics to derive a new two-dimensional, long-timescale, approximation of the full model, which differs from the quasi-steady-state approximation introduced by Kuznetsov et al. (1994), but is validated against numerical solutions of the full model. Through a phase-plane analysis, we show that our reduced model is excitable, a feature not traditionally associated with tumour-immune dynamics. Through a systematic parameter sensitivity analysis, we demonstrate that excitability generates complex bifurcating dynamics in the model. These are consistent with a variety of clinically observed phenomena, and suggest that excitability may underpin tumour-immune interactions. The model exhibits the three stages of immunoediting - elimination, equilibrium, and escape, via stable steady states with different tumour cell concentrations. Such heterogeneity in tumour cell numbers can stem from variability in initial conditions and/or model parameters that control the properties of the immune system and its response to the tumour. We identify different biophysical parameter targets that could be manipulated with immunotherapy in order to control tumour size, and we find that preferred strategies may differ between patients depending on the strength of their immune systems, as determined by patient-specific values of associated model parameters.

Gene-Specific Linear Trends Constrain Transcriptional Variability of the Toll-like Receptor Signaling

Single-cell gene expression is inherently variable, but how this variability is controlled in response to stimulation remains unclear. Here, we use single-cell RNA-seq and single-molecule mRNA counting (smFISH) to study inducible gene expression in the immune toll-like receptor system. We show that mRNA counts of tumor necrosis factor α conform to a standard stochastic switch model, while transcription of interleukin-1β involves an additional regulatory step resulting in increased heterogeneity. Despite different modes of regulation, systematic analysis of single-cell data for a range of genes demonstrates that the variability in transcript count is linearly constrained by the mean response over a range of conditions. Mathematical modeling of smFISH counts and experimental perturbation of chromatin state demonstrates that linear constraints emerge through modulation of transcriptional bursting along with gene-specific relationships. Overall, our analyses demonstrate that the variability of the inducible single-cell mRNA response is constrained by transcriptional bursting.

•

Single-cell TNF-α and IL-1β mRNA responses are differentially controlled

•

Variability of TLR-induced responses scale linearly with mean mRNA counts

•

Gene-specific constraints emerge via modulation of transcriptional bursting

•

Chromatin state regulates transcriptional bursting of IL-1β

Partitioning stable and unstable expression level variation in cell populations: A theoretical framework and its application to the T cell receptor

Phenotypic variation in the copy number of gene products expressed by cells or tissues has been the focus of intense investigation. To what extent the observed differences in cellular expression levels are persistent or transient is an intriguing question. Here, we develop a quantitative framework that resolves the expression variation into stable and unstable components. The difference between the expression means in two cohorts isolated from any cell population is shown to converge to an asymptotic value, with a characteristic time, τ_T, that measures the timescale of the unstable dynamics. The asymptotic difference in the means, relative to the initial value, measures the stable proportion of the original population variance Rα2. Empowered by this insight, we analysed the T-cell receptor (TCR) expression variation in CD4 T cells. About 70% of TCR expression variance is stable in a diverse polyclonal population, while over 80% of the variance in an isogenic TCR transgenic population is volatile. In both populations the TCR levels fluctuate with a characteristic time of 32 hours. This systematic characterisation of the expression variation dynamics, relying on time series of cohorts’ means, can be combined with technologies that measure gene or protein expression in single cells or in bulk.

No two cells are identical. Even isogenic cells, living in the same environment and expressing the same set of genes display measurable differences or variation in the expression level of any of these genes. How much of the differences in expression levels are permanent and how much of these differences vanish in time has intrigued us for generations. We develop a theoretical framework based on a stochastic model and put it to work in the analysis of T cell receptor expression level in CD4 T cells. We show that T cell populations with genetically diverse receptors display stable variation in receptor expression but, surprisingly, we detect persistent differences in receptor levels among uniform transgenic T cells. The analysis, being based on the mean cohort expression levels logarithm, can be applied to techniques that measure expression at single-cell level and also to the myriad of genomics and proteomics techniques that measure expression in bulk populations.

Interacting Particle Solutions of Fokker-Planck Equations Through Gradient-Log-Density Estimation

Fokker-Planck equations are extensively employed in various scientific fields as they characterise the behaviour of stochastic systems at the level of probability density functions. Although broadly used, they allow for analytical treatment only in limited settings, and often it is inevitable to resort to numerical solutions. Here, we develop a computational approach for simulating the time evolution of Fokker-Planck solutions in terms of a mean field limit of an interacting particle system. The interactions between particles are determined by the gradient of the logarithm of the particle density, approximated here by a novel statistical estimator. The performance of our method shows promising results, with more accurate and less fluctuating statistics compared to direct stochastic simulations of comparable particle number. Taken together, our framework allows for effortless and reliable particle-based simulations of Fokker-Planck equations in low and moderate dimensions. The proposed gradient-log-density estimator is also of independent interest, for example, in the context of optimal control.

Enhancement of gene expression noise from transcription factor binding to genomic decoy sites

The genome contains several high-affinity non-functional binding sites for transcription factors (TFs) creating a hidden and unexplored layer of gene regulation. We investigate the role of such “decoy sites” in controlling noise (random fluctuations) in the level of a TF that is synthesized in stochastic bursts. Prior studies have assumed that decoy-bound TFs are protected from degradation, and in this case decoys function to buffer noise. Relaxing this assumption to consider arbitrary degradation rates for both bound/unbound TF states, we find rich noise behaviors. For low-affinity decoys, noise in the level of unbound TF always monotonically decreases to the Poisson limit with increasing decoy numbers. In contrast, for high-affinity decoys, noise levels first increase with increasing decoy numbers, before decreasing back to the Poisson limit. Interestingly, while protection of bound TFs from degradation slows the time-scale of fluctuations in the unbound TF levels, the decay of bound TFs leads to faster fluctuations and smaller noise propagation to downstream target proteins. In summary, our analysis reveals stochastic dynamics emerging from nonspecific binding of TFs and highlights the dual role of decoys as attenuators or amplifiers of gene expression noise depending on their binding affinity and stability of the bound TF.