Effects of molecular memory and bursting on fluctuations in gene expression

Nascent RNA kinetics with complex promoter architecture: Analytic results and parameter inference

Transcription is a stochastic process that involves several downstream operations which make it difficult to model and infer transcription kinetics from mature RNA numbers in individual cell. However, recent advances in single-cell technologies have enabled a more precise measurement of the fluctuations of nascent RNA that closely reflect transcription kinetics. In this paper we introduce a general stochastic model to mimic nascent RNA kinetics with complex promoter architecture. We derive the exact distribution and moments of nascent RNA using queuing theory techniques, which provide valuable insights into the effect of the molecular memory created by the multistep activation and deactivation on the stochastic kinetics of nascent RNA. Moreover, based on the analytical results, we develop a statistical method to infer the promoter memory from stationary nascent RNA distributions. Data analysis of synthetic data and a realistic example, the HIV-1 gene, verifies the validity of this inference method.

Phenotypic memory in quorum sensing

Quorum sensing (QS) is a regulatory mechanism used by bacteria to coordinate group behavior in response to high cell densities. During QS, cells monitor the concentration of external signals, known as autoinducers, as a proxy for cell density. QS often involves positive feedback loops, leading to the upregulation of genes associated with QS signal production and detection. This results in distinct steady-state concentrations of QS-related molecules in QS-ON and QS-OFF states. Due to the slow decay rates of biomolecules such as proteins, even after removal of the initial stimuli, cells can retain elevated levels of QS-associated biomolecules for extended periods of time. This persistence of biomolecules after the removal of the initial stimuli has the potential to impact the response to future stimuli, indicating a memory of past exposure. This phenomenon, which is a consequence of the carry-over of biomolecules rather than genetic inheritance, is known as "phenotypic" memory. This theoretical study aims to investigate the presence of phenotypic memory in QS and the conditions that influence this memory. Numerical simulations based on ordinary differential equations and analytical modeling were used to study gene expression in response to sudden changes in cell density and extracellular signal concentrations. The model examined the effect of various cellular parameters on the strength of QS memory and the impact on gene regulatory dynamics. The findings revealed that QS memory has a transient effect on the expression of QS-responsive genes. These consequences of QS memory depend strongly on how cell density was perturbed, as well as various cellular parameters, including the Fold Change in the expression of QS-regulated genes, the autoinducer synthesis rate, the autoinducer threshold required for activation, and the cell growth rate.

Analysis of a detailed multi-stage model of stochastic gene expression using queueing theory and model reduction

We introduce a biologically detailed, stochastic model of gene expression describing the multiple rate-limiting steps of transcription, nuclear pre-mRNA processing, nuclear mRNA export, cytoplasmic mRNA degradation and translation of mRNA into protein. The processes in sub-cellular compartments are described by an arbitrary number of processing stages, thus accounting for a significantly finer molecular description of gene expression than conventional models such as the telegraph, two-stage and three-stage models of gene expression. We use two distinct tools, queueing theory and model reduction using the slow-scale linear-noise approximation, to derive exact or approximate analytic expressions for the moments or distributions of nuclear mRNA, cytoplasmic mRNA and protein fluctuations, as well as lower bounds for their Fano factors in steady-state conditions. We use these to study the phase diagram of the stochastic model; in particular we derive parametric conditions determining three types of transitions in the properties of mRNA fluctuations: from sub-Poissonian to super-Poissonian noise, from high noise in the nucleus to high noise in the cytoplasm, and from a monotonic increase to a monotonic decrease of the Fano factor with the number of processing stages. In contrast, protein fluctuations are always super-Poissonian and show weak dependence on the number of mRNA processing stages. Our results delineate the region of parameter space where conventional models give qualitatively incorrect results and provide insight into how the number of processing stages, e.g. the number of rate-limiting steps in initiation, splicing and mRNA degradation, shape stochastic gene expression by modulation of molecular memory.

Solving stochastic gene-expression models using queueing theory: A tutorial review

Stochastic models of gene expression are typically formulated using the chemical master equation, which can be solved exactly or approximately using a repertoire of analytical methods. Here, we provide a tutorial review of an alternative approach based on queueing theory that has rarely been used in the literature of gene expression. We discuss the interpretation of six types of infinite-server queues from the angle of stochastic single-cell biology and provide analytical expressions for the stationary and nonstationary distributions and/or moments of mRNA/protein numbers and bounds on the Fano factor. This approach may enable the solution of complex models that have hitherto evaded analytical solution.

Exact results for gene-expression models with general waiting-time distributions

Complex molecular details of transcriptional regulation can be coarse-grained by assuming that reaction waiting times for promoter-state transitions, the mRNA synthesis, and the mRNA degradation follow general distributions. However, how such a generalized two-state model is analytically solved is a long-standing issue. Here we first present analytical formulas of burst-size distributions for this model. Then, we derive an iterative equation for the mRNA moment-generating function, by which mRNA raw and binomial moments of any order can be conveniently calculated. The analytical results obtained in the special cases of phase-type waiting-time distributions not only provide insights into the mechanisms of complex transcriptional regulations but also bring conveniences for experimental data-based statistical inferences.

Phase separation reduces cell-to-cell variability of transcriptional bursting

Gene expression is a stochastic and noisy process often occurring in "bursts". Experiments have shown that the compartmentalization of proteins by liquid-liquid phase separation is conducive to reducing the noise of gene expression. Therefore, an important goal is to explore the role of bursts in phase separation noise reduction processes. We propose a coupled model that includes phase separation and a two-state gene expression process. Using the timescale separation method, we obtain approximate solutions for the expectation, variance, and noise strength of the dilute phase. We find that a higher burst frequency weakens the ability of noise reduction by phase separation, but as the burst size increases, this ability first increases and then decreases. This study provides a deeper understanding of phase separation to reduce noise in the stochastic gene expression with burst kinetics.

Regulatory Mechanisms for Transcriptional Bursting Revealed by an Event-Based Model

Gene transcription often occurs in discrete bursts, and it can be difficult to deduce the underlying regulatory mechanisms for transcriptional bursting with limited experimental data. Here, we categorize numerous states of single eukaryotic genes and identify 6 essential transcriptional events, each comprising a series of state transitions; transcriptional bursting is characterized as a sequence of 4 events, capable of being organized in various configurations, in addition to the beginning and ending events. By associating transcriptional kinetics with mean durations and recurrence probabilities of the events, we unravel how transcriptional bursting is modulated by various regulators including transcription factors. Through analytical derivation and numerical simulation, this study reveals key state transitions contributing to transcriptional sensitivity and specificity, typical characteristics of burst profiles, global constraints on intrinsic transcriptional noise, major regulatory modes in individual genes and across the genome, and requirements for fast gene induction upon stimulation. It is illustrated how biochemical reactions on different time scales are modulated to separately shape the durations and ordering of the events. Our results suggest that transcriptional patterns are essentially controlled by a shared set of transcriptional events occurring under specific promoter architectures and regulatory modes, the number of which is actually limited.

Stochastic modeling of the mRNA life process: A generalized master equation

The mRNA life cycle is a complex biochemical process, involving transcription initiation, elongation, termination, splicing, and degradation. Each of these molecular events is multistep and can create a memory. The effect of this molecular memory on gene expression is not clear, although there are many related yet scattered experimental reports. To address this important issue, we develop a general theoretical framework formulated as a master equation in the sense of queue theory, which can reduce to multiple previously studied gene models in limiting cases. This framework allows us to interpret experimental observations, extract kinetic parameters from experimental data, and identify how the mRNA kinetics vary under regulatory influences. Notably, it allows us to evaluate the influences of elongation processes on mature RNA distribution; e.g., we find that the non-exponential elongation time can induce the bimodal mRNA expression and there is an optimal elongation noise intensity such that the mature RNA noise achieves the lowest level. In a word, our framework can not only provide insight into complex mRNA life processes but also bridge a dialogue between theoretical studies and experimental data.

Steviol glycosides from Stevia rebaudiana Bertoni mitigate lipid metabolism abnormalities in diabetes by modulating selected gene expression - An in vivo study

In diabetes, in parallel to hyperglycaemia, elevated serum lipids are also diagnosed, representing a high-risk factor for coronary heart disease and cardiovascular complications. The objective of this study was to unravel the mechanisms that underlie the potential of steviol glycosides (stevioside or rebaudioside A) administered at two doses (500 or 2500 mg/kg body weight for 5 weeks) to regulate lipid metabolism. In this paper, the expression of selected genes responsible for glucose and lipid metabolism (Glut4, Pparγ, Cebpa, Fasn, Lpl and Egr1) in the peripheral tissues (adipose, liver and muscle tissue) was determined using quantitative real-time PCR method. It was found that the supplementation of steviol glycosides affected the expression of Glut4, Cebpa and Fasn genes, depending on the type of the glycoside and its dose, as well as the type of tissue, whish in part may explain the lipid-regulatory potential of steviol glycosides in hyperglycaemic conditions. Nevertheless, more in-depth studies, including human trials, are needed to confirm these effects, before steviol glycosides can be used in the therapy of type 2 diabetes.

Serial Sampling of the Small Airway Epithelium to Identify Persistent Smoking-dysregulated Genes

Rationale: The small airway epithelium (beyond the sixth generation), the initiation site of smoking-induced airway disorders, is highly sensitive to the stress of smoking. Because of variations over time in smoking habits, the small airway epithelium transcriptome is dynamic, fluctuating not only among smokers but also within each smoker. Objectives: To perform accurate assessment of the smoking-related dysregulation of the human small airway epithelium despite the variation of smoking within the same individual and of the effects of smoking cessation on the dysregulated transcriptome. Methods: We conducted serial sampling of the same smokers and nonsmoker control subjects over time to identify persistent smoking dysregulation of the biology of the small airway epithelium over 1 year. We conducted serial sampling of smokers who quit smoking, before and after smoking cessation, to assess the effect of smoking cessation on the smoking-dysregulated genes. Measurements and Main Results: Repeated measures ANOVA of the small airway epithelium transcriptome sampled four times in the same individuals over 1 year enabled the identification of 475 persistent smoking-dysregulated genes. Most genes were normalized after 12 months of smoking cessation; however, 53 (11%) genes, including CYP1B1, PIR, ME1, and TRIM16, remained persistently abnormally expressed. Dysregulated pathways enriched with the nonreversible genes included xenobiotic metabolism signaling, bupropion degradation, and nicotine degradation. Conclusions: Analysis of repetitive sampling of the same individuals identified persistent smoking-induced dysregulation of the small airway epithelium transcriptome and the effect of smoking cessation. These results help identify targets for the development of therapies that can be applicable to smoking-related airway diseases.

Theoretical and computational tools to model multistable gene regulatory networks

The last decade has witnessed a surge of theoretical and computational models to describe the dynamics of complex gene regulatory networks, and how these interactions can give rise to multistable and heterogeneous cell populations. As the use of theoretical modeling to describe genetic and biochemical circuits becomes more widespread, theoreticians with mathematical and physical backgrounds routinely apply concepts from statistical physics, non-linear dynamics, and network theory to biological systems. This review aims at providing a clear overview of the most important methodologies applied in the field while highlighting current and future challenges. It also includes hands-on tutorials to solve and simulate some of the archetypical biological system models used in the field. Furthermore, we provide concrete examples from the existing literature for theoreticians that wish to explore this fast-developing field. Whenever possible, we highlight the similarities and differences between biochemical and regulatory networks and 'classical' systems typically studied in non-equilibrium statistical and quantum mechanics.

The minimal intrinsic stochasticity of constitutively expressed eukaryotic genes is sub-Poissonian

Gene expression inherently gives rise to stochastic variation ("noise") in the production of gene products. Minimizing noise is crucial for ensuring reliable cellular functions. However, noise cannot be suppressed below a certain intrinsic limit. For constitutively expressed genes, this limit is typically assumed to be Poissonian noise, wherein the variance in mRNA numbers is equal to their mean. Here, we demonstrate that several cell division genes in fission yeast exhibit mRNA variances significantly below this limit. The reduced variance can be explained by a gene expression model incorporating multiple transcription and mRNA degradation steps. Notably, in this sub-Poissonian regime, distinct from Poissonian or super-Poissonian regimes, cytoplasmic noise is effectively suppressed through a higher mRNA export rate. Our findings redefine the lower limit of eukaryotic gene expression noise and uncover molecular requirements for achieving ultralow noise, which is expected to be important for vital cellular functions.

Inferring transcriptional bursting kinetics from single-cell snapshot data using a generalized telegraph model

Gene expression has inherent stochasticity resulting from transcription's burst manners. Single-cell snapshot data can be exploited to rigorously infer transcriptional burst kinetics, using mathematical models as blueprints. The classical telegraph model (CTM) has been widely used to explain transcriptional bursting with Markovian assumptions. However, growing evidence suggests that the gene-state dwell times are generally non-exponential, as gene-state switching is a multi-step process in organisms. Therefore, interpretable non-Markovian mathematical models and efficient statistical inference methods are urgently required in investigating transcriptional burst kinetics. We develop an interpretable and tractable model, the generalized telegraph model (GTM), to characterize transcriptional bursting that allows arbitrary dwell-time distributions, rather than exponential distributions, to be incorporated into the ON and OFF switching process. Based on the GTM, we propose an inference method for transcriptional bursting kinetics using an approximate Bayesian computation framework. This method demonstrates an efficient and scalable estimation of burst frequency and burst size on synthetic data. Further, the application of inference to genome-wide data from mouse embryonic fibroblasts reveals that GTM would estimate lower burst frequency and higher burst size than those estimated by CTM. In conclusion, the GTM and the corresponding inference method are effective tools to infer dynamic transcriptional bursting from static single-cell snapshot data.

The minimal intrinsic stochasticity of constitutively expressed eukaryotic genes is sub-Poissonian

Stochastic variation in gene products ("noise") is an inescapable by-product of gene expression. Noise must be minimized to allow for the reliable execution of cellular functions. However, noise cannot be suppressed beyond an intrinsic lower limit. For constitutively expressed genes, this limit is believed to be Poissonian, meaning that the variance in mRNA numbers cannot be lower than their mean. Here, we show that several cell division genes in fission yeast have mRNA variances significantly below this limit, which cannot be explained by the classical gene expression model for low-noise genes. Our analysis reveals that multiple steps in both transcription and mRNA degradation are essential to explain this sub-Poissonian variance. The sub-Poissonian regime differs qualitatively from previously characterized noise regimes, a hallmark being that cytoplasmic noise is reduced when the mRNA export rate increases. Our study re-defines the lower limit of eukaryotic gene expression noise and identifies molecular requirements for ultra-low noise which are expected to support essential cell functions.

The effect of microRNA on protein variability and gene expression fidelity

Small regulatory RNA molecules such as microRNA modulate gene expression through inhibiting the translation of messenger RNA (mRNA). Such posttranscriptional regulation has been recently hypothesized to reduce the stochastic variability of gene expression around average levels. Here, we quantify noise in stochastic gene expression models with and without such regulation. Our results suggest that silencing mRNA posttranscriptionally will always increase, rather than decrease, gene expression noise when the silencing of mRNA also increases its degradation, as is expected for microRNA interactions with mRNA. In that regime, we also find that silencing mRNA generally reduces the fidelity of signal transmission from deterministically varying upstream factors to protein levels. These findings suggest that microRNA binding to mRNA does not generically confer precision to protein expression.

Robust KALMAN Filter State Estimation for Gene Regulatory Networks

This paper proposes a revised version of the robust generalized maximum likelihood (GM)-type unscented KALMAN filter (GM-UKF) for the state estimation of gene regulatory networks (GRNs) in the presence of different types of deviations from assumptions. As known, the parameters and the power of the assumed noises within the GRN model may change abruptly as a result of jump behavior and bursting process in transcription and translation phases. Moreover, there may be outlying samples among genomic measurement data. Some other outliers may also occur in the model dynamics. The outliers may be misinterpreted by the filtering method if not detected and downweighted. To deal with all such deviations, a robust GM-UKF is designed that includes some modifications to address the challenges in calculating the projection statistics in GRNs such as the nonlinear behavior and the natural distance of the states. The proposed filter is compared to four Bayesian filters, i.e., the conventional UKF, the H _∞-UKF, the downweighting UKF (DW-UKF), and a modified version of the GM-UKF, the so-called maximum-likelihood UKF(M-UKF). The outcome results demonstrate that the GM-UKF outperforms other methods for all outlier types while the H _∞-UKF is appropriate for the changes in noise powers.

Genome-wide inference reveals that feedback regulations constrain promoter-dependent transcriptional burst kinetics

Gene expression in mammalian cells is highly variable and episodic, resulting in a series of discontinuous bursts of mRNAs. A challenge is to understand how static promoter architecture and dynamic feedback regulations dictate bursting on a genome-wide scale. Although single-cell RNA sequencing (scRNA-seq) provides an opportunity to address this challenge, effective analytical methods are scarce. We developed an interpretable and scalable inference framework, which combined experimental data with a mechanistic model to infer transcriptional burst kinetics (sizes and frequencies) and feedback regulations. Applying this framework to scRNA-seq data generated from embryonic mouse fibroblast cells, we found Simpson's paradoxes, i.e. genome-wide burst kinetics exhibit different characteristics in two cases without and with distinguishing feedback regulations. We also showed that feedbacks differently modulate burst frequencies and sizes and conceal the effects of transcription start site distributions on burst kinetics. Notably, only in the presence of positive feedback, TATA genes are expressed with high burst frequencies and enhancer-promoter interactions mainly modulate burst frequencies. The developed inference method provided a flexible and efficient way to investigate transcriptional burst kinetics and the obtained results would be helpful for understanding cell development and fate decision.

The missing link between genetic association and regulatory function

The genetic basis of most traits is highly polygenic and dominated by non-coding alleles. It is widely assumed that such alleles exert small regulatory effects on the expression of cis-linked genes. However, despite the availability of gene expression and epigenomic datasets, few variant-to-gene links have emerged. It is unclear whether these sparse results are due to limitations in available data and methods, or to deficiencies in the underlying assumed model. To better distinguish between these possibilities, we identified 220 gene-trait pairs in which protein-coding variants influence a complex trait or its Mendelian cognate. Despite the presence of expression quantitative trait loci near most GWAS associations, by applying a gene-based approach we found limited evidence that the baseline expression of trait-related genes explains GWAS associations, whether using colocalization methods (8% of genes implicated), transcription-wide association (2% of genes implicated), or a combination of regulatory annotations and distance (4% of genes implicated). These results contradict the hypothesis that most complex trait-associated variants coincide with homeostatic expression QTLs, suggesting that better models are needed. The field must confront this deficit and pursue this 'missing regulation.'

Inferring entropy production rate from partially observed Langevin dynamics under coarse-graining

The entropy production rate (EPR) measures time-irreversibility in systems operating far from equilibrium. The challenge in estimating the EPR for a continuous variable system is the finite spatiotemporal resolution and the limited accessibility to all of the nonequilibrium degrees of freedom. Here, we estimate the irreversibility in partially observed systems following oscillatory dynamics governed by coupled overdamped Langevin equations. We coarse-grain an observed variable of a nonequilibrium driven system into a few discrete states and estimate a lower bound on the total EPR. As a model system, we use hair-cell bundle oscillations driven by molecular motors, such that the bundle tip position is observed, but the positions of the motors are hidden. In the observed variable space, the underlying driven process exhibits second-order semi-Markov statistics. The waiting time distributions (WTD), associated with transitions among the coarse-grained states, are non-exponential and convey the information on the broken time-reversal symmetry. By invoking the underlying time-irreversibility, we calculate a lower bound on the total EPR from the Kullback-Leibler divergence (KLD) between WTD. We show that the mean dwell-time asymmetry factor - the ratio between the mean dwell-times along the forward direction and the backward direction, can qualitatively measure the degree of broken time reversal symmetry and increases with finer spatial resolution. Finally, we apply our methodology to a continuous-time discrete Markov chain model, coarse-grained into a linear system exhibiting second-order semi-Markovian statistics, and demonstrate the estimation of a lower bound on the total EPR from irreversibility manifested only in the WTD.

Persistent Correlation in Cellular Noise Determines Longevity of Viral Infections

The slowly decaying viral dynamics, even after 2-3 weeks from diagnosis, is one of the characteristics of COVID-19 infection that is still unexplored in theoretical and experimental studies. This long-lived characteristic of viral infections in the framework of inherent variations or noise present at the cellular level is often overlooked. Therefore, in this work, we aim to understand the effect of these variations by proposing a stochastic non-Markovian model that not only captures the coupled dynamics between the immune cells and the virus but also enables the study of the effect of fluctuations. Numerical simulations of our model reveal that the long-range temporal correlations in fluctuations dictate the long-lived dynamics of a viral infection and, in turn, also affect the rates of immune response. Furthermore, predictions of our model system are in agreement with the experimental viral load data of COVID-19 patients from various countries.

Generalized fluctuation-dissipation theorem for non-Markovian reaction networks

Intracellular biochemical networks often display large fluctuations in the molecule numbers or the concentrations of reactive species, making molecular approaches necessary for system descriptions. For Markovian reaction networks, the fluctuation-dissipation theorem (FDT) has been well established and extensively used in fast evaluation of fluctuations in reactive species. For non-Markovian reaction networks, however, the similar FDT has not been established so far. Here, we present a generalized FDT (gFDT) for a large class of non-Markovian reaction networks where general intrinsic-event waiting-time distributions account for the effect of intrinsic noise and general stochastic reaction delays represent the impact of extrinsic noise from environmental perturbations. The starting point is a generalized chemical master equation (gCME), which describes the probabilistic behavior of an equivalent Markovian reaction network and identifies the structure of the original non-Markovian reaction network in terms of stoichiometries and effective transition rates (extensions of common reaction propensity functions). From this formulation follows directly the solution of the linear noise approximation of the stationary gCME for all the components in the non-Markovian reaction network. While the gFDT can quickly trace noisy sources in non-Markovian reaction networks, example analysis verifies its effectiveness.

Systematic inference identifies a major source of heterogeneity in cell signaling dynamics: The rate-limiting step number

Identifying the sources of cell-to-cell variability in signaling dynamics is essential to understand drug response variability and develop effective therapeutics. However, it is challenging because not all signaling intermediate reactions can be experimentally measured simultaneously. This can be overcome by replacing them with a single random time delay, but the resulting process is non-Markovian, making it difficult to infer cell-to-cell heterogeneity in reaction rates and time delays. To address this, we developed an efficient and scalable moment-based Bayesian inference method (MBI) with a user-friendly computational package that infers cell-to-cell heterogeneity in the non-Markovian signaling process. We applied MBI to single-cell expression profiles from promoters responding to antibiotics and discovered a major source of cell-to-cell variability in antibiotic stress response: the number of rate-limiting steps in signaling cascades. This knowledge can help identify effective therapies that destroy all pathogenic or cancer cells, and the approach can be applied to precision medicine.

Coloured noise induces phenotypic diversity with energy dissipation

Genes integrate many different sources of noise to adapt their survival strategy with energy costs, but how this noise impacts gene phenotype switching is not fully understood. Here, we refine a mechanistic model with multiplicative and additive coloured noise and analyse the influence of noise strength (NS) and autocorrelation time (AT) on gene phenotypic diversity. Different from white noise, we found that in the autocorrelation time-scale plane, increasing the multiplicative noise will broaden the bimodal region of the gene product, and additive noise will induce bimodal region drift from the lower level to the higher level, while the AT will promote this transition. Specifically, the effect of AT on gene expression is similar to a feedback loop; that is, the AT of multiplicative noise will elongate the mean first passage time (MFPT) from the low stable state to the high stable state, but it will reduce the MFPT from the high stable state to the low stable state, and the opposite is true for additive noise. Moreover, these transitions will violate the detailed equilibrium and then consume energy. By effective topology network reconstruction, we found that when the NS is small, the more obvious the bimodality is, the lower the energy dissipation; however, when the NS is large, it will consume more energy with a tendency for bimodality. The overall analysis implies that living organisms will utilize noise strength and its autocorrelation time for better survival in complex and fluctuating environments.

Kinetic characteristics of transcriptional bursting in a complex gene model with cyclic promoter structure

While transcription often occurs in a bursty manner, various possible regulations can lead to complex promoter patterns such as promoter cycles, giving rise to an important question: How do promoter kinetics shape transcriptional bursting kinetics? Here we introduce and analyze a general model of the promoter cycle consisting of multi-OFF states and multi-ON states, focusing on the effects of multi-ON mechanisms on transcriptional bursting kinetics. The derived analytical results indicate that burst size follows a mixed geometric distribution rather than a single geometric distribution assumed in previous studies, and ON and OFF times obey their own mixed exponential distributions. In addition, we find that the multi-ON mechanism can lead to bimodal burst-size distribution, antagonistic timing of ON and OFF, and diverse burst frequencies, each further contributing to cell-to-cell variability in the mRNA expression level. These results not only reveal essential features of transcriptional bursting kinetics patterns shaped by multi-state mechanisms but also can be used to the inferences of transcriptional bursting kinetics and promoter structure based on experimental data.

Controlling gene expression timing through gene regulatory architecture

Gene networks typically involve the regulatory control of multiple genes with related function. This connectivity enables correlated control of the levels and timing of gene expression. Here we study how gene expression timing in the single-input module motif can be encoded in the regulatory DNA of a gene. Using stochastic simulations, we examine the role of binding affinity, TF regulatory function and network size in controlling the mean first-passage time to reach a fixed fraction of steady-state expression for both an auto-regulated TF gene and a target gene. We also examine how the variability in first-passage time depends on these factors. We find that both network size and binding affinity can dramatically speed up or slow down the response time of network genes, in some cases predicting more than a 100-fold change compared to that for a constitutive gene. Furthermore, these factors can also significantly impact the fidelity of this response. Importantly, these effects do not occur at “extremes” of network size or binding affinity, but rather in an intermediate window of either quantity.

Mean-field theory accurately captures the variation of copy number distributions across the mRNA life cycle

We consider a stochastic model where a gene switches between two states, an mRNA transcript is released in the active state, and subsequently it undergoes an arbitrary number of sequential unimolecular steps before being degraded. The reactions effectively describe various stages of the mRNA life cycle such as initiation, elongation, termination, splicing, export, and degradation. We construct a mean-field approach that leads to closed-form steady-state distributions for the number of transcript molecules at each stage of the mRNA life cycle. By comparison with stochastic simulations, we show that the approximation is highly accurate over all the parameter space, independent of the type of expression (constitutive or bursty) and of the shape of the distribution (unimodal, bimodal, and nearly bimodal). The theory predicts that in a population of identical cells, any bimodality is gradually washed away as the mRNA progresses through its life cycle.

Silent transcription intervals and translational bursting lead to diverse phenotypic switching

For complex process of gene expression, we use theoretical analysis and stochastic simulations to study the phenotypic diversity induced by silent transcription intervals and translational bursting.

Exact distributions for stochastic gene expression models with arbitrary promoter architecture and translational bursting

Gene expression in individual cells is inherently variable and sporadic, leading to cell-to-cell variability in mRNA and protein levels. Recent single-cell and single-molecule experiments indicate that promoter architecture and translational bursting play significant roles in controlling gene expression noise and generating the phenotypic diversity that life exhibits. To quantitatively understand the impact of these factors, it is essential to construct an accurate mathematical description of stochastic gene expression and find the exact analytical results, which is a formidable task. Here, we develop a stochastic model of bursty gene expression, which considers the complex promoter architecture governing the variability in mRNA expression and a general distribution characterizing translational burst. We derive the analytical expression for the corresponding protein steady-state distribution and all moment statistics of protein counts. We show that the total protein noise can be decomposed into three parts: the low-copy noise of protein due to probabilistic individual birth and death events, the noise due to stochastic switching between promoter states, and the noise resulting from translational busting. The theoretical results derived provide quantitative insights into the biochemical mechanisms of stochastic gene expression.

Systematic analysis of noise reduction properties of coupled and isolated feed-forward loops

Cells can maintain their homeostasis in a noisy environment since their signaling pathways can filter out noise somehow. Several network motifs have been proposed for biological noise filtering and, among these, feed-forward loops have received special attention. Specific feed-forward loops show noise reducing capabilities, but we notice that this feature comes together with a reduced signal transducing performance. In posttranslational signaling pathways feed-forward loops do not function in isolation, rather they are coupled with other motifs to serve a more complex function. Feed-forward loops are often coupled to other feed-forward loops, which could affect their noise-reducing capabilities. Here we systematically study all feed-forward loop motifs and all their pairwise coupled systems with activation-inactivation kinetics to identify which networks are capable of good noise reduction, while keeping their signal transducing performance. Our analysis shows that coupled feed-forward loops can provide better noise reduction and, at the same time, can increase the signal transduction of the system. The coupling of two coherent 1 or one coherent 1 and one incoherent 4 feed-forward loops can give the best performance in both of these measures.

Cellular behavior can be affected by noise in molecular interactions. Signaling pathways should process noisy input signals and support cellular decision making by properly transducing the signals, while removing noise from them. Three component networks of feed-forward loops (FFLs) have been proposed to serve as ideal noise reducers, while linear pathways were shown to be good signal transducers. These signaling units do not work in isolation, so there is a possibility that a combination of various feed-forward loops can provide good noise reduction, while maintaining good signal transduction. To test this hypothesis, we have systematically tested the noise reducing and signal transducing capabilities of all possible combinations of feed-forward loops and compared them with the performance of individual FFLs. We built mathematical models of all these systems and compared their capabilities at reducing noise in the input signal while maintaining responses to meaningful changes in the incoming signal. We found that a combination of two copies of a special type of fully positive signaling FFLs is the best noise reducer, while a combination of two incoherent (one positive, one negative signal) FFLs can provide the best signal transduction. The combination of these two FFLs could provide good signal processing where both noise reduction and signal transduction are achieved.

Pathway dynamics can delineate the sources of transcriptional noise in gene expression

Single-cell expression profiling opens up new vistas on cellular processes. Extensive cell-to-cell variability at the transcriptomic and proteomic level has been one of the stand-out observations. Because most experimental analyses are destructive we only have access to snapshot data of cellular states. This loss of temporal information presents significant challenges for inferring dynamics, as well as causes of cell-to-cell variability. In particular, we typically cannot separate dynamic variability from within cells ('intrinsic noise') from variability across the population ('extrinsic noise'). Here, we make this non-identifiability mathematically precise, allowing us to identify new experimental set-ups that can assist in resolving this non-identifiability. We show that multiple generic reporters from the same biochemical pathways (e.g. mRNA and protein) can infer magnitudes of intrinsic and extrinsic transcriptional noise, identifying sources of heterogeneity. Stochastic simulations support our theory, and demonstrate that 'pathway-reporters' compare favourably to the well-known, but often difficult to implement, dual-reporter method.

Single-cell Transcriptomes Reveal Characteristics of MicroRNA in Gene Expression Noise Reduction

Isogenic cells growing in identical environments show cell-to-cell variations because of the stochasticity in gene expression. High levels of variation or noise can disrupt robust gene expression and result in tremendous consequences for cell behaviors. In this work, we showed evidence from single-cell RNA sequencing data analysis that microRNAs (miRNAs) can reduce gene expression noise at the mRNA level in mouse cells. We identified that the miRNA expression level, number of targets, target pool abundance, and miRNA–target interaction strength are the key features contributing to noise repression. miRNAs tend to work together in cooperative subnetworks to repress target noise synergistically in a cell type-specific manner. By building a physical model of post-transcriptional regulation and observing in synthetic gene circuits, we demonstrated that accelerated degradation with elevated transcriptional activation of the miRNA target provides resistance to extrinsic fluctuations. Together, through the integrated analysis of single-cell RNA and miRNA expression profiles, we demonstrated that miRNAs are important post-transcriptional regulators for reducing gene expression noise and conferring robustness to biological processes.

Exact results for queuing models of stochastic transcription with memory and crosstalk

Gene transcription is a complex multistep biochemical process, which can create memory between individual reaction events. On the other hand, many inducible genes, when activated by external cues, are often coregulated by several competitive pathways with crosstalk. This raises an unexplored question: how do molecular memory and crosstalk together affect gene expressions? To address this question, we introduce a queuing model of stochastic transcription, where two crossing signaling pathways are used to direct gene activation in response to external signals and memory functions to model multistep reaction processes involved in transcription. We first establish, based on the total probability principle, the chemical master equation for this queuing model, and then we derive, based on the binomial moment approach, exact expressions for statistical quantities (including distributions) of mRNA, which provide insights into the roles of crosstalk and memory in controlling the mRNA level and noise. We find that molecular memory of gene activation decreases the mRNA level but increases the mRNA noise, and double activation pathways always reduce the mRNA noise in contrast to a single pathway. In addition, we find that molecular memory can make the mRNA bimodality disappear.

Maximization of information transmission influences selection of native phosphorelay architectures

Phosphorelays are signal transduction circuits that sense environmental changes and adjust cellular metabolism. Five different circuit architectures account for 99% of all phosphorelay operons annotated in over 9,000 fully sequenced genomes. Here we asked what biological design principles, if any, could explain selection among those architectures in nature. We began by studying kinetically well characterized phosphorelays (Spo0 of Bacillus subtilis and Sln1 of Saccharomyces cerevisiae). We find that natural circuit architecture maximizes information transmission in both cases. We use mathematical models to compare information transmission among the architectures for a realistic range of concentration and parameter values. Mapping experimentally determined phosphorelay protein concentrations onto that range reveals that the native architecture maximizes information transmission in sixteen out of seventeen analyzed phosphorelays. These results suggest that maximization of information transmission is important in the selection of native phosphorelay architectures, parameter values and protein concentrations.

Correlation between external regulators governs the mean-noise relationship in stochastic gene expression

Gene transcription in single cells is inherently a probabilistic process. The relationship between variance ($ \sigma^{2} $) and mean expression ($ \mu $) is of paramount importance for investigations into the evolutionary origins and consequences of noise in gene expression. It is often formulated as $ \log \left({{{\sigma}^{2}}}/{{{\mu}^{2}}}\; \right) = \beta\log\mu+\log\alpha $, where $ \beta $ is a key parameter since its sign determines the qualitative dependence of noise on mean. We reveal that the sign of $ \beta $ is controlled completely by external regulation, but independent of promoter structure. Specifically, it is negative if regulators as stochastic variables are independent but positive if they are correlated. The essential mechanism revealed here can well interpret diverse experimental phenomena underlying expression noise. Our results imply that external regulation rather than promoter sequence governs the mean-noise relationship.

Exploring dissipative sources of non-Markovian biochemical reaction systems

Many biological processes including important intracellular processes are governed by biochemical reaction networks. Usually, these reaction systems operate far from thermodynamic equilibrium, implying free-energy dissipation. On the other hand, single reaction events happen often in a memory manner, leading to non-Markovian kinetics. A question then arises: how do we calculate free-energy dissipation (defined as the entropy production rate) in this physically real case? We derive an analytical formula for calculating the energy consumption of a general reaction system with molecular memory characterized by nonexponential waiting-time distributions. It shows that this dissipation is composed of two parts: one from broken detailed balance of an equivalent Markovian system with the same topology and substrates, and the other from the direction-time dependence of waiting-time distributions. But, if the system is in a detailed balance and the waiting-time distribution is direction-time independent, there is no energy dissipation even in the non-Markovian case. These general results provide insights into the physical mechanisms underlying nonequilibrium processes. A continuous-time random-walk model and a generalized model of stochastic gene expression are chosen to clearly show dissipative sources and the relationship between energy dissipation and molecular memory.

Scaling of intrinsic noise in an autocratic reaction network

Biochemical reactions in living cells often produce stochastic trajectories due to the fluctuations of the finite number of the macromolecular species present inside the cell. A significant number of computational and theoretical studies have previously investigated stochasticity in small regulatory networks to understand its origin and regulation. At the systems level regulatory networks have been determined to be hierarchical resembling social networks. In order to determine the stochasticity in networks with hierarchical architecture, here we computationally investigated intrinsic noise in an autocratic reaction network in which only the upstream regulators regulate the downstream regulators. We studied the effects of the qualitative and quantitative nature of regulatory interactions on the stochasticity in the network. We established an unconventional scaling of noise with average abundance in which the noise passes through a minimum indicating that the network can be noisy both in the low and high abundance regimes. We determined that the bursty kinetics of the trajectories are responsible for such scaling. The scaling of noise remains intact for a mixed network that includes democratic subnetworks within the autocratic network.

Stochastic models for single-cell data: Current challenges and the way forward

Although the quantity and quality of single-cell data have progressed rapidly, making quantitative predictions with single-cell stochastic models remains challenging. The stochastic nature of cellular processes leads to at least three challenges in building models with single-cell data: (a) because variability in single-cell data can be attributed to multiple different sources, it is difficult to rule out conflicting mechanistic models that explain the same data equally well; (b) the distinction between interesting biological variability and experimental variability is sometimes ambiguous; (c) the nonstandard distributions of single-cell data can lead to violations of the assumption of symmetric errors in least-squares fitting. In this review, we first discuss recent studies that overcome some of the challenges or set up a promising direction and then introduce some powerful statistical approaches utilized in these studies. We conclude that applying and developing statistical approaches could lead to further progress in building stochastic models for single-cell data.

TATA and paused promoters active in differentiated tissues have distinct expression characteristics

Core promoter types differ in the extent to which RNA polymerase II (Pol II) pauses after initiation, but how this affects their tissue-specific gene expression characteristics is not well understood. While promoters with Pol II pausing elements are active throughout development, TATA promoters are highly active in differentiated tissues. We therefore used a genomics approach on late-stage Drosophila embryos to analyze the properties of promoter types. Using tissue-specific Pol II ChIP-seq, we found that paused promoters have high levels of paused Pol II throughout the embryo, even in tissues where the gene is not expressed, while TATA promoters only show Pol II occupancy when the gene is active. The promoter types are associated with different chromatin accessibility in ATAC-seq data and have different expression characteristics in single-cell RNA-seq data. The two promoter types may therefore be optimized for different properties: paused promoters show more consistent expression when active, while TATA promoters have lower background expression when inactive. We propose that tissue-specific genes have evolved to use two different strategies for their differential expression across tissues.

Explicit effect of stochastic reaction delay on gene expression

Apart from intrinsic stochastic variability, gene expression also involves stochastic reaction delay arising from heterogeneity and fluctuation processes, which can affect the efficiency of reactants (e.g., mRNA or protein) in exploring their environments. In contrast to the former that has been extensively investigated, the impact of the latter on gene expression remains not fully understood. Here, we analyze a non-Markovian model of bursty gene expression with general delay distribution. We analytically find that the effect of stochastic reaction delay is equivalent to the introduction of negative feedback, and stationary protein distribution only depends on the mean of the delay and is independent of its distribution. We numerically show that the stochastic reaction delay always slightly amplifies the mean protein level but remarkably reduces the protein noise (quantified by the ratio of the variance over the squared average). Our analysis indicates that stochastic reaction delay is an important factor affecting gene expression.

Queuing Models of Gene Expression: Analytical Distributions and Beyond

Activation of a gene is a multistep biochemical process, involving recruitments of transcription factors and histone kinases as well as modification of histones. Many of these intermediate reaction steps would have been unspecified by experiments. Therefore, classical two-state models of gene expression established based on the memoryless (or Markovian) assumption would not well describe the reality in gene expression. Recent experimental data have indicated that the inactive phases of gene promoters are differently distributed, showing strong memory. Here, we use a nonexponential waiting-time distribution to model the complex activation process of a gene, and then analyze a queuing model of stochastic transcription. We successfully derive the analytical expression of the stationary mRNA distribution, which provides insight into the effect of molecular memory created by complex activating events on the mRNA expression. We find that the reduction in the waiting-time noise may result in the increase in the mRNA noise, contrary to the previous conclusion. Based on the derived distribution, we also develop a method to infer the waiting-time distribution from a known mRNA distribution. Data analysis on a realistic example verifies the validity of this method.

The SIR dynamic model of infectious disease transmission and its analogy with chemical kinetics

Mathematical models of the dynamics of infectious disease transmission are used to forecast epidemics and assess mitigation strategies. In this article, we highlight the analogy between the dynamics of disease transmission and chemical reaction kinetics while providing an exposition on the classic Susceptible–Infectious–Removed (SIR) epidemic model. Particularly, the SIR model resembles a dynamic model of a batch reactor carrying out an autocatalytic reaction with catalyst deactivation. This analogy between disease transmission and chemical reaction enables the exchange of ideas between epidemic and chemical kinetic modeling communities.

Analytical results for non-Markovian models of bursty gene expression

Modeling stochastic gene expression has long relied on Markovian hypothesis. In recent years, however, this hypothesis is challenged by the increasing availability of time-resolved data. Correspondingly, there is considerable interest in understanding how non-Markovian reaction kinetics of gene expression impact protein variations across a population of genetically identical cells. Here, we analyze a stochastic model of gene expression with arbitrary waiting-time distributions, which includes existing gene models as its special cases. We find that stationary probabilistic behavior of this non-Markovian system is exactly the same as that of an equivalent Markovian system with the same substrates. Based on this fact, we derive analytical results, which provide insight into the roles of feedback regulation and molecular memory in controlling the protein noise and properties of the steady states, which are inaccessible via existing methodology. Our results also provide quantitative insight into diverse cellular processes involving stochastic sources of gene expression and molecular memory.

Spheroid-Based Approach to Assess the Tissue Relevance of Analysis of Dispersed-Settled Tissue Cells by Cytometry of the Reaction Rate Constant

Cytometry of Reaction Rate Constant (CRRC) uses time-lapse fluorescence microscopy to measure a rate constant of a catalytic reaction in individual cells and, thus, facilitate accurate size determination for cell subpopulations with distinct efficiencies of this reaction. Reliable CRRC requires uniform exposure of cells to the reaction substrate followed by their uniform imaging, which in turn, requires that a tissue sample be disintegrated into a suspension of dispersed cells, and these cells settle on the support surface before being analyzed by CRRC. We call such cells "dispersed-settled" to distinguish them from cells cultured as a monolayer. Studies of the dispersed-settled cells can be tissue-relevant only if the cells maintain their 3D tissue state during the multi-hour CRRC procedure. Here, we propose an approach for assessing tissue relevance of the CRRC-based analysis of the dispersed-settled cells. Our approach utilizes cultured multicellular spheroids as a 3D cell model and cultured cell monolayers as a 2D cell model. The CRRC results of the dispersed-settled cells derived from spheroids are compared to those of spheroids and monolayers in order to find if the dispersed-settled cells are representative of the spheroids. To demonstrate its practical use, we applied this approach to a cellular reaction of multidrug resistance (MDR) transport, which was followed by extrusion of a fluorescent substrate from the cells. The approach proved to be reliable and revealed long-term maintenance of MDR transport in the dispersed-settled cells obtained from cultured ovarian cancer spheroids. Accordingly, CRRC can be used to determine accurately the size of a cell subpopulation with an elevated level of MDR transport in tumor samples, which makes CRRC a suitable method for the development of MDR-based predictors of chemoresistance. The proposed spheroid-based approach for validation of CRRC is applicable to other types of cellular reactions and, thus, will be an indispensable tool for transforming CRRC from an experimental technique into a practical analytical tool.

Transcription in Living Cells: Molecular Mechanisms of Bursting

Transcription in several organisms from certain bacteria to humans has been observed to be stochastic in nature: toggling between active and inactive states. Periods of active nascent RNA synthesis known as bursts represent individual gene activation events in which multiple polymerases are initiated. Therefore, bursting is the single locus illustration of both gene activation and repression. Although transcriptional bursting was originally observed decades ago, only recently have technological advances enabled the field to begin elucidating gene regulation at the single-locus level. In this review, we focus on how biochemical, genomic, and single-cell data describe the regulatory steps of transcriptional bursts.

Enhancement of gene expression noise from transcription factor binding to genomic decoy sites

The genome contains several high-affinity non-functional binding sites for transcription factors (TFs) creating a hidden and unexplored layer of gene regulation. We investigate the role of such “decoy sites” in controlling noise (random fluctuations) in the level of a TF that is synthesized in stochastic bursts. Prior studies have assumed that decoy-bound TFs are protected from degradation, and in this case decoys function to buffer noise. Relaxing this assumption to consider arbitrary degradation rates for both bound/unbound TF states, we find rich noise behaviors. For low-affinity decoys, noise in the level of unbound TF always monotonically decreases to the Poisson limit with increasing decoy numbers. In contrast, for high-affinity decoys, noise levels first increase with increasing decoy numbers, before decreasing back to the Poisson limit. Interestingly, while protection of bound TFs from degradation slows the time-scale of fluctuations in the unbound TF levels, the decay of bound TFs leads to faster fluctuations and smaller noise propagation to downstream target proteins. In summary, our analysis reveals stochastic dynamics emerging from nonspecific binding of TFs and highlights the dual role of decoys as attenuators or amplifiers of gene expression noise depending on their binding affinity and stability of the bound TF.

Qualitative and quantitative nature of mutual interactions dictate chemical noise in a democratic reaction network

The functions of a living cell rely on a complex network of biochemical reactions that allow it to respond against various internal and external cues. The outcomes of these chemical reactions are often stochastic due to intrinsic and extrinsic noise leading to population heterogeneity. The majority of calculations of stochasticity in reaction networks have focused on small regulatory networks addressing the role of timescales, feedback regulations, and network topology in propagation of noise. Here we computationally investigated chemical noise in a network with democratic architecture where each node is regulated by all other nodes in the network. We studied the effects of the qualitative and quantitative nature of mutual interactions on the propagation of both intrinsic and extrinsic noise in the network. We show that an increased number of inhibitory signals lead to ultrasensitive switching of average and that leads to sharp transition of intrinsic noise. The intrinsic noise exhibits a biphasic power-law scaling with the average, and the scaling coefficients strongly correlate with the strength of inhibitory signal. The noise strength critically depends on the strength of the interactions, where negative interactions attenuate both intrinsic and extrinsic noise.

A hybrid stochastic model of the budding yeast cell cycle

The growth and division of eukaryotic cells are regulated by complex, multi-scale networks. In this process, the mechanism of controlling cell-cycle progression has to be robust against inherent noise in the system. In this paper, a hybrid stochastic model is developed to study the effects of noise on the control mechanism of the budding yeast cell cycle. The modeling approach leverages, in a single multi-scale model, the advantages of two regimes: (1) the computational efficiency of a deterministic approach, and (2) the accuracy of stochastic simulations. Our results show that this hybrid stochastic model achieves high computational efficiency while generating simulation results that match very well with published experimental measurements.

Molecular-memory-driven phenotypic switching in a genetic toggle switch without cooperative binding

A genetic toggle switch would involve multistep reaction processes (e.g., complex promoter activation), creating memories between individual reaction events. Revealing the effect of this molecular memory is important for understanding intracellular processes such as cellular decision making. We propose a generalized genetic toggle switch model and use a generalized chemical master equation theory to account for the memory effect. Interestingly, we find that molecular memory can induce bimodality in this memory system although the corresponding memoryless counterpart is not bimodal. This finding implies a plausible alternative mechanism for phenotypic switching that is driven by molecular memory rather than by ultrasensitivity or cooperative binding as shown in previous studies. We also find that unbalanced memories arising from the processes by which mutually inhibiting transcription factors are produced can give rise to asymmetric bimodality without changing the positions of two peaks in the bimodal protein distribution. Given the prevalence of molecular memory in gene regulation, our findings would provide insights into cell fate decisions in growth and development.

Analysis of Single-Cell Gene Pair Coexpression Landscapes by Stochastic Kinetic Modeling Reveals Gene-Pair Interactions in Development

Single-cell transcriptomics is advancing discovery of the molecular determinants of cell identity, while spurring development of novel data analysis methods. Stochastic mathematical models of gene regulatory networks help unravel the dynamic, molecular mechanisms underlying cell-to-cell heterogeneity, and can thus aid interpretation of heterogeneous cell-states revealed by single-cell measurements. However, integrating stochastic gene network models with single cell data is challenging. Here, we present a method for analyzing single-cell gene-pair coexpression patterns, based on biophysical models of stochastic gene expression and interaction dynamics. We first developed a high-computational-throughput approach to stochastic modeling of gene-pair coexpression landscapes, based on numerical solution of gene network Master Equations. We then comprehensively catalogued coexpression patterns arising from tens of thousands of gene-gene interaction models with different biochemical kinetic parameters and regulatory interactions. From the computed landscapes, we obtain a low-dimensional "shape-space" describing distinct types of coexpression patterns. We applied the theoretical results to analysis of published single cell RNA sequencing data and uncovered complex dynamics of coexpression among gene pairs during embryonic development. Our approach provides a generalizable framework for inferring evolution of gene-gene interactions during critical cell-state transitions.

Improvement of the memory function of a mutual repression network in a stochastic environment by negative autoregulation

BACKGROUND

Cellular memory is a ubiquitous function of biological systems. By generating a sustained response to a transient inductive stimulus, often due to bistability, memory is central to the robust control of many important biological processes. However, our understanding of the origins of cellular memory remains incomplete. Stochastic fluctuations that are inherent to most biological systems have been shown to hamper memory function. Yet, how stochasticity changes the behavior of genetic circuits is generally not clear from a deterministic analysis of the network alone. Here, we apply deterministic rate equations, stochastic simulations, and theoretical analyses of Fokker-Planck equations to investigate how intrinsic noise affects the memory function in a mutual repression network.

RESULTS

We find that the addition of negative autoregulation improves the persistence of memory in a small gene regulatory network by reducing stochastic fluctuations. Our theoretical analyses reveal that this improved memory function stems from an increased stability of the steady states of the system. Moreover, we show how the tuning of critical network parameters can further enhance memory.

CONCLUSIONS

Our work illuminates the power of stochastic and theoretical approaches to understanding biological circuits, and the importance of considering stochasticity when designing synthetic circuits with memory function.