Transcription stochasticity of complex gene regulation models

Leveraging gene correlations in single cell transcriptomic data

BACKGROUND

Many approaches have been developed to overcome technical noise in single cell RNA-sequencing (scRNAseq). As researchers dig deeper into data-looking for rare cell types, subtleties of cell states, and details of gene regulatory networks-there is a growing need for algorithms with controllable accuracy and fewer ad hoc parameters and thresholds. Impeding this goal is the fact that an appropriate null distribution for scRNAseq cannot simply be extracted from data in which ground truth about biological variation is unknown (i.e., usually).

RESULTS

We approach this problem analytically, assuming that scRNAseq data reflect only cell heterogeneity (what we seek to characterize), transcriptional noise (temporal fluctuations randomly distributed across cells), and sampling error (i.e., Poisson noise). We analyze scRNAseq data without normalization-a step that skews distributions, particularly for sparse data-and calculate p values associated with key statistics. We develop an improved method for selecting features for cell clustering and identifying gene-gene correlations, both positive and negative. Using simulated data, we show that this method, which we call BigSur (Basic Informatics and Gene Statistics from Unnormalized Reads), captures even weak yet significant correlation structures in scRNAseq data. Applying BigSur to data from a clonal human melanoma cell line, we identify thousands of correlations that, when clustered without supervision into gene communities, align with known cellular components and biological processes, and highlight potentially novel cell biological relationships.

CONCLUSIONS

New insights into functionally relevant gene regulatory networks can be obtained using a statistically grounded approach to the identification of gene-gene correlations.

Exact burst-size distributions for gene-expression models with complex promoter structure

In prokaryotic and eukaryotic cells, most genes are transcribed in a bursty fashion on one hand and complex gene regulations may lead to complex promoter structure on the other hand. This raises an unsolved issue: how does promoter structure shape transcriptional bursting kinetics characterized by burst size and frequency? Here we analyze stochastic models of gene transcription, which consider complex regulatory mechanisms. Notably, we develop an efficient method to derive exact burst-size distributions. The analytical results show that if the promoter of a gene contains only one active state, the burst size indeed follows a geometric distribution, in agreement with the previous result derived under certain limiting conditions. However, if it contains a multitude of active states, the burst size in general obeys a non-geometric distribution, which is a linearly weighted sum of geometric distributions. This superposition principle reveals the essential feature of bursting kinetics in complex cases of transcriptional regulation although it seems that there has been no direct experimental confirmation. The derived burst-size distributions not only highlight the importance of promoter structure in regulating bursting kinetics, but can be also used in the exact inference of this kinetics based on experimental data.

Transcriptional bursting dynamics in gene expression

Gene transcription is a stochastic process that occurs in all organisms. Transcriptional bursting, a critical molecular dynamics mechanism, creates significant heterogeneity in mRNA and protein levels. This heterogeneity drives cellular phenotypic diversity. Currently, the lack of a comprehensive quantitative model limits the research on transcriptional bursting. This review examines various gene expression models and compares their strengths and weaknesses to guide researchers in selecting the most suitable model for their research context. We also provide a detailed summary of the key metrics related to transcriptional bursting. We compared the temporal dynamics of transcriptional bursting across species and the molecular mechanisms influencing these bursts, and highlighted the spatiotemporal patterns of gene expression differences by utilizing metrics such as burst size and burst frequency. We summarized the strategies for modeling gene expression from both biostatistical and biochemical reaction network perspectives. Single-cell sequencing data and integrated multiomics approaches drive our exploration of cutting-edge trends in transcriptional bursting mechanisms. Moreover, we examined classical methods for parameter estimation that help capture dynamic parameters in gene expression data, assessing their merits and limitations to facilitate optimal parameter estimation. Our comprehensive summary and review of the current transcriptional burst dynamics theories provide deeper insights for promoting research on the nature of cell processes, cell fate determination, and cancer diagnosis.

Nascent RNA kinetics with complex promoter architecture: Analytic results and parameter inference

Transcription is a stochastic process that involves several downstream operations which make it difficult to model and infer transcription kinetics from mature RNA numbers in individual cell. However, recent advances in single-cell technologies have enabled a more precise measurement of the fluctuations of nascent RNA that closely reflect transcription kinetics. In this paper we introduce a general stochastic model to mimic nascent RNA kinetics with complex promoter architecture. We derive the exact distribution and moments of nascent RNA using queuing theory techniques, which provide valuable insights into the effect of the molecular memory created by the multistep activation and deactivation on the stochastic kinetics of nascent RNA. Moreover, based on the analytical results, we develop a statistical method to infer the promoter memory from stationary nascent RNA distributions. Data analysis of synthetic data and a realistic example, the HIV-1 gene, verifies the validity of this inference method.

Solving stochastic gene-expression models using queueing theory: A tutorial review

Stochastic models of gene expression are typically formulated using the chemical master equation, which can be solved exactly or approximately using a repertoire of analytical methods. Here, we provide a tutorial review of an alternative approach based on queueing theory that has rarely been used in the literature of gene expression. We discuss the interpretation of six types of infinite-server queues from the angle of stochastic single-cell biology and provide analytical expressions for the stationary and nonstationary distributions and/or moments of mRNA/protein numbers and bounds on the Fano factor. This approach may enable the solution of complex models that have hitherto evaded analytical solution.

GAiN: An integrative tool utilizing generative adversarial neural networks for augmented gene expression analysis

Big genomic data and artificial intelligence (AI) are ushering in an era of precision medicine, providing opportunities to study previously under-represented subtypes and rare diseases rather than categorize them as variances. However, clinical researchers face challenges in accessing such novel technologies as well as reliable methods to study small datasets or subcohorts with unique phenotypes. To address this need, we developed an integrative approach, GAiN, to capture patterns of gene expression from small datasets on the basis of an ensemble of generative adversarial networks (GANs) while leveraging big population data. Where conventional biostatistical methods fail, GAiN reliably discovers differentially expressed genes (DEGs) and enriched pathways between two cohorts with limited numbers of samples (n = 10) when benchmarked against a gold standard. GAiN is freely available at GitHub. Thus, GAiN may serve as a crucial tool for gene expression analysis in scenarios with limited samples, as in the context of rare diseases, under-represented populations, or limited investigator resources.

Exact results for gene-expression models with general waiting-time distributions

Complex molecular details of transcriptional regulation can be coarse-grained by assuming that reaction waiting times for promoter-state transitions, the mRNA synthesis, and the mRNA degradation follow general distributions. However, how such a generalized two-state model is analytically solved is a long-standing issue. Here we first present analytical formulas of burst-size distributions for this model. Then, we derive an iterative equation for the mRNA moment-generating function, by which mRNA raw and binomial moments of any order can be conveniently calculated. The analytical results obtained in the special cases of phase-type waiting-time distributions not only provide insights into the mechanisms of complex transcriptional regulations but also bring conveniences for experimental data-based statistical inferences.

Poisson representation: a bridge between discrete and continuous models of stochastic gene regulatory networks

Stochastic gene expression dynamics can be modelled either discretely or continuously. Previous studies have shown that the mRNA or protein number distributions of some simple discrete and continuous gene expression models are related by Gardiner's Poisson representation. Here, we systematically investigate the Poisson representation in complex stochastic gene regulatory networks. We show that when the gene of interest is unregulated, the discrete and continuous descriptions of stochastic gene expression are always related by the Poisson representation, no matter how complex the model is. This generalizes the results obtained in Dattani & Barahona (Dattani & Barahona 2017 J. R. Soc. Interface 14, 20160833 (doi:10.1098/rsif.2016.0833)). In addition, using a simple counter-example, we find that the Poisson representation in general fails to link the two descriptions when the gene is regulated. However, for a general stochastic gene regulatory network, we demonstrate that the discrete and continuous models are approximately related by the Poisson representation in the limit of large protein numbers. These theoretical results are further applied to analytically solve many complex gene expression models whose exact distributions are previously unknown.

Leveraging gene correlations in single cell transcriptomic data

BACKGROUND

Many approaches have been developed to overcome technical noise in single cell RNA-sequencing (scRNAseq). As researchers dig deeper into data-looking for rare cell types, subtleties of cell states, and details of gene regulatory networks-there is a growing need for algorithms with controllable accuracy and fewer ad hoc parameters and thresholds. Impeding this goal is the fact that an appropriate null distribution for scRNAseq cannot simply be extracted from data when ground truth about biological variation is unknown (i.e., usually).

RESULTS

We approach this problem analytically, assuming that scRNAseq data reflect only cell heterogeneity (what we seek to characterize), transcriptional noise (temporal fluctuations randomly distributed across cells), and sampling error (i.e., Poisson noise). We analyze scRNAseq data without normalization-a step that skews distributions, particularly for sparse data-and calculate p-values associated with key statistics. We develop an improved method for selecting features for cell clustering and identifying gene-gene correlations, both positive and negative. Using simulated data, we show that this method, which we call BigSur (Basic Informatics and Gene Statistics from Unnormalized Reads), captures even weak yet significant correlation structures in scRNAseq data. Applying BigSur to data from a clonal human melanoma cell line, we identify thousands of correlations that, when clustered without supervision into gene communities, align with known cellular components and biological processes, and highlight potentially novel cell biological relationships.

CONCLUSIONS

New insights into functionally relevant gene regulatory networks can be obtained using a statistically grounded approach to the identification of gene-gene correlations.

Regulatory Mechanisms for Transcriptional Bursting Revealed by an Event-Based Model

Gene transcription often occurs in discrete bursts, and it can be difficult to deduce the underlying regulatory mechanisms for transcriptional bursting with limited experimental data. Here, we categorize numerous states of single eukaryotic genes and identify 6 essential transcriptional events, each comprising a series of state transitions; transcriptional bursting is characterized as a sequence of 4 events, capable of being organized in various configurations, in addition to the beginning and ending events. By associating transcriptional kinetics with mean durations and recurrence probabilities of the events, we unravel how transcriptional bursting is modulated by various regulators including transcription factors. Through analytical derivation and numerical simulation, this study reveals key state transitions contributing to transcriptional sensitivity and specificity, typical characteristics of burst profiles, global constraints on intrinsic transcriptional noise, major regulatory modes in individual genes and across the genome, and requirements for fast gene induction upon stimulation. It is illustrated how biochemical reactions on different time scales are modulated to separately shape the durations and ordering of the events. Our results suggest that transcriptional patterns are essentially controlled by a shared set of transcriptional events occurring under specific promoter architectures and regulatory modes, the number of which is actually limited.

Deciphering a global source of non-genetic heterogeneity in cancer cells

Cell-to-cell variability within a clonal population, also known as non-genetic heterogeneity, has created significant challenges for intervening with diseases such as cancer. While non-genetic heterogeneity can arise from the variability in the expression of specific genes, it remains largely unclear whether and how clonal cells could be heterogeneous in the expression of the entire transcriptome. Here, we showed that gene transcriptional activity is globally modulated in individual cancer cells, leading to non-genetic heterogeneity in the global transcription rate. Such heterogeneity contributes to cell-to-cell variability in transcriptome size and displays both dynamic and static characteristics, with the global transcription rate temporally modulated in a cell-cycle-coupled manner and the time-averaged rate being distinct between cells and heritable across generations. Additional evidence indicated the role of ATP metabolism in this heterogeneity, and suggested its implication in intrinsic cancer drug tolerance. Collectively, our work shed light on the mode, mechanism, and implication of a global but often hidden source of non-genetic heterogeneity.

Inferring transcriptional bursting kinetics from single-cell snapshot data using a generalized telegraph model

Gene expression has inherent stochasticity resulting from transcription's burst manners. Single-cell snapshot data can be exploited to rigorously infer transcriptional burst kinetics, using mathematical models as blueprints. The classical telegraph model (CTM) has been widely used to explain transcriptional bursting with Markovian assumptions. However, growing evidence suggests that the gene-state dwell times are generally non-exponential, as gene-state switching is a multi-step process in organisms. Therefore, interpretable non-Markovian mathematical models and efficient statistical inference methods are urgently required in investigating transcriptional burst kinetics. We develop an interpretable and tractable model, the generalized telegraph model (GTM), to characterize transcriptional bursting that allows arbitrary dwell-time distributions, rather than exponential distributions, to be incorporated into the ON and OFF switching process. Based on the GTM, we propose an inference method for transcriptional bursting kinetics using an approximate Bayesian computation framework. This method demonstrates an efficient and scalable estimation of burst frequency and burst size on synthetic data. Further, the application of inference to genome-wide data from mouse embryonic fibroblasts reveals that GTM would estimate lower burst frequency and higher burst size than those estimated by CTM. In conclusion, the GTM and the corresponding inference method are effective tools to infer dynamic transcriptional bursting from static single-cell snapshot data.

RNA cytometry of single-cells using semi-permeable microcapsules

Analytical tools for gene expression profiling of individual cells are critical for studying complex biological systems. However, the techniques enabling rapid measurements of gene expression on thousands of single-cells are lacking. Here, we report a high-throughput RNA cytometry for digital profiling of single-cells isolated in liquid droplets enveloped by a thin semi-permeable membrane (microcapsules). Due to the selective permeability of the membrane, the desirable enzymes and reagents can be loaded, or replaced, in the microcapsule at any given step by simply changing the reaction buffer in which the microcapsules are dispersed. Therefore, complex molecular biology workflows can be readily adapted to conduct nucleic acid analysis on encapsulated mammalian cells, or other biological species. The microcapsules support sequential multi-step enzymatic reactions and remain intact under different biochemical conditions, freezing, thawing, and thermocycling. Combining microcapsules with conventional FACS provides a high-throughput approach for conducting RNA cytometry of individual cells based on their digital gene expression signature.

Full classification of dynamics for one-dimensional continuous-time Markov chains with polynomial transition rates

This paper provides a full classification of the dynamics for continuous-time Markov chains (CTMCs) on the nonnegative integers with polynomial transition rate functions and without arbitrary large backward jumps. Such stochastic processes are abundant in applications, in particular in biology. More precisely, for CTMCs of bounded jumps, we provide necessary and sufficient conditions in terms of calculable parameters for explosivity, recurrence versus transience, positive recurrence versus null recurrence, certain absorption, and implosivity. Simple sufficient conditions for exponential ergodicity of stationary distributions and quasi-stationary distributions as well as existence and nonexistence of moments of hitting times are also obtained. Similar simple sufficient conditions for the aforementioned dynamics together with their opposite dynamics are established for CTMCs with unbounded forward jumps. Finally, we apply our results to stochastic reaction networks, an extended class of branching processes, a general bursty single-cell stochastic gene expression model, and population processes, none of which are birth–death processes. The approach is based on a mixture of Lyapunov–Foster-type results, the classical semimartingale approach, and estimates of stationary measures.

Kinetic characteristics of transcriptional bursting in a complex gene model with cyclic promoter structure

While transcription often occurs in a bursty manner, various possible regulations can lead to complex promoter patterns such as promoter cycles, giving rise to an important question: How do promoter kinetics shape transcriptional bursting kinetics? Here we introduce and analyze a general model of the promoter cycle consisting of multi-OFF states and multi-ON states, focusing on the effects of multi-ON mechanisms on transcriptional bursting kinetics. The derived analytical results indicate that burst size follows a mixed geometric distribution rather than a single geometric distribution assumed in previous studies, and ON and OFF times obey their own mixed exponential distributions. In addition, we find that the multi-ON mechanism can lead to bimodal burst-size distribution, antagonistic timing of ON and OFF, and diverse burst frequencies, each further contributing to cell-to-cell variability in the mRNA expression level. These results not only reveal essential features of transcriptional bursting kinetics patterns shaped by multi-state mechanisms but also can be used to the inferences of transcriptional bursting kinetics and promoter structure based on experimental data.

Exact distributions for stochastic gene expression models with arbitrary promoter architecture and translational bursting

Gene expression in individual cells is inherently variable and sporadic, leading to cell-to-cell variability in mRNA and protein levels. Recent single-cell and single-molecule experiments indicate that promoter architecture and translational bursting play significant roles in controlling gene expression noise and generating the phenotypic diversity that life exhibits. To quantitatively understand the impact of these factors, it is essential to construct an accurate mathematical description of stochastic gene expression and find the exact analytical results, which is a formidable task. Here, we develop a stochastic model of bursty gene expression, which considers the complex promoter architecture governing the variability in mRNA expression and a general distribution characterizing translational burst. We derive the analytical expression for the corresponding protein steady-state distribution and all moment statistics of protein counts. We show that the total protein noise can be decomposed into three parts: the low-copy noise of protein due to probabilistic individual birth and death events, the noise due to stochastic switching between promoter states, and the noise resulting from translational busting. The theoretical results derived provide quantitative insights into the biochemical mechanisms of stochastic gene expression.

A Language for Modeling and Optimizing Experimental Biological Protocols

Automation is becoming ubiquitous in all laboratory activities, moving towards precisely defined and codified laboratory protocols. However, the integration between laboratory protocols and mathematical models is still lacking. Models describe physical processes, while protocols define the steps carried out during an experiment: neither cover the domain of the other, although they both attempt to characterize the same phenomena. We should ideally start from an integrated description of both the model and the steps carried out to test it, to concurrently analyze uncertainties in model parameters, equipment tolerances, and data collection. To this end, we present a language to model and optimize experimental biochemical protocols that facilitates such an integrated description, and that can be combined with experimental data. We provide probabilistic semantics for our language in terms of Gaussian processes (GPs) based on the linear noise approximation (LNA) that formally characterizes the uncertainties in the data collection, the underlying model, and the protocol operations. In a set of case studies, we illustrate how the resulting framework allows for automated analysis and optimization of experimental protocols, including Gibson assembly protocols.

Exact results for queuing models of stochastic transcription with memory and crosstalk

Gene transcription is a complex multistep biochemical process, which can create memory between individual reaction events. On the other hand, many inducible genes, when activated by external cues, are often coregulated by several competitive pathways with crosstalk. This raises an unexplored question: how do molecular memory and crosstalk together affect gene expressions? To address this question, we introduce a queuing model of stochastic transcription, where two crossing signaling pathways are used to direct gene activation in response to external signals and memory functions to model multistep reaction processes involved in transcription. We first establish, based on the total probability principle, the chemical master equation for this queuing model, and then we derive, based on the binomial moment approach, exact expressions for statistical quantities (including distributions) of mRNA, which provide insights into the roles of crosstalk and memory in controlling the mRNA level and noise. We find that molecular memory of gene activation decreases the mRNA level but increases the mRNA noise, and double activation pathways always reduce the mRNA noise in contrast to a single pathway. In addition, we find that molecular memory can make the mRNA bimodality disappear.

Correlation between external regulators governs the mean-noise relationship in stochastic gene expression

Gene transcription in single cells is inherently a probabilistic process. The relationship between variance ($ \sigma^{2} $) and mean expression ($ \mu $) is of paramount importance for investigations into the evolutionary origins and consequences of noise in gene expression. It is often formulated as $ \log \left({{{\sigma}^{2}}}/{{{\mu}^{2}}}\; \right) = \beta\log\mu+\log\alpha $, where $ \beta $ is a key parameter since its sign determines the qualitative dependence of noise on mean. We reveal that the sign of $ \beta $ is controlled completely by external regulation, but independent of promoter structure. Specifically, it is negative if regulators as stochastic variables are independent but positive if they are correlated. The essential mechanism revealed here can well interpret diverse experimental phenomena underlying expression noise. Our results imply that external regulation rather than promoter sequence governs the mean-noise relationship.

Queuing Models of Gene Expression: Analytical Distributions and Beyond

Activation of a gene is a multistep biochemical process, involving recruitments of transcription factors and histone kinases as well as modification of histones. Many of these intermediate reaction steps would have been unspecified by experiments. Therefore, classical two-state models of gene expression established based on the memoryless (or Markovian) assumption would not well describe the reality in gene expression. Recent experimental data have indicated that the inactive phases of gene promoters are differently distributed, showing strong memory. Here, we use a nonexponential waiting-time distribution to model the complex activation process of a gene, and then analyze a queuing model of stochastic transcription. We successfully derive the analytical expression of the stationary mRNA distribution, which provides insight into the effect of molecular memory created by complex activating events on the mRNA expression. We find that the reduction in the waiting-time noise may result in the increase in the mRNA noise, contrary to the previous conclusion. Based on the derived distribution, we also develop a method to infer the waiting-time distribution from a known mRNA distribution. Data analysis on a realistic example verifies the validity of this method.

Phenotypic selection through cell death: stochastic modelling of O-6-methylguanine-DNA methyltransferase dynamics

Glioblastoma (GBM) is the most aggressive malignant primary brain tumour with a median overall survival of 15 months. To treat GBM, patients currently undergo a surgical resection followed by exposure to radiotherapy and concurrent and adjuvant temozolomide (TMZ) chemotherapy. However, this protocol often leads to treatment failure, with drug resistance being the main reason behind this. To date, many studies highlight the role of O-6-methylguanine-DNA methyltransferase (MGMT) in conferring drug resistance. The mechanism through which MGMT confers resistance is not well studied-particularly in terms of computational models. With only a few reasonable biological assumptions, we were able to show that even a minimal model of MGMT expression could robustly explain TMZ-mediated drug resistance. In particular, we showed that for a wide range of parameter values constrained by novel cell growth and viability assays, a model accounting for only stochastic gene expression of MGMT coupled with cell growth, division, partitioning and death was able to exhibit phenotypic selection of GBM cells expressing MGMT in response to TMZ. Furthermore, we found this selection allowed the cells to pass their acquired phenotypic resistance onto daughter cells in a stable manner (as long as TMZ is provided). This suggests that stochastic gene expression alone is enough to explain the development of chemotherapeutic resistance.

Analytical results for non-Markovian models of bursty gene expression

Modeling stochastic gene expression has long relied on Markovian hypothesis. In recent years, however, this hypothesis is challenged by the increasing availability of time-resolved data. Correspondingly, there is considerable interest in understanding how non-Markovian reaction kinetics of gene expression impact protein variations across a population of genetically identical cells. Here, we analyze a stochastic model of gene expression with arbitrary waiting-time distributions, which includes existing gene models as its special cases. We find that stationary probabilistic behavior of this non-Markovian system is exactly the same as that of an equivalent Markovian system with the same substrates. Based on this fact, we derive analytical results, which provide insight into the roles of feedback regulation and molecular memory in controlling the protein noise and properties of the steady states, which are inaccessible via existing methodology. Our results also provide quantitative insight into diverse cellular processes involving stochastic sources of gene expression and molecular memory.

Molecular-memory-driven phenotypic switching in a genetic toggle switch without cooperative binding

A genetic toggle switch would involve multistep reaction processes (e.g., complex promoter activation), creating memories between individual reaction events. Revealing the effect of this molecular memory is important for understanding intracellular processes such as cellular decision making. We propose a generalized genetic toggle switch model and use a generalized chemical master equation theory to account for the memory effect. Interestingly, we find that molecular memory can induce bimodality in this memory system although the corresponding memoryless counterpart is not bimodal. This finding implies a plausible alternative mechanism for phenotypic switching that is driven by molecular memory rather than by ultrasensitivity or cooperative binding as shown in previous studies. We also find that unbalanced memories arising from the processes by which mutually inhibiting transcription factors are produced can give rise to asymmetric bimodality without changing the positions of two peaks in the bimodal protein distribution. Given the prevalence of molecular memory in gene regulation, our findings would provide insights into cell fate decisions in growth and development.

Models of protein production along the cell cycle: An investigation of possible sources of noise

In this article, we quantitatively study, through stochastic models, the effects of several intracellular phenomena, such as cell volume growth, cell division, gene replication as well as fluctuations of available RNA polymerases and ribosomes. These phenomena are indeed rarely considered in classic models of protein production and no relative quantitative comparison among them has been performed. The parameters for a large and representative class of proteins are determined using experimental measures. The main important and surprising conclusion of our study is to show that despite the significant fluctuations of free RNA polymerases and free ribosomes, they bring little variability to protein production contrary to what has been previously proposed in the literature. After verifying the robustness of this quite counter-intuitive result, we discuss its possible origin from a theoretical view, and interpret it as the result of a mean-field effect.

Markovian approaches to modeling intracellular reaction processes with molecular memory

Many cellular processes are governed by stochastic reaction events. These events do not necessarily occur in single steps of individual molecules, and, conversely, each birth or death of a macromolecule (e.g., protein) could involve several small reaction steps, creating a memory between individual events and thus leading to nonmarkovian reaction kinetics. Characterizing this kinetics is challenging. Here, we develop a systematic approach for a general reaction network with arbitrary intrinsic waiting-time distributions, which includes the stationary generalized chemical-master equation (sgCME), the stationary generalized Fokker-Planck equation, and the generalized linear-noise approximation. The first formulation converts a nonmarkovian issue into a markovian one by introducing effective transition rates (that explicitly decode the effect of molecular memory) for the reactions in an equivalent reaction network with the same substrates but without molecular memory. Nonmarkovian features of the reaction kinetics can be revealed by solving the sgCME. The latter 2 formulations can be used in the fast evaluation of fluctuations. These formulations can have broad applications, and, in particular, they may help us discover new biological knowledge underlying memory effects. When they are applied to generalized stochastic models of gene-expression regulation, we find that molecular memory is in effect equivalent to a feedback and can induce bimodality, fine-tune the expression noise, and induce switch.

Quantifying heterogeneity of stochastic gene expression

The heterogeneity of stochastic gene expression, which refers to the temporal fluctuation in a gene product and its cell-to-cell variation, has attracted considerable interest from biologists, physicists, and mathematicians. The dynamics of protein production and degradation have been modeled as random processes with transition probabilities. However, there is a gap between theory and phenomena, particularly in terms of analytical formulation and parameter estimation. In this study, we propose a theoretical framework in which we present a basic model of a gene regulatory system, derive a steady-state solution, and provide a Bayesian approach for estimating the model parameters from single-cell experimental data. The proposed framework is demonstrated to be applicable for various scales of single-cell experiments at both the mRNA and protein levels and is useful for comparing kinetic parameters across species, genomes, and cell strains.

Extreme calorie restriction in yeast retentostats induces uniform non-quiescent growth arrest

Non-dividing Saccharomyces cerevisiae cultures are highly relevant for fundamental and applied studies. However, cultivation conditions in which non-dividing cells retain substantial metabolic activity are lacking. Unlike stationary-phase (SP) batch cultures, the current experimental paradigm for non-dividing yeast cultures, cultivation under extreme calorie restriction (ECR) in retentostat enables non-dividing yeast cells to retain substantial metabolic activity and to prevent rapid cellular deterioration. Distribution of F-actin structures and single-cell copy numbers of specific transcripts revealed that cultivation under ECR yields highly homogeneous cultures, in contrast to SP cultures that differentiate into quiescent and non-quiescent subpopulations. Combined with previous physiological studies, these results indicate that yeast cells subjected to ECR survive in an extended G₁ phase. This study demonstrates that yeast cells exposed to ECR differ from carbon-starved cells and offer a promising experimental model for studying non-dividing, metabolically active, and robust eukaryotic cells.

Time-dependent solutions for a stochastic model of gene expression with molecule production in the form of a compound Poisson process

We study a stochastic model of gene expression, in which protein production has a form of random bursts whose size distribution is arbitrary, whereas protein decay is a first-order reaction. We find exact analytical expressions for the time evolution of the cumulant-generating function for the most general case when both the burst size probability distribution and the model parameters depend on time in an arbitrary (e.g., oscillatory) manner, and for arbitrary initial conditions. We show that in the case of periodic external activation and constant protein degradation rate, the response of the gene is analogous to the resistor-capacitor low-pass filter, where slow oscillations of the external driving have a greater effect on gene expression than the fast ones. We also demonstrate that the nth cumulant of the protein number distribution depends on the nth moment of the burst size distribution. We use these results to show that different measures of noise (coefficient of variation, Fano factor, fractional change of variance) may vary in time in a different manner. Therefore, any biological hypothesis of evolutionary optimization based on the nonmonotonic dependence of a chosen measure of noise on time must justify why it assumes that biological evolution quantifies noise in that particular way. Finally, we show that not only for exponentially distributed burst sizes but also for a wider class of burst size distributions (e.g., Dirac delta and gamma) the control of gene expression level by burst frequency modulation gives rise to proportional scaling of variance of the protein number distribution to its mean, whereas the control by amplitude modulation implies proportionality of protein number variance to the mean squared.

Dissecting the stochastic transcription initiation process in live Escherichia coli

We investigate the hypothesis that, in Escherichia coli, while the concentration of RNA polymerases differs in different growth conditions, the fraction of RNA polymerases free for transcription remains approximately constant within a certain range of these conditions. After establishing this, we apply a standard model-fitting procedure to fully characterize the in vivo kinetics of the rate-limiting steps in transcription initiation of the Plac/ara-1 promoter from distributions of intervals between transcription events in cells with different RNA polymerase concentrations. We find that, under full induction, the closed complex lasts ∼788 s while subsequent steps last ∼193 s, on average. We then establish that the closed complex formation usually occurs multiple times prior to each successful initiation event. Furthermore, the promoter intermittently switches to an inactive state that, on average, lasts ∼87 s. This is shown to arise from the intermittent repression of the promoter by LacI. The methods employed here should be of use to resolve the rate-limiting steps governing the in vivo dynamics of initiation of prokaryotic promoters, similar to established steady-state assays to resolve the in vitro dynamics.

Applications and implications of the exponentially modified gamma distribution as a model for time variabilities related to cell proliferation and gene expression

A panel of published distributions of cell interdivision times (IDT) comprising 77 datasets related to 16 cell types, some studied under different conditions, was used to evaluate their conformance to the exponentially modified gamma distribution (EMGD) in comparison with distributions suggested for IDT data earlier. Lognormal, gamma, inverse Gaussian, and shifted Weibull and gamma distributions were found to be generally inferior to EMGD. Exponentially modified Gaussian (EMG) performed equally well. Although EMGD or EMG may be worse than some other distributions in specific cases, the reason that IDT distributions must be generated by a common mechanism of the cell cycle makes it unlikely that they differ essentially in different cell types. Therefore, exponentially modified peak functions, such as EMGD or EMG, are most appropriate if the use of a single distribution for IDT data is reasonable. EMGD is also shown to be the best descriptive tool for published data on the distribution of times between the bursts of mRNA synthesis at defined genes in single cells. EMG is inadequate to such data because its Gaussian component markedly extends to the negative time domain. The applicability of EMGD to comparable features of cells and genes behaviors are discussed to support the validity of the transition probability model and to relate the exponential component of EMGD to the times of cell dwelling in the restriction point of the cell cycle.

Contributions of cell growth and biochemical reactions to nongenetic variability of cells

Cell-to-cell variability in the molecular composition of isogenic, steady-state growing cells arises spontaneously from the inherent stochasticity of intracellular biochemical reactions and cell growth. Here, we present a general decomposition of the total variance in the copy number per cell of a particular molecule. It quantifies the individual contributions made by processes associated with cell growth, biochemical reactions, and their control. We decompose the growth contribution further into variance contributions of random partitioning of molecules at cell division, mother-cell heterogeneity, and variation in cell-cycle progression. The contribution made by biochemical reactions is expressed in variance generated by molecule synthesis, degradation, and their regulation. We use this theory to study the influence of different growth and reaction-related processes, such as DNA replication, variable molecule-partitioning probability, and synthesis bursts, on stochastic cell-to-cell variability. Using simulations, we characterize the impact of noise in the generation-time on cell-to-cell variability. This article offers a widely-applicable theory on the influence of biochemical reactions and cellular growth on the phenotypic variability of growing, isogenic cells. The theory aids the design and interpretation of experiments involving single-molecule counting or real-time imaging of fluorescent reporter constructs.

Multiplex Eukaryotic Transcription (In)activation: Timing, Bursting and Cycling of a Ratchet Clock Mechanism

Activation of eukaryotic transcription is an intricate process that relies on a multitude of regulatory proteins forming complexes on chromatin. Chromatin modifications appear to play a guiding role in protein-complex assembly on chromatin. Together, these processes give rise to stochastic, often bursting, transcriptional activity. Here we present a model of eukaryotic transcription that aims to integrate those mechanisms. We use stochastic and ordinary-differential-equation modeling frameworks to examine various possible mechanisms of gene regulation by multiple transcription factors. We find that the assembly of large transcription factor complexes on chromatin via equilibrium-binding mechanisms is highly inefficient and insensitive to concentration changes of single regulatory proteins. An alternative model that lacks these limitations is a cyclic ratchet mechanism. In this mechanism, small protein complexes assemble sequentially on the promoter. Chromatin modifications mark the completion of a protein complex assembly, and sensitize the local chromatin for the assembly of the next protein complex. In this manner, a strict order of protein complex assemblies is attained. Even though the individual assembly steps are highly stochastic in duration, a sequence of them gives rise to a remarkable precision of the transcription cycle duration. This mechanism explains how transcription activation cycles, lasting for tens of minutes, derive from regulatory proteins residing on chromatin for only tens of seconds. Transcriptional bursts are an inherent feature of such transcription activation cycles. Bursting transcription can cause individual cells to remain in synchrony transiently, offering an explanation of transcriptional cycling as observed in cell populations, both on promoter chromatin status and mRNA levels.

Effects of promoter leakage on dynamics of gene expression

Background

Quantitative analysis of simple molecular networks is an important step forward understanding fundamental intracellular processes. As network motifs occurring recurrently in complex biological networks, gene auto-regulatory circuits have been extensively studied but gene expression dynamics remain to be fully understood, e.g., how promoter leakage affects expression noise is unclear.

Results

In this work, we analyze a gene model with auto regulation, where the promoter is assumed to have one active state with highly efficient transcription and one inactive state with very lowly efficient transcription (termed as promoter leakage). We first derive the analytical distribution of gene product, and then analyze effects of promoter leakage on expression dynamics including bursting kinetics. Interestingly, we find that promoter leakage always reduces expression noise and that increasing the leakage rate tends to simplify phenotypes. In addition, higher leakage results in fewer bursts.

Conclusions

Our results reveal the essential role of promoter leakage in controlling expression dynamics and further phenotype. Specifically, promoter leakage is a universal mechanism of reducing expression noise, controlling phenotypes in different environments and making the gene produce generate fewer bursts.

Electronic supplementary material

The online version of this article (doi:10.1186/s12918-015-0157-z) contains supplementary material, which is available to authorized users.

Feedback-induced counterintuitive correlations of gene expression noise with bursting kinetics

Previous studies showed that a higher frequency of bursting results in lower expression noise whereas a larger size of bursting leads to higher expression noise. Here, we show counterintuitive correlations of expression noise with bursting kinetics due to the effect of feedback. Specifically, in the case of increasing the negative feedback strength but keeping the mean expression fixed, both the mean burst frequency and the mean burst size are invariant if the off-switching rate decreases, but expression noise is reduced; or the mean burst frequency is invariant and the burst size decreases if the transcription rate increases, but expression noise is amplified. Similarly, in the case of increasing the positive feedback strength but keeping the mean expression fixed, both the mean burst frequency and the mean burst size are invariant if the on-switching rate decreases; or the mean burst frequency increases and the mean burst size is invariant if the leakage rate decreases, but expression noise is amplified. In addition, we find that the previous conclusion that a larger burst size results in the lower noise in burst size needs to be modified in the case of feedback. Our results not only clarify the confusing relationship between feedback and expression noise but also imply that the mRNA or protein noise is no longer a simple sum of the internal noise and the promoter noise as shown in the case of no feedback.

Reconciling the concurrent fast and slow cycling of proteins on gene promoters

During gene transcription, proteins appear to cycle on and off some gene promoters with both long (tens of minutes) and short periods (no more than several minutes). The essence of these phenomena still remains unclear. Here, we propose a stochastic model for the state evolution of promoters in terms of DNA-protein interactions. The model associates the characteristics of microscopic molecular interactions with macroscopic measurable quantities. Through theoretical derivation, we reconcile the contradictory viewpoints on the concurrent fast and slow cycling; both the cycling phenomena are further reproduced by fitting simulation results to the experimental data on the pS2 gene. Our results suggest that the fast cycling dictates how the proteins behave on the promoter and that stable binding hardly occurs. Different kinds of proteins rapidly bind/unbind the promoter at distinct transcriptional stages fulfilling specific functions; this feature is essentially manifested as the slow cycling of proteins when detected by chromatin immunoprecipitation assays. Thus, the slow cycling represents neither stable binding of proteins nor external modulation of the fast cycling. This work also reveals the relationship between the essence and measurement of transcriptional dynamics.

Exploration of the spontaneous fluctuating activity of single enzyme molecules

Single enzyme molecules display inevitable, stochastic fluctuations in their catalytic activity. In metabolism, for instance, the stochastic activity of individual enzymes is averaged out due to their high copy numbers per single cell. However, many processes inside cells rely on single enzyme activity, such as transcription, replication, translation, and histone modifications. Here we introduce the main theoretical concepts of stochastic single-enzyme activity starting from the Michaelis-Menten enzyme mechanism. Next, we discuss stochasticity of multi-substrate enzymes, of enzymes and receptors with multiple conformational states and finally, how fluctuations in receptor activity arise from fluctuations in signal concentration. This paper aims to introduce the exciting field of single-molecule enzyme kinetics and stochasticity to a wider audience of biochemists and systems biologists.

Eukaryotic transcriptional dynamics: from single molecules to cell populations

Transcriptional regulation is achieved through combinatorial interactions between regulatory elements in the human genome and a vast range of factors that modulate the recruitment and activity of RNA polymerase. Experimental approaches for studying transcription in vivo now extend from single-molecule techniques to genome-wide measurements. Parallel to these developments is the need for testable quantitative and predictive models for understanding gene regulation. These conceptual models must also provide insight into the dynamics of transcription and the variability that is observed at the single-cell level. In this Review, we discuss recent results on transcriptional regulation and also the models those results engender. We show how a non-equilibrium description informs our view of transcription by explicitly considering time- and energy-dependence at the molecular level.