Exploiting Natural Fluctuations to Identify Kinetic Mechanisms in Sparsely Characterized Systems

Studying stochastic systems biology of the cell with single-cell genomics data

Recent experimental developments in genome-wide RNA quantification hold considerable promise for systems biology. However, rigorously probing the biology of living cells requires a unified mathematical framework that accounts for single-molecule biological stochasticity in the context of technical variation associated with genomics assays. We review models for a variety of RNA transcription processes, as well as the encapsulation and library construction steps of microfluidics-based single-cell RNA sequencing, and present a framework to integrate these phenomena by the manipulation of generating functions. Finally, we use simulated scenarios and biological data to illustrate the implications and applications of the approach.

Studying stochastic systems biology of the cell with single-cell genomics data

Recent experimental developments in genome-wide RNA quantification hold considerable promise for systems biology. However, rigorously probing the biology of living cells requires a unified mathematical framework that accounts for single-molecule biological stochasticity in the context of technical variation associated with genomics assays. We review models for a variety of RNA transcription processes, as well as the encapsulation and library construction steps of microfluidics-based single-cell RNA sequencing, and present a framework to integrate these phenomena by the manipulation of generating functions. Finally, we use simulated scenarios and biological data to illustrate the implications and applications of the approach.

The effect of microRNA on protein variability and gene expression fidelity

Small regulatory RNA molecules such as microRNA modulate gene expression through inhibiting the translation of messenger RNA (mRNA). Such posttranscriptional regulation has been recently hypothesized to reduce the stochastic variability of gene expression around average levels. Here, we quantify noise in stochastic gene expression models with and without such regulation. Our results suggest that silencing mRNA posttranscriptionally will always increase, rather than decrease, gene expression noise when the silencing of mRNA also increases its degradation, as is expected for microRNA interactions with mRNA. In that regime, we also find that silencing mRNA generally reduces the fidelity of signal transmission from deterministically varying upstream factors to protein levels. These findings suggest that microRNA binding to mRNA does not generically confer precision to protein expression.

RNA velocity unraveled

We perform a thorough analysis of RNA velocity methods, with a view towards understanding the suitability of the various assumptions underlying popular implementations. In addition to providing a self-contained exposition of the underlying mathematics, we undertake simulations and perform controlled experiments on biological datasets to assess workflow sensitivity to parameter choices and underlying biology. Finally, we argue for a more rigorous approach to RNA velocity, and present a framework for Markovian analysis that points to directions for improvement and mitigation of current problems.

Single-cell sequencing data are snapshots of biological processes, making it challenging to infer dynamic relationships between cell types. RNA velocity attempts to bypass this challenge by treating the unspliced RNA content as a proxy for spliced RNA content in the near future, and using this “extrapolation” to build directional relationships. However, the method, as implemented in several software packages, is not yet reliable enough to be actionable, in part due to the large number of arbitrary, user-set hyperparameters, as well as fundamental incompatibilities between the biophysics of transcription in the living cell and the models used throughout the velocity workflows. In this study, we review these issues, and use existing results from the fields of stochastic modeling and fluorescence transcriptomics to develop an alternative theoretical framework. We show that our framework can facilitate the development and inference of physically consistent models for sequencing data, as well as the unification of single-cell analyses to self-consistently treat variation due to cell type dynamics and identities, the stochasticity inherent to single-molecule processes, and the uncertainty introduced by sequencing experiments.

Inferring gene regulation dynamics from static snapshots of gene expression variability

Inferring functional relationships within complex networks from static snapshots of a subset of variables is a ubiquitous problem in science. For example, a key challenge of systems biology is to translate cellular heterogeneity data obtained from single-cell sequencing or flow-cytometry experiments into regulatory dynamics. We show how static population snapshots of covariability can be exploited to rigorously infer properties of gene expression dynamics when gene expression reporters probe their upstream dynamics on separate timescales. This can be experimentally exploited in dual-reporter experiments with fluorescent proteins of unequal maturation times, thus turning an experimental bug into an analysis feature. We derive correlation conditions that detect the presence of closed-loop feedback regulation in gene regulatory networks. Furthermore, we show how genes with cell-cycle-dependent transcription rates can be identified from the variability of coregulated fluorescent proteins. Similar correlation constraints might prove useful in other areas of science in which static correlation snapshots are used to infer causal connections between dynamically interacting components.

Pathway dynamics can delineate the sources of transcriptional noise in gene expression

Single-cell expression profiling opens up new vistas on cellular processes. Extensive cell-to-cell variability at the transcriptomic and proteomic level has been one of the stand-out observations. Because most experimental analyses are destructive we only have access to snapshot data of cellular states. This loss of temporal information presents significant challenges for inferring dynamics, as well as causes of cell-to-cell variability. In particular, we typically cannot separate dynamic variability from within cells ('intrinsic noise') from variability across the population ('extrinsic noise'). Here, we make this non-identifiability mathematically precise, allowing us to identify new experimental set-ups that can assist in resolving this non-identifiability. We show that multiple generic reporters from the same biochemical pathways (e.g. mRNA and protein) can infer magnitudes of intrinsic and extrinsic transcriptional noise, identifying sources of heterogeneity. Stochastic simulations support our theory, and demonstrate that 'pathway-reporters' compare favourably to the well-known, but often difficult to implement, dual-reporter method.

Data-driven network models for genetic circuits from time-series data with incomplete measurements

Synthetic gene networks are frequently conceptualized and visualized as static graphs. This view of biological programming stands in stark contrast to the transient nature of biomolecular interaction, which is frequently enacted by labile molecules that are often unmeasured. Thus, the network topology and dynamics of synthetic gene networks can be difficult to verify in vivo or in vitro, due to the presence of unmeasured biological states. Here we introduce the dynamical structure function as a new mesoscopic, data-driven class of models to describe gene networks with incomplete measurements of state dynamics. We develop a network reconstruction algorithm and a code base for reconstructing the dynamical structure function from data, to enable discovery and visualization of graphical relationships in a genetic circuit diagram as time-dependent functions rather than static, unknown weights. We prove a theorem, showing that dynamical structure functions can provide a data-driven estimate of the size of crosstalk fluctuations from an idealized model. We illustrate this idea with numerical examples. Finally, we show how data-driven estimation of dynamical structure functions can explain failure modes in two experimentally implemented genetic circuits, a previously reported in vitro genetic circuit and a new E. coli-based transcriptional event detector.

Gene Expression at a Single Molecule Level: Implications for MDS and AML

Non-genetic heterogeneity, or gene expression stochasticity, is an important source of variability in biological systems. With the advent and improvement of single molecule resolution technologies, it has been shown that transcription dynamics and resultant transcript number fluctuations generate significant cell-to-cell variability that has important biological effects and may contribute substantially to both tissue homeostasis and disease. In this respect, the pathophysiology of stem cell-derived malignancies such as AML and MDS, which has historically been studied at the ensemble level, may require re-evaluation. To that end, it is our aim in this review to highlight the results of recent single-molecule, biophysical, and systems studies of gene expression dynamics, with the explicit purpose of demonstrating how the insights from these basic science studies may help inform and progress the field of leukemia biology and, ultimately, research into novel therapies.

The circadian oscillator analysed at the single-transcript level

The circadian clock is an endogenous and self-sustained oscillator that anticipates daily environmental cycles. While rhythmic gene expression of circadian genes is well-described in populations of cells, the single-cell mRNA dynamics of multiple core clock genes remain largely unknown. Here we use single-molecule fluorescence in situ hybridisation (smFISH) at multiple time points to measure pairs of core clock transcripts, Rev-erbα (Nr1d1), Cry1 and Bmal1, in mouse fibroblasts. The mean mRNA level oscillates over 24 h for all three genes, but mRNA numbers show considerable spread between cells. We develop a probabilistic model for multivariate mRNA counts using mixtures of negative binomials, which accounts for transcriptional bursting, circadian time and cell-to-cell heterogeneity, notably in cell size. Decomposing the mRNA variability into distinct noise sources shows that clock time contributes a small fraction of the total variability in mRNA number between cells. Thus, our results highlight the intrinsic biological challenges in estimating circadian phase from single-cell mRNA counts and suggest that circadian phase in single cells is encoded post-transcriptionally.

Stochastic models for single-cell data: Current challenges and the way forward

Although the quantity and quality of single-cell data have progressed rapidly, making quantitative predictions with single-cell stochastic models remains challenging. The stochastic nature of cellular processes leads to at least three challenges in building models with single-cell data: (a) because variability in single-cell data can be attributed to multiple different sources, it is difficult to rule out conflicting mechanistic models that explain the same data equally well; (b) the distinction between interesting biological variability and experimental variability is sometimes ambiguous; (c) the nonstandard distributions of single-cell data can lead to violations of the assumption of symmetric errors in least-squares fitting. In this review, we first discuss recent studies that overcome some of the challenges or set up a promising direction and then introduce some powerful statistical approaches utilized in these studies. We conclude that applying and developing statistical approaches could lead to further progress in building stochastic models for single-cell data.

Noisy signal propagation and amplification in phenotypic transition cascade of colonic cells

Like genes and proteins, cells can use biochemical networks to sense and process information. The differentiation of the cell state in colonic crypts forms a typical unidirectional phenotypic transitional cascade, in which stem cells differentiate into the transit-amplifying cells (TACs), and TACs continue to differentiate into fully differentiated cells. In order to quantitatively describe the relationship between the noise of each compartment and the amplification of signals, the gain factor is introduced, and the gain-fluctuation relation is obtained by using the linear noise approximation of the master equation. Through the simulation of these theoretical formulas, the characters of noise propagation and amplification are studied. It is found that the transmitted noise is an important part of the total noise in each downstream cell. Therefore, a small number of downstream cells can only cause its small inherent noise, but the total noise may be very large due to the transmitted noise. The influence of the transmitted noise may be the indirect cause of colon cancer. In addition, the total noise of the downstream cells always has a minimum value. As long as a reasonable value of the gain factor is selected, the number of cells in colonic crypts will be controlled within the normal range. This may be a good method to intervene the uncontrollable growth of tumor cells and effectively control the deterioration of colon cancer.

Using Models to (Re-)Design Synthetic Circuits

Mathematical models play an important role in the design of synthetic gene circuits, by guiding the choice of biological components and their assembly into novel gene networks. Here, we present a guide for biologists to build and utilize models of gene networks (synthetic or natural) to analyze dynamical properties of these networks while considering the low numbers of molecules inside cells that results in stochastic gene expression. We start by describing how to write down a model and discussing the level of details to include. We then briefly demonstrate how to simulate a network's dynamics using deterministic differential equations that assume high numbers of molecules. To consider the role of stochastic gene expression in single cells, we provide a detailed tutorial on running stochastic Gillespie simulations of a network, including instructions on coding the Gillespie algorithm with example code. Finally, we illustrate how using a combination of quantitative experimental characterization of a synthetic circuit and mathematical modeling can guide the iterative redesign of a synthetic circuit to achieve the desired properties. This is shown using a classic synthetic oscillator, the repressilator, which we recently redesigned into the most precise and robust synthetic oscillator to date. We thus provide a toolkit for synthetic biologists to build more precise and robust synthetic circuits, which should lead to a deeper understanding of the dynamics of gene regulatory networks.

Multiplex RNA single molecule FISH of inducible mRNAs in single yeast cells

Transcript levels powerfully influence cell behavior and phenotype and are carefully regulated at several steps. Recently developed single cell approaches such as RNA single molecule fluorescence in-situ hybridization (smFISH) have produced advances in our understanding of how these steps work within the cell. In comparison to single-cell sequencing, smFISH provides more accurate quantification of RNA levels. Additionally, transcript subcellular localization is directly visualized, enabling the analysis of transcription (initiation and elongation), RNA export and degradation. As part of our efforts to investigate how this type of analysis can generate improved models of gene expression, we used smFISH to quantify the kinetic expression of STL1 and CTT1 mRNAs in single Saccharomyces cerevisiae cells upon 0.2 and 0.4 M NaCl osmotic stress. In this Data Descriptor, we outline our procedure along with our data in the form of raw images and processed mRNA counts. We discuss how these data can be used to develop single cell modelling approaches, to study fundamental processes in transcription regulation and develop single cell image processing approaches.

Investigating epithelial-to-mesenchymal transition with integrated computational and experimental approaches

The transition between epithelial and mesenchymal (EMT) is a fundamental cellular process that plays critical roles in development, cancer metastasis, and tissue wound healing. EMT is not a binary process but involves multiple partial EMT states that give rise to a high degree of cell state plasticity. Here, we first reviewed several studies on theoretical predictions and experimental verification of these intermediate states, the role of partial EMT on kidney fibrosis development, and how quantitative signaling information controls cell commitment to partial or full EMT upon transient signals. Next, we summarized existing knowledge and open questions on the coupling between EMT and other biological processes, such as the cell cycle, epigenetic regulation, stemness, and apoptosis. Taken together, EMT is a model system that has attracted increasing interests for quantitative experimental and theoretical studies.

Homeostasis of protein and mRNA concentrations in growing cells

Many experiments show that the numbers of mRNA and protein are proportional to the cell volume in growing cells. However, models of stochastic gene expression often assume constant transcription rate per gene and constant translation rate per mRNA, which are incompatible with these experiments. Here, we construct a minimal gene expression model to fill this gap. Assuming ribosomes and RNA polymerases are limiting in gene expression, we show that the numbers of proteins and mRNAs both grow exponentially during the cell cycle and that the concentrations of all mRNAs and proteins achieve cellular homeostasis; the competition between genes for the RNA polymerases makes the transcription rate independent of the genome number. Furthermore, by extending the model to situations in which DNA (mRNA) can be saturated by RNA polymerases (ribosomes) and becomes limiting, we predict a transition from exponential to linear growth of cell volume as the protein-to-DNA ratio increases.

Distribution shapes govern the discovery of predictive models for gene regulation

Systems biology seeks to combine experiments with computation to predict biological behaviors. However, despite tremendous data and knowledge, biological models make less-accurate predictions compared with other fields. By analyzing single-cell, single-molecule measurements of mRNA during yeast stress response, we explore why and how the shapes of experimental distributions control prediction accuracy. We show how asymmetric data distributions with long tails cause standard modeling approaches to yield excellent fits but make meaningless predictions. We show how these biases arise from the violation of fundamental assumptions in standard modeling approaches. We demonstrate how advanced computational tools solve this dilemma and achieve predictive understanding of spatiotemporal mechanisms of transcription control including RNA polymerase initiation and elongation and mRNA accumulation, transport, and decay.

Despite substantial experimental and computational efforts, mechanistic modeling remains more predictive in engineering than in systems biology. The reason for this discrepancy is not fully understood. One might argue that the randomness and complexity of biological systems are the main barriers to predictive understanding, but these issues are not unique to biology. Instead, we hypothesize that the specific shapes of rare single-molecule event distributions produce substantial yet overlooked challenges for biological models. We demonstrate why modern statistical tools to disentangle complexity and stochasticity, which assume normally distributed fluctuations or enormous datasets, do not apply to the discrete, positive, and nonsymmetric distributions that characterize mRNA fluctuations in single cells. As an example, we integrate single-molecule measurements and advanced computational analyses to explore mitogen-activated protein kinase induction of multiple stress response genes. Through systematic analyses of different metrics to compare the same model to the same data, we elucidate why standard modeling approaches yield nonpredictive models for single-cell gene regulation. We further explain how advanced tools recover precise, reproducible, and predictive understanding of transcription regulation mechanisms, including gene activation, polymerase initiation, elongation, mRNA accumulation, spatial transport, and decay.

Complexity-aware simple modeling

Mathematical models continue to be essential for deepening our understanding of biology. On one extreme, simple or small-scale models help delineate general biological principles. However, the parsimony of detail in these models as well as their assumption of modularity and insulation make them inaccurate for describing quantitative features. On the other extreme, large-scale and detailed models can quantitatively recapitulate a phenotype of interest, but have to rely on many unknown parameters, making them often difficult to parse mechanistically and to use for extracting general principles. We discuss some examples of a new approach-complexity-aware simple modeling-that can bridge the gap between the small-scale and large-scale approaches.

Careful accounting of extrinsic noise in protein expression reveals correlations among its sources

In order to grow and replicate, living cells must express a diverse array of proteins, but the process by which proteins are made includes a great deal of inherent randomness. Understanding this randomness-whether it arises from the discrete stochastic nature of chemical reactivity ("intrinsic" noise), or from cell-to-cell variability in the concentrations of molecules involved in gene expression, or from the timings of important cell-cycle events like DNA replication and cell division ("extrinsic" noise)-remains a challenge. In this article we analyze a model of gene expression that accounts for several extrinsic sources of noise, including those associated with chromosomal replication, cell division, and variability in the numbers of RNA polymerase, ribonuclease E, and ribosomes. We then attempt to fit our model to a large proteomics and transcriptomics data set and find that only through the introduction of a few key correlations among the extrinsic noise sources can we accurately recapitulate the experimental data. These include significant correlations between the rate of mRNA degradation (mediated by ribonuclease E) and the rates of both transcription (RNA polymerase) and translation (ribosomes) and, strikingly, an anticorrelation between the transcription and the translation rates themselves.

Determining the Limitations and Benefits of Noise in Gene Regulation and Signal Transduction through Single Cell, Microscopy-Based Analysis

Stochastic fluctuations, termed "noise," in the level of biological molecules can greatly impact cellular functions. While biological noise can sometimes be detrimental, recent studies have provided an increasing number of examples in which biological noise can be functionally beneficial. Rather than provide an exhaustive review of the growing literature in this field, in this review, we focus on single-cell studies based on quantitative microscopy that have generated a deeper understanding of the sources, characteristics, limitations, and benefits of biological noise. Specifically, we highlight studies showing how noise can help coordinate the expression of multiple downstream target genes, impact the channel capacity of signaling networks, and interact synergistically with oscillatory dynamics to enhance the sensitivity of signal processing. We conclude with a discussion of current challenges and future opportunities.

Staying Clear of the Dragons

A new, game-changing approach makes it possible to rigorously disprove models without making assumptions about the unknown parts of the biological system.