Thermodynamic limit of a nonequilibrium steady state: Maxwell-type construction for a bistable biochemical system

Nonequilibrium fluctuations of chemical reaction networks at criticality: The Schlögl model as paradigmatic case

Chemical reaction networks can undergo nonequilibrium phase transitions upon variation in external control parameters, such as the chemical potential of a species. We investigate the flux in the associated chemostats that is proportional to the entropy production and its critical fluctuations within the Schlögl model. Numerical simulations show that the corresponding diffusion coefficient diverges at the critical point as a function of system size. In the vicinity of the critical point, the diffusion coefficient follows a scaling form. We develop an analytical approach based on the chemical Langevin equation and van Kampen's system size expansion that yields the corresponding exponents in the monostable regime. In the bistable regime, we rely on a two-state approximation in order to analytically describe the critical behavior.

Universal slow dynamics of chemical reaction networks

Understanding the emergent behavior of chemical reaction networks (CRNs) is a fundamental aspect of biology and its origin from inanimate matter. A closed CRN monotonically tends to thermal equilibrium, but when it is opened to external reservoirs, a range of behaviors is possible, including transition to a new equilibrium state, a nonequilibrium state, or indefinite growth. This study shows that slowly driven CRNs are governed by the conserved quantities of the closed system, which are generally far fewer in number than the species. Considering both deterministic and stochastic dynamics, a universal slow-dynamics equation is derived with singular perturbation methods and is shown to be thermodynamically consistent. The slow dynamics is highly robust against microscopic details of the network, which may be unknown in practical situations. In particular, nonequilibrium states of realistic large CRNs can be sought without knowledge of bulk reaction rates. The framework is successfully tested against a suite of networks of increasing complexity and argued to be relevant in the treatment of open CRNs as chemical machines.

Trade-offs between number fluctuations and response in nonequilibrium chemical reaction networks

We study the response of chemical reaction networks driven far from equilibrium to logarithmic perturbations of reaction rates. The response of the mean number of a chemical species is observed to be quantitively limited by number fluctuations and the maximum thermodynamic driving force. We prove these trade-offs for linear chemical reaction networks and a class of nonlinear chemical reaction networks with a single chemical species. Numerical results for several model systems support the conclusion that these trade-offs continue to hold for a broad class of chemical reaction networks, though their precise form appears to sensitively depend on the deficiency of the network.

Coloured noise induces phenotypic diversity with energy dissipation

Genes integrate many different sources of noise to adapt their survival strategy with energy costs, but how this noise impacts gene phenotype switching is not fully understood. Here, we refine a mechanistic model with multiplicative and additive coloured noise and analyse the influence of noise strength (NS) and autocorrelation time (AT) on gene phenotypic diversity. Different from white noise, we found that in the autocorrelation time-scale plane, increasing the multiplicative noise will broaden the bimodal region of the gene product, and additive noise will induce bimodal region drift from the lower level to the higher level, while the AT will promote this transition. Specifically, the effect of AT on gene expression is similar to a feedback loop; that is, the AT of multiplicative noise will elongate the mean first passage time (MFPT) from the low stable state to the high stable state, but it will reduce the MFPT from the high stable state to the low stable state, and the opposite is true for additive noise. Moreover, these transitions will violate the detailed equilibrium and then consume energy. By effective topology network reconstruction, we found that when the NS is small, the more obvious the bimodality is, the lower the energy dissipation; however, when the NS is large, it will consume more energy with a tendency for bimodality. The overall analysis implies that living organisms will utilize noise strength and its autocorrelation time for better survival in complex and fluctuating environments.

Irreversibility in dynamical phases and transitions

Living and non-living active matter consumes energy at the microscopic scale to drive emergent, macroscopic behavior including traveling waves and coherent oscillations. Recent work has characterized non-equilibrium systems by their total energy dissipation, but little has been said about how dissipation manifests in distinct spatiotemporal patterns. We introduce a measure of irreversibility we term the entropy production factor to quantify how time reversal symmetry is broken in field theories across scales. We use this scalar, dimensionless function to characterize a dynamical phase transition in simulations of the Brusselator, a prototypical biochemically motivated non-linear oscillator. We measure the total energetic cost of establishing synchronized biochemical oscillations while simultaneously quantifying the distribution of irreversibility across spatiotemporal frequencies.

Exponential volume dependence of entropy-current fluctuations at first-order phase transitions in chemical reaction networks

In chemical reaction networks, bistability can only occur far from equilibrium. It is associated with a first-order phase transition where the control parameter is the thermodynamic force. At the bistable point, the entropy production is known to be discontinuous with respect to the thermodynamic force. We show that the fluctuations of the entropy production have an exponential volume-dependence when the system is bistable. At the phase transition, the exponential prefactor is the height of the effective potential barrier between the two fixed-points. Our results obtained for Schlögl's model can be extended to any chemical network.

Optimal control of protein copy number

Cell-cell communication is often achieved by secreted signaling molecules that bind membrane-bound receptors. A common class of such receptors are G-protein coupled receptors, where extracellular binding induces changes on the membrane affinity near the receptor for certain cytosolic proteins, effectively altering their chemical potential. We analyze the minimum-dissipation schedules for dynamically changing chemical potential to induce steady-state changes in protein copy-number distributions, and illustrate with analytic solutions for linear chemical reaction networks. Protocols that change chemical potential on biologically relevant timescales are experimentally accessible using optogenetic manipulations, and our framework provides nontrivial predictions about functional dynamical cell-cell interactions.

Interlinked GTPase cascades provide a motif for both robust switches and oscillators

GTPases regulate a wide range of cellular processes, such as intracellular vesicular transport, signal transduction and protein translation. These hydrolase enzymes operate as biochemical switches by toggling between an active guanosine triphosphate (GTP)-bound state and an inactive guanosine diphosphate (GDP)-bound state. We compare two network motifs, a single-species switch and an interlinked cascade that consists of two species coupled through positive and negative feedback loops. We find that interlinked cascades are closer to the ideal all-or-none switch and are more robust against fluctuating signals. While the single-species switch can only achieve bistability, interlinked cascades can be converted into oscillators by tuning the cofactor concentrations, which catalyse the activity of the cascade. These regimes can only be achieved with sufficient chemical driving provided by GTP hydrolysis. In this study, we present a thermodynamically consistent model that can achieve bistability and oscillations with the same feedback motif.

Non-Equilibrium Thermodynamics and Stochastic Dynamics of a Bistable Catalytic Surface Reaction

Catalytic surface reaction networks exhibit nonlinear dissipative phenomena, such as bistability. Macroscopic rate law descriptions predict that the reaction system resides on one of the two steady-state branches of the bistable region for an indefinite period of time. However, the smaller the catalytic surface, the greater the influence of coverage fluctuations, given that their amplitude normally scales as the square root of the system size. Thus, one can observe fluctuation-induced transitions between the steady-states. In this work, a model for the bistable catalytic CO oxidation on small surfaces is studied. After a brief introduction of the average stochastic modelling framework and its corresponding deterministic limit, we discuss the non-equilibrium conditions necessary for bistability. The entropy production rate, an important thermodynamic quantity measuring dissipation in a system, is compared across the two approaches. We conclude that, in our catalytic model, the most favorable non-equilibrium steady state is not necessary the state with the maximum or minimum entropy production rate.

Sensitivity of asymmetric rate-dependent critical systems to initial conditions: Insights into cellular decision making

The work reported here aims to address the effects of time-dependent parameters and stochasticity on decision making in biological systems. We achieve this by extending previous studies that resorted to simple bifurcation normal forms, although in the present case we focus primarily on the issue of the system's sensitivity to initial conditions in the presence of two different noise distributions, Gaussian and Lévy. In addition, we also assess the impact of two-way sweeping at different rates through the critical region of a canonical Pitchfork bifurcation with a constant external asymmetry. The parallel with decision making in biocircuits is performed on this simple system since it is equivalent in its available states and dynamics to more complex genetic circuits published previously. Overall we verify that rate-dependent effects, previously reported as being important features of bifurcating systems, are specific to particular initial conditions. Processing of each starting state, which for the normal form underlying this study is akin to a classification task, is affected by the balance between sweeping speed through critical regions and the type of fluctuations added. For the heavy-tailed noise, two-way dynamic bifurcations are more efficient in processing the external signals, here understood to be jointly represented by the critical parameter profile and the external asymmetry amplitude, when compared to the system relying on escape dynamics. This is particular to the case when the system starts at an attractor not favored by the asymmetry and, in conjunction, when the sweeping amplitude is large.

On Differences between Deterministic and Stochastic Models of Chemical Reactions: Schlögl Solved with ZI-Closure

Deterministic and stochastic models of chemical reaction kinetics can give starkly different results when the deterministic model exhibits more than one stable solution. For example, in the stochastic Schlögl model, the bimodal stationary probability distribution collapses to a unimodal distribution when the system size increases, even for kinetic constant values that result in two distinct stable solutions in the deterministic Schlögl model. Using zero-information (ZI) closure scheme, an algorithm for solving chemical master equations, we compute stationary probability distributions for varying system sizes of the Schlögl model. With ZI-closure, system sizes can be studied that have been previously unattainable by stochastic simulation algorithms. We observe and quantify paradoxical discrepancies between stochastic and deterministic models and explain this behavior by postulating that the entropy of non-equilibrium steady states (NESS) is maximum.

Relatively slow stochastic gene-state switching in the presence of positive feedback significantly broadens the region of bimodality through stabilizing the uninduced phenotypic state

Within an isogenic population, even in the same extracellular environment, individual cells can exhibit various phenotypic states. The exact role of stochastic gene-state switching regulating the transition among these phenotypic states in a single cell is not fully understood, especially in the presence of positive feedback. Recent high-precision single-cell measurements showed that, at least in bacteria, switching in gene states is slow relative to the typical rates of active transcription and translation. Hence using the lac operon as an archetype, in such a region of operon-state switching, we present a fluctuating-rate model for this classical gene regulation module, incorporating the more realistic operon-state switching mechanism that was recently elucidated. We found that the positive feedback mechanism induces bistability (referred to as deterministic bistability), and that the parameter range for its occurrence is significantly broadened by stochastic operon-state switching. We further show that in the absence of positive feedback, operon-state switching must be extremely slow to trigger bistability by itself. However, in the presence of positive feedback, which stabilizes the induced state, the relatively slow operon-state switching kinetics within the physiological region are sufficient to stabilize the uninduced state, together generating a broadened parameter region of bistability (referred to as stochastic bistability). We illustrate the opposite phenotype-transition rate dependence upon the operon-state switching rates in the two types of bistability, with the aid of a recently proposed rate formula for fluctuating-rate models. The rate formula also predicts a maximal transition rate in the intermediate region of operon-state switching, which is validated by numerical simulations in our model. Overall, our findings suggest a biological function of transcriptional “variations” among genetically identical cells, for the emergence of bistability and transition between phenotypic states.

Identifying the mechanism underlying the coexistence of multiple stable phenotypic states has been a challenging scientific problem for more than half a century, and an appropriate mathematical model at the single-cell level is also in high demand. Single-cell measurements conducted in the past ten years have shown that gene-state switching is slow relative to the typical rates of active transcription and translation; hence the recently proposed fluctuating-rate model is a good candidate for describing the single-cell dynamics. We use the classic gene regulation module of the lac operon as an archetype and build a specific fluctuating-rate model based on the recently identified operon-state switching mechanism. This model is analyzed to dissect the interplay between positive feedback and the stochastic switching of gene states in the emergence of bistability/multistablity and the transition between phenotypic states. We show that relatively slow operon-state switching stabilizes the uninduced state and that the positive feedback stabilizes the induced state. Thus, the parameter range for bistability is significantly broadened. In addition, recently proposed landscape theory and rate formula predict opposite phenotype-transition rate dependence on operon-state switching rates for the two types of bistability.

Derivation of Markov processes that violate detailed balance

Time-reversal symmetry of the microscopic laws dictates that the equilibrium distribution of a stochastic process must obey the condition of detailed balance. However, cyclic Markov processes that do not admit equilibrium distributions with detailed balance are often used to model systems driven out of equilibrium by external agents. I show that for a Markov model without detailed balance, an extended Markov model can be constructed, which explicitly includes the degrees of freedom for the driving agent and satisfies the detailed balance condition. The original cyclic Markov model for the driven system is then recovered as an approximation at early times by summing over the degrees of freedom for the driving agent. I also show that the widely accepted expression for the entropy production in a cyclic Markov model is actually a time derivative of an entropy component in the extended model. Further, I present an analytic expression for the entropy component that is hidden in the cyclic Markov model.

Processes on the emergent landscapes of biochemical reaction networks and heterogeneous cell population dynamics: differentiation in living matters

The notion of an attractor has been widely employed in thinking about the nonlinear dynamics of organisms and biological phenomena as systems and as processes. The notion of a landscape with valleys and mountains encoding multiple attractors, however, has a rigorous foundation only for closed, thermodynamically non-driven, chemical systems, such as a protein. Recent advances in the theory of nonlinear stochastic dynamical systems and its applications to mesoscopic reaction networks, one reaction at a time, have provided a new basis for a landscape of open, driven biochemical reaction systems under sustained chemostat. The theory is equally applicable not only to intracellular dynamics of biochemical regulatory networks within an individual cell but also to tissue dynamics of heterogeneous interacting cell populations. The landscape for an individual cell, applicable to a population of isogenic non-interacting cells under the same environmental conditions, is defined on the counting space of intracellular chemical compositions x = (x₁,x₂, … ,x_N ) in a cell, where x_ℓ is the concentration of the ℓth biochemical species. Equivalently, for heterogeneous cell population dynamics x_ℓ is the number density of cells of the ℓth cell type. One of the insights derived from the landscape perspective is that the life history of an individual organism, which occurs on the hillsides of a landscape, is nearly deterministic and 'programmed', while population-wise an asynchronous non-equilibrium steady state resides mostly in the lowlands of the landscape. We argue that a dynamic 'blue-sky' bifurcation, as a representation of Waddington's landscape, is a more robust mechanism for a cell fate decision and subsequent differentiation than the widely pictured pitch-fork bifurcation. We revisit, in terms of the chemostatic driving forces upon active, living matter, the notions of near-equilibrium thermodynamic branches versus far-from-equilibrium states. The emergent landscape perspective permits a quantitative discussion of a wide range of biological phenomena as nonlinear, stochastic dynamics.

Entropy production selects nonequilibrium states in multistable systems

Far-from-equilibrium thermodynamics underpins the emergence of life, but how has been a long-outstanding puzzle. Best candidate theories based on the maximum entropy production principle could not be unequivocally proven, in part due to complicated physics, unintuitive stochastic thermodynamics, and the existence of alternative theories such as the minimum entropy production principle. Here, we use a simple, analytically solvable, one-dimensional bistable chemical system to demonstrate the validity of the maximum entropy production principle. To generalize to multistable stochastic system, we use the stochastic least-action principle to derive the entropy production and its role in the stability of nonequilibrium steady states. This shows that in a multistable system, all else being equal, the steady state with the highest entropy production is favored, with a number of implications for the evolution of biological, physical, and geological systems.

Transcription Driven Phase Separation in Chromatin Brush

We theoretically predict the local density of nucleosomes on DNA brushes in a solution of molecules, which are necessary for transcription and the assembly of nucleosomes. Our theory predicts that in a confined space, DNA brushes show phase separation, where a region of relatively large nucleosomal occupancy coexists with a region of smaller nucleosomal occupancy. This phase separation is driven by an instability arising from the fact that the rate of transcription increases as the nucleosomal occupancy decreases due to the excluded volume interactions between nucleosomes and RNA polymerase during thermal diffusion and, in turn, nucleosomes are (in some cases) desorbed from DNA when RNA polymerase collides with nucleosomes during transcription. The miscibility phase diagram shows critical points, which are sensitive to the rate constants involved in transcription, the changes of interactions of DNA chain segments by assembling nucleosomes, and pressures that are applied to the brushes.

Bistability: requirements on cell-volume, protein diffusion, and thermodynamics

Bistability is considered wide-spread among bacteria and eukaryotic cells, useful e.g. for enzyme induction, bet hedging, and epigenetic switching. However, this phenomenon has mostly been described with deterministic dynamic or well-mixed stochastic models. Here, we map known biological bistable systems onto the well-characterized biochemical Schlögl model, using analytical calculations and stochastic spatiotemporal simulations. In addition to network architecture and strong thermodynamic driving away from equilibrium, we show that bistability requires fine-tuning towards small cell volumes (or compartments) and fast protein diffusion (well mixing). Bistability is thus fragile and hence may be restricted to small bacteria and eukaryotic nuclei, with switching triggered by volume changes during the cell cycle. For large volumes, single cells generally loose their ability for bistable switching and instead undergo a first-order phase transition.

Stochastic phenotype transition of a single cell in an intermediate region of gene state switching

Multiple phenotypic states often arise in a single cell with different gene-expression states that undergo transcription regulation with positive feedback. Recent experiments show that, at least in E.coli, the gene state switching can be neither extremely slow nor exceedingly rapid as many previous theoretical treatments assumed. Rather, it is in the intermediate region which is difficult to handle mathematically. Under this condition, from a full chemical-master-equation description we derive a model in which the protein copy number, for a given gene state, follows a deterministic mean-field description while the protein-synthesis rates fluctuate due to stochastic gene state switching. The simplified kinetics yields a nonequilibrium landscape function, which, similar to the energy function for equilibrium fluctuation, provides the leading orders of fluctuations around each phenotypic state, as well as the transition rates between the two phenotypic states. This rate formula is analogous to Kramers' theory for chemical reactions. The resulting behaviors are significantly different from the two limiting cases studied previously.

Model discrimination in dynamic molecular systems: application to parotid de-differentiation network

In modern systems biology the modeling of longitudinal data, such as changes in mRNA concentrations, is often of interest. Fully parametric, ordinary differential equations (ODE)-based models are typically developed for the purpose, but their lack of fit in some examples indicates that more flexible Bayesian models may be beneficial, particularly when there are relatively few data points available. However, under such sparse data scenarios it is often difficult to identify the most suitable model. The process of falsifying inappropriate candidate models is called model discrimination. We propose here a formal method of discrimination between competing Bayesian mixture-type longitudinal models that is both sensitive and sufficiently flexible to account for the complex variability of the longitudinal molecular data. The ideas from the field of Bayesian analysis of computer model validation are applied, along with modern Markov Chain Monte Carlo (MCMC) algorithms, in order to derive an appropriate Bayes discriminant rule. We restrict attention to the two-model comparison problem and present the application of the proposed rule to the mRNA data in the de-differentiation network of three mRNA concentrations in mammalian salivary glands as well as to a large synthetic dataset derived from the model used in the recent DREAM6 competition.

Stochastic transitions in a bistable reaction system on the membrane

Transitions between steady states of a multi-stable stochastic system in the perfectly mixed chemical reactor are possible only because of stochastic switching. In realistic cellular conditions, where diffusion is limited, transitions between steady states can also follow from the propagation of travelling waves. Here, we study the interplay between the two modes of transition for a prototype bistable system of kinase-phosphatase interactions on the plasma membrane. Within microscopic kinetic Monte Carlo simulations on the hexagonal lattice, we observed that for finite diffusion the behaviour of the spatially extended system differs qualitatively from the behaviour of the same system in the well-mixed regime. Even when a small isolated subcompartment remains mostly inactive, the chemical travelling wave may propagate, leading to the activation of a larger compartment. The activating wave can be induced after a small subdomain is activated as a result of a stochastic fluctuation. Such a spontaneous onset of activity is radically more probable in subdomains characterized by slower diffusion. Our results show that a local immobilization of substrates can lead to the global activation of membrane proteins by the mechanism that involves stochastic fluctuations followed by the propagation of a semi-deterministic travelling wave.

Decision making in noisy bistable systems with time-dependent asymmetry

Our work draws special attention to the importance of the effects of time-dependent parameters on decision making in bistable systems. Here, we extend previous studies of the mechanism known as speed-dependent cellular decision making in genetic circuits by performing an analytical treatment of the canonical supercritical pitchfork bifurcation problem with an additional time-dependent asymmetry and control parameter. This model has an analogous behavior to the genetic switch. In the presence of transient asymmetries and fluctuations, slow passage through the critical region in both systems increases substantially the probability of specific decision outcomes. We also study the relevance for attractor selection of reaching maximum values for the external asymmetry before and after the critical region. Overall, maximum asymmetries should be reached at an instant where the position of the critical point allows for compensation of the detrimental effects of noise in retaining memory of the transient asymmetries.

Interplay between path and speed in decision making by high-dimensional stochastic gene regulatory networks

Induction of a specific transcriptional program by external signaling inputs is a crucial aspect of intracellular network functioning. The theoretical concept of coexisting attractors representing particular genetic programs is reasonably adapted to experimental observations of "genome-wide" expression profiles or phenotypes. Attractors can be associated either with developmental outcomes such as differentiation into specific types of cells, or maintenance of cell functioning such as proliferation or apoptosis. Here we review a mechanism known as speed-dependent cellular decision making (SdCDM) in a small epigenetic switch and generalize the concept to high-dimensional space. We demonstrate that high-dimensional network clustering capacity is dependent on the level of intrinsic noise and the speed at which external signals operate on the transcriptional landscape.

Landscapes of non-gradient dynamics without detailed balance: stable limit cycles and multiple attractors

Landscape is one of the key notions in literature on biological processes and physics of complex systems with both deterministic and stochastic dynamics. The large deviation theory (LDT) provides a possible mathematical basis for the scientists' intuition. In terms of Freidlin-Wentzell's LDT, we discuss explicitly two issues in singularly perturbed stationary diffusion processes arisen from nonlinear differential equations: (1) For a process whose corresponding ordinary differential equation has a stable limit cycle, the stationary solution exhibits a clear separation of time scales: an exponential terms and an algebraic prefactor. The large deviation rate function attains its minimum zero on the entire stable limit cycle, while the leading term of the prefactor is inversely proportional to the velocity of the non-uniform periodic oscillation on the cycle. (2) For dynamics with multiple stable fixed points and saddles, there is in general a breakdown of detailed balance among the corresponding attractors. Two landscapes, a local and a global, arise in LDT, and a Markov jumping process with cycle flux emerges in the low-noise limit. A local landscape is pertinent to the transition rates between neighboring stable fixed points; and the global landscape defines a nonequilibrium steady state. There would be nondifferentiable points in the latter for a stationary dynamics with cycle flux. LDT serving as the mathematical foundation for emergent landscapes deserves further investigations.

Speed-dependent cellular decision making in nonequilibrium genetic circuits

Despite being governed by the principles of nonequilibrium transitions, gene expression dynamics underlying cell fate decision is poorly understood. In particular, the effect of signaling speed on cellular decision making is still unclear. Here we show that the decision between alternative cell fates, in a structurally symmetric circuit, can be biased depending on the speed at which the system is forced to go through the decision point. The circuit consists of two mutually inhibiting and self-activating genes, forced by two external signals with identical stationary values but different transient times. Under these conditions, slow passage through the decision point leads to a consistently biased decision due to the transient signaling asymmetry, whereas fast passage reduces and eventually eliminates the switch imbalance. The effect is robust to noise and shows that dynamic bifurcations, well known in nonequilibrium physics, are important for the control of genetic circuits.

Fixation, transient landscape, and diffusion dilemma in stochastic evolutionary game dynamics

Agent-based stochastic models for finite populations have recently received much attention in the game theory of evolutionary dynamics. Both the ultimate fixation and the pre-fixation transient behavior are important to a full understanding of the dynamics. In this paper, we study the transient dynamics of the well-mixed Moran process through constructing a landscape function. It is shown that the landscape playing a central theoretical "device" that integrates several lines of inquiries: the stable behavior of the replicator dynamics, the long-time fixation, and continuous diffusion approximation associated with asymptotically large population. Several issues relating to the transient dynamics are discussed: (i) multiple time scales phenomenon associated with intra- and inter-attractoral dynamics; (ii) discontinuous transition in stochastically stationary process akin to Maxwell construction in equilibrium statistical physics; and (iii) the dilemma diffusion approximation facing as a continuous approximation of the discrete evolutionary dynamics. It is found that rare events with exponentially small probabilities, corresponding to the uphill movements and barrier crossing in the landscape with multiple wells that are made possible by strong nonlinear dynamics, plays an important role in understanding the origin of the complexity in evolutionary, nonlinear biological systems.

Exact results in the large system size limit for the dynamics of the chemical master equation, a one dimensional chain of equations

We apply the Hamilton-Jacobi equation (HJE) formalism to solve the dynamics of the chemical master equation (CME). We found exact analytical expressions (in large system-size limit) for the probability distribution, including explicit expression for the dynamics of variance of distribution. We also give the solution for some simple cases of the model with time-dependent rates. We derived the results of the Van Kampen method from the HJE approach using a special ansatz. Using the Van Kampen method, we give a system of ordinary differential equations (ODEs) to define the variance in a two-dimensional case. We performed numerics for the CME with stationary noise. We give analytical criteria for the disappearance of bistability in the case of stationary noise in one-dimensional CMEs.

Non-equilibrium phase transition in mesoscopic biochemical systems: from stochastic to nonlinear dynamics and beyond

A theory for an non-equilibrium phase transition in a driven biochemical network is presented. The theory is based on the chemical master equation (CME) formulation of mesoscopic biochemical reactions and the mathematical method of large deviations. The large deviations theory provides an analytical tool connecting the macroscopic multi-stability of an open chemical system with the multi-scale dynamics of its mesoscopic counterpart. It shows a corresponding non-equilibrium phase transition among multiple stochastic attractors. As an example, in the canonical phosphorylation-dephosphorylation system with feedback that exhibits bistability, we show that the non-equilibrium steady-state (NESS) phase transition has all the characteristics of classic equilibrium phase transition: Maxwell construction, a discontinuous first-derivative of the 'free energy function', Lee-Yang's zero for a generating function and a critical point that matches the cusp in nonlinear bifurcation theory. To the biochemical system, the mathematical analysis suggests three distinct timescales and needed levels of description. They are (i) molecular signalling, (ii) biochemical network nonlinear dynamics, and (iii) cellular evolution. For finite mesoscopic systems such as a cell, motions associated with (i) and (iii) are stochastic while that with (ii) is deterministic. Both (ii) and (iii) are emergent properties of a dynamic biochemical network.

The chemical master equation approach to nonequilibrium steady-state of open biochemical systems: linear single-molecule enzyme kinetics and nonlinear biochemical reaction networks

We develop the stochastic, chemical master equation as a unifying approach to the dynamics of biochemical reaction systems in a mesoscopic volume under a living environment. A living environment provides a continuous chemical energy input that sustains the reaction system in a nonequilibrium steady state with concentration fluctuations. We discuss the linear, unimolecular single-molecule enzyme kinetics, phosphorylation-dephosphorylation cycle (PdPC) with bistability, and network exhibiting oscillations. Emphasis is paid to the comparison between the stochastic dynamics and the prediction based on the traditional approach based on the Law of Mass Action. We introduce the difference between nonlinear bistability and stochastic bistability, the latter has no deterministic counterpart. For systems with nonlinear bistability, there are three different time scales: (a) individual biochemical reactions, (b) nonlinear network dynamics approaching to attractors, and (c) cellular evolution. For mesoscopic systems with size of a living cell, dynamics in (a) and (c) are stochastic while that with (b) is dominantly deterministic. Both (b) and (c) are emergent properties of a dynamic biochemical network; We suggest that the (c) is most relevant to major cellular biochemical processes such as epi-genetic regulation, apoptosis, and cancer immunoediting. The cellular evolution proceeds with transitions among the attractors of (b) in a "punctuated equilibrium" manner.

Evolutionary stability and quasi-stationary strategy in stochastic evolutionary game dynamics

Stochastic evolutionary game dynamics for finite populations has recently been widely explored in the study of evolutionary game theory. It is known from the work of Traulsen et al. [2005. Phys. Rev. Lett. 95, 238701] that the stochastic evolutionary dynamics approaches the deterministic replicator dynamics in the limit of large population size. However, sometimes the limiting behavior predicted by the stochastic evolutionary dynamics is not quite in agreement with the steady-state behavior of the replicator dynamics. This paradox inspired us to give reasonable explanations of the traditional concept of evolutionarily stable strategy (ESS) in the context of finite populations. A quasi-stationary analysis of the stochastic evolutionary game dynamics is put forward in this study and we present a new concept of quasi-stationary strategy (QSS) for large but finite populations. It is shown that the consistency between the QSS and the ESS implies that the long-term behavior of the replicator dynamics can be predicted by the quasi-stationary behavior of the stochastic dynamics. We relate the paradox to the time scales and find that the contradiction occurs only when the fixation time scale is much longer than the quasi-stationary time scale. Our work may shed light on understanding the relationship between the deterministic and stochastic methods of modeling evolutionary game dynamics.

Stochastic bistability and bifurcation in a mesoscopic signaling system with autocatalytic kinase

Bistability is a nonlinear phenomenon widely observed in nature including in biochemical reaction networks. Deterministic chemical kinetics studied in the past has shown that bistability occurs in systems with strong (cubic) nonlinearity. For certain mesoscopic, weakly nonlinear (quadratic) biochemical reaction systems in a small volume, however, stochasticity can induce bistability and bifurcation that have no macroscopic counterpart. We report the simplest yet known reactions involving driven phosphorylation-dephosphorylation cycle kinetics with autocatalytic kinase. We show that the noise-induced phenomenon is correlated with free energy dissipation and thus conforms with the open-chemical system theory. A previous reported noise-induced bistability in futile cycles is found to have originated from the kinase synchronization in a bistable system with slow transitions, as reported here.