Diffusion approximations to the chemical master equation only have a consistent stochastic thermodynamics at chemical equilibrium

Nonequilibrium fluctuations of chemical reaction networks at criticality: The Schlögl model as paradigmatic case

Chemical reaction networks can undergo nonequilibrium phase transitions upon variation in external control parameters, such as the chemical potential of a species. We investigate the flux in the associated chemostats that is proportional to the entropy production and its critical fluctuations within the Schlögl model. Numerical simulations show that the corresponding diffusion coefficient diverges at the critical point as a function of system size. In the vicinity of the critical point, the diffusion coefficient follows a scaling form. We develop an analytical approach based on the chemical Langevin equation and van Kampen's system size expansion that yields the corresponding exponents in the monostable regime. In the bistable regime, we rely on a two-state approximation in order to analytically describe the critical behavior.

Optimizing dynamical functions for speed with stochastic paths

Living systems are built from microscopic components that function dynamically; they generate work with molecular motors, assemble and disassemble structures such as microtubules, keep time with circadian clocks, and catalyze the replication of DNA. How do we implement these functions in synthetic nanostructured materials to execute them before the onset of dissipative losses? Answering this question requires a quantitative understanding of when we can improve performance and speed while minimizing the dissipative losses associated with operating in a fluctuating environment. Here, we show that there are four modalities for optimizing dynamical functions that can guide the design of nanoscale systems. We analyze Markov models that span the design space: a clock, ratchet, replicator, and self-assembling system. Using stochastic thermodynamics and an exact expression for path probabilities, we classify these models of dynamical functions based on the correlation of speed with dissipation and with the chosen performance metric. We also analyze random networks to identify the model features that affect their classification and the optimization of their functionality. Overall, our results show that the possible nonequilibrium paths can determine our ability to optimize the performance of dynamical functions, despite ever-present dissipation, when there is a need for speed.

Stochastic paths controlling speed and dissipation

Natural processes occur in a finite amount of time and dissipate energy, entropy, and matter. Near equilibrium, thermodynamic intuition suggests that fast irreversible processes will dissipate more energy and entropy than slow quasistatic processes connecting the same initial and final states. For small systems, recently discovered thermodynamic speed limits suggest that faster processes will dissipate more than slower processes. Here, we test the hypothesis that this relationship between speed and dissipation holds for stochastic paths far from equilibrium. To analyze stochastic paths on finite timescales, we derive an exact expression for the path probabilities of continuous-time Markov chains from the path summation solution to the master equation. We present a minimal model for a driven system in which relative energies of the initial and target states control the speed, and the nonequilibrium currents of a cycle control the dissipation. Although the hypothesis holds near equilibrium, we find that faster processes can dissipate less under far-from-equilibrium conditions because of strong currents. This model serves as a minimal prototype for designing kinetics to sculpt the nonequilibrium path space so that faster paths produce less dissipation.

Estimating Entropy Production from Waiting Time Distributions

Living systems operate far from thermal equilibrium by converting the chemical potential of ATP into mechanical work to achieve growth, replication, or locomotion. Given time series observations of intra-, inter-, or multicellular processes, a key challenge is to detect nonequilibrium behavior and quantify the rate of free energy consumption. Obtaining reliable bounds on energy consumption and entropy production directly from experimental data remains difficult in practice, as many degrees of freedom typically are hidden to the observer, so that the accessible coarse-grained dynamics may not obviously violate detailed balance. Here, we introduce a novel method for bounding the entropy production of physical and living systems which uses only the waiting time statistics of hidden Markov processes and, hence, can be directly applied to experimental data. By determining a universal limiting curve, we infer entropy production bounds from experimental data for gene regulatory networks, mammalian behavioral dynamics, and numerous other biological processes. Further considering the asymptotic limit of increasingly precise biological timers, we estimate the necessary entropic cost of heartbeat regulation in humans, dogs, and mice.

Thermodynamic Optimality of Glycolytic Oscillations

Temporal order in living matters reflects the self-organizing nature of dynamical processes driven out of thermodynamic equilibrium. Because of functional reasons, the period of a biochemical oscillation must be tuned to a specific value with precision; however, according to the thermodynamic uncertainty relation (TUR), the precision of the oscillatory period is constrained by the thermodynamic cost of generating it. After reviewing the basics of chemical oscillations using the Brusselator as a model system, we study the glycolytic oscillation generated by octameric phosphofructokinase (PFK), which is known to display a period of several minutes. By exploring the phase space of glycolytic oscillations, we find that the glycolytic oscillation under the cellular condition is realized in a cost-effective manner. Specifically, over the biologically relevant range of parameter values of glycolysis and octameric PFK, the entropy production from the glycolytic oscillation is minimal when the oscillation period is (5-10) min. Furthermore, the glycolytic oscillation is found at work near the phase boundary of limit cycles, suggesting that a moderate increase of glucose injection rate leads to the loss of oscillatory dynamics, which is reminiscent of the loss of pulsatile insulin release resulting from elevated blood glucose level.

Stochastic approach to entropy production in chemical chaos

Methods are presented to evaluate the entropy production rate in stochastic reactive systems. These methods are shown to be consistent with known results from nonequilibrium chemical thermodynamics. Moreover, it is proved that the time average of the entropy production rate can be decomposed into the contributions of the cycles obtained from the stoichiometric matrix in both stochastic processes and deterministic systems. These methods are applied to a complex reaction network constructed on the basis of Rössler's reinjection principle and featuring chemical chaos.

Exponential volume dependence of entropy-current fluctuations at first-order phase transitions in chemical reaction networks

In chemical reaction networks, bistability can only occur far from equilibrium. It is associated with a first-order phase transition where the control parameter is the thermodynamic force. At the bistable point, the entropy production is known to be discontinuous with respect to the thermodynamic force. We show that the fluctuations of the entropy production have an exponential volume-dependence when the system is bistable. At the phase transition, the exponential prefactor is the height of the effective potential barrier between the two fixed-points. Our results obtained for Schlögl's model can be extended to any chemical network.

Ab initio scaling laws between noise and mean of gene expression

Gene expression is inherently noisy due to fluctuations occurring at the molecular level. From a top-down perspective, noise has been traditionally decomposed into an intrinsic component that scales inversely with the mean expression level and an extrinsic component that is constant in absence of regulatory changes. Here, we adopt a bottom-up approach to reveal that extrinsic noise, by itself, can follow the aforementioned decomposition, which entails that one component of it can be confounded with intrinsic noise. Analytical expressions of the noise-mean relationship were derived for different scenarios, which were in part supported by numerical simulations.

Stochastic thermodynamics based on an Einstein-Boltzmann definition of fluctuating entropy

Stochastic thermodynamics is an extension of classical nonequilibrium thermodynamics to small systems, where fluctuations are expected to play an important role. A central difficulty met when developing such an extension is how to define a nonequilibrium fluctuating entropy. Typically, the expression used is based on Gibbs' formula for entropy at equilibrium. In this work, we show that one can construct an alternative framework for stochastic thermodynamics based on an extension of Einstein's formula connecting the probability of fluctuations and entropy around equilibrium states. We compare the two approaches and discuss, in particular, how they lead to different interpretations of what a stochastic entropy and entropy production represent.

Stochastic thermodynamics and entropy production of chemical reaction systems

We investigate the nonequilibrium stationary states of systems consisting of chemical reactions among molecules of several chemical species. To this end, we introduce and develop a stochastic formulation of nonequilibrium thermodynamics of chemical reaction systems based on a master equation defined on the space of microscopic chemical states and on appropriate definitions of entropy and entropy production. The system is in contact with a heat reservoir and is placed out of equilibrium by the contact with particle reservoirs. In our approach, the fluxes of various types, such as the heat and particle fluxes, play a fundamental role in characterizing the nonequilibrium chemical state. We show that the rate of entropy production in the stationary nonequilibrium state is a bilinear form in the affinities and the fluxes of reaction, which are expressed in terms of rate constants and transition rates, respectively. We also show how the description in terms of microscopic states can be reduced to a description in terms of the numbers of particles of each species, from which follows the chemical master equation. As an example, we calculate the rate of entropy production of the first and second Schlögl reaction models.

Limits of predictions in thermodynamic systems: a review

The past twenty years have seen a resurgence of interest in nonequilibrium thermodynamics, thanks to advances in the theory of stochastic processes and in their thermodynamic interpretation. Fluctuation theorems provide fundamental constraints on the dynamics of systems arbitrarily far from thermal equilibrium. Thermodynamic uncertainty relations bound the dissipative cost of precision in a wide variety of processes. Concepts of excess work and excess heat provide the basis for a complete thermodynamics of nonequilibrium steady states, including generalized Clausius relations and thermodynamic potentials. But these general results carry their own limitations: fluctuation theorems involve exponential averages that can depend sensitively on unobservably rare trajectories; steady-state thermodynamics makes use of a dual dynamics that lacks any direct physical interpretation. This review aims to present these central results of contemporary nonequilibrium thermodynamics in such a way that the power of each claim for making physical predictions can be clearly assessed, using examples from current topics in soft matter and biophysics.

Optimal inference strategies and their implications for the linear noise approximation

We study the information loss of a class of inference strategies that is solely based on time averaging. For an array of independent binary sensors (e.g., receptors, single electron transistors) measuring a weak random signal (e.g., ligand concentration, gate voltage) this information loss is up to 0.5  bit per measurement irrespective of the number of sensors. We derive a condition related to the local detailed balance relation that determines whether or not such a loss of information occurs. Specifically, if the free-energy difference arising from the signal is symmetrically distributed among the forward and backward rates, time integration mechanisms will capture the full information about the signal. As an implication, for the linear noise approximation, we can identify the same loss of information, arising from its inherent simplification of the dynamics.

Stochastic thermodynamics of reactive systems: An extended local equilibrium approach

The recently developed extended local equilibrium approach to stochastic thermodynamics is applied to reactive systems. The properties of the fluctuating entropy and entropy production are analyzed for general linear and for prototypical nonlinear kinetic processes. It is shown that nonlinear kinetics typically induces deviations of the mean entropy production from its value in the deterministic (mean-field) limit. The probability distributions around the mean are derived and shown to qualitatively differ in thermodynamic equilibrium, under nonequilibrium conditions and in the vicinity of criticalities associated to the onset of multistability. In each case large deviation-type properties are shown to hold. The results are compared with those of alternative approaches developed in the literature.