Communications: Can one identify nonequilibrium in a three-state system by analyzing two-state trajectories?

Thermodynamic cost for precision of general counting observables

We analytically derive universal bounds that describe the tradeoff between thermodynamic cost and precision in a sequence of events related to some internal changes of an otherwise hidden physical system. The precision is quantified by the fluctuations in either the number of events counted over time or the waiting times between successive events. Our results are valid for the same broad class of nonequilibrium driven systems considered by the thermodynamic uncertainty relation, but they extend to both time-symmetric and asymmetric observables. We show how optimal precision saturating the bounds can be achieved. For waiting-time fluctuations of asymmetric observables, a phase transition in the optimal configuration arises, where higher precision can be achieved by combining several signals.

Identifying the generator matrix of a stationary Markov chain using partially observable data

Given that most states in real-world systems are inaccessible, it is critical to study the inverse problem of an irreversibly stationary Markov chain regarding how a generator matrix can be identified using minimal observations. The hitting-time distribution of an irreversibly stationary Markov chain is first generalized from a reversible case. The hitting-time distribution is then decoded via the taboo rate, and the results show remarkably that under mild conditions, the generator matrix of a reversible Markov chain or a specific case of irreversibly stationary ones can be identified by utilizing observations from all leaves and two adjacent states in each cycle. Several algorithms are proposed for calculating the generator matrix accurately, and numerical examples are presented to confirm their validity and efficiency. An application to neurophysiology is provided to demonstrate the applicability of such statistics to real-world data. This means that partially observable data can be used to identify the generator matrix of a stationary Markov chain.

Scaling of entropy production under coarse graining in active disordered media

Entropy production plays a fundamental role in the study of nonequilibrium systems by offering a quantitative handle on the degree of time-reversal symmetry breaking. It depends crucially on the degree of freedom considered as well as on the scale of description. How the entropy production at one resolution of the degrees of freedom is related to the entropy production at another resolution is a fundamental question which has recently attracted interest. This relationship is of particular relevance to coarse-grained and continuum descriptions of a given phenomenon. In this work, we derive the scaling of the entropy production under iterative coarse graining on the basis of the correlations of the underlying microscopic transition rates for noninteracting particles in active disordered media. Our approach unveils a natural criterion to distinguish equilibrium-like and genuinely nonequilibrium macroscopic phenomena based on the sign of the scaling exponent of the entropy production per mesostate.

Efficient use of single molecule time traces to resolve kinetic rates, models and uncertainties

Single molecule time traces reveal the time evolution of unsynchronized kinetic systems. Especially single molecule Förster resonance energy transfer (smFRET) provides access to enzymatically important time scales, combined with molecular distance resolution and minimal interference with the sample. Yet the kinetic analysis of smFRET time traces is complicated by experimental shortcomings-such as photo-bleaching and noise. Here we recapitulate the fundamental limits of single molecule fluorescence that render the classic, dwell-time based kinetic analysis unsuitable. In contrast, our Single Molecule Analysis of Complex Kinetic Sequences (SMACKS) considers every data point and combines the information of many short traces in one global kinetic rate model. We demonstrate the potential of SMACKS by resolving the small kinetic effects caused by different ionic strengths in the chaperone protein Hsp90. These results show an unexpected interrelation between conformational dynamics and ATPase activity in Hsp90.

Decomposition of the entropy production rate and nonequilibrium thermodynamics of switching diffusion processes

A switching diffusion process (SDP) is a widely used stochastic model in physics and biology, especially for molecular motors that exhibit a discrete internal chemical kinetics as well as a continuous external mechanical motion. The nonequilibrium thermodynamics of switching diffusion processes has not been extensively studied yet. In the present paper, we propose the decomposition of the entropy production rate in one-dimensional SDPs, based on the flux decomposition. However, similar decompositions of the housekeeping heat dissipation rate and free energy dissipation rate cannot guarantee the non-negativity of each decomposed component. Hence, we modify this decomposition with the flow of exponential relative information under steady-state fluxes, resulting in another decomposition with all non-negative components. Furthermore, we also provide the nonequilibrium thermodynamics of one-dimensional SDPs under the perspectives of coarse -graining and exchange of information between the chemical kinetics and mechanical motion, resulting in several other decompositions of entropy production rate. Finally, we generalize all the results to high-dimensional SDPs with a more general mathematical treatment.

Single-Molecule Analysis beyond Dwell Times: Demonstration and Assessment in and out of Equilibrium

We present a simple and robust technique for extracting kinetic rate models and thermodynamic quantities from single-molecule time traces. Single-molecule analysis of complex kinetic sequences (SMACKS) is a maximum-likelihood approach that resolves all statistically relevant rates and also their uncertainties. This is achieved by optimizing one global kinetic model based on the complete data set while allowing for experimental variations between individual trajectories. In contrast to dwell-time analysis, which is the current standard method, SMACKS includes every experimental data point, not only dwell times. As a result, it works as well for long trajectories as for an equivalent set of short ones. In addition, the previous systematic overestimation of fast over slow rates is solved. We demonstrate the power of SMACKS on the kinetics of the multidomain protein Hsp90 measured by single-molecule Förster resonance energy transfer. Experiments in and out of equilibrium are analyzed and compared to simulations, shedding new light on the role of Hsp90's ATPase function. SMACKS resolves accurate rate models even if states cause indistinguishable signals. Thereby, it pushes the boundaries of single-molecule kinetics beyond those of current methods.

Effective rates from thermodynamically consistent coarse-graining of models for molecular motors with probe particles

Many single-molecule experiments for molecular motors comprise not only the motor but also large probe particles coupled to it. The theoretical analysis of these assays, however, often takes into account only the degrees of freedom representing the motor. We present a coarse-graining method that maps a model comprising two coupled degrees of freedom which represent motor and probe particle to such an effective one-particle model by eliminating the dynamics of the probe particle in a thermodynamically and dynamically consistent way. The coarse-grained rates obey a local detailed balance condition and reproduce the net currents. Moreover, the average entropy production as well as the thermodynamic efficiency is invariant under this coarse-graining procedure. Our analysis reveals that only by assuming unrealistically fast probe particles, the coarse-grained transition rates coincide with the transition rates of the traditionally used one-particle motor models. Additionally, we find that for multicyclic motors the stall force can depend on the probe size. We apply this coarse-graining method to specific case studies of the F(1)-ATPase and the kinesin motor.

Stochastic thermodynamics, fluctuation theorems and molecular machines

Stochastic thermodynamics as reviewed here systematically provides a framework for extending the notions of classical thermodynamics such as work, heat and entropy production to the level of individual trajectories of well-defined non-equilibrium ensembles. It applies whenever a non-equilibrium process is still coupled to one (or several) heat bath(s) of constant temperature. Paradigmatic systems are single colloidal particles in time-dependent laser traps, polymers in external flow, enzymes and molecular motors in single molecule assays, small biochemical networks and thermoelectric devices involving single electron transport. For such systems, a first-law like energy balance can be identified along fluctuating trajectories. For a basic Markovian dynamics implemented either on the continuum level with Langevin equations or on a discrete set of states as a master equation, thermodynamic consistency imposes a local-detailed balance constraint on noise and rates, respectively. Various integral and detailed fluctuation theorems, which are derived here in a unifying approach from one master theorem, constrain the probability distributions for work, heat and entropy production depending on the nature of the system and the choice of non-equilibrium conditions. For non-equilibrium steady states, particularly strong results hold like a generalized fluctuation-dissipation theorem involving entropy production. Ramifications and applications of these concepts include optimal driving between specified states in finite time, the role of measurement-based feedback processes and the relation between dissipation and irreversibility. Efficiency and, in particular, efficiency at maximum power can be discussed systematically beyond the linear response regime for two classes of molecular machines, isothermal ones such as molecular motors, and heat engines such as thermoelectric devices, using a common framework based on a cycle decomposition of entropy production.

Stochastic thermodynamics under coarse graining

A general formulation of stochastic thermodynamics is presented for open systems exchanging energy and particles with multiple reservoirs. By introducing a partition in terms of "mesostates" (e.g., sets of "microstates"), the consequence on the thermodynamic description of the system is studied in detail. When microstates within mesostates rapidly thermalize, the entire structure of the microscopic theory is recovered at the mesostate level. This is not the case when these microstates remain out of equilibrium, leading to additional contributions to the entropy balance. Some of our results are illustrated for a model of two coupled quantum dots.

Entropy production and Kullback-Leibler divergence between stationary trajectories of discrete systems

The irreversibility of a stationary time series can be quantified using the Kullback-Leibler divergence (KLD) between the probability of observing the series and the probability of observing the time-reversed series. Moreover, this KLD is a tool to estimate entropy production from stationary trajectories since it gives a lower bound to the entropy production of the physical process generating the series. In this paper we introduce analytical and numerical techniques to estimate the KLD between time series generated by several stochastic dynamics with a finite number of states. We examine the accuracy of our estimators for a specific example, a discrete flashing ratchet, and investigate how close the KLD is to the entropy production depending on the number of degrees of freedom of the system that are sampled in the trajectories.

Estimating dissipation from single stationary trajectories

In this Letter we show that the time reversal asymmetry of a stationary time series provides information about the entropy production of the physical mechanism generating the series, even if one ignores any detail of that mechanism. We develop estimators for the entropy production which can detect nonequilibrium processes even when there are no measurable flows in the time series.