Thermodynamic costs of information processing in sensory adaptation

Machine learning at the mesoscale: A computation-dissipation bottleneck

The cost of information processing in physical systems calls for a trade-off between performance and energetic expenditure. Here we formulate and study a computation-dissipation bottleneck in mesoscopic systems used as input-output devices. Using both real data sets and synthetic tasks, we show how nonequilibrium leads to enhanced performance. Our framework sheds light on a crucial compromise between information compression, input-output computation and dynamic irreversibility induced by nonreciprocal interactions.

Thermodynamic Bound on the Asymmetry of Cross-Correlations

The principle of microscopic reversibility says that, in equilibrium, two-time cross-correlations are symmetric under the exchange of observables. Thus, the asymmetry of cross-correlations is a fundamental, measurable, and often-used statistical signature of deviation from equilibrium. Here we find a simple and universal inequality that bounds the magnitude of asymmetry by the cycle affinity, i.e., the strength of thermodynamic driving. Our result applies to a large class of systems and all state observables, and it suggests a fundamental thermodynamic cost for various nonequilibrium functions quantified by the asymmetry. It also provides a powerful tool to infer affinity from measured cross-correlations, in a different and complementary way to the thermodynamic uncertainty relations. As an application, we prove a thermodynamic bound on the coherence of noisy oscillations, which was previously conjectured by Barato and Seifert [Phys. Rev. E 95, 062409 (2017)PRESCM2470-004510.1103/PhysRevE.95.062409]. We also derive a thermodynamic bound on directed information flow in a biochemical signal transduction model.

Physical Constraints in Intracellular Signaling: The Cost of Sending a Bit

Many biological processes require timely communication between molecular components. Cells employ diverse physical channels to this end, transmitting information through diffusion, electrical depolarization, and mechanical waves among other strategies. Here we bound the energetic cost of transmitting information through these physical channels, in k_{B}T/bit, as a function of the size of the sender and receiver, their spatial separation, and the communication latency. These calculations provide an estimate for the energy costs associated with information processing arising from the physical constraints of the cellular environment, which we find to be many orders of magnitude larger than unity in natural units. From these calculations, we construct a phase diagram indicating where each strategy is most efficient. Our results suggest that intracellular information transfer may constitute a substantial energetic cost. This provides a new tool for understanding tradeoffs in cellular network function.

Theoretical foundations of studying criticality in the brain

Criticality is hypothesized as a physical mechanism underlying efficient transitions between cortical states and remarkable information-processing capacities in the brain. While considerable evidence generally supports this hypothesis, nonnegligible controversies persist regarding the ubiquity of criticality in neural dynamics and its role in information processing. Validity issues frequently arise during identifying potential brain criticality from empirical data. Moreover, the functional benefits implied by brain criticality are frequently misconceived or unduly generalized. These problems stem from the nontriviality and immaturity of the physical theories that analytically derive brain criticality and the statistic techniques that estimate brain criticality from empirical data. To help solve these problems, we present a systematic review and reformulate the foundations of studying brain criticality, that is, ordinary criticality (OC), quasi-criticality (qC), self-organized criticality (SOC), and self-organized quasi-criticality (SOqC), using the terminology of neuroscience. We offer accessible explanations of the physical theories and statistical techniques of brain criticality, providing step-by-step derivations to characterize neural dynamics as a physical system with avalanches. We summarize error-prone details and existing limitations in brain criticality analysis and suggest possible solutions. Moreover, we present a forward-looking perspective on how optimizing the foundations of studying brain criticality can deepen our understanding of various neuroscience questions.

Percolation may explain efficiency, robustness, and economy of the brain

The brain consists of billions of neurons connected by ultra-dense synapses, showing remarkable efficiency, robust flexibility, and economy in information processing. It is generally believed that these advantageous properties are rooted in brain connectivity; however, direct evidence remains absent owing to technical limitations or theoretical vacancy. This research explores the origins of these properties in the largest yet brain connectome of the fruit fly. We reveal that functional connectivity formation in the brain can be explained by a percolation process controlled by synaptic excitation-inhibition (E/I) balance. By increasing the E/I balance gradually, we discover the emergence of these properties as byproducts of percolation transition when the E/I balance arrives at 3:7. As the E/I balance keeps increase, an optimal E/I balance 1:1 is unveiled to ensure these three properties simultaneously, consistent with previous in vitro experimental predictions. Once the E/I balance reaches over 3:2, an intrinsic limitation of these properties determined by static (anatomical) brain connectivity can be observed. Our work demonstrates that percolation, a universal characterization of critical phenomena and phase transitions, may serve as a window toward understanding the emergence of various brain properties.

The optimal strategy balancing risk and speed predicts DNA damage checkpoint override times

Checkpoints arrest biological processes allowing time for error correction. The phenomenon of checkpoint override (also known as checkpoint adaptation, slippage, or leakage), during cellular self-replication is biologically critical but currently lacks a quantitative, functional, or system-level understanding. To uncover fundamental laws governing error-correction systems, we derived a general theory of optimal checkpoint strategies, balancing the trade-off between risk and self-replication speed. Mathematically, the problem maps onto the optimization of an absorbing boundary for a random walk. We applied the theory to the DNA damage checkpoint (DDC) in budding yeast, an intensively researched model checkpoint. Using novel reporters for double-strand DNA breaks (DSBs), we first quantified the probability distribution of DSB repair in time including rare events and, secondly, the survival probability after override. With these inputs, the optimal theory predicted remarkably accurately override times as a function of DSB numbers, which we measured precisely for the first time. Thus, a first-principles calculation revealed undiscovered patterns underlying highly noisy override processes. Our multi-DSB measurements revise well-known past results and show that override is more general than previously thought.

Universal minimal cost of coherent biochemical oscillations

Biochemical clocks are essential for virtually all living systems. A biochemical clock that is isolated from an external periodic signal and subjected to fluctuations can oscillate coherently only for a finite number of oscillations. Furthermore, such an autonomous clock can oscillate only if it consumes free energy. What is the minimum amount of free-energy consumption required for a certain number of coherent oscillations? We conjecture a universal bound that answers this question. A system that oscillates coherently for N oscillations has a minimal free-energy cost per oscillation of 4π^{2}Nk_{B}T. Our bound is valid for general finite Markov processes, is conjectured based on extensive numerical evidence, is illustrated with numerical simulations of a known model for a biochemical oscillator, and applies to existing experimental data.

Information thermodynamics of encoding and encoders

Non-isolated systems have diverse coupling relations with the external environment. These relations generate complex thermodynamics and information transmission between the system and its environment. The framework depicted in the current research attempts to glance at the critical role of the internal orders inside the non-isolated system in shaping the information thermodynamics coupling. We characterize the coupling as a generalized encoding process, where the system acts as an information thermodynamics encoder to encode the external information based on thermodynamics. We formalize the encoding process in the context of the nonequilibrium second law of thermodynamics, revealing an intrinsic difference in information thermodynamics characteristics between information thermodynamics encoders with and without internal correlations. During the information encoding process of an external source Y, specific sub-systems in an encoder X with internal correlations can exceed the information thermodynamics bound on ( X , Y ) and encode more information than system X works as a whole. We computationally verify this theoretical finding in an Ising model with a random external field and a neural data set of the human brain during visual perception and recognition. Our analysis demonstrates that the stronger internal correlation inside these systems implies a higher possibility for specific sub-systems to encode more information than the global one. These findings may suggest a new perspective in studying information thermodynamics in diverse physical and biological systems.

Developmental energetics: Energy expenditure, budgets and metabolism during animal embryogenesis

Developing embryos are metabolically active, open systems that constantly exchange matter and energy with their environment. They function out of thermodynamic equilibrium and continuously use metabolic pathways to obtain energy from maternal nutrients, in order to fulfill the energetic requirements of growth and development. While an increasing number of studies highlight the role of metabolism in different developmental contexts, the physicochemical basis of embryogenesis, or how cellular processes use energy and matter to act together and transform a zygote into an adult organism, remains unknown. As we obtain a better understanding of metabolism, and benefit from current technology development, it is a promising time to revisit the energetic cost of development and how energetic principles may govern embryogenesis. Here, we review recent advances in methodology to measure and infer energetic parameters in developing embryos. We highlight a potential common pattern in embryonic energy expenditure and metabolic strategy across animal embryogenesis, and discuss challenges and open questions in developmental energetics.

Minimal informational requirements for fitness

The existing concept of the "fitness value of information" provides a theoretical upper bound on the fitness advantage of using information concerning a fluctuating environment. Using concepts from rate-distortion theory, we develop a theoretical framework to answer a different pair of questions: What is the minimal amount of information needed for a population to achieve a certain growth rate? What is the minimal amount of information gain needed for one subpopulation to achieve a certain average selection coefficient over another? We introduce a correspondence between fitness and distortion and solve for the rate-distortion functions of several systems using analytical and numerical methods. Because accurate information processing is energetically costly, our approach provides a theoretical basis for understanding evolutionary "design principles" underlying information-cost trade-offs.

Improved bounds on entropy production in living systems

Living systems maintain or increase local order by working against the second law of thermodynamics. Thermodynamic consistency is restored as they consume free energy, thereby increasing the net entropy of their environment. Recently introduced estimators for the entropy production rate have provided major insights into the efficiency of important cellular processes. In experiments, however, many degrees of freedom typically remain hidden to the observer, and, in these cases, existing methods are not optimal. Here, by reformulating the problem within an optimization framework, we are able to infer improved bounds on the rate of entropy production from partial measurements of biological systems. Our approach yields provably optimal estimates given certain measurable transition statistics. In contrast to prevailing methods, the improved estimator reveals nonzero entropy production rates even when nonequilibrium processes appear time symmetric and therefore may pretend to obey detailed balance. We demonstrate the broad applicability of this framework by providing improved bounds on the energy consumption rates in a diverse range of biological systems including bacterial flagella motors, growing microtubules, and calcium oscillations within human embryonic kidney cells.

Thermodynamic uncertainty relation to assess biological processes

We review the trade-offs between speed, fluctuations, and thermodynamic cost involved with biological processes in nonequilibrium states and discuss how optimal these processes are in light of the universal bound set by the thermodynamic uncertainty relation (TUR). The values of the uncertainty product Q of TUR, which can be used as a measure of the precision of enzymatic processes realized for a given thermodynamic cost, are suboptimal when the substrate concentration is at the Michaelis constant, and some of the key biological processes are found to work around this condition. We illustrate the utility of Q in assessing how close the molecular motors and biomass producing machineries are to the TUR bound, and for the cases of biomass production (or biological copying processes), we discuss how their optimality quantified in terms of Q is balanced with the error rate in the information transfer process. We also touch upon the trade-offs in other error-minimizing processes in biology, such as gene regulation and chaperone-assisted protein folding. A spectrum of Q recapitulating the biological processes surveyed here provides glimpses into how biological systems are evolved to optimize and balance the conflicting functional requirements.

Optimizing energetic cost of uncertainty in a driven system with and without feedback

Many biological functions require dynamics to be necessarily driven out of equilibrium. In contrast, in various contexts, a nonequilibrium dynamics at fast timescales can be described by an effective equilibrium dynamics at a slower timescale. In this work, we study two different aspects: (i) the energy-efficiency tradeoff for a specific nonequilibrium linear dynamics of two variables with feedback and (ii) the cost of effective parameters in a coarse-grained theory as given by the "hidden" dissipation and entropy production rate in the effective equilibrium limit of the dynamics. To meaningfully discuss the tradeoff between energy consumption and the efficiency of the desired function, a one-to-one mapping between function(s) and energy input is required. The function considered in this work is the variance of one of the variables. We get a one-to-one mapping by considering the minimum variance obtained for a fixed entropy production rate and vice versa. We find that this minimum achievable variance is a monotonically decreasing function of the given entropy production rate. When there is a timescale separation, in the effective equilibrium limit, the cost of the effective potential and temperature is the associated "hidden" entropy production rate.

Fitness value of information with delayed phenotype switching: Optimal performance with imperfect sensing

The ability of organisms to accurately sense their environment and respond accordingly is critical for evolutionary success. However, exactly how the sensory ability influences fitness is a topic of active research, while the necessity of a time delay between when unreliable environmental cues are sensed and when organisms can mount a response has yet to be explored at any length. Accounting for this delay in phenotype response in models of population growth, we find that a critical error probability can exist under certain environmental conditions: An organism with a sensory system with any error probability less than the critical value can achieve the same long-term growth rate as an organism with a perfect sensing system. We also observe a tradeoff between the evolutionary value of sensory information and robustness to error, mediated by the rate at which the phenotype distribution relaxes to steady state. The existence of the critical error probability could have several important evolutionary consequences, primarily that sensory systems operating at the nonzero critical error probability may be evolutionarily optimal.

Dissipation-Time Uncertainty Relation

We show that the entropy production rate bounds the rate at which physical processes can be performed in stochastic systems far from equilibrium. In particular, we prove the fundamental tradeoff ⟨S[over ˙]_{e}⟩T≥k_{B} between the entropy flow ⟨S[over ˙]_{e}⟩ into the reservoirs and the mean time T to complete any process whose time-reversed is exponentially rarer. This dissipation-time uncertainty relation is a novel form of speed limit: the smaller the dissipation, the larger the time to perform a process.

More than meets the eye: Predator-induced pupil size plasticity in a teleost fish

Most animals are visually oriented, and their eyes provide their 'window to the world'. Eye size correlates positively with visual performance, because larger eyes can house larger pupils that increase photon catch and contrast discrimination, particularly under dim light, which have positive effects on behaviours that enhance fitness, including predator avoidance and foraging. Recent studies have linked predation risk to selection for larger eyes and pupils, and such changes should be of importance for the majority of teleost fishes as they have a pupil that is fixed in size (eyes lack a pupillary sphincter muscle) and, hence, do not respond to changes in light conditions. Here, we quantify eye and pupil size of individual crucian carp, a common freshwater fish, following controlled manipulations of perceived predation risk (presence/absence). We also tested if crucian carp responded to increased predation risk by shifts in diel activity patterns. We found that crucian carp show phenotypic plasticity with regards to pupil size, but not eye size, as pupil size increased when exposed to predators (pike). Predator-exposed crucian carp also shifted from diurnal to nocturnal activity. Using a modelling exercise, we moreover show that the plastically enlarged pupils significantly increase visual range, especially for small objects under dim light conditions. Overall, our results provide compelling evidence for predator-induced pupil enlargement resulting in enhanced visual capabilities in a teleost fish. Pupil size plasticity in combination with the observed shift towards nocturnal activity may allow for efficient foraging also under dark conditions when predation risk from diurnal and visually oriented predators is reduced. The data highlight the powerful role of predation risk for eye development and evolution.

Design of a MAPK signalling cascade balances energetic cost versus accuracy of information transmission

Cellular processes are inherently noisy, and the selection for accurate responses in presence of noise has likely shaped signalling networks. Here, we investigate the trade-off between accuracy of information transmission and its energetic cost for a mitogen-activated protein kinase (MAPK) signalling cascade. Our analysis of the pheromone response pathway of budding yeast suggests that dose-dependent induction of the negative transcriptional feedbacks in this network maximizes the information per unit energetic cost, rather than the information transmission capacity itself. We further demonstrate that futile cycling of MAPK phosphorylation and dephosphorylation has a measurable effect on growth fitness, with energy dissipation within the signalling cascade thus likely being subject to evolutionary selection. Considering optimization of accuracy versus the energetic cost of information processing, a concept well established in physics and engineering, may thus offer a general framework to understand the regulatory design of cellular signalling systems.

Cellular signalling networks provide information to the cell, but the trade-off between accuracy of information transfer and energetic cost of doing so has not been assessed. Here, the authors investigate a MAPK signalling cascade in budding yeast and find that information is maximised per unit energetic cost.

Trade-offs between effectiveness and cost in bifunctional enzyme circuit with concentration robustness

A fundamental trade-off in biological systems is whether they consume resources to perform biological functions or save resources. Bacteria need to reliably and rapidly respond to input signals by using limited cellular resources. However, excessive resource consumption will become a burden for bacteria growth. To investigate the relationship between functional effectiveness and resource cost, we study the ubiquitous bifunctional enzyme circuit, which is robust to fluctuations in protein concentration and responds quickly to signal changes. We show that trade-off relationships exist between functional effectiveness and protein cost. Expressing more proteins of the circuit increases concentration robustness and response speed but affects bacterial growth. In particular, our study reveals a general relationship between free-energy dissipation rate, response speed, and concentration robustness. The dissipation of free energy plays an important role in the concentration robustness and response speed. High robustness can only be achieved with a large amount of free-energy consumption and protein cost. In addition, the noise of the output increases with increasing protein cost, while the noise of the response time decreases with increasing protein cost. We also calculate the trade-off relationships in the EnvZ-OmpR system and the nitrogen assimilation system, which both have the bifunctional enzyme. Similar results indicate that these relationships are mainly derived from the specific feature of the bifunctional enzyme circuits and are not relevant to the details of the models. According to the trade-off relationships, bacteria take a compromise solution that reliably performs biological functions at a reasonable cost.

Prediction and Dissipation in Nonequilibrium Molecular Sensors: Conditionally Markovian Channels Driven by Memoryful Environments

Biological sensors must often predict their input while operating under metabolic constraints. However, determining whether or not a particular sensor is evolved or designed to be accurate and efficient is challenging. This arises partly from the functional constraints being at cross purposes and partly since quantifying the prediction performance of even in silico sensors can require prohibitively long simulations, especially when highly complex environments drive sensors out of equilibrium. To circumvent these difficulties, we develop new expressions for the prediction accuracy and thermodynamic costs of the broad class of conditionally Markovian sensors subject to complex, correlated (unifilar hidden semi-Markov) environmental inputs in nonequilibrium steady state. Predictive metrics include the instantaneous memory and the total predictable information (the mutual information between present sensor state and input future), while dissipation metrics include power extracted from the environment and the nonpredictive information rate. Success in deriving these formulae relies on identifying the environment's causal states, the input's minimal sufficient statistics for prediction. Using these formulae, we study large random channels and the simplest nontrivial biological sensor model-that of a Hill molecule, characterized by the number of ligands that bind simultaneously-the sensor's cooperativity. We find that the seemingly impoverished Hill molecule can capture an order of magnitude more predictable information than large random channels.

Dissipation in Non-Steady State Regulatory Circuits

In order to respond to environmental signals, cells often use small molecular circuits to transmit information about their surroundings. Recently, motivated by specific examples in signaling and gene regulation, a body of work has focused on the properties of circuits that function out of equilibrium and dissipate energy. We briefly review the probabilistic measures of information and dissipation and use simple models to discuss and illustrate trade-offs between information and dissipation in biological circuits. We find that circuits with non-steady state initial conditions can transmit more information at small readout delays than steady state circuits. The dissipative cost of this additional information proves marginal compared to the steady state dissipation. Feedback does not significantly increase the transmitted information for out of steady state circuits but does decrease dissipative costs. Lastly, we discuss the case of bursty gene regulatory circuits that, even in the fast switching limit, function out of equilibrium.

Maxwell's Demons with Finite Size and Response Time

Nearly all theoretical analyses of Maxwell's demon focus on its energetic and entropic costs of operation. Here, we focus on its rate of operation. In our model, a demon's rate limitation stems from its finite response time and gate area. We determine the rate limits of mass and energy transfer, as well as entropic reduction for four such demons: those that select particles according to (1) direction, (2) energy, (3) number, and (4) entropy. Last, we determine the optimal gate size for a demon with small, finite response time, and compare our predictions with molecular dynamics simulations with both ideal and nonideal gasses. Also, we study the conditions under which the demons are able to move both energy and particles in the chosen direction when attempting to only move one.

Stochastic thermodynamic limit on E. coli adaptation by information geometric approach

Biological systems process information under noisy environment. Sensory adaptation model of E. coli is suitable for investigation because of its simplicity. To understand the adaptation processing quantitatively, stochastic thermodynamic approach has been attempted. Information processing can be assumed as state transition of a system that consists of signal transduction molecules using thermodynamic approach, and efficiency can be measured as thermodynamic cost. Recently, using information geometry and stochastic thermodynamics, a relationship between speed of the transition and the thermodynamic cost has been investigated for a chemical reaction model. Here, we introduce this approach to sensory adaptation model of E. coli, and examined a relationship between adaptation speed and the thermodynamic cost, and efficiency of the adaptation speed. For increasing external noise level in stimulation, the efficiency decreased, but the efficiency was highly robust to external stimulation strength. Moreover, we demonstrated that there is the best noise to achieve the adaptation in the aspect of thermodynamic efficiency. Our quantification method provides a framework to understand the adaptation speed and the thermodynamic cost for various biological systems.

A Foraging Mandala for Aquatic Microorganisms

Aquatic environments harbor a great diversity of microorganisms, which interact with the same patchy, particulate, or diffuse resources by means of a broad array of physiological and behavioral adaptations, resulting in substantially different life histories and ecological success. To date, efforts to uncover and understand this diversity have not been matched by equivalent efforts to identify unifying frameworks that can provide a degree of generality and thus serve as a stepping stone to scale up microscale dynamics to predict their ecosystem-level consequences. In particular, evaluating the ecological consequences of different resource landscapes and of different microbial adaptations has remained a major challenge in aquatic microbial ecology. Here, inspired by Ramon Margalef’s mandala for phytoplankton, we propose a foraging mandala for microorganisms in aquatic environments, which accounts for both the local environment and individual adaptations. This biophysical framework distills resource acquisition into two fundamental parameters: the search time for a new resource and the growth return obtained from encounter with a resource. We illustrate the foraging mandala by considering a broad range of microbial adaptations and environmental characteristics. The broad applicability of the foraging mandala suggests that it could be a useful framework to compare disparate microbial strategies in aquatic environments and to reduce the vast complexity of microbe-environment interactions into a minimal number of fundamental parameters.

Stochastic Thermodynamic Interpretation of Information Geometry

In recent years, the unified theory of information and thermodynamics has been intensively discussed in the context of stochastic thermodynamics. The unified theory reveals that information theory would be useful to understand nonstationary dynamics of systems far from equilibrium. In this Letter, we have found a new link between stochastic thermodynamics and information theory well-known as information geometry. By applying this link, an information geometric inequality can be interpreted as a thermodynamic uncertainty relationship between speed and thermodynamic cost. We have numerically applied an information geometric inequality to a thermodynamic model of a biochemical enzyme reaction.

Energy-speed-accuracy relation in complex networks for biological discrimination

Discriminating between correct and incorrect substrates is a core process in biology, but how is energy apportioned between the conflicting demands of accuracy (μ), speed (σ), and total entropy production rate (P)? Previous studies have focused on biochemical networks with simple structure or relied on simplifying kinetic assumptions. Here, we use the linear framework for timescale separation to analytically examine steady-state probabilities away from thermodynamic equilibrium for networks of arbitrary complexity. We also introduce a method of scaling parameters that is inspired by Hopfield's treatment of kinetic proofreading. Scaling allows asymptotic exploration of high-dimensional parameter spaces. We identify in this way a broad class of complex networks and scalings for which the quantity σln(μ)/P remains asymptotically finite whenever accuracy improves from equilibrium, so that μ_{eq}/μ→0. Scalings exist, however, even for Hopfield's original network, for which σln(μ)/P is asymptotically infinite, illustrating the parametric complexity. Outside the asymptotic regime, numerical calculations suggest that, under more restrictive parametric assumptions, networks satisfy the bound, σln(μ/μ_{eq})/P<1, and we discuss the biological implications for discrimination by ribosomes and DNA polymerase. The methods introduced here may be more broadly useful for analyzing complex networks that implement other forms of cellular information processing.

Broken detailed balance and non-equilibrium dynamics in living systems: a review

Living systems operate far from thermodynamic equilibrium. Enzymatic activity can induce broken detailed balance at the molecular scale. This molecular scale breaking of detailed balance is crucial to achieve biological functions such as high-fidelity transcription and translation, sensing, adaptation, biochemical patterning, and force generation. While biological systems such as motor enzymes violate detailed balance at the molecular scale, it remains unclear how non-equilibrium dynamics manifests at the mesoscale in systems that are driven through the collective activity of many motors. Indeed, in several cellular systems the presence of non-equilibrium dynamics is not always evident at large scales. For example, in the cytoskeleton or in chromosomes one can observe stationary stochastic processes that appear at first glance thermally driven. This raises the question how non-equilibrium fluctuations can be discerned from thermal noise. We discuss approaches that have recently been developed to address this question, including methods based on measuring the extent to which the system violates the fluctuation-dissipation theorem. We also review applications of this approach to reconstituted cytoskeletal networks, the cytoplasm of living cells, and cell membranes. Furthermore, we discuss a more recent approach to detect actively driven dynamics, which is based on inferring broken detailed balance. This constitutes a non-invasive method that uses time-lapse microscopy data, and can be applied to a broad range of systems in cells and tissue. We discuss the ideas underlying this method and its application to several examples including flagella, primary cilia, and cytoskeletal networks. Finally, we briefly discuss recent developments in stochastic thermodynamics and non-equilibrium statistical mechanics, which offer new perspectives to understand the physics of living systems.

Role of sufficient statistics in stochastic thermodynamics and its implication to sensory adaptation

A sufficient statistic is a significant concept in statistics, which means a probability variable that has sufficient information required for an inference task. We investigate the roles of sufficient statistics and related quantities in stochastic thermodynamics. Specifically, we prove that for general continuous-time bipartite networks, the existence of a sufficient statistic implies that an informational quantity called the sensory capacity takes the maximum. Since the maximal sensory capacity imposes a constraint that the energetic efficiency cannot exceed one-half, our result implies that the existence of a sufficient statistic is inevitably accompanied by energetic dissipation. We also show that, in a particular parameter region of linear Langevin systems there exists the optimal noise intensity at which the sensory capacity, the information-thermodynamic efficiency, and the total entropy production are optimized at the same time. We apply our general result to a model of sensory adaptation of E. coli and find that the sensory capacity is nearly maximal with experimentally realistic parameters.

Multidimensional biochemical information processing of dynamical patterns

Cells receive signaling molecules by receptors and relay information via sensory networks so that they can respond properly depending on the type of signal. Recent studies have shown that cells can extract multidimensional information from dynamical concentration patterns of signaling molecules. We herein study how biochemical systems can process multidimensional information embedded in dynamical patterns. We model the decoding networks by linear response functions, and optimize the functions with the calculus of variations to maximize the mutual information between patterns and output. We find that, when the noise intensity is lower, decoders with different linear response functions, i.e., distinct decoders, can extract much information. However, when the noise intensity is higher, distinct decoders do not provide the maximum amount of information. This indicates that, when transmitting information by dynamical patterns, embedding information in multiple patterns is not optimal when the noise intensity is very large. Furthermore, we explore the biochemical implementations of these decoders using control theory and demonstrate that these decoders can be implemented biochemically through the modification of cascade-type networks, which are prevalent in actual signaling pathways.

Information theory, predictability and the emergence of complex life

Despite the obvious advantage of simple life forms capable of fast replication, different levels of cognitive complexity have been achieved by living systems in terms of their potential to cope with environmental uncertainty. Against the inevitable cost associated with detecting environmental cues and responding to them in adaptive ways, we conjecture that the potential for predicting the environment can overcome the expenses associated with maintaining costly, complex structures. We present a minimal formal model grounded in information theory and selection, in which successive generations of agents are mapped into transmitters and receivers of a coded message. Our agents are guessing machines and their capacity to deal with environments of different complexity defines the conditions to sustain more complex agents.

Stochastic thermodynamics of interacting degrees of freedom: Fluctuation theorems for detached path probabilities

Systems with interacting degrees of freedom play a prominent role in stochastic thermodynamics. Our aim is to use the concept of detached path probabilities and detached entropy production for bipartite Markov processes and elaborate on a series of special cases including measurement-feedback systems, sensors, and hidden Markov models. For these special cases we show that fluctuation theorems involving the detached entropy production recover known results which have been obtained separately before. Additionally, we show that the fluctuation relation for the detached entropy production can be used in model selection for data stemming from a hidden Markov model. We discuss the relation to previous approaches including those which use information flow or learning rate to quantify the influence of one subsystem on the other. In conclusion, we present a complete framework with which to find fluctuation relations for coupled systems.

Limits of predictions in thermodynamic systems: a review

The past twenty years have seen a resurgence of interest in nonequilibrium thermodynamics, thanks to advances in the theory of stochastic processes and in their thermodynamic interpretation. Fluctuation theorems provide fundamental constraints on the dynamics of systems arbitrarily far from thermal equilibrium. Thermodynamic uncertainty relations bound the dissipative cost of precision in a wide variety of processes. Concepts of excess work and excess heat provide the basis for a complete thermodynamics of nonequilibrium steady states, including generalized Clausius relations and thermodynamic potentials. But these general results carry their own limitations: fluctuation theorems involve exponential averages that can depend sensitively on unobservably rare trajectories; steady-state thermodynamics makes use of a dual dynamics that lacks any direct physical interpretation. This review aims to present these central results of contemporary nonequilibrium thermodynamics in such a way that the power of each claim for making physical predictions can be clearly assessed, using examples from current topics in soft matter and biophysics.

The Reactive Species Interactome: Evolutionary Emergence, Biological Significance, and Opportunities for Redox Metabolomics and Personalized Medicine

SIGNIFICANCE

Oxidative stress is thought to account for aberrant redox homeostasis and contribute to aging and disease. However, more often than not, administration of antioxidants is ineffective, suggesting that our current understanding of the underlying regulatory processes is incomplete. Recent Advances: Similar to reactive oxygen species and reactive nitrogen species, reactive sulfur species are now emerging as important signaling molecules, targeting regulatory cysteine redox switches in proteins, affecting gene regulation, ion transport, intermediary metabolism, and mitochondrial function. To rationalize the complexity of chemical interactions of reactive species with themselves and their targets and help define their role in systemic metabolic control, we here introduce a novel integrative concept defined as the reactive species interactome (RSI). The RSI is a primeval multilevel redox regulatory system whose architecture, together with the physicochemical characteristics of its constituents, allows efficient sensing and rapid adaptation to environmental changes and various other stressors to enhance fitness and resilience at the local and whole-organism level.

CRITICAL ISSUES

To better characterize the RSI-related processes that determine fluxes through specific pathways and enable integration, it is necessary to disentangle the chemical biology and activity of reactive species (including precursors and reaction products), their targets, communication systems, and effects on cellular, organ, and whole-organism bioenergetics using system-level/network analyses.

FUTURE DIRECTIONS

Understanding the mechanisms through which the RSI operates will enable a better appreciation of the possibilities to modulate the entire biological system; moreover, unveiling molecular signatures that characterize specific environmental challenges or other forms of stress will provide new prevention/intervention opportunities for personalized medicine. Antioxid. Redox Signal. 00, 000-000.

Information-Theoretic Bound on the Entropy Production to Maintain a Classical Nonequilibrium Distribution Using Ancillary Control

There are many functional contexts where it is desirable to maintain a mesoscopic system in a nonequilibrium state. However, such control requires an inherent energy dissipation. In this article, we unify and extend a number of works on the minimum energetic cost to maintain a mesoscopic system in a prescribed nonequilibrium distribution using ancillary control. For a variety of control mechanisms, we find that the minimum amount of energy dissipation necessary can be cast as an information-theoretic measure of distinguishability between the target nonequilibrium state and the underlying equilibrium distribution. This work offers quantitative insight into the intuitive idea that more energy is needed to maintain a system farther from equilibrium.

Coherence of biochemical oscillations is bounded by driving force and network topology

Biochemical oscillations are prevalent in living organisms. Systems with a small number of constituents cannot sustain coherent oscillations for an indefinite time because of fluctuations in the period of oscillation. We show that the number of coherent oscillations that quantifies the precision of the oscillator is universally bounded by the thermodynamic force that drives the system out of equilibrium and by the topology of the underlying biochemical network of states. Our results are valid for arbitrary Markov processes, which are commonly used to model biochemical reactions. We apply our results to a model for a single KaiC protein and to an activator-inhibitor model that consists of several molecules. From a mathematical perspective, based on strong numerical evidence, we conjecture a universal constraint relating the imaginary and real parts of the first nontrivial eigenvalue of a stochastic matrix.

A dual-docking microfluidic cell migration assay (D2-Chip) for testing neutrophil chemotaxis and the memory effect

Chemotaxis is a classic mechanism for guiding cell migration and an important topic in both fundamental cell biology and health sciences. Neutrophils are a widely used model to study eukaryotic cell migration and neutrophil chemotaxis itself can lead to protective or harmful immune actions to the body. While much has been learnt from past research about how neutrophils effectively navigate through a chemoattractant gradient, many interesting questions remain unclear. For example, while it is tempting to model neutrophil chemotaxis using the well-established biased random walk theory, the experimental proof was challenged by the cell's highly persistent migrating nature. A special experimental design is required to test the key predictions from the random walk model. Another question that has interested the cell migration community for decades concerns the existence of chemotactic memory and its underlying mechanism. Although chemotactic memory has been suggested in various studies, a clear quantitative experimental demonstration will improve our understanding of the migratory memory effect. Motivated by these questions, we developed a microfluidic cell migration assay (so-called dual-docking chip or D2-Chip) that can test both the biased random walk model and the memory effect for neutrophil chemotaxis on a single chip enabled by multi-region gradient generation and dual-region cell alignment. Our results provide experimental support for the biased random walk model and chemotactic memory for neutrophil chemotaxis. Quantitative data analyses provide new insights into neutrophil chemotaxis and memory by making connections to entropic disorder, cell morphology and oscillating migratory response.

Thermodynamic Paradigm for Solution Demixing Inspired by Nuclear Transport in Living Cells

Living cells display a remarkable capacity to compartmentalize their functional biochemistry. A particularly fascinating example is the cell nucleus. Exchange of macromolecules between the nucleus and the surrounding cytoplasm does not involve traversing a lipid bilayer membrane. Instead, large protein channels known as nuclear pores cross the nuclear envelope and regulate the passage of other proteins and RNA molecules. Beyond simply gating diffusion, the system of nuclear pores and associated transport receptors is able to generate substantial concentration gradients, at the energetic expense of guanosine triphosphate hydrolysis. In contrast to conventional approaches to demixing such as reverse osmosis and dialysis, the biological system operates continuously, without application of cyclic changes in pressure or solvent exchange. Abstracting the biological paradigm, we examine this transport system as a thermodynamic machine of solution demixing. Building on the construct of free energy transduction and biochemical kinetics, we find conditions for the stable operation and optimization of the concentration gradients as a function of dissipation in the form of entropy production.

Biochemical Machines for the Interconversion of Mutual Information and Work

We propose a physically realizable information-driven device consisting of an enzyme in a chemical bath, interacting with pairs of molecules prepared in correlated states. These correlations persist without direct interaction and thus store free energy equal to the mutual information. The enzyme can harness this free energy, and that stored in the individual molecular states, to do chemical work. Alternatively, the enzyme can use the chemical driving to create mutual information. A modified system can function without external intervention, approaching biological systems more closely.

Stochastic Thermodynamics of Learning

Virtually every organism gathers information about its noisy environment and builds models from those data, mostly using neural networks. Here, we use stochastic thermodynamics to analyze the learning of a classification rule by a neural network. We show that the information acquired by the network is bounded by the thermodynamic cost of learning and introduce a learning efficiency η≤1. We discuss the conditions for optimal learning and analyze Hebbian learning in the thermodynamic limit.

Optimal inference strategies and their implications for the linear noise approximation

We study the information loss of a class of inference strategies that is solely based on time averaging. For an array of independent binary sensors (e.g., receptors, single electron transistors) measuring a weak random signal (e.g., ligand concentration, gate voltage) this information loss is up to 0.5  bit per measurement irrespective of the number of sensors. We derive a condition related to the local detailed balance relation that determines whether or not such a loss of information occurs. Specifically, if the free-energy difference arising from the signal is symmetrically distributed among the forward and backward rates, time integration mechanisms will capture the full information about the signal. As an implication, for the linear noise approximation, we can identify the same loss of information, arising from its inherent simplification of the dynamics.

Backward transfer entropy: Informational measure for detecting hidden Markov models and its interpretations in thermodynamics, gambling and causality

The transfer entropy is a well-established measure of information flow, which quantifies directed influence between two stochastic time series and has been shown to be useful in a variety fields of science. Here we introduce the transfer entropy of the backward time series called the backward transfer entropy, and show that the backward transfer entropy quantifies how far it is from dynamics to a hidden Markov model. Furthermore, we discuss physical interpretations of the backward transfer entropy in completely different settings of thermodynamics for information processing and the gambling with side information. In both settings of thermodynamics and the gambling, the backward transfer entropy characterizes a possible loss of some benefit, where the conventional transfer entropy characterizes a possible benefit. Our result implies the deep connection between thermodynamics and the gambling in the presence of information flow, and that the backward transfer entropy would be useful as a novel measure of information flow in nonequilibrium thermodynamics, biochemical sciences, economics and statistics.

Linear irreversible thermodynamics and Onsager reciprocity for information-driven engines

In the recent progress in nonequilibrium thermodynamics, information has been recognized as a kind of thermodynamic resource that can drive thermodynamic current without any direct energy injection. In this paper, we establish the framework of linear irreversible thermodynamics for a broad class of autonomous information processing. In particular, we prove that the Onsager reciprocity holds true with information: The linear response matrix is well-defined and is shown symmetric with both of the information affinity and the conventional thermodynamic affinity. As an application, we derive a universal bound for the efficiency at maximum power for information-driven engines in the linear regime. Our result reveals the fundamental role of information flow in linear irreversible thermodynamics.

Information processing in bacteria: memory, computation, and statistical physics: a key issues review

Living systems have to constantly sense their external environment and adjust their internal state in order to survive and reproduce. Biological systems, from as complex as the brain to a single E. coli cell, have to process these data in order to make appropriate decisions. How do biological systems sense external signals? How do they process the information? How do they respond to signals? Through years of intense study by biologists, many key molecular players and their interactions have been identified in different biological machineries that carry out these signaling functions. However, an integrated, quantitative understanding of the whole system is still lacking for most cellular signaling pathways, not to say the more complicated neural circuits. To study signaling processes in biology, the key thing to measure is the input-output relationship. The input is the signal itself, such as chemical concentration, external temperature, light (intensity and frequency), and more complex signals such as the face of a cat. The output can be protein conformational changes and covalent modifications (phosphorylation, methylation, etc), gene expression, cell growth and motility, as well as more complex output such as neuron firing patterns and behaviors of higher animals. Due to the inherent noise in biological systems, the measured input-output dependence is often noisy. These noisy data can be analysed by using powerful tools and concepts from information theory such as mutual information, channel capacity, and the maximum entropy hypothesis. This information theory approach has been successfully used to reveal the underlying correlations between key components of biological networks, to set bounds for network performance, and to understand possible network architecture in generating observed correlations. Although the information theory approach provides a general tool in analysing noisy biological data and may be used to suggest possible network architectures in preserving information, it does not reveal the underlying mechanism that leads to the observed input-output relationship, nor does it tell us much about which information is important for the organism and how biological systems use information to carry out specific functions. To do that, we need to develop models of the biological machineries, e.g. biochemical networks and neural networks, to understand the dynamics of biological information processes. This is a much more difficult task. It requires deep knowledge of the underlying biological network-the main players (nodes) and their interactions (links)-in sufficient detail to build a model with predictive power, as well as quantitative input-output measurements of the system under different perturbations (both genetic variations and different external conditions) to test the model predictions to guide further development of the model. Due to the recent growth of biological knowledge thanks in part to high throughput methods (sequencing, gene expression microarray, etc) and development of quantitative in vivo techniques such as various florescence technology, these requirements are starting to be realized in different biological systems. The possible close interaction between quantitative experimentation and theoretical modeling has made systems biology an attractive field for physicists interested in quantitative biology. In this review, we describe some of the recent work in developing a quantitative predictive model of bacterial chemotaxis, which can be considered as the hydrogen atom of systems biology. Using statistical physics approaches, such as the Ising model and Langevin equation, we study how bacteria, such as E. coli, sense and amplify external signals, how they keep a working memory of the stimuli, and how they use these data to compute the chemical gradient. In particular, we will describe how E. coli cells avoid cross-talk in a heterogeneous receptor cluster to keep a ligand-specific memory. We will also study the thermodynamic costs of adaptation for cells to maintain an accurate memory. The statistical physics based approach described here should be useful in understanding design principles for cellular biochemical circuits in general.

Sensory capacity: An information theoretical measure of the performance of a sensor

For a general sensory system following an external stochastic signal, we introduce the sensory capacity. This quantity characterizes the performance of a sensor: sensory capacity is maximal if the instantaneous state of the sensor has as much information about a signal as the whole time series of the sensor. We show that adding a memory to the sensor increases the sensory capacity. This increase quantifies the improvement of the sensor with the addition of the memory. Our results are obtained with the framework of stochastic thermodynamics of bipartite systems, which allows for the definition of an efficiency that relates the rate with which the sensor learns about the signal with the energy dissipated by the sensor, which is given by the thermodynamic entropy production. We demonstrate a general trade-off between sensory capacity and efficiency: if the sensory capacity is equal to its maximum 1, then the efficiency must be less than 1/2. As a physical realization of a sensor we consider a two-component cellular network estimating a fluctuating external ligand concentration as signal. This model leads to coupled linear Langevin equations that allow us to obtain explicit analytical results.

Work Fluctuation-Dissipation Trade-Off in Heat Engines

Reducing work fluctuation and dissipation in heat engines or, more generally, information heat engines that perform feedback control, is vital to maximize their efficiency. The same problem arises when we attempt to maximize the efficiency of a given thermodynamic task that undergoes nonequilibrium processes for arbitrary initial and final states. We find that the most general trade-off relation between work fluctuation and dissipation applicable to arbitrary nonequilibrium processes is bounded from below by the information distance characterizing how far the system is from thermal equilibrium. The minimum amount of dissipation is found to be given in terms of the relative entropy and the Renyi divergence, both of which quantify the information distance between the state of the system and the canonical distribution. We give an explicit protocol that achieves the fundamental lower bound of the trade-off relation.

Bacterial chemotaxis: information processing, thermodynamics, and behavior

Escherichia coli has long been used as a model organism due to the extensive experimental characterization of its pathways and molecular components. Take chemotaxis as an example, which allows bacteria to sense and swim in response to chemicals, such as nutrients and toxins. Many of the pathway's remarkable sensing and signaling properties are now concisely summarized in terms of design (or engineering) principles. More recently, new approaches from information theory and stochastic thermodynamics have begun to address how pathways process environmental stimuli and what the limiting factors are. However, to fully capitalize on these theoretical advances, a closer connection with single-cell experiments will be required.

Thermodynamics of stochastic Turing machines

In analogy to Brownian computers we explicitly show how to construct stochastic models which mimic the behavior of a general-purpose computer (a Turing machine). Our models are discrete state systems obeying a Markovian master equation, which are logically reversible and have a well-defined and consistent thermodynamic interpretation. The resulting master equation, which describes a simple one-step process on an enormously large state space, allows us to thoroughly investigate the thermodynamics of computation for this situation. Especially in the stationary regime we can well approximate the master equation by a simple Fokker-Planck equation in one dimension. We then show that the entropy production rate at steady state can be made arbitrarily small, but the total (integrated) entropy production is finite and grows logarithmically with the number of computational steps.