Behavior of information flow near criticality

Characterizing the nonmonotonic behavior of mutual information along biochemical reaction cascades

Cells sense environmental signals and transmit information intracellularly through changes in the abundance of molecular components. Such molecular abundances can be measured in single cells and exhibit significant heterogeneity in clonal populations even in identical environments. Experimentally observed joint probability distributions can then be used to quantify the covariability and mutual information between molecular abundances along signaling cascades. However, because stationary state abundances along stochastic biochemical reaction cascades are not conditionally independent, their mutual information is not constrained by the data-processing inequality. Here, we report the conditions under which the mutual information between stationary state abundances increases along a cascade of biochemical reactions. This nonmonotonic behavior can be intuitively understood in terms of noise propagation and time-averaging stochastic fluctuations that are short-lived compared to an extrinsic signal. Our results reemphasize that mutual information measurements of stationary state distributions of cellular components may be of limited utility for characterizing cellular signaling processes because they do not measure information transfer.

Entropy production in communication channels

In many complex systems, whether biological or artificial, the thermodynamic costs of communication among their components are large. These systems also tend to split information transmitted between any two components across multiple channels. A common hypothesis is that such inverse multiplexing strategies reduce total thermodynamic costs. So far, however, there have been no physics-based results supporting this hypothesis. This gap existed partially because we have lacked a theoretical framework that addresses the interplay of thermodynamics and information in off-equilibrium systems. Here we present the first study that rigorously combines such a framework, stochastic thermodynamics, with Shannon information theory. We develop a minimal model that captures the fundamental features common to a wide variety of communication systems, and study the relationship between the entropy production of the communication process and the channel capacity, the canonical measure of the communication capability of a channel. In contrast to what is assumed in previous works not based on first principles, we show that the entropy production is not always a convex and monotonically increasing function of the channel capacity. However, those two properties are recovered for sufficiently high channel capacity. These results clarify when and how to split a single communication stream across multiple channels.

Duality between predictability and reconstructability in complex systems

Predicting the evolution of a large system of units using its structure of interaction is a fundamental problem in complex system theory. And so is the problem of reconstructing the structure of interaction from temporal observations. Here, we find an intricate relationship between predictability and reconstructability using an information-theoretical point of view. We use the mutual information between a random graph and a stochastic process evolving on this random graph to quantify their codependence. Then, we show how the uncertainty coefficients, which are intimately related to that mutual information, quantify our ability to reconstruct a graph from an observed time series, and our ability to predict the evolution of a process from the structure of its interactions. We provide analytical calculations of the uncertainty coefficients for many different systems, including continuous deterministic systems, and describe a numerical procedure when exact calculations are intractable. Interestingly, we find that predictability and reconstructability, even though closely connected by the mutual information, can behave differently, even in a dual manner. We prove how such duality universally emerges when changing the number of steps in the process. Finally, we provide evidence that predictability-reconstruction dualities may exist in dynamical processes on real networks close to criticality.

Inferring couplings in networks across order-disorder phase transitions

Statistical inference is central to many scientific endeavors, yet how it works remains unresolved. Answering this requires a quantitative understanding of the intrinsic interplay between statistical models, inference methods, and the structure in the data. To this end, we characterize the efficacy of direct coupling analysis (DCA) - a highly successful method for analyzing amino acid sequence data-in inferring pairwise interactions from samples of ferromagnetic Ising models on random graphs. Our approach allows for physically motivated exploration of qualitatively distinct data regimes separated by phase transitions. We show that inference quality depends strongly on the nature of data-generating distributions: optimal accuracy occurs at an intermediate temperature where the detrimental effects from macroscopic order and thermal noise are minimal. Importantly our results indicate that DCA does not always outperform its local-statistics-based predecessors; while DCA excels at low temperatures, it becomes inferior to simple correlation thresholding at virtually all temperatures when data are limited. Our findings offer insights into the regime in which DCA operates so successfully, and more broadly, how inference interacts with the structure in the data.

Cardio PyMEA: A user-friendly, open-source Python application for cardiomyocyte microelectrode array analysis

Open source analytical software for the analysis of electrophysiological cardiomyocyte data offers a variety of new functionalities to complement closed-source, proprietary tools. Here, we present the Cardio PyMEA application, a free, modifiable, and open source program for the analysis of microelectrode array (MEA) data obtained from cardiomyocyte cultures. Major software capabilities include: beat detection; pacemaker origin estimation; beat amplitude and interval; local activation time, upstroke velocity, and conduction velocity; analysis of cardiomyocyte property-distance relationships; and robust power law analysis of pacemaker spatiotemporal instability. Cardio PyMEA was written entirely in Python 3 to provide an accessible, integrated workflow that possesses a user-friendly graphical user interface (GUI) written in PyQt5 to allow for performant, cross-platform utilization. This application makes use of object-oriented programming (OOP) principles to facilitate the relatively straightforward incorporation of custom functionalities, e.g. power law analysis, that suit the needs of the user. Cardio PyMEA is available as an open source application under the terms of the GNU General Public License (GPL). The source code for Cardio PyMEA can be downloaded from Github at the following repository: https://github.com/csdunhamUC/cardio_pymea.

Pacemaker translocations and power laws in 2D stem cell-derived cardiomyocyte cultures

Power laws are of interest to several scientific disciplines because they can provide important information about the underlying dynamics (e.g. scale invariance and self-similarity) of a given system. Because power laws are of increasing interest to the cardiac sciences as potential indicators of cardiac dysfunction, it is essential that rigorous, standardized analytical methods are employed in the evaluation of power laws. This study compares the methods currently used in the fields of condensed matter physics, geoscience, neuroscience, and cardiology in order to provide a robust analytical framework for evaluating power laws in stem cell-derived cardiomyocyte cultures. One potential power law-obeying phenomenon observed in these cultures is pacemaker translocations, or the spatial and temporal instability of the pacemaker region, in a 2D cell culture. Power law analysis of translocation data was performed using increasingly rigorous methods in order to illustrate how differences in analytical robustness can result in misleading power law interpretations. Non-robust methods concluded that pacemaker translocations adhere to a power law while robust methods convincingly demonstrated that they obey a doubly truncated power law. The results of this study highlight the importance of employing comprehensive methods during power law analysis of cardiomyocyte cultures.

Escherichia coli chemotaxis is information limited

Organisms acquire and use information from their environment to guide their behaviour. However, it is unclear whether this information quantitatively limits their behavioural performance. Here, we relate information to the ability of Escherichia coli to navigate up chemical gradients, the behaviour known as chemotaxis. First, we derive a theoretical limit on the speed with which cells climb gradients, given the rate at which they acquire information. Next, we measure cells' gradient-climbing speeds and the rate of information acquisition by their chemotaxis signaling pathway. We find that E. coli make behavioural decisions with much less than the one bit required to determine whether they are swimming up-gradient. Some of this information is irrelevant to gradient climbing, and some is lost in communication to behaviour. Despite these limitations, E. coli climb gradients at speeds within a factor of two of the theoretical bound. Thus, information can limit the performance of an organism, and sensory-motor pathways may have evolved to efficiently use information acquired from the environment.