Beyond the death of linear response: 1/f optimal information transport

Complexity synchronization in living matter: a mini review

Fractal time series have been argued to be ubiquitous in human physiology and some of the implications of that ubiquity are quite remarkable. One consequence of the omnipresent fractality is complexity synchronization (CS) observed in the interactions among simultaneously recorded physiologic time series discussed herein. This new kind of synchronization has been revealed in the interaction triad of organ-networks (ONs) consisting of the mutually interacting time series generated by the brain (electroencephalograms, EEGs), heart (electrocardiograms, ECGs), and lungs (Respiration). The scaled time series from each member of the triad look nothing like one another and yet they bear a deeply recorded synchronization invisible to the naked eye. The theory of scaling statistics is used to explain the source of the CS observed in the information exchange among these multifractal time series. The multifractal dimension (MFD) of each time series is a measure of the time-dependent complexity of that time series, and it is the matching of the MFD time series that provides the synchronization referred to as CS. The CS is one manifestation of the hypothesis given by a "Law of Multifractal Dimension Synchronization" (LMFDS) which is supported by data. Therefore, the review aspects of this paper are chosen to make the extended range of the LMFDS hypothesis sufficiently reasonable to warrant further empirical testing.

Complexity Synchronization of Organ Networks

The transdisciplinary nature of science as a whole became evident as the necessity for the complex nature of phenomena to explain social and life science, along with the physical sciences, blossomed into complexity theory and most recently into complexitysynchronization. This science motif is based on the scaling arising from the 1/f-variability in complex dynamic networks and the need for a network of networks to exchange information internally during intra-network dynamics and externally during inter-network dynamics. The measure of complexity adopted herein is the multifractal dimension of the crucial event time series generated by an organ network, and the difference in the multifractal dimensions of two organ networks quantifies the relative complexity between interacting complex networks. Information flows from dynamic networks at a higher level of complexity to those at lower levels of complexity, as summarized in the 'complexity matching effect', and the flow is maximally efficient when the complexities are equal. Herein, we use the scaling of empirical datasets from the brain, cardiovascular and respiratory networks to support the hypothesis that complexity synchronization occurs between scaling indices or equivalently with the matching of the time dependencies of the networks' multifractal dimensions.

The Fractal Tapestry of Life: III Multifractals Entail the Fractional Calculus

This is the third essay advocating the use the (non-integer) fractional calculus (FC) to capture the dynamics of complex networks in the twilight of the Newtonian era. Herein, the focus is on drawing a distinction between networks described by monfractal time series extensively discussed in the prequels and how they differ in function from multifractal time series, using physiological phenomena as exemplars. In prequel II, the network effect was introduced to explain how the collective dynamics of a complex network can transform a many-body non-linear dynamical system modeled using the integer calculus (IC) into a single-body fractional stochastic rate equation. Note that these essays are about biomedical phenomena that have historically been improperly modeled using the IC and how fractional calculus (FC) models better explain experimental results. This essay presents the biomedical entailment of the FC, but it is not a mathematical discussion in the sense that we are not concerned with the formal infrastucture, which is cited, but we are concerned with what that infrastructure entails. For example, the health of a physiologic network is characterized by the width of the multifractal spectrum associated with its time series, and which becomes narrower with the onset of certain pathologies. Physiologic time series that have explicitly related pathology to a narrowing of multifractal time series include but are not limited to heart rate variability (HRV), stride rate variability (SRV) and breath rate variability (BRV). The efficiency of the transfer of information due to the interaction between two such complex networks is determined by their relative spectral width, with information being transferred from the network with the broader to that with the narrower width. A fractional-order differential equation, whose order is random, is shown to generate a multifractal time series, thereby providing a FC model of the information exchange between complex networks. This equivalence between random fractional derivatives and multifractality has not received the recognition in the bioapplications literature we believe it warrants.

Spectral Properties of Stochastic Processes Possessing Finite Propagation Velocity

This article investigates the spectral structure of the evolution operators associated with the statistical description of stochastic processes possessing finite propagation velocity. Generalized Poisson–Kac processes and Lévy walks are explicitly considered as paradigmatic examples of regular and anomalous dynamics. A generic spectral feature of these processes is the lower boundedness of the real part of the eigenvalue spectrum that corresponds to an upper limit of the spectral dispersion curve, physically expressing the relaxation rate of a disturbance as a function of the wave vector. We also analyze Generalized Poisson–Kac processes possessing a continuum of stochastic states parametrized with respect to the velocity. In this case, there is a critical value for the wave vector, above which the point spectrum ceases to exist, and the relaxation dynamics becomes controlled by the essential part of the spectrum. This model can be extended to the quantum case, and in fact, it represents a simple and clear example of a sub-quantum dynamics with hidden variables.

Co-actors Exhibit Similarity in Their Structure of Behavioural Variation That Remains Stable Across Range of Naturalistic Activities

Human behaviour, along with any natural/biological behaviour, has varying degrees of intrinsic 'noise' or variability. Many studies have shown that the structure or patterning of this variability is sensitive to changes in task and constraint. Furthermore, two or more humans interacting together often begin to exhibit similar structures of behavioural variability (i.e., the patterning of their behavioural fluctuations becomes aligned or matched) independent of any moment-to-moment synchronization (termed complexity matching). However, much of the previous work has focused on a subset of simple or contrived behaviours within the context of highly controlled laboratory tasks. In the current study, individuals and pairs performed five self-paced (unsupervised), semi-structured activities around a university campus. Empatica E4 wristbands and iPhones were used to record the participants' behavioural activity via accelerometers and GPS. The results revealed that the structure of variability in naturalistic human behaviour co-varies with the task-goal constraints, and that the patterning of the behavioural fluctuations exhibited by co-acting individuals does become aligned during the performance of everyday activities. The results also revealed that the degree of complexity matching that occurred between pairs remained invariant across activity type, indicating that this measure could be employed as a robust, task-independent index of interpersonal behaviour.

Neuronal Avalanches in Input and Associative Layers of Auditory Cortex

The primary auditory cortex processes acoustic sequences for the perception of behaviorally meaningful sounds such as speech. Sound information arrives at its input layer four from where activity propagates to associative layer 2/3. It is currently not known whether there is a characteristic organization of neuronal population activity across layers and sound levels during sound processing. Here, we identify neuronal avalanches, which in theory and experiments have been shown to maximize dynamic range and optimize information transfer within and across networks, in primary auditory cortex. We used in vivo 2-photon imaging of pyramidal neurons in cortical layers L4 and L2/3 of mouse A1 to characterize the populations of neurons that were active spontaneously, i.e., in the absence of a sound stimulus, and those recruited by single-frequency tonal stimuli at different sound levels. Single-frequency sounds recruited neurons of widely ranging frequency selectivity in both layers. We defined neuronal ensembles as neurons being active within or during successive temporal windows at the temporal resolution of our imaging. For both layers, neuronal ensembles were highly variable in size during spontaneous activity as well as during sound presentation. Ensemble sizes distributed according to power laws, the hallmark of neuronal avalanches, and were similar across sound levels. Avalanches activated by sound were composed of neurons with diverse tuning preference, yet with selectivity independent of avalanche size. Our results suggest that optimization principles identified for avalanches guide population activity in L4 and L2/3 of auditory cortex during and in-between stimulus processing.

Scale-Free Amplitude Modulation of Neuronal Oscillations Tracks Comprehension of Accelerated Speech

Speech comprehension is preserved up to a threefold acceleration, but deteriorates rapidly at higher speeds. Current models posit that perceptual resilience to accelerated speech is limited by the brain's ability to parse speech into syllabic units using δ/θ oscillations. Here, we investigated whether the involvement of neuronal oscillations in processing accelerated speech also relates to their scale-free amplitude modulation as indexed by the strength of long-range temporal correlations (LRTC). We recorded MEG while 24 human subjects (12 females) listened to radio news uttered at different comprehensible rates, at a mostly unintelligible rate and at this same speed interleaved with silence gaps. δ, θ, and low-γ oscillations followed the nonlinear variation of comprehension, with LRTC rising only at the highest speed. In contrast, increasing the rate was associated with a monotonic increase in LRTC in high-γ activity. When intelligibility was restored with the insertion of silence gaps, LRTC in the δ, θ, and low-γ oscillations resumed the low levels observed for intelligible speech. Remarkably, the lower the individual subject scaling exponents of δ/θ oscillations, the greater the comprehension of the fastest speech rate. Moreover, the strength of LRTC of the speech envelope decreased at the maximal rate, suggesting an inverse relationship with the LRTC of brain dynamics when comprehension halts. Our findings show that scale-free amplitude modulation of cortical oscillations and speech signals are tightly coupled to speech uptake capacity.SIGNIFICANCE STATEMENT One may read this statement in 20-30 s, but reading it in less than five leaves us clueless. Our minds limit how much information we grasp in an instant. Understanding the neural constraints on our capacity for sensory uptake is a fundamental question in neuroscience. Here, MEG was used to investigate neuronal activity while subjects listened to radio news played faster and faster until becoming unintelligible. We found that speech comprehension is related to the scale-free dynamics of δ and θ bands, whereas this property in high-γ fluctuations mirrors speech rate. We propose that successful speech processing imposes constraints on the self-organization of synchronous cell assemblies and their scale-free dynamics adjusts to the temporal properties of spoken language.

Self-organizing Complex Networks: individual versus global rules

We introduce a form of Self-Organized Criticality (SOC) inspired by the new generation of evolutionary game theory, which ranges from physiology to sociology. The single individuals are the nodes of a composite network, equivalent to two interacting subnetworks, one leading to strategy choices made by the individuals under the influence of the choices of their nearest neighbors and the other measuring the Prisoner's Dilemma Game payoffs of these choices. The interaction between the two networks is established by making the imitation strength K increase or decrease according to whether the last two payoffs increase or decrease upon increasing or decreasing K. Although each of these imitation strengths is selected selfishly, and independently of the others as well, the social system spontaneously evolves toward the state of cooperation. Criticality is signaled by temporal complexity, namely the occurrence of non-Poisson renewal events, the time intervals between two consecutive crucial events being given by an inverse power law index μ = 1.3 rather than by avalanches with an inverse power law distribution as in the original form of SOC. This new phenomenon is herein labeled self-organized temporal criticality (SOTC). We compare this bottom-up self-organization process to the adoption of a global choice rule based on assigning to all the units the same value K, with the time evolution of common K being determined by consciousness of the social benefit, a top-down process implying the action of a leader. In this case self-organization is impeded by large intensity fluctuations and the global social benefit turns out to be much weaker. We conclude that the SOTC model fits the requests of a manifesto recently proposed by a number of European social scientists.

Aging Wiener-Khinchin theorem and critical exponents of 1/f^{β} noise

The power spectrum of a stationary process may be calculated in terms of the autocorrelation function using the Wiener-Khinchin theorem. We here generalize the Wiener-Khinchin theorem for nonstationary processes and introduce a time-dependent power spectrum 〈S_{t_{m}}(ω)〉 where t_{m} is the measurement time. For processes with an aging autocorrelation function of the form 〈I(t)I(t+τ)〉=t^{Υ}ϕ_{EA}(τ/t), where ϕ_{EA}(x) is a nonanalytic function when x is small, we find aging 1/f^{β} noise. Aging 1/f^{β} noise is characterized by five critical exponents. We derive the relations between the scaled autocorrelation function and these exponents. We show that our definition of the time-dependent spectrum retains its interpretation as a density of Fourier modes and discuss the relation to the apparent infrared divergence of 1/f^{β} noise. We illustrate our results for blinking-quantum-dot models, single-file diffusion, and Brownian motion in a logarithmic potential.

Nonergodic complexity management

Linear response theory, the backbone of nonequilibrium statistical physics, has recently been extended to explain how and why nonergodic renewal processes are insensitive to simple perturbations, such as in habituation. It was established that a permanent correlation results between an external stimulus and the response of a complex system generating nonergodic renewal processes, when the stimulus is a similar nonergodic process. This is the principle of complexity management, whose proof relies on ensemble distribution functions. Herein we extend the proof to the nonergodic case using time averages and a single time series, hence making it usable in real life situations where ensemble averages cannot be performed because of the very nature of the complex systems being studied.

General response formula and application to topological insulator in quantum open system

It is well-known that the quantum linear response theory is based on the first-order perturbation theory for a system in thermal equilibrium. Hence, this theory breaks down when the system is in a steady state far from thermal equilibrium and the response up to higher order in perturbation is not negligible. In this paper, we develop a nonlinear response theory for such quantum open system. We first formulate this theory in terms of general susceptibility, after which we apply it to the derivation of Hall conductance for open system at finite temperature. As an example, the Hall conductance of the two-band model is derived. Then we calculate the Hall conductance for a two-dimensional ferromagnetic electron gas and a two-dimensional lattice model. The calculations show that the transition points of topological phase are robust against the environment. Our results provide a promising platform for the coherent manipulation of the nonlinear response in quantum open system, which has potential applications for quantum information processing and statistical physics.

Aging Wiener-Khinchin Theorem

The Wiener-Khinchin theorem shows how the power spectrum of a stationary random signal I(t) is related to its correlation function ⟨I(t)I(t+τ)⟩. We consider nonstationary processes with the widely observed aging correlation function ⟨I(t)I(t+τ)⟩∼t(γ)ϕ(EA)(τ/t) and relate it to the sample spectrum. We formulate two aging Wiener-Khinchin theorems relating the power spectrum to the time- and ensemble-averaged correlation functions, discussing briefly the advantages of each. When the scaling function ϕ(EA)(x) exhibits a nonanalytical behavior in the vicinity of its small argument we obtain the aging 1/f-type of spectrum. We demonstrate our results with three examples: blinking quantum dots, single-file diffusion, and Brownian motion in a logarithmic potential, showing that our approach is valid for a wide range of physical mechanisms.

From Neural and Social Cooperation to the Global Emergence of Cognition

The recent article (Turalska et al., 2012) discusses the emergence of intelligence via criticality as a consequence of locality breakdown. Herein, we use criticality for the foundation of a novel generation of game theory making the local interaction between players yield long-range effects. We first establish that criticality is not confined to the Ising-like structure of the sociological model of (Turalska et al., 2012), called the decision making model (DMM), through the study of the emergence of altruism using the altruism-selfishness model (ASM). Both models generate criticality, one by imitation of opinion (DMM) and the other by imitation of behavior (ASM). The dynamics of a sociological network 𝒮 influences the behavioral network ℱ through two game theoretic paradigms: (i) the value of altruism; (ii) the benefit of rapid consensus. In (i), the network 𝒮 debates the moral issue of altruism by means of the DMM, while at the level ℱ the individuals operate according to the ASM. The individuals of the level 𝒮, through a weak influence on the individuals of the level ℱ, exert a societal control on ℱ, fitting the principle of complexity management and complexity matching. In (ii), the benefit to society is the rapid attainment of consensus in the 𝒮 level. The agents of the level ℱ operate according to the prisoner's dilemma prescription, with the defectors acting as DMM contrarians at the level 𝒮. The contrarians, acting as the inhibitory links of neural networks, exert on society the same beneficial effect of maintaining the criticality-induced resilience that they generate in neural networks. The conflict between personal and social benefit makes the networks evolve toward criticality. Finally, we show that the theory of this article is compatible with recent discoveries in the burgeoning field of social neuroscience.

Spectral convergence in tapping and physiological fluctuations: coupling and independence of 1/f noise in the central and autonomic nervous systems

When humans perform a response task or timing task repeatedly, fluctuations in measures of timing from one action to the next exhibit long-range correlations known as 1/f noise. The origins of 1/f noise in timing have been debated for over 20 years, with one common explanation serving as a default: humans are composed of physiological processes throughout the brain and body that operate over a wide range of timescales, and these processes combine to be expressed as a general source of 1/f noise. To test this explanation, the present study investigated the coupling vs. independence of 1/f noise in timing deviations, key-press durations, pupil dilations, and heartbeat intervals while tapping to an audiovisual metronome. All four dependent measures exhibited clear 1/f noise, regardless of whether tapping was synchronized or syncopated. 1/f spectra for timing deviations were found to match those for key-press durations on an individual basis, and 1/f spectra for pupil dilations matched those in heartbeat intervals. Results indicate a complex, multiscale relationship among 1/f noises arising from common sources, such as those arising from timing functions vs. those arising from autonomic nervous system (ANS) functions. Results also provide further evidence against the default hypothesis that 1/f noise in human timing is just the additive combination of processes throughout the brain and body. Our findings are better accommodated by theories of complexity matching that begin to formalize multiscale coordination as a foundation of human behavior.

Linear response at criticality

We study a set of cooperatively interacting units at criticality, and we prove with analytical and numerical arguments that they generate the same renewal non-Poisson intermittency as that produced by blinking quantum dots, thereby giving a stronger support to the results of earlier investigation. By analyzing how this out-of-equilibrium system responds to harmonic perturbations, we find that the response can be described only using a new form of linear response theory that accounts for aging and the nonergodic behavior of the underlying process. We connect the undamped response of the system at criticality to the decaying response predicted by the recently established nonergodic fluctuation-dissipation theorem for dichotomous processes using information about the second moment of the fluctuations. We demonstrate that over a wide range of perturbation frequencies the response of the cooperative system is greatest when at criticality.

From self-organized to extended criticality

We address the issue of criticality that is attracting the attention of an increasing number of neurophysiologists. Our main purpose is to establish the specific nature of some dynamical processes that although physically different, are usually termed as “critical,” and we focus on those characterized by the cooperative interaction of many units. We notice that the term “criticality” has been adopted to denote both noise-induced phase transitions and Self-Organized Criticality (SOC) with no clear connection with the traditional phase transitions, namely the transformation of a thermodynamic system from one state of matter to another. We notice the recent attractive proposal of extended criticality advocated by Bailly and Longo, which is realized through a wide set of critical points rather than emerging as a singularity from a unique value of the control parameter. We study a set of cooperatively firing neurons and we show that for an extended set of interaction couplings the system exhibits a form of temporal complexity similar to that emerging at criticality from ordinary phase transitions. This extended criticality regime is characterized by three main properties: (i) In the ideal limiting case of infinitely large time period, temporal complexity corresponds to Mittag-Leffler complexity; (ii) For large values of the interaction coupling the periodic nature of the process becomes predominant while maintaining to some extent, in the intermediate time asymptotic region, the signature of complexity; (iii) Focusing our attention on firing neuron avalanches, we find two of the popular SOC properties, namely the power indexes 2 and 1.5 respectively for time length and for the intensity of the avalanches. We derive the main conclusion that SOC emerges from extended criticality, thereby explaining the experimental observation of Plenz and Beggs: avalanches occur in time with surprisingly regularity, in apparent conflict with the temporal complexity of physical critical points.

Overview 2010 of ARL Program on Network Science for Human Decision Making

The Army Research Laboratory program on the Network Science of Human Decision Making brings together researchers from a variety of disciplines to work on a complex research problem that defies confinement within any single discipline. Consequently, new and rewarding solutions have been obtained for a problem of importance to society and the Army, that being, the human dimension of complex networks. This program investigates the basic research foundation of a science of networks supporting the linkage between the cognitive and social domains as they relate to human decision making. The research strategy extends recent methods of non-equilibrium statistical physics to non-stationary, renewal stochastic processes characteristic of the interactions among nodes in complex networks. The theoretical analyses of complex networks, although mathematically rigorous, often elude analytic solutions and require simulation and computation to analyze the underlying dynamic process. The information transfer between two complex networks is calculated using the principle of complexity management as well as direct numerical calculation of the decision making model developed within the project.

Residence time statistics for N renewal processes

We present a study of residence time statistics for N renewal processes with a long tailed distribution of the waiting time. Such processes describe many nonequilibrium systems ranging from the intensity of N blinking quantum dots to the residence time of N Brownian particles. With numerical simulations and exact calculations, we show sharp transitions for a critical number of degrees of freedom N. In contrast to the expectation, the fluctuations in the limit of N→∞ are nontrivial. We briefly discuss how our approach can be used to detect nonergodic kinetics from the measurements of many blinking chromophores, without the need to reach the single molecule limit.

Criticality and transmission of information in a swarm of cooperative units

We show that the intelligence of a swarm of cooperative units (birds) emerges at criticality, as an effect of the joint action of frequent organizational collapses and of spatial correlation as extended as the flock size. The organizational collapses make the birds become independent of one another, thereby allowing the flock to follow the direction of the lookout birds. Long-range correlation violates the principle of locality, making the lookout birds transmit information on either danger or resources with a time delay determined by the time distance between two consecutive collapses.

Temporal complexity of the order parameter at the phase transition

We study a decision making model in a condition where it is equivalent to the two-dimensional Ising model, and we show that at the onset of phase transition it generates temporal complexity, namely, nonstationary and nonergodic fluctuations. We argue that this is a general property of criticality, thereby opening the door to the application of the recently discovered phenomenon of complexity matching: For an efficient transfer of information to occur, a perturbing complex network must share the same temporal complexity as the perturbed complex network.

Transmission of information between complex systems: 1/f resonance

We study the transport of information between two complex systems with similar properties. Both systems generate non-Poisson renewal fluctuations with a power-law spectrum 1/f(3-μ), the case μ=2 corresponding to ideal 1/f noise. We denote by μ(S) and μ(P) the power-law indexes of the system of interest S and the perturbing system P, respectively. By adopting a generalized fluctuation-dissipation theorem (FDT) we show that the ideal condition of 1/f noise for both systems corresponds to maximal information transport. We prove that to make the system S respond when μ(S)<2 we have to set the condition μ(P)<2. In the latter case, if μ(P)<μ(S), the system S inherits the relaxation properties of the perturbing system. In the case where μ(P)>2, no response and no information transmission occurs in the long-time limit. We consider two possible generalizations of the fluctuation dissipation theorem and show that both lead to maximal information transport in the condition of 1/f noise.