The criticality hypothesis: how local cortical networks might optimize information processing

Coexistence of scale-invariant and rhythmic behavior in self-organized criticality

Scale-free behavior as well as oscillations are frequently observed in the activity of many natural systems. One important example is the cortical tissues of mammalian brain where both phenomena are simultaneously observed. Rhythmic oscillations as well as critical (scale-free) dynamics are thought to be important, but theoretically incompatible, features of a healthy brain. Motivated by the above, we study the possibility of the coexistence of scale-free avalanches along with rhythmic behavior within the framework of self-organized criticality. In particular, we add an oscillatory perturbation to local threshold condition of the continuous Zhang model and characterize the subsequent activity of the system. We observe regular oscillations embedded in well-defined avalanches which exhibit scale-free size and duration in line with observed neuronal avalanches. The average amplitude of such oscillations are shown to decrease with increasing frequency consistent with real brain oscillations. Furthermore, it is shown that optimal amplification of oscillations occur at the critical point, further providing evidence for functional advantages of criticality.

Traits of criticality in membrane potential fluctuations of pyramidal neurons in the CA1 region of rat hippocampus

Evidence that neural circuits are operating near criticality has been provided at various levels of brain organisation with a presumed role in maximising information processing and multiscale activity association. Criticality has been linked to excitation at both the single-cell and network levels, as action potential generation marks an obvious phase transition from a resting to an excitable state. Using in vitro intracellular recordings, we examine irregular, small amplitude membrane potential fluctuations from CA1 pyramidal neurons of Wistar male rats. We show that these fluctuations, confounded with noise, carry information relevant to the neuronal state. The underlying dynamics exhibit intermittent characteristics shown to describe the temporal fluctuations of the order parameter of a macroscopic system at its critical point even in the absence of firing. An externally applied stimulus serves as the control parameter, driving the system in and out of its critical state. Based on our experimental observations we calculate the equivalent of the isothermal critical exponent δ_h finding a value which depends on the applied stimulus. For each neuron there is a stimulus amplitude for which the critical behaviour becomes most pronounced. The corresponding mean value of δ_h in the considered ensemble of neurons is δ_h  ≈ 1.89, close to theoretical predictions for critical networks. Finally, we show that the firing rate of a neuron decreases exponentially with δ_h .

Information-Based Principle Induces Small-World Topology and Self-Organized Criticality in a Large Scale Brain Network

The information processing in the large scale network of the human brain is related to its cognitive functions. Due to requirements for adaptation to changing environments under biological constraints, these processes in the brain can be hypothesized to be optimized. The principles based on the information optimization are expected to play a central role in affecting the dynamics and topological structure of the brain network. Recent studies on the functional connectivity between brain regions, referred to as the functional connectome, reveal characteristics of their networks, such as self-organized criticality of brain dynamics and small-world topology. However, these important attributes are established separately, and their relations to the principle of the information optimization are unclear. Here, we show that the maximization principle of the mutual information entropy induces the optimal state, at which the small-world network topology and the criticality in the activation dynamics emerge. Our findings, based on the functional connectome analyses, show that according to the increasing mutual information entropy, the coactivation pattern converges to the state of self-organized criticality, and a phase transition of the network topology, which is responsible for the small-world topology, arises simultaneously at the same point. The coincidence of these phase transitions at the same critical point indicates that the criticality of the dynamics and the phase transition of the network topology are essentially rooted in the same phenomenon driven by the mutual information maximization. As a consequence, the two different attributes of the brain, self-organized criticality and small-world topology, can be understood within a unified perspective under the information-based principle. Thus, our study provides an insight into the mechanism underlying the information processing in the brain.

1/f electrophysiological spectra in resting and drug-induced states can be explained by the dynamics of multiple oscillatory relaxation processes

Neurophysiological recordings are dominated by arhythmical activity whose spectra can be characterised by power-law functions, and on this basis are often referred to as reflecting scale-free brain dynamics (1/f^β). Relatively little is known regarding the neural generators and temporal dynamics of this arhythmical behaviour compared to rhythmical behaviour. Here we used Irregularly Resampled AutoSpectral Analysis (IRASA) to quantify β, in both the high (5-100 Hz, β_hf) and low frequency bands (0.1-2.5 Hz, β_lf) in MEG/EEG/ECoG recordings and to separate arhythmical from rhythmical modes of activity, such as, alpha rhythms. In MEG/EEG/ECoG data, we demonstrate that oscillatory alpha power dynamically correlates over time with β_hf and similarly, participants with higher rhythmical alpha power have higher β_hf. In a series of pharmaco-MEG investigations using the GABA reuptake inhibitor tiagabine, the glutamatergic AMPA receptor antagonist perampanel, the NMDA receptor antagonist ketamine and the mixed partial serotonergic agonist LSD, a variety of effects on both β_hf and β_lf were observed. Additionally, strong modulations of β_hf were seen in monkey ECoG data during general anaesthesia using propofol and ketamine. We develop and test a unifying model which can explain, the 1/f nature of electrophysiological spectra, their dynamic interaction with oscillatory rhythms as well as the sensitivity of 1/f activity to drug interventions by considering electrophysiological spectra as being generated by a collection of stochastically perturbed damped oscillators having a distribution of relaxation rates.

Emergence of diversity in homogeneous coupled Boolean networks

The origin of multicellularity in metazoa is one of the fundamental questions of evolutionary biology. We have modeled the generic behaviors of gene regulatory networks in isogenic cells as stochastic nonlinear dynamical systems-coupled Boolean networks with perturbation. Model simulations under a variety of dynamical regimes suggest that the central characteristic of multicellularity, permanent spatial differentiation (diversification), indeed can arise. Additionally, we observe that diversification is more likely to occur near the critical regime of Lyapunov stability.

A Basic Phase Diagram of Neuronal Dynamics

The extreme complexity of the brain has attracted the attention of neuroscientists and other researchers for a long time. More recently, the neuromorphic hardware has matured to provide a new powerful tool to study neuronal dynamics. Here, we study neuronal dynamics using different settings on a neuromorphic chip built with flexible parameters of neuron models. Our unique setting in the network of leaky integrate-and-fire (LIF) neurons is to introduce a weak noise environment. We observed three different types of collective neuronal activities, or phases, separated by sharp boundaries, or phase transitions. From this, we construct a rudimentary phase diagram of neuronal dynamics and demonstrate that a noise-induced chaotic phase (N-phase), which is dominated by neuronal avalanche activity (intermittent aperiodic neuron firing), emerges in the presence of noise and its width grows with the noise intensity. The dynamics can be manipulated in this N-phase. Our results and comparison with clinical data is consistent with the literature and our previous work showing that healthy brain must reside in the N-phase. We argue that the brain phase diagram with further refinement may be used for the diagnosis and treatment of mental disease and also suggest that the dynamics may be manipulated to serve as a means of new information processing (e.g., for optimization). Neuromorphic chips, similar to the one we used but with a variety of neuron models, may be used to further enhance the understanding of human brain function and accelerate the development of neuroscience research.

Neurophysiological Basis of Multi-Scale Entropy of Brain Complexity and Its Relationship With Functional Connectivity

Recently, non-linear statistical measures such as multi-scale entropy (MSE) have been introduced as indices of the complexity of electrophysiology and fMRI time-series across multiple time scales. In this work, we investigated the neurophysiological underpinnings of complexity (MSE) of electrophysiology and fMRI signals and their relations to functional connectivity (FC). MSE and FC analyses were performed on simulated data using neural mass model based brain network model with the Brain Dynamics Toolbox, on animal models with concurrent recording of fMRI and electrophysiology in conjunction with pharmacological manipulations, and on resting-state fMRI data from the Human Connectome Project. Our results show that the complexity of regional electrophysiology and fMRI signals is positively correlated with network FC. The associations between MSE and FC are dependent on the temporal scales or frequencies, with higher associations between MSE and FC at lower temporal frequencies. Our results from theoretical modeling, animal experiment and human fMRI indicate that (1) Regional neural complexity and network FC may be two related aspects of brain's information processing: the more complex regional neural activity, the higher FC this region has with other brain regions; (2) MSE at high and low frequencies may represent local and distributed information processing across brain regions. Based on literature and our data, we propose that the complexity of regional neural signals may serve as an index of the brain's capacity of information processing—increased complexity may indicate greater transition or exploration between different states of brain networks, thereby a greater propensity for information processing.

Network Dynamics of Attention During a Naturalistic Behavioral Paradigm

This study investigates the dynamics of attention during continuous, naturalistic interactions in a video game. Specifically, the effect of repeated distraction on a continuous primary task is related to a functional model of network connectivity. We introduce the Non-linear Attentional Saturation Hypothesis (NASH), which predicts that effective connectivity within attentional networks increases non-linearly with decreasing distraction over time, and exhibits dampening at critical parameter values. Functional magnetic resonance imaging (fMRI) data collected using a naturalistic behavioral paradigm coupled with an interactive video game is used to test the hypothesis. As predicted, connectivity in pre-defined regions corresponding to attentional networks increases as distraction decreases. Moreover, the functional relationship between connectivity and distraction is convex, that is, network connectivity somewhat increases as distraction decreases during the continuous primary task, however, connectivity increases considerably as distraction falls below critical levels. This result characterizes the non-linear pattern of connectivity within attentional networks, particularly with respect to their dynamics during behavior. These results are also summarized in the form of a network structure analysis, which underscores the role of various nodes in regulating the global network state. In conclusion, we situate the implications of this research in the context of cognitive complexity and an emerging theory of flow during media exposure.

Applications of community detection techniques to brain graphs: Algorithmic considerations and implications for neural function

The human brain can be represented as a graph in which neural units such as cells or small volumes of tissue are heterogeneously connected to one another through structural or functional links. Brain graphs are parsimonious representations of neural systems that have begun to offer fundamental insights into healthy human cognition, as well as its alteration in disease. A critical open question in network neuroscience lies in how neural units cluster into densely interconnected groups that can provide the coordinated activity that is characteristic of perception, action, and adaptive behaviors. Tools that have proven particularly useful for addressing this question are community detection approaches, which can identify communities or modules: groups of neural units that are densely interconnected with other units in their own group but sparsely interconnected with units in other groups. In this paper, we describe a common community detection algorithm known as modularity maximization, and we detail its applications to brain graphs constructed from neuroimaging data. We pay particular attention to important algorithmic considerations, especially in recent extensions of these techniques to graphs that evolve in time. After recounting a few fundamental insights that these techniques have provided into brain function, we highlight potential avenues of methodological advancements for future studies seeking to better characterize the patterns of coordinated activity in the brain that accompany human behavior. This tutorial provides a naive reader with an introduction to theoretical considerations pertinent to the generation of brain graphs, an understanding of modularity maximization for community detection, a resource of statistical measures that can be used to characterize community structure, and an appreciation of the usefulness of these approaches in uncovering behaviorally-relevant network dynamics in neuroimaging data.

Scale-freeness or partial synchronization in neural mass phase oscillator networks: Pick one of two?

Modeling and interpreting (partial) synchronous neural activity can be a challenge. We illustrate this by deriving the phase dynamics of two seminal neural mass models: the Wilson-Cowan firing rate model and the voltage-based Freeman model. We established that the phase dynamics of these models differed qualitatively due to an attractive coupling in the first and a repulsive coupling in the latter. Using empirical structural connectivity matrices, we determined that the two dynamics cover the functional connectivity observed in resting state activity. We further searched for two pivotal dynamical features that have been reported in many experimental studies: (1) a partial phase synchrony with a possibility of a transition towards either a desynchronized or a (fully) synchronized state; (2) long-term autocorrelations indicative of a scale-free temporal dynamics of phase synchronization. Only the Freeman phase model exhibited scale-free behavior. Its repulsive coupling, however, let the individual phases disperse and did not allow for a transition into a synchronized state. The Wilson-Cowan phase model, by contrast, could switch into a (partially) synchronized state, but it did not generate long-term correlations although being located close to the onset of synchronization, i.e. in its critical regime. That is, the phase-reduced models can display one of the two dynamical features, but not both.

Synaptic E-I Balance Underlies Efficient Neural Coding

Both theoretical and experimental evidence indicate that synaptic excitation and inhibition in the cerebral cortex are well-balanced during the resting state and sensory processing. Here, we briefly summarize the evidence for how neural circuits are adjusted to achieve this balance. Then, we discuss how such excitatory and inhibitory balance shapes stimulus representation and information propagation, two basic functions of neural coding. We also point out the benefit of adopting such a balance during neural coding. We conclude that excitatory and inhibitory balance may be a fundamental mechanism underlying efficient coding.

Catecholamines alter the intrinsic variability of cortical population activity and perception

The ascending modulatory systems of the brain stem are powerful regulators of global brain state. Disturbances of these systems are implicated in several major neuropsychiatric disorders. Yet, how these systems interact with specific neural computations in the cerebral cortex to shape perception, cognition, and behavior remains poorly understood. Here, we probed into the effect of two such systems, the catecholaminergic (dopaminergic and noradrenergic) and cholinergic systems, on an important aspect of cortical computation: its intrinsic variability. To this end, we combined placebo-controlled pharmacological intervention in humans, recordings of cortical population activity using magnetoencephalography (MEG), and psychophysical measurements of the perception of ambiguous visual input. A low-dose catecholaminergic, but not cholinergic, manipulation altered the rate of spontaneous perceptual fluctuations as well as the temporal structure of "scale-free" population activity of large swaths of the visual and parietal cortices. Computational analyses indicate that both effects were consistent with an increase in excitatory relative to inhibitory activity in the cortical areas underlying visual perceptual inference. We propose that catecholamines regulate the variability of perception and cognition through dynamically changing the cortical excitation-inhibition ratio. The combined readout of fluctuations in perception and cortical activity we established here may prove useful as an efficient and easily accessible marker of altered cortical computation in neuropsychiatric disorders.

Connectome-harmonic decomposition of human brain activity reveals dynamical repertoire re-organization under LSD

Recent studies have started to elucidate the effects of lysergic acid diethylamide (LSD) on the human brain but the underlying dynamics are not yet fully understood. Here we used 'connectome-harmonic decomposition', a novel method to investigate the dynamical changes in brain states. We found that LSD alters the energy and the power of individual harmonic brain states in a frequency-selective manner. Remarkably, this leads to an expansion of the repertoire of active brain states, suggestive of a general re-organization of brain dynamics given the non-random increase in co-activation across frequencies. Interestingly, the frequency distribution of the active repertoire of brain states under LSD closely follows power-laws indicating a re-organization of the dynamics at the edge of criticality. Beyond the present findings, these methods open up for a better understanding of the complex brain dynamics in health and disease.

A model of individualized canonical microcircuits supporting cognitive operations

Major cognitive functions such as language, memory, and decision-making are thought to rely on distributed networks of a large number of basic elements, called canonical microcircuits. In this theoretical study we propose a novel canonical microcircuit model and find that it supports two basic computational operations: a gating mechanism and working memory. By means of bifurcation analysis we systematically investigate the dynamical behavior of the canonical microcircuit with respect to parameters that govern the local network balance, that is, the relationship between excitation and inhibition, and key intrinsic feedback architectures of canonical microcircuits. We relate the local behavior of the canonical microcircuit to cognitive processing and demonstrate how a network of interacting canonical microcircuits enables the establishment of spatiotemporal sequences in the context of syntax parsing during sentence comprehension. This study provides a framework for using individualized canonical microcircuits for the construction of biologically realistic networks supporting cognitive operations.

Comparative approximations of criticality in a neural and quantum regime

Under a variety of conditions, stochastic and non-linear systems with many degrees of freedom tend to evolve towards complexity and criticality. Over the last decades, a steady proliferation of models re: far-from-equilibrium thermodynamics of metastable, many-valued systems arose, serving as attributes of a 'critical' attractor landscape. Building off recent data citing trademark aspects of criticality in the brain-including: power-laws, scale-free (1/f) behavior (scale invariance, or scale independence), critical slowing, and avalanches-it has been conjectured that operating at criticality entails functional advantages such as: optimized neural computation and information processing; boosted memory; large dynamical ranges; long-range communication; and an increased ability to react to highly diverse stimuli. In short, critical dynamics provide a necessary condition for neurobiologically significant elements of brain dynamics. Theoretical predictions have been verified in specific models such as Boolean networks, liquid state machines, and neural networks. These findings inspired the neural criticality hypothesis, proposing that the brain operates in a critical state because the associated optimal computational capabilities provide an evolutionarily advantage. This paper develops in three parts: after developing the critical landscape, we will then shift gears to rediscover another inroad to criticality via stochastic quantum field theory and dissipative dynamics. The existence of these two approaches deserves some consideration, given both neural and quantum criticality hypotheses propose specific mechanisms that leverage the same phenomena. This suggests that understanding the quantum approach could help to shed light on brain-based modeling. In the third part, we will turn to Whitehead's actual entities and modes of perception in order to demonstrate a concomitant logic underwriting both models. In the discussion, I briefly motivate a reading of criticality and its properties as responsive to the characterization of tenets from Eastern wisdom traditions.

Network Neuroscience Theory of Human Intelligence

An enduring aim of research in the psychological and brain sciences is to understand the nature of individual differences in human intelligence, examining the stunning breadth and diversity of intellectual abilities and the remarkable neurobiological mechanisms from which they arise. This Opinion article surveys recent neuroscience evidence to elucidate how general intelligence, g, emerges from individual differences in the network architecture of the human brain. The reviewed findings motivate new insights about how network topology and dynamics account for individual differences in g, represented by the Network Neuroscience Theory. According to this framework, g emerges from the small-world topology of brain networks and the dynamic reorganization of its community structure in the service of system-wide flexibility and adaptation.

Coexistence of critical sensitivity and subcritical specificity can yield optimal population coding

The vicinity of phase transitions selectively amplifies weak stimuli, yielding optimal sensitivity to distinguish external input. Along with this enhanced sensitivity, enhanced levels of fluctuations at criticality reduce the specificity of the response. Given that the specificity of the response is largely compromised when the sensitivity is maximal, the overall benefit of criticality for signal processing remains questionable. Here, it is shown that this impasse can be solved by heterogeneous systems incorporating functional diversity, in which critical and subcritical components coexist. The subnetwork of critical elements has optimal sensitivity, and the subnetwork of subcritical elements has enhanced specificity. Combining segregated features extracted from the different subgroups, the resulting collective response can maximize the trade-off between sensitivity and specificity measured by the dynamic-range-to-noise ratio. Although numerous benefits can be observed when the entire system is critical, our results highlight that optimal performance is obtained when only a small subset of the system is at criticality.

Statistical complexity is maximized in a small-world brain

In this paper, we study a network of Izhikevich neurons to explore what it means for a brain to be at the edge of chaos. To do so, we first constructed the phase diagram of a single Izhikevich excitatory neuron, and identified a small region of the parameter space where we find a large number of phase boundaries to serve as our edge of chaos. We then couple the outputs of these neurons directly to the parameters of other neurons, so that the neuron dynamics can drive transitions from one phase to another on an artificial energy landscape. Finally, we measure the statistical complexity of the parameter time series, while the network is tuned from a regular network to a random network using the Watts-Strogatz rewiring algorithm. We find that the statistical complexity of the parameter dynamics is maximized when the neuron network is most small-world-like. Our results suggest that the small-world architecture of neuron connections in brains is not accidental, but may be related to the information processing that they do.

Energy-efficient neural information processing in individual neurons and neuronal networks

Brains are composed of networks of an enormous number of neurons interconnected with synapses. Neural information is carried by the electrical signals within neurons and the chemical signals among neurons. Generating these electrical and chemical signals is metabolically expensive. The fundamental issue raised here is whether brains have evolved efficient ways of developing an energy-efficient neural code from the molecular level to the circuit level. Here, we summarize the factors and biophysical mechanisms that could contribute to the energy-efficient neural code for processing input signals. The factors range from ion channel kinetics, body temperature, axonal propagation of action potentials, low-probability release of synaptic neurotransmitters, optimal input and noise, the size of neurons and neuronal clusters, excitation/inhibition balance, coding strategy, cortical wiring, and the organization of functional connectivity. Both experimental and computational evidence suggests that neural systems may use these factors to maximize the efficiency of energy consumption in processing neural signals. Studies indicate that efficient energy utilization may be universal in neuronal systems as an evolutionary consequence of the pressure of limited energy. As a result, neuronal connections may be wired in a highly economical manner to lower energy costs and space. Individual neurons within a network may encode independent stimulus components to allow a minimal number of neurons to represent whole stimulus characteristics efficiently. This basic principle may fundamentally change our view of how billions of neurons organize themselves into complex circuits to operate and generate the most powerful intelligent cognition in nature. © 2017 Wiley Periodicals, Inc.

Refractory period in network models of excitable nodes: self-sustaining stable dynamics, extended scaling region and oscillatory behavior

Networks of excitable nodes have recently attracted much attention particularly in regards to neuronal dynamics, where criticality has been argued to be a fundamental property. Refractory behavior, which limits the excitability of neurons is thought to be an important dynamical property. We therefore consider a simple model of excitable nodes which is known to exhibit a transition to instability at a critical point (λ = 1), and introduce refractory period into its dynamics. We use mean-field analytical calculations as well as numerical simulations to calculate the activity dependent branching ratio that is useful to characterize the behavior of critical systems. We also define avalanches and calculate probability distribution of their size and duration. We find that in the presence of refractory period the dynamics stabilizes while various parameter regimes become accessible. A sub-critical regime with λ < 1.0, a standard critical behavior with exponents close to critical branching process for λ = 1, a regime with 1 < λ < 2 that exhibits an interesting scaling behavior, and an oscillating regime with λ > 2.0. We have therefore shown that refractory behavior leads to a wide range of scaling as well as periodic behavior which are relevant to real neuronal dynamics.

Clinical Concepts Emerging from fMRI Functional Connectomics

Recent advances in connectomics have led to a synthesis of perspectives regarding the brain's functional organization that reconciles classical concepts of localized specialization with an appreciation for properties that emerge from interactions across distributed functional networks. This provides a more comprehensive framework for understanding neural mechanisms of normal cognition and disease. Although fMRI has not become a routine clinical tool, research has already had important influences on clinical concepts guiding diagnosis and patient management. Here we review illustrative examples. Studies demonstrating the network plasticity possible in adults and the global consequences of even focal brain injuries or disease both have had substantial impact on modern concepts of disease evolution and expression. Applications of functional connectomics in studies of clinical populations are challenging traditional disease classifications and helping to clarify biological relationships between clinical syndromes (and thus also ways of extending indications for, or "re-purposing," current treatments). Large datasets from prospective, longitudinal studies promise to enable the discovery and validation of functional connectomic biomarkers with the potential to identify people at high risk of disease before clinical onset, at a time when treatments may be most effective. Studies of pain and consciousness have catalyzed reconsiderations of approaches to clinical management, but also have stimulated debate about the clinical meaningfulness of differences in internal perceptual or cognitive states inferred from functional connectomics or other physiological correlates. By way of a closing summary, we offer a personal view of immediate challenges and potential opportunities for clinically relevant applications of fMRI-based functional connectomics.

Understanding principles of integration and segregation using whole-brain computational connectomics: implications for neuropsychiatric disorders

To survive in an ever-changing environment, the brain must seamlessly integrate a rich stream of incoming information into coherent internal representations that can then be used to efficiently plan for action. The brain must, however, balance its ability to integrate information from various sources with a complementary capacity to segregate information into modules which perform specialized computations in local circuits. Importantly, evidence suggests that imbalances in the brain's ability to bind together and/or segregate information over both space and time is a common feature of several neuropsychiatric disorders. Most studies have, however, until recently strictly attempted to characterize the principles of integration and segregation in static (i.e. time-invariant) representations of human brain networks, hence disregarding the complex spatio-temporal nature of these processes. In the present Review, we describe how the emerging discipline of whole-brain computational connectomics may be used to study the causal mechanisms of the integration and segregation of information on behaviourally relevant timescales. We emphasize how novel methods from network science and whole-brain computational modelling can expand beyond traditional neuroimaging paradigms and help to uncover the neurobiological determinants of the abnormal integration and segregation of information in neuropsychiatric disorders.This article is part of the themed issue 'Mathematical methods in medicine: neuroscience, cardiology and pathology'.

Critical dynamics of endogenous fluctuations predict cognitive flexibility in the Go/NoGo task

Fluctuations with power-law scaling and long-range temporal correlations (LRTCs) are characteristic to human psychophysical performance. Systems operating in a critical state exhibit such LRTCs, but phenomenologically similar fluctuations and LRTCs may also be caused by slow decay of the system’s memory without the system being critical. Theoretically, criticality endows the system with the greatest representational capacity and flexibility in state transitions. Without criticality, however, slowly decaying system memory would predict inflexibility. We addressed these contrasting predictions of the ‘criticality’ and ‘long-memory’ candidate mechanisms of human behavioral LRTCs by using a Go/NoGo task wherein the commission errors constitute a measure of cognitive flexibility. Response time (RT) fluctuations in this task exhibited power-law frequency scaling, autocorrelations, and LRTCs. We show here that the LRTC scaling exponents, quantifying the strength of long-range correlations, were negatively correlated with the commission error rates. Strong LRTCs hence parallel optimal cognitive flexibility and, in line with the criticality hypothesis, indicate a functionally advantageous state. This conclusion was corroborated by a positive correlation between the LRTC scaling exponents and executive functions measured with the Rey-Osterrieth Complex Figure test. Our results hence support the notion that LRTCs arise from critical dynamics that is functionally significant for human cognitive performance.

A distribution model of functional connectome based on criticality and energy constraints

The analysis of the network structure of the functional connectivity data constructed from fMRI images provides basic information about functions and features of the brain activity. We focus on the two features which are considered as relevant to the brain activity, the criticality and the constraint regarding energy consumptions. Within a wide variety of complex systems, the critical state occurs associated with a phase transition between distinct phases, random one and order one. Although the hypothesis that human brain activity is also in a state of criticality is supported by some experimental results, it still remains controversial. One issue is that experimental distributions exhibit deviations from the power law predicted by the criticality. Based on the assumption that constraints on brain from the biological costs cause these deviations, we derive a distribution model. The evaluation using the information criteria indicates an advantage of this model in fitting to experimental data compared to other representative distribution models, the truncated power law and the power law. Our findings also suggest that the mechanism underlying this model is closely related to the cost effective behavior in human brain with maximizing the network efficiency for the given network cost.

Long-range temporal correlations in neural narrowband time-series arise due to critical dynamics

We show theoretically that the hypothesis of criticality as a theory of long-range fluctuation in the human brain may be distinguished from the theory of passive filtering on the basis of macroscopic neuronal signals such as the electroencephalogram, using novel theory of narrowband amplitude time-series at criticality. Our theory predicts the division of critical activity into meta-universality classes. As a consequence our analysis shows that experimental electroencephalography data favours the hypothesis of criticality in the human brain.

The role of driver nodes in managing epileptic seizures: Application of Kuramoto model

Synchronization is an important global phenomenon which could be found in a wide range of complex systems such as brain or electronic devices. However, in some circumstances the synchronized states are not desirable for the system and should be suppressed. For example, excessively synchronized activities in the brain network could be the root of neuronal disorders like epileptic seizures. According to the controllability theory of the complex networks, a minimum set of driver nodes has the ability to control the entire system. In this study, we examine the role of driver nodes in suppressing the excessive synchronization in a generalized Kuramoto model, which consists of two types of oscillators: contrarian and regular ones. We used two different structural topologies: Barabási-Albert scale-free (BASF) network and Caenorhabditis elegans (C.elegans) neuronal network. Our results show that contrarian driver nodes have the sufficient ability to break the synchronized level of the systems. In this case, the system coherency level is not fully suppressed that is avoiding dysfunctions of normal brain functions which require the neuronal synchronized activities. Moreover, in this case, the oscillators grouped in two distinct synchronized clusters that could be an indication of chaotic behavior of the system known as resting-state activity of the brain.

Scale Invariance in Lateral Head Scans During Spatial Exploration

Universality connects various natural phenomena through physical principles governing their dynamics, and has provided broadly accepted answers to many complex questions, including information processing in neuronal systems. However, its significance in behavioral systems is still elusive. Lateral head scanning (LHS) behavior in rodents might contribute to spatial navigation by actively managing (optimizing) the available sensory information. Our findings of scale invariant distributions in LHS lifetimes, interevent intervals and event magnitudes, provide evidence for the first time that the optimization takes place at a critical point in LHS dynamics. We propose that the LHS behavior is responsible for preprocessing of the spatial information content, critical for subsequent foolproof encoding by the respective downstream neural networks.

Avalanche and edge-of-chaos criticality do not necessarily co-occur in neural networks

There are indications that for optimizing neural computation, neural networks may operate at criticality. Previous approaches have used distinct fingerprints of criticality, leaving open the question whether the different notions would necessarily reflect different aspects of one and the same instance of criticality, or whether they could potentially refer to distinct instances of criticality. In this work, we choose avalanche criticality and edge-of-chaos criticality and demonstrate for a recurrent spiking neural network that avalanche criticality does not necessarily entrain dynamical edge-of-chaos criticality. This suggests that the different fingerprints may pertain to distinct phenomena.

Cinematic Operation of the Cerebral Cortex Interpreted via Critical Transitions in Self-Organized Dynamic Systems

Measurements of local field potentials over the cortical surface and the scalp of animals and human subjects reveal intermittent bursts of beta and gamma oscillations. During the bursts, narrow-band metastable amplitude modulation (AM) patters emerge for a fraction of a second and ultimately dissolve to the broad-band random background activity. The burst process depends on previously learnt conditioned stimuli (CS), thus different AM patterns may emerge in response to different CS. This observation leads to our cinematic theory of cognition when perception happens in discrete steps manifested in the sequence of AM patterns. Our article summarizes findings in the past decades on experimental evidence of cinematic theory of cognition and relevant mathematical models. We treat cortices as dissipative systems that self-organize themselves near a critical level of activity that is a non-equilibrium metastable state. Criticality is arguably a key aspect of brains in their rapid adaptation, reconfiguration, high storage capacity, and sensitive response to external stimuli. Self-organized criticality (SOC) became an important concept to describe neural systems. We argue that transitions from one AM pattern to the other require the concept of phase transitions, extending beyond the dynamics described by SOC. We employ random graph theory (RGT) and percolation dynamics as fundamental mathematical approaches to model fluctuations in the cortical tissue. Our results indicate that perceptions are formed through a phase transition from a disorganized (high entropy) to a well-organized (low entropy) state, which explains the swiftness of the emergence of the perceptual experience in response to learned stimuli.

Griffiths phase on hierarchical modular networks with small-world edges

The Griffiths phase has been proposed to induce a stretched critical regime that facilitates self-organizing of brain networks for optimal function. This phase stems from the intrinsic structural heterogeneity of brain networks, i.e., the hierarchical modular structure. In this work, the Griffiths phase is studied in modified hierarchical networks with small-world connections based on the 3-regular Hanoi network. Through extensive simulations, the hierarchical level-dependent inter-module wiring probabilities are identified to determine the emergence of the Griffiths phase. Numerical results and the complementary spectral analysis of the relevant networks can be helpful for a deeper understanding of the essential structural characteristics of finite-dimensional networks to support the Griffiths phase.

An in Silico, Biomarker-Based Method for the Evaluation of Virtual Neuropsychiatric Drug Effects

The recent explosion in neuroscience research has markedly increased our understanding of the neurobiological correlates of many psychiatric illnesses, but this has unfortunately not translated into more effective pharmacologic treatments for these conditions. At the same time, researchers have increasingly sought out biological markers, or biomarkers, as a way to categorize psychiatric illness, as these are felt to be closer to underlying genetic and neurobiological vulnerabilities. While biomarker-based drug discovery approaches have tended to employ in vivo (e.g., rodent) or in vitro test systems, relatively little attention has been paid to the potential of computational, or in silico, methodologies. Here we describe such a methodology, using as an example a biophysically detailed computational model of hippocampus that is made to generate putative schizophrenia biomarkers by the inclusion of a number of neuropathological changes that have been associated with the illness (NMDA system deficit, decreased neural connectivity, hyperdopaminergia). We use the specific inability to attune to gamma band (40 Hz) auditory stimulus as our illness biomarker. We expose this system to a large number of virtual medications, defined by systematic variation of model parameters corresponding to five cellular-level effects. The potential efficacy of virtual medications is determined by a wellness metric (WM) that we have developed. We identify a number of virtual agents that consist of combinations of mechanisms, which are not simply reversals of the causative lesions. The manner in which this methodology could be extended to other neuropsychiatric conditions, such as Alzheimer's disease, autism, and fragile X syndrome, is discussed.

Power-law statistics and universal scaling in the absence of criticality

Critical states are sometimes identified experimentally through power-law statistics or universal scaling functions. We show here that such features naturally emerge from networks in self-sustained irregular regimes away from criticality. In these regimes, statistical physics theory of large interacting systems predict a regime where the nodes have independent and identically distributed dynamics. We thus investigated the statistics of a system in which units are replaced by independent stochastic surrogates and found the same power-law statistics, indicating that these are not sufficient to establish criticality. We rather suggest that these are universal features of large-scale networks when considered macroscopically. These results put caution on the interpretation of scaling laws found in nature.

Neuronal Correlation Parameter and the Idea of Thermodynamic Entropy of an N-Body Gravitationally Bounded System

Understanding how the brain encodes information and performs computation requires statistical and functional analysis. Given the complexity of the human brain, simple methods that facilitate the interpretation of statistical correlations among different brain regions can be very useful. In this report we introduce a numerical correlation measure that may serve the interpretation of correlational neuronal data, and may assist in the evaluation of different brain states. The description of the dynamical brain system, through a global numerical measure may indicate the presence of an action principle which may facilitate a application of physics principles in the study of the human brain and cognition.

Phase transitions and self-organized criticality in networks of stochastic spiking neurons

Phase transitions and critical behavior are crucial issues both in theoretical and experimental neuroscience. We report analytic and computational results about phase transitions and self-organized criticality (SOC) in networks with general stochastic neurons. The stochastic neuron has a firing probability given by a smooth monotonic function Φ(V) of the membrane potential V, rather than a sharp firing threshold. We find that such networks can operate in several dynamic regimes (phases) depending on the average synaptic weight and the shape of the firing function Φ. In particular, we encounter both continuous and discontinuous phase transitions to absorbing states. At the continuous transition critical boundary, neuronal avalanches occur whose distributions of size and duration are given by power laws, as observed in biological neural networks. We also propose and test a new mechanism to produce SOC: the use of dynamic neuronal gains - a form of short-term plasticity probably located at the axon initial segment (AIS) - instead of depressing synapses at the dendrites (as previously studied in the literature). The new self-organization mechanism produces a slightly supercritical state, that we called SOSC, in accord to some intuitions of Alan Turing.

The Parkinsonian Subthalamic Network: Measures of Power, Linear, and Non-linear Synchronization and their Relationship to L-DOPA Treatment and OFF State Motor Severity

In this paper we investigated the dopaminergic modulation of neuronal interactions occurring in the subthalamic nucleus (STN) during Parkinson's disease (PD). We utilized linear measures of local and long range synchrony such as power and coherence, as well as Detrended Fluctuation Analysis for Phase Synchrony (DFA-PS)- a recently developed non-linear method that computes the extent of long tailed autocorrelations present in the phase interactions between two coupled signals. Through analysis of local field potentials (LFPs) taken from the STN we seek to determine changes in the neurodynamics that may underpin the pathophysiology of PD in a group of 12 patients who had undergone surgery for deep brain stimulation. We demonstrate up modulation of alpha-theta (5-12 Hz) band power in response to L-DOPA treatment, whilst low beta band power (15-20 Hz) band-power is suppressed. We also find evidence for significant local connectivity within the region surrounding STN although there was evidence for its modulation via administration of L-DOPA. Further to this we present evidence for a positive correlation between the phase ordering of bilateral STN interactions and the severity of bradykinetic and rigidity symptoms in PD. Although, the ability of non-linear measures to predict clinical state did not exceed standard measures such as beta power, these measures may help identify the connections which play a role in pathological dynamics.

Criticality Maximizes Complexity in Neural Tissue

The analysis of neural systems leverages tools from many different fields. Drawing on techniques from the study of critical phenomena in statistical mechanics, several studies have reported signatures of criticality in neural systems, including power-law distributions, shape collapses, and optimized quantities under tuning. Independently, neural complexity-an information theoretic measure-has been introduced in an effort to quantify the strength of correlations across multiple scales in a neural system. This measure represents an important tool in complex systems research because it allows for the quantification of the complexity of a neural system. In this analysis, we studied the relationships between neural complexity and criticality in neural culture data. We analyzed neural avalanches in 435 recordings from dissociated hippocampal cultures produced from rats, as well as neural avalanches from a cortical branching model. We utilized recently developed maximum likelihood estimation power-law fitting methods that account for doubly truncated power-laws, an automated shape collapse algorithm, and neural complexity and branching ratio calculation methods that account for sub-sampling, all of which are implemented in the freely available Neural Complexity and Criticality MATLAB toolbox. We found evidence that neural systems operate at or near a critical point and that neural complexity is optimized in these neural systems at or near the critical point. Surprisingly, we found evidence that complexity in neural systems is dependent upon avalanche profiles and neuron firing rate, but not precise spiking relationships between neurons. In order to facilitate future research, we made all of the culture data utilized in this analysis freely available online.

Charting moment-to-moment brain signal variability from early to late childhood

Large-scale brain signals exhibit rich intermittent patterning, reflecting the fact that the cortex actively eschews fixed points in favor of itinerant wandering with frequent state transitions. Fluctuations in endogenous cortical activity occur at multiple time scales and index a dynamic repertoire of network states that are continuously explored, even in the absence of external sensory inputs. Here, we quantified such moment-to-moment brain signal variability at rest in a large, cross-sectional sample of children ranging in age from seven to eleven years. Our findings revealed a monotonic rise in the complexity of electroencephalogram (EEG) signals as measured by sample entropy, from the youngest to the oldest age cohort, across a range of time scales and spatial regions. From year to year, the greatest changes in intraindividual brain signal variability were recorded at electrodes covering the anterior cortical zones. These results provide converging evidence concerning the age-dependent expansion of functional cortical network states during a critical developmental period ranging from early to late childhood.

Do Cortical Circuits Need Protecting from Themselves?

All hippocampal and neocortical networks can be driven to seize quite easily. This can be done using drugs, by altering the ionic constituency of the bathing medium [cerebrospinal fluid (CSF)], or by electrical stimulation (both experimentally and clinically, as in electroconvulsive therapy). It is worth asking why this is so, because this will both tell us more about potentially devastating neurological disorders and extend our understanding of cortical function and architecture. Here I review work examining the features of cortical networks that bias activity towards and away from hyperexcitability. I suggest that several cellular- and circuit-level features of rapidly responsive interneuron networks tip the balance away from seizure in the healthy brain.

Analysis of Power Laws, Shape Collapses, and Neural Complexity: New Techniques and MATLAB Support via the NCC Toolbox

Neural systems include interactions that occur across many scales. Two divergent methods for characterizing such interactions have drawn on the physical analysis of critical phenomena and the mathematical study of information. Inferring criticality in neural systems has traditionally rested on fitting power laws to the property distributions of "neural avalanches" (contiguous bursts of activity), but the fractal nature of avalanche shapes has recently emerged as another signature of criticality. On the other hand, neural complexity, an information theoretic measure, has been used to capture the interplay between the functional localization of brain regions and their integration for higher cognitive functions. Unfortunately, treatments of all three methods-power-law fitting, avalanche shape collapse, and neural complexity-have suffered from shortcomings. Empirical data often contain biases that introduce deviations from true power law in the tail and head of the distribution, but deviations in the tail have often been unconsidered; avalanche shape collapse has required manual parameter tuning; and the estimation of neural complexity has relied on small data sets or statistical assumptions for the sake of computational efficiency. In this paper we present technical advancements in the analysis of criticality and complexity in neural systems. We use maximum-likelihood estimation to automatically fit power laws with left and right cutoffs, present the first automated shape collapse algorithm, and describe new techniques to account for large numbers of neural variables and small data sets in the calculation of neural complexity. In order to facilitate future research in criticality and complexity, we have made the software utilized in this analysis freely available online in the MATLAB NCC (Neural Complexity and Criticality) Toolbox.

Self-transcending meditation is good for mental health: why this should be the case

A simple theory of health has recently been proposed: while poor quality regulation corresponds to poor quality health so that improving regulation should improve health, optimal regulation optimizes function and optimizes health. Examining the term 'optimal regulation' in biological systems leads to a straightforward definition in terms of 'criticality' in complexity biology, a concept that seems to apply universally throughout biology. Criticality maximizes information processing and sensitivity of response to external stimuli, and for these reasons may be held to optimize regulation. In this way a definition of health has been given in terms of regulation, a scientific concept, which ties into detailed properties of complex systems, including brain cortices, and mental health. Models of experience and meditation built on complexity also point to criticality: it represents the condition making self-awareness possible, and is strengthened by meditation practices leading to the state of pure consciousness-the content-free state of mind in deep meditation. From this it follows that healthy function of the brain cortex, its sensitivity,y and consistency of response to external challenges should improve by practicing techniques leading to content-free awareness-transcending the original focus introduced during practice. Evidence for this is reviewed.

Dynamical systems, attractors, and neural circuits

Biology is the study of dynamical systems. Yet most of us working in biology have limited pedagogical training in the theory of dynamical systems, an unfortunate historical fact that can be remedied for future generations of life scientists. In my particular field of systems neuroscience, neural circuits are rife with nonlinearities at all levels of description, rendering simple methodologies and our own intuition unreliable. Therefore, our ideas are likely to be wrong unless informed by good models. These models should be based on the mathematical theories of dynamical systems since functioning neurons are dynamic—they change their membrane potential and firing rates with time. Thus, selecting the appropriate type of dynamical system upon which to base a model is an important first step in the modeling process. This step all too easily goes awry, in part because there are many frameworks to choose from, in part because the sparsely sampled data can be consistent with a variety of dynamical processes, and in part because each modeler has a preferred modeling approach that is difficult to move away from. This brief review summarizes some of the main dynamical paradigms that can arise in neural circuits, with comments on what they can achieve computationally and what signatures might reveal their presence within empirical data. I provide examples of different dynamical systems using simple circuits of two or three cells, emphasizing that any one connectivity pattern is compatible with multiple, diverse functions.