The criticality hypothesis: how local cortical networks might optimize information processing

Subsampled Directed-Percolation Models Explain Scaling Relations Experimentally Observed in the Brain

Recent experimental results on spike avalanches measured in the urethane-anesthetized rat cortex have revealed scaling relations that indicate a phase transition at a specific level of cortical firing rate variability. The scaling relations point to critical exponents whose values differ from those of a branching process, which has been the canonical model employed to understand brain criticality. This suggested that a different model, with a different phase transition, might be required to explain the data. Here we show that this is not necessarily the case. By employing two different models belonging to the same universality class as the branching process (mean-field directed percolation) and treating the simulation data exactly like experimental data, we reproduce most of the experimental results. We find that subsampling the model and adjusting the time bin used to define avalanches (as done with experimental data) are sufficient ingredients to change the apparent exponents of the critical point. Moreover, experimental data is only reproduced within a very narrow range in parameter space around the phase transition.

Spike-phase coupling as an order parameter in a leaky integrate-and-fire model

It is known that the leaky integrate-and-fire neural model shows a transition from irregular to synchronous firing by increasing the coupling between the neurons. However, a quantitative characterization of this order-disorder transition, that is, the determination of the order of transition and also the critical exponents in the case of continuous transition, is not entirely known. In this work, we consider a network of N excitatory neurons with local connections, residing on a square lattice with periodic boundary conditions. The cooperation between neurons K plays the role of the control parameter that generates criticality when the critical cooperation strength K_{c} is adopted. We introduce the population-averaged voltage (PAV) as a representative value of the network's cooperative activity. Then, we show that the coupling between the timing of spikes and the phase of temporal fluctuations of PAV defined as m resorts to identify a Kuramoto order parameter. By increasing K, we find a continuous transition from irregular spiking to a phase-locked state at the critical point K_{c}. We deploy the finite-size scaling analysis to calculate the critical exponents of this transition. To explore the formal indicator of criticality, we study the neuronal avalanches profile at this critical point and find a scaling behavior with the exponents in a fair agreement with the experimental values both in vivo and in vitro.

Inferring a network from dynamical signals at its nodes

We give an approximate solution to the difficult inverse problem of inferring the topology of an unknown network from given time-dependent signals at the nodes. For example, we measure signals from individual neurons in the brain, and infer how they are inter-connected. We use Maximum Caliber as an inference principle. The combinatorial challenge of high-dimensional data is handled using two different approximations to the pairwise couplings. We show two proofs of principle: in a nonlinear genetic toggle switch circuit, and in a toy neural network.

Stability and memory-loss go hand-in-hand: three results in dynamics and computation

The search for universal laws that help establish a relationship between dynamics and computation is driven by recent expansionist initiatives in biologically inspired computing. A general setting to understand both such dynamics and computation is a driven dynamical system that responds to a temporal input. Surprisingly, we find memory-loss a feature of driven systems to forget their internal states helps provide unambiguous answers to the following fundamental stability questions that have been unanswered for decades: what is necessary and sufficient so that slightly different inputs still lead to mostly similar responses? How does changing the driven system’s parameters affect stability? What is the mathematical definition of the edge-of-criticality? We anticipate our results to be timely in understanding and designing biologically inspired computers that are entering an era of dedicated hardware implementations for neuromorphic computing and state-of-the-art reservoir computing applications.

Stability of motor cortex network states during learning-associated neural reorganizations

A substantial reorganization of neural activity and neuron-to-movement relationship in motor cortical circuits accompanies the emergence of reproducible movement patterns during motor learning. Little is known about how this tempest of neural activity restructuring impacts the stability of network states in recurrent cortical circuits. To investigate this issue, we reanalyzed data in which we recorded for 14 days via population calcium imaging the activity of the same neural populations of pyramidal neurons in layer 2/3 and layer 5 of forelimb motor and premotor cortex in mice during the daily learning of a lever-press task. We found that motor cortex network states remained stable with respect to the critical network state during the extensive reorganization of both neural population activity and its relation to lever movement throughout learning. Specifically, layer 2/3 cortical circuits unceasingly displayed robust evidence for operating at the critical network state, a regime that maximizes information capacity and transmission and provides a balance between network robustness and flexibility. In contrast, layer 5 circuits operated away from the critical network state for all 14 days of recording and learning. In conclusion, this result indicates that the wide-ranging malleability of synapses, neurons, and neural connectivity during learning operates within the constraint of a stable and layer-specific network state regarding dynamic criticality, and suggests that different cortical layers operate under distinct constraints because of their specialized goals.NEW & NOTEWORTHY The neural activity reorganizes throughout motor learning, but how this reorganization impacts the stability of network states is unclear. We used two-photon calcium imaging to investigate how the network states in layer 2/3 and layer 5 of forelimb motor and premotor cortex are modulated by motor learning. We show that motor cortex network states are layer-specific and constant regarding criticality during neural activity reorganization, and suggests that layer-specific constraints could be motivated by different functions.

Multi-scale analysis and modelling of collective migration in biological systems

Collective migration has become a paradigm for emergent behaviour in systems of moving and interacting individual units resulting in coherent motion. In biology, these units are cells or organisms. Collective cell migration is important in embryonic development, where it underlies tissue and organ formation, as well as pathological processes, such as cancer invasion and metastasis. In animal groups, collective movements may enhance individuals' decisions and facilitate navigation through complex environments and access to food resources. Mathematical models can extract unifying principles behind the diverse manifestations of collective migration. In biology, with a few exceptions, collective migration typically occurs at a 'mesoscopic scale' where the number of units ranges from only a few dozen to a few thousands, in contrast to the large systems treated by statistical mechanics. Recent developments in multi-scale analysis have allowed linkage of mesoscopic to micro- and macroscopic scales, and for different biological systems. The articles in this theme issue on 'Multi-scale analysis and modelling of collective migration' compile a range of mathematical modelling ideas and multi-scale methods for the analysis of collective migration. These approaches (i) uncover new unifying organization principles of collective behaviour, (ii) shed light on the transition from single to collective migration, and (iii) allow us to define similarities and differences of collective behaviour in groups of cells and organisms. As a common theme, self-organized collective migration is the result of ecological and evolutionary constraints both at the cell and organismic levels. Thereby, the rules governing physiological collective behaviours also underlie pathological processes, albeit with different upstream inputs and consequences for the group. This article is part of the theme issue 'Multi-scale analysis and modelling of collective migration in biological systems'.

C. elegans episodic swimming is driven by multifractal kinetics

Fractal scaling is a common property of temporal change in various modes of animal behavior. The molecular mechanisms of fractal scaling in animal behaviors remain largely unexplored. The nematode C. elegans alternates between swimming and resting states in a liquid solution. Here, we report that C. elegans episodic swimming is characterized by scale-free kinetics with long-range temporal correlation and local temporal clusterization, namely consistent with multifractal kinetics. Residence times in actively-moving and inactive states were distributed in a power law-based scale-free manner. Multifractal analysis showed that temporal correlation and temporal clusterization were distinct between the actively-moving state and the inactive state. These results indicate that C. elegans episodic swimming is driven by transition between two behavioral states, in which each of two transition kinetics follows distinct multifractal kinetics. We found that a conserved behavioral modulator, cyclic GMP dependent kinase (PKG) may regulate the multifractal kinetics underlying an animal behavior. Our combinatorial analysis approach involving molecular genetics and kinetics provides a platform for the molecular dissection of the fractal nature of physiological and behavioral phenomena.

Why Brain Criticality Is Clinically Relevant: A Scoping Review

The past 25 years have seen a strong increase in the number of publications related to criticality in different areas of neuroscience. The potential of criticality to explain various brain properties, including optimal information processing, has made it an increasingly exciting area of investigation for neuroscientists. Recent reviews on this topic, sometimes termed brain criticality, make brief mention of clinical applications of these findings to several neurological disorders such as epilepsy, neurodegenerative disease, and neonatal hypoxia. Other clinicallyrelevant domains - including anesthesia, sleep medicine, developmental-behavioral pediatrics, and psychiatry - are seldom discussed in review papers of brain criticality. Thorough assessments of these application areas and their relevance for clinicians have also yet to be published. In this scoping review, studies of brain criticality involving human data of all ages are evaluated for their current and future clinical relevance. To make the results of these studies understandable to a more clinical audience, a review of the key concepts behind criticality (e.g., phase transitions, long-range temporal correlation, self-organized criticality, power laws, branching processes) precedes the discussion of human clinical studies. Open questions and forthcoming areas of investigation are also considered.

Entropy and the Brain: An Overview

Entropy is a powerful tool for quantification of the brain function and its information processing capacity. This is evident in its broad domain of applications that range from functional interactivity between the brain regions to quantification of the state of consciousness. A number of previous reviews summarized the use of entropic measures in neuroscience. However, these studies either focused on the overall use of nonlinear analytical methodologies for quantification of the brain activity or their contents pertained to a particular area of neuroscientific research. The present study aims at complementing these previous reviews in two ways. First, by covering the literature that specifically makes use of entropy for studying the brain function. Second, by highlighting the three fields of research in which the use of entropy has yielded highly promising results: the (altered) state of consciousness, the ageing brain, and the quantification of the brain networks' information processing. In so doing, the present overview identifies that the use of entropic measures for the study of consciousness and its (altered) states led the field to substantially advance the previous findings. Moreover, it realizes that the use of these measures for the study of the ageing brain resulted in significant insights on various ways that the process of ageing may affect the dynamics and information processing capacity of the brain. It further reveals that their utilization for analysis of the brain regional interactivity formed a bridge between the previous two research areas, thereby providing further evidence in support of their results. It concludes by highlighting some potential considerations that may help future research to refine the use of entropic measures for the study of brain complexity and its function. The present study helps realize that (despite their seemingly differing lines of inquiry) the study of consciousness, the ageing brain, and the brain networks' information processing are highly interrelated. Specifically, it identifies that the complexity, as quantified by entropy, is a fundamental property of conscious experience, which also plays a vital role in the brain's capacity for adaptation and therefore whose loss by ageing constitutes a basis for diseases and disorders. Interestingly, these two perspectives neatly come together through the association of entropy and the brain capacity for information processing.

Time-dependent branching processes: a model of oscillating neuronal avalanches

Recently, neuronal avalanches have been observed to display oscillations, a phenomenon regarded as the co-existence of a scale-free behaviour (the avalanches close to criticality) and scale-dependent dynamics (the oscillations). Ordinary continuous-time branching processes with constant extinction and branching rates are commonly used as models of neuronal activity, yet they lack any such time-dependence. In the present work, we extend a basic branching process by allowing the extinction rate to oscillate in time as a new model to describe cortical dynamics. By means of a perturbative field theory, we derive relevant observables in closed form. We support our findings by quantitative comparison to numerics and qualitative comparison to available experimental results.

Fluctuation in Pupil Size and Spontaneous Blinks Reflect Story Transportation

Thirty-nine participants listened to 28 neutral and horror excerpts of Stephen King short stories while constantly tracking their emotional arousal. Pupil size was measured with an Eyelink 1000+, and participants rated valence and transportation after each story. In addition to computing mean pupil size across 1-sec intervals, we extracted blink count and used detrended fluctuation analysis (DFA) to obtain the scaling exponents of long-range temporal correlations (LRTCs) in pupil size time-series. Pupil size was expected to be sensitive also to emotional arousal, whereas blink count and LRTC's were expected to reflect cognitive engagement. The results showed that self-reported arousal increased, pupil size was overall greater, and the decreasing slope of pupil size was flatter for horror than for neutral stories. Horror stories induced higher transportation than neutral stories. High transportation was associated with a steeper increase in self-reported arousal across time, stronger LRTCs in pupil size fluctuations, and lower blink count. These results indicate that pupil size reflects emotional arousal induced by the text content, while LRTCs and blink count are sensitive to cognitive engagement associated with transportation, irrespective of the text type. The study demonstrates the utility of pupillometric measures and blink count to study literature reception.

Cortical electrophysiological evidence for individual-specific temporal organization of brain functional networks

The human brain has been demonstrated to rapidly and continuously form and dissolve networks on a subsecond timescale, offering effective and essential substrates for cognitive processes. Understanding how the dynamic organization of brain functional networks on a subsecond level varies across individuals is, therefore, of great interest for personalized neuroscience. However, it remains unclear whether features of such rapid network organization are reliably unique and stable in single subjects and, therefore, can be used in characterizing individual networks. Here, we used two sets of 5‐min magnetoencephalography (MEG) resting data from 39 healthy subjects over two consecutive days and modeled the spontaneous brain activity as recurring networks fast shifting between each other in a coordinated manner. MEG cortical maps were obtained through source reconstruction using the beamformer method and subjects' temporal structure of recurring networks was obtained via the Hidden Markov Model. Individual organization of dynamic brain activity was quantified with the features of the network‐switching pattern (i.e., transition probability and mean interval time) and the time‐allocation mode (i.e., fractional occupancy and mean lifetime). Using these features, we were able to identify subjects from the group with significant accuracies (~40% on average in 0.5–48 Hz). Notably, the default mode network displayed a distinguishable pattern, being the least frequently visited network with the longest duration for each visit. Together, we provide initial evidence suggesting that the rapid dynamic temporal organization of brain networks achieved in electrophysiology is intrinsic and subject specific.

The Emergence of Integrated Information, Complexity, and 'Consciousness' at Criticality

Integrated Information Theory (IIT) posits that integrated information ( Φ ) represents the quantity of a conscious experience. Here, the generalized Ising model was used to calculate Φ as a function of temperature in toy models of fully connected neural networks. A Monte-Carlo simulation was run on 159 normalized, random, positively weighted networks analogous to small five-node excitatory neural network motifs. Integrated information generated by this sample of small Ising models was measured across model parameter spaces. It was observed that integrated information, as an order parameter, underwent a phase transition at the critical point in the model. This critical point was demarcated by the peak of the generalized susceptibility (or variance in configuration due to temperature) of integrated information. At this critical point, integrated information was maximally receptive and responsive to perturbations of its own states. The results of this study provide evidence that Φ can capture integrated information in an empirical dataset, and display critical behavior acting as an order parameter from the generalized Ising model.

Closer to critical resting-state neural dynamics in individuals with higher fluid intelligence

According to the critical brain hypothesis, the brain is considered to operate near criticality and realize efficient neural computations. Despite the prior theoretical and empirical evidence in favor of the hypothesis, no direct link has been provided between human cognitive performance and the neural criticality. Here we provide such a key link by analyzing resting-state dynamics of functional magnetic resonance imaging (fMRI) networks at a whole-brain level. We develop a data-driven analysis method, inspired from statistical physics theory of spin systems, to map out the whole-brain neural dynamics onto a phase diagram. Using this tool, we show evidence that neural dynamics of human participants with higher fluid intelligence quotient scores are closer to a critical state, i.e., the boundary between the paramagnetic phase and the spin-glass (SG) phase. The present results are consistent with the notion of "edge-of-chaos" neural computation.

Emergence of power laws in noncritical neuronal systems

Experimental and computational studies provide compelling evidence that neuronal systems are characterized by power-law distributions of neuronal avalanche sizes. This fact is interpreted as an indication that these systems are operating near criticality, and, in turn, typical properties of critical dynamical processes, such as optimal information transmission and stability, are attributed to neuronal systems. The purpose of this Rapid Communication is to show that the presence of power-law distributions for the size of neuronal avalanches is not a sufficient condition for the system to operate near criticality. Specifically, we consider a simplistic model of neuronal dynamics on networks and show that the degree distribution of the underlying neuronal network may trigger power-law distributions for neuronal avalanches even when the system is not in its critical regime. To certify and explain our findings we develop an analytical approach based on percolation theory and branching processes techniques.

Principles of Mutual Information Maximization and Energy Minimization Affect the Activation Patterns of Large Scale Networks in the Brain

Successive patterns of activation and deactivation in local areas of the brain indicate the mechanisms of information processing in the brain. It is possible that this process can be optimized by principles, such as the maximization of mutual information and the minimization of energy consumption. In the present paper, I showed evidence for this argument by demonstrating the correlation among mutual information, the energy of the activation, and the activation patterns. Modeling the information processing based on the functional connectome datasets of the human brain, I simulated information transfer in this network structure. Evaluating the statistical quantities of the different network states, I clarified the correlation between them. First, I showed that mutual information and network energy have a close relationship, and that the values are maximized and minimized around a same network state. This implies that there is an optimal network state in the brain that is organized according to the principles regarding mutual information and energy. On the other hand, the evaluation of the network structure revealed that the characteristic network structure known as the criticality also emerges around this state. These results imply that the characteristic features of the functional network are also affected strongly by these principles. To assess the functional aspects of this state, I investigated the output activation patterns in response to random input stimuli. Measuring the redundancy of the responses in terms of the number of overlapping activation patterns, the results indicate that there is a negative correlation between mutual information and the redundancy in the patterns, suggesting that there is a trade-off between communication efficiency and robustness due to redundancy, and the principles of mutual information and network energy are important to network formation and its function in the human brain.

Imaging epilepsy in larval zebrafish

Our understanding of the genetic aetiology of paediatric epilepsies has grown substantially over the last decade. However, in order to translate improved diagnostics to personalised treatments, there is an urgent need to link molecular pathophysiology in epilepsy to whole-brain dynamics in seizures. Zebrafish have emerged as a promising new animal model for epileptic seizure disorders, with particular relevance for genetic and developmental epilepsies. As a novel model organism for epilepsy research they combine key advantages: the small size of larval zebrafish allows high throughput in vivo experiments; the availability of advanced genetic tools allows targeted modification to model specific human genetic disorders (including genetic epilepsies) in a vertebrate system; and optical access to the entire central nervous system has provided the basis for advanced microscopy technologies to image structure and function in the intact larval zebrafish brain. There is a growing body of literature describing and characterising features of epileptic seizures and epilepsy in larval zebrafish. Recently genetically encoded calcium indicators have been used to investigate the neurobiological basis of these seizures with light microscopy. This approach offers a unique window into the multiscale dynamics of epileptic seizures, capturing both whole-brain dynamics and single-cell behaviour concurrently. At the same time, linking observations made using calcium imaging in the larval zebrafish brain back to an understanding of epileptic seizures largely derived from cortical electrophysiological recordings in human patients and mammalian animal models is non-trivial. In this review we briefly illustrate the state of the art of epilepsy research in zebrafish with particular focus on calcium imaging of epileptic seizures in the larval zebrafish. We illustrate the utility of a dynamic systems perspective on the epileptic brain for providing a principled approach to linking observations across species and identifying those features of brain dynamics that are most relevant to epilepsy. In the following section we survey the literature for imaging features associated with epilepsy and epileptic seizures and link these to observations made from humans and other more traditional animal models. We conclude by identifying the key challenges still facing epilepsy research in the larval zebrafish and indicate strategies for future research to address these and integrate more directly with the themes and questions that emerge from investigating epilepsy in other model systems and human patients.

Entropy of the Multi-Channel EEG Recordings Identifies the Distributed Signatures of Negative, Neutral and Positive Affect in Whole-Brain Variability

Individuals’ ability to express their subjective experiences in terms of such attributes as pleasant/unpleasant or positive/negative feelings forms a fundamental property of their affect and emotion. However, neuroscientific findings on the underlying neural substrates of the affect appear to be inconclusive with some reporting the presence of distinct and independent brain systems and others identifying flexible and distributed brain regions. A common theme among these studies is the focus on the change in brain activation. As a result, they do not take into account the findings that indicate the brain activation and its information content does not necessarily modulate and that the stimuli with equivalent sensory and behavioural processing demands may not necessarily result in differential brain activation. In this article, we take a different stance on the analysis of the differential effect of the negative, neutral and positive affect on the brain functioning in which we look into the whole-brain variability: that is the change in the brain information processing measured in multiple distributed regions. For this purpose, we compute the entropy of individuals’ muti-channel EEG recordings who watched movie clips with differing affect. Our results suggest that the whole-brain variability significantly differentiates between the negative, neutral and positive affect. They also indicate that although some brain regions contribute more to such differences, it is the whole-brain variational pattern that results in their significantly above chance level prediction. These results imply that although the underlying brain substrates for negative, neutral and positive affect exhibit quantitatively differing degrees of variability, their differences are rather subtly encoded in the whole-brain variational patterns that are distributed across its entire activity.

Scaling Behaviour and Critical Phase Transitions in Integrated Information Theory

Integrated Information Theory proposes a measure of conscious activity (Φ), characterised as the irreducibility of a dynamical system to the sum of its components. Due to its computational cost, current versions of the theory (IIT 3.0) are difficult to apply to systems larger than a dozen units, and, in general, it is not well known how integrated information scales as systems grow larger in size. In this article, we propose to study the scaling behaviour of integrated information in a simple model of a critical phase transition: an infinite-range kinetic Ising model. In this model, we assume a homogeneous distribution of couplings to simplify the computation of integrated information. This simplified model allows us to critically review some of the design assumptions behind the measure and connect its properties with well-known phenomena in phase transitions in statistical mechanics. As a result, we point to some aspects of the mathematical definitions of IIT that 3.0 fail to capture critical phase transitions and propose a reformulation of the assumptions made by integrated information measures.

Mental Effort and Information-Processing Costs Are Inversely Related to Global Brain Free Energy During Visual Categorization

Mental effort is a neurocognitive process that reflects the controlled expenditure of psychological information-processing resources during perception, cognition, and action. There is a practical need to operationalize and measure mental effort in order to minimize detrimental effects of mental fatigue on real-world human performance. Previous research has identified several neurocognitive indices of mental effort, but these indices are indirect measures that are also sensitive to experimental demands or general factors such as sympathetic arousal. The present study investigated a potential direct neurocognitive index of mental effort based in theories where bounded rational decision makers (realized as embodied brains) are modeled as generalized thermodynamic systems. This index is called free energy, an information-theoretic system property of the brain that reflects the difference between the brain's current and predicted states. Theory predicts that task-related differences in a decision makers' free energy are inversely related to information-processing costs related to task decisions. The present study tested this prediction by quantifying global brain free energy from electroencephalographic (EEG) measures of human brain function. EEG signals were recorded while participants engaged in two visual categorization tasks in which categorization decisions resulted from the allocation of different levels of mental information processing resources. A novel method was developed to quantify brain free energy from machine learning classification of EEG trials. Participant information-processing resource costs were estimated via computational analysis of behavior, whereas the subjective expression of mental effort was estimated via participant ratings of mental workload. Following theoretical predictions, task-related differences in brain free energy negatively correlated with increased allocation of information-processing resource costs. These brain free energy differences were smaller for the visual categorization task that required a greater versus lesser allocation of information-processing resources. Ratings of mental workload were positively correlated with information-processing resource costs, and negatively correlated with global brain free energy differences, only for the categorization task requiring the larger amount of information-processing resource costs. These findings support theoretical thermodynamic approaches to decision making and provide the first empirical evidence of a relationship between mental effort, brain free energy, and neurocognitive information-processing.

Oscillations and collective excitability in a model of stochastic neurons under excitatory and inhibitory coupling

We study a model with excitable neurons modeled as stochastic units with three states, representing quiescence, firing, and refractoriness. The transition rates between quiescence and firing depend exponentially on the number of firing neighbors, whereas all other rates are kept constant. This model class was shown to exhibit collective oscillations (synchronization) if neurons are spiking autonomously, but not if neurons are in the excitable regime. In both cases, neurons were restricted to interact through excitatory coupling. Here we show that a plethora of collective phenomena appear if inhibitory coupling is added. Besides the usual transition between an absorbing and an active phase, the model with excitatory and inhibitory neurons can also undergo reentrant transitions to an oscillatory phase. In the mean-field description, oscillations can emerge through supercritical or subcritical Hopf bifurcations, as well as through infinite period bifurcations. The model has bistability between active and oscillating behavior, as well as collective excitability, a regime where the system can display a peak of global activity when subject to a sufficiently strong perturbation. We employ a variant of the Shinomoto-Kuramoto order parameter to characterize the phase transitions and their system-size dependence.

Criticality as a Determinant of Integrated Information Φ in Human Brain Networks

Integrated information theory (IIT) describes consciousness as information integrated across highly differentiated but irreducible constituent parts in a system. However, in a complex dynamic system such as the brain, the optimal conditions for large integrated information systems have not been elucidated. In this study, we hypothesized that network criticality, a balanced state between a large variation in functional network configuration and a large constraint on structural network configuration, may be the basis of the emergence of a large Φ¯, a surrogate of integrated information. We also hypothesized that as consciousness diminishes, the brain loses network criticality and Φ¯ decreases. We tested these hypotheses with a large-scale brain network model and high-density electroencephalography (EEG) acquired during various levels of human consciousness under general anesthesia. In the modeling study, maximal criticality coincided with maximal Φ¯. The EEG study demonstrated an explicit relationship between Φ¯, criticality, and level of consciousness. The conscious resting state showed the largest Φ¯ and criticality, whereas the balance between variation and constraint in the brain network broke down as the response rate dwindled. The results suggest network criticality as a necessary condition of a large Φ¯ in the human brain.

Cortical Circuit Dynamics Are Homeostatically Tuned to Criticality In Vivo

Homeostatic mechanisms stabilize neuronal activity in vivo, but whether this process gives rise to balanced network dynamics is unknown. Here, we continuously monitored the statistics of network spiking in visual cortical circuits in freely behaving rats for 9 days. Under control conditions in light and dark, networks were robustly organized around criticality, a regime that maximizes information capacity and transmission. When input was perturbed by visual deprivation, network criticality was severely disrupted and subsequently restored to criticality over 48 h. Unexpectedly, the recovery of excitatory dynamics preceded homeostatic plasticity of firing rates by >30 h. We utilized model investigations to manipulate firing rate homeostasis in a cell-type-specific manner at the onset of visual deprivation. Our results suggest that criticality in excitatory networks is established by inhibitory plasticity and architecture. These data establish that criticality is consistent with a homeostatic set point for visual cortical dynamics and suggest a key role for homeostatic regulation of inhibition.

The avalanche-like behaviour of large-scale haemodynamic activity from wakefulness to deep sleep

Increasing evidence suggests that responsiveness is associated with critical or near-critical cortical dynamics, which exhibit scale-free cascades of spatio-temporal activity. These cascades, or 'avalanches', have been detected at multiple scales, from in vitro and in vivo microcircuits to voltage imaging and brain-wide functional magnetic resonance imaging (fMRI) recordings. Criticality endows the cortex with certain information-processing capacities postulated as necessary for conscious wakefulness, yet it remains unknown how unresponsiveness impacts on the avalanche-like behaviour of large-scale human haemodynamic activity. We observed a scale-free hierarchy of co-activated connected clusters by applying a point-process transformation to fMRI data recorded during wakefulness and non-rapid eye movement (NREM) sleep. Maximum-likelihood estimates revealed a significant effect of sleep stage on the scaling parameters of the cluster size power-law distributions. Post hoc statistical tests showed that differences were maximal between wakefulness and N2 sleep. These results were robust against spatial coarse graining, fitting alternative statistical models and different point-process thresholds, and disappeared upon phase shuffling the fMRI time series. Evoked neural bistabilities preventing arousals during N2 sleep do not suffice to explain these differences, which point towards changes in the intrinsic dynamics of the brain that could be necessary to consolidate a state of deep unresponsiveness.

25 years of criticality in neuroscience - established results, open controversies, novel concepts

Twenty-five years ago, Dunkelmann and Radons (1994) showed that neural networks can self-organize to a critical state. In models, the critical state offers a number of computational advantages. Thus this hypothesis, and in particular the experimental work by Beggs and Plenz (2003), has triggered an avalanche of research, with thousands of studies referring to it. Nonetheless, experimental results are still contradictory. How is it possible, that a hypothesis has attracted active research for decades, but nonetheless remains controversial? We discuss the experimental and conceptual controversy, and then present a parsimonious solution that (i) unifies the contradictory experimental results, (ii) avoids disadvantages of a critical state, and (iii) enables rapid, adaptive tuning of network properties to task requirements.

Time-series thresholding and the definition of avalanche size

Avalanches whose sizes and durations are distributed as power laws appear in many contexts, from physics to geophysics and biology. Here we show that there is a hidden peril in thresholding continuous times series-from either empirical or synthetic data-for the identification of avalanches. In particular, we consider two possible alternative definitions of avalanche size used, e.g., in the empirical determination of avalanche exponents in the analysis of neural-activity data. By performing analytical and computational studies of an Ornstein-Uhlenbeck process (taken as a guiding example) we show that (1) if relatively large threshold values are employed to determine the beginning and ending of avalanches and (2) if-as sometimes done in the literature-avalanche sizes are defined as the total area (above zero) of the avalanche, then true asymptotic scaling behavior is not seen, instead the observations are dominated by transient effects. This problem-that we have detected in some recent works-leads to misinterpretations of the resulting scaling regimes.

Topological phase transitions in functional brain networks

Functional brain networks are often constructed by quantifying correlations between time series of activity of brain regions. Their topological structure includes nodes, edges, triangles, and even higher-dimensional objects. Topological data analysis (TDA) is the emerging framework to process data sets under this perspective. In parallel, topology has proven essential for understanding fundamental questions in physics. Here we report the discovery of topological phase transitions in functional brain networks by merging concepts from TDA, topology, geometry, physics, and network theory. We show that topological phase transitions occur when the Euler entropy has a singularity, which remarkably coincides with the emergence of multidimensional topological holes in the brain network. The geometric nature of the transitions can be interpreted, under certain hypotheses, as an extension of percolation to high-dimensional objects. Due to the universal character of phase transitions and noise robustness of TDA, our findings open perspectives toward establishing reliable topological and geometrical markers for group and possibly individual differences in functional brain network organization.

Spectral peculiarity and criticality of a human connectome

We have performed the comparative spectral analysis of structural connectomes for various organisms using open-access data. Our results indicate new peculiar features of connectomes of higher organisms. We found that the spectral density of adjacency matrices of human connectome has maximal deviation from the one of randomized network, compared to other organisms. Considering the network evolution induced by the preference of 3-cycles formation, we discovered that for macaque and human connectomes the evolution with the conservation of local clusterization is crucial, while for primitive organisms the conservation of averaged clusterization is sufficient. Investigating for the first time the level spacing distribution of the spectrum of human connectome Laplacian matrix, we explicitly demonstrate that the spectral statistics corresponds to the critical regime, which is hybrid of Wigner-Dyson and Poisson distributions. This observation provides strong support for debated statement of the brain criticality.

Simple model of complex dynamics of activity patterns in developing networks of neuronal cultures

Living neuronal networks in dissociated neuronal cultures are widely known for their ability to generate highly robust spatiotemporal activity patterns in various experimental conditions. Such patterns are often treated as neuronal avalanches that satisfy the power scaling law and thereby exemplify self-organized criticality in living systems. A crucial question is how these patterns can be explained and modeled in a way that is biologically meaningful, mathematically tractable and yet broad enough to account for neuronal heterogeneity and complexity. Here we derive and analyse a simple network model that may constitute a response to this question. Our derivations are based on few basic phenomenological observations concerning the input-output behavior of an isolated neuron. A distinctive feature of the model is that at the simplest level of description it comprises of only two variables, the network activity variable and an exogenous variable corresponding to energy needed to sustain the activity, and few parameters such as network connectivity and efficacy of signal transmission. The efficacy of signal transmission is modulated by the phenomenological energy variable. Strikingly, this simple model is already capable of explaining emergence of network spikes and bursts in developing neuronal cultures. The model behavior and predictions are consistent with published experimental evidence on cultured neurons. At the larger, cellular automata scale, introduction of the energy-dependent regulatory mechanism results in the overall model behavior that can be characterized as balancing on the edge of the network percolation transition. Network activity in this state shows population bursts satisfying the scaling avalanche conditions. This network state is self-sustainable and represents energetic balance between global network-wide processes and spontaneous activity of individual elements.

Dynamic Computation in Visual Thalamocortical Networks

Contemporary neurodynamical frameworks, such as coordination dynamics and winnerless competition, posit that the brain approximates symbolic computation by transitioning between metastable attractive states. This article integrates these accounts with electrophysiological data suggesting that coherent, nested oscillations facilitate information representation and transmission in thalamocortical networks. We review the relationship between criticality, metastability, and representational capacity, outline existing methods for detecting metastable oscillatory patterns in neural time series data, and evaluate plausible spatiotemporal coding schemes based on phase alignment. We then survey the circuitry and the mechanisms underlying the generation of coordinated alpha and gamma rhythms in the primate visual system, with particular emphasis on the pulvinar and its role in biasing visual attention and awareness. To conclude the review, we begin to integrate this perspective with longstanding theories of consciousness and cognition.

Multi-scale detection of hierarchical community architecture in structural and functional brain networks

Community detection algorithms have been widely used to study the organization of complex networks like the brain. These techniques provide a partition of brain regions (or nodes) into clusters (or communities), where nodes within a community are densely interconnected with one another. In their simplest application, community detection algorithms are agnostic to the presence of community hierarchies: clusters embedded within clusters of other clusters. To address this limitation, we exercise a multi-scale extension of a common community detection technique, and we apply the tool to synthetic graphs and to graphs derived from human neuroimaging data, including structural and functional imaging data. Our multi-scale community detection algorithm links a graph to copies of itself across neighboring topological scales, thereby becoming sensitive to conserved community organization across levels of the hierarchy. We demonstrate that this method is sensitive to topological inhomogeneities of the graph's hierarchy by providing a local measure of community stability and inter-scale reliability across topological scales. We compare the brain's structural and functional network architectures, and we demonstrate that structural graphs display a more prominent hierarchical community organization than functional graphs. Finally, we build an explicitly multimodal multiplex graph that combines both structural and functional connectivity in a single model, and we identify the topological scales where resting state functional connectivity and underlying structural connectivity show similar versus unique hierarchical community architecture. Together, our results demonstrate the advantages of the multi-scale community detection algorithm in studying hierarchical community structure in brain graphs, and they illustrate its utility in modeling multimodal neuroimaging data.

Neuromodulatory Influences on Integration and Segregation in the Brain

Cognitive function relies on the dynamic cooperation of specialized regions of the brain; however, the elements of the system responsible for coordinating this interaction remain poorly understood. In this Opinion article I argue that this capacity is mediated in part by competitive and cooperative dynamic interactions between two prominent metabotropic neuromodulatory systems - the cholinergic basal forebrain and the noradrenergic locus coeruleus (LC). I assert that activity in these projection nuclei regulates the amount of segregation and integration within the whole brain network by modulating the activity of a diverse set of specialized regions of the brain on a timescale relevant for cognition and attention.

Single-Cell Membrane Potential Fluctuations Evince Network Scale-Freeness and Quasicriticality

What information single neurons receive about general neural circuit activity is a fundamental question for neuroscience. Somatic membrane potential (V _m) fluctuations are driven by the convergence of synaptic inputs from a diverse cross-section of upstream neurons. Furthermore, neural activity is often scale-free, implying that some measurements should be the same, whether taken at large or small scales. Together, convergence and scale-freeness support the hypothesis that single V _m recordings carry useful information about high-dimensional cortical activity. Conveniently, the theory of "critical branching networks" (one purported explanation for scale-freeness) provides testable predictions about scale-free measurements that are readily applied to V _m fluctuations. To investigate, we obtained whole-cell current-clamp recordings of pyramidal neurons in visual cortex of turtles with unknown genders. We isolated fluctuations in V _m below the firing threshold and analyzed them by adapting the definition of "neuronal avalanches" (i.e., spurts of population spiking). The V _m fluctuations which we analyzed were scale-free and consistent with critical branching. These findings recapitulated results from large-scale cortical population data obtained separately in complementary experiments using microelectrode arrays described previously (Shew et al., 2015). Simultaneously recorded single-unit local field potential did not provide a good match, demonstrating the specific utility of V _m Modeling shows that estimation of dynamical network properties from neuronal inputs is most accurate when networks are structured as critical branching networks. In conclusion, these findings extend evidence of critical phenomena while also establishing subthreshold pyramidal neuron V _m fluctuations as an informative gauge of high-dimensional cortical population activity.SIGNIFICANCE STATEMENT The relationship between membrane potential (V _m) dynamics of single neurons and population dynamics is indispensable to understanding cortical circuits. Just as important to the biophysics of computation are emergent properties such as scale-freeness, where critical branching networks offer insight. This report makes progress on both fronts by comparing statistics from single-neuron whole-cell recordings with population statistics obtained with microelectrode arrays. Not only are fluctuations of somatic V _m scale-free, they match fluctuations of population activity. Thus, our results demonstrate appropriation of the brain's own subsampling method (convergence of synaptic inputs) while extending the range of fundamental evidence for critical phenomena in neural systems from the previously observed mesoscale (fMRI, LFP, population spiking) to the microscale, namely, V _m fluctuations.

Pattern phase diagram of spiking neurons on spatial networks

We study an abstracted model of neuronal activity via numerical simulation and report spatiotemporal pattern formation and criticallike dynamics. A population of pulse coupled, discretized, relaxation oscillators is simulated over networks with varying edge density and spatial embeddedness. For intermediate edge density and sufficiently strong spatial embeddedness, we observe a spatiotemporal pattern in the field of oscillator phases, visually resembling the surface of a frothing liquid. Increasing the edge density results in a distribution of neuronal avalanche sizes which follows a power law with exponent one (Zipf's law). Further increasing edge density yields metastability between pattern formation and synchronization, before transitioning entirely into synchrony.

Computational capabilities at the edge of chaos for one dimensional systems undergoing continuous transitions

While there has been a keen interest in studying computation at the edge of chaos for dynamical systems undergoing a phase transition, this has come under question for cellular automata. We show that for continuously deformed cellular automata, there is an enhancement of computation capabilities as the system moves towards cellular automata with chaotic spatiotemporal behavior. The computation capabilities are followed by looking into the Shannon entropy rate and the excess entropy, which allow identifying the balance between unpredictability and complexity. Enhanced computation power shows an increase of excess entropy, while the system entropy density has a sudden jump to values near one. The analysis is extended to a system of non-linear locally coupled oscillators that have been reported to exhibit spatiotemporal diagrams similar to cellular automata.

Multi-Scale Expressions of One Optimal State Regulated by Dopamine in the Prefrontal Cortex

The prefrontal cortex (PFC), which plays key roles in many higher cognitive processes, is a hierarchical system consisting of multi-scale organizations. Optimizing the working state at each scale is essential for PFC's information processing. Typical optimal working states at different scales have been separately reported, including the dopamine-mediated inverted-U profile of the working memory (WM) at the system level, critical dynamics at the network level, and detailed balance of excitatory and inhibitory currents (E/I balance) at the cellular level. However, it remains unclear whether these states are scale-specific expressions of the same optimal state and, if so, what is the underlying mechanism for its regulation traversing across scales. Here, by studying a neural network model, we show that the optimal performance of WM co-occurs with the critical dynamics at the network level and the E/I balance at the level of individual neurons, suggesting the existence of a unified, multi-scale optimal state for the PFC. Importantly, such a state could be modulated by dopamine at the synaptic level through a series of U or inverted-U profiles. These results suggest that seemingly different optimal states for specific scales are multi-scale expressions of one condition regulated by dopamine. Our work suggests a cross-scale perspective to understand the PFC function and its modulation.

Stochastic oscillations and dragon king avalanches in self-organized quasi-critical systems

In the last decade, several models with network adaptive mechanisms (link deletion-creation, dynamic synapses, dynamic gains) have been proposed as examples of self-organized criticality (SOC) to explain neuronal avalanches. However, all these systems present stochastic oscillations hovering around the critical region that are incompatible with standard SOC. Here we make a linear stability analysis of the mean field fixed points of two self-organized quasi-critical systems: a fully connected network of discrete time stochastic spiking neurons with firing rate adaptation produced by dynamic neuronal gains and an excitable cellular automata with depressing synapses. We find that the fixed point corresponds to a stable focus that loses stability at criticality. We argue that when this focus is close to become indifferent, demographic noise can elicit stochastic oscillations that frequently fall into the absorbing state. This mechanism interrupts the oscillations, producing both power law avalanches and dragon king events, which appear as bands of synchronized firings in raster plots. Our approach differs from standard SOC models in that it predicts the coexistence of these different types of neuronal activity.

Conflicting emergences. Weak vs. strong emergence for the modelling of brain function

The concept of "emergence" has become commonplace in the modelling of complex systems, both natural and man-made; a functional property" emerges" from a system when it cannot be readily explained by the properties of the system's sub-units. A bewildering array of adaptive and sophisticated behaviours can be observed from large ensembles of elementary agents such as ant colonies, bird flocks or by the interactions of elementary material units such as molecules or weather elements. Ultimately, emergence has been adopted as the ontological support of a number of attempts to model brain function. This manuscript aims to clarify the ontology of emergence and delve into its many facets, particularly into its "strong" and "weak" versions that underpin two different approaches to the modelling of behaviour. The first group of models is here represented by the "free energy" principle of brain function and the "integrated information theory" of consciousness. The second group is instead represented by computational models such as oscillatory networks that use mathematical scalable representations to generate emergent behaviours and are then able to bridge neurobiology with higher mental functions. Drawing on the epistemological literature, we observe that due to their loose mechanistic links with the underlying biology, models based on strong forms of emergence are at risk of metaphysical implausibility. This, in practical terms, translates into the over determination that occurs when the proposed model becomes only one of a large set of possible explanations for the observable phenomena. On the other hand, computational models that start from biologically plausible elementary units, hence are weakly emergent, are not limited by ontological faults and, if scalable and able to realistically simulate the hierarchies of brain output, represent a powerful vehicle for future neuroscientific research programmes.

K-th Nearest Neighbor (KNN) Entropy Estimates of Complexity and Integration from Ongoing and Stimulus-Evoked Electroencephalographic (EEG) Recordings of the Human Brain

Information-theoretic measures for quantifying multivariate statistical dependence have proven useful for the study of the unity and diversity of the human brain. Two such measures–integration, I(X), and interaction complexity, C_I(X)–have been previously applied to electroencephalographic (EEG) signals recorded during ongoing wakeful brain states. Here, I(X) and C_I(X) were computed for empirical and simulated visually-elicited alpha-range (8–13 Hz) EEG signals. Integration and complexity of evoked (stimulus-locked) and induced (non-stimulus-locked) EEG responses were assessed using nonparametric k-th nearest neighbor (KNN) entropy estimation, which is robust to the nonstationarity of stimulus-elicited EEG signals. KNN-based I(X) and C_I(X) were also computed for the alpha-range EEG of ongoing wakeful brain states. I(X) and C_I(X) patterns differentiated between induced and evoked EEG signals and replicated previous wakeful EEG findings obtained using Gaussian-based entropy estimators. Absolute levels of I(X) and C_I(X) were related to absolute levels of alpha-range EEG power and phase synchronization, but stimulus-related changes in the information-theoretic and other EEG properties were independent. These findings support the hypothesis that visual perception and ongoing wakeful mental states emerge from complex, dynamical interaction among segregated and integrated brain networks operating near an optimal balance between order and disorder.

Role of Network Science in the Study of Anesthetic State Transitions

The heterogeneity of molecular mechanisms, target neural circuits, and neurophysiologic effects of general anesthetics makes it difficult to develop a reliable and drug-invariant index of general anesthesia. No single brain region or mechanism has been identified as the neural correlate of consciousness, suggesting that consciousness might emerge through complex interactions of spatially and temporally distributed brain functions. The goal of this review article is to introduce the basic concepts of networks and explain why the application of network science to general anesthesia could be a pathway to discover a fundamental mechanism of anesthetic-induced unconsciousness. This article reviews data suggesting that reduced network efficiency, constrained network repertoires, and changes in cortical dynamics create inhospitable conditions for information processing and transfer, which lead to unconsciousness. This review proposes that network science is not just a useful tool but a necessary theoretical framework and method to uncover common principles of anesthetic-induced unconsciousness.

Common neural signatures of psychedelics: Frequency-specific energy changes and repertoire expansion revealed using connectome-harmonic decomposition

The search for the universal laws of human brain function is still on-going but progress is being made. Here we describe the novel concepts of connectome harmonics and connectome-harmonic decomposition, which can be used to characterize the brain activity associated with any mental state. We use this new frequency-specific language to describe the brain activity elicited by psilocybin and LSD and find remarkably similar effects in terms of increases in total energy and power, as well as frequency-specific energy changes and repertoire expansion. In addition, we find enhanced signatures of criticality suggesting that the brain dynamics tune toward criticality in both psychedelic elicited states. Overall, our findings provide new evidence for the remarkable ability of psychedelics to change the spatiotemporal dynamics of the human brain.

Exploring Criticality as a Generic Adaptive Mechanism

The activity of many biological and cognitive systems is not poised deep within a specific regime of activity. Instead, they operate near points of critical behavior located at the boundary between different phases. Certain authors link some of the properties of criticality with the ability of living systems to generate autonomous or intrinsically generated behavior. However, these claims remain highly speculative. In this paper, we intend to explore the connection between criticality and autonomous behavior through conceptual models that show how embodied agents may adapt themselves toward critical points. We propose to exploit maximum entropy models and their formal descriptions of indicators of criticality to present a learning model that drives generic agents toward critical points. Specifically, we derive such a learning model in an embodied Boltzmann machine by implementing a gradient ascent rule that maximizes the heat capacity of the controller in order to make the network maximally sensitive to external perturbations. We test and corroborate the model by implementing an embodied agent in the Mountain Car benchmark test, which is controlled by a Boltzmann machine that adjusts its weights according to the model. We find that the neural controller reaches an apparent point of criticality, which coincides with a transition point of the behavior of the agent between two regimes of behavior, maximizing the synergistic information between its sensors and the combination of hidden and motor neurons. Finally, we discuss the potential of our learning model to answer questions about the connection between criticality and the capabilities of living systems to autonomously generate intrinsic constraints on their behavior. We suggest that these “critical agents” are able to acquire flexible behavioral patterns that are useful for the development of successful strategies in different contexts.

Balancing selfishness and norm conformity can explain human behavior in large-scale prisoner's dilemma games and can poise human groups near criticality

Cooperation is central to the success of human societies as it is crucial for overcoming some of the most pressing social challenges of our time; still, how human cooperation is achieved and may persist is a main puzzle in the social and biological sciences. Recently, scholars have recognized the importance of social norms as solutions to major local and large-scale collective action problems, from the management of water resources to the reduction of smoking in public places to the change in fertility practices. Yet a well-founded model of the effect of social norms on human cooperation is still lacking. Using statistical-physics techniques and integrating findings from cognitive and behavioral sciences, we present an analytically tractable model in which individuals base their decisions to cooperate both on the economic rewards they obtain and on the degree to which their action complies with social norms. Results from this parsimonious model are in agreement with observations in recent large-scale experiments with humans. We also find the phase diagram of the model and show that the experimental human group is poised near a critical point, a regime where recent work suggests living systems respond to changing external conditions in an efficient and coordinated manner.

Criticality Distinguishes the Ensemble of Biological Regulatory Networks

The hypothesis that many living systems should exhibit near-critical behavior is well motivated theoretically, and an increasing number of cases have been demonstrated empirically. However, a systematic analysis across biological networks, which would enable identification of the network properties that drive criticality, has not yet been realized. Here, we provide a first comprehensive survey of criticality across a diverse sample of biological networks, leveraging a publicly available database of 67 Boolean models of regulatory circuits. We find all 67 networks to be near critical. By comparing to ensembles of random networks with similar topological and logical properties, we show that criticality in biological networks is not predictable solely from macroscale properties such as mean degree ⟨K⟩ and mean bias in the logic functions ⟨p⟩, as previously emphasized in theories of random Boolean networks. Instead, the ensemble of real biological circuits is jointly constrained by the local causal structure and logic of each node. In this way, biological regulatory networks are more distinguished from random networks by their criticality than by other macroscale network properties such as degree distribution, edge density, or fraction of activating conditions.