The emergence of synchrony in networks of mutually inferring neurons

Cerebellar state estimation enables resilient coupling across behavioural domains

Cerebellar computations are necessary for fine behavioural control and may rely on internal models for estimation of behaviourally relevant states. Here, we propose that the central cerebellar function is to estimate how states interact with each other, and to use these estimates to coordinates extra-cerebellar neuronal dynamics underpinning a range of interconnected behaviours. To support this claim, we describe a cerebellar model for state estimation that includes state interactions, and link this model with the neuronal architecture and dynamics observed empirically. This is formalised using the free energy principle, which provides a dual perspective on a system in terms of both the dynamics of its physical-in this case neuronal-states, and the inferential process they entail. As a demonstration of this proposal, we simulate cerebellar-dependent synchronisation of whisking and respiration, which are known to be tightly coupled in rodents, as well as limb and tail coordination during locomotion. In summary, we propose that the ubiquitous involvement of the cerebellum in behaviour arises from its central role in precisely coupling behavioural domains.

Body as First Teacher: The Role of Rhythmic Visceral Dynamics in Early Cognitive Development

Embodied cognition-the idea that mental states and processes should be understood in relation to one's bodily constitution and interactions with the world-remains a controversial topic within cognitive science. Recently, however, increasing interest in predictive processing theories among proponents and critics of embodiment alike has raised hopes of a reconciliation. This article sets out to appraise the unificatory potential of predictive processing, focusing in particular on embodied formulations of active inference. Our analysis suggests that most active-inference accounts invoke weak, potentially trivial conceptions of embodiment; those making stronger claims do so independently of the theoretical commitments of the active-inference framework. We argue that a more compelling version of embodied active inference can be motivated by adopting a diachronic perspective on the way rhythmic physiological activity shapes neural development in utero. According to this visceral afferent training hypothesis, early-emerging physiological processes are essential not only for supporting the biophysical development of neural structures but also for configuring the cognitive architecture those structures entail. Focusing in particular on the cardiovascular system, we propose three candidate mechanisms through which visceral afferent training might operate: (a) activity-dependent neuronal development, (b) periodic signal modeling, and (c) oscillatory network coordination.

Hierarchical growth in neural networks structure: Organizing inputs by Order of Hierarchical Complexity

Several studies demonstrate that the structure of the brain increases in hierarchical complexity throughout development. We tested if the structure of artificial neural networks also increases in hierarchical complexity while learning a developing task, called the balance beam problem. Previous simulations of this developmental task do not reflect a necessary premise underlying development: a more complex structure can be built out of less complex ones, while ensuring that the more complex structure does not replace the less complex one. In order to address this necessity, we segregated the input set by subsets of increasing Orders of Hierarchical Complexity. This is a complexity measure that has been extensively shown to underlie the complexity behavior and hypothesized to underlie the complexity of the neural structure of the brain. After segregating the input set, minimal neural network models were trained separately for each input subset, and adjacent complexity models were analyzed sequentially to observe whether there was a structural progression. Results show that three different network structural progressions were found, performing with similar accuracy, pointing towards self-organization. Also, more complex structures could be built out of less complex ones without substituting them, successfully addressing catastrophic forgetting and leveraging performance of previous models in the literature. Furthermore, the model structures trained on the two highest complexity subsets performed better than simulations of the balance beam present in the literature. As a major contribution, this work was successful in addressing hierarchical complexity structural growth in neural networks, and is the first that segregates inputs by Order of Hierarchical Complexity. Since this measure can be applied to all domains of data, the present method can be applied to future simulations, systematizing the simulation of developmental and evolutionary structural growth in neural networks.

Subthalamic Nucleus (STN)-Deep Brain Stimulation Reduces the Power of Mu and Beta Rhythms and Enhances Synchrony at the Motor Cortices in Parkinson's Disease: A Report of Two Cases

The motor circuit in Parkinson's disease (PD) involves the basal ganglia, thalamus, motor cortex, and cerebellum. Hence, subthalamic nucleus (STN) or globus pallidus internus deep brain stimulation is commonly used in treating refractory Parkinson's patients. During the procedure, the local field potential (LPF) is commonly made along the trajectory of the STN. Two cases were assessed, where an electroencephalographic recording at the sensorimotor cortices was also performed with and without stimulation at the optimal STN electrode site. The 'on' stimulation state associated with clinical improvement correlated with a marked reduction in the late theta (7.5 Hz), alpha (10.5 Hz) (Mu wave), and beta (20 Hz) wave power. Besides, more synchronized and coherent brainwaves were noted when the stimulation was 'on'.

Small steps for mankind: Modeling the emergence of cumulative culture from joint active inference communication

Although the increase in the use of dynamical modeling in the literature on cultural evolution makes current models more mathematically sophisticated, these models have yet to be tested or validated. This paper provides a testable deep active inference formulation of social behavior and accompanying simulations of cumulative culture in two steps: First, we cast cultural transmission as a bi-directional process of communication that induces a generalized synchrony (operationalized as a particular convergence) between the belief states of interlocutors. Second, we cast social or cultural exchange as a process of active inference by equipping agents with the choice of who to engage in communication with. This induces trade-offs between confirmation of current beliefs and exploration of the social environment. We find that cumulative culture emerges from belief updating (i.e., active inference and learning) in the form of a joint minimization of uncertainty. The emergent cultural equilibria are characterized by a segregation into groups, whose belief systems are actively sustained by selective, uncertainty minimizing, dyadic exchanges. The nature of these equilibria depends sensitively on the precision afforded by various probabilistic mappings in each individual's generative model of their encultured niche.

Redressing the emperor in causal clothing

Over-flexibility in the definition of Friston blankets obscures a key distinction between observational and interventional inference. The latter requires cognizers form not just a causal representation of the world but also of their own boundary and relationship with it, in order to diagnose the consequences of their actions. We suggest this locates the blanket in the eye of the beholder.

The dual action of glioma-derived exosomes on neuronal activity: synchronization and disruption of synchrony

Seizures represent a frequent symptom in gliomas and significantly impact patient morbidity and quality of life. Although the pathogenesis of tumor-related seizures is not fully understood, accumulating evidence indicates a key role of the peritumoral microenvironment. Brain cancer cells interact with neurons by forming synapses with them and by releasing exosomes, cytokines, and other small molecules. Strong interactions among neurons often lead to the synchronization of their activity. In this paper, we used an in vitro model to investigate the role of exosomes released by glioma cell lines and by patient-derived glioma stem cells (GSCs). The addition of exosomes released by U87 glioma cells to neuronal cultures at day in vitro (DIV) 4, when neurons are not yet synchronous, induces synchronization. At DIV 7-12 neurons become highly synchronous, and the addition of the same exosomes disrupts synchrony. By combining Ca²⁺ imaging, electrical recordings from single neurons with patch-clamp electrodes, substrate-integrated microelectrode arrays, and immunohistochemistry, we show that synchronization and de-synchronization are caused by the combined effect of (i) the formation of new neuronal branches, associated with a higher expression of Arp3, (ii) the modification of synaptic efficiency, and (iii) a direct action of exosomes on the electrical properties of neurons, more evident at DIV 7-12 when the threshold for spike initiation is significantly reduced. At DIV 7-12 exosomes also selectively boost glutamatergic signaling by increasing the number of excitatory synapses. Remarkably, de-synchronization was also observed with exosomes released by glioma-associated stem cells (GASCs) from patients with low-grade glioma but not from patients with high-grade glioma, where a more variable outcome was observed. These results show that exosomes released from glioma modify the electrical properties of neuronal networks and that de-synchronization caused by exosomes from low-grade glioma can contribute to the neurological pathologies of patients with brain cancers.

Emergence of associative learning in a neuromorphic inference network

OBJECTIVE

In the theoretical framework of predictive coding and active inference, the brain can be viewed as instantiating a rich generative model of the world that predicts incoming sensory data while continuously updating its parameters via minimization of prediction errors. While this theory has been successfully applied to cognitive processes - by modelling the activity of functional neural networks at a mesoscopic scale - the validity of the approach when modelling neurons as an ensemble of inferring agents, in a biologically plausible architecture, remained to be explored.

APPROACH

We modelled a simplified cerebellar circuit with individual neurons acting as Bayesian agents to simulate the classical delayed eyeblink conditioning protocol. Neurons and synapses adjusted their activity to minimize their prediction error, which was used as the network cost function. This cerebellar network was then implemented in hardware by replicating digital neuronal elements via a low-power microcontroller.

MAIN RESULTS

Persistent changes of synaptic strength - that mirrored neurophysiological observations - emerged via local (neurocentric) prediction error minimization, leading to the expression of associative learning. The same paradigm was effectively emulated in low-power hardware showing remarkably efficient performance compared to conventional neuromorphic architectures.

SIGNIFICANCE

These findings show that: i) an ensemble of free energy minimizing neurons - organized in a biological plausible architecture - can recapitulate functional self-organization observed in nature, such as associative plasticity, and ii) a neuromorphic network of inference units can learn unsupervised tasks without embedding predefined learning rules in the circuit, thus providing a potential avenue to a novel form of brain-inspired artificial intelligence.

Neural Synchrony and Network Dynamics in Social Interaction: A Hyper-Brain Cell Assembly Hypothesis

Mounting neurophysiological evidence suggests that interpersonal interaction relies on continual communication between cell assemblies within interacting brains and continual adjustments of these neuronal dynamic states between the brains. In this Hypothesis and Theory article, a Hyper-Brain Cell Assembly Hypothesis is suggested on the basis of a conceptual review of neural synchrony and network dynamics and their roles in emerging cell assemblies within the interacting brains. The proposed hypothesis states that such cell assemblies can emerge not only within, but also between the interacting brains. More precisely, the hyper-brain cell assembly encompasses and integrates oscillatory activity within and between brains, and represents a common hyper-brain unit, which has a certain relation to social behavior and interaction. Hyper-brain modules or communities, comprising nodes across two or several brains, are considered as one of the possible representations of the hypothesized hyper-brain cell assemblies, which can also have a multidimensional or multilayer structure. It is concluded that the neuronal dynamics during interpersonal interaction is brain-wide, i.e., it is based on common neuronal activity of several brains or, more generally, of the coupled physiological systems including brains.

Bayesian mechanics for stationary processes

This paper develops a Bayesian mechanics for adaptive systems. Firstly, we model the interface between a system and its environment with a Markov blanket. This affords conditions under which states internal to the blanket encode information about external states. Second, we introduce dynamics and represent adaptive systems as Markov blankets at steady state. This allows us to identify a wide class of systems whose internal states appear to infer external states, consistent with variational inference in Bayesian statistics and theoretical neuroscience. Finally, we partition the blanket into sensory and active states. It follows that active states can be seen as performing active inference and well-known forms of stochastic control (such as PID control), which are prominent formulations of adaptive behaviour in theoretical biology and engineering.

Affect-Logic, Embodiment, Synergetics, and the Free Energy Principle: New Approaches to the Understanding and Treatment of Schizophrenia

This theoretical paper explores the affect-logic approach to schizophrenia in light of the general complexity theories of cognition: embodied cognition, Haken's synergetics, and Friston's free energy principle. According to affect-logic, the mental apparatus is an embodied system open to its environment, driven by bioenergetic inputs of emotions. Emotions are rooted in goal-directed embodied states selected by evolutionary pressure for coping with specific situations such as fight, flight, attachment, and others. According to synergetics, nonlinear bifurcations and the emergence of new global patterns occur in open systems when control parameters reach a critical level. Applied to the emergence of psychotic states, synergetics and the proposed energetic understanding of emotions lead to the hypothesis that critical levels of emotional tension may be responsible for the transition from normal to psychotic modes of functioning in vulnerable individuals. In addition, the free energy principle through learning suggests that psychotic symptoms correspond to alternative modes of minimizing free energy, which then entails distorted perceptions of the body, self, and reality. This synthetic formulation has implications for novel therapeutic and preventive strategies in the treatment of psychoses, among these are milieu-therapeutic approaches of the Soteria type that focus on a sustained reduction of emotional tension and phenomenologically oriented methods for improving the perception of body, self, and reality.

What it is like to be a bit: an integrated information decomposition account of emergent mental phenomena

A central question in neuroscience concerns the relationship between consciousness and its physical substrate. Here, we argue that a richer characterization of consciousness can be obtained by viewing it as constituted of distinct information-theoretic elements. In other words, we propose a shift from quantification of consciousness-viewed as integrated information-to its decomposition. Through this approach, termed Integrated Information Decomposition (ΦID), we lay out a formal argument that whether the consciousness of a given system is an emergent phenomenon depends on its information-theoretic composition-providing a principled answer to the long-standing dispute on the relationship between consciousness and emergence. Furthermore, we show that two organisms may attain the same amount of integrated information, yet differ in their information-theoretic composition. Building on ΦID's revised understanding of integrated information, termed ΦR, we also introduce the notion of ΦR-ing ratio to quantify how efficiently an entity uses information for conscious processing. A combination of ΦR and ΦR-ing ratio may provide an important way to compare the neural basis of different aspects of consciousness. Decomposition of consciousness enables us to identify qualitatively different 'modes of consciousness', establishing a common space for mapping the phenomenology of different conscious states. We outline both theoretical and empirical avenues to carry out such mapping between phenomenology and information-theoretic modes, starting from a central feature of everyday consciousness: selfhood. Overall, ΦID yields rich new ways to explore the relationship between information, consciousness, and its emergence from neural dynamics.

Contextual perception under active inference

Human social interactions depend on the ability to resolve uncertainty about the mental states of others. The context in which social interactions take place is crucial for mental state attribution as sensory inputs may be perceived differently depending on the context. In this paper, we introduce a mental state attribution task where a target-face with either an ambiguous or an unambiguous emotion is embedded in different social contexts. The social context is determined by the emotions conveyed by other faces in the scene. This task involves mental state attribution to a target-face (either happy or sad) depending on the social context. Using active inference models, we provide a proof of concept that an agent's perception of sensory stimuli may be altered by social context. We show with simulations that context congruency and facial expression coherency improve behavioural performance in terms of decision times. Furthermore, we show through simulations that the abnormal viewing strategies employed by patients with schizophrenia may be due to (i) an imbalance between the precisions of local and global features in the scene and (ii) a failure to modulate the sensory precision to contextualise emotions.

A Variational Approach to Scripts

This paper proposes a formal reconstruction of the script construct by leveraging the active inference framework, a behavioral modeling framework that casts action, perception, emotions, and attention as processes of (Bayesian or variational) inference. We propose a first principles account of the script construct that integrates its different uses in the behavioral and social sciences. We begin by reviewing the recent literature that uses the script construct. We then examine the main mathematical and computational features of active inference. Finally, we leverage the resources of active inference to offer a formal model of scripts. Our integrative model accounts for the dual nature of scripts (as internal, psychological schema used by agents to make sense of event types and as constitutive behavioral categories that make up the social order) and also for the stronger and weaker conceptions of the construct (which do and do not relate to explicit action sequences, respectively).

Dopamine Transporter Is a Master Regulator of Dopaminergic Neural Network Connectivity

Dopaminergic neurons of the substantia nigra pars compacta (SNC) and ventral tegmental area (VTA) exhibit spontaneous firing activity. The dopaminergic neurons in these regions have been shown to exhibit differential sensitivity to neuronal loss and psychostimulants targeting dopamine transporter. However, it remains unclear whether these regional differences scale beyond individual neuronal activity to regional neuronal networks. Here, we used live-cell calcium imaging to show that network connectivity greatly differs between SNC and VTA regions with higher incidence of hub-like neurons in the VTA. Specifically, the frequency of hub-like neurons was significantly lower in SNC than in the adjacent VTA, consistent with the interpretation of a lower network resilience to SNC neuronal loss. We tested this hypothesis, in DAT-cre/loxP-GCaMP6f mice of either sex, when activity of an individual dopaminergic neuron is suppressed, through whole-cell patch clamp electrophysiology, in either SNC or VTA networks. Neuronal loss in the SNC increased network clustering, whereas the larger number of hub-neurons in the VTA overcompensated by decreasing network clustering in the VTA. We further show that network properties are regulatable via a dopamine transporter but not a D2 receptor dependent mechanism. Our results demonstrate novel regulatory mechanisms of functional network topology in dopaminergic brain regions.SIGNIFICANCE STATEMENT In this work, we begin to untangle the differences in complex network properties between the substantia nigra pars compacta (SNC) and VTA, that may underlie differential sensitivity between regions. The methods and analysis employed provide a springboard for investigations of network topology in multiple deep brain structures and disorders.

Markov blankets in the brain

Recent characterisations of self-organising systems depend upon the presence of a 'Markov blanket': a statistical boundary that mediates the interactions between the inside and outside of a system. We leverage this idea to provide an analysis of partitions in neuronal systems. This is applicable to brain architectures at multiple scales, enabling partitions into single neurons, brain regions, and brain-wide networks. This treatment is based upon the canonical micro-circuitry used in empirical studies of effective connectivity, so as to speak directly to practical applications. The notion of effective connectivity depends upon the dynamic coupling between functional units, whose form recapitulates that of a Markov blanket at each level of analysis. The nuance afforded by partitioning neural systems in this way highlights certain limitations of 'modular' perspectives of brain function that only consider a single level of description.

Neural and phenotypic representation under the free-energy principle

The aim of this paper is to leverage the free-energy principle and its corollary process theory, active inference, to develop a generic, generalizable model of the representational capacities of living creatures; that is, a theory of phenotypic representation. Given their ubiquity, we are concerned with distributed forms of representation (e.g., population codes), whereby patterns of ensemble activity in living tissue come to represent the causes of sensory input or data. The active inference framework rests on the Markov blanket formalism, which allows us to partition systems of interest, such as biological systems, into internal states, external states, and the blanket (active and sensory) states that render internal and external states conditionally independent of each other. In this framework, the representational capacity of living creatures emerges as a consequence of their Markovian structure and nonequilibrium dynamics, which together entail a dual-aspect information geometry. This entails a modest representational capacity: internal states have an intrinsic information geometry that describes their trajectory over time in state space, as well as an extrinsic information geometry that allows internal states to encode (the parameters of) probabilistic beliefs about (fictive) external states. Building on this, we describe here how, in an automatic and emergent manner, information about stimuli can come to be encoded by groups of neurons bound by a Markov blanket; what is known as the neuronal packet hypothesis. As a concrete demonstration of this type of emergent representation, we present numerical simulations showing that self-organizing ensembles of active inference agents sharing the right kind of probabilistic generative model are able to encode recoverable information about a stimulus array.

An Integrated World Modeling Theory (IWMT) of Consciousness: Combining Integrated Information and Global Neuronal Workspace Theories With the Free Energy Principle and Active Inference Framework; Toward Solving the Hard Problem and Characterizing Agentic Causation

The Free Energy Principle and Active Inference Framework (FEP-AI) begins with the understanding that persisting systems must regulate environmental exchanges and prevent entropic accumulation. In FEP-AI, minds and brains are predictive controllers for autonomous systems, where action-driven perception is realized as probabilistic inference. Integrated Information Theory (IIT) begins with considering the preconditions for a system to intrinsically exist, as well as axioms regarding the nature of consciousness. IIT has produced controversy because of its surprising entailments: quasi-panpsychism; subjectivity without referents or dynamics; and the possibility of fully-intelligent-yet-unconscious brain simulations. Here, I describe how these controversies might be resolved by integrating IIT with FEP-AI, where integrated information only entails consciousness for systems with perspectival reference frames capable of generating models with spatial, temporal, and causal coherence for self and world. Without that connection with external reality, systems could have arbitrarily high amounts of integrated information, but nonetheless would not entail subjective experience. I further describe how an integration of these frameworks may contribute to their evolution as unified systems theories and models of emergent causation. Then, inspired by both Global Neuronal Workspace Theory (GNWT) and the Harmonic Brain Modes framework, I describe how streams of consciousness may emerge as an evolving generation of sensorimotor predictions, with the precise composition of experiences depending on the integration abilities of synchronous complexes as self-organizing harmonic modes (SOHMs). These integrating dynamics may be particularly likely to occur via richly connected subnetworks affording body-centric sources of phenomenal binding and executive control. Along these connectivity backbones, SOHMs are proposed to implement turbo coding via loopy message-passing over predictive (autoencoding) networks, thus generating maximum a posteriori estimates as coherent vectors governing neural evolution, with alpha frequencies generating basic awareness, and cross-frequency phase-coupling within theta frequencies for access consciousness and volitional control. These dynamic cores of integrated information also function as global workspaces, centered on posterior cortices, but capable of being entrained with frontal cortices and interoceptive hierarchies, thus affording agentic causation. Integrated World Modeling Theory (IWMT) represents a synthetic approach to understanding minds that reveals compatibility between leading theories of consciousness, thus enabling inferential synergy.

Choosing a Markov blanket

This commentary focuses upon the relationship between two themes in the target article: the ways in which a Markov blanket may be defined and the role of precision and salience in mediating the interactions between what is internal and external to a system. These each rest upon the different perspectives we might take while "choosing" a Markov blanket.