Active Inference: A Process Theory

Nested Selves: Self-Organization and Shared Markov Blankets in Prenatal Development in Humans

The immune system is a central component of organismic function in humans. This paper addresses self-organization of biological systems in relation to-and nested within-other biological systems in pregnancy. Pregnancy constitutes a fundamental state for human embodiment and a key step in the evolution and conservation of our species. While not all humans can be pregnant, our initial state of emerging and growing within another person's body is universal. Hence, the pregnant state does not concern some individuals but all individuals. Indeed, the hierarchical relationship in pregnancy reflects an even earlier autopoietic process in the embryo by which the number of individuals in a single blastoderm is dynamically determined by cell- interactions. The relationship and the interactions between the two self-organizing systems during pregnancy may play a pivotal role in understanding the nature of biological self-organization per se in humans. Specifically, we consider the role of the immune system in biological self-organization in addition to neural/brain systems that furnish us with a sense of self. We examine the complex case of pregnancy, whereby two immune systems need to negotiate the exchange of resources and information in order to maintain viable self-regulation of nested systems. We conclude with a proposal for the mechanisms-that scaffold the complex relationship between two self-organising systems in pregnancy-through the lens of the Active Inference, with a focus on shared Markov blankets.

Information foraging with an oracle

During ecological decisions, such as when foraging for food or selecting a weekend activity, we often have to balance the costs and benefits of exploiting known options versus exploring novel ones. Here, we ask how individuals address such cost-benefit tradeoffs during tasks in which we can either explore by ourselves or seek external advice from an oracle (e.g., a domain expert or recommendation system). To answer this question, we designed two studies in which participants chose between inquiring (at a cost) for expert advice from an oracle, or to search for options without guidance, under manipulations affecting the optimal choice. We found that participants showed a greater propensity to seek expert advice when it was instrumental to increase payoff (study A), and when it reduced choice uncertainty, above and beyond payoff maximization (study B). This latter result was especially apparent in participants with greater trait-level intolerance of uncertainty. Taken together, these results suggest that we seek expert advice for both economic goals (i.e., payoff maximization) and epistemic goals (i.e., uncertainty minimization) and that our decisions to ask or not ask for advice are sensitive to cost-benefit tradeoffs.

Active Predictive Coding: A Unifying Neural Model for Active Perception, Compositional Learning, and Hierarchical Planning

There is growing interest in predictive coding as a model of how the brain learns through predictions and prediction errors. Predictive coding models have traditionally focused on sensory coding and perception. Here we introduce active predictive coding (APC) as a unifying model for perception, action, and cognition. The APC model addresses important open problems in cognitive science and AI, including (1) how we learn compositional representations (e.g., part-whole hierarchies for equivariant vision) and (2) how we solve large-scale planning problems, which are hard for traditional reinforcement learning, by composing complex state dynamics and abstract actions from simpler dynamics and primitive actions. By using hypernetworks, self-supervised learning, and reinforcement learning, APC learns hierarchical world models by combining task-invariant state transition networks and task-dependent policy networks at multiple abstraction levels. We illustrate the applicability of the APC model to active visual perception and hierarchical planning. Our results represent, to our knowledge, the first proof-of-concept demonstration of a unified approach to addressing the part-whole learning problem in vision, the nested reference frames learning problem in cognition, and the integrated state-action hierarchy learning problem in reinforcement learning.

Gestalt's Perspective on Insight: A Recap Based on Recent Behavioral and Neuroscientific Evidence

The Gestalt psychologists' theory of insight problem-solving was based on a direct parallelism between perceptual experience and higher-order forms of cognition (e.g., problem-solving). Similarly, albeit not exclusively, to the sudden recognition of bistable figures, these psychologists contended that problem-solving involves a restructuring of one's initial representation of the problem's elements, leading to a sudden leap of understanding phenomenologically indexed by the "Aha!" feeling. Over the last century, different scholars have discussed the validity of the Gestalt psychologists' perspective, foremost using the behavioral measures available at the time. However, in the last two decades, scientists have gained a deeper understanding of insight problem-solving due to the advancements in cognitive neuroscience. This review aims to provide a retrospective reading of Gestalt theory based on the knowledge accrued by adopting novel paradigms of research and investigating their neurophysiological correlates. Among several key points that the Gestalt psychologists underscored, we focus specifically on the role of the visual system in marking a discrete switch of knowledge into awareness, as well as the perceptual experience and holistic standpoints. While the main goal of this paper is to read the previous theory in light of new evidence, we also hope to initiate an academic discussion and encourage further research about the points we raise.

Path integrals, particular kinds, and strange things

This paper describes a path integral formulation of the free energy principle. The ensuing account expresses the paths or trajectories that a particle takes as it evolves over time. The main results are a method or principle of least action that can be used to emulate the behaviour of particles in open exchange with their external milieu. Particles are defined by a particular partition, in which internal states are individuated from external states by active and sensory blanket states. The variational principle at hand allows one to interpret internal dynamics-of certain kinds of particles-as inferring external states that are hidden behind blanket states. We consider different kinds of particles, and to what extent they can be imbued with an elementary form of inference or sentience. Specifically, we consider the distinction between dissipative and conservative particles, inert and active particles and, finally, ordinary and strange particles. Strange particles can be described as inferring their own actions, endowing them with apparent autonomy or agency. In short-of the kinds of particles afforded by a particular partition-strange kinds may be apt for describing sentient behaviour.

Predictive coding and stochastic resonance as fundamental principles of auditory phantom perception

Mechanistic insight is achieved only when experiments are employed to test formal or computational models. Furthermore, in analogy to lesion studies, phantom perception may serve as a vehicle to understand the fundamental processing principles underlying healthy auditory perception. With a special focus on tinnitus-as the prime example of auditory phantom perception-we review recent work at the intersection of artificial intelligence, psychology and neuroscience. In particular, we discuss why everyone with tinnitus suffers from (at least hidden) hearing loss, but not everyone with hearing loss suffers from tinnitus. We argue that intrinsic neural noise is generated and amplified along the auditory pathway as a compensatory mechanism to restore normal hearing based on adaptive stochastic resonance. The neural noise increase can then be misinterpreted as auditory input and perceived as tinnitus. This mechanism can be formalized in the Bayesian brain framework, where the percept (posterior) assimilates a prior prediction (brain's expectations) and likelihood (bottom-up neural signal). A higher mean and lower variance (i.e. enhanced precision) of the likelihood shifts the posterior, evincing a misinterpretation of sensory evidence, which may be further confounded by plastic changes in the brain that underwrite prior predictions. Hence, two fundamental processing principles provide the most explanatory power for the emergence of auditory phantom perceptions: predictive coding as a top-down and adaptive stochastic resonance as a complementary bottom-up mechanism. We conclude that both principles also play a crucial role in healthy auditory perception. Finally, in the context of neuroscience-inspired artificial intelligence, both processing principles may serve to improve contemporary machine learning techniques.

Modeling face recognition in the predictive coding framework: A combined computational modeling and functional imaging study

The learning of new facial identities and the recognition of familiar faces are crucial processes for social interactions. Recently, a combined computational modeling and functional magnetic resonance imaging (fMRI) study used predictive coding as a biologically plausible framework to model face identity learning and to relate specific model parameters with brain activity (Apps and Tsakiris, Nat Commun 4, 2698, 2013). On the one hand, it was shown that behavioral responses on a two-option face recognition task could be predicted by the level of contextual and facial familiarity in a computational model derived from predictive-coding principles. On the other hand, brain activity in specific brain regions was associated with these parameters. More specifically, brain activity in the superior temporal sulcus (STS) varied with contextual familiarity, whereas activity in the fusiform face area (FFA) covaried with the prediction error parameter that updated facial familiarity. Literature combining fMRI assessments and computational modeling in humans still needs to be expanded. Furthermore, prior results are largely not replicated. The present study was, therefore, specifically set up to replicate these previous findings. Our results support the original findings in two critical aspects. First, on a group level, the behavioral responses were modeled best by the same computational model reported by the original authors. Second, we showed that estimates of these model parameters covary with brain activity in specific, face-sensitive brain regions. Our results thus provide further evidence that the functional properties of the face perception network conform to central principles of predictive coding. However, our study yielded diverging findings on specific computational model parameters reflected in brain activity. On the one hand, we did not find any evidence of a computational involvement of the STS. On the other hand, our results showed that activity in the right FFA was associated with multiple computational model parameters. Our data do not provide evidence for functional segregation between particular face-sensitive brain regions, as previously proposed.

Hierarchical network structure as the source of hierarchical dynamics (power-law frequency spectra) in living and non-living systems: How state-trait continua (body plans, personalities) emerge from first principles in biophysics

Living systems are hierarchical control systems that display a small world network structure. In such structures, many smaller clusters are nested within fewer larger ones, producing a fractal-like structure with a 'power-law' cluster size distribution (a mereology). Just like their structure, the dynamics of living systems shows fractal-like qualities: the timeseries of inner message passing and overt behavior contain high frequencies or 'states' (treble) that are nested within lower frequencies or 'traits' (bass), producing a power-law frequency spectrum that is known as a 'state-trait continuum' in the behavioral sciences. Here, we argue that the power-law dynamics of living systems results from their power-law network structure: organisms 'vertically encode' the deep spatiotemporal structure of their (anticipated) environments, to the effect that many small clusters near the base of the hierarchy produce high frequency signal changes and fewer larger clusters at its top produce ultra-low frequencies. Such ultra-low frequencies exert a tonic regulatory pressure that produces morphological as well as behavioral traits (i.e., body plans and personalities). Nested-modular structure causes higher frequencies to be embedded within lower frequencies, producing a power-law state-trait continuum. At the heart of such dynamics lies the need for efficient energy dissipation through networks of coupled oscillators, which also governs the dynamics of non-living systems (e.q., earthquakes, stock market fluctuations). Since hierarchical structure produces hierarchical dynamics, the development and collapse of hierarchical structure (e.g., during maturation and disease) should leave specific traces in system dynamics (shifts in lower frequencies, i.e. morphological and behavioral traits) that may serve as early warning signs to system failure. The applications of this idea range from (bio)physics and phylogenesis to ontogenesis and clinical medicine.

An Introduction to Predictive Processing Models of Perception and Decision-Making

The predictive processing framework includes a broad set of ideas, which might be articulated and developed in a variety of ways, concerning how the brain may leverage predictive models when implementing perception, cognition, decision-making, and motor control. This article provides an up-to-date introduction to the two most influential theories within this framework: predictive coding and active inference. The first half of the paper (Sections 2-5) reviews the evolution of predictive coding, from early ideas about efficient coding in the visual system to a more general model encompassing perception, cognition, and motor control. The theory is characterized in terms of the claims it makes at Marr's computational, algorithmic, and implementation levels of description, and the conceptual and mathematical connections between predictive coding, Bayesian inference, and variational free energy (a quantity jointly evaluating model accuracy and complexity) are explored. The second half of the paper (Sections 6-8) turns to recent theories of active inference. Like predictive coding, active inference models assume that perceptual and learning processes minimize variational free energy as a means of approximating Bayesian inference in a biologically plausible manner. However, these models focus primarily on planning and decision-making processes that predictive coding models were not developed to address. Under active inference, an agent evaluates potential plans (action sequences) based on their expected free energy (a quantity that combines anticipated reward and information gain). The agent is assumed to represent the world as a partially observable Markov decision process with discrete time and discrete states. Current research applications of active inference models are described, including a range of simulation work, as well as studies fitting models to empirical data. The paper concludes by considering future research directions that will be important for further development of both models.

Playing Brains: The Ethical Challenges Posed by Silicon Sentience and Hybrid Intelligence in DishBrain

The convergence of human and artificial intelligence is currently receiving considerable scholarly attention. Much debate about the resulting Hybrid Minds focuses on the integration of artificial intelligence into the human brain through intelligent brain-computer interfaces as they enter clinical use. In this contribution we discuss a complementary development: the integration of a functional in vitro network of human neurons into an in silico computing environment.To do so, we draw on a recent experiment reporting the creation of silico-biological intelligence as a case study (Kagan et al., 2022b). In this experiment, multielectrode arrays were plated with stem cell-derived human neurons, creating a system which the authors call DishBrain. By embedding the system into a virtual game-world, neural clusters were able to receive electrical input signals from the game-world and to respond appropriately with output signals from pre-assigned motor regions. Using this design, the authors demonstrate how the DishBrain self-organises and successfully learns to play the computer game 'Pong', exhibiting 'sentient' and intelligent behaviour in its virtual environment.The creation of such hybrid, silico-biological intelligence raises numerous ethical challenges. Following the neuroscientific framework embraced by the authors themselves, we discuss the arising ethical challenges in the context of Karl Friston's Free Energy Principle, focusing on the risk of creating synthetic phenomenology. Following the DishBrain's creator's neuroscientific assumptions, we highlight how DishBrain's design may risk bringing about artificial suffering and argue for a congruently cautious approach to such synthetic biological intelligence.

The Projective Consciousness Model: Projective Geometry at the Core of Consciousness and the Integration of Perception, Imagination, Motivation, Emotion, Social Cognition and Action

Consciousness has been described as acting as a global workspace that integrates perception, imagination, emotion and action programming for adaptive decision making. The mechanisms of this workspace and their relationships to the phenomenology of consciousness need to be further specified. Much research in this area has focused on the neural correlates of consciousness, but, arguably, computational modeling can better be used toward this aim. According to the Projective Consciousness Model (PCM), consciousness is structured as a viewpoint-organized, internal space, relying on 3D projective geometry and governed by the action of the Projective Group as part of a process of active inference. The geometry induces a group-structured subjective perspective on an encoded world model, enabling adaptive perspective taking in agents. Here, we review and discuss the PCM. We emphasize the role of projective mechanisms in perception and the appraisal of affective and epistemic values as tied to the motivation of action, under an optimization process of Free Energy minimization, or more generally stochastic optimal control. We discuss how these mechanisms enable us to model and simulate group-structured drives in the context of social cognition and to understand the mechanisms underpinning empathy, emotion expression and regulation, and approach-avoidance behaviors. We review previous results, drawing on applications in robotics and virtual humans. We briefly discuss future axes of research relating to applications of the model to simulation- and model-based behavioral science, geometrically structured artificial neural networks, the relevance of the approach for explainable AI and human-machine interactions, and the study of the neural correlates of consciousness.

A functional account of stimulation-based aerobic glycolysis and its role in interpreting BOLD signal intensity increases in neuroimaging experiments

In aerobic glycolysis, oxygen is abundant, and yet cells metabolize glucose without using it, decreasing their ATP per glucose yield by 15-fold. During task-based stimulation, aerobic glycolysis occurs in localized brain regions, presenting a puzzle: why produce ATP inefficiently when, all else being equal, evolution should favor the efficient use of metabolic resources? The answer is that all else is not equal. We propose that a tradeoff exists between efficient ATP production and the efficiency with which ATP is spent to transmit information. Aerobic glycolysis, despite yielding little ATP per glucose, may support neuronal signaling in thin (< 0.5 µm), information-efficient axons. We call this the efficiency tradeoff hypothesis. This tradeoff has potential implications for interpretations of task-related BOLD "activation" observed in fMRI. We hypothesize that BOLD "activation" may index local increases in aerobic glycolysis, which support signaling in thin axons carrying "bottom-up" information, or "prediction error"-i.e., the BIAPEM (BOLD increases approximate prediction error metabolism) hypothesis. Finally, we explore implications of our hypotheses for human brain evolution, social behavior, and mental disorders.

The interpersonal computational psychiatry of social coordination in schizophrenia

Impairments in social coordination form a core dimension of various psychiatric disorders, including schizophrenia. Advances in interpersonal and computational psychiatry support a major change in studying social coordination in schizophrenia. Although these developments provided novel perspectives to study how interpersonal activities shape coordination and to examine computational mechanisms, direct attempts to integrate the two methodologies have been sparse. Here, we propose an interpersonal computational framework that (1) leverages the active inference framework to model aberrant social coordination processes in schizophrenia and (2) incorporates dynamical system models to dissect intrapersonal and interpersonal synchronisation to inform a statistical model based on active inference. We discuss how this interpersonal computational psychiatry framework can elucidate the aberrant processes leading to psychopathology, with schizophrenia as an example, and highlight how it might aid clinical intervention and practice. Finally, we discuss challenges and opportunities for using the framework in studying social coordination impairments.

Active Vision in Binocular Depth Estimation: A Top-Down Perspective

Depth estimation is an ill-posed problem; objects of different shapes or dimensions, even if at different distances, may project to the same image on the retina. Our brain uses several cues for depth estimation, including monocular cues such as motion parallax and binocular cues such as diplopia. However, it remains unclear how the computations required for depth estimation are implemented in biologically plausible ways. State-of-the-art approaches to depth estimation based on deep neural networks implicitly describe the brain as a hierarchical feature detector. Instead, in this paper we propose an alternative approach that casts depth estimation as a problem of active inference. We show that depth can be inferred by inverting a hierarchical generative model that simultaneously predicts the eyes' projections from a 2D belief over an object. Model inversion consists of a series of biologically plausible homogeneous transformations based on Predictive Coding principles. Under the plausible assumption of a nonuniform fovea resolution, depth estimation favors an active vision strategy that fixates the object with the eyes, rendering the depth belief more accurate. This strategy is not realized by first fixating on a target and then estimating the depth; instead, it combines the two processes through action-perception cycles, with a similar mechanism of the saccades during object recognition. The proposed approach requires only local (top-down and bottom-up) message passing, which can be implemented in biologically plausible neural circuits.

Lifeworlds in pain: a principled method for investigation and intervention

The experience of pain spans biological, psychological and sociocultural realms, both basic and complex, it is by turns necessary and devastating. Despite an extensive knowledge of the constituents of pain, the ability to translate this into effective intervention remains limited. It is suggested that current, multiscale, medical approaches, largely informed by the biopsychosocial (BPS) model, attempt to integrate knowledge but are undermined by an epistemological obligation, one that necessitates a prior isolation of the constituent parts. To overcome this impasse, we propose that an anthropological stance needs to be taken, underpinned by a Bayesian apparatus situated in computational psychiatry. Here, pain is presented within the context of lifeworlds, where attention is shifted away from the constituents of experience (e.g. nociception, reward processing and fear-avoidance), towards the dynamic affiliation that occurs between these processes over time. We argue that one can derive a principled method of investigation and intervention for pain from modelling approaches in computational psychiatry. We suggest that these modelling methods provide the necessary apparatus to navigate multiscale ontology and epistemology of pain. Finally, a unified approach to the experience of pain is presented, where the relational, inter-subjective phenomenology of pain is brought into contact with a principled method of translation; in so doing, revealing the conditions and possibilities of lifeworlds in pain.

Body as First Teacher: The Role of Rhythmic Visceral Dynamics in Early Cognitive Development

Embodied cognition-the idea that mental states and processes should be understood in relation to one's bodily constitution and interactions with the world-remains a controversial topic within cognitive science. Recently, however, increasing interest in predictive processing theories among proponents and critics of embodiment alike has raised hopes of a reconciliation. This article sets out to appraise the unificatory potential of predictive processing, focusing in particular on embodied formulations of active inference. Our analysis suggests that most active-inference accounts invoke weak, potentially trivial conceptions of embodiment; those making stronger claims do so independently of the theoretical commitments of the active-inference framework. We argue that a more compelling version of embodied active inference can be motivated by adopting a diachronic perspective on the way rhythmic physiological activity shapes neural development in utero. According to this visceral afferent training hypothesis, early-emerging physiological processes are essential not only for supporting the biophysical development of neural structures but also for configuring the cognitive architecture those structures entail. Focusing in particular on the cardiovascular system, we propose three candidate mechanisms through which visceral afferent training might operate: (a) activity-dependent neuronal development, (b) periodic signal modeling, and (c) oscillatory network coordination.

An active inference model of hierarchical action understanding, learning and imitation

We advance a novel active inference model of the cognitive processing that underlies the acquisition of a hierarchical action repertoire and its use for observation, understanding and imitation. We illustrate the model in four simulations of a tennis learner who observes a teacher performing tennis shots, forms hierarchical representations of the observed actions, and imitates them. Our simulations show that the agent's oculomotor activity implements an active information sampling strategy that permits inferring the kinematic aspects of the observed movement, which lie at the lowest level of the action hierarchy. In turn, this low-level kinematic inference supports higher-level inferences about deeper aspects of the observed actions: proximal goals and intentions. Finally, the inferred action representations can steer imitative responses, but interfere with the execution of different actions. Our simulations show that hierarchical active inference provides a unified account of action observation, understanding, learning and imitation and helps explain the neurobiological underpinnings of visuomotor cognition, including the multiple routes for action understanding in the dorsal and ventral streams and mirror mechanisms.

Electrophysiological connectivity of logical deduction: Early cortical MEG study

Complex human reasoning involves minimal abilities to extract conclusions implied in the available information. These abilities are considered "deductive" because they exemplify certain abstract relations among propositions or probabilities called deductive arguments. However, the electrophysiological dynamics which supports such complex cognitive processes has not been addressed yet. In this work we consider typically deductive logico-probabilistically valid inferences and aim to verify or refute their electrophysiological functional connectivity differences from invalid inferences with the same content (same relational variables, same stimuli, same relevant and salient features). We recorded the brain electrophysiological activity of 20 participants (age = 20.35 ± 3.23) by means of an MEG system during two consecutive reasoning tasks: a search task (invalid condition) without any specific deductive rules to follow, and a logically valid deductive task (valid condition) with explicit deductive rules as instructions. We calculated the functional connectivity (FC) for each condition and conducted a seed-based analysis in a set of cortical regions of interest. Finally, we used a cluster-based permutation test to compare the differences between logically valid and invalid conditions in terms of FC. As a first novel result we found higher FC for valid condition in beta band between regions of interest and left prefrontal, temporal, parietal, and cingulate structures. FC analysis allows a second novel result which is the definition of a propositional network with operculo-cingular, parietal and medial nodes, specifically including disputed medial deductive "core" areas. The experiment discloses measurable cortical processes which do not depend on content but on truth-functional propositional operators. These experimental novelties may contribute to understand the cortical bases of deductive processes.

Resilience as the Ability to Maintain Well-Being: An Allostatic Active Inference Model

Resilience is often characterized as the outcome of well-being maintenance despite threats to that well-being. We suggest that resilience can also be characterized as an emotional-intelligence-related ability to obtain this outcome. We formulate an allostatic active inference model that outlines the primary tools of this resilience ability as monitoring well-being, maintaining stable well-being beliefs while updating situational beliefs and flexibly prioritizing actions that are expected to lead to well-being maintenance or gathering the information needed to discern what those actions could be. This model helps to explain the role of positive emotions in resilience as well as how people high in resilience ability use regulatory flexibility in the service of maintaining well-being and provides a starting point for assessing resilience as an ability.

Experimental validation of the free-energy principle with in vitro neural networks

Empirical applications of the free-energy principle are not straightforward because they entail a commitment to a particular process theory, especially at the cellular and synaptic levels. Using a recently established reverse engineering technique, we confirm the quantitative predictions of the free-energy principle using in vitro networks of rat cortical neurons that perform causal inference. Upon receiving electrical stimuli-generated by mixing two hidden sources-neurons self-organised to selectively encode the two sources. Pharmacological up- and downregulation of network excitability disrupted the ensuing inference, consistent with changes in prior beliefs about hidden sources. As predicted, changes in effective synaptic connectivity reduced variational free energy, where the connection strengths encoded parameters of the generative model. In short, we show that variational free energy minimisation can quantitatively predict the self-organisation of neuronal networks, in terms of their responses and plasticity. These results demonstrate the applicability of the free-energy principle to in vitro neural networks and establish its predictive validity in this setting.

Exploring cognitive individuality and the underlying creativity in statistical learning and phase entrainment

Statistical learning starts at an early age and is intimately linked to brain development and the emergence of individuality. Through such a long period of statistical learning, the brain updates and constructs statistical models, with the model's individuality changing based on the type and degree of stimulation received. However, the detailed mechanisms underlying this process are unknown. This paper argues three main points of statistical learning, including 1) cognitive individuality based on "reliability" of prediction, 2) the construction of information "hierarchy" through chunking, and 3) the acquisition of "1-3Hz rhythm" that is essential for early language and music learning. We developed a Hierarchical Bayesian Statistical Learning (HBSL) model that takes into account both reliability and hierarchy, mimicking the statistical learning processes of the brain. Using this model, we conducted a simulation experiment to visualize the temporal dynamics of perception and production processes through statistical learning. By modulating the sensitivity to sound stimuli, we simulated three cognitive models with different reliability on bottom-up sensory stimuli relative to top-down prior prediction: hypo-sensitive, normal-sensitive, and hyper-sensitive models. We suggested that statistical learning plays a crucial role in the acquisition of 1-3 Hz rhythm. Moreover, a hyper-sensitive model quickly learned the sensory statistics but became fixated on their internal model, making it difficult to generate new information, whereas a hypo-sensitive model has lower learning efficiency but may be more likely to generate new information. Various individual characteristics may not necessarily confer an overall advantage over others, as there may be a trade-off between learning efficiency and the ease of generating new information. This study has the potential to shed light on the heterogeneous nature of statistical learning, as well as the paradoxical phenomenon in which individuals with certain cognitive traits that impede specific types of perceptual abilities exhibit superior performance in creative contexts.

A Goal-Directed Trajectory Planning Using Active Inference in UAV-Assisted Wireless Networks

Deploying unmanned aerial vehicles (UAVs) as aerial base stations is an exceptional approach to reinforce terrestrial infrastructure owing to their remarkable flexibility and superior agility. However, it is essential to design their flight trajectory effectively to make the most of UAV-assisted wireless communications. This paper presents a novel method for improving wireless connectivity between UAVs and terrestrial users through effective path planning. This is achieved by developing a goal-directed trajectory planning method using active inference. First, we create a global dictionary using traveling salesman problem with profits (TSPWP) instances executed on various training examples. This dictionary represents the world model and contains letters representing available hotspots, tokens representing local paths, and words depicting complete trajectories and hotspot order. By using this world model, the UAV can understand the TSPWP's decision-making grammar and how to use the available letters to form tokens and words at various levels of abstraction and time scales. With this knowledge, the UAV can assess encountered situations and deduce optimal routes based on the belief encoded in the world model. Our proposed method outperforms traditional Q-learning by providing fast, stable, and reliable solutions with good generalization ability.

Introducing tomsup: Theory of mind simulations using Python

Theory of mind (ToM) is considered crucial for understanding social-cognitive abilities and impairments. However, verbal theories of the mechanisms underlying ToM are often criticized as under-specified and mutually incompatible. This leads to measures of ToM being unreliable, to the extent that even canonical experimental tasks do not require representation of others' mental states. There have been attempts at making computational models of ToM, but these are not easily available for broad research application. In order to help meet these challenges, we here introduce the Python package tomsup: Theory of mind simulations using Python. The package provides a computational eco-system for investigating and comparing computational models of hypothesized ToM mechanisms and for using them as experimental stimuli. The package notably includes an easy-to-use implementation of the variational recursive Bayesian k-ToM model developed by (Devaine, Hollard, & Daunizeau, 2014b) and of simpler non-recursive decision models, for comparison. We provide a series of tutorials on how to: (i) simulate agents relying on the k-ToM model and on a range of simpler types of mechanisms; (ii) employ those agents to generate online experimental stimuli; (iii) analyze the data generated in such experimental setup, and (iv) specify new custom ToM and heuristic cognitive models.

Cortical and subcortical mapping of the allostatic-interoceptive system in the human brain: replication and extension with 7 Tesla fMRI

The brain continuously anticipates the energetic needs of the body and prepares to meet those needs before they arise, a process called allostasis. In support of allostasis, the brain continually models the internal state of the body, a process called interoception. Using published tract-tracing studies in non-human animals as a guide, we previously identified a large-scale system supporting allostasis and interoception in the human brain with functional magnetic resonance imaging (fMRI) at 3 Tesla. In the present study, we replicated and extended this system in humans using 7 Tesla fMRI (N = 91), improving the precision of subgenual and pregenual anterior cingulate topography as well as brainstem nuclei mapping. We verified over 90% of the anatomical connections in the hypothesized allostatic-interoceptive system observed in non-human animal research. We also identified functional connectivity hubs verified in tract-tracing studies but not previously detected using 3 Tesla fMRI. Finally, we demonstrated that individuals with stronger fMRI connectivity between system hubs self-reported greater interoceptive awareness, building on construct validity evidence from our earlier paper. Taken together, these results strengthen evidence for the existence of a whole-brain system supporting interoception in the service of allostasis and we consider the implications for mental and physical health.

Metacognitive effects of attitudinal (in)congruence on social media: relating processing fluency, subjective knowledge, and political participation

Introduction

Encountering political disagreements in our daily lives can discourage us from participating in democratic processes. To date, research has mainly focused on social motives or attitudinal mechanisms to explain this phenomenon. In the present study, we adopt a different approach and highlight metacognitive effects of attitudinal (in)congruence on processing fluency (i.e., perceived ease of processing) and subjective knowledge as well as their relationship with behavioral outcomes such as the intention to politically participate.

Methods

In a pre-registered online experiment (N = 1,258), participants saw a political social media post with six opinionated user-generated comments. These comments either all matched (congruent condition) or contradicted (incongruent condition) participants' personal opinions. Processing fluency, issue specific subjective knowledge, and intention to politically participate were then measured using established self-report scales.

Results

In line with our hypotheses, the congruent stimuli evoked a higher feeling of processing fluency than the incongruent ones (d = 0.21). Furthermore, participants in the congruent condition indicated a higher intention to politically participate (d = 0.23) and rated their own knowledge on the topic as higher (d = 0.22) than participants in the incongruent condition-even though the factual knowledge gain should be equal in both conditions. Finally, we observed positive relationships between processing fluency and subjective issue knowledge (β = 0.11) as well as between subjective issue knowledge and issue-specific political participation (β = 0.43).

Discussion

Our findings highlight the importance of considering metacognitive constructs such as subjective knowledge to explain political behaviors and suggest that attitudinal congruence influences the way we perceive our own knowledge and information processing.

Biased belief updating in depression

Cognitive approaches to depression have benefitted from recent research on belief updating, examining how new information is used to alter beliefs. This review presents recent advances in understanding various sources of bias in belief updating in depression. Specifically, research has demonstrated that people with depression have difficulty revising negative beliefs in response to novel positive information, whereas belief updating in depression is not related to an enhanced integration of negative information. In terms of mechanisms underlying the deficient processing of positive information, research has shown that people with depression use defensive cognitive strategies to devalue novel positive information. Furthermore, the disregard of novel positive information can be amplified by the presence of state negative affect, and the resulting persistence of negative beliefs in turn perpetuates chronically low mood, contributing to a self-reinforcing negative feedback loop of beliefs and affect. Synthesising previous research, this review proposes a coherent framework of when belief change is likely to occur, and argues that future research also needs to elucidate why people with depression hesitate to abandon negative beliefs. Recent insights from belief updating have not only improved the understanding of the psychopathology of depression, but also have the potential to improve its cognitive-behavioural treatment.

Electrical analysis of logical complexity: an exploratory eeg study of logically valid/invalid deducive inference

INTRODUCTION

Logically valid deductive arguments are clear examples of abstract recursive computational procedures on propositions or on probabilities. However, it is not known if the cortical time-consuming inferential processes in which logical arguments are eventually realized in the brain are in fact physically different from other kinds of inferential processes.

METHODS

In order to determine whether an electrical EEG discernible pattern of logical deduction exists or not, a new experimental paradigm is proposed contrasting logically valid and invalid inferences with exactly the same content (same premises and same relational variables) and distinct logical complexity (propositional truth-functional operators). Electroencephalographic signals from 19 subjects (24.2 ± 3.3 years) were acquired in a two-condition paradigm (100 trials for each condition). After the initial general analysis, a trial-by-trial approach in beta-2 band allowed to uncover not only evoked but also phase asynchronous activity between trials.

RESULTS

showed that (i) deductive inferences with the same content evoked the same response pattern in logically valid and invalid conditions, (ii) mean response time in logically valid inferences is 61.54% higher, (iii) logically valid inferences are subjected to an early (400 ms) and a late reprocessing (600 ms) verified by two distinct beta-2 activations (p-value < 0,01, Wilcoxon signed rank test).

CONCLUSION

We found evidence of a subtle but measurable electrical trait of logical validity. Results put forward the hypothesis that some logically valid deductions are recursive or computational cortical events.

Cognitive effort and active inference

This paper aims to integrate some key constructs in the cognitive neuroscience of cognitive control and executive function by formalising the notion of cognitive (or mental) effort in terms of active inference. To do so, we call upon a task used in neuropsychology to assess impulse inhibition-a Stroop task. In this task, participants must suppress the impulse to read a colour word and instead report the colour of the text of the word. The Stroop task is characteristically effortful, and we unpack a theory of mental effort in which, to perform this task accurately, participants must overcome prior beliefs about how they would normally act. However, our interest here is not in overt action, but in covert (mental) action. Mental actions change our beliefs but have no (direct) effect on the outside world-much like deploying covert attention. This account of effort as mental action lets us generate multimodal (choice, reaction time, and electrophysiological) data of the sort we might expect from a human participant engaging in this task. We analyse how parameters determining cognitive effort influence simulated responses and demonstrate that-when provided only with performance data-these parameters can be recovered, provided they are within a certain range.

Free energy and inference in living systems

Organisms are non-equilibrium, stationary systems self-organized via spontaneous symmetry breaking and undergoing metabolic cycles with broken detailed balance in the environment. The thermodynamic free-energy (FE) principle describes an organism's homeostasis as the regulation of biochemical work constrained by the physical FE cost. By contrast, recent research in neuroscience and theoretical biology explains a higher organism's homeostasis and allostasis as Bayesian inference facilitated by the informational FE. As an integrated approach to living systems, this study presents an FE minimization theory overarching the essential features of both the thermodynamic and neuroscientific FE principles. Our results reveal that the perception and action of animals result from active inference entailed by FE minimization in the brain, and the brain operates as a Schrödinger's machine conducting the neural mechanics of minimizing sensory uncertainty. A parsimonious model suggests that the Bayesian brain develops the optimal trajectories in neural manifolds and induces a dynamic bifurcation between neural attractors in the process of active inference.

How uncertain are you? Disentangling expected and unexpected uncertainty in pupil-linked brain arousal during reversal learning

During decision making, we are continuously faced with two sources of uncertainty regarding the links between stimuli, our actions, and outcomes. On the one hand, our expectations are often probabilistic, that is, stimuli or actions yield the expected outcome only with a certain probability (expected uncertainty). On the other hand, expectations might become invalid due to sudden, unexpected changes in the environment (unexpected uncertainty). Several lines of research show that pupil-linked brain arousal is a sensitive indirect measure of brain mechanisms underlying uncertainty computations. Thus, we investigated whether it is involved in disentangling these two forms of uncertainty. To this aim, we measured pupil size during a probabilistic reversal learning task. In this task, participants had to figure out which of two response options led to reward with higher probability, whereby sometimes the identity of the more advantageous response option was switched. Expected uncertainty was manipulated by varying the reward probability of the advantageous choice option, whereas the level of unexpected uncertainty was assessed by using a Bayesian computational model estimating change probability and resulting uncertainty. We found that both aspects of unexpected uncertainty influenced pupil responses, confirming that pupil-linked brain arousal is involved in model updating after unexpected changes in the environment. Furthermore, high level of expected uncertainty impeded the detection of sudden changes in the environment, both on physiological and behavioral level. These results emphasize the role of pupil-linked brain arousal and underlying neural structures in handling situations in which the previously established contingencies are no longer valid.

"Getting on the same page" enhancing team performance with shared mental models-case studies of evidence informed practice in elite sport

Within high performing, team invasion sports, collective decision making and coordination between teammates are essential characteristics. There is a wealth of evidence supportive of shared mental models as being an important construct to underpin team coordination. Yet, to this point, there is limited research considering the coaches' voices in the application of shared mental models in high performance sport, nor the challenges coaches face throughout the process. Given these limitations, we provide two case studies of evidence informed practice which privilege the voice of coaches who work in elite rugby union. In doing so, we aim to offer a deeper insight regarding the development, implementation, and continued use of shared mental models to enhance performance. Through these first-person case studies, we present the development of two shared mental models and the processes taken, challenges faced, and coaching methods used to underpin them. The case studies are then discussed with implications for coaches' practice supporting the development of their players' collective decision making.

Studying brains what could neurometaphysics be to NeurotechEU?

NeurotechEU has introduced a new conceptual hierarchy for neuroscientific research and its applications along 8 different core research areas, including the so-called 'neurometaphysics'. This paper explores this concept of neurometaphysics, its topics and its potential approach. It warns against an endemic Cartesianism in (neuro)science that somehow seems to survive explicit refutations by implicitly persisting in our conceptual scheme. Two consequences of this persisting Cartesian legacy are discussed; the isolated brain assumption and the idea that activity requires identifiable neural 'decisions'. Neuropragmatism is introduced as offering the promise of progress in neurometaphysics, by emphasizing that (1) studying brains interact organically with their environment and (2) studying brains requires an attitude of continuous learning.

Regulative development as a model for origin of life and artificial life studies

Using the formal framework of the Free Energy Principle, we show how generic thermodynamic requirements on bidirectional information exchange between a system and its environment can generate complexity. This leads to the emergence of hierarchical computational architectures in systems that operate sufficiently far from thermal equilibrium. In this setting, the environment of any system increases its ability to predict system behavior by "engineering" the system towards increased morphological complexity and hence larger-scale, more macroscopic behaviors. When seen in this light, regulative development becomes an environmentally-driven process in which "parts" are assembled to produce a system with predictable behavior. We suggest on this basis that life is thermodynamically favorable and that, when designing artificial living systems, human engineers are acting like a generic "environment".

The brain is not mental! coupling neuronal and immune cellular processing in human organisms

Significant efforts have been made in the past decades to understand how mental and cognitive processes are underpinned by neural mechanisms in the brain. This paper argues that a promising way forward in understanding the nature of human cognition is to zoom out from the prevailing picture focusing on its neural basis. It considers instead how neurons work in tandem with other type of cells (e.g., immune) to subserve biological self-organization and adaptive behavior of the human organism as a whole. We focus specifically on the immune cellular processing as key actor in complementing neuronal processing in achieving successful self-organization and adaptation of the human body in an ever-changing environment. We overview theoretical work and empirical evidence on "basal cognition" challenging the idea that only the neuronal cells in the brain have the exclusive ability to "learn" or "cognize." The focus on cellular rather than neural, brain processing underscores the idea that flexible responses to fluctuations in the environment require a carefully crafted orchestration of multiple cellular and bodily systems at multiple organizational levels of the biological organism. Hence cognition can be seen as a multiscale web of dynamic information processing distributed across a vast array of complex cellular (e.g., neuronal, immune, and others) and network systems, operating across the entire body, and not just in the brain. Ultimately, this paper builds up toward the radical claim that cognition should not be confined to one system alone, namely, the neural system in the brain, no matter how sophisticated the latter notoriously is.

Decoding reward-curiosity conflict in decision-making from irrational behaviors

Humans and animals are not always rational. They not only rationally exploit rewards but also explore an environment owing to their curiosity. However, the mechanism of such curiosity-driven irrational behavior is largely unknown. Here, we developed a decision-making model for a two-choice task based on the free energy principle, which is a theory integrating recognition and action selection. The model describes irrational behaviors depending on the curiosity level. We also proposed a machine learning method to decode temporal curiosity from behavioral data. By applying it to rat behavioral data, we found that the rat had negative curiosity, reflecting conservative selection sticking to more certain options and that the level of curiosity was upregulated by the expected future information obtained from an uncertain environment. Our decoding approach can be a fundamental tool for identifying the neural basis for reward-curiosity conflicts. Furthermore, it could be effective in diagnosing mental disorders.

Correspondence of functional connectivity gradients across human isocortex, cerebellum, and hippocampus

Gradient mapping is an important technique to summarize high dimensional biological features as low dimensional manifold representations in exploring brain structure-function relationships at various levels of the cerebral cortex. While recent studies have characterized the major gradients of functional connectivity in several brain structures using this technique, very few have systematically examined the correspondence of such gradients across structures under a common systems-level framework. Using resting-state functional magnetic resonance imaging, here we show that the organizing principles of the isocortex, and those of the cerebellum and hippocampus in relation to the isocortex, can be described using two common functional gradients. We suggest that the similarity in functional connectivity gradients across these structures can be meaningfully interpreted within a common computational framework based on the principles of predictive processing. The present results, and the specific hypotheses that they suggest, represent an important step toward an integrative account of brain function.

Quantifying aberrant approach-avoidance conflict in psychopathology: A review of computational approaches

Making effective decisions during approach-avoidance conflict is critical in daily life. Aberrant decision-making during approach-avoidance conflict is evident in a range of psychological disorders, including anxiety, depression, trauma-related disorders, substance use disorders, and alcohol use disorders. To help clarify etiological pathways and reveal novel intervention targets, clinical research into decision-making is increasingly adopting a computational psychopathology approach. This approach uses mathematical models that can identify specific decision-making related processes that are altered in mental health disorders. In our review, we highlight foundational approach-avoidance conflict research, followed by more in-depth discussion of computational approaches that have been used to model behavior in these tasks. Specifically, we describe the computational models that have been applied to approach-avoidance conflict (e.g., drift-diffusion, active inference, and reinforcement learning models), and provide resources to guide clinical researchers who may be interested in applying computational modeling. Finally, we identify notable gaps in the current literature and potential future directions for computational approaches aimed at identifying mechanisms of approach-avoidance conflict in psychopathology.

Where is the mind within the brain? Transient selection of subnetworks by metabotropic receptors and G protein-gated ion channels

Perhaps the most important question posed by brain research is: How the brain gives rise to the mind. To answer this question, we have primarily relied on the connectionist paradigm: The brain's entire knowledge and thinking skills are thought to be stored in the connections; and the mental operations are executed by network computations. I propose here an alternative paradigm: Our knowledge and skills are stored in metabotropic receptors (MRs) and the G protein-gated ion channels (GPGICs). Here, mental operations are assumed to be executed by the functions of MRs and GPGICs. As GPGICs have the capacity to close or open branches of dendritic trees and axon terminals, their states transiently re-route neural activity throughout the nervous system. First, MRs detect ligands that signal the need to activate GPGICs. Next, GPGICs transiently select a subnetwork within the brain. The process of selecting this new subnetwork is what constitutes a mental operation - be it in a form of directed attention, perception or making a decision. Synaptic connections and network computations play only a secondary role, supporting MRs and GPGICs. According to this new paradigm, the mind emerges within the brain as the function of MRs and GPGICs whose primary function is to continually select the pathways over which neural activity will be allowed to pass. It is argued that MRs and GPGICs solve the scaling problem of intelligence from which the connectionism paradigm suffers.

[Mother brain: Bayesian theory of maternal interoception during pregnancy and postpartum]

The perinatal period, including pregnancy and postpartum, causes major morphological, endocrinal, and thermal transitions in women. As the fetus grows, abdominal muscle fibers stretch, internal organs such as the bladder or colon move, and the uterine anatomy changes. Many of these changes involve interoception, the perception of internal body signals such as muscle and visceral sensations. Despite the importance of these interoceptive signals, few studies have explored perinatal interoception. We propose an innovative theory of maternal interoception based on recent findings in neuroscience. We show that interoceptive signals processing during pregnancy is crucial for understanding perinatal phenomenology and psychopathology, such as maternal perception of fetal movements, maternal-infant bonding, denial of pregnancy, phantom fetal movements after childbirth, pseudocyesis or even puerperal delusion. Knowing the importance of these interoceptive mechanisms, clinicians in obstetrics, gynecology and mental health should be particularly vigilant to maternal interoception during the perinatal period.

The neurobiology of functional neurological disorders characterised by impaired awareness

We review the neurobiology of Functional Neurological Disorders (FND), i.e., neurological disorders not explained by currently identifiable histopathological processes, in order to focus on those characterised by impaired awareness (functionally impaired awareness disorders, FIAD), and especially, on the paradigmatic case of Resignation Syndrome (RS). We thus provide an improved more integrated theory of FIAD, able to guide both research priorities and the diagnostic formulation of FIAD. We systematically address the diverse spectrum of clinical presentations of FND with impaired awareness, and offer a new framework for understanding FIAD. We find that unraveling the historical development of neurobiological theory of FIAD is of paramount importance for its current understanding. Then, we integrate contemporary clinical material in order to contextualise the neurobiology of FIAD within social, cultural, and psychological perspectives. We thus review neuro-computational insights in FND in general, to arrive at a more coherent account of FIAD. FIAD may be based on maladaptive predictive coding, shaped by stress, attention, uncertainty, and, ultimately, neurally encoded beliefs and their updates. We also critically appraise arguments in support of and against such Bayesian models. Finally, we discuss implications of our theoretical account and provide pointers towards an improved clinical diagnostic formulation of FIAD. We suggest directions for future research towards a more unified theory on which future interventions and management strategies could be based, as effective treatments and clinical trial evidence remain limited.

A key role of the hippocampal P3 in the attentional blink

The attentional blink (AB) refers to an impaired identification of target stimuli (T2), which are presented shortly after a prior target (T1) within a rapid serial visual presentation (RSVP) stream. It has been suggested that the AB is related to a failed transfer of T2 into working memory and that hippocampus (HC) and entorhinal cortex (EC) are regions crucial for this transfer. Since the event-related P3 component has been linked to inhibitory processes, we hypothesized that the hippocampal P3 elicited by T1 may impact on T2 processing within HC and EC. To test this hypothesis, we reanalyzed microwire data from 21 patients, who performed an RSVP task, during intracranial recordings for epilepsy surgery assessment (Reber et al., 2017). We identified T1-related hippocampal P3 components in the local field potentials (LFPs) and determined the temporal onset of T2 processing in HC/EC based on single-unit response onset activity. In accordance with our hypothesis, T1-related single-trial P3 amplitudes at the onset of T2 processing were clearly larger for unseen compared to seen T2-stimuli. Moreover, increased T1-related single-trial P3 peak latencies were found for T2[unseen] versus T2[seen] trials in case of lags 1 to 3, which was in line with our predictions. In conclusion, our findings support inhibition models of the AB and indicate that the hippocampal P3 elicited by T1 plays a central role in the AB.

Inferring Causal Factors of Core Affect Dynamics on Social Participation through the Lens of the Observer

A core endeavour in current affective computing and social signal processing research is the construction of datasets embedding suitable ground truths to foster machine learning methods. This practice brings up hitherto overlooked intricacies. In this paper, we consider causal factors potentially arising when human raters evaluate the affect fluctuations of subjects involved in dyadic interactions and subsequently categorise them in terms of social participation traits. To gauge such factors, we propose an emulator as a statistical approximation of the human rater, and we first discuss the motivations and the rationale behind the approach.The emulator is laid down in the next section as a phenomenological model where the core affect stochastic dynamics as perceived by the rater are captured through an Ornstein-Uhlenbeck process; its parameters are then exploited to infer potential causal effects in the attribution of social traits. Following that, by resorting to a publicly available dataset, the adequacy of the model is evaluated in terms of both human raters' emulation and machine learning predictive capabilities. We then present the results, which are followed by a general discussion concerning findings and their implications, together with advantages and potential applications of the approach.

To copy or not to copy? That is the question! From chimpanzees to the foundation of human technological culture

A prerequisite for copying innovative behaviour faithfully is the capacity of observers' brains, regarded as 'hierarchically mechanistic minds', to overcome cognitive 'surprisal' (see 2.), by maximising the evidence for their internal models, through active inference. Unlike modern humans, chimpanzees and other great apes show considerable limitations in their ability, or 'Zone of Bounded Surprisal', to overcome cognitive surprisal induced by innovative or unorthodox behaviour that rarely, therefore, is copied precisely or accurately. Most can copy adequately what is within their phenotypically habitual behavioural repertoire, in which technology plays scant part. Widespread intra- and intergenerational social transmission of complex technological innovations is not a hall-mark of great-ape taxa. 3 Ma, precursors of the genus Homo made stone artefacts, and stone-flaking likely was habitual before 2 Ma. After that time, early Homo erectus has left traces of technological innovations, though faithful copying of these and their intra- and intergenerational social transmission were rare before 1 Ma. This likely owed to a cerebral infrastructure of interconnected neuronal systems more limited than ours. Brains were smaller in size than ours, and cerebral neuronal systems ceased to develop when early Homo erectus attained full adult maturity by the mid-teen years, whereas its development continues until our mid-twenties nowadays. Pleistocene Homo underwent remarkable evolutionary adaptation of neurobiological propensities, and cerebral aspects are discussed that, it is proposed here, plausibly, were fundamental for faithful copying, which underpinned social transmission of technologies, cumulative learning, and culture. Here, observers' responses to an innovation are more important for ensuring its transmission than is an innovator's production of it, because, by themselves, the minimal cognitive prerequisites that are needed for encoding and assimilating innovations are insufficient for practical outcomes to accumulate and spread intra- and intergenerationally.

Reconfiguration of response-set in task switching: Event-related potential evidence

In task switching, an interaction between task and response is often observed, with response repetition (RR) benefits in task-repeat trials and RR costs in task-switch trials. The theoretical accounts of the RR effect remain controversial, and neuroscience evidence is scarce. The present study utilized the event-related potentials (ERPs) method to explore the neural mechanism underlying the RR effect by adopting a cued task-switching paradigm. The ERP results revealed the interaction between task and response in the P3b time window, with a response switch positivity under task-repetition conditions and an RR positivity under task-switching conditions. In addition, there were RR positivity in the N2 irrespective of task transition and in the late component (LC, 550-600 ms) that only under the task repetition condition. On the individual level, the RR benefit positively correlated with the RR positivity in the LC, while the RR costs negatively correlated with RR positivity in the N2/P3 component. These results suggest that both response reconfiguration and episodic-retrieval make contributions to the RR effects, which were also discussed in terms of predictive model for a domain-general inference and learning of perceptual categories.

Evidence for entropy maximisation in human free choice behaviour

The freedom to choose between options is strongly linked to notions of free will. Accordingly, several studies have shown that individuals demonstrate a preference for choice, or the availability of multiple options, over and above utilitarian value. Yet we lack a decision-making framework that integrates preference for choice with traditional utility maximisation in free choice behaviour. Here we test the predictions of an inference-based model of decision-making in which an agent actively seeks states yielding entropy (availability of options) in addition to utility (economic reward). We designed a study in which participants freely navigated a virtual environment consisting of two consecutive choices leading to reward locations in separate rooms. Critically, the choice of one room always led to two final doors while, in the second room, only one door was permissible to choose. This design allowed us to separately determine the influence of utility and entropy on participants' choice behaviour and their self-evaluation of free will. We found that choice behaviour was better predicted by an inference-based model than by expected utility alone, and that both the availability of options and the value of the context positively influenced participants' perceived freedom of choice. Moreover, this consideration of options was apparent in the ongoing motion dynamics as individuals navigated the environment. In a second study, in which participants selected between rooms that gave access to three or four doors, we observed a similar pattern of results, with participants preferring the room that gave access to more options and feeling freer in it. These results suggest that free choice behaviour is well explained by an inference-based framework in which both utility and entropy are optimised and supports the idea that the feeling of having free will is tightly related to options availability.

A dynamical model of visual motion processing for arbitrary stimuli including type II plaids

To explore the operating principle of visual motion processing in the brain underlying perception and eye movements, we model the information processing of velocity estimate of the visual stimulus at the algorithmic level using the dynamical system approach. In this study, we formulate the model as an optimization process of an appropriately defined objective function. The model is applicable to arbitrary visual stimuli. We find that our theoretical predictions qualitatively agree with time evolution of eye movement reported by previous works across various types of stimulus. Our results suggest that the brain implements the present framework as the internal model of motion vision. We anticipate our model to be a promising building block for more profound understanding of visual motion processing as well as for the development of robotics.

Combining the Projective Consciousness Model and Virtual Humans for immersive psychological research: a proof-of-concept simulating a ToM assessment

Relating explicit psychological mechanisms and observable behaviours is a central aim of psychological and behavioural science. One of the challenges is to understand and model the role of consciousness, and in particular its subjective perspective as an internal level of representation (including for social cognition) in the governance of behaviour. Toward this aim, we implemented the principles of the Projective Consciousness Model (PCM) into artificial agents embodied as virtual humans, extending a previous implementation of the model. Our goal was to offer a proof-of-concept, based purely on simulations, as a basis for a future methodological framework. Its overarching aim is to be able to assess hidden psychological parameters in human participants, based on a model relevant to consciousness research, in the context of experiments in virtual reality. As an illustration of the approach, we focused on simulating the role of Theory of Mind (ToM) in the choice of strategic behaviours of approach and avoidance to optimise the satisfaction of agents’ preferences. We designed a main experiment in a virtual environment that could be used with real humans, allowing us to classify behaviours as a function of order of ToM, up to the second order. We show that agents using the PCM demonstrated expected behaviours with consistent parameters of ToM in this experiment. We also show that the agents could be used to estimate correctly each other’s order of ToM. Furthermore, in a supplementary experiment, we demonstrated how the agents could simultaneously estimate order of ToM and preferences attributed to others to optimize behavioural outcomes. Future studies will empirically assess and fine tune the framework with real humans in virtual reality experiments.

Interpersonal attunement in social interactions: from collective psychophysiology to inter-personalized psychiatry and beyond

In this article, we analyse social interactions, drawing on diverse points of views, ranging from dialectics, second-person neuroscience and enactivism to dynamical systems, active inference and machine learning. To this end, we define interpersonal attunement as a set of multi-scale processes of building up and materializing social expectations-put simply, anticipating and interacting with others and ourselves. While cultivating and negotiating common ground, via communication and culture-building activities, are indispensable for the survival of the individual, the relevant multi-scale mechanisms have been largely considered in isolation. Here, collective psychophysiology, we argue, can lend itself to the fine-tuned analysis of social interactions, without neglecting the individual. On the other hand, an interpersonal mismatch of expectations can lead to a breakdown of communication and social isolation known to negatively affect mental health. In this regard, we review psychopathology in terms of interpersonal misattunement, conceptualizing psychiatric disorders as disorders of social interaction, to describe how individual mental health is inextricably linked to social interaction. By doing so, we foresee avenues for an inter-personalized psychiatry, which moves from a static spectrum of disorders to a dynamic relational space, focusing on how the multi-faceted processes of social interaction can help to promote mental health. This article is part of the theme issue 'Concepts in interaction: social engagement and inner experiences'.