Neural Elements for Predictive Coding

Updating predictions in a complex repertoire of actions and its neural representation

Even though actions we observe in everyday life seem to unfold in a continuous manner, they are automatically divided into meaningful chunks, that are single actions or segments, which provide information for the formation and updating of internal predictive models. Specifically, boundaries between actions constitute a hub for predictive processing since the prediction of the current action comes to an end and calls for updating of predictions for the next action. In the current study, we investigated neural processes which characterize such boundaries using a repertoire of complex action sequences with a predefined probabilistic structure. Action sequences consisted of actions that started with the hand touching an object (T) and ended with the hand releasing the object (U). These action boundaries were determined using an automatic computer vision algorithm. Participants trained all action sequences by imitating demo videos. Subsequently, they returned for an fMRI session during which the original action sequences were presented in addition to slightly modified versions thereof. Participants completed a post-fMRI memory test to assess the retention of original action sequences. The exchange of individual actions, and thus a violation of action prediction, resulted in increased activation of the action observation network and the anterior insula. At U events, marking the end of an action, increased brain activation in supplementary motor area, striatum, and lingual gyrus was indicative of the retrieval of the previously encoded action repertoire. As expected, brain activation at U events also reflected the predefined probabilistic branching structure of the action repertoire. At T events, marking the beginning of the next action, midline and hippocampal regions were recruited, reflecting the selected prediction of the unfolding action segment. In conclusion, our findings contribute to a better understanding of the various cerebral processes characterizing prediction during the observation of complex action repertoires.

Understanding music and aging through the lens of Bayesian inference

Bayesian inference has recently gained momentum in explaining music perception and aging. A fundamental mechanism underlying Bayesian inference is the notion of prediction. This framework could explain how predictions pertaining to musical (melodic, rhythmic, harmonic) structures engender action, emotion, and learning, expanding related concepts of music research, such as musical expectancies, groove, pleasure, and tension. Moreover, a Bayesian perspective of music perception may shed new insights on the beneficial effects of music in aging. Aging could be framed as an optimization process of Bayesian inference. As predictive inferences refine over time, the reliance on consolidated priors increases, while the updating of prior models through Bayesian inference attenuates. This may affect the ability of older adults to estimate uncertainties in their environment, limiting their cognitive and behavioral repertoire. With Bayesian inference as an overarching framework, this review synthesizes the literature on predictive inferences in music and aging, and details how music could be a promising tool in preventive and rehabilitative interventions for older adults through the lens of Bayesian inference.

A sensory-motor theory of the neocortex

Recent neurophysiological and neuroanatomical studies suggest a close interaction between sensory and motor processes across the neocortex. Here, I propose that the neocortex implements active predictive coding (APC): each cortical area estimates both latent sensory states and actions (including potentially abstract actions internal to the cortex), and the cortex as a whole predicts the consequences of actions at multiple hierarchical levels. Feedback from higher areas modulates the dynamics of state and action networks in lower areas. I show how the same APC architecture can explain (1) how we recognize an object and its parts using eye movements, (2) why perception seems stable despite eye movements, (3) how we learn compositional representations, for example, part-whole hierarchies, (4) how complex actions can be planned using simpler actions, and (5) how we form episodic memories of sensory-motor experiences and learn abstract concepts such as a family tree. I postulate a mapping of the APC model to the laminar architecture of the cortex and suggest possible roles for cortico-cortical and cortico-subcortical pathways.

Priors and prejudice: hierarchical predictive processing in intergroup perception

Hierarchical predictive processing provides a framework outlining how prior expectations shape perception and cognition. Here, we highlight hierarchical predictive processing as a framework for explaining how social context and group-based social knowledge can directly shape intergroup perception. More specifically, we argue that hierarchical predictive processing confers a uniquely valuable toolset to explain extant findings and generate novel hypotheses for intergroup perception. We first provide an overview of hierarchical predictive processing, specifying its primary theoretical assumptions. We then review evidence showing how prior knowledge influences intergroup perception. Next, we outline how hierarchical predictive processing can account well for findings in the intergroup perception literature. We then underscore the theoretical strengths of hierarchical predictive processing compared to other frameworks in this space. We finish by outlining future directions and laying out hypotheses that test the implications of hierarchical predictive processing for intergroup perception and intergroup cognition more broadly. Taken together, hierarchical predictive processing provides explanatory value and capacity for novel hypothesis generation for intergroup perception.

Perceptual Expectations Are Reflected by Early Alpha Power Reduction

The predictability of a stimulus can be characterized by its transitional probability. Perceptual expectations derived from the transitional probability of the stimulus were found to modulate the early alpha oscillations in the sensory regions of the brain when neural responses to expected versus unexpected stimuli were compared. The objective of our study was to find out the extent to which this low-frequency oscillation reflects stimulus predictability. We aimed to detect the alpha-power difference with smaller differences in transitional probabilities by comparing expected stimuli with neutral ones. We studied the effect of expectation on perception by applying an unsupervised visual statistical learning paradigm with expected and neutral stimuli embedded in an image sequence while recording EEG. Time-frequency analysis showed that expected stimuli elicit lower alpha power in the window of 8-12 Hz and 0-400 msec after stimulus presentation, appearing in the centroparietal region. Comparing previous findings of expectancy-based alpha-band modulation with our results suggests that early alpha oscillation shows an inverse relationship with stimulus predictability. Although current data are insufficient to determine the origin of the alpha power reduction, this could be a potential sign of expectation suppression in cortical oscillatory activity.

Synergizing habits and goals with variational Bayes

Behaving efficiently and flexibly is crucial for biological and artificial embodied agents. Behavior is generally classified into two types: habitual (fast but inflexible), and goal-directed (flexible but slow). While these two types of behaviors are typically considered to be managed by two distinct systems in the brain, recent studies have revealed a more sophisticated interplay between them. We introduce a theoretical framework using variational Bayesian theory, incorporating a Bayesian intention variable. Habitual behavior depends on the prior distribution of intention, computed from sensory context without goal-specification. In contrast, goal-directed behavior relies on the goal-conditioned posterior distribution of intention, inferred through variational free energy minimization. Assuming that an agent behaves using a synergized intention, our simulations in vision-based sensorimotor tasks explain the key properties of their interaction as observed in experiments. Our work suggests a fresh perspective on the neural mechanisms of habits and goals, shedding light on future research in decision making.

Imagination vs. routines: festive time, weekly time, and the predictive brain

This paper examines the relationship between societal structures shaped by traditions, norms, laws, and customs, and creative expressions in arts and media through the lens of the predictive coding framework in cognitive science. The article proposes that both dimensions of culture can be viewed as adaptations designed to enhance and train the brain's predictive abilities in the social domain. Traditions, norms, laws, and customs foster shared predictions and expectations among individuals, thereby reducing uncertainty in social environments. On the other hand, arts and media expose us to simulated experiences that explore alternative social realities, allowing the predictive machinery of the brain to hone its skills through exposure to a wider array of potentially relevant social circumstances and scenarios. We first review key principles of predictive coding and active inference, and then explore the rationale of cultural traditions and artistic culture in this perspective. Finally, we draw parallels between institutionalized normative habits that stabilize social worlds and creative and imaginative acts that temporarily subvert established conventions to inject variability.

Contemporary neurocognitive models of memory: A descriptive comparative analysis

The great complexity involved in the study of memory has given rise to numerous hypotheses and models associated with various phenomena at different levels of analysis. This has allowed us to delve deeper in our knowledge about memory but has also made it difficult to synthesize and integrate data from different lines of research. In this context, this work presents a descriptive comparative analysis of contemporary models that address the structure and function of multiple memory systems. The main goal is to outline a panoramic view of the key elements that constitute these models in order to visualize both the current state of research and possible future directions. The elements that stand out from different levels of analysis are distributed neural networks, hierarchical organization, predictive coding, homeostasis, and evolutionary perspective.

Cellular mechanisms of cooperative context-sensitive predictive inference

We argue that prediction success maximization is a basic objective of cognition and cortex, that it is compatible with but distinct from prediction error minimization, that neither objective requires subtractive coding, that there is clear neurobiological evidence for the amplification of predicted signals, and that we are unconvinced by evidence proposed in support of subtractive coding. We outline recent discoveries showing that pyramidal cells on which our cognitive capabilities depend usually transmit information about input to their basal dendrites and amplify that transmission when input to their distal apical dendrites provides a context that agrees with the feedforward basal input in that both are depolarizing, i.e., both are excitatory rather than inhibitory. Though these intracellular discoveries require a level of technical expertise that is beyond the current abilities of most neuroscience labs, they are not controversial and acclaimed as groundbreaking. We note that this cellular cooperative context-sensitivity greatly enhances the cognitive capabilities of the mammalian neocortex, and that much remains to be discovered concerning its evolution, development, and pathology.

Somatosensory omissions reveal action-related predictive processing

The intricate relation between action and somatosensory perception has been studied extensively in the past decades. Generally, a forward model is thought to predict the somatosensory consequences of an action. These models propose that when an action is reliably coupled to a tactile stimulus, unexpected absence of the stimulus should elicit prediction error. Although such omission responses have been demonstrated in the auditory modality, it remains unknown whether this mechanism generalizes across modalities. This study therefore aimed to record action-induced somatosensory omission responses using EEG in humans. Self-paced button presses were coupled to somatosensory stimuli in 88% of trials, allowing a prediction, or in 50% of trials, not allowing a prediction. In the 88% condition, stimulus omission resulted in a neural response consisting of multiple components, as revealed by temporal principal component analysis. The oN1 response suggests similar sensory sources as stimulus-evoked activity, but an origin outside primary cortex. Subsequent oN2 and oP3 responses, as previously observed in the auditory domain, likely reflect modality-unspecific higher order processes. Together, findings straightforwardly demonstrate somatosensory predictions during action and provide evidence for a partially amodal mechanism of prediction error generation.

An active inference perspective for the amygdala complex

The amygdala is a heterogeneous network of subcortical nuclei with central importance in cognitive and clinical neuroscience. Various experimental designs in human psychology and animal model research have mapped multiple conceptual frameworks (e.g., valence/salience and decision making) to ever more refined amygdala circuitry. However, these predominantly bottom up-driven accounts often rely on interpretations tailored to a specific phenomenon, thus preventing comprehensive and integrative theories. We argue here that an active inference model of amygdala function could unify these fractionated approaches into an overarching framework for clearer empirical predictions and mechanistic interpretations. This framework embeds top-down predictive models, informed by prior knowledge and belief updating, within a dynamical system distributed across amygdala circuits in which self-regulation is implemented by continuously tracking environmental and homeostatic demands.

How previous experience shapes future affective subjective ratings: A follow-up study investigating implicit learning and cue ambiguity

People use their previous experience to predict future affective events. Since we live in ever-changing environments, affective predictions must generalize from past contexts (from which they may be implicitly learned) to new, potentially ambiguous contexts. This study investigated how past (un)certain relationships influence subjective experience following new ambiguous cues, and whether past relationships can be learned implicitly. Two S1-S2 paradigms were employed as learning and test phases in two experiments. S1s were colored circles, S2s negative or neutral affective pictures. Participants (Experiment 1 N = 121, Experiment 2 N = 116) were assigned to the certain (CG) or uncertain group (UG), and they were presented with 100% (CG) or 50% (UG) S1-S2 congruency during an uninstructed (Experiment 1) or implicit (Experiment 2) learning phase. During the test phase both groups were presented with a new 75% S1-S2 paradigm, and ambiguous (Experiment 1) or unambiguous (Experiment 2) S1s. Participants were asked to rate the expected valence of upcoming S2s (expectancy ratings), or their experienced valence and arousal (valence and arousal ratings). In Experiment 1 ambiguous cues elicited less negative expectancy ratings, and less unpleasant valence ratings, independently of prior experience. In Experiment 2, both groups showed similar expectancies, predicting upcoming pictures' valence according to the 75% contingencies of the test phase. Overall, we found that in the presence of ambiguous cues subjective affective experience is dampened, and that implicit previous experience does not emerge at the subjective level by significantly shaping reported affective experience.

Cortical depth profiles in primary visual cortex for illusory and imaginary experiences

Visual illusions and mental imagery are non-physical sensory experiences that involve cortical feedback processing in the primary visual cortex. Using laminar functional magnetic resonance imaging (fMRI) in two studies, we investigate if information about these internal experiences is visible in the activation patterns of different layers of primary visual cortex (V1). We find that imagery content is decodable mainly from deep layers of V1, whereas seemingly 'real' illusory content is decodable mainly from superficial layers. Furthermore, illusory content shares information with perceptual content, whilst imagery content does not generalise to illusory or perceptual information. Together, our results suggest that illusions and imagery, which differ immensely in their subjective experiences, also involve partially distinct early visual microcircuits. However, overlapping microcircuit recruitment might emerge based on the nuanced nature of subjective conscious experience.

The empirical status of predictive coding and active inference

Research on predictive processing models has focused largely on two specific algorithmic theories: Predictive Coding for perception and Active Inference for decision-making. While these interconnected theories possess broad explanatory potential, they have only recently begun to receive direct empirical evaluation. Here, we review recent studies of Predictive Coding and Active Inference with a focus on evaluating the degree to which they are empirically supported. For Predictive Coding, we find that existing empirical evidence offers modest support. However, some positive results can also be explained by alternative feedforward (e.g., feature detection-based) models. For Active Inference, most empirical studies have focused on fitting these models to behavior as a means of identifying and explaining individual or group differences. While Active Inference models tend to explain behavioral data reasonably well, there has not been a focus on testing empirical validity of active inference theory per se, which would require formal comparison to other models (e.g., non-Bayesian or model-free reinforcement learning models). This review suggests that, while promising, a number of specific research directions are still necessary to evaluate the empirical adequacy and explanatory power of these algorithms.

Generating meaning: active inference and the scope and limits of passive AI

Prominent accounts of sentient behavior depict brains as generative models of organismic interaction with the world, evincing intriguing similarities with current advances in generative artificial intelligence (AI). However, because they contend with the control of purposive, life-sustaining sensorimotor interactions, the generative models of living organisms are inextricably anchored to the body and world. Unlike the passive models learned by generative AI systems, they must capture and control the sensory consequences of action. This allows embodied agents to intervene upon their worlds in ways that constantly put their best models to the test, thus providing a solid bedrock that is - we argue - essential to the development of genuine understanding. We review the resulting implications and consider future directions for generative AI.

Learning beyond sensations: How dreams organize neuronal representations

Semantic representations in higher sensory cortices form the basis for robust, yet flexible behavior. These representations are acquired over the course of development in an unsupervised fashion and continuously maintained over an organism's lifespan. Predictive processing theories propose that these representations emerge from predicting or reconstructing sensory inputs. However, brains are known to generate virtual experiences, such as during imagination and dreaming, that go beyond previously experienced inputs. Here, we suggest that virtual experiences may be just as relevant as actual sensory inputs in shaping cortical representations. In particular, we discuss two complementary learning principles that organize representations through the generation of virtual experiences. First, "adversarial dreaming" proposes that creative dreams support a cortical implementation of adversarial learning in which feedback and feedforward pathways engage in a productive game of trying to fool each other. Second, "contrastive dreaming" proposes that the invariance of neuronal representations to irrelevant factors of variation is acquired by trying to map similar virtual experiences together via a contrastive learning process. These principles are compatible with known cortical structure and dynamics and the phenomenology of sleep thus providing promising directions to explain cortical learning beyond the classical predictive processing paradigm.

Acetylcholine modulates the precision of prediction error in the auditory cortex

A fundamental property of sensory systems is their ability to detect novel stimuli in the ambient environment. The auditory brain contains neurons that decrease their response to repetitive sounds but increase their firing rate to novel or deviant stimuli; the difference between both responses is known as stimulus-specific adaptation or neuronal mismatch (nMM). Here, we tested the effect of microiontophoretic applications of ACh on the neuronal responses in the auditory cortex (AC) of anesthetized rats during an auditory oddball paradigm, including cascade controls. Results indicate that ACh modulates the nMM, affecting prediction error responses but not repetition suppression, and this effect is manifested predominantly in infragranular cortical layers. The differential effect of ACh on responses to standards, relative to deviants (in terms of averages and variances), was consistent with the representational sharpening that accompanies an increase in the precision of prediction errors. These findings suggest that ACh plays an important role in modulating prediction error signaling in the AC and gating the access of these signals to higher cognitive levels.

From active affordance to active inference: vertical integration of cognition in the cerebral cortex through dual subcortical control systems

In previous papers, we proposed that the dorsal attention system's top-down control is regulated by the dorsal division of the limbic system, providing a feedforward or impulsive form of control generating expectancies during active inference. In contrast, we proposed that the ventral attention system is regulated by the ventral limbic division, regulating feedback constraints and error-correction for active inference within the neocortical hierarchy. Here, we propose that these forms of cognitive control reflect vertical integration of subcortical arousal control systems that evolved for specific forms of behavior control. The feedforward impetus to action is regulated by phasic arousal, mediated by lemnothalamic projections from the reticular activating system of the lower brainstem, and then elaborated by the hippocampus and dorsal limbic division. In contrast, feedback constraint-based on environmental requirements-is regulated by the tonic activation furnished by collothalamic projections from the midbrain arousal control centers, and then sustained and elaborated by the amygdala, basal ganglia, and ventral limbic division. In an evolutionary-developmental analysis, understanding these differing forms of active affordance-for arousal and motor control within the subcortical vertebrate neuraxis-may help explain the evolution of active inference regulating the cognition of expectancy and error-correction within the mammalian 6-layered neocortex.

Experience shapes chandelier cell function and structure in the visual cortex

Detailed characterization of interneuron types in primary visual cortex (V1) has greatly contributed to understanding visual perception, yet the role of chandelier cells (ChCs) in visual processing remains poorly characterized. Using viral tracing we found that V1 ChCs predominantly receive monosynaptic input from local layer 5 pyramidal cells and higher-order cortical regions. Two-photon calcium imaging and convolutional neural network modeling revealed that ChCs are visually responsive but weakly selective for stimulus content. In mice running in a virtual tunnel, ChCs respond strongly to events known to elicit arousal, including locomotion and visuomotor mismatch. Repeated exposure of the mice to the virtual tunnel was accompanied by reduced visual responses of ChCs and structural plasticity of ChC boutons and axon initial segment length. Finally, ChCs only weakly inhibited pyramidal cells. These findings suggest that ChCs provide an arousal-related signal to layer 2/3 pyramidal cells that may modulate their activity and/or gate plasticity of their axon initial segments during behaviorally relevant events.

Computational components of visual predictive coding circuitry

If a full visual percept can be said to be a 'hypothesis', so too can a neural 'prediction' - although the latter addresses one particular component of image content (such as 3-dimensional organisation, the interplay between lighting and surface colour, the future trajectory of moving objects, and so on). And, because processing is hierarchical, predictions generated at one level are conveyed in a backward direction to a lower level, seeking to predict, in fact, the neural activity at that prior stage of processing, and learning from errors signalled in the opposite direction. This is the essence of 'predictive coding', at once an algorithm for information processing and a theoretical basis for the nature of operations performed by the cerebral cortex. Neural models for the implementation of predictive coding invoke specific functional classes of neuron for generating, transmitting and receiving predictions, and for producing reciprocal error signals. Also a third general class, 'precision' neurons, tasked with regulating the magnitude of error signals contingent upon the confidence placed upon the prediction, i.e., the reliability and behavioural utility of the sensory data that it predicts. So, what is the ultimate source of a 'prediction'? The answer is multifactorial: knowledge of the current environmental context and the immediate past, allied to memory and lifetime experience of the way of the world, doubtless fine-tuned by evolutionary history too. There are, in consequence, numerous potential avenues for experimenters seeking to manipulate subjects' expectation, and examine the neural signals elicited by surprising, and less surprising visual stimuli. This review focuses upon the predictive physiology of mouse and monkey visual cortex, summarising and commenting on evidence to date, and placing it in the context of the broader field. It is concluded that predictive coding has a firm grounding in basic neuroscience and that, unsurprisingly, there remains much to learn.

Delirium is associated with loss of feedback cortical connectivity

INTRODUCTION

Post-operative delirium (POD) is associated with increased morbidity and mortality but is bereft of treatments, largely due to our limited understanding of the underlying pathophysiology. We hypothesized that delirium reflects a disturbance in cortical connectivity that leads to altered predictions of the sensory environment.

METHODS

High-density electroencephalogram recordings during an oddball auditory roving paradigm were collected from 131 patients. Dynamic causal modeling (DCM) analysis facilitated inference about the neuronal connectivity and inhibition-excitation dynamics underlying auditory-evoked responses.

RESULTS

Mismatch negativity amplitudes were smaller in patients with POD. DCM showed that delirium was associated with decreased left-sided superior temporal gyrus (l-STG) to auditory cortex feedback connectivity. Feedback connectivity also negatively correlated with delirium severity and systemic inflammation. Increased inhibition of l-STG, with consequent decreases in feed-forward and feed-back connectivity, occurred for oddball tones during delirium.

DISCUSSION

Delirium is associated with decreased feedback cortical connectivity, possibly resulting from increased intrinsic inhibitory tone.

HIGHLIGHTS

Mismatch negativity amplitude was reduced in patients with delirium. Patients with postoperative delirium had increased feedforward connectivity before surgery. Feedback connectivity was diminished from left-side superior temporal gyrus to left primary auditory sensory area during delirium. Feedback connectivity inversely correlated with inflammation and delirium severity.

Interoceptive technologies for psychiatric interventions: From diagnosis to clinical applications

Interoception-the perception of internal bodily signals-has emerged as an area of interest due to its implications in emotion and the prevalence of dysfunctional interoceptive processes across psychopathological conditions. Despite the importance of interoception in cognitive neuroscience and psychiatry, its experimental manipulation remains technically challenging. This is due to the invasive nature of existing methods, the limitation of self-report and unimodal measures of interoception, and the absence of standardized approaches across disparate fields. This article integrates diverse research efforts from psychology, physiology, psychiatry, and engineering to address this oversight. Following a general introduction to the neurophysiology of interoception as hierarchical predictive processing, we review the existing paradigms for manipulating interoception (e.g., interoceptive modulation), their underlying mechanisms (e.g., interoceptive conditioning), and clinical applications (e.g., interoceptive exposure). We suggest a classification for interoceptive technologies and discuss their potential for diagnosing and treating mental health disorders. Despite promising results, considerable work is still needed to develop standardized, validated measures of interoceptive function across domains and before these technologies can translate safely and effectively to clinical settings.

Augmented action observation: Theory and practical applications in sensorimotor rehabilitation

Sensory feedback is a fundamental aspect of effective motor learning in sport and clinical contexts. One way to provide this is through sensory augmentation, where extrinsic sensory information are associated with, and modulated by, movement. Traditionally, sensory augmentation has been used as an online strategy, where feedback is provided during physical execution of an action. In this article, we argue that action observation can be an additional effective channel to provide augmented feedback, which would be complementary to other, more traditional, motor learning and sensory augmentation strategies. Given these similarities between observing and executing an action, action observation could be used when physical training is difficult or not feasible, for example during immobilization or during the initial stages of a rehabilitation protocol when peripheral fatigue is a common issue. We review the benefits of observational learning and preliminary evidence for the effectiveness of using augmented action observation to improve learning. We also highlight current knowledge gaps which make the transition from laboratory to practical contexts difficult. Finally, we highlight the key areas of focus for future research.

Predictive coding and stochastic resonance as fundamental principles of auditory phantom perception

Mechanistic insight is achieved only when experiments are employed to test formal or computational models. Furthermore, in analogy to lesion studies, phantom perception may serve as a vehicle to understand the fundamental processing principles underlying healthy auditory perception. With a special focus on tinnitus-as the prime example of auditory phantom perception-we review recent work at the intersection of artificial intelligence, psychology and neuroscience. In particular, we discuss why everyone with tinnitus suffers from (at least hidden) hearing loss, but not everyone with hearing loss suffers from tinnitus. We argue that intrinsic neural noise is generated and amplified along the auditory pathway as a compensatory mechanism to restore normal hearing based on adaptive stochastic resonance. The neural noise increase can then be misinterpreted as auditory input and perceived as tinnitus. This mechanism can be formalized in the Bayesian brain framework, where the percept (posterior) assimilates a prior prediction (brain's expectations) and likelihood (bottom-up neural signal). A higher mean and lower variance (i.e. enhanced precision) of the likelihood shifts the posterior, evincing a misinterpretation of sensory evidence, which may be further confounded by plastic changes in the brain that underwrite prior predictions. Hence, two fundamental processing principles provide the most explanatory power for the emergence of auditory phantom perceptions: predictive coding as a top-down and adaptive stochastic resonance as a complementary bottom-up mechanism. We conclude that both principles also play a crucial role in healthy auditory perception. Finally, in the context of neuroscience-inspired artificial intelligence, both processing principles may serve to improve contemporary machine learning techniques.

Cellular and laminar architecture: A short history and commentary

The feedforward/feedback classification, as originally stated in relation to early visual areas in the macaque monkey, has had a significant influence on ideas of laminar interactions, area reciprocity, and cortical hierarchical organization. In some contrast with this macroscale "laminar connectomics," a more cellular approach to cortical connections, as briefly surveyed here, points to a still underappreciated heterogeneity of neuronal subtypes and complex microcircuitries. From the perspective of heterogeneities, the question of how brain regions interact and influence each other quickly leads to discussions about concurrent hierarchical and nonhierarchical cortical features, brain organization as a multiscale system forming nested groups and hierarchies, connectomes annotated by multiple biological attributes, and interleaved and overlapping scales of organization.

Degeneracy in the neurological model of auditory speech repetition

Both classic and contemporary models of auditory word repetition involve at least four left hemisphere regions: primary auditory cortex for processing sounds; pSTS (within Wernicke's area) for processing auditory images of speech; pOp (within Broca's area) for processing motor images of speech; and primary motor cortex for overt speech articulation. Previous functional-MRI (fMRI) studies confirm that auditory repetition activates these regions, in addition to many others. Crucially, however, contemporary models do not specify how regions interact and drive each other during auditory repetition. Here, we used dynamic causal modelling, to test the functional interplay among the four core brain regions during single auditory word and pseudoword repetition. Our analysis is grounded in the principle of degeneracy-i.e., many-to-one structure-function relationships-where multiple neural pathways can execute the same function. Contrary to expectation, we found that, for both word and pseudoword repetition, (i) the effective connectivity between pSTS and pOp was predominantly bidirectional and inhibitory; (ii) activity in the motor cortex could be driven by either pSTS or pOp; and (iii) the latter varied both within and between individuals. These results suggest that different neural pathways can support auditory speech repetition. This degeneracy may explain resilience to functional loss after brain damage.

Predictive Coding as a Neuromorphic Alternative to Backpropagation: A Critical Evaluation

Backpropagation has rapidly become the workhorse credit assignment algorithm for modern deep learning methods. Recently, modified forms of predictive coding (PC), an algorithm with origins in computational neuroscience, have been shown to result in approximately or exactly equal parameter updates to those under backpropagation. Due to this connection, it has been suggested that PC can act as an alternative to backpropagation with desirable properties that may facilitate implementation in neuromorphic systems. Here, we explore these claims using the different contemporary PC variants proposed in the literature. We obtain time complexity bounds for these PC variants, which we show are lower bounded by backpropagation. We also present key properties of these variants that have implications for neurobiological plausibility and their interpretations, particularly from the perspective of standard PC as a variational Bayes algorithm for latent probabilistic models. Our findings shed new light on the connection between the two learning frameworks and suggest that in its current forms, PC may have more limited potential as a direct replacement of backpropagation than previously envisioned.

An Introduction to Predictive Processing Models of Perception and Decision-Making

The predictive processing framework includes a broad set of ideas, which might be articulated and developed in a variety of ways, concerning how the brain may leverage predictive models when implementing perception, cognition, decision-making, and motor control. This article provides an up-to-date introduction to the two most influential theories within this framework: predictive coding and active inference. The first half of the paper (Sections 2-5) reviews the evolution of predictive coding, from early ideas about efficient coding in the visual system to a more general model encompassing perception, cognition, and motor control. The theory is characterized in terms of the claims it makes at Marr's computational, algorithmic, and implementation levels of description, and the conceptual and mathematical connections between predictive coding, Bayesian inference, and variational free energy (a quantity jointly evaluating model accuracy and complexity) are explored. The second half of the paper (Sections 6-8) turns to recent theories of active inference. Like predictive coding, active inference models assume that perceptual and learning processes minimize variational free energy as a means of approximating Bayesian inference in a biologically plausible manner. However, these models focus primarily on planning and decision-making processes that predictive coding models were not developed to address. Under active inference, an agent evaluates potential plans (action sequences) based on their expected free energy (a quantity that combines anticipated reward and information gain). The agent is assumed to represent the world as a partially observable Markov decision process with discrete time and discrete states. Current research applications of active inference models are described, including a range of simulation work, as well as studies fitting models to empirical data. The paper concludes by considering future research directions that will be important for further development of both models.

Relative fluency (unfelt vs felt) in active inference

For a growing number of researchers, it is now accepted that the brain is a predictive organ that predicts the content of the sensorium and crucially the precision of-or confidence in-its own predictions. In order to predict the precision of its predictions, the brain has to infer the reliability of its own beliefs. This means that our brains have to recognise the precision of their predictions or, at least, their accuracy. In this paper, we argue that fluency is product of this recognition process. In short, to recognise fluency is to infer that we have a precise 'grip' on the unfolding processes that generate our sensations. More specifically, we propose that it is changes in fluency - from unfelt to felt - that are both recognised and realised when updating predictions about precision. Unfelt fluency orients attention to unpredicted sensations, while felt fluency supervenes on-and contextualises-unfelt fluency; thereby rendering certain attentional processes, phenomenologically opaque. As such, fluency underwrites the precision we place in our predictions and therefore acts upon our perceptual inferences. Hence, the causes of conscious subjective inference have unconscious perceptual precursors.

The QBIT theory of consciousness: Entropy and qualia

The QBIT theory is a recently introduced multi-disciplinary approach to the problem of consciousness. One of the main axioms of the theory is that when information-theoretic certainty of an observer about a stimulus goes beyond a certain threshold, the observer becomes conscious of that stimulus. This axiom could provide an explanation for how the brain generates consciousness.In short, the QBIT theory suggests that the brain generates consciousness by reducing the entropy of its internal representations below a critical threshold. This paper explains how the brain gradually minimizes the entropy of its internal representations and consequently generate minimum-entropy representations (also known as conscious representations or qualia). The paper also explores the consequences of this entropy-minimization process in the context of quantum information theory.

The Spatial Precision of Contextual Feedback Signals in Human V1

Neurons in the primary visual cortex (V1) receive sensory inputs that describe small, local regions of the visual scene and cortical feedback inputs from higher visual areas processing the global scene context. Investigating the spatial precision of this visual contextual modulation will contribute to our understanding of the functional role of cortical feedback inputs in perceptual computations. We used human functional magnetic resonance imaging (fMRI) to test the spatial precision of contextual feedback inputs to V1 during natural scene processing. We measured brain activity patterns in the stimulated regions of V1 and in regions that we blocked from direct feedforward input, receiving information only from non-feedforward (i.e., feedback and lateral) inputs. We measured the spatial precision of contextual feedback signals by generalising brain activity patterns across parametrically spatially displaced versions of identical images using an MVPA cross-classification approach. We found that fMRI activity patterns in cortical feedback signals predicted our scene-specific features in V1 with a precision of approximately 4 degrees. The stimulated regions of V1 carried more precise scene information than non-stimulated regions; however, these regions also contained information patterns that generalised up to 4 degrees. This result shows that contextual signals relating to the global scene are similarly fed back to V1 when feedforward inputs are either present or absent. Our results are in line with contextual feedback signals from extrastriate areas to V1, describing global scene information and contributing to perceptual computations such as the hierarchical representation of feature boundaries within natural scenes.

Neuronal responses to omitted tones in the auditory brain: A neuronal correlate for predictive coding

Prediction provides key advantages for survival, and cognitive studies have demonstrated that the brain computes multilevel predictions. Evidence for predictions remains elusive at the neuronal level because of the complexity of separating neural activity into predictions and stimulus responses. We overcome this challenge by recording from single neurons from cortical and subcortical auditory regions in anesthetized and awake preparations, during unexpected stimulus omissions interspersed in a regular sequence of tones. We find a subset of neurons that responds reliably to omitted tones. In awake animals, omission responses are similar to anesthetized animals, but larger and more frequent, indicating that the arousal and attentional state levels affect the degree to which predictions are neuronally represented. Omission-sensitive neurons also responded to frequency deviants, with their omission responses getting emphasized in the awake state. Because omission responses occur in the absence of sensory input, they provide solid and empirical evidence for the implementation of a predictive process.

Dual-stream cortical pathways mediate sensory prediction

Predictions are constantly generated from diverse sources to optimize cognitive functions in the ever-changing environment. However, the neural origin and generation process of top-down induced prediction remain elusive. We hypothesized that motor-based and memory-based predictions are mediated by distinct descending networks from motor and memory systems to the sensory cortices. Using functional magnetic resonance imaging (fMRI) and a dual imagery paradigm, we found that motor and memory upstream systems activated the auditory cortex in a content-specific manner. Moreover, the inferior and posterior parts of the parietal lobe differentially relayed predictive signals in motor-to-sensory and memory-to-sensory networks. Dynamic causal modeling of directed connectivity revealed selective enabling and modulation of connections that mediate top-down sensory prediction and ground the distinctive neurocognitive basis of predictive processing.

A parahippocampal-sensory Bayesian vicious circle generates pain or tinnitus: a source-localized EEG study

Pain and tinnitus share common pathophysiological mechanisms, clinical features, and treatment approaches. A source-localized resting-state EEG study was conducted in 150 participants: 50 healthy controls, 50 pain, and 50 tinnitus patients. Resting-state activity as well as functional and effective connectivity was computed in source space. Pain and tinnitus were characterized by increased theta activity in the pregenual anterior cingulate cortex, extending to the lateral prefrontal cortex and medial anterior temporal lobe. Gamma-band activity was increased in both auditory and somatosensory cortex, irrespective of the pathology, and extended to the dorsal anterior cingulate cortex and parahippocampus. Functional and effective connectivity were largely similar in pain and tinnitus, except for a parahippocampal-sensory loop that distinguished pain from tinnitus. In tinnitus, the effective connectivity between parahippocampus and auditory cortex is bidirectional, whereas the effective connectivity between parahippocampus and somatosensory cortex is unidirectional. In pain, the parahippocampal-somatosensory cortex is bidirectional, but parahippocampal auditory cortex unidirectional. These modality-specific loops exhibited theta-gamma nesting. Applying a Bayesian brain model of brain functioning, these findings suggest that the phenomenological difference between auditory and somatosensory phantom percepts result from a vicious circle of belief updating in the context of missing sensory information. This finding may further our understanding of multisensory integration and speaks to a universal treatment for pain and tinnitus-by selectively disrupting parahippocampal-somatosensory and parahippocampal-auditory theta-gamma activity and connectivity.

How the conception of control influences our understanding of actions

Wilful movement requires neural control. Commonly, neural computations are thought to generate motor commands that bring the musculoskeletal system - that is, the plant - from its current physical state into a desired physical state. The current state can be estimated from past motor commands and from sensory information. Modelling movement on the basis of this concept of plant control strives to explain behaviour by identifying the computational principles for control signals that can reproduce the observed features of movements. From an alternative perspective, movements emerge in a dynamically coupled agent-environment system from the pursuit of subjective perceptual goals. Modelling movement on the basis of this concept of perceptual control aims to identify the controlled percepts and their coupling rules that can give rise to the observed characteristics of behaviour. In this Perspective, we discuss a broad spectrum of approaches to modelling human motor control and their notions of control signals, internal models, handling of sensory feedback delays and learning. We focus on the influence that the plant control and the perceptual control perspective may have on decisions when modelling empirical data, which may in turn shape our understanding of actions.

Expectation violations enhance neuronal encoding of sensory information in mouse primary visual cortex

The response of cortical neurons to sensory stimuli is shaped both by past events (adaptation) and the expectation of future events (prediction). Here we employed a visual stimulus paradigm with different levels of predictability to characterise how expectation influences orientation selectivity in the primary visual cortex (V1) of male mice. We recorded neuronal activity using two-photon calcium imaging (GCaMP6f) while animals viewed sequences of grating stimuli which either varied randomly in their orientations or rotated predictably with occasional transitions to an unexpected orientation. For single neurons and the population, there was significant enhancement in the gain of orientation-selective responses to unexpected gratings. This gain-enhancement for unexpected stimuli was prominent in both awake and anaesthetised mice. We implemented a computational model to demonstrate how trial-to-trial variability in neuronal responses were best characterised when adaptation and expectation effects were combined.

Amygdala connectivity related to subsequent stress responses during the COVID-19 outbreak

Introduction

The amygdala plays an important role in stress responses and stress-related psychiatric disorders. It is possible that amygdala connectivity may be a neurobiological vulnerability marker for stress responses or stress-related psychiatric disorders and will be useful to precisely identify the vulnerable individuals before stress happens. However, little is known about the relationship between amygdala connectivity and subsequent stress responses. The current study investigated whether amygdala connectivity measured before experiencing stress is a predisposing neural feature of subsequent stress responses while individuals face an emergent and unexpected event like the COVID-19 outbreak.

Methods

Data collected before the COVID-19 pandemic from an established fMRI cohort who lived in the pandemic center in China (Hubei) during the COVID-19 outbreak were used to investigate the relationship between amygdala connectivity and stress responses during and after the pandemic in 2020. The amygdala connectivity was measured with resting-state functional connectivity (rsFC) and effective connectivity.

Results

We found the rsFC of the right amygdala with the dorsomedial prefrontal cortex (dmPFC) was negatively correlated with the stress responses at the first survey during the COVID-19 outbreak, and the rsFC between the right amygdala and bilateral superior frontal gyri (partially overlapped with the dmPFC) was correlated with SBSC at the second survey. Dynamic causal modeling suggested that the self-connection of the right amygdala was negatively correlated with stress responses during the pandemic.

Discussion

Our findings expand our understanding about the role of amygdala in stress responses and stress-related psychiatric disorders and suggest that amygdala connectivity is a predisposing neural feature of subsequent stress responses.

Worlds apart? Testing the cultural distance hypothesis in music perception of Chinese and Western listeners

According to the cultural distance hypothesis (CDH), individuals learn culture-specific statistical structures in music as internal stylistic models and use these models in predictive processing of music, with musical structures closer to their home culture being easier to predict. This cultural distance effect may be affected by domain-specific (musical ability) and domain-general individual characteristics (openness, implicit cultural bias). To test the CDH and its modulation by individual characteristics, we recruited Chinese and Western adults to categorize stylistically ambiguous and unambiguous Chinese and Western melodies by cultural origin. Categorization performance was better for unambiguous (low CD) than ambiguous melodies (high CD), and for in-culture melodies regardless of ambiguity for both groups, providing evidence for CDH. Musical ability, but not other traits, correlated positively with melody categorization, suggesting that musical ability refines internal stylistic models. Therefore, both cultures show musical enculturation in their home culture with a modulatory effect of individual musical ability.

Inconsistent illusory motion in predictive coding deep neural networks

Why do we perceive illusory motion in some static images? Several accounts point to eye movements, response latencies to different image elements, or interactions between image patterns and motion energy detectors. Recently PredNet, a recurrent deep neural network (DNN) based on predictive coding principles, was reported to reproduce the "Rotating Snakes" illusion, suggesting a role for predictive coding. We begin by replicating this finding, then use a series of "in silico" psychophysics and electrophysiology experiments to examine whether PredNet behaves consistently with human observers and non-human primate neural data. A pretrained PredNet predicted illusory motion for all subcomponents of the Rotating Snakes pattern, consistent with human observers. However, we found no simple response delays in internal units, unlike evidence from electrophysiological data. PredNet's detection of motion in gradients seemed dependent on contrast, but depends predominantly on luminance in humans. Finally, we examined the robustness of the illusion across ten PredNets of identical architecture, retrained on the same video data. There was large variation across network instances in whether they reproduced the Rotating Snakes illusion, and what motion, if any, they predicted for simplified variants. Unlike human observers, no network predicted motion for greyscale variants of the Rotating Snakes pattern. Our results sound a cautionary note: even when a DNN successfully reproduces some idiosyncrasy of human vision, more detailed investigation can reveal inconsistencies between humans and the network, and between different instances of the same network. These inconsistencies suggest that predictive coding does not reliably give rise to human-like illusory motion.

Computational psychiatry: from synapses to sentience

This review considers computational psychiatry from a particular viewpoint: namely, a commitment to explaining psychopathology in terms of pathophysiology. It rests on the notion of a generative model as underwriting (i) sentient processing in the brain, and (ii) the scientific process in psychiatry. The story starts with a view of the brain-from cognitive and computational neuroscience-as an organ of inference and prediction. This offers a formal description of neuronal message passing, distributed processing and belief propagation in neuronal networks; and how certain kinds of dysconnection lead to aberrant belief updating and false inference. The dysconnections in question can be read as a pernicious synaptopathy that fits comfortably with formal notions of how we-or our brains-encode uncertainty or its complement, precision. It then considers how the ensuing process theories are tested empirically, with an emphasis on the computational modelling of neuronal circuits and synaptic gain control that mediates attentional set, active inference, learning and planning. The opportunities afforded by this sort of modelling are considered in light of in silico experiments; namely, computational neuropsychology, computational phenotyping and the promises of a computational nosology for psychiatry. The resulting survey of computational approaches is not scholarly or exhaustive. Rather, its aim is to review a theoretical narrative that is emerging across subdisciplines within psychiatry and empirical scales of investigation. These range from epilepsy research to neurodegenerative disorders; from post-traumatic stress disorder to the management of chronic pain, from schizophrenia to functional medical symptoms.

Hierarchical predictive coding in distributed pain circuits

Predictive coding is a computational theory on describing how the brain perceives and acts, which has been widely adopted in sensory processing and motor control. Nociceptive and pain processing involves a large and distributed network of circuits. However, it is still unknown whether this distributed network is completely decentralized or requires networkwide coordination. Multiple lines of evidence from human and animal studies have suggested that the cingulate cortex and insula cortex (cingulate-insula network) are two major hubs in mediating information from sensory afferents and spinothalamic inputs, whereas subregions of cingulate and insula cortices have distinct projections and functional roles. In this mini-review, we propose an updated hierarchical predictive coding framework for pain perception and discuss its related computational, algorithmic, and implementation issues. We suggest active inference as a generalized predictive coding algorithm, and hierarchically organized traveling waves of independent neural oscillations as a plausible brain mechanism to integrate bottom-up and top-down information across distributed pain circuits.

Influence of E/I balance and pruning in peri-personal space differences in schizophrenia: A computational approach

The encoding of the space close to the body, named peri-personal space (PPS), is thought to play a crucial role in the unusual experiences of the self observed in schizophrenia (SCZ). However, it is unclear why SCZ patients and high schizotypal (H-SPQ) individuals present a narrower PPS and why the boundaries of the PPS are more sharply defined in patients. We hypothesise that the unusual PPS representation observed in SCZ is caused by an imbalance of excitation and inhibition (E/I) in recurrent synapses of unisensory neurons or an impairment of bottom-up and top-down connectivity between unisensory and multisensory neurons. These hypotheses were tested computationally by manipulating the effects of E/I imbalance, feedback weights and synaptic density in the network. Using simulations we explored the effects of such impairments in the PPS representation generated by the network and fitted the model to behavioural data. We found that increased excitation of sensory neurons could account for the smaller PPS observed in SCZ and H-SPQ, whereas a decrease of synaptic density caused the sharp definition of the PPS observed in SCZ. We propose a novel conceptual model of PPS representation in the SCZ spectrum that can account for alterations in self-world demarcation, failures in tactile discrimination and symptoms observed in patients.

How childhood maltreatment alters perception and cognition - the predictive processing account of borderline personality disorder

Borderline personality disorder (BPD) is a severe mental disorder, comprised of heterogeneous psychological and neurobiological pathologies. Here, we propose a predictive processing (PP) account of BPD to integrate these seemingly unrelated pathologies. In particular, we argue that the experience of childhood maltreatment, which is highly prevalent in BPD, leaves a developmental legacy with two facets: first, a coarse-grained, alexithymic model of self and others - leading to a rigidity and inflexibility concerning beliefs about self and others. Second, this developmental legacy leads to a loss of confidence or precision afforded beliefs about the consequences of social behavior. This results in an over reliance on sensory evidence and social feedback, with concomitant lability, impulsivity and hypersensitivity. In terms of PP, people with BPD show a distorted belief updating in response to new information with two opposing manifestations: rapid changes in beliefs and a lack of belief updating despite disconfirmatory evidence. This account of distorted information processing has the potential to explain both the instability (of affect, self-image, and interpersonal relationships) and the rigidity (of beliefs about self and others) which is typical of BPD. At the neurobiological level, we propose that enhanced levels of dopamine are associated with the increased integration of negative social feedback, and we also discuss the hypothesis of an impaired inhibitory control of the prefrontal cortex in the processing of negative social information. Our account may provide a new understanding not only of the clinical aspects of BPD, but also a unifying theory of the corresponding neurobiological pathologies. We conclude by outlining some directions for future research on the behavioral, neurobiological, and computational underpinnings of this model, and point to some clinical implications of it.

Applying the Properties of Neurons in Machine Learning: A Brain-like Neural Model with Interactive Stimulation for Data Classification

Some neural models achieve outstanding results in image recognition, semantic segmentation and natural language processing. However, their classification performance on structured and small-scale datasets that do not involve feature extraction is worse than that of traditional algorithms, although they require more time to train. In this paper, we propose a brain-like neural model with interactive stimulation (NMIS) that focuses on data classification. It consists of a primary neural field and a senior neural field that play different cognitive roles. The former is used to correspond to real instances in the feature space, and the latter stores the category pattern. Neurons in the primary field exchange information through interactive stimulation and their activation is transmitted to the senior field via inter-field interaction, simulating the mechanisms of neuronal interaction and synaptic plasticity, respectively. The proposed NMIS is biologically plausible and does not involve complex optimization processes. Therefore, it exhibits better learning ability on small-scale and structured datasets than traditional BP neural networks. For large-scale data classification, a nearest neighbor NMIS (NN_NMIS), an optimized version of NMIS, is proposed to improve computational efficiency. Numerical experiments performed on some UCI datasets show that the proposed NMIS and NN_NMIS are significantly superior to some classification algorithms that are widely used in machine learning.

Greater tau pathology is associated with altered predictive coding

Altered predictive coding may underlie the reduced auditory mismatch negativity amplitude observed in patients with dementia. We hypothesized that accumulating dementia-associated pathologies, including amyloid and tau, lead to disturbed predictions of our sensory environment. This would manifest as increased reliance on 'observed' sensory information with an associated increase in feedforward, and decrease in feedback, signalling. To test this hypothesis, we studied a cross-sectional cohort of participants who underwent PET imaging and high-density EEG during an oddball paradigm, and used dynamic casual modelling and Bayesian statistics to make inferences about the neuronal architectures (generators) and mechanisms (effective connectivity) underlying the observed auditory-evoked responses. Amyloid-β imaging with [C-11] Pittsburgh Compound-B PET was qualitatively rated using established criteria. Tau-positive PET scans, with [F-18]MK-6240, were defined by an MK-6240 standardized uptake value ratio positivity threshold at 2 standard deviations above the mean of the Amyloid(-) group in the entorhinal cortex (entorhinal MK-6240 standardized uptake value ratio > 1.27). The cross-sectional cohort included a total of 56 participants [9 and 13 participants in the Tau(+) and Amyloid(+) subgroups, respectively: age interquartile range of (73.50-75.34) and (70.5-75.34) years, 56 and 69% females, respectively; 46 and 43 participants in the Tau(-) and Amyloid(-) subgroups, respectively: age interquartile range of (62.72-72.5) and (62.64-72.48) years, 67 and 65% females, respectively]. Mismatch negativity amplitudes were significantly smaller in Tau+ subgroup than Tau- subgroup (cluster statistics corrected for multiple comparisons: P = 0.028). Dynamic causal modelling showed that tau pathology was associated with increased feedforward connectivity and decreased feedback connectivity, with increased excitability of superior temporal gyrus but not inferior frontal regions. This effect on superior temporal gyrus was consistent with the distribution of tau disease on PET in these participants, indicating that the observed differences in mismatch negativity reflect pathological changes evolving in preclinical dementia. Exclusion of participants with diagnosed mild cognitive impairment or dementia did not affect the results. These observational data provide proof of concept that abnormalities in predictive coding may be detected in the preclinical phase of Alzheimer's disease. This framework also provides a construct to understand how progressive impairments lead to loss of orientation to the sensory world in dementia. Based on our modelling results, plus animal models indicating that Alzheimer's disease pathologies produce hyperexcitability of higher cortical regions through local disinhibition, mismatch negativity might be a useful monitor to deploy as strategies that target interneuron dysfunction are developed.

Emotion regulation strategies differentially modulate neural activity across affective prediction stages: An HD-EEG investigation

Emotion regulation (ER) strategies can influence how affective predictions are constructed by the brain (generation stage) to prearrange action (implementation stage) and update internal models according to incoming stimuli (updating stage). However, neurocomputational mechanisms by which this is achieved are unclear. We investigated through high-density EEG if different ER strategies (expressive suppression vs. cognitive reappraisal) predicted event-related potentials (ERPs) and brain source activity across affective prediction stages, as a function of contextual uncertainty. An S1-S2 paradigm with emotional faces and pictures as S1s and S2s was presented to 36 undergraduates. Contextual uncertainty was manipulated across three blocks with 100, 75, or 50% S1-S2 affective congruency. The effects of ER strategies, as assessed through the Emotion Regulation Questionnaire, on ERP and brain source activity were tested for each prediction stage through linear mixed-effects models. No ER strategy affected prediction generation. During implementation, in the 75% block, a higher tendency to suppress emotions predicted higher activity in the left supplementary motor area at 1,500–2,000 ms post-stimulus, and smaller amplitude of the Contingent Negative Variation at 2,000–2,500 ms. During updating, in the 75% block, a higher tendency to cognitively reappraise emotions predicted larger P2, Late Positive Potential, and right orbitofrontal cortex activity. These results suggest that both ER strategies interact with the levels of contextual uncertainty by differently modulating ERPs and source activity, and that different strategies are deployed in a moderately predictive context, supporting the efficient updating of affective predictive models only in the context in which model updating occurs.

Pooling strategies in V1 can account for the functional and structural diversity across species

Neurons in the primary visual cortex are selective to orientation with various degrees of selectivity to the spatial phase, from high selectivity in simple cells to low selectivity in complex cells. Various computational models have suggested a possible link between the presence of phase invariant cells and the existence of orientation maps in higher mammals’ V1. These models, however, do not explain the emergence of complex cells in animals that do not show orientation maps. In this study, we build a theoretical model based on a convolutional network called Sparse Deep Predictive Coding (SDPC) and show that a single computational mechanism, pooling, allows the SDPC model to account for the emergence in V1 of complex cells with or without that of orientation maps, as observed in distinct species of mammals. In particular, we observed that pooling in the feature space is directly related to the orientation map formation while pooling in the retinotopic space is responsible for the emergence of a complex cells population. Introducing different forms of pooling in a predictive model of early visual processing as implemented in SDPC can therefore be viewed as a theoretical framework that explains the diversity of structural and functional phenomena observed in V1.

Unbalanced functional connectivity at rest affects the ERP correlates of affective prediction in high intolerance of uncertainty individuals: A high density EEG investigation

In a recent study we outlined the link between Intolerance of Uncertainty (IU) and the neural correlates of affective predictions, as constructed by the brain (generation stage) to prepare to relevant stimuli (implementation stage), and update predictive models according to incoming stimuli (updating stage). In this study we further explored whether the brain's functional organization at rest can modulate neural activity elicited within an emotional S1-S2 paradigm as a function of IU and uncertainty of S1-S2 contingencies. We computed resting state functional connectivity (RS-FC) from a 3-min resting period recorded with high density EEG, and we tested whether RS graph theory nodal measures (i.e., strength, clustering coefficient, betweenness centrality) predicted in-task ERP modulation as a function of IU. We found that RS-FC differently predicted in-task ERPs within the generation and updating stages. Higher IU levels were associated to altered RS-FC patterns within both domain-specific (i.e., right superior temporal sulcus) and domain-general regions (i.e., right orbitofrontal cortex), predictive of a reduced modulation of in-task ERPs in the generation and updating stages. This is presumably ascribable to an unbalancing between synchronization and integration within these regions, which may disrupt the exchange of information between top-down and bottom-up pathways. This altered RS-FC pattern may in turn result in the construction of less efficient affective predictions and a reduced ability to deal with contextual uncertainty in individuals high in IU.