Visual Mismatch and Predictive Coding: A Computational Single-Trial ERP Study

Virtual Social Interaction in a Multiplayer-Online Video Game Increases Implicit Learning: An EEG Study

It is well known that social interaction enhances learning processes, improving abilities such as attention and memorization. However, it is not clear whether similar advantages may be obtained even in virtual environments. Here, we investigate whether virtual interactions in a video game, similarly to real-life social interactions, may improve individuals' performance in a subsequent implicit learning task. Twenty-one healthy participants were asked to play a cooperative video game for 20 minutes in three different gaming modalities: alone (Single-Player); together with someone without verbal interactions (Multi-Player -); and with someone with verbal interactions (Multi-Player +). After each gaming session, participants were presented with an EEG paradigm directed to measure mismatch negativity (MMN) responses, a well-validated index of implicit learning. MMN responses were significantly larger following Multi-Player +, as compared with Single-Player, and Multi-Player - conditions. No significant difference was found between Single-Player, and Multi-Player - conditions. These results indicate that implicit learning processes are enhanced following communicative virtual interactions. Verbal interaction in a virtual environment seems necessary to elicit social copresence and its positive effects on learning performances. This finding may have important implications for the design of virtual rehabilitation protocols and distance learning programs.

Incorporating uncertainty within dynamic interoceptive learning

Introduction

Interoception, the perception of the internal state of the body, has been shown to be closely linked to emotions and mental health. Of particular interest are interoceptive learning processes that capture associations between environmental cues and body signals as a basis for making homeostatically relevant predictions about the future. One method of measuring respiratory interoceptive learning that has shown promising results is the Breathing Learning Task (BLT). While the original BLT required binary predictions regarding the presence or absence of an upcoming inspiratory resistance, here we extended this paradigm to capture continuous measures of prediction (un)certainty.

Methods

Sixteen healthy participants completed the continuous version of the BLT, where they were asked to predict the likelihood of breathing resistances on a continuous scale from 0.0 to 10.0. In order to explain participants' responses, a Rescorla-Wagner model of associative learning was combined with suitable observation models for continuous or binary predictions, respectively. For validation, we compared both models against corresponding null models and examined the correlation between observed and modeled predictions. The model was additionally extended to test whether learning rates differed according to stimuli valence. Finally, summary measures of prediction certainty as well as model estimates for learning rates were considered against interoceptive and mental health questionnaire measures.

Results

Our results demonstrated that the continuous model fits closely captured participant behavior using empirical data, and the binarised predictions showed excellent replicability compared to previously collected data. However, the model extension indicated that there were no significant differences between learning rates for negative (i.e. breathing resistance) and positive (i.e. no breathing resistance) stimuli. Finally, significant correlations were found between fatigue severity and both prediction certainty and learning rate, as well as between anxiety sensitivity and prediction certainty.

Discussion

These results demonstrate the utility of gathering enriched continuous prediction data in interoceptive learning tasks, and suggest that the updated BLT is a promising paradigm for future investigations into interoceptive learning and potential links to mental health.

Facial feedback manipulation influences the automatic detection of unexpected emotional body expressions

Unexpected or changing facial expressions are known to be able to engage more automatic processing than frequently occurring facial expressions, thereby inducing a neural differential wave response known as expression mismatch negativity (EMMN). Recent studies have shown that EMMN can be modulated by the observer's facial feedback (i.e., feedback from their own facial movements). A similar EMMN activity has been discovered for body expressions, but thus far only a few emotion types have been investigated. It is unknown whether the EMMNs evoked by body expressions can be influenced by facial feedback. To explore this question, we recorded EEG activity of 29 participants in the reverse oddball paradigm. Here two unexamined categories of body expressions were presented, happy and sad, placed in two paired stimulus sequences: in one the happy body was presented with a probability of 80% (standards) while the sad body was presented with a probability of 20% (deviants), and in the other the probabilities were reversed. The facial feedback was manipulated by different pen holding conditions (i.e., participants holding the pen with the teeth, lips, or nondominant hand). The nonparametric cluster permutation test revealed significant happy and sad body-related EMMN (bEMMN) activities. The happy-bEMMN were more negative than sad-bEMMN within the range of 100-150 ms. Additionally, the bEMMN amplitude of both emotions is modulated by the facial feedback conditions. These results expand the range of emotional types applicable to bEMMN and provide evidence for the validity of the facial feedback hypothesis across emotional carriers.

Shared attention in virtual immersive reality enhances electrophysiological correlates of implicit sensory learning

Shared attention effects on learning and memory demonstrate that experiences are amplified when we are not alone. Virtual reality poses new challenges to the study of co-presence. Above all, is coattending together with someone else's avatar in an immersive VR setting comparable with shared experiences at a neural processing level? In the present study we investigate shared attention effects in VR for the first time. We recorded mismatch negativities (MMN) during an auditory roving paradigm, a well-known index of implicit perceptual learning. EEG responses to deviant and standard sounds were registered while subjects were alone (Solo condition) or together (Other condition) with a virtual avatar (Virtual scenario) or physically present confederate (Physical scenario). We found an overall main effect of co-presence on MMN revealed by a point-by-point 2 × 2 ANOVA, thereby replicating previous studies on physical co-presence. Additionally, we found no significant interaction between the scenario (Physical vs. Virtual) and co-presence (Solo vs. Other). Our results indicate that virtual immersive co-presence mimics physical co-presence.

How previous experience shapes future affective subjective ratings: A follow-up study investigating implicit learning and cue ambiguity

People use their previous experience to predict future affective events. Since we live in ever-changing environments, affective predictions must generalize from past contexts (from which they may be implicitly learned) to new, potentially ambiguous contexts. This study investigated how past (un)certain relationships influence subjective experience following new ambiguous cues, and whether past relationships can be learned implicitly. Two S1-S2 paradigms were employed as learning and test phases in two experiments. S1s were colored circles, S2s negative or neutral affective pictures. Participants (Experiment 1 N = 121, Experiment 2 N = 116) were assigned to the certain (CG) or uncertain group (UG), and they were presented with 100% (CG) or 50% (UG) S1-S2 congruency during an uninstructed (Experiment 1) or implicit (Experiment 2) learning phase. During the test phase both groups were presented with a new 75% S1-S2 paradigm, and ambiguous (Experiment 1) or unambiguous (Experiment 2) S1s. Participants were asked to rate the expected valence of upcoming S2s (expectancy ratings), or their experienced valence and arousal (valence and arousal ratings). In Experiment 1 ambiguous cues elicited less negative expectancy ratings, and less unpleasant valence ratings, independently of prior experience. In Experiment 2, both groups showed similar expectancies, predicting upcoming pictures' valence according to the 75% contingencies of the test phase. Overall, we found that in the presence of ambiguous cues subjective affective experience is dampened, and that implicit previous experience does not emerge at the subjective level by significantly shaping reported affective experience.

The empirical status of predictive coding and active inference

Research on predictive processing models has focused largely on two specific algorithmic theories: Predictive Coding for perception and Active Inference for decision-making. While these interconnected theories possess broad explanatory potential, they have only recently begun to receive direct empirical evaluation. Here, we review recent studies of Predictive Coding and Active Inference with a focus on evaluating the degree to which they are empirically supported. For Predictive Coding, we find that existing empirical evidence offers modest support. However, some positive results can also be explained by alternative feedforward (e.g., feature detection-based) models. For Active Inference, most empirical studies have focused on fitting these models to behavior as a means of identifying and explaining individual or group differences. While Active Inference models tend to explain behavioral data reasonably well, there has not been a focus on testing empirical validity of active inference theory per se, which would require formal comparison to other models (e.g., non-Bayesian or model-free reinforcement learning models). This review suggests that, while promising, a number of specific research directions are still necessary to evaluate the empirical adequacy and explanatory power of these algorithms.

The aesthetic valve: how aesthetic appreciation may switch emotional states from anxiety to curiosity

Pursuing new knowledge in the entropic environment is pivotal for survival. However, dealing with uncertainty is a costly challenge for the agent surrounded by the stochastic sensory world, giving rise to different epistemic emotions, such as curiosity and anxiety. We recently proposed that aesthetic appreciation may have the role of associating pleasant feedback with the update of predictive representations. According to this idea, aesthetic appreciation and its associated rewarding feeling could drive people to seek new knowledge over anxiety. However, the relationship between aesthetic appreciation, curiosity, and anxiety has been still under-examined in the literature. Here, we explore the relationship between these epistemic emotions in a series of three experiments. In study 1, we examined whether music-induced aesthetic appreciation would influence curiosity in a gambling task. In studies 2a and 2b, we explore the relationship between music-induced aesthetic appreciation and anxiety state. Overall, aesthetic appreciation promoted curiosity-driven behaviour while it was negatively associated with anxiety. These results were consistent with the idea that aesthetic appreciation could act as a 'valve', prompting the individual to perceive curiosity (i.e. to consider novelty as a valuable opportunity to acquire new knowledge) rather than anxiety (i.e. to consider novelty as a risk to be avoided). This article is part of the theme issue 'Art, aesthetics and predictive processing: theoretical and empirical perspectives'.

Perceptual oddities: assessing the relationship between film editing and prediction processes

During film viewing, humans parse sequences of individual shots into larger narrative structures, often weaving transitions at edit points into an apparently seamless and continuous flow. Editing helps filmmakers manipulate visual transitions to induce feelings of fluency/disfluency, tension/relief, curiosity, expectation and several emotional responses. We propose that the perceptual dynamics induced by film editing can be captured by a predictive processing (PP) framework. We hypothesise that visual discontinuities at edit points produce discrepancies between anticipated and actual sensory input, leading to prediction error. Further, we propose that the magnitude of prediction error depends on the predictability of each shot within the narrative flow, and lay out an account based on conflict monitoring. We test this hypothesis in two empirical studies measuring electroencephalography (EEG) during passive viewing of film excerpts, as well as behavioural responses during an active edit detection task. We report the neural and behavioural modulations at editing boundaries across three levels of narrative depth, showing greater modulations for edits spanning less predictable, deeper narrative transitions. Overall, our contribution lays the groundwork for understanding film editing from a PP perspective. This article is part of the theme issue 'Art, aesthetics and predictive processing: theoretical and empirical perspectivess'.

Traveling waves shape neural population dynamics enabling predictions and internal model updating

The brain generates predictions based on statistical regularities in our environment. However, it is unclear how predictions are optimized through iterative interactions with the environment. Because traveling waves (TWs) propagate across the cortex shaping neural excitability, they can carry information to serve predictive processing. Using human intracranial recordings, we show that anterior-to-posterior alpha TWs correlated with prediction strength. Learning about priors altered neural state space trajectories, and how much it altered correlated with trial-by-trial prediction strength. Learning involved mismatches between predictions and sensory evidence triggering alpha-phase resets in lateral temporal cortex, accompanied by stronger alpha phase-high gamma amplitude coupling and high-gamma power. The mismatch initiated posterior-to-anterior alpha TWs and change in the subsequent trial's state space trajectory, facilitating model updating. Our findings suggest a vital role of alpha TWs carrying both predictions to sensory cortex and mismatch signals to frontal cortex for trial-by-trial fine-tuning of predictive models.

Seeking the neural representation of statistical properties in print during implicit processing of visual words

Statistical learning (SL) plays a key role in literacy acquisition. Studies have increasingly revealed the influence of distributional statistical properties of words on visual word processing, including the effects of word frequency (lexical level) and mappings between orthography, phonology, and semantics (sub-lexical level). However, there has been scant evidence to directly confirm that the statistical properties contained in print can be directly characterized by neural activities. Using time-resolved representational similarity analysis (RSA), the present study examined neural representations of different types of statistical properties in visual word processing. From the perspective of predictive coding, an equal probability sequence with low built-in prediction precision and three oddball sequences with high built-in prediction precision were designed with consistent and three types of inconsistent (orthographically inconsistent, orthography-to-phonology inconsistent, and orthography-to-semantics inconsistent) Chinese characters as visual stimuli. In the three oddball sequences, consistent characters were set as the standard stimuli (probability of occurrence p = 0.75) and three types of inconsistent characters were set as deviant stimuli (p = 0.25), respectively. In the equal probability sequence, the same consistent and inconsistent characters were presented randomly with identical occurrence probability (p = 0.25). Significant neural representation activities of word frequency were observed in the equal probability sequence. By contrast, neural representations of sub-lexical statistics only emerged in oddball sequences where short-term predictions were shaped. These findings reveal that the statistical properties learned from long-term print environment continues to play a role in current word processing mechanisms and these mechanisms can be modulated by short-term predictions.

A multimodal cortical network of sensory expectation violation revealed by fMRI

The brain is subjected to multi-modal sensory information in an environment governed by statistical dependencies. Mismatch responses (MMRs), classically recorded with EEG, have provided valuable insights into the brain's processing of regularities and the generation of corresponding sensory predictions. Only few studies allow for comparisons of MMRs across multiple modalities in a simultaneous sensory stream and their corresponding cross-modal context sensitivity remains unknown. Here, we used a tri-modal version of the roving stimulus paradigm in fMRI to elicit MMRs in the auditory, somatosensory and visual modality. Participants (N = 29) were simultaneously presented with sequences of low and high intensity stimuli in each of the three senses while actively observing the tri-modal input stream and occasionally reporting the intensity of the previous stimulus in a prompted modality. The sequences were based on a probabilistic model, defining transition probabilities such that, for each modality, stimuli were more likely to repeat (p = .825) than change (p = .175) and stimulus intensities were equiprobable (p = .5). Moreover, each transition was conditional on the configuration of the other two modalities comprising global (cross-modal) predictive properties of the sequences. We identified a shared mismatch network of modality general inferior frontal and temporo-parietal areas as well as sensory areas, where the connectivity (psychophysiological interaction) between these regions was modulated during mismatch processing. Further, we found deviant responses within the network to be modulated by local stimulus repetition, which suggests highly comparable processing of expectation violation across modalities. Moreover, hierarchically higher regions of the mismatch network in the temporo-parietal area around the intraparietal sulcus were identified to signal cross-modal expectation violation. With the consistency of MMRs across audition, somatosensation and vision, our study provides insights into a shared cortical network of uni- and multi-modal expectation violation in response to sequence regularities.

Time-resolved dynamic computational modeling of human EEG recordings reveals gradients of generative mechanisms for the MMN response

Despite attempts to unify the different theoretical accounts of the mismatch negativity (MMN), there is still an ongoing debate on the neurophysiological mechanisms underlying this complex brain response. On one hand, neuronal adaptation to recurrent stimuli is able to explain many of the observed properties of the MMN, such as its sensitivity to controlled experimental parameters. On the other hand, several modeling studies reported evidence in favor of Bayesian learning models for explaining the trial-to-trial dynamics of the human MMN. However, direct comparisons of these two main hypotheses are scarce, and previous modeling studies suffered from methodological limitations. Based on reports indicating spatial and temporal dissociation of physiological mechanisms within the timecourse of mismatch responses in animals, we hypothesized that different computational models would best fit different temporal phases of the human MMN. Using electroencephalographic data from two independent studies of a simple auditory oddball task (n = 82), we compared adaptation and Bayesian learning models' ability to explain the sequential dynamics of auditory deviance detection in a time-resolved fashion. We first ran simulations to evaluate the capacity of our design to dissociate the tested models and found that they were sufficiently distinguishable above a certain level of signal-to-noise ratio (SNR). In subjects with a sufficient SNR, our time-resolved approach revealed a temporal dissociation between the two model families, with high evidence for adaptation during the early MMN window (from 90 to 150-190 ms post-stimulus depending on the dataset) and for Bayesian learning later in time (170-180 ms or 200-220ms). In addition, Bayesian model averaging of fixed-parameter models within the adaptation family revealed a gradient of adaptation rates, resembling the anatomical gradient in the auditory cortical hierarchy reported in animal studies.

Same but different: The latency of a shared expectation signal interacts with stimulus attributes

Predictive coding theories assert that perceptual inference is a hierarchical process of belief updating, wherein the onset of unexpected sensory data causes so-called prediction error responses that calibrate erroneous inferences. Given the functionally specialised organisation of visual cortex, it is assumed that prediction error propagation interacts with the specific visual attribute violating an expectation. We sought to test this within the temporal domain by applying time-resolved decoding methods to electroencephalography (EEG) data evoked by contextual trajectory violations of either brightness, size, or orientation within a bound stimulus. We found that following ∼170 ms post stimulus onset, responses to both size violations and orientation violations were decodable from physically identical control trials in which no attributes were violated. These two violation types were then directly compared, with attribute-specific signalling being decoded from 265 ms. Temporal generalisation suggested that this dissociation was driven by latency shifts in shared expectation signalling between the two conditions. Using a novel temporal bias method, we then found that this shared signalling occurred earlier for size violations than orientation violations. To our knowledge, we are among the first to decode expectation violations in humans using EEG and have demonstrated a temporal dissociation in attribute-specific expectancy violations.

Anterior cingulate and medial prefrontal cortex oscillations underlie learning alterations in trait anxiety in humans

Anxiety has been linked to altered belief formation and uncertainty estimation, impacting learning. Identifying the neural processes underlying these changes is important for understanding brain pathology. Here, we show that oscillatory activity in the medial prefrontal, anterior cingulate and orbitofrontal cortex (mPFC, ACC, OFC) explains anxiety-related learning alterations. In a magnetoencephalography experiment, two groups of human participants pre-screened with high and low trait anxiety (HTA, LTA: 39) performed a probabilistic reward-based learning task. HTA undermined learning through an overestimation of volatility, leading to faster belief updating, more stochastic decisions and pronounced lose-shift tendencies. On a neural level, we observed increased gamma activity in the ACC, dmPFC, and OFC during encoding of precision-weighted prediction errors in HTA, accompanied by suppressed ACC alpha/beta activity. Our findings support the association between altered learning and belief updating in anxiety and changes in gamma and alpha/beta activity in the ACC, dmPFC, and OFC.

A developmental shift in habituation to pain in human neonates

Habituation to recurrent non-threatening or unavoidable noxious stimuli is an important aspect of adaptation to pain. Neonates, especially if preterm, are exposed to repeated noxious procedures during their clinical care. They can mount strong behavioral, autonomic, spinal, and cortical responses to a single noxious stimulus; however, it is not known whether the developing nervous system can adapt to the recurrence of these inputs. Here, we used electroencephalography to investigate changes in cortical microstates (representing the complex sequential processing of noxious inputs) following two consecutive clinically required heel lances in term and preterm infants. We show that stimulus repetition dampens the engagement of initial microstates and associated behavioral and autonomic responses in term infants, while preterm infants do not show signs of habituation. Nevertheless, both groups engage different longer-latency cortical microstates to each lance, which is likely to reflect changes in higher-level stimulus processing with repeated stimulation. These data suggest that while both age groups are capable of encoding contextual differences in pain, the preterm brain does not regulate the initial cortical, behavioral, and autonomic responses to repeated noxious stimuli. Habituation mechanisms to pain are already in place at term age but mature over the equivalent of the last trimester of gestation and are not fully functional in preterm neonates.

Modulation of Motor Vigor by Expectation of Reward Probability Trial-by-Trial Is Preserved in Healthy Ageing and Parkinson's Disease Patients

Motor improvements, such as faster movement times or increased velocity, have been associated with reward magnitude in deterministic contexts. Yet whether individual inferences on reward probability influence motor vigor dynamically remains undetermined. We investigated how dynamically inferring volatile action-reward contingencies modulated motor performance trial-by-trial. We conducted three studies that coupled a reversal learning paradigm with a motor sequence task and used a validated hierarchical Bayesian model to fit trial-by-trial data. In Study 1, we tested healthy younger [HYA; 37 (24 females)] and older adults [HOA; 37 (17 females)], and medicated Parkinson's disease (PD) patients [20 (7 females)]. We showed that stronger predictions about the tendency of the action-reward contingency led to faster performance tempo, commensurate with movement time, on a trial-by-trial basis without robustly modulating reaction time (RT). Using Bayesian linear mixed models, we demonstrated a similar invigoration effect on performance tempo in HYA, HOA, and PD, despite HOA and PD being slower than HYA. In Study 2 [HYA, 39 (29 females)], we additionally showed that retrospective subjective inference about credit assignment did not contribute to differences in motor vigor effects. Last, Study 3 [HYA, 33 (27 females)] revealed that explicit beliefs about the reward tendency (confidence ratings) modulated performance tempo trial-by-trial. Our study is the first to reveal that the dynamic updating of beliefs about volatile action-reward contingencies positively biases motor performance through faster tempo. We also provide robust evidence for a preserved sensitivity of motor vigor to inferences about the action-reward mapping in aging and medicated PD.SIGNIFICANCE STATEMENT Navigating a world rich in uncertainty relies on updating beliefs about the probability that our actions lead to reward. Here, we investigated how inferring the action-reward contingencies in a volatile environment modulated motor vigor trial-by-trial in healthy younger and older adults, and in Parkinson's disease (PD) patients on medication. We found an association between trial-by-trial predictions about the tendency of the action-reward contingency and performance tempo, with stronger expectations speeding the movement. We additionally provided evidence for a similar sensitivity of performance tempo to the strength of these predictions in all groups. Thus, dynamic beliefs about the changing relationship between actions and their outcome enhanced motor vigor. This positive bias was not compromised by age or Parkinson's disease.

The Role of the Left Inferior Frontal Gyrus in Introspection during Verbal Communication

Conversation enables the sharing of our subjective experiences through verbalizing introspected thoughts and feelings. The mentalizing network represents introspection, and successful conversation is characterized by alignment through imitation mediated by the mirror neuron system (MNS). Therefore, we hypothesized that the interaction between the mentalizing network and MNS mediates the conversational exchange of introspection. To test this, we performed hyperscanning functional magnetic resonance imaging during structured real-time conversations between 19 pairs of healthy participants. The participants first evaluated their preference for and familiarity with a presented object and then disclosed it. The control was the object feature identification task. When contrasted with the control, the preference/familiarity evaluation phase activated the dorso-medial prefrontal cortex, anterior cingulate cortex, precuneus, left hippocampus, right cerebellum, and orbital portion of the left inferior frontal gyrus (IFG), which represents introspection. The left IFG was activated when the two participants' statements of introspection were mismatched during the disclosure. Disclosing introspection enhanced the functional connectivity of the left IFG with the bilateral superior temporal gyrus and primary motor cortex, representing the auditory MNS. Thus, the mentalizing system and MNS are hierarchically linked in the left IFG during a conversation, allowing for the sharing of introspection of the self and others.

Physical but not virtual presence of others potentiates implicit and explicit learning

E-learning activities are becoming more and more common. Whilst it is well known that the physical presence of others motivates individuals to engage in perceptual and learning tasks, systematic investigations comparing the effects of physical and virtual co-presence of others on knowledge acquisition are still scarce. Here we investigate the effects of physical and virtual co-presence of others on explicit and implicit learning. In Experiment 1 (discovery sample), retrieval accuracy in a spatial memory task and EEG indexes (mismatch negativity-MMN) of implicit perceptual learning were recorded when participants were alone or in presence of another individual. In Experiment 2 (replicating sample), we added a "virtual" condition, where the same tasks were performed during a video-conference call. In both experiments, MMN was demonstrated to encode for perceptual learning as revealed by the significant correlation with Bayesian Surprise (a consolidated information-theoretic index of Bayesian learning). Furthermore, In Experiments 1 and 2 physical co-presence systematically ameliorated memorization performances and increased MMN indexes related to implicit learning. These positive effects were absent in the virtual condition, thus suggesting that only physical, but not virtual co-presence is effective in potentiating learning dynamics.

Atypical prediction error learning is associated with prodromal symptoms in individuals at clinical high risk for psychosis

Reductions in the auditory mismatch negativity (MMN) have been well-demonstrated in schizophrenia rendering it a promising biomarker for understanding the emergence of psychosis. According to the predictive coding theory of psychosis, MMN impairments may reflect disturbances in hierarchical information processing driven by maladaptive precision-weighted prediction errors (pwPEs) and enhanced belief updating. We applied a hierarchical Bayesian model of learning to single-trial EEG data from an auditory oddball paradigm in 31 help-seeking antipsychotic-naive high-risk individuals and 23 healthy controls to understand the computational mechanisms underlying the auditory MMN. We found that low-level sensory and high-level volatility pwPE expression correlated with EEG amplitudes, coinciding with the timing of the MMN. Furthermore, we found that prodromal positive symptom severity was associated with increased expression of sensory pwPEs and higher-level belief uncertainty. Our findings provide support for the role of pwPEs in auditory MMN generation, and suggest that increased sensory pwPEs driven by changes in belief uncertainty may render the environment seemingly unpredictable. This may predispose high-risk individuals to delusion-like ideation to explain this experience. These results highlight the value of computational models for understanding the pathophysiological mechanisms of psychosis.

Adaptive Cognitive Control in Prematurely Born Children: An HD-EEG Investigation

Preterm birth is a neurodevelopmental risk condition often associated with cognitive control (CC) impairment. Recent evidence showed that CC can be implicitly adapted through associative learning. In the present study we investigated the ability to flexibly adjust CC as a function of implicit stimulus-response temporal regularities in preterm (PT; N = 21; mean age 8 ± 1.3 years; gestational age 30 ± 18.5 weeks) and full-term (FT; N = 20; mean age 8 ± 1.3 years) school-age children. All children underwent an HD-EEG recording while undergoing the Dynamic Temporal Prediction (DTP) task, a simple S1–S2 detection task purposely designed to generate local-global temporal predictability of imperative stimuli. The Wisconsin card sorting test (WCST) was administered to measure explicit CC. The PT group showed more premature and slower (DTP) as well as perseverative (WCST) responses than the FT group. Moreover, pre-terms showed poor adaptive CC as revealed by less efficient global response-speed adjustment. This behavioral pattern was mirrored by a reduced and less sensitive to global manipulation anticipatory Contingent Negative Variation (CNV) and by different cortical source recruitment. These findings suggest that implicit CC may be a reliable endophenotypic marker of atypical cognitive development associated with preterm birth.

Auditory mismatch responses are differentially sensitive to changes in muscarinic acetylcholine versus dopamine receptor function

The auditory mismatch negativity (MMN) has been proposed as a biomarker of NMDA receptor (NMDAR) dysfunction in schizophrenia. Such dysfunction may be caused by aberrant interactions of different neuromodulators with NMDARs, which could explain clinical heterogeneity among patients. In two studies (N = 81 each), we used a double-blind placebo-controlled between-subject design to systematically test whether auditory mismatch responses under varying levels of environmental stability are sensitive to diminishing and enhancing cholinergic vs. dopaminergic function. We found a significant drug × mismatch interaction: while the muscarinic acetylcholine receptor antagonist biperiden delayed and topographically shifted mismatch responses, particularly during high stability, this effect could not be detected for amisulpride, a dopamine D2/D3 receptor antagonist. Neither galantamine nor levodopa, which elevate acetylcholine and dopamine levels, respectively, exerted significant effects on MMN. This differential MMN sensitivity to muscarinic versus dopaminergic receptor function may prove useful for developing tests that predict individual treatment responses in schizophrenia.

Visual Mismatch Negativity Reflects Enhanced Response to the Deviant: Evidence From Event-Related Potentials and Electroencephalogram Time-Frequency Analysis

Automatic detection of information changes in the visual environment is crucial for individual survival. Researchers use the oddball paradigm to study the brain’s response to frequently presented (standard) stimuli and occasionally presented (deviant) stimuli. The component that can be observed in the difference wave is called visual mismatch negativity (vMMN), which is obtained by subtracting event-related potentials (ERPs) evoked by the deviant from ERPs evoked by the standard. There are three hypotheses to explain the vMMN. The sensory fatigue (or refractoriness) hypothesis considers that weakened neural activity caused by repetition results in decreased ERPs of the standard. The memory trace hypothesis proposes that vMMN results from increased responses to the deviant. The predictive coding hypothesis attributes the difference to enhanced responses for deviants and suppression for standards. However, when distinguishing between these effects, previous researchers did not consider the effect of low-level features on the vMMN. In this experiment, we used face sequences composed of different emotions (e.g., neutral and fearful face) and presented an oddball sequence, a reverse oddball sequence, and an equiprobable sequence to participants. The deviant of the oddball sequence was subtracted from the standard of the oddball sequence, the reverse oddball sequence, and the same type of stimulus of the equiprobable sequence to get oddball-vMMN (vMMN1), reverse oddball-vMMN (vMMN2), and equiprobable-vMMN (vMMN3), respectively. The results showed no significant difference between vMMN2 and vMMN3 in 100–350 ms following stimulus onset, while the vMMN effect was significant, indicating that the probability of the standard did not affect vMMN, which supported the memory trace hypothesis. Additionally, the fearful-related vMMN were more negative than the neutral-related vMMN within the range of 100–150 ms, suggesting a negative bias. We analyzed the source location of different vMMNs. There was no significant difference in brain regions between different vMMNs. Time-frequency analysis showed that the deviant had stronger theta-band oscillatory than the standard (visual mismatch oscillatory responses, vMORs). However, there was no difference between vMORs2 and vMORs3, indicating that vMORs reflect an enhanced response to the deviant in terms of neural oscillation, supporting the memory trace hypothesis.

Dynamics of Oddball Sound Processing: Trial-by-Trial Modeling of ECoG Signals

Recent computational models of perception conceptualize auditory oddball responses as signatures of a (Bayesian) learning process, in line with the influential view of the mismatch negativity (MMN) as a prediction error signal. Novel MMN experimental paradigms have put an emphasis on neurophysiological effects of manipulating regularity and predictability in sound sequences. This raises the question of the contextual adaptation of the learning process itself, which on the computational side speaks to the mechanisms of gain-modulated (or precision-weighted) prediction error. In this study using electrocorticographic (ECoG) signals, we manipulated the predictability of oddball sound sequences with two objectives: (i) Uncovering the computational process underlying trial-by-trial variations of the cortical responses. The fluctuations between trials, generally ignored by approaches based on averaged evoked responses, should reflect the learning involved. We used a general linear model (GLM) and Bayesian Model Reduction (BMR) to assess the respective contributions of experimental manipulations and learning mechanisms under probabilistic assumptions. (ii) To validate and expand on previous findings regarding the effect of changes in predictability using simultaneous EEG-MEG recordings. Our trial-by-trial analysis revealed only a few stimulus-responsive sensors but the measured effects appear to be consistent over subjects in both time and space. In time, they occur at the typical latency of the MMN (between 100 and 250 ms post-stimulus). In space, we found a dissociation between time-independent effects in more anterior temporal locations and time-dependent (learning) effects in more posterior locations. However, we could not observe any clear and reliable effect of our manipulation of predictability modulation onto the above learning process. Overall, these findings clearly demonstrate the potential of trial-to-trial modeling to unravel perceptual learning processes and their neurophysiological counterparts.

State anxiety alters the neural oscillatory correlates of predictions and prediction errors during reward-based learning

Anxiety influences how the brain estimates and responds to uncertainty. The consequences of these processes on behaviour have been described in theoretical and empirical studies, yet the associated neural correlates remain unclear. Rhythm-based accounts of Bayesian predictive coding propose that predictions in generative models of perception are represented in alpha (8-12 Hz) and beta oscillations (13-30 Hz). Updates to predictions are driven by prediction errors weighted by precision (inverse variance) encoded in gamma oscillations (>30 Hz) and associated with the suppression of beta activity. We tested whether state anxiety alters the neural oscillatory activity associated with predictions and precision-weighted prediction errors (pwPE) during learning. Healthy human participants performed a probabilistic reward-based learning task in a volatile environment. In our previous work, we described learning behaviour in this task using a hierarchical Bayesian model, revealing more precise (biased) beliefs about the tendency of the reward contingency in state anxiety, consistent with reduced learning in this group. The model provided trajectories of predictions and pwPEs for the current study, allowing us to assess their parametric effects on the time-frequency representations of EEG data. Using convolution modelling for oscillatory responses, we found that, relative to a control group, state anxiety increased beta activity in frontal and sensorimotor regions during processing of pwPE, and in fronto-parietal regions during encoding of predictions. No effects of state anxiety on gamma modulation were found. Our findings expand prior evidence on the oscillatory representations of predictions and pwPEs into the reward-based learning domain. The results suggest that state anxiety modulates beta-band oscillatory correlates of pwPE and predictions in generative models, providing insights into the neural processes associated with biased belief updating and poorer learning.

The automatic detection of unexpected emotion and neutral body postures: A visual mismatch negativity study

The ability to automatically detect emotional changes in the environment is crucial for social interaction. In the visual system, expression-related mismatch negativity (EMMN) reflects the automatic processing of emotional changes in facial expression. However, body postures also carry visual emotional information that can be recognized effectively and processed automatically, although their processing mechanism remains unknown. In this study, the reverse oddball paradigm was used to investigate the mismatch responses of unexpected fear and neutral body postures. The nonparametric cluster permutation test revealed significant fear and neutral visual mismatch negativity (vMMN) activities, and the fear-related vMMN was enhanced prior (130-230 ms) to the neutral vMMN (180-230 ms). The body-sensitive N190 component may partially account for the vMMN obtained in this study. The fearful body posture evoked a greater N190 response over the neutral body, and amplitudes of N190 were more negative in the deviant condition than the standard condition. Additionally, the body-related visual mismatch oscillatory responses were associated with enhancement of the alpha band oscillation, especially for the fearful body posture. These results expanded the applicable scope of body posture cues corresponding to mismatch signals, objectively defined the electrophysiological activities evoked, and revealed the processing bias toward negative emotion.

Temporal–spectral signaling of sensory information and expectations in the cerebral processing of pain

Pain is not only shaped by sensory information but also by an individual’s expectations. Here, we investigated how commonly analyzed electroencephalography (EEG) responses to pain signal sensory information, expectations, and discrepancies thereof (prediction errors) in the processing of pain. Bayesian analysis confirmed that pain perception was shaped by objective sensory information and expectations. In contrast, EEG responses at different latencies (including the N1, N2, and P2 components) and frequencies (including alpha, beta, and gamma oscillations) were shaped by sensory information but not by expectations. Thus, EEG responses to pain are more involved in signaling sensory information than in signaling expectations or prediction errors. Expectation effects are obviously mediated by other brain mechanisms than the effects of sensory information on pain.

The perception of pain is shaped by somatosensory information about threat. However, pain is also influenced by an individual’s expectations. Such expectations can result in clinically relevant modulations and abnormalities of pain. In the brain, sensory information, expectations (predictions), and discrepancies thereof (prediction errors) are signaled by an extended network of brain areas which generate evoked potentials and oscillatory responses at different latencies and frequencies. However, a comprehensive picture of how evoked and oscillatory brain responses signal sensory information, predictions, and prediction errors in the processing of pain is lacking so far. Here, we therefore applied brief painful stimuli to 48 healthy human participants and independently modulated sensory information (stimulus intensity) and expectations of pain intensity while measuring brain activity using electroencephalography (EEG). Pain ratings confirmed that pain intensity was shaped by both sensory information and expectations. In contrast, Bayesian analyses revealed that stimulus-induced EEG responses at different latencies (the N1, N2, and P2 components) and frequencies (alpha, beta, and gamma oscillations) were shaped by sensory information but not by expectations. Expectations, however, shaped alpha and beta oscillations before the painful stimuli. These findings indicate that commonly analyzed EEG responses to painful stimuli are more involved in signaling sensory information than in signaling expectations or mismatches of sensory information and expectations. Moreover, they indicate that the effects of expectations on pain are served by brain mechanisms which differ from those conveying effects of sensory information on pain.

The Predictive Dynamics of Happiness and Well-Being

We offer an account of mental health and well-being using the predictive processing framework (PPF). According to this framework, the difference between mental health and psychopathology can be located in the goodness of the predictive model as a regulator of action. What is crucial for avoiding the rigid patterns of thinking, feeling and acting associated with psychopathology is the regulation of action based on the valence of affective states. In PPF, valence is modelled as error dynamics—the change in prediction errors over time . Our aim in this paper is to show how error dynamics can account for both momentary happiness and longer term well-being. What will emerge is a new neurocomputational framework for making sense of human flourishing.

Standard Tone Stability as a Manipulation of Precision in the Oddball Paradigm: Modulation of Prediction Error Responses to Fixed-Probability Deviants

Electrophysiological sensory deviance detection signals, such as the mismatch negativity (MMN), have been interpreted from the predictive coding framework as manifestations of prediction error (PE). From a frequentist perspective of the classic oddball paradigm, deviant stimuli are unexpected because of their low probability. However, the amount of PE elicited by a stimulus can be dissociated from its probability of occurrence: when the observer cannot make confident predictions, any event holds little surprise value, no matter how improbable. Here we tested the hypothesis that the magnitude of the neural response elicited to an improbable sound (D) would scale with the precision of the prediction derived from the repetition of another sound (S), by manipulating repetition stability. We recorded the Electroencephalogram (EEG) from 20 participants while passively listening to 4 types of isochronous pure tone sequences differing in the probability of the S tone (880 Hz) while holding constant the probability of the D tone [1,046 Hz; p(D) = 1/11]: Oddball [p(S) = 10/11]; High confidence (7/11); Low confidence (4/11); and Random (1/11). Tones of 9 different frequencies were equiprobably presented as fillers [p(S) + p(D) + p(F) = 1]. Using a mass-univariate non-parametric, cluster-based correlation analysis controlling for multiple comparisons, we found that the amplitude of the deviant-elicited ERP became more negative with increasing S probability, in a time-electrode window consistent with the MMN (ca. 120–200 ms; frontal), suggesting that the strength of a PE elicited to an improbable event indeed increases with the precision of the predictive model.

Automatic Sensory Predictions: A Review of Predictive Mechanisms in the Brain and Their Link to Conscious Processing

The human brain has the astonishing capacity of integrating streams of sensory information from the environment and forming predictions about future events in an automatic way. Despite being initially developed for visual processing, the bulk of predictive coding research has subsequently focused on auditory processing, with the famous mismatch negativity signal as possibly the most studied signature of a surprise or prediction error (PE) signal. Auditory PEs are present during various consciousness states. Intriguingly, their presence and characteristics have been linked with residual levels of consciousness and return of awareness. In this review we first give an overview of the neural substrates of predictive processes in the auditory modality and their relation to consciousness. Then, we focus on different states of consciousness - wakefulness, sleep, anesthesia, coma, meditation, and hypnosis - and on what mysteries predictive processing has been able to disclose about brain functioning in such states. We review studies investigating how the neural signatures of auditory predictions are modulated by states of reduced or lacking consciousness. As a future outlook, we propose the combination of electrophysiological and computational techniques that will allow investigation of which facets of sensory predictive processes are maintained when consciousness fades away.

Electrophysiological Signatures of Hierarchical Learning

Human perception and learning is thought to rely on a hierarchical generative model that is continuously updated via precision-weighted prediction errors (pwPEs). However, the neural basis of such cognitive process and how it unfolds during decision-making remain poorly understood. To investigate this question, we combined a hierarchical Bayesian model (i.e., Hierarchical Gaussian Filter [HGF]) with electroencephalography (EEG), while participants performed a probabilistic reversal learning task in alternatingly stable and volatile environments. Behaviorally, the HGF fitted significantly better than two control, nonhierarchical, models. Neurally, low-level and high-level pwPEs were independently encoded by the P300 component. Low-level pwPEs were reflected in the theta (4-8 Hz) frequency band, but high-level pwPEs were not. Furthermore, the expressions of high-level pwPEs were stronger for participants with better HGF fit. These results indicate that the brain employs hierarchical learning and encodes both low- and high-level learning signals separately and adaptively.

Preattentive processing of visually guided self-motion in humans and monkeys

The visually-based control of self-motion is a challenging task, requiring - if needed - immediate adjustments to keep on track. Accordingly, it would appear advantageous if the processing of self-motion direction (heading) was predictive, thereby accelerating the encoding of unexpected changes, and un-impaired by attentional load. We tested this hypothesis by recording EEG in humans and macaque monkeys with similar experimental protocols. Subjects viewed a random dot pattern simulating self-motion across a ground plane in an oddball EEG paradigm. Standard and deviant trials differed only in their simulated heading direction (forward-left vs. forward-right). Event-related potentials (ERPs) were compared in order to test for the occurrence of a visual mismatch negativity (vMMN), a component that reflects preattentive and likely also predictive processing of sensory stimuli. Analysis of the ERPs revealed signatures of a prediction mismatch for deviant stimuli in both humans and monkeys. In humans, a MMN was observed starting 110 ms after self-motion onset. In monkeys, peak response amplitudes following deviant stimuli were enhanced compared to the standard already 100 ms after self-motion onset. We consider our results strong evidence for a preattentive processing of visual self-motion information in humans and monkeys, allowing for ultrafast adjustments of their heading direction.

Subjectively different emotional schematic faces not automatically discriminated from the brain's bioelectrical responses

The present study investigates how the brain automatically discriminates emotional schematic faces, as indicated by the mismatch responses, and how reliable these brain responses are. Thirty-three healthy volunteers participated in the vMMN EEG experiment with four experimental sets differing from each other by the type of standard (object with scrambled face features) and the type of deviants (Angry, Happy and Neutral schematic faces) presented. Conscious subjective evaluations of valence, arousal and attention catching of the same stimuli showed clear differentiation of emotional expressions. Deviant faces elicited rather similar vMMN at frontal and occipital sites. Bayesian analyses suggest that vMMN does not differ between angry and happy faces. Neutral faces, however, did not yield statistically significant vMMN at occipital leads. Pearson's correlation and intra-class correlation analyses showed that the brain's reactions to the stimuli were highly stable within individuals across the experimental sets, whereas the mismatch responses were much more variable.

Evaluating the evidence for expectation suppression in the visual system

Reports of expectation suppression have shaped the development of influential predictive coding-based theories of visual perception. However recent work has highlighted confounding factors that may mimic or inflate expectation suppression effects. In this review, we describe four confounds that are prevalent across experiments that tested for expectation suppression: effects of surprise, attention, stimulus repetition and adaptation, and stimulus novelty. With these confounds in mind we then critically review the evidence for expectation suppression across probabilistic cueing, statistical learning, oddball, action-outcome learning and apparent motion designs. We found evidence for expectation suppression within a specific subset of statistical learning designs that involved weeks of sequence learning prior to neural activity measurement. Across other experimental contexts, whereby stimulus appearance probabilities were learned within one or two testing sessions, there was inconsistent evidence for genuine expectation suppression. We discuss how an absence of expectation suppression could inform models of predictive processing, repetition suppression and perceptual decision-making. We also provide suggestions for designing experiments that may better test for expectation suppression in future work.

MEG reveals preference specific increases of sexual-image-evoked responses in paedophilic sexual offenders and healthy controls

OBJECTIVES

Paedophilic disorder is characterised by sexual attraction towards children. Classification of a counterpart as sexually attractive likely occurs rapidly, and involves both conscious and unconscious attentional and cognitive processes. Magnetoencephalography (MEG) is an imaging method especially well-suited to examine visual and attentional processes triggered by sexual images within the range of milliseconds.

METHODS

We investigated brain responses to sexual images depicting adults (frequent) and children (infrequent stimulus) in seventeen paedophilic patients with a history of child sexual offending (P + CSO) and twenty healthy controls (HC) during a passive visual oddball paradigm. Event-related fields (ERF) were measured to extract the magnetic visual mismatch negativity (vMMNm), and how it relates to the processing of different classes of sexual stimuli.

RESULTS

P + CSO exhibited significantly longer vMMNm latencies (100-180 ms post-stimulus) than HC. Moreover, P + CSO showed widespread increased amplitudes in response to child images starting from P3a and P3b components and lasting up to 400 ms post-stimulus presentation localised in frontal and temporal brain regions.

CONCLUSIONS

This study uncovers the first MEG differences in automatic change detection between P + CSO and HC during the presentation of subliminal sexual images of adults and children, contributing towards a better understanding of the neurobiological processes of P + CSO.

What's next? Neural correlates of emotional predictions: A high-density EEG investigation

Emotions were recently reconsidered as predictions, constructed by the brain (generation stage) to prearrange action (implementation stage), and update internal models according to incoming stimuli (updating stage). However, it is unclear how emotional predictions are shaped by stimuli predictability. This study investigated the role of stimuli predictability on emotional predictions through high-density EEG. Twenty-six undergraduates underwent a S1-S2 paradigm, with emotional faces as S1s and emotional pictures as S2s. Stimuli predictability was manipulated across three blocks, in which S1 valence was predictive of S2 in the 100%, 75%, or 50% of trials. ERPs and brain sources were analyzed for each stage. During prediction generation, a larger N170/superior temporal sulcus activity emerged to fearful faces in blocks with full (100%) and medium (75%) predictive ratios. During implementation, the random block (50%) elicited a valence-independent pre-allocation of resources, reflected by a larger CNV and activation of a wide left network. In the updating stage, emotional pictures always elicited a larger LPP, while a larger P2 to neutral stimuli and a higher activity of the orbitofrontal cortex signaled early valence-dependent and late block-dependent prediction errors. These findings provide the first evidence of how stimuli predictability shape each neurocomputational stage of emotional predictions construction.

Neural surprise in somatosensory Bayesian learning

Tracking statistical regularities of the environment is important for shaping human behavior and perception. Evidence suggests that the brain learns environmental dependencies using Bayesian principles. However, much remains unknown about the employed algorithms, for somesthesis in particular. Here, we describe the cortical dynamics of the somatosensory learning system to investigate both the form of the generative model as well as its neural surprise signatures. Specifically, we recorded EEG data from 40 participants subjected to a somatosensory roving-stimulus paradigm and performed single-trial modeling across peri-stimulus time in both sensor and source space. Our Bayesian model selection procedure indicates that evoked potentials are best described by a non-hierarchical learning model that tracks transitions between observations using leaky integration. From around 70ms post-stimulus onset, secondary somatosensory cortices are found to represent confidence-corrected surprise as a measure of model inadequacy. Indications of Bayesian surprise encoding, reflecting model updating, are found in primary somatosensory cortex from around 140ms. This dissociation is compatible with the idea that early surprise signals may control subsequent model update rates. In sum, our findings support the hypothesis that early somatosensory processing reflects Bayesian perceptual learning and contribute to an understanding of its underlying mechanisms.

Our environment features statistical regularities, such as a drop of rain predicting imminent rainfall. Despite the importance for behavior and survival, much remains unknown about how these dependencies are learned, particularly for somatosensation. As surprise signalling about novel observations indicates a mismatch between one’s beliefs and the world, it has been hypothesized that surprise computation plays an important role in perceptual learning. By analyzing EEG data from human participants receiving sequences of tactile stimulation, we compare different formulations of surprise and investigate the employed underlying learning model. Our results indicate that the brain estimates transitions between observations. Furthermore, we identified different signatures of surprise computation and thereby provide a dissociation of the neural correlates of belief inadequacy and belief updating. Specifically, early surprise responses from around 70ms were found to signal the need for changes to the model, with encoding of its subsequent updating occurring from around 140ms. These results provide insights into how somatosensory surprise signals may contribute to the learning of environmental statistics.

Timing of repetition suppression of event-related potentials to unattended objects

Current theories of object perception emphasize the automatic nature of perceptual inference. Repetition suppression (RS), the successive decrease of brain responses to repeated stimuli, is thought to reflect the optimization of perceptual inference through neural plasticity. While functional imaging studies revealed brain regions that show suppressed responses to the repeated presentation of an object, little is known about the intra-trial time course of repetition effects to everyday objects. Here, we used event-related potentials (ERPs) to task-irrelevant line-drawn objects, while participants engaged in a distractor task. We quantified changes in ERPs over repetitions using three general linear models that modeled RS by an exponential, linear, or categorical "change detection" function in each subject. Our aim was to select the model with highest evidence and determine the within-trial time-course and scalp distribution of repetition effects using that model. Model comparison revealed the superiority of the exponential model indicating that repetition effects are observable for trials beyond the first repetition. Model parameter estimates revealed a sequence of RS effects in three time windows (86-140, 322-360, and 400-446 ms) and with occipital, temporoparietal, and frontotemporal distribution, respectively. An interval of repetition enhancement (RE) was also observed (320-340 ms) over occipitotemporal sensors. Our results show that automatic processing of task-irrelevant objects involves multiple intervals of RS with distinct scalp topographies. These sequential intervals of RS and RE might reflect the short-term plasticity required for optimization of perceptual inference and the associated changes in prediction errors and predictions, respectively, over stimulus repetitions during automatic object processing.

Visual mismatch responses index surprise signalling but not expectation suppression

The ability to distinguish between commonplace and unusual sensory events is critical for efficient learning and adaptive behaviour. This has been investigated using oddball designs in which sequences of often-appearing (i.e., expected) stimuli are interspersed with rare (i.e., surprising) deviants. Resulting differences in electrophysiological responses following surprising compared to expected stimuli are known as visual mismatch responses (VMRs). VMRs are thought to index co-occurring contributions of stimulus repetition effects, expectation suppression (that occurs when one's expectations are fulfilled), and expectation violation (i.e., surprise) responses; however, these different effects have been conflated in existing oddball designs. To better isolate and quantify effects of expectation suppression and surprise, we adapted an oddball design based on Fast Periodic Visual Stimulation (FPVS) that controls for stimulus repetition effects. We recorded electroencephalography (EEG) while participants (N = 48) viewed stimulation sequences in which a single face identity was periodically presented at 6 Hz. Critically, one of two different face identities (termed oddballs) appeared as every 7th image throughout the sequence. The presentation probabilities of each oddball image within a sequence varied between 10 and 90%, such that participants could form expectations about which oddball face identity was more likely to appear within each sequence. We also included 'expectation neutral' 50% probability sequences, whereby consistently biased expectations would not be formed for either oddball face identity. We found that VMRs indexed surprise responses, and effects of expectation suppression were absent. That is, ERPs were more negative-going at occipitoparietal electrodes for surprising compared to neutral oddballs, but did not differ between expected and neutral oddballs. Surprising oddball-evoked ERPs were also highly similar across the 10-40% appearance probability conditions. Our findings indicate that VMRs which are not accounted for by repetition effects are best described as an all-or-none surprise response, rather than a minimisation of prediction error responses associated with expectation suppression.

State anxiety biases estimates of uncertainty and impairs reward learning in volatile environments

Clinical and subclinical (trait) anxiety impairs decision making and interferes with learning. Less understood are the effects of temporary anxious states on learning and decision making in healthy populations, and whether these can serve as a model for clinical anxiety. Here we test whether anxious states in healthy individuals elicit a pattern of aberrant behavioural, neural, and physiological responses comparable with those found in anxiety disorders-particularly when processing uncertainty in unstable environments. In our study, both a state anxious and a control group learned probabilistic stimulus-outcome mappings in a volatile task environment while we recorded their electrophysiological (EEG) signals. By using a hierarchical Bayesian model of inference and learning, we assessed the effect of state anxiety on Bayesian belief updating with a focus on uncertainty estimates. State anxiety was associated with an underestimation of environmental uncertainty, and informational uncertainty about the reward tendency. Anxious individuals' beliefs about reward contingencies were more precise (had smaller uncertainty) and thus more resistant to updating, ultimately leading to impaired reward-based learning. State anxiety was also associated with greater uncertainty about volatility. We interpret this pattern as evidence that state anxious individuals are less tolerant to informational uncertainty about the contingencies governing their environment and more willing to be uncertain about the level of stability of the world itself. Further, we tracked the neural representation of belief update signals in the trial-by-trial EEG amplitudes. In control participants, lower-level precision-weighted prediction errors (pwPEs) about reward tendencies were represented in the ERP signals across central and parietal electrodes peaking at 496 ms, overlapping with the late P300 in classical ERP analysis. The state anxiety group did not exhibit a significant representation of low-level pwPEs, and there were no significant differences between the groups. Smaller variance in low-level pwPE about reward tendencies in state anxiety could partially account for the null results. Expanding previous computational work on trait anxiety, our findings establish that temporary anxious states in healthy individuals impair reward-based learning in volatile environments, primarily through changes in uncertainty estimates, which play a central role in current Bayesian accounts of perceptual inference and learning.

Characterizing the brain's dynamical response from scalp-level neural electrical signals: a review of methodology development

The brain displays dynamical system behaviors at various levels that are functionally and cognitively relevant. Ample researches have examined how the dynamical properties of brain activity reflect the neural cognitive working mechanisms. A prevalent approach in this field is to extract the trial-averaged brain electrophysiological signals as a representation of the dynamical response of the complex neural system to external stimuli. However, the responses are intrinsically variable in latency from trial to trial. The variability compromises the accuracy of the detected dynamical response pattern based on trial-averaged approach, which may mislead subsequent modelling works. More accurate characterization of the brain's dynamical response incorporating single trial variability information is of profound significance in deepening our understanding of neural cognitive dynamics and brain's working principles. Various methods have been attempted to address the trial-to-trial asynchrony issue in order to achieve an improved representation of the dynamical response. We review the latest development of methodology in this area and the contribution of latency variability-based decomposition and reconstruction of dynamical response to neural cognitive researches.

Associations of mismatch negativity with psychotic symptoms and functioning transdiagnostically across psychotic disorders

Mismatch negativity (MMN) amplitude has been widely shown to be diminished in schizophrenia and, more recently, in other psychotic disorders. Although there is considerable evidence linking MMN reduction to cognitive and functional deficits in schizophrenia, there is little evidence of associations with specific psychotic symptoms. Further, it is unclear if MMN reductions relate to specific symptoms, cognitive, and functional deficits transdiagnostically across different psychotic disorders. The present study examines MMN amplitude in a large cohort of cases diagnosed with psychotic disorders including schizophrenia and schizoaffective disorder (N = 116); bipolar disorder and major depressive disorder (N = 75); and other psychotic disorders (N = 25), as well as individuals with no psychotic disorder diagnoses (N = 248). Furthermore, we examined the association of MMN with symptoms, cognitive functioning, and real-world functioning to determine whether these relationships differ by diagnosis. Results showed that MMN amplitude was reduced in cases overall compared to never-psychotic individuals, with no differences between psychotic disorders. Furthermore, there were transdiagnostic associations of reduced duration MMN (MMN-D) with worse auditory hallucinations (r = .14) and disorganization (r = .14), frequency MMN (MMN-F) with real-word functioning (r = .20) and episodic memory (r = -.22), and both components with executive functioning (MMN-D: r = -.17; MMN-F: r = -.15). Our findings relating MMN reductions with cognitive and real-world functioning replicate earlier research in schizophrenia and extend these relationships to other psychotic disorders. Furthermore, our correlations with MMN-D are consistent with computational modeling research and theoretical proposals that view MMN reduction, cognitive dysfunction, and psychotic symptoms as reflecting underlying predictive coding deficits. However, differences in relationships with MMN-F suggest that additional work is warranted on this topic. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Ketamine Affects Prediction Errors about Statistical Regularities: A Computational Single-Trial Analysis of the Mismatch Negativity

The auditory mismatch negativity (MMN) is significantly reduced in schizophrenia. Notably, a similar MMN reduction can be achieved with NMDA receptor (NMDAR) antagonists. Both phenomena have been interpreted as reflecting an impairment of predictive coding or, more generally, the "Bayesian brain" notion that the brain continuously updates a hierarchical model to infer the causes of its sensory inputs. Specifically, neurobiological interpretations of predictive coding view perceptual inference as an NMDAR-dependent process of minimizing hierarchical precision-weighted prediction errors (PEs), and disturbances of this putative process play a key role in hierarchical Bayesian theories of schizophrenia. Here, we provide empirical evidence for this theory, demonstrating the existence of multiple, hierarchically related PEs in a "roving MMN" paradigm. We applied a hierarchical Bayesian model to single-trial EEG data from healthy human volunteers of either sex who received the NMDAR antagonist S-ketamine in a placebo-controlled, double-blind, within-subject fashion. Using an unrestricted analysis of the entire time-sensor space, our trial-by-trial analysis indicated that low-level PEs (about stimulus transitions) are expressed early (102-207 ms poststimulus), while high-level PEs (about transition probability) are reflected by later components (152-199 and 215-277 ms) of single-trial responses. Furthermore, we find that ketamine significantly diminished the expression of high-level PE responses, implying that NMDAR antagonism disrupts the inference on abstract statistical regularities. Our findings suggest that NMDAR dysfunction impairs hierarchical Bayesian inference about the world's statistical structure. Beyond the relevance of this finding for schizophrenia, our results illustrate the potential of computational single-trial analyses for assessing potential pathophysiological mechanisms.

Alterations in the amplitude and burst rate of beta oscillations impair reward-dependent motor learning in anxiety

Anxiety results in sub-optimal motor learning, but the precise mechanisms through which this effect occurs remain unknown. Using a motor sequence learning paradigm with separate phases for initial exploration and reward-based learning, we show that anxiety states in humans impair learning by attenuating the update of reward estimates. Further, when such estimates are perceived as unstable over time (volatility), anxiety constrains adaptive behavioral changes. Neurally, anxiety during initial exploration increased the amplitude and the rate of long bursts of sensorimotor and prefrontal beta oscillations (13-30 Hz). These changes extended to the subsequent learning phase, where phasic increases in beta power and burst rate following reward feedback were linked to smaller updates in reward estimates, with a higher anxiety-related increase explaining the attenuated belief updating. These data suggest that state anxiety alters the dynamics of beta oscillations during reward processing, thereby impairing proper updating of motor predictions when learning in unstable environments.

Differential Effects of Awareness and Task Relevance on Early and Late ERPs in a No-Report Visual Oddball Paradigm

To date it is poorly understood how and when deviance processing interacts with awareness and task relevance. Furthermore, an important issue in the study of consciousness is the prevalent confound of conscious perception with the requirement of reporting it. This study addresses these topics using a no-report inattentional blindness paradigm with a visual oddball sequence of geometrical shapes presented to male and female human participants. Electrophysiological responses were obtained in three physically identical Phases A-C that differed only with respect to the instructions: (A) participants were uninformed about the shapes and attended an unrelated foreground task (inattentional blind), (B) were informed about the shapes but still attended the foreground task, and (C) attended the shapes. Conscious processing of shapes was indexed by the visual awareness negativity but not a P3. Deviance processing was associated with the visual mismatch negativity independently of consciousness and task relevance. The oddball P3, however, only emerged when the stimuli were task relevant, and was absent for consciously perceived but task irrelevant stimuli. The P3 thus does not represent a reliable marker of stimulus awareness. This result pattern supports the view of hierarchical predictive processing, where lower levels display automatic deviance processing, whereas higher levels require attention and task relevance.SIGNIFICANCE STATEMENT To react to potentially important changes in our environment it is fundamental to detect deviations from regularities of sensory input. It has yet to be understood how awareness and task relevance of this input interact with deviance processing. We investigated the role of awareness in deviance detection while at the same time circumventing the confound of awareness and report by means of a no-report paradigm. Our results suggest that early processes are elicited automatically, whereas, contrary to prominent theories, late processes do not depend on awareness but on task-based attention.

Evaluating the neurophysiological evidence for predictive processing as a model of perception

For many years, the dominant theoretical framework guiding research into the neural origins of perceptual experience has been provided by hierarchical feedforward models, in which sensory inputs are passed through a series of increasingly complex feature detectors. However, the long-standing orthodoxy of these accounts has recently been challenged by a radically different set of theories that contend that perception arises from a purely inferential process supported by two distinct classes of neurons: those that transmit predictions about sensory states and those that signal sensory information that deviates from those predictions. Although these predictive processing (PP) models have become increasingly influential in cognitive neuroscience, they are also criticized for lacking the empirical support to justify their status. This limited evidence base partly reflects the considerable methodological challenges that are presented when trying to test the unique predictions of these models. However, a confluence of technological and theoretical advances has prompted a recent surge in human and nonhuman neurophysiological research seeking to fill this empirical gap. Here, we will review this new research and evaluate the degree to which its findings support the key claims of PP.

The release from refractoriness hypothesis of N1 of event-related potentials needs reassessment

N1 of event-related potentials (ERPs) is augmented in amplitude in ∼50-150 ms by occasional changes (deviants) in the physical features of a sound repeated at intervals of from ∼400 ms to seconds (standard). The release-from-refractoriness hypothesis links the N1 augmentation to a deviant-feature-specific neural population that is fresh to fully respond as opposed to a standard-feature-specific neural population that is unresponsive due to its post-response refractoriness. The present work explored this hypothesis in the context of ERP studies, behavioral habituation studies and studies on stimulus-specific adaptation (SSA). The idea of hundreds of milliseconds neural population-level refractoriness was observed to be founded upon negative N1 evidence (no observable effect of dishabituating stimuli on N1 to standards - the null hypothesis retained) and merely supported by positive N1 evidence (null hypotheses rejected). This idea was also found to be directly challenged by positive N1 evidence. No conclusive network- or single-neuron-level evidence was found for the refractoriness. Therefore, the validity of the release-from-refractoriness hypothesis of N1 to guide psychophysiological research needs reassessment.

Combined expectancies: the role of expectations for the coding of salient bottom-up signals

The visual system forms predictions about upcoming visual features based on previous visual experiences. Such predictions impact on current perception, so that expected stimuli can be detected faster and with higher accuracy. A key question is how these predictions are formed and on which levels of processing they arise. Particularly, predictions could be formed on early levels of processing, where visual features are represented separately, or might require higher levels of processing, with predictions formed based on full object representations that involve combinations of visual features. In four experiments, the present study investigated whether the visual system forms joint prediction errors or whether expectations about different visual features such as color and orientation are formed independently. The first experiment revealed that task-irrelevant and implicitly learned expectations were formed independently when the features were separately bound to different objects. In a second experiment, no evidence for a mutual influence of both types of task-irrelevant and implicitly formed feature expectations was observed, although both visual features were assigned to the same objects. A third experiment confirmed the findings of the previous experiments for explicitly rather than implicitly formed expectations. Finally, no evidence for a mutual influence of different feature expectations was observed when features were assigned to a single centrally presented object. Overall, the present results do not support the view that object feature binding generates joint feature-based expectancies of different object features. Rather, the results suggest that expectations for color and orientation are processed and resolved independently at the feature level.