Immediate stimulus repetition abolishes stimulus expectation and surprise effects in fast periodic visual oddball designs

Stimulus expectations do not modulate visual event-related potentials in probabilistic cueing designs

Humans and other animals can learn and exploit repeating patterns that occur within their environments. These learned patterns can be used to form expectations about future sensory events. Several influential predictive coding models have been proposed to explain how learned expectations influence the activity of stimulus-selective neurons in the visual system. These models specify reductions in neural response measures when expectations are fulfilled (termed expectation suppression) and increases following surprising sensory events. However, there is currently scant evidence for expectation suppression in the visual system when confounding factors are taken into account. Effects of surprise have been observed in blood oxygen level dependent (BOLD) signals, but not when using electrophysiological measures. To provide a strong test for expectation suppression and surprise effects we performed a predictive cueing experiment while recording electroencephalographic (EEG) data. Participants (n=48) learned cue-face associations during a training session and were then exposed to these cue-face pairs in a subsequent experiment. Using univariate analyses of face-evoked event-related potentials (ERPs) we did not observe any differences across expected (90% probability), neutral (50%) and surprising (10%) face conditions. Across these comparisons, Bayes factors consistently favoured the null hypothesis throughout the time-course of the stimulus-evoked response. When using multivariate pattern analysis we did not observe above-chance classification of expected and surprising face-evoked ERPs. By contrast, we found robust within- and across-trial stimulus repetition effects. Our findings do not support predictive coding-based accounts that specify reduced prediction error signalling when perceptual expectations are fulfilled. They instead highlight the utility of other types of predictive processing models that describe expectation-related phenomena in the visual system without recourse to prediction error signalling.

The automatic detection of unexpected emotion and neutral body postures: A visual mismatch negativity study

The ability to automatically detect emotional changes in the environment is crucial for social interaction. In the visual system, expression-related mismatch negativity (EMMN) reflects the automatic processing of emotional changes in facial expression. However, body postures also carry visual emotional information that can be recognized effectively and processed automatically, although their processing mechanism remains unknown. In this study, the reverse oddball paradigm was used to investigate the mismatch responses of unexpected fear and neutral body postures. The nonparametric cluster permutation test revealed significant fear and neutral visual mismatch negativity (vMMN) activities, and the fear-related vMMN was enhanced prior (130-230 ms) to the neutral vMMN (180-230 ms). The body-sensitive N190 component may partially account for the vMMN obtained in this study. The fearful body posture evoked a greater N190 response over the neutral body, and amplitudes of N190 were more negative in the deviant condition than the standard condition. Additionally, the body-related visual mismatch oscillatory responses were associated with enhancement of the alpha band oscillation, especially for the fearful body posture. These results expanded the applicable scope of body posture cues corresponding to mismatch signals, objectively defined the electrophysiological activities evoked, and revealed the processing bias toward negative emotion.

Balancing Prediction and Surprise: A Role for Active Sleep at the Dawn of Consciousness?

The brain is a prediction machine. Yet the world is never entirely predictable, for any animal. Unexpected events are surprising, and this typically evokes prediction error signatures in mammalian brains. In humans such mismatched expectations are often associated with an emotional response as well, and emotional dysregulation can lead to cognitive disorders such as depression or schizophrenia. Emotional responses are understood to be important for memory consolidation, suggesting that positive or negative 'valence' cues more generally constitute an ancient mechanism designed to potently refine and generalize internal models of the world and thereby minimize prediction errors. On the other hand, abolishing error detection and surprise entirely (as could happen by generalization or habituation) is probably maladaptive, as this might undermine the very mechanism that brains use to become better prediction machines. This paradoxical view of brain function as an ongoing balance between prediction and surprise suggests a compelling approach to study and understand the evolution of consciousness in animals. In particular, this view may provide insight into the function and evolution of 'active' sleep. Here, we propose that active sleep - when animals are behaviorally asleep but their brain seems awake - is widespread beyond mammals and birds, and may have evolved as a mechanism for optimizing predictive processing in motile creatures confronted with constantly changing environments. To explore our hypothesis, we progress from humans to invertebrates, investigating how a potential role for rapid eye movement (REM) sleep in emotional regulation in humans could be re-examined as a conserved sleep function that co-evolved alongside selective attention to maintain an adaptive balance between prediction and surprise. This view of active sleep has some interesting implications for the evolution of subjective awareness and consciousness in animals.

Neurophysiological responses of globus pallidus internus during the auditory oddball task in Parkinson's disease

Parkinson's disease can be associated with significant cognitive impairment that may lead to dementia. Deep brain stimulation (DBS) of the subthalamic nucleus is an effective therapy for motor symptoms but is associated with cognitive decline. DBS of globus pallidus internus (GPi) poses less risk of cognitive decline so may be the preferred target. A research priority is to identify biomarkers of cognitive decline in this population, but efforts are hampered by a lack of understanding of the role of the different basal ganglia nuclei, such as the globus pallidus, in cognitive processing. During deep brain stimulation (DBS) surgery, we monitored single units, beta oscillatory LFP activity as well as event related potentials (ERPs) from the globus pallidus internus (GPi) of 16 Parkinson's disease patients, while they performed an auditory attention task. We used an auditory oddball task, during which one standard tone is presented at regular intervals and a second deviant tone is presented with a low probability that the subject is requested to count and report at the end of the task. All forms of neuronal activity studied were selective modulated by the attended tones. Of 62 neurons studied, the majority (51 or 82%) responded selectively to the deviant tone. Beta oscillatory activity showed an overall desynchronization during both types of attended tones interspersed by bursts of beta activity giving rise to peaks at a latency of around 200 ms after tone onset. cognitive ERPs recorded in GPi were selective to the attended tone and the right-side cERP was larger than the left side. The averages of trials showing a difference in beta oscillatory activity between deviant and standard also had a significant difference in cERP amplitude. In one block of trials, the random occurrence of 3 deviant tones in short succession silenced the activity of the GPi neuron being recorded. Trial blocks where a clear difference in LFP beta was seen were twice as likely to yield a correct tone count (25 vs 11). The data demonstrate strong modulation of GPi neuronal activity during the auditory oddball task. Overall, this study demonstrates an involvement of GPi in processing of non-motor cognitive tasks such as working memory and attention, and suggests that direct effects of DBS in non-motor GPi may contribute to cognitive changes observed post-operatively.

Evaluating the evidence for expectation suppression in the visual system

Reports of expectation suppression have shaped the development of influential predictive coding-based theories of visual perception. However recent work has highlighted confounding factors that may mimic or inflate expectation suppression effects. In this review, we describe four confounds that are prevalent across experiments that tested for expectation suppression: effects of surprise, attention, stimulus repetition and adaptation, and stimulus novelty. With these confounds in mind we then critically review the evidence for expectation suppression across probabilistic cueing, statistical learning, oddball, action-outcome learning and apparent motion designs. We found evidence for expectation suppression within a specific subset of statistical learning designs that involved weeks of sequence learning prior to neural activity measurement. Across other experimental contexts, whereby stimulus appearance probabilities were learned within one or two testing sessions, there was inconsistent evidence for genuine expectation suppression. We discuss how an absence of expectation suppression could inform models of predictive processing, repetition suppression and perceptual decision-making. We also provide suggestions for designing experiments that may better test for expectation suppression in future work.

Visual mismatch responses index surprise signalling but not expectation suppression

The ability to distinguish between commonplace and unusual sensory events is critical for efficient learning and adaptive behaviour. This has been investigated using oddball designs in which sequences of often-appearing (i.e., expected) stimuli are interspersed with rare (i.e., surprising) deviants. Resulting differences in electrophysiological responses following surprising compared to expected stimuli are known as visual mismatch responses (VMRs). VMRs are thought to index co-occurring contributions of stimulus repetition effects, expectation suppression (that occurs when one's expectations are fulfilled), and expectation violation (i.e., surprise) responses; however, these different effects have been conflated in existing oddball designs. To better isolate and quantify effects of expectation suppression and surprise, we adapted an oddball design based on Fast Periodic Visual Stimulation (FPVS) that controls for stimulus repetition effects. We recorded electroencephalography (EEG) while participants (N = 48) viewed stimulation sequences in which a single face identity was periodically presented at 6 Hz. Critically, one of two different face identities (termed oddballs) appeared as every 7th image throughout the sequence. The presentation probabilities of each oddball image within a sequence varied between 10 and 90%, such that participants could form expectations about which oddball face identity was more likely to appear within each sequence. We also included 'expectation neutral' 50% probability sequences, whereby consistently biased expectations would not be formed for either oddball face identity. We found that VMRs indexed surprise responses, and effects of expectation suppression were absent. That is, ERPs were more negative-going at occipitoparietal electrodes for surprising compared to neutral oddballs, but did not differ between expected and neutral oddballs. Surprising oddball-evoked ERPs were also highly similar across the 10-40% appearance probability conditions. Our findings indicate that VMRs which are not accounted for by repetition effects are best described as an all-or-none surprise response, rather than a minimisation of prediction error responses associated with expectation suppression.

External (Versus Internal) Facial Features Contribute Most to Repetition Priming in Facial Recognition: ERP Evidence

Previous event-related potential (ERP) research demonstrated four successive ERP components in the repetition priming of human face recognition: P100, N170, N250r, and N400. While these components correspond, respectively, to the four stages proposed by the interactive activation and competition (IAC) model, there has been no emphasis in past research on how internal and external facial features affect repetition priming and the sensitivity of these ERP components to item interval. This study was designed to address these issues. We used faces of celebrities as targets, including completely familiar faces, familiar internal feature faces, and familiar external feature faces. We displayed a target face either immediately following its prime (immediate repetition) or after a delay with interference from a presentation of two other faces (delayed repetition). ERP differences at P100 and N170 were nearly statistically non-significant; familiar faces and familiar external feature faces were associated with reliable ERP signals of N250r and N400 in the immediate repetition condition. For delayed repetition, however, N250r and N400 signals were only preserved for the familiar external feature faces. The differences of these ERP components suggest that, compared with internal facial features, external features of a previously presented face contribute more to brain-based facial repetition priming, particularly during the last two stages of the IAC model.