Visual mismatch negativity: a predictive coding view

Automatic processing of unattended mean emotion: Evidence from visual mismatch responses

The mean emotion from multiple facial expressions can be extracted rapidly and precisely. However, it remains debated whether mean emotion processing is automatic which can occur under no attention. To address this question, we used a passive oddball paradigm and recorded event-related brain potentials when participants discriminated the changes in the central fixation while a set of four faces was presented in the periphery. The face set consisted of one happy and three angry expressions (mean negative) or one angry and three happy expressions (mean positive), and the mean negative and mean positive face sets were shown with a probability of 20% (deviant) and 80% (standard) respectively in the sequence, or the vice versa. The cluster-based permutation analyses showed that the visual mismatch negativity started early at around 92 ms and was also observed in later time windows when the mean emotion was negative, while a mismatch positivity was observed at around 168-266 ms when the mean emotion was positive. The results suggest that there might be different mechanisms underlying the processing of mean negative and mean positive emotions. More importantly, the brain can detect the changes in the mean emotion automatically, and ensemble coding for multiple facial expressions can occur in an automatic fashion without attention.

Rare incompatible stimuli evoke visual mismatch negativity in a flanker task

In the flanker task, the behavioral performance for incompatible stimuli is worse in the mostly compatible (rare) condition than in the equiprobable condition. Furthermore, incompatible stimuli evoke visual mismatch negativity (VMMN) when comparing the rare and equiprobable conditions. Compatible and incompatible stimuli differ in terms of their shape and type. This study aimed to examine whether VMMN evoked by rare incompatible stimuli were associated with the shape or type of the stimulus. In a modified version of the flanker task, stimuli were manipulated by two shapes (typical or peculiar) and two types (compatible or incompatible): typical compatible stimuli (< <  <  <  < and >  >  >  > >), typical incompatible stimuli (> >  <  >  > and <  <  >  < <), peculiar compatible stimuli (+ <  <  <  + and +  >  >  > +), and peculiar incompatible stimuli (+ >  <  >  + and +  <  >  < +). In the rare condition, typical incompatible, peculiar compatible, and peculiar incompatible stimuli were presented with a probability of 10%, whereas all the stimuli were presented equally in the equiprobable condition. Right posterior negativity from 200 to 250 ms was significantly more negative in the rare condition than in the equiprobable condition for typical and peculiar incompatible stimuli; however, this difference was not observed for peculiar compatible stimuli. VMMN was significantly more negative for typical and peculiar incompatible stimuli than for peculiar compatible stimuli, and was not significantly different between typical and peculiar incompatible stimuli. These findings suggest that VMMN for incompatible stimuli is associated with the type rather than the shape of the stimulus.

Prioritization of social information processing: Eye gaze elicits earlier vMMN than arrows

Numerous research studies have demonstrated that eye gaze and arrows act as cues that automatically guide spatial attention. However, it remains uncertain whether the attention shifts triggered by these two types of stimuli vary in terms of automatic processing mechanisms. In our current investigation, we employed an equal probability paradigm to explore the likenesses and distinctions in the neural mechanisms of automatic processing for eye gaze and arrows in non-attentive conditions, using visual mismatch negative (vMMN) as an indicator of automatic processing. The sample size comprised 17 participants. The results indicated a significant interaction between time duration, stimulus material, and stimulus type. The findings demonstrated that both eye gaze and arrows were processed automatically, triggering an early vMMN, although with temporal variations. The vMMN for eye gaze occurred between 180 and 220 ms, whereas for arrows it ranged from 235 to 275 ms. Moreover, arrow stimuli produced a more pronounced vMMN amplitude. The earlier vMMN response to eye gaze compared with arrows implies the specificity and precedence of social information processing associated with eye gaze over the processing of nonsocial information with arrows. However, arrow could potentially elicit a stronger vMMN because of their heightened salience compared to the background, and the expansion of attention focusing might amplify the vMMN impact. This study offers insights into the similarities and differences in attention processing of social and non-social information under unattended conditions from the perspective of automatic processing.

PreCNet: Next-Frame Video Prediction Based on Predictive Coding

Predictive coding, currently a highly influential theory in neuroscience, has not been widely adopted in machine learning yet. In this work, we transform the seminal model of Rao and Ballard (1999) into a modern deep learning framework while remaining maximally faithful to the original schema. The resulting network we propose (PreCNet) is tested on a widely used next-frame video prediction benchmark, which consists of images from an urban environment recorded from a car-mounted camera, and achieves state-of-the-art performance. Performance on all measures (MSE, PSNR, and SSIM) was further improved when a larger training set (2M images from BDD100k) pointed to the limitations of the KITTI training set. This work demonstrates that an architecture carefully based on a neuroscience model, without being explicitly tailored to the task at hand, can exhibit exceptional performance.

Statistical Learning of Incidental Perceptual Regularities Induces Sensory Conditioned Cortical Responses

Statistical learning of sensory patterns can lead to predictive neural processes enhancing stimulus perception and enabling fast deviancy detection. Predictive processes have been extensively demonstrated when environmental statistical regularities are relevant to task execution. Preliminary evidence indicates that statistical learning can even occur independently of task relevance and top-down attention, although the temporal profile and neural mechanisms underlying sensory predictions and error signals induced by statistical learning of incidental sensory regularities remain unclear. In our study, we adopted an implicit sensory conditioning paradigm that elicited the generation of specific perceptual priors in relation to task-irrelevant audio-visual associations, while recording Electroencephalography (EEG). Our results showed that learning task-irrelevant associations between audio-visual stimuli resulted in anticipatory neural responses to predictive auditory stimuli conveying anticipatory signals of expected visual stimulus presence or absence. Moreover, we observed specific modulation of cortical responses to probabilistic visual stimulus presentation or omission. Pattern similarity analysis indicated that predictive auditory stimuli tended to resemble the response to expected visual stimulus presence or absence. Remarkably, Hierarchical Gaussian filter modeling estimating dynamic changes of prediction error signals in relation to differential probabilistic occurrences of audio-visual stimuli further demonstrated instantiation of predictive neural signals by showing distinct neural processing of prediction error in relation to violation of expected visual stimulus presence or absence. Overall, our findings indicated that statistical learning of non-salient and task-irrelevant perceptual regularities could induce the generation of neural priors at the time of predictive stimulus presentation, possibly conveying sensory-specific information about the predicted consecutive stimulus.

Neural mechanism underlying preview effects and masked priming effects in visual word processing

Two classic experimental paradigms - masked repetition priming and the boundary paradigm - have played a pivotal role in understanding the process of visual word recognition. Traditionally, these paradigms have been employed by different communities of researchers, with their own long-standing research traditions. Nevertheless, a review of the literature suggests that the brain-electric correlates of word processing established with both paradigms may show interesting similarities, in particular with regard to the location, timing, and direction of N1 and N250 effects. However, as of yet, no direct comparison has been undertaken between the two paradigms. In the current study, we used combined eye-tracking/EEG to perform such a within-subject comparison using the same materials (single Chinese characters) as stimuli. To facilitate direct comparisons, we used a simplified version of the boundary paradigm - the single word boundary paradigm. Our results show the typical early repetition effects of N1 and N250 for both paradigms. However, repetition effects in N250 (i.e., a reduced negativity following identical-word primes/previews as compared to different-word primes/previews) were larger with the single word boundary paradigm than with masked priming. For N1 effects, repetition effects were similar across the two paradigms, showing a larger N1 after repetitions as compared to alternations. Therefore, the results indicate that at the neural level, a briefly presented and masked foveal prime produces qualitatively similar facilitatory effects on visual word recognition as a parafoveal preview before a single saccade, although such effects appear to be stronger in the latter case.

Two Prediction Error Systems in the Nonlemniscal Inferior Colliculus: "Spectral" and "Nonspectral"

According to the predictive processing framework, perception emerges from the reciprocal exchange of predictions and prediction errors (PEs) between hierarchically organized neural circuits. The nonlemniscal division of the inferior colliculus (IC) is the earliest source of auditory PE signals, but their neuronal generators, properties, and functional relevance have remained mostly undefined. We recorded single-unit mismatch responses to auditory oddball stimulation at different intensities, together with activity evoked by two sequences of alternating tones to control frequency-specific effects. Our results reveal a differential treatment of the unpredictable "many-standards" control and the predictable "cascade" control by lemniscal and nonlemniscal IC neurons that is not present in the auditory thalamus or cortex. Furthermore, we found that frequency response areas of nonlemniscal IC neurons reflect their role in subcortical predictive processing, distinguishing three hierarchical levels: (1) nonlemniscal neurons with sharply tuned receptive fields exhibit mild repetition suppression without signaling PEs, thereby constituting the input level of the local predictive processing circuitry. (2) Neurons with broadly tuned receptive fields form the main, "spectral" PE signaling system, which provides dynamic gain compensation to near-threshold unexpected sounds. This early enhancement of saliency reliant on spectral features was not observed in the auditory thalamus or cortex. (3) Untuned neurons form an accessory, "nonspectral" PE signaling system, which reports all surprising auditory deviances in a robust and consistent manner, resembling nonlemniscal neurons in the auditory cortex. These nonlemniscal IC neurons show unstructured and unstable receptive fields that could result from inhibitory input controlled by corticofugal projections conveying top-down predictions.

Systematic review and meta-analysis of the visual mismatch negativity in schizophrenia

Mismatch negativity (MMN) is an event-related potential component automatically elicited by events that violate predictions based on prior events. To elicit this component, researchers use stimulus repetition to induce predictions, and the MMN is obtained by subtracting the brain response to rare or unpredicted stimuli from that of frequent stimuli. Under the Predictive Processing framework, one increasingly popular interpretation of the mismatch response postulates that MMN represents a prediction error. In this context, the reduced MMN amplitude to auditory stimuli has been considered a potential biomarker of Schizophrenia, representing a reduced prediction error and the inability to update the mental model of the world based on the sensory signals. It is unclear, however, whether this amplitude reduction is specific for auditory events or if the visual MMN reveals a similar pattern in schizophrenia spectrum disorder. This review and meta-analysis aimed to summarise the available literature on the vMMN in schizophrenia. A systematic literature search resulted in 10 eligible studies that resulted in a combined effect size of g = -.63, CI [-.86, -.41], reflecting lower vMMN amplitudes in patients. These results are in line with the findings in the auditory domain. This component offers certain advantages, such as less susceptibility to overlap with components generated by attentional demands. Future studies should use vMMN to explore abnormalities in the Predictive Processing framework in different stages and groups of the SSD and increase the knowledge in the search for biomarkers in schizophrenia.

The 3,4-methylenedioxymethamphetamine enhances early visual processing for salient socio-emotional stimuli

The 3,4-methylenedioxymethamphetamine (MDMA) has long been used non-medically, and it is currently under investigation for its potential therapeutic benefits. Both uses may be related to its ability to enhance empathy, sociability, emotional processing and its anxiolytic effects. However, the neural mechanisms underlying these effects, and their specificity to MDMA compared to other stimulants, are not yet fully understood. Here, using electroencephalography (EEG), we investigated the effects of MDMA and a prototypic stimulant, methamphetamine (MA), on early visual processing of socio-emotional stimuli in an oddball emotional faces paradigm. Specifically, we examined whether MDMA or MA enhance the processing of facial expressions, compared to placebo, during the early stages of visual perception. MDMA enhanced an event-related component that is sensitive to detecting faces (N170), specifically for happy and angry expressions compared to neutral faces. MA did not affect this measure, and neither drug altered other components of the response to emotional faces. These findings provide novel insights into the neural mechanisms underlying the effects of MDMA on socio-emotional processing and may have implications for the therapeutic use of MDMA in the treatment of social anxiety and other psychiatric disorders.

Pain perception as hierarchical Bayesian inference: A test case for the theory of constructed emotion

An intriguing perspective about human emotion, the theory of constructed emotion considers emotions as generative models according to the Bayesian brain hypothesis. This theory brings fresh insight to existing findings, but its complexity renders it challenging to test experimentally. We argue that laboratory studies of pain could support the theory because although some may not consider pain to be a genuine emotion, the theory must at minimum be able to explain pain perception and its dysfunction in pathology. We review emerging evidence that bear on this question. We cover behavioral and neural laboratory findings, computational models, placebo hyperalgesia, and chronic pain. We conclude that there is substantial evidence for a predictive processing account of painful experience, paving the way for a better understanding of neuronal and computational mechanisms of other emotions.

Investigating sensitivity to multi-domain prediction errors in chronic auditory phantom perception

The perception of a continuous phantom in a sensory domain in the absence of an external stimulus is explained as a maladaptive compensation of aberrant predictive coding, a proposed unified theory of brain functioning. If this were true, these changes would occur not only in the domain of the phantom percept but in other sensory domains as well. We confirm this hypothesis by using tinnitus (continuous phantom sound) as a model and probe the predictive coding mechanism using the established local-global oddball paradigm in both the auditory and visual domains. We observe that tinnitus patients are sensitive to changes in predictive coding not only in the auditory but also in the visual domain. We report changes in well-established components of event-related EEG such as the mismatch negativity. Furthermore, deviations in stimulus characteristics were correlated with the subjective tinnitus distress. These results provide an empirical confirmation that aberrant perceptions are a symptom of a higher-order systemic disorder transcending the domain of the percept.

Unsupervised Characterization of Prediction Error Markers in Unisensory and Multisensory Streams Reveal the Spatiotemporal Hierarchy of Cortical Information Processing

Elicited upon violation of regularity in stimulus presentation, mismatch negativity (MMN) reflects the brain's ability to perform automatic comparisons between consecutive stimuli and provides an electrophysiological index of sensory error detection whereas P300 is associated with cognitive processes such as updating of the working memory. To date, there has been extensive research on the roles of MMN and P300 individually, because of their potential to be used as clinical markers of consciousness and attention, respectively. Here, we intend to explore with an unsupervised and rigorous source estimation approach, the underlying cortical generators of MMN and P300, in the context of prediction error propagation along the hierarchies of brain information processing in healthy human participants. The existing methods of characterizing the two ERPs involve only approximate estimations of their amplitudes and latencies based on specific sensors of interest. Our objective is twofold: first, we introduce a novel data-driven unsupervised approach to compute latencies and amplitude of ERP components accurately on an individual-subject basis and reconfirm earlier findings. Second, we demonstrate that in multisensory environments, MMN generators seem to reflect a significant overlap of "modality-specific" and "modality-independent" information processing while P300 generators mark a shift toward completely "modality-independent" processing. Advancing earlier understanding that multisensory contexts speed up early sensory processing, our study reveals that temporal facilitation extends to even the later components of prediction error processing, using EEG experiments. Such knowledge can be of value to clinical research for characterizing the key developmental stages of lifespan aging, schizophrenia, and depression.

Visual omitted stimulus potentials are not retinotopic

Omitted stimulus potentials (OSPs) are elicited in response to the omission of expected stimuli and are thought to reflect prediction errors. If prediction errors are signaled in the sensory cortex, OSPs are expected to be generated in the sensory cortex. The present study investigated the involvement of the early visual cortex in the generation of OSPs by testing whether omitted visual stimuli elicit brain responses in a spatially specific manner. Checkerboard pattern stimuli were presented alternately in the upper and lower visual fields, and the stimuli were omitted in 10 % of the trials. Event-related potentials were recorded from 33 participants. While a retinotopic C1 component was evoked by real visual stimuli, omitted stimuli did not produce any response reflecting retinotopy but did elicit a visual mismatch negativity, which was larger for omitted stimuli expected in the lower visual field than for those in the upper visual field. These results suggest that omitted visual stimuli are processed in a different pathway than actual stimuli.

Parafoveal and foveal N400 effects in natural reading: A timeline of semantic processing from fixation-related potentials

The depth at which parafoveal words are processed during reading is an ongoing topic of debate. Recent studies using RSVP-with-flanker paradigms have shown that implausible words within sentences elicit an N400 component while they are still in parafoveal vision, suggesting that the semantics of parafoveal words can be accessed to rapidly update the sentence representation. To study this effect in natural reading, we combined the coregistration of eye movements and EEG with the deconvolution modeling of fixation-related potentials (FRPs) to test whether semantic plausibility is processed parafoveally during Chinese sentence reading. For one target word per sentence, both its parafoveal and foveal plausibility were orthogonally manipulated using the boundary paradigm. Consistent with previous eye movement studies, we observed a delayed effect of parafoveal plausibility on fixation durations that only emerged on the foveal word. Crucially, in FRPs aligned to the pretarget fixation, a clear N400 effect emerged already based on parafoveal plausibility, with more negative voltages for implausible previews. Once participants fixated the target, we again observed an N400 effect of foveal plausibility. Interestingly, this foveal N400 was absent whenever the preview had been implausible, indicating that when a word's (im)plausibility is already processed in parafoveal vision, this information is not revised anymore upon direct fixation. Implausible words also elicited a late positive component (LPC), but exclusively when in foveal vision. Our results not only provide convergent neural and behavioral evidence for the parafoveal uptake of semantic information, but also indicate different contributions of parafoveal versus foveal information toward higher level sentence processing.

Prior probability cues bias sensory encoding with increasing task exposure

When observers have prior knowledge about the likely outcome of their perceptual decisions, they exhibit robust behavioural biases in reaction time and choice accuracy. Computational modelling typically attributes these effects to strategic adjustments in the criterion amount of evidence required to commit to a choice alternative - usually implemented by a starting point shift - but recent work suggests that expectations may also fundamentally bias the encoding of the sensory evidence itself. Here, we recorded neural activity with EEG while participants performed a contrast discrimination task with valid, invalid, or neutral probabilistic cues across multiple testing sessions. We measured sensory evidence encoding via contrast-dependent steady-state visual-evoked potentials (SSVEP), while a read-out of criterion adjustments was provided by effector-selective mu-beta band activity over motor cortex. In keeping with prior modelling and neural recording studies, cues evoked substantial biases in motor preparation consistent with criterion adjustments, but we additionally found that the cues produced a significant modulation of the SSVEP during evidence presentation. While motor preparation adjustments were observed in the earliest trials, the sensory-level effects only emerged with extended task exposure. Our results suggest that, in addition to strategic adjustments to the decision process, probabilistic information can also induce subtle biases in the encoding of the evidence itself.

Orientation and contrast deviance examined: Contrast effects mimic deviant-related negativity yet neither produce the canonical neural correlate of prediction error

The visual mismatch negativity (vMMN) is a negative-going event-related potential (ERP) component that is largest somewhere between 100 and 300 ms after the onset of an unpredictable visual event (i.e., a deviant) in an otherwise predictable sequence of visual events (i.e., standards). Many have argued that the vMMN allows us to monitor our ever-changing visual environment for deviants critical to our survival. Recently, however, it has become unclear whether unpredicted changes in low-level features of visual input, like orientation, can evoke the vMMN. I address this by testing isolated orientation changes, to confirm recent findings, and isolated contrast changes, to determine whether other low-level features of visual input do not evoke the vMMN in a traditional oddball paradigm. Eighteen participants saw sequences of rare, unanticipated, and different deviant stimuli, interspersed among frequent, anticipated, and identical standard stimuli. Stimuli were Gabor patches. Neither deviant produced a vMMN. Therefore, changes in low-level visual properties of well-controlled stimuli-a stimulus in which one property can be manipulated while all others remain unaffected-like Gabor patches do not yield a vMMN.

Facial feedback manipulation influences the automatic detection of unexpected emotional body expressions

Unexpected or changing facial expressions are known to be able to engage more automatic processing than frequently occurring facial expressions, thereby inducing a neural differential wave response known as expression mismatch negativity (EMMN). Recent studies have shown that EMMN can be modulated by the observer's facial feedback (i.e., feedback from their own facial movements). A similar EMMN activity has been discovered for body expressions, but thus far only a few emotion types have been investigated. It is unknown whether the EMMNs evoked by body expressions can be influenced by facial feedback. To explore this question, we recorded EEG activity of 29 participants in the reverse oddball paradigm. Here two unexamined categories of body expressions were presented, happy and sad, placed in two paired stimulus sequences: in one the happy body was presented with a probability of 80% (standards) while the sad body was presented with a probability of 20% (deviants), and in the other the probabilities were reversed. The facial feedback was manipulated by different pen holding conditions (i.e., participants holding the pen with the teeth, lips, or nondominant hand). The nonparametric cluster permutation test revealed significant happy and sad body-related EMMN (bEMMN) activities. The happy-bEMMN were more negative than sad-bEMMN within the range of 100-150 ms. Additionally, the bEMMN amplitude of both emotions is modulated by the facial feedback conditions. These results expand the range of emotional types applicable to bEMMN and provide evidence for the validity of the facial feedback hypothesis across emotional carriers.

The effects of positions on deviant processing in mostly incompatible blocks in the flanker task

It is assumed that focused attention is induced by mostly incompatible (MI) blocks in the flanker task. This study aimed to examine the differences in deviant processing between positions of a stimulus in MI blocks. Thirty-nine adults participated in this study. Compatible and incompatible stimuli were classified into three types: typical (central and surrounding colors: black), central-deviant (central: red; surrounding: black), and surrounding-deviant (central: black; surrounding: red). Rare and equiprobable conditions were set for MI blocks. Central- and surrounding-deviant stimuli were presented with low probabilities in the rare condition and with identical probabilities to that of typical stimuli in the equiprobable condition. Deviant processing was evaluated by comparing between event-related potentials in rare and equiprobable conditions. The posterior negativity from 120 to 170 ms (i.e., N1) for central-deviant stimuli was significantly more negative in the rare condition than in the equiprobable condition, whereas there was no difference for surrounding-deviant stimuli. Conversely, the posterior negativity from 180 to 230 ms for both stimuli was significantly more negative in the rare condition than in the equiprobable condition, and the difference (i.e., visual mismatch negativity) was similar in central- and surrounding-deviant stimuli. These findings suggest that focused attention induced by MI blocks leads to differences in deviant processing between central and surrounding areas during the N1 time range. Therefore, evaluations of deviant processing can help examine processing in central and surrounding areas independently and are valuable for understanding cognitive control mechanisms in the flanker tasks.

Automatic Change Detection in Interwoven Sequences: A Visual Mismatch Negativity Study

In this study, we investigated whether the cognitive system, known to be able to register regular visual event sequences and the violation of these sequences automatically, had the capacity of processing two sequences simultaneously. To this end, we measured the visual mismatch negativity (vMMN) component of ERPs as interwoven event sequences simultaneously presented to the left and right side of the screen. One of the sequences consisted of geometric patterns (diamonds); the other, photographs of human faces. In successive cycles, parts of the stimuli vanished and then re-appeared (the OFF/ON method). The vanishing parts served as either standard (frequently vanishing parts) or infrequent (deviant) events, but these events were task-irrelevant. The 20 adult participants (age 21.40 ± 2.72 years) performed a visual tracking task, with the OFF/ON task being a passive oddball paradigm. According to the results, both OFF and ON events, and both diamond and face stimuli elicited the vMMN component, showing that the system underlying this activity is capable of processing two event sequences if the sequences consist of fairly different kind of objects as stimuli. The sLORETA analysis showed that the source of vMMN was more frequent contralaterally to the deviant event, and the sources comprised loci from ventral and dorsal structures, as well as some anterior loci.

Shared attention in virtual immersive reality enhances electrophysiological correlates of implicit sensory learning

Shared attention effects on learning and memory demonstrate that experiences are amplified when we are not alone. Virtual reality poses new challenges to the study of co-presence. Above all, is coattending together with someone else's avatar in an immersive VR setting comparable with shared experiences at a neural processing level? In the present study we investigate shared attention effects in VR for the first time. We recorded mismatch negativities (MMN) during an auditory roving paradigm, a well-known index of implicit perceptual learning. EEG responses to deviant and standard sounds were registered while subjects were alone (Solo condition) or together (Other condition) with a virtual avatar (Virtual scenario) or physically present confederate (Physical scenario). We found an overall main effect of co-presence on MMN revealed by a point-by-point 2 × 2 ANOVA, thereby replicating previous studies on physical co-presence. Additionally, we found no significant interaction between the scenario (Physical vs. Virtual) and co-presence (Solo vs. Other). Our results indicate that virtual immersive co-presence mimics physical co-presence.

Contingency learning on the proportional congruency effect of the Stroop task is manifest in deviant processing

OBJECTIVE

The proportion congruency effect has been reported in interference tasks. The mostly congruent block is the frequent condition, and the mostly incongruent block is the rare condition for congruent stimuli, whereas the mostly congruent block is the rare condition, and the mostly incongruent block is the frequent condition for incongruent stimuli. This study examined the cognitive mechanism underlying the proportion congruency effect in the two-choice Stroop task using event-related potential components related to deviant processing.

METHOD

Stimuli were Kanji characters meaning 'red' and 'blue' painted by congruent and incongruent colors. Participants were required to provide a two-choice button-press response corresponding to the colors. The congruent and incongruent stimuli were presented on rare (20%) and frequent (80%) conditions.

RESULTS

N1 was enhanced in the rare condition relative to the frequent condition for both congruent and incongruent stimuli. The results suggested that colors and characters were not processed independently in the N1 time range, which made selective attention to the relevant feature difficult. Posterior negativity from 200 to 250 ms was also different between rare and frequent conditions, indicating the presence of visual mismatch negativity for congruent and incongruent stimuli. It was considered that the distinction between congruent and incongruent stimuli was evident in mostly incongruent blocks, indicating that the selective attention mechanism was not actively engaged.

CONCLUSION

The proportion congruency effect was explained by contingency learning rather than selective attention in the present task. The cognitive mechanisms underlying the proportion congruency effect are reflected by deviant event-related potential components.

Metaphors or mechanism? Predictive coding and a (brief) history of empirical study of the arts

Predictive processing (PP) offers an intriguing approach to perception, cognition, but also to appreciation of the arts. It does this by positing both a theoretical basis-one might say a 'metaphor'-for how we engage and respond, placing emphasis on mismatches rather than fluent overlap between schema and environment. Even more, it holds the promise for translating metaphor into neurobiological bases, suggesting a means for considering mechanisms-from basic perceptions to possibly even our complex, aesthetic experiences. However, while we share the excitement of this promise, the history of empirical or psychological aesthetics is also permeated by metaphors that have progressed our understanding but which also tend to elude translation into concrete, mechanistic operationalization-a challenge that can also be made to PP. We briefly consider this difficulty of convincing implementation of PP via a brief historical outline of some developments in the psychological study of aesthetics and art in order to show how these ideas have often anticipated PP but also how they have remained at the level of rather metaphorical and difficult-to-measure concepts. Although theoretical in scope, we hope that this commentary will spur researchers to reflect on PP with the aim of translating metaphorical explanations into well-defined mechanisms in future empirical study. This article is part of the theme issue 'Art, aesthetics and predictive processing: theoretical and empirical perspectives'.

Sex modulation of faces prediction error in the autistic brain

Recent research suggests that autistic females may have superior socio-cognitive abilities compared to autistic males, potentially contributing to underdiagnosis in females. However, it remains unclear whether these differences arise from distinct neurophysiological functioning in autistic males and females. This study addresses this question by presenting 41 autistic and 48 non-autistic adults with a spatially filtered faces oddball paradigm. Analysis of event-related potentials from scalp electroencephalography reveal a neurophysiological profile in autistic females that fell between those of autistic males and non-autistic females, highlighting sex differences in autism from the initial stages of face processing. This finding underscores the urgent need to explore neurophysiological sex differences in autism and encourages efforts toward a better comprehension of compensation mechanism and a clearer definition of what is meant by camouflaging.

A comparison of visual and acoustic mismatch negativity as potential biomarkers in schizophrenia

Mismatch negativity (MMN) is an event-related potential (ERP) component generated when an unexpected deviant stimulus occurs in a pattern of standard stimuli. Several studies showed that the MMN response to both auditory and visual stimuli is attenuated in schizophrenia. While previous studies investigated auditory and visual MMN in different cohorts, here we examined the potential clinical utility of MMN responses to auditory and visual stimuli within the same group of patients. Altogether 39 patients with schizophrenia and 39 healthy controls matched in age, gender, and education were enrolled. We recorded EEG using 64 channels in eight experimental blocks where we presented auditory and visual stimulus sequences. Mismatch responses were obtained by subtracting responses to standard from the physically identical deviant stimuli. We found a significant MMN response to the acoustic stimuli in the control group, whereas no significant mismatch response was observed in the patient group. The group difference was significant for the acoustic stimuli. The 12 vane windmill pattern evoked a significant MMN response in the early time window in the control group but not in the patient group. The 6 vane windmill pattern evoked MMN only in the patient group. However, we found no significant difference between the groups. Furthermore, we found no correlation between the clinical variables and the MMN amplitudes. Our results suggest that predictive processes underlying mismatch generation in patients with schizophrenia may be more affected in the acoustic compared to the visual domain. Acoustic MMN tends to be a more promising biomarker in schizophrenia.

Seeking the neural representation of statistical properties in print during implicit processing of visual words

Statistical learning (SL) plays a key role in literacy acquisition. Studies have increasingly revealed the influence of distributional statistical properties of words on visual word processing, including the effects of word frequency (lexical level) and mappings between orthography, phonology, and semantics (sub-lexical level). However, there has been scant evidence to directly confirm that the statistical properties contained in print can be directly characterized by neural activities. Using time-resolved representational similarity analysis (RSA), the present study examined neural representations of different types of statistical properties in visual word processing. From the perspective of predictive coding, an equal probability sequence with low built-in prediction precision and three oddball sequences with high built-in prediction precision were designed with consistent and three types of inconsistent (orthographically inconsistent, orthography-to-phonology inconsistent, and orthography-to-semantics inconsistent) Chinese characters as visual stimuli. In the three oddball sequences, consistent characters were set as the standard stimuli (probability of occurrence p = 0.75) and three types of inconsistent characters were set as deviant stimuli (p = 0.25), respectively. In the equal probability sequence, the same consistent and inconsistent characters were presented randomly with identical occurrence probability (p = 0.25). Significant neural representation activities of word frequency were observed in the equal probability sequence. By contrast, neural representations of sub-lexical statistics only emerged in oddball sequences where short-term predictions were shaped. These findings reveal that the statistical properties learned from long-term print environment continues to play a role in current word processing mechanisms and these mechanisms can be modulated by short-term predictions.

A multimodal cortical network of sensory expectation violation revealed by fMRI

The brain is subjected to multi-modal sensory information in an environment governed by statistical dependencies. Mismatch responses (MMRs), classically recorded with EEG, have provided valuable insights into the brain's processing of regularities and the generation of corresponding sensory predictions. Only few studies allow for comparisons of MMRs across multiple modalities in a simultaneous sensory stream and their corresponding cross-modal context sensitivity remains unknown. Here, we used a tri-modal version of the roving stimulus paradigm in fMRI to elicit MMRs in the auditory, somatosensory and visual modality. Participants (N = 29) were simultaneously presented with sequences of low and high intensity stimuli in each of the three senses while actively observing the tri-modal input stream and occasionally reporting the intensity of the previous stimulus in a prompted modality. The sequences were based on a probabilistic model, defining transition probabilities such that, for each modality, stimuli were more likely to repeat (p = .825) than change (p = .175) and stimulus intensities were equiprobable (p = .5). Moreover, each transition was conditional on the configuration of the other two modalities comprising global (cross-modal) predictive properties of the sequences. We identified a shared mismatch network of modality general inferior frontal and temporo-parietal areas as well as sensory areas, where the connectivity (psychophysiological interaction) between these regions was modulated during mismatch processing. Further, we found deviant responses within the network to be modulated by local stimulus repetition, which suggests highly comparable processing of expectation violation across modalities. Moreover, hierarchically higher regions of the mismatch network in the temporo-parietal area around the intraparietal sulcus were identified to signal cross-modal expectation violation. With the consistency of MMRs across audition, somatosensation and vision, our study provides insights into a shared cortical network of uni- and multi-modal expectation violation in response to sequence regularities.

ERP evidence of attentional somatosensory processing and stimulus-response coupling under different hand and arm postures

We investigated (1) the effects of divided and focused attention on event-related brain potentials (ERPs) elicited by somatosensory stimulation under different response modes, (2) the effects of hand position (closely-placed vs. separated hands) and arm posture (crossed vs. uncrossed forearms) on the attentional modulation of somatosensory ERPs, and (3) changes in the coupling of stimulus- and response-related processes by somatosensory attention using a single-trial analysis of P300 latency and reaction times. Electrocutaneous stimulation was presented randomly to the thumb or middle finger of the left or right hand at random interstimulus intervals (700-900 ms). Subjects attended unilaterally or bilaterally to stimuli in order to detect target stimuli by a motor response or counting. The effects of unilaterally-focused attention were also tested under different hand and arm positions. The amplitude of N140 in the divided attention condition was intermediate between unilaterally attended and unattended stimuli in the unilaterally-focused attention condition in both the mental counting and motor response tasks. Attended infrequent (target) stimuli elicited greater P300 in the unilaterally attention condition than in the divided attention condition. P300 latency was longer in the divided attention condition than in the unilaterally-focused attention condition in the motor response task, but remained unchanged in the counting task. Closely locating the hands had no impact, whereas crossing the forearms decreased the attentional enhancement in N140 amplitude. In contrast, these two manipulations uniformly decreased P300 amplitude and increased P300 latency. The correlation between single-trial P300 latency and RT was decreased by crossed forearms, but not by divided attention or closely-placed hands. Therefore, the present results indicate that focused and divided attention differently affected middle latency and late processing, and that hand position and arm posture also differently affected attentional processes and stimulus-response coupling.

Automatic sensory change processing in adults with attention deficit and hyperactivity disorder: a visual mismatch negativity study

In addition to higher-order executive functions, underlying sensory processing ability is also thought to play an important role in Attention-Deficit/Hyperactivity Disorder (AD/HD). An event-related potential feature, the mismatch negativity, reflects the ability of automatic sensory change processing and may be correlated with AD/HD symptoms and executive functions. This study aims to investigate the characteristics of visual mismatch negativity (vMMN) in adults with AD/HD. Twenty eight adults with AD/HD and 31 healthy controls were included in this study. These two groups were matched in age, IQ and sex. In addition, both groups completed psychiatric evaluations, a visual ERP task used to elicit vMMN, and psychological measures about AD/HD symptoms and day-to-day executive functions. Compared to trols, the late vMMN (230-330 ms) was significantly reduced in the AD/HD group. Correlation analyses showed that late vMMN was correlated with executive functions but not AD/HD symptoms. However, further mediation analyses showed that different executive functions had mediated the relationships between late vMMN and AD/HD symptoms. Our findings indicate that the late vMMN, reflecting automatic sensory change processing ability, was impaired in adults with AD/HD. This impairment could have negative impact on AD/HD symptoms via affecting day-to-day executive functions.

Top-down input modulates visual context processing through an interneuron-specific circuit

Visual stimuli that deviate from the current context elicit augmented responses in the primary visual cortex (V1). These heightened responses, known as "deviance detection," require local inhibition in the V1 and top-down input from the anterior cingulate area (ACa). Here, we investigated the mechanisms by which the ACa and V1 interact to support deviance detection. Local field potential recordings in mice during an oddball paradigm showed that ACa-V1 synchrony peaks in the theta/alpha band (≈10 Hz). Two-photon imaging in the V1 revealed that mainly pyramidal neurons exhibited deviance detection, while contextually redundant stimuli increased vasoactive intestinal peptide (VIP)-positive interneuron (VIP) activity and decreased somatostatin-positive interneuron (SST) activity. Optogenetic drive of ACa-V1 inputs at 10 Hz activated V1-VIPs but inhibited V1-SSTs, mirroring the dynamics present during the oddball paradigm. Chemogenetic inhibition of V1-VIPs disrupted Aca-V1 synchrony and deviance detection in the V1. These results outline temporal and interneuron-specific mechanisms of top-down modulation that support visual context processing.

Crossmodal visual predictions elicit spatially specific early visual cortex activity but later than real visual stimuli

Previous studies have indicated that crossmodal visual predictions are instrumental in controlling early visual cortex activity. The exact time course and spatial precision of such crossmodal top-down influences on the visual cortex have been unknown. In the present study, participants were exposed to audiovisual combinations comprising one of two sounds and a Gabor patch either in the top left or in the bottom right visual field. Event-related potentials (ERPs) were recorded to these frequent crossmodal combinations (standards) as well as to trials in which the visual stimulus was omitted (omissions) or the visual and auditory stimuli were recombined (deviants). Standards and deviants elicited an ERP between 50 and 100 ms of opposite polarity known as the C1 effect commonly associated with retinotopic processing in early visual cortex. By contrast, a C1 effect was not observed in omission trials. Spatially specific omission and mismatch effects (deviants minus standards) started only later with a latency of 230 ms and 170 ms, respectively. These results suggest that crossmodal visual predictions control visual cortex activity in a spatially specific manner. However, visual predictions do not modulate visual cortex activity with the same timing as visual stimulation activates these areas but rather seem to involve distinct neural mechanisms. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Markov chains as a proxy for the predictive memory representations underlying mismatch negativity

Events not conforming to a regularity inherent to a sequence of events elicit prediction error signals of the brain such as the Mismatch Negativity (MMN) and impair behavioral task performance. Events conforming to a regularity lead to attenuation of brain activity such as stimulus-specific adaptation (SSA) and behavioral benefits. Such findings are usually explained by theories stating that the information processing system predicts the forthcoming event of the sequence via detected sequential regularities. A mathematical model that is widely used to describe, to analyze and to generate event sequences are Markov chains: They contain a set of possible events and a set of probabilities for transitions between these events (transition matrix) that allow to predict the next event on the basis of the current event and the transition probabilities. The accuracy of such a prediction depends on the distribution of the transition probabilities. We argue that Markov chains also have useful applications when studying cognitive brain functions. The transition matrix can be regarded as a proxy for generative memory representations that the brain uses to predict the next event. We assume that detected regularities in a sequence of events correspond to (a subset of) the entries in the transition matrix. We apply this idea to the Mismatch Negativity (MMN) research and examine three types of MMN paradigms: classical oddball paradigms emphasizing sound probabilities, between-sound regularity paradigms manipulating transition probabilities between adjacent sounds, and action-sound coupling paradigms in which sounds are associated with actions and their intended effects. We show that the Markovian view on MMN yields theoretically relevant insights into the brain processes underlying MMN and stimulates experimental designs to study the brain's processing of event sequences.

Mismatch negativity as a marker of auditory pattern separation

To what extent does incidental encoding of auditory stimuli influence subsequent episodic memory for the same stimuli? We examined whether the mismatch negativity (MMN), an event-related potential generated by auditory change detection, is correlated with participants' ability to discriminate those stimuli (i.e. targets) from highly similar lures and from dissimilar foils. We measured the MMN in 30 young adults (18-32 years, 18 females) using a passive auditory oddball task with standard and deviant 5-tone sequences differing in pitch contour. After exposure, all participants completed an incidental memory test for old targets, lures, and foils. As expected, participants at test exhibited high sensitivity in recognizing target items relative to foils and lower sensitivity in recognizing target items relative to lures. Notably, we found a significant correlation between MMN amplitude and lure discrimination, but not foil discrimination. Our investigation shows that our capacity to discriminate sensory inputs at encoding, as measured by the MMN, translates into precision in memory for those inputs.

Exploiting Information in Event-Related Brain Potentials from Average Temporal Waveform, Time-Frequency Representation, and Phase Dynamics

Characterizing the brain's dynamic pattern of response to an input in electroencephalography (EEG) is not a trivial task due to the entanglement of the complex spontaneous brain activity. In this context, the brain's response can be defined as (1) the additional neural activity components generated after the input or (2) the changes in the ongoing spontaneous activities induced by the input. Moreover, the response can be manifested in multiple features. Three commonly studied examples of features are (1) transient temporal waveform, (2) time-frequency representation, and (3) phase dynamics. The most extensively used method of average event-related potentials (ERPs) captures the first one, while the latter two and other more complex features are attracting increasing attention. However, there has not been much work providing a systematic illustration and guidance for how to effectively exploit multifaceted features in neural cognitive research. Based on a visual oddball ERPs dataset with 200 participants, this work demonstrates how the information from the above-mentioned features are complementary to each other and how they can be integrated based on stereotypical neural-network-based machine learning approaches to better exploit neural dynamic information in basic and applied cognitive research.

Effect of visuo-proprioceptive mismatch rate on recalibration in hand perception

We estimate our hand's position by combining relevant visual and proprioceptive cues. A cross-sensory spatial mismatch can be created by viewing the hand through a prism or, more recently, rotating a visual cursor that represents hand position. This is often done in the context of target-directed reaching to study motor adaptation, the systematic updating of motor commands in response to a systematic movement error. However, a visuo-proprioceptive mismatch also elicits recalibration in the relationship between the hand's seen and felt position. The principles governing visuo-proprioceptive recalibration are poorly understood, compared to motor adaptation. For example, motor adaptation occurs robustly whether the cursor is rotated quickly or slowly, although the former may involve more explicit processes. Here, we asked whether visuo-proprioceptive recalibration, in the absence of motor adaptation, works the same way. Three groups experienced a 70 mm visuo-proprioceptive mismatch about their hand at a Slow, Medium, or Fast rate (0.84, 1.67, or 3.34 mm every two trials, respectively), with no error feedback. Once attained, the 70 mm mismatch was maintained for the remaining trials. Total recalibration differed significantly across groups, with the Fast, Medium, and Slow groups recalibrating 63.7, 56.3, and 42.8 mm on average, respectively. This suggests a slower mismatch rate may be less effective at eliciting recalibration. In contrast to motor adaptation studies, no further recalibration was observed in the maintenance phase. This may be related to the distinct mechanisms thought to contribute to perceptual recalibration via cross-sensory cue conflict versus sensory prediction errors.

The role of attention control in visual mismatch negativity (vMMN) studies

The detection of unattended visual changes is investigated by the visual mismatch negativity (vMMN) component of event-related potentials (ERPs). The vMMN is measured as the difference between the ERPs to infrequent (deviant) and frequent (standard) stimuli irrelevant to the ongoing task. In the present study, we used human faces expressing different emotions as deviants and standards. In such studies, participants perform various tasks, so their attention is diverted from the vMMN-related stimuli. If such tasks vary in their attentional demand, they might influence the outcome of vMMN studies. In this study, we compared four kinds of frequently used tasks: (1) a tracking task that demanded continuous performance, (2) a detection task where the target stimuli appeared at any time, (3) a detection task where target stimuli appeared only in the inter-stimulus intervals, and (4) a task where target stimuli were members of the stimulus sequence. This fourth task elicited robust vMMN, while in the other three tasks, deviant stimuli elicited moderate posterior negativity (vMMN). We concluded that the ongoing task had a marked influence on vMMN; thus, it is important to consider this effect in vMMN studies.

Impact of emotional valence on mismatch negativity in the course of cortical face processing

Various aspects of cortical face processing have been studied by assessing event related potentials (ERP). It has been described in the literature that mismatch negativity (MMN), a well-studied ERP, is not only modulated by sensory features but also emotional valence. However, the exact impact of emotion on the temporo-spatial profile of visual MMN during face processing remains inconsistent. By employing a sequential oddball paradigm using both neutral and emotional deviants, we were able to differentiate two distinct vMMN subcomponents. While an early subcomponent at 150-250 ms is elicited by emotional salient facial stimuli, the later subcomponent at 250-400 ms seems to reflect the detection of regularity violations in facial recognition per se, unaffected by emotional salience. Our results suggest that emotional valence is encoded in vMMN signal strength at an early stage of facial processing. Furthermore, we assume that of facial processing consists of temporo-spatially distinct, partially overlapping levels concerning different facial aspects.

Intelligence and Visual Mismatch Negativity: Is Pre-Attentive Visual Discrimination Related to General Cognitive Ability?

EEG has been used for decades to identify neurocognitive processes related to intelligence. Evidence is accumulating for associations with neural markers of higher-order cognitive processes (e.g., working memory); however, whether associations are specific to complex processes or also relate to earlier processing stages remains unclear. Addressing these issues has implications for improving our understanding of intelligence and its neural correlates. The MMN is an ERP that is elicited when, within a series of frequent standard stimuli, rare deviant stimuli are presented. As stimuli are typically presented outside the focus of attention, the MMN is suggested to capture automatic pre-attentive discrimination processes. However, the MMN and its relation to intelligence has largely only been studied in the auditory domain, thus preventing conclusions about the involvement of automatic discrimination processes in humans' dominant sensory modality-vision. EEG was recorded from 50 healthy participants during a passive visual oddball task that presented simple sequence violations and deviations within a more complex hidden pattern. Signed area amplitudes and fractional area latencies of the visual MMN were calculated with and without Laplacian transformation. Correlations between visual MMN and intelligence (Raven's Advanced Progressive Matrices) were of negligible to small effect sizes, differed critically between measurement approaches, and Bayes Factors provided anecdotal to substantial evidence for the absence of an association. We discuss differences between the auditory and visual MMN, the implications of different measurement approaches, and offer recommendations for further research in this evolving field.

Face familiarity revealed by fixational eye movements and fixation-related potentials in free viewing

Event-related potentials (ERPs) and the oculomotor inhibition (OMI) in response to visual transients are known to be sensitive to stimulus properties, attention, and expectation. We have recently found that the OMI is also sensitive to face familiarity. In natural vision, stimulation of the visual cortex is generated primarily by saccades, and it has been recently suggested that fixation-related potentials (FRPs) share similar components with the ERPs. Here, we investigated whether FRPs and microsaccade inhibition (OMI) in free viewing are sensitive to face familiarity. Observers freely watched a slideshow of seven unfamiliar and one familiar facial images presented randomly for 4-s periods, with multiple images per identity. We measured the occipital fixation-related N1 relative to the P1 magnitude as well as the associated fixation-triggered OMI. We found that the average N1-P1 was significantly smaller and the OMI was shorter for the familiar face, compared with any of the seven unfamiliar faces. Moreover, the P1 was suppressed across saccades for the familiar but not for the unfamiliar faces. Our results highlight the sensitivity of the occipital FRPs to stimulus properties such as face familiarity and advance our understanding of the integration process across successive saccades in natural vision.

Beyond Infant's Looking: The Neural Basis for Infant Prediction Errors

Contemporary conceptualizations on infant cognitive development focus on predictive processes; the basic idea is that the brain continuously creates predictions about what is expected and that the divergence between predicted and actual perceived data yields a prediction error. This prediction error updates the model from which the predictions are generated and therefore is a basic mechanism for learning and adaptation to the dynamics of the ever-changing environment. In this article, we review the types of available empirical evidence supporting the idea that predictive processes can be found in infancy, especially emphasizing the contribution of electrophysiology as a potential method for testing the similarity of the brain mechanisms for processing prediction errors in infants to those of adults. In infants, as with older children, adolescents, and adults, predictions involve synchronization bursts of middle-central theta reflecting brain activity in the anterior cingulate cortex. We discuss how early in development such brain mechanisms develop and open questions that still remain to be empirically investigated.

The neuroelectrophysiological and behavioral effects of transcranial direct current stimulation on executive vigilance under a continuous monotonous condition

A prolonged period of vigilance task will lead to vigilance decrement and a drop in cognitive efficiency. Although transcranial direct current stimulation (tDCS) can be used to improve cognitive performance following vigilance decrement, the findings in this area of study are inconsistent. This study aims to identify the neuroelectrophysiological and behavioral effects of tDCS over the left dorsolateral prefrontal cortex (DLPFC) on executive vigilance under a continuous monotonous condition. We recruited 29 participants who randomly received 30 min active or sham tDCS before the vigilance task (anode electrode at the left DLPFC, cathode electrode at the right supraorbital area). Participants completed four sessions of vigilance task and five sessions of self-report sleepiness, Oddball task, and Go/Nogo task, for a total of about 5 h. EEG was acquired in real-time throughout the experiment. Repeated measures of ANOVA were utilized to analyze the evolution of each metric with task-on-time. The results demonstrated that subjective arousal state, vigilance performance, event-related potentials (ERPs), and EEG power were significantly affected by time on task. Brain stimulation did not significantly affect the evolution of subjective and objective executive vigilance performance, but significantly modulated spontaneous activity in the alpha and beta bands across the entire brain. The continuous enhancement of the prefrontal cortex increased P2 amplitude for the Oddball task, which was associated with the enhancement of the early stage of information processing. P3 amplitude had a temporary enhancement effect, which significantly decreased following a cognitive fatigue. tDCS had a continuous enhancement effect on N2 amplitude for the Go/Nogo task, which was associated with the enhanced inhibition of distracting stimuli. Together, the current data suggest that anodal tDCS over left DLPFC possibly enhances the early stage of relevant information processing and the inhibitory control of distracting stimuli during a continuous and monotonous vigilance task.

Automatic change detection: Mismatch negativity and the now-classic Rensink, O’Reagan, and Clark (1997) stimuli

Change blindness experiments had demonstrated that detection of significant changes in natural images is extremely difficult when brief blank fields are placed between alternating displays of an original and a modified scene. On the other hand, research on the visual mismatch negativity (vMMN) component of the event-related potentials (ERPs) identified sensitivity to events (deviants) different from the regularity of stimulus sequences (standards), even if the deviant and standard events are non-attended. The present study sought to investigate the apparent controversy between the experience under the change blindness paradigm and the ERP results. To this end, the stimulus of Rensink, O’Reagen, and Clark (1997) was adapted to a passive oddball ERP paradigm to investigate the underlying processing differences between the standard (original) and deviant (altered) stimuli measured in 22 subjects. Posterior negativity within the 280–330 ms latency range emerged as the difference between ERPs elicited by standard and deviant stimuli, identified as visual mismatch negativity (vMMN). These results raise the possibility that change blindness is not based on the lack of detailed visual representations or the deficiency of comparing two representations. However, effective discrimination of the two scene versions requires considerable frequency differences between them.

Detection of deviance in Japanese kanji compound words

Reading fluency is based on the automatic visual recognition of words. As a manifestation of the automatic processing of words, an automatic deviance detection of visual word stimuli can be observed in the early stages of visual recognition. To clarify whether this phenomenon occurs with Japanese kanji compounds—since their lexicality is related to semantic association—we investigated the brain response by utilizing three types of deviants: differences in font type, lexically correct or incorrect Japanese kanji compound words and pseudo-kanji characters modified from correct and incorrect compounds. We employed magnetoencephalography (MEG) to evaluate the spatiotemporal profiles of the related brain regions. The study included 22 adult native Japanese speakers (16 females). The abovementioned three kinds of stimuli containing 20% deviants were presented during the MEG measurement. Activity in the occipital pole region of the brain was observed upon the detection of font-type deviance within 250 ms of stimulus onset. Although no significant activity upon detecting lexically correct/incorrect kanji compounds or pseudo-kanji character deviations was observed, the activity in the posterior transverse region of the collateral sulcus (pCoS)—which is a fusiform neighboring area—was larger when detecting lexically correct kanji compounds than when detecting pseudo-kanji characters. Taken together, these results support the notion that the automatic detection of deviance in kanji compounds may be limited to a low-level feature, such as the stimulus stroke thickness.

Visually Perceived Negative Emotion Enhances Mismatch Negativity but Fails to Compensate for Age-Related Impairments

Objective: Automatic detection of auditory stimuli, represented by the mismatch negativity (MMN), facilitates rapid processing of salient stimuli in the environment. The amplitude of MMN declines with ageing. However, whether automatic detection of auditory stimuli is affected by visually perceived negative emotions with normal ageing remains unclear. We aimed to evaluate how fearful facial expressions affect the MMN amplitude under ageing.

Methods: We used a modified oddball paradigm to analyze the amplitude of N100 (N1) and MMN in 22 young adults and 21 middle-aged adults.

Results: We found that the amplitude of N1 elicited by standard tones was smaller under fearful facial expressions than neutral facial expressions and was more negative for young adults than middle-aged adults. The MMN amplitude under fearful facial expressions was greater than neutral facial expressions, but the amplitude in middle-aged adults was smaller than in young adults.

Conclusion: Visually perceived negative emotion promotes the extraction of auditory features. Additionally, it enhances the effect of auditory change detection in middle-aged adults but fails to compensate for this decline with normal ageing.

Significance: The study may help to understand how visually perceived emotion affects the early stage of auditory information processing from an event process perspective.