Visual mismatch negativity and stimulus-specific adaptation: the role of stimulus complexity

Prioritization of social information processing: Eye gaze elicits earlier vMMN than arrows

Numerous research studies have demonstrated that eye gaze and arrows act as cues that automatically guide spatial attention. However, it remains uncertain whether the attention shifts triggered by these two types of stimuli vary in terms of automatic processing mechanisms. In our current investigation, we employed an equal probability paradigm to explore the likenesses and distinctions in the neural mechanisms of automatic processing for eye gaze and arrows in non-attentive conditions, using visual mismatch negative (vMMN) as an indicator of automatic processing. The sample size comprised 17 participants. The results indicated a significant interaction between time duration, stimulus material, and stimulus type. The findings demonstrated that both eye gaze and arrows were processed automatically, triggering an early vMMN, although with temporal variations. The vMMN for eye gaze occurred between 180 and 220 ms, whereas for arrows it ranged from 235 to 275 ms. Moreover, arrow stimuli produced a more pronounced vMMN amplitude. The earlier vMMN response to eye gaze compared with arrows implies the specificity and precedence of social information processing associated with eye gaze over the processing of nonsocial information with arrows. However, arrow could potentially elicit a stronger vMMN because of their heightened salience compared to the background, and the expansion of attention focusing might amplify the vMMN impact. This study offers insights into the similarities and differences in attention processing of social and non-social information under unattended conditions from the perspective of automatic processing.

The role of attention control in visual mismatch negativity (vMMN) studies

The detection of unattended visual changes is investigated by the visual mismatch negativity (vMMN) component of event-related potentials (ERPs). The vMMN is measured as the difference between the ERPs to infrequent (deviant) and frequent (standard) stimuli irrelevant to the ongoing task. In the present study, we used human faces expressing different emotions as deviants and standards. In such studies, participants perform various tasks, so their attention is diverted from the vMMN-related stimuli. If such tasks vary in their attentional demand, they might influence the outcome of vMMN studies. In this study, we compared four kinds of frequently used tasks: (1) a tracking task that demanded continuous performance, (2) a detection task where the target stimuli appeared at any time, (3) a detection task where target stimuli appeared only in the inter-stimulus intervals, and (4) a task where target stimuli were members of the stimulus sequence. This fourth task elicited robust vMMN, while in the other three tasks, deviant stimuli elicited moderate posterior negativity (vMMN). We concluded that the ongoing task had a marked influence on vMMN; thus, it is important to consider this effect in vMMN studies.

Violated Expectations for Spatial and Feature Attributes of Visual Trajectories Modulate Event-Related Potential Amplitudes across the Visual Processing Hierarchy

During visual perception the brain must combine its predictions about what is to be perceived with incoming relevant information. The present study investigated how this process interacts with attention by using event-related potentials that index these cognitive mechanisms. Specifically, this study focused on examining how the amplitudes of the N170, N2pc, and N300 would be modulated by violations of expectations for spatial and featural attributes of visual stimuli. Participants viewed a series of shape stimuli in which a salient shape moved across a set of circular locations so that the trajectory of the shape implied the final position and shape of the stimulus. The final salient stimuli occurred in one of four possible outcomes: predictable position and shape, predictable position but unpredictable shape, unpredictable position but predictable shape, and unpredictable position and shape. The N170 was enhanced by unpredictable positions and shapes, whereas the N300 was enlarged only by unpredictable positions. The N2pc was not modulated by violations of expectation for shapes or positions. Additionally, it was observed post-hoc that the P1pc amplitude was increased by unpredictable shapes. These findings revealed that incorrect prediction increases neural activity. Furthermore, they suggest that prediction and attention interact differently in different stages of visual perception, depending on the type of attention being engaged: The N170 indexes initial prediction error signalling irrespective of the type of information (spatial or featural) in which error occurs, followed by the N300 as a marker of prediction updating involving reorientation of spatial attention.

Detection of deviance in Japanese kanji compound words

Reading fluency is based on the automatic visual recognition of words. As a manifestation of the automatic processing of words, an automatic deviance detection of visual word stimuli can be observed in the early stages of visual recognition. To clarify whether this phenomenon occurs with Japanese kanji compounds—since their lexicality is related to semantic association—we investigated the brain response by utilizing three types of deviants: differences in font type, lexically correct or incorrect Japanese kanji compound words and pseudo-kanji characters modified from correct and incorrect compounds. We employed magnetoencephalography (MEG) to evaluate the spatiotemporal profiles of the related brain regions. The study included 22 adult native Japanese speakers (16 females). The abovementioned three kinds of stimuli containing 20% deviants were presented during the MEG measurement. Activity in the occipital pole region of the brain was observed upon the detection of font-type deviance within 250 ms of stimulus onset. Although no significant activity upon detecting lexically correct/incorrect kanji compounds or pseudo-kanji character deviations was observed, the activity in the posterior transverse region of the collateral sulcus (pCoS)—which is a fusiform neighboring area—was larger when detecting lexically correct kanji compounds than when detecting pseudo-kanji characters. Taken together, these results support the notion that the automatic detection of deviance in kanji compounds may be limited to a low-level feature, such as the stimulus stroke thickness.

The Neural Responses of Visual Complexity in the Oddball Paradigm: An ERP Study

This research measured human neural responses to images of different visual complexity levels using the oddball paradigm to explore the neurocognitive responses of complexity perception in visual processing. In the task, 24 participants (12 females) were required to react to images with high complexity for all stimuli. We hypothesized that high-complexity stimuli would induce early visual and attentional processing effects and may elicit the visual mismatch negativity responses and the emergence of error-related negativity. Our results showed that the amplitude of P1 and N1 were unaffected by complexity in the early visual processing. Under the target stimuli, both N2 and P3b components were reported, suggesting that the N2 component was sensitive to the complexity deviation, and the attentional processing related to complexity may be derived from the occipital zone according to the feature of the P3b component. In addition, compared with the low-complexity stimulus, the high-complexity stimulus aroused a larger amplitude of the visual mismatch negativity. The detected error negativity (Ne) component reflected the error detection of the participants’ mismatch between visual complexity and psychological expectations.

EEG-based visual deviance detection in freely behaving mice

The mouse is widely used as an experimental model to study visual processing. To probe how the visual system detects changes in the environment, functional paradigms in freely behaving mice are strongly needed. We developed and validated the first EEG-based method to investigate visual deviance detection in freely behaving mice. Mice with EEG implants were exposed to a visual deviant detection paradigm that involved changes in light intensity as standard and deviant stimuli. By subtracting the standard from the deviant evoked waveform, deviant detection was evident as bi-phasic negativity (starting around 70 ms) in the difference waveform. Additionally, deviance-associated evoked (beta/gamma) and induced (gamma) oscillatory responses were found. We showed that the results were stimulus-independent by applying a "flip-flop" design and the results showed good repeatability in an independent measurement. Together, we put forward a validated, easy-to-use paradigm to measure visual deviance processing in freely behaving mice.

Subjectively different emotional schematic faces not automatically discriminated from the brain's bioelectrical responses

The present study investigates how the brain automatically discriminates emotional schematic faces, as indicated by the mismatch responses, and how reliable these brain responses are. Thirty-three healthy volunteers participated in the vMMN EEG experiment with four experimental sets differing from each other by the type of standard (object with scrambled face features) and the type of deviants (Angry, Happy and Neutral schematic faces) presented. Conscious subjective evaluations of valence, arousal and attention catching of the same stimuli showed clear differentiation of emotional expressions. Deviant faces elicited rather similar vMMN at frontal and occipital sites. Bayesian analyses suggest that vMMN does not differ between angry and happy faces. Neutral faces, however, did not yield statistically significant vMMN at occipital leads. Pearson's correlation and intra-class correlation analyses showed that the brain's reactions to the stimuli were highly stable within individuals across the experimental sets, whereas the mismatch responses were much more variable.

The effect of hand motion and object orientation on the automatic detection of orientation: A visual mismatch negativity study

We investigated the effects of voluntary hand movements and continuously present objects on the automatic detection of deviant stimuli in a passive oddball paradigm. The visual mismatch negativity (vMMN) component of event-related potentials (ERPs) was measured as the index of automatic deviant detection. The stimuli were textures consisting of parallel, oblique bars with frequent (standard) and infrequent (deviant) orientation. Traditional vMMN was measured by the difference between ERPs to frequent (standard) and infrequent (deviant) textures. Additionally, we measured 'genuine' vMMN by comparing the ERPs to deviant and control textures in the equal probability procedure. Compatible and incompatible hand movement directions to the standard texture had no influence on 'traditional' vMMN and elicited no 'genuine' vMMN. However, the deviant texture elicited 'genuine' vMMN if the orientation of a continuously present rectangle was different from the standard (and identical to the deviant) texture orientation. Our results suggest that the direction of voluntary hand movement and the orientation of task-irrelevant visual patterns do not acquire common memory representation, but a continuously present object contributes to the detection of sequential regularity violation.