The attentional blink demonstrates automatic deviance processing in vision

The role of attention control in visual mismatch negativity (vMMN) studies

The detection of unattended visual changes is investigated by the visual mismatch negativity (vMMN) component of event-related potentials (ERPs). The vMMN is measured as the difference between the ERPs to infrequent (deviant) and frequent (standard) stimuli irrelevant to the ongoing task. In the present study, we used human faces expressing different emotions as deviants and standards. In such studies, participants perform various tasks, so their attention is diverted from the vMMN-related stimuli. If such tasks vary in their attentional demand, they might influence the outcome of vMMN studies. In this study, we compared four kinds of frequently used tasks: (1) a tracking task that demanded continuous performance, (2) a detection task where the target stimuli appeared at any time, (3) a detection task where target stimuli appeared only in the inter-stimulus intervals, and (4) a task where target stimuli were members of the stimulus sequence. This fourth task elicited robust vMMN, while in the other three tasks, deviant stimuli elicited moderate posterior negativity (vMMN). We concluded that the ongoing task had a marked influence on vMMN; thus, it is important to consider this effect in vMMN studies.

What processes are disrupted during the attentional blink? An integrative review of event-related potential research

Reporting the second of two targets is impaired when these appear in close succession, a phenomenon known as the attentional blink (AB). Despite decades of research, what factors limit our ability to process multiple sequentially presented events remains unclear. Specifically, two central issues remain open: does failure to report the second target (T2) reflect a structural limitation in working memory (WM) encoding or a disruption to attentional processes? And is perceptual processing of the stimulus that we fail to report impaired, or only processes that occur after this stimulus is identified? We address these questions by reviewing event-related potential (ERP) studies of the AB, after providing a brief overview of the theoretical landscape relevant to these debates and clarifying key concepts essential for interpreting ERP studies. We show that failure to report the second target is most often associated with disrupted attentional engagement (associated with a smaller and delayed N2pc component). This disruption occurs after early processing of T2 (associated with an intact P1 component), weakens its semantic processing (typically associated with a smaller N400 component), and prevents its encoding into WM (associated with absent P3b). However, failure to encode T2 in WM can occur despite intact attentional engagement and semantic processing. We conclude that the AB phenomenon, which reflects our limited ability to process sequential events, emerges from the disruption of both attentional engagement and WM encoding.

Preattentive processing of visually guided self-motion in humans and monkeys

The visually-based control of self-motion is a challenging task, requiring - if needed - immediate adjustments to keep on track. Accordingly, it would appear advantageous if the processing of self-motion direction (heading) was predictive, thereby accelerating the encoding of unexpected changes, and un-impaired by attentional load. We tested this hypothesis by recording EEG in humans and macaque monkeys with similar experimental protocols. Subjects viewed a random dot pattern simulating self-motion across a ground plane in an oddball EEG paradigm. Standard and deviant trials differed only in their simulated heading direction (forward-left vs. forward-right). Event-related potentials (ERPs) were compared in order to test for the occurrence of a visual mismatch negativity (vMMN), a component that reflects preattentive and likely also predictive processing of sensory stimuli. Analysis of the ERPs revealed signatures of a prediction mismatch for deviant stimuli in both humans and monkeys. In humans, a MMN was observed starting 110 ms after self-motion onset. In monkeys, peak response amplitudes following deviant stimuli were enhanced compared to the standard already 100 ms after self-motion onset. We consider our results strong evidence for a preattentive processing of visual self-motion information in humans and monkeys, allowing for ultrafast adjustments of their heading direction.

Do categorical representations modulate early automatic visual processing? A visual mismatch-negativity study

Perceptual categorization is an important cognitive function. In the auditory domain, categorization already occurs within the first 200 ms of information processing, as indexed by the mismatch negativity. Here, we assessed the characteristics of the visual mismatch negativity (vMMN) elicited during the categorization of previously unknown visual stimuli. To examine this, we used five-dot patterns with characteristics that allow for the formation of categories through rotation and reflection but not through other physical properties. To assess whether or not between-category and within-category vMMN differ in amplitude, the data was analyzed with the Bayesian approach. We observed that both between-category and within-category deviants elicited a vMMN, but that both vMMNs were comparable in magnitude. This finding suggests that abstract categorical representations are not always automatically processed at early visual stages and demonstrates limitations of generalization from the auditory domain to visual domain.

Spatially intermixed objects of different categories are parsed automatically

Our visual system is able to separate spatially intermixed objects into different categorical groups (e.g., berries and leaves) using the shape of feature distribution: Determining whether all objects belong to one or several categories depends on whether the distribution has one or several peaks. Despite the apparent ease of rapid categorization, it is a very computationally demanding task, given severely limited "bottlenecks" of attention and working memory capable of processing only a few objects at a time. Here, we tested whether this rapid categorical parsing is automatic or requires attention. We used the visual mismatch negativity (vMMN) ERP component known as a marker of automatic sensory discrimination. 20 volunteers (16 female, mean age-22.7) participated in our study. Loading participants' attention with a central task, we observed a substantial vMMN response to unattended background changes of categories defined by certain length-orientation conjunctions. Importantly, this occurred in conditions where the distributions of these features had several peaks and, hence, supported categorical separation. These results suggest that spatially intermixed objects are parsed into distinct categories automatically and give new insight into how the visual system can bypass the severe processing restrictions and form rich perceptual experience.

Consciousness modulates the automatic change detection of masked emotional faces: Evidence from visual mismatch negativity

The ability to automatically detect changes in the environment is crucial for organisms to survive. In the visual system, changes in visual stimuli may evoke visual mismatch negativity (vMMN), an event-related potential (ERP) component that reflects automatic change detection. Previous studies that used visual masking to examine the effects of consciousness did not yield evidence that vMMN could be elicited by subliminal stimuli. However, these studies used relatively simple visual features. To further examine the role of consciousness in vMMN, the present study used emotional (happy and fearful) faces, which are biologically and socially significant visual stimuli. A passive oddball paradigm was employed, and we found that only fearful faces could evoke vMMN at a low consciousness level. Furthermore, the fear-related vMMN was enhanced by the consciousness level, and localized in regions of the brain associated with emotional face processing and the prefrontal cortex. We also found that the emotional visual mismatch oscillatory responses (vMORs) were associated with the enhancement of the alpha-band oscillation. Moreover, consciousness could weaken the happiness-related vMOR. These results suggested that changes to emotional faces-especially fearful faces-could be unconsciously detected by the brain. More importantly, this automatic change detection mechanism could be modulated by consciousness.

Visual mismatch negativity and representational momentum: Their possible involvement in the same automatic prediction

To maintain real-time interaction with a dynamically changing visual object, the brain is thought to automatically predict the next state of the object based on the pattern of its preceding changes. A behavioral phenomenon known as representational momentum (RM: forward displacement of the remembered final state of an object along its preceding change pattern) and an electrophysiological phenomenon known as visual mismatch negativity (VMMN: an event-related brain potential component that is elicited when an object suddenly deviates from its preceding change pattern) have each indicated the existence of such automatic predictive processes. However, there has been no direct investigation of whether or not these phenomena are involved in the same predictive processes. To address this issue, the present study examined the correlation between RM and VMMN by using a hybrid paradigm in which both phenomena can be measured for the rotation of a bar. The results showed that the magnitudes of RM and VMMN were positively correlated; participants who exhibited greater RM along the regular rotation of a bar tended to show greater VMMN in response to sudden reversal embedded in the regular rotation of a bar. This result provides empirical support for the hypothesis that RM and VMMN may be involved in the same automatic predictive processes. Due to the methodological limitations of a correlation analysis, this hypothesis has to be carefully tested in future studies that examine the relationship between RM and VMMN from multiple perspectives.

Sex and Physiological Cycles Affect the Automatic Perception of Attractive Opposite-Sex Faces: A Visual Mismatch Negativity Study

Facial attractiveness plays important roles in social interaction. Electrophysiological and neuroimaging studies found several brain areas to be differentially responsive to attractive relative to unattractive faces. However, little is known about the time course of the information processing, especially under the unattended condition. Based on a "cross-modal delayed response" paradigm, the present study aimed to explore the automatic mechanism of facial attractiveness processing of females with different physiological cycles and males, respectively, through recording the event-related potentials in response to (un)attractive opposite-sex faces by two experiments. The attractiveness-related visual mismatch negativity (attractiveness vMMN) in posterior scalp distribution was recorded in both the experiments, which indicated that attractive faces could be processed automatically. And high-attractive opposite-sex faces can elicit larger vMMN in males than females in menstrual period in Study 1, but similar as females in ovulatory period in Study 2. Furthermore, by comparison, the latency of attractiveness vMMN in females with the ovulatory period was the longest. These results indicated as follows: (1) Males were more sensitive to attractive female faces, (2) females in ovulatory period were also attracted by the attractive male faces, (3) the long vMMN latency in females during ovulatory period suggested a special reproductive motivation to avoid being tainted by genes, which takes priority over the breeding motivation.

Preattentive and Predictive Processing of Visual Motion

Interaction with the environment requires fast and reliable sensory processing. The visual system is confronted with a continuous flow of high-dimensional input (e.g. orientation, color, motion). From a theoretical point of view, it would be advantageous if critical information was processed independent of attentional load, i.e. preattentively. Here, we hypothesized that visual motion is such a critical signal and aimed for a neural signature of its preattentive encoding. Furthermore, we were interested in the neural correlates of predictability of linear motion trajectories based on the presence or absence of preceding motion. We presented a visual oddball paradigm and studied event-related potentials (ERPs). Stimuli were linearly moving Gabor patches that disappeared behind an occluder. The difference between deviant and standard trials was a trajectory change which happened behind the occluder in deviant trials only, inducing a prediction error. As hypothesized, we found a visual mismatch negativity-component over parietal and occipital electrodes. In a further condition, trials without preceding motion were presented in which the patch just appeared from behind the occluder and, hence, was not predictable. We found larger ERP-components for unpredictable stimuli. In summary, our results provide evidence for a preattentive and predictive processing of linear trajectories of visual motion.

Automatic Conflict Monitoring by Event-Related Potentials Could be used to Estimate Visual Acuity Levels

Numerous studies have explored the physical attribute features or face perceptions in conflict processing, while complicate gradient conflicts were rarely discussed. The aim of the study was to discuss the relationship between the event-related potential (ERP) component features and different visual acuity levels by using the modified S1-S2 task under non-attention status. Three visual acuity levels were applied, each with four orientations of "E" optotype stimuli randomly presented in the center of the visual field while participants were required to concentrate on listening to stories. The results showed that the amplitudes of P1 and P3 as well as difference P3 were larger in supra-threshold condition. In threshold condition, larger amplitudes for both N2 and difference N2 exhibited in frontal and central areas. In sub-threshold condition, there was no endogenous component elicited by mismatch stimuli except smaller anterior N1. Meanwhile, the specific distributions of N1 and N2 were presented and compared with previous face processing. The findings showed that visual conflict processing took place not only at an early stage but also at the late period, which might be as the consequences of interaction between conflict strength and involuntary attention. We concluded that automatic conflict detecting of visual icons by the serial ERP components could distinguish different visual acuity levels. The involvement of endogenous components could reveal the specific mechanism of more precise and fine conflict identification of complex physical attributes under non-attention status, furthermore could be used as valid markers to estimate the magnitude of visual acuity objectively.

Visual mismatch negativity is unaffected by top-down prediction of the timing of deviant events

Visual mismatch negativity (VMMN) is an event-related brain potential component that is automatically elicited by infrequent (deviant) stimuli that are inserted among frequent (standard) stimuli (i.e., an oddball sequence). Although the elicitation of VMMN is basically determined in a stimulus-driven manner, it can be modulated by top-down control. In a previous study using a "patterned" oddball sequence, where deviant (D) stimuli were regularly inserted among standard (S) stimuli (i.e., repetitions of an SSSSD pattern), VMMN was largely reduced when participants noticed the SSSSD pattern and actively predicted both the identity and timing of the deviant stimuli compared to when they did not notice the SSSSD pattern and did not form such active prediction. The present study further investigated whether or not active prediction of only the timing of deviant stimuli is sufficient for the reduction of VMMN. With the patterned oddball sequence with one deviant (here, deviant stimuli were fixed throughout the block), VMMN was reduced when the participants noticed the SSSSD pattern and actively predicted both the identity and timing of deviant stimuli (i.e., replication of the previous finding). In contrast, with the patterned oddball sequence with two deviants (deviant stimuli were randomly varied between two possibilities), VMMN was not significantly reduced when the participants noticed the SSSSD pattern and actively predicted only the timing of deviant stimuli. These results suggest that active prediction of only the timing of deviant stimuli is not sufficient to reduce VMMN.

The Orienting Response in Healthy Aging: Novelty P3 Indicates No General Decline but Reduced Efficacy for Fast Stimulation Rates

Automatic orienting to unexpected changes in the environment is a pre-requisite for adaptive behavior. One prominent mechanism of automatic attentional control is the Orienting Response (OR). Despite the fundamental significance of the OR in everyday life, only little is known about how the OR is affected by healthy aging. We tested this question in two age groups (19-38 and 55-72 years) and measured skin-conductance responses (SCRs) and event-related brain potentials (ERPs) to novels (i.e., short environmental sounds presented only once in the experiment; 10% of the trials) compared to standard sounds (600 Hz sinusoidal tones with 200 ms duration; 90% of the trials). Novel and standard stimuli were presented in four conditions differing in the inter-stimulus interval (ISI) with a mean ISI of either 10, 3, 1, or 0.5 s (blocked presentation). In both age groups, pronounced SCRs were elicited by novels in the 10 s ISI condition, suggesting the elicitation of stable ORs. These effects were accompanied by pronounced N1 and frontal P3 amplitudes in the ERP, suggesting that automatic novelty processing and orientation of attention are effective in both age groups. Furthermore, the SCR and ERP effects declined with decreasing ISI length. In addition, differences between the two groups were observable with the fastest presentation rates (i.e., 1 and 0.5 s ISI length). The most prominent difference was a shift of the peak of the frontal positivity from around 300 to 200 ms in the 19-38 years group while in the 55-72 years group the amplitude of the frontal P3 decreased linearly with decreasing ISI length. Taken together, this pattern of results does not suggest a general decline in processing efficacy with healthy aging. At least with very rare changes (here, the novels in the 10 s ISI condition) the OR is as effective in healthy older adults as in younger adults. With faster presentation rates, however, the efficacy of the OR decreases. This seems to result in a switch from novelty to deviant processing in younger adults, but less so in the group of older adults.

Visual mismatch negativity to masked stimuli presented at very brief presentation rates

Mismatch negativity (MMN) has been characterised as a 'pre-attentive' component of an event-related potential (ERP) that is related to discrimination and error prediction processes. The aim of the current experiment was to establish whether visual MMN could be recorded to briefly presented, backward and forward masked visual stimuli, given both below and above levels of subjective experience. Evidence of visual MMN elicitation in the absence of the ability to consciously report stimuli would provide strong evidence for the automaticity of the visual MMN mechanism. Using an oddball paradigm, two stimuli that differed in orientation from each other, a + and an ×, were presented on a computer screen. Electroencephalogram (EEG) was recorded from nine participants (six females), mean age 21.4 years. Results showed that for stimuli that were effectively masked at 7 ms presentation, there was little variation in the ERPs evoked to standard and deviant stimuli or in the subtraction waveform employed to delineate the visual MMN. At 14 ms stimulus presentation, when participants were able to report stimulus presence, an enhanced negativity at around 175 and 305 ms was observed to the deviant and was evident in the subtraction waveform. However, some of the difference observed in the ERPs can be attributed to stimulus characteristics, as the use of a 'lonely' deviant protocol revealed attenuated visual MMN components at 14 ms stimulus presentation. Overall, results suggest that some degree of conscious attention is required before visual MMN components emerge, suggesting visual MMN is not an entirely pre-attentive process.

Facial Expression Related vMMN: Disentangling Emotional from Neutral Change Detection

Detection of changes in facial emotional expressions is crucial to communicate and to rapidly and automatically process possible threats in the environment. Recent studies suggest that expression-related visual mismatch negativity (vMMN) reflects automatic processing of emotional changes. In the present study we used a controlled paradigm to investigate the specificity of emotional change-detection. In order to disentangle specific responses to emotional deviants from that of neutral deviants, we presented neutral expression as standard stimulus (p = 0.80) and both angry and neutral expressions as deviants (p = 0.10, each). In addition to an oddball sequence, an equiprobable sequence was presented, to control for refractoriness and low-level differences. Our results showed that in an early time window (100–200 ms), the controlled vMMN was greater than the oddball vMMN only for the angry deviant, suggesting the importance of controlling for refractoriness and stimulus physical features in emotion related studies. Within the controlled vMMN, angry and neutral deviants both elicited early and late peaks occurring at 140 and 310 ms, respectively, but only the emotional vMMN presented sustained amplitude after each peak. By directly comparing responses to emotional and neutral deviants, our study provides evidence of specific activity reflecting the automatic detection of emotional change. This differs from broader “visual” change processing, and suggests the involvement of two partially-distinct pre-attentional systems in the detection of changes in facial expressions.

Gender differences in pre-attentive change detection for visual but not auditory stimuli

OBJECTIVE

Despite ongoing debate about gender differences in pre-attention processes, little is known about gender effects on change detection for auditory and visual stimuli. We explored gender differences in change detection while processing duration information in auditory and visual modalities.

METHOD

We investigated pre-attentive processing of duration information using a deviant-standard reverse oddball paradigm (50 ms/150 ms) for auditory and visual mismatch negativity (aMMN and vMMN) in males and females (n=21/group).

RESULT

In the auditory modality, decrement and increment aMMN were observed at 150-250 ms after the stimulus onset, and there was no significant gender effect on MMN amplitudes in temporal or fronto-central areas. In contrast, in the visual modality, only increment vMMN was observed at 180-260 ms after the onset of stimulus, and it was higher in males than in females.

CONCLUSION

No gender effect was found in change detection for auditory stimuli, but change detection was facilitated for visual stimuli in males.

SIGNIFICANCE

Gender effects should be considered in clinical studies of pre-attention for visual stimuli.

Automatic prediction regarding the next state of a visual object: Electrophysiological indicators of prediction match and mismatch

Behavioral phenomena such as representational momentum suggest that the brain can automatically predict the next state of a visual object, based on sequential rules embedded in its preceding spatiotemporal context. To identify electrophysiological indicators of automatic visual prediction in terms of prediction match and mismatch, we recorded event-related brain potentials (ERPs) while participants passively viewed three types of task-irrelevant sequences of a bar stimulus: (1) an oddball sequence, which contained a sequential rule defined by stimulus repetition, providing repetition-rule-conforming (standard) and -violating (deviant) stimuli; (2) a rotating-oddball sequence, which contained a sequential rule defined by stimulus change (i.e., rotation), providing change-rule-conforming (regular) and -violating (irregular) stimuli; and (3) a random sequence, which did not contain a sequential rule, providing a neutral (control) stimulus. This protocol allowed us to expect that (1) an ERP effect that reflects a prediction-mismatch process should be exclusively observed in both the deviant-minus-control and irregular-minus-control comparisons and (2) an ERP effect that reflects a prediction-match process should be exclusively observed in both the standard-minus-control and regular-minus-control comparisons. The results showed that the ERP effect that met the criterion for prediction mismatch was an occipito-temporal negative deflection at around 170-300ms (visual mismatch negativity), while the ERP effect that met the criterion for prediction match was a frontal/central negative deflection at around 150-270ms (probably, the reduction of P2). These two contrasting ERP effects support a hypothetical view that automatic visual prediction would involve both an increase in the neural response to prediction-incongruent (i.e., novel) events and a decrease in the neural response to prediction-congruent (i.e., redundant) events. This article is part of a Special Issue entitled SI: Prediction and Attention.

Visual mismatch negativity: a predictive coding view

An increasing number of studies investigate the visual mismatch negativity (vMMN) or use the vMMN as a tool to probe various aspects of human cognition. This paper reviews the theoretical underpinnings of vMMN in the light of methodological considerations and provides recommendations for measuring and interpreting the vMMN. The following key issues are discussed from the experimentalist's point of view in a predictive coding framework: (1) experimental protocols and procedures to control "refractoriness" effects; (2) methods to control attention; (3) vMMN and veridical perception.

Automatic detection of trustworthiness of the face: a visual mismatch negativity study

Recognizing intentions of strangers from facial cues is crucial in everyday social interactions. Recent studies demonstrated enhanced event-related potential (ERP) responses to untrustworthy compared to trustworthy faces. The aim of the present study was to investigate the electrophysiological correlates of automatic processing of trustworthiness cues in a visual oddball paradigm in two consecutive experimental blocks. In one block, frequent trustworthy (p = 0.9) and rare untrustworthy face stimuli (p = 0.1) were briefly presented on a computer screen with each stimulus consisting of four peripherally positioned faces. In the other block stimuli were presented with reversed probabilities enabling the comparison of ERPs evoked by physically identical deviant and standard stimuli. To avoid attentional effects participants engaged in a central detection task. Analyses of deviant minus standard difference waveforms revealed that deviant untrustworthy but not trustworthy faces elicited the visual mismatch negativity (vMMN) component. The present results indicate that adaptation occurred to repeated unattended trustworthy (but not untrustworthy) faces, i.e., an automatic expectation was elicited towards trustworthiness signals, which was violated by deviant untrustworthy faces. As an evolutionary adaptive mechanism, the observed fast detection of trustworthiness-related social facial cues may serve as the basis of conscious recognition of reliable partners.

Integration of sensory information precedes the sensation of vection: a combined behavioral and event-related brain potential (ERP) study

Illusory self-motion (known as vection) describes the sensation of ego-motion in the absence of physical movement. Vection typically occurs in stationary observers being exposed to visual information that suggest self-motion (e.g. simulators, virtual reality). In the present study, we tested whether sensory integration of visual information triggers vection: participants (N=13) perceived patterns of moving altered black-and-white vertical stripes on a screen that was divided into a central and a surrounding peripheral visual field. In both fields the pattern was either moving or stationary, resulting in four combinations of central and peripheral motions: (1) central and peripheral stripes moved into the same direction, (2) central and peripheral stripes moved in opposite directions, or (3) either the central or (4) the peripheral stripes were stable while the other stripes were in motion. This stimulation induced vection: Results showed significantly higher vection ratings when the stationary center of the pattern was surrounded by a moving periphery. Event-related potentials mirrored this finding: The occipital N2 was largest with stationary central and moving peripheral stripes. Our findings suggest that sensory integration of peripheral and central visual information triggers the perception of vection. Furthermore, we found evidence that neural processes precede the subjective perception of vection strength prior to the actual onset of vection. We will discuss our findings with respect to the role of stimulus eccentricity, stimulus' depth, and neural correlates involved during the genesis of vection.

Unattended and attended visual change detection of motion as indexed by event-related potentials and its behavioral correlates

Visual mismatch negativity (vMMN) is a negative-going component amongst cognitive event-related potentials. It reflects an automatic change-detection process that occurs when an infrequent stimulus is presented that is incongruent with the representation of a frequent (standard) event. In our research we use visual motion (more specifically motion direction changes) to study vMMN. Since movement in the visual field is quite irresistible to our brain, the question in hand is, if the detection of motion direction changes is dependent on attention directed to the stimulus. We present a new continuous whole-display stimulus configuration, where the attention capturing primary task of motion onset detection is in the central part of the visual display and visual oddball sequence on the background. The visual oddball paradigm consisted of 85% standard and 15% deviant events, motion direction change being the deviant. We show that even though the unattended visual oddball sequence does not affect the performance in the demanding behavioral primary task, the differences appearing in that sequence are noticed by our brain and reflected in two distinguishable vMMN components in occipital and parietal scalp locations. When attention is directed toward the visual oddball sequence, we only see different processing of standards and deviants in later time-windows and task-related activity in frontal scalp location. Our results are obtained under strict attention manipulation conditions.

Automatic processing of unattended lexical information in visual oddball presentation: neurophysiological evidence

Previous electrophysiological studies of automatic language processing revealed early (100–200 ms) reflections of access to lexical characteristics of speech signal using the so-called mismatch negativity (MMN), a negative ERP deflection elicited by infrequent irregularities in unattended repetitive auditory stimulation. In those studies, lexical processing of spoken stimuli became manifest as an enhanced ERP in response to unattended real words, as opposed to phonologically matched but meaningless pseudoword stimuli. This lexical ERP enhancement was explained by automatic activation of word memory traces realized as distributed strongly intra-connected neuronal circuits, whose robustness guarantees memory trace activation even in the absence of attention on spoken input. Such an account would predict the automatic activation of these memory traces upon any presentation of linguistic information, irrespective of the presentation modality. As previous lexical MMN studies exclusively used auditory stimulation, we here adapted the lexical MMN paradigm to investigate early automatic lexical effects in the visual modality. In a visual oddball sequence, matched short word and pseudoword stimuli were presented tachistoscopically in perifoveal area outside the visual focus of attention, as the subjects' attention was concentrated on a concurrent non-linguistic visual dual task in the center of the screen. Using EEG, we found a visual analogue of the lexical ERP enhancement effect, with unattended written words producing larger brain response amplitudes than matched pseudowords, starting at ~100 ms. Furthermore, we also found significant visual MMN, reported here for the first time for unattended perifoveal lexical stimuli. The data suggest early automatic lexical processing of visually presented language which commences rapidly and can take place outside the focus of attention.

Task difficulty affects the predictive process indexed by visual mismatch negativity

Visual mismatch negativity (MMN) is an event-related brain potential (ERP) component that is elicited by prediction-incongruent events in successive visual stimulation. Previous oddball studies have shown that visual MMN in response to task-irrelevant deviant stimuli is insensitive to the manipulation of task difficulty, which supports the notion that visual MMN reflects attention-independent predictive processes. In these studies, however, visual MMN was evaluated in deviant-minus-standard difference waves, which may lead to an underestimation of the effects of task difficulty due to the possible superposition of N1-difference reflecting refractory effects. In the present study, we investigated the effects of task difficulty on visual MMN, less contaminated by N1-difference. While the participant performed a size-change detection task regarding a continuously-presented central fixation circle, we presented oddball sequences consisting of deviant and standard bar stimuli with different orientations (9.1 and 90.9%) and equiprobable sequences consisting of 11 types of control bar stimuli with different orientations (9.1% each) at the surrounding visual fields. Task difficulty was manipulated by varying the magnitude of the size-change. We found that the peak latencies of visual MMN evaluated in the deviant-minus-control difference waves were delayed as a function of task difficulty. Therefore, in contrast to the previous understanding, the present findings support the notion that visual MMN is associated with attention-demanding predictive processes.

Object-related regularities are processed automatically: evidence from the visual mismatch negativity

One of the most challenging tasks of our visual systems is to structure and integrate the enormous amount of incoming information into distinct coherent objects. It is an ongoing debate whether or not the formation of visual objects requires attention. Implicit behavioral measures suggest that object formation can occur for task-irrelevant and unattended visual stimuli. The present study investigated pre-attentive visual object formation by combining implicit behavioral measures and an electrophysiological indicator of pre-attentive visual irregularity detection, the visual mismatch negativity (vMMN) of the event-related potential. Our displays consisted of two symmetrically arranged, task-irrelevant ellipses, the objects. In addition, there were two discs of either high or low luminance presented on the objects, which served as targets. Participants had to indicate whether the targets were of the same or different luminance. In separate conditions, the targets either usually were enclosed in the same object or in two different objects (standards). Occasionally, the regular target-to-object assignment was changed (deviants). That is, standards and deviants were exclusively defined on the basis of the task-irrelevant target-to-object assignment but not on the basis of some feature regularity. Although participants did not notice the regularity nor the occurrence of the deviation in the sequences, task-irrelevant deviations resulted in increased reaction times. Moreover, compared with physically identical standard displays deviating target-to-object assignments elicited a negative potential in the 246–280 ms time window over posterio-temporal electrode positions which was identified as vMMN. With variable resolution electromagnetic tomography (VARETA) object-related vMMN was localized to the inferior temporal gyrus. Our results support the notion that the visual system automatically structures even task-irrelevant aspects of the incoming information into objects.

Mismatch Negativity Does Not Show Evidence of Memory Reactivation in the Visual Modality

The possibility of reactivation of the memory representation underlying visual mismatch negativity (vMMN) was investigated in a modified passive roving-standard paradigm. Stimuli (arrays of Gábor patches) were presented in sequences with blank interval between the sequences. The first member of each sequence was identical to the standard of the previous sequence, while the second stimulus had different orientation therefore the second stimulus was considered as deviant. In a control condition the stimuli of the previous sequence had random orientations. Event-related potentials (ERPs) in response to the deviants were compared to ERPs in response to the (physically identical) second stimulus of the control sequences. The comparison showed emergence of a positive component at an early (98–132 ms) latency range elicited by deviants. This component is interpreted as an index of increased sensitivity to rare changes in sequences dominated by identical stimuli rather than a component specific to violation of sequential regularity. Consequently, contrary to the findings in the auditory modality, the first stimulus of the sequence did not reactivate the memory representation underlying the vMMN, since subsequent deviant elicited no vMMN.

Automatic processing of rare versus novel auditory stimuli reveal different mechanisms of auditory change detection

Automatic detection of rare stimuli or changes in an auditory stimulation can distract ongoing task processing by attracting attention away from task relevant information. Typically, the effectiveness of auditory change detection is tested by rare and unpredictable deviations (compared with an otherwise regular auditory presentation) or by rare environmental sounds. The present study demonstrates that both types of stimuli are capable of triggering automatic orientation of attention and that rare environmental sounds are more effective than deviations in distraction of attention. This finding suggests different mechanisms underlying the detection of auditory change. Moreover, novelty as constituted by unique environmental sounds did not add to the effectiveness of automatic change detection, involuntary control of attention, and distraction.

Impact of lower- vs. upper-hemifield presentation on automatic colour-deviance detection: a visual mismatch negativity study

The automatic processing of deviances from the temporal context of the visual environment has become an important topic in visual cognitive sciences, which is often investigated using the visual mismatch negativity (vMMN). This event-related potential (ERP) component is elicited by an irregular stimulus (e.g., a red disc) presented in a series of stimuli (e.g., green discs) comprising a temporal regularity (e.g., colour repetition). We determined the influence of lower- vs. upper-hemifield presentation of the irregular stimulus on the vMMN while using whole-field stimulus displays controlling for sustained shifts in spatial attention. Deviances presented in the lower hemifield elicited a larger vMMN than the ones presented in the upper hemifield at a latency of 200-280ms. However, this asymmetry was preceded by deviance-related hemifield effects already emerging at an earlier latency (110-150ms), where upper-hemifield deviances elicited a positive potential but lower-hemifield deviances did not. With variable resolution electromagnetic tomography (VARETA) early deviance-related activity was localised to retinotopically organised regions of the visual cortex (BA 17/18) and vMMN-sources were localised to the middle/superior occipital gyrus, to higher areas along the temporal visual stream, but also to BA 17/18. We argue that the upper/lower-hemifield vMMN asymmetry relies at least partially on the hemifield-dependent differential sensitivity of early deviance-related activity generated in retinotopically organised regions of the visual cortex. However, a superior automatic processing of deviances presented in the lower visual hemifield may also contribute to the effect.

Automatic prediction error responses to hands with unexpected laterality: an electrophysiological study

Little is known about how the human brain keeps track of body parts in the visual field. Here we show that unattended images of right/left hands elicit a mismatch response when they violate a regularity established by repeated visual presentations of the other hand. In a visual oddball experiment we found mismatch responses to hands with unexpected laterality (e.g. left versus predicted right hand) in the periphery of the visual field. Unexpected left hands were processed predominantly in the contralateral superior parietal cortex, whereas unexpected right hands evoked differential activity in the contralateral superior parietal, ventral premotor, prefrontal and temporal areas, indicating a more elaborate automatic processing of the dominant hand. The amplitude of the differential activity to the right hand correlated with handedness test scores. Our results reveal the continuous monitoring of the left or right identity of hands, which is prerequisite to the ability to automatically transform observed actions into the observer's ego-centric spatial reference frame.

Using Redundant Visual Information From Different Dimensions for Attentional Selection

The present study investigated the use of redundant information for attentional selection of a visual object. Each display contained two overlapping objects, and participants had to report the color of the occluding object. A baseline condition did not require object selection because the objects were identical. A single-cue condition required object selection based on spatial arrangement (i.e., occlusion) because the objects had the same shape. A double-cue condition afforded object selection by occlusion and shape because the objects consistently differed in shape. Behavioral results showed that the redundant shape cue facilitated attentional selection, although participants were never supposed to respond to shape. The Event-Related Brain Potential (ERP) results showed a posterior N2 effect in both selection conditions, and a frontal N2 effect in the double-cue condition only. These results suggest that the redundancy gain in the double-cue condition relied on processes of voluntary attention, presumably the increase of attentional weights for visual shape information.