Effects of stimulus location on automatic detection of changes in motion direction in the human brain

Migraine versus tension-type headache in automatic emotional processing: A visual mismatch negativity study

OBJECTIVE

It is important to discriminate different headaches in clinical practice, and neurocognitive biomarkers may serve as objective tools. Several reports have suggested potential cognitive impairment for primary headaches, whereas cognitions within specific domains remain elusive, e.g., emotional processing. In this study, we aimed to characterize processing of facial expressions in migraine and tension-type headache (TTH) by analyzing expression-related visual mismatch negativity (EMMN) and explored whether their processing patterns were distinct.

METHODS

Altogether, 73 headache patients (20 migraine with aura (MA), 28 migraine without aura (MwoA), 25 TTH) and 27 age-matched healthy controls were recruited. After a battery of mood/neuropsychological evaluations, an expression-related oddball paradigm containing multiple models of neutral, happy and sad faces was used to investigate automatic emotional processing.

RESULTS

We observed cognitive impairment in all headache patients, especially in attention/execution subdomains, but no discrepancy existed among different headaches. Although analyses of P1/N170 did not reach significant levels, amplitude of early and late EMMN was markedly diminished in MA and MwoA compared with controls and TTH, regardless of happy or sad expression. Moreover, sad EMMN was larger (more negative) than happy EMMN only in controls, while not in all headache groups.

CONCLUSIONS

Our findings implied that migraine, rather than TTH, might lead to more severe impairment of automatic emotional processing, which was manifested as no observable EMMN elicitation and disappearance of negative bias effect. The EMMN component could assist in discrimination of migraine from TTH and diagnosis of undefined headaches, and its availability needed further validations.

Exogenous Attention to Emotional Stimuli Presenting Realistic (3D) Looming Motion

Previous research shows that dynamic stimuli, on the one hand, and emotional stimuli, on the other, capture exogenous attention due to their biological relevance. Through neural (ERPs) and behavioral measures (reaction times and errors), the present study explored the combined effect of looming motion and emotional content on attentional capture. To this end, 3D-recreated static and dynamic animals assessed as emotional (positive or negative) or neutral were presented as distractors while 71 volunteers performed a line orientation task. We observed a two-phase effect: firstly (before 300 ms), early components of ERPs (P1p and N2po) showed enhanced exogenous attentional capture by looming positive distractors and static threatening animals. Thereafter, dynamic and static threatening distractors received enhanced endogenous attention as revealed by both late ERP activity (LPC) and behavioral (errors) responses. These effects are likely explained by both the emotional valence and the distance of the stimulus at each moment.

Preattentive processing of visually guided self-motion in humans and monkeys

The visually-based control of self-motion is a challenging task, requiring - if needed - immediate adjustments to keep on track. Accordingly, it would appear advantageous if the processing of self-motion direction (heading) was predictive, thereby accelerating the encoding of unexpected changes, and un-impaired by attentional load. We tested this hypothesis by recording EEG in humans and macaque monkeys with similar experimental protocols. Subjects viewed a random dot pattern simulating self-motion across a ground plane in an oddball EEG paradigm. Standard and deviant trials differed only in their simulated heading direction (forward-left vs. forward-right). Event-related potentials (ERPs) were compared in order to test for the occurrence of a visual mismatch negativity (vMMN), a component that reflects preattentive and likely also predictive processing of sensory stimuli. Analysis of the ERPs revealed signatures of a prediction mismatch for deviant stimuli in both humans and monkeys. In humans, a MMN was observed starting 110 ms after self-motion onset. In monkeys, peak response amplitudes following deviant stimuli were enhanced compared to the standard already 100 ms after self-motion onset. We consider our results strong evidence for a preattentive processing of visual self-motion information in humans and monkeys, allowing for ultrafast adjustments of their heading direction.

Intensity- and timing-dependent modulation of motion perception with transcranial magnetic stimulation of visual cortex

Despite the widespread use of transcranial magnetic stimulation (TMS) in research and clinical care, the dose-response relations and neurophysiological correlates of modulatory effects remain relatively unexplored. To fill this gap, we studied modulation of visual processing as a function of TMS parameters. Our approach combined electroencephalography (EEG) with application of single pulse TMS to visual cortex as participants performed a motion perception task. During each participants' first visit, motion coherence thresholds, 64-channel visual evoked potentials (VEPs), and TMS resting motor thresholds (RMT) were measured. In second and third visits, single pulse TMS was delivered at one of two latencies, either 30 ms before the onset of motion or at the onset latency of the N2 VEP component derived from the first session. TMS was delivered at 0%, 80%, 100%, or 120% of RMT over the site of N2 peak activity, or at 120% over vertex. Behavioral results demonstrated a significant main effect of TMS timing on accuracy, with better performance when TMS was applied at the N2-Onset timing versus Pre-Onset, as well as a significant interaction, indicating that 80% intensity produced higher accuracy than other conditions at the N2-Onset. TMS effects on the P3 VEP showed reduced amplitudes in the 80% Pre-Onset condition, an increase for the 120% N2-Onset condition, and monotonic amplitude scaling with stimulation intensity. The N2 component was not affected by TMS. These findings reveal the influence of TMS intensity and timing on visual perception and electrophysiological responses, with optimal facilitation at stimulation intensities below RMT.

Pre-attentive dysfunction of processing emotional faces in interictal migraine revealed by expression-related visual mismatch negativity

BACKGROUND

Several investigations have indicated emotional processing impairment in migraineurs, while no report is available considering the automatic processing of emotional information. In this study, we aimed to characterize the pre-attentive processing of facial expressions in migraine sufferers by recording and analyzing expression-related visual mismatch negativity (EMMN).

METHODS

Altogether, 30 migraineurs (19 females) during the interictal period and 30 age-matched healthy controls (17 females) were recruited. An expression-related oddball paradigm was used to investigate automatic emotional processing, and a group of schematic emotional faces (neutral, happy, sad) unrelated to the participant's task were employed in the experiment in order to avoid low-level processing.

RESULTS

There was no significant difference in behavioral performance (the response accuracy and reaction time) between migraine patients and healthy controls. Nevertheless, the mean EMMN amplitudes within the ranges of 150-250 ms and 250-350 ms were markedly attenuated in patients compared with controls, regardless of happy or sad condition (happy minus neutral or sad minus neutral), and sad EMMN was observed to be larger than happy EMMN only in healthy participants. Moreover, these electrophysiological data directly correlated with frequency and duration of migrainous attacks.

CONCLUSIONS

Our findings implied that the pre-attentive dysfunction of processing both happy and sad expressions was demonstrated in interictal migraineurs, without the existence of negative bias (sad superiority) effect. Further studies on the availability of EMMN as an evaluative marker for migraine are warranted.

Dysfunction in Automatic Processing of Emotional Facial Expressions in Patients with Obstructive Sleep Apnea Syndrome: An Event-Related Potential Study

AIM

Obstructive sleep apnea syndrome (OSAS) is a prevalent chronic disease characterized by sleep fragmentation and intermittent hypoxemia. Several studies suggested that electrophysiological changes and neurocognitive abnormalities occurred in OSAS patients. In this study, we compared automatic processing of emotional facial expressions schematic in OSAS patients and matched healthy controls via assessing expression-related mismatch negativity (EMMN).

METHODS

Twenty-two OSAS patients (mean age 44.59 years) and twenty-one healthy controls (mean age 42.71 years) were enrolled in this study. All participants underwent Montreal Cognitive Assessment (MoCA) scale test and polysomnographic recording. An expression-related oddball paradigm was used to elicit EMMN and the electroencephalogram was recorded and analyzed. Furthermore, Pearson's correlations were calculated to discuss the correlation between neuropsychological test scores, clinical variables and electrophysiological data.

RESULTS

Compared with healthy controls, OSAS sufferers demonstrated significantly reduced EMMN mean amplitudes within corresponding time intervals, regardless of happy or sad conditions. Meanwhile, we observed that amplitude of sad EMMN was larger (more negative) than happy EMNN in healthy controls, while not in patients. Moderate correlations were found between MoCA test scores, sleep parameters and EMMN amplitudes.

CONCLUSION

Our findings suggested pre-attentive dysfunction of processing emotional facial expressions in patients with OSAS, without the existence of negative bias effect. Moreover, correlation analysis showed that clinical characteristics of OSAS patients could affect EMMN amplitudes. Further studies on the advantages of EMMN as clinical and electrophysiological indicators of OSAS are warranted.

Sex and Physiological Cycles Affect the Automatic Perception of Attractive Opposite-Sex Faces: A Visual Mismatch Negativity Study

Facial attractiveness plays important roles in social interaction. Electrophysiological and neuroimaging studies found several brain areas to be differentially responsive to attractive relative to unattractive faces. However, little is known about the time course of the information processing, especially under the unattended condition. Based on a "cross-modal delayed response" paradigm, the present study aimed to explore the automatic mechanism of facial attractiveness processing of females with different physiological cycles and males, respectively, through recording the event-related potentials in response to (un)attractive opposite-sex faces by two experiments. The attractiveness-related visual mismatch negativity (attractiveness vMMN) in posterior scalp distribution was recorded in both the experiments, which indicated that attractive faces could be processed automatically. And high-attractive opposite-sex faces can elicit larger vMMN in males than females in menstrual period in Study 1, but similar as females in ovulatory period in Study 2. Furthermore, by comparison, the latency of attractiveness vMMN in females with the ovulatory period was the longest. These results indicated as follows: (1) Males were more sensitive to attractive female faces, (2) females in ovulatory period were also attracted by the attractive male faces, (3) the long vMMN latency in females during ovulatory period suggested a special reproductive motivation to avoid being tainted by genes, which takes priority over the breeding motivation.

Preattentive and Predictive Processing of Visual Motion

Interaction with the environment requires fast and reliable sensory processing. The visual system is confronted with a continuous flow of high-dimensional input (e.g. orientation, color, motion). From a theoretical point of view, it would be advantageous if critical information was processed independent of attentional load, i.e. preattentively. Here, we hypothesized that visual motion is such a critical signal and aimed for a neural signature of its preattentive encoding. Furthermore, we were interested in the neural correlates of predictability of linear motion trajectories based on the presence or absence of preceding motion. We presented a visual oddball paradigm and studied event-related potentials (ERPs). Stimuli were linearly moving Gabor patches that disappeared behind an occluder. The difference between deviant and standard trials was a trajectory change which happened behind the occluder in deviant trials only, inducing a prediction error. As hypothesized, we found a visual mismatch negativity-component over parietal and occipital electrodes. In a further condition, trials without preceding motion were presented in which the patch just appeared from behind the occluder and, hence, was not predictable. We found larger ERP-components for unpredictable stimuli. In summary, our results provide evidence for a preattentive and predictive processing of linear trajectories of visual motion.

Magnocellular Bias in Exogenous Attention to Biologically Salient Stimuli as Revealed by Manipulating Their Luminosity and Color

Exogenous attention is a set of mechanisms that allow us to detect and reorient toward salient events—such as appetitive or aversive—that appear out of the current focus of attention. The nature of these mechanisms, particularly the involvement of the parvocellular and magnocellular visual processing systems, was explored. Thirty-four participants performed a demanding digit categorization task while salient (spiders or S) and neutral (wheels or W) stimuli were presented as distractors under two figure–ground formats: heterochromatic/isoluminant (exclusively processed by the parvocellular system, Par trials) and isochromatic/heteroluminant (preferentially processed by the magnocellular system, Mag trials). This resulted in four conditions: SPar, SMag, WPar, and WMag. Behavioral (RTs and error rates in the task) and electrophysiological (ERPs) indices of exogenous attention were analyzed. Behavior showed greater attentional capture by SMag than by SPar distractors and enhanced modulation of SMag capture as fear of spiders reported by participants increased. ERPs reflected a sequence from magnocellular dominant (P1p, ≃120 msec) to both magnocellular and parvocellular processing (N2p and P2a, ≃200 msec). Importantly, amplitudes in one N2p subcomponent were greater to SMag than to SPar and WMag distractors, indicating greater magnocellular sensitivity to saliency. Taking together, results support a magnocellular bias in exogenous attention toward distractors of any nature during initial processing, a bias that remains in later stages when biologically salient distractors are present.

Preattentive Processing of Numerical Visual Information

Humans can perceive and estimate approximate numerical information, even when accurate counting is impossible e.g., due to short presentation time. If the number of objects to be estimated is small, typically around 1–4 items, observers are able to give very fast and precise judgments with high confidence—an effect that is called subitizing. Due to its speed and effortless nature subitizing has usually been assumed to be preattentive, putting it into the same category as other low level visual features like color or orientation. More recently, however, a number of studies have suggested that subitizing might be dependent on attentional resources. In our current study we investigated the potentially preattentive nature of visual numerical perception in the subitizing range by means of EEG. We presented peripheral, task irrelevant sequences of stimuli consisting of a certain number of circular patches while participants were engaged in a demanding, non-numerical detection task at the fixation point drawing attention away from the number stimuli. Within a sequence of stimuli of a given number of patches (called “standards”) we interspersed some stimuli of different numerosity (“oddballs”). We compared the evoked responses to visually identical stimuli that had been presented in two different conditions, serving as standard in one condition and as oddball in the other. We found significant visual mismatch negativity (vMMN) responses over parieto-occipital electrodes. In addition to the event-related potential (ERP) analysis, we performed a time-frequency analysis (TFA) to investigate whether the vMMN was accompanied by additional oscillatory processes. We found a concurrent increase in evoked theta power of similar strength over both hemispheres. Our results provide clear evidence for a preattentive processing of numerical visual information in the subitizing range.

Visual mismatch negativity: a predictive coding view

An increasing number of studies investigate the visual mismatch negativity (vMMN) or use the vMMN as a tool to probe various aspects of human cognition. This paper reviews the theoretical underpinnings of vMMN in the light of methodological considerations and provides recommendations for measuring and interpreting the vMMN. The following key issues are discussed from the experimentalist's point of view in a predictive coding framework: (1) experimental protocols and procedures to control "refractoriness" effects; (2) methods to control attention; (3) vMMN and veridical perception.

Automatic detection of trustworthiness of the face: a visual mismatch negativity study

Recognizing intentions of strangers from facial cues is crucial in everyday social interactions. Recent studies demonstrated enhanced event-related potential (ERP) responses to untrustworthy compared to trustworthy faces. The aim of the present study was to investigate the electrophysiological correlates of automatic processing of trustworthiness cues in a visual oddball paradigm in two consecutive experimental blocks. In one block, frequent trustworthy (p = 0.9) and rare untrustworthy face stimuli (p = 0.1) were briefly presented on a computer screen with each stimulus consisting of four peripherally positioned faces. In the other block stimuli were presented with reversed probabilities enabling the comparison of ERPs evoked by physically identical deviant and standard stimuli. To avoid attentional effects participants engaged in a central detection task. Analyses of deviant minus standard difference waveforms revealed that deviant untrustworthy but not trustworthy faces elicited the visual mismatch negativity (vMMN) component. The present results indicate that adaptation occurred to repeated unattended trustworthy (but not untrustworthy) faces, i.e., an automatic expectation was elicited towards trustworthiness signals, which was violated by deviant untrustworthy faces. As an evolutionary adaptive mechanism, the observed fast detection of trustworthiness-related social facial cues may serve as the basis of conscious recognition of reliable partners.

Emotion-related visual mismatch responses in schizophrenia: impairments and correlations with emotion recognition

BACKGROUND AND OBJECTIVES

Mismatch negativity (MMN) is an event-related potential (ERP) measure of preattentional sensory processing. While deficits in the auditory MMN are robust electrophysiological findings in schizophrenia, little is known about visual mismatch response and its association with social cognitive functions such as emotion recognition in schizophrenia. Our aim was to study the potential deficit in the visual mismatch response to unexpected facial emotions in schizophrenia and its association with emotion recognition impairments, and to localize the sources of the mismatch signals.

EXPERIMENTAL DESIGN

The sample comprised 24 patients with schizophrenia and 24 healthy control subjects. Controls were matched individually to patients by gender, age, and education. ERPs were recorded using a high-density 128-channel BioSemi amplifier. Mismatch responses to happy and fearful faces were determined in 2 time windows over six regions of interest (ROIs). Emotion recognition performance and its association with the mismatch response were also investigated.

PRINCIPAL OBSERVATIONS

Mismatch signals to both emotional conditions were significantly attenuated in patients compared to controls in central and temporal ROIs. Controls recognized emotions significantly better than patients. The association between overall emotion recognition performance and mismatch response to the happy condition was significant in the 250-360 ms time window in the central ROI. The estimated sources of the mismatch responses for both emotional conditions were localized in frontal regions, where patients showed significantly lower activity.

CONCLUSIONS

Impaired generation of mismatch signals indicate insufficient automatic processing of emotions in patients with schizophrenia, which correlates strongly with decreased emotion recognition.

Unattended and attended visual change detection of motion as indexed by event-related potentials and its behavioral correlates

Visual mismatch negativity (vMMN) is a negative-going component amongst cognitive event-related potentials. It reflects an automatic change-detection process that occurs when an infrequent stimulus is presented that is incongruent with the representation of a frequent (standard) event. In our research we use visual motion (more specifically motion direction changes) to study vMMN. Since movement in the visual field is quite irresistible to our brain, the question in hand is, if the detection of motion direction changes is dependent on attention directed to the stimulus. We present a new continuous whole-display stimulus configuration, where the attention capturing primary task of motion onset detection is in the central part of the visual display and visual oddball sequence on the background. The visual oddball paradigm consisted of 85% standard and 15% deviant events, motion direction change being the deviant. We show that even though the unattended visual oddball sequence does not affect the performance in the demanding behavioral primary task, the differences appearing in that sequence are noticed by our brain and reflected in two distinguishable vMMN components in occipital and parietal scalp locations. When attention is directed toward the visual oddball sequence, we only see different processing of standards and deviants in later time-windows and task-related activity in frontal scalp location. Our results are obtained under strict attention manipulation conditions.

Altered visual information processing systems in bipolar disorder: evidence from visual MMN and P3

Objective: Mismatch negativity (MMN) and P3 are unique ERP components that provide objective indices of human cognitive functions such as short-term memory and prediction. Bipolar disorder (BD) is an endogenous psychiatric disorder characterized by extreme shifts in mood, energy, and ability to function socially. BD patients usually show cognitive dysfunction, and the goal of this study was to access their altered visual information processing via visual MMN (vMMN) and P3 using windmill pattern stimuli.

Methods: Twenty patients with BD and 20 healthy controls matched for age, gender, and handedness participated in this study. Subjects were seated in front of a monitor and listened to a story via earphones. Two types of windmill patterns (standard and deviant) and white circle (target) stimuli were randomly presented on the monitor. All stimuli were presented in random order at 200-ms durations with an 800-ms inter-stimulus interval. Stimuli were presented at 80% (standard), 10% (deviant), and 10% (target) probabilities. The participants were instructed to attend to the story and press a button as soon as possible when the target stimuli were presented. Event-related potentials (ERPs) were recorded throughout the experiment using 128-channel EEG equipment. vMMN was obtained by subtracting standard from deviant stimuli responses, and P3 was evoked from the target stimulus.

Results: Mean reaction times for target stimuli in the BD group were significantly higher than those in the control group. Additionally, mean vMMN-amplitudes and peak P3-amplitudes were significantly lower in the BD group than in controls.

Conclusions: Abnormal vMMN and P3 in patients indicate a deficit of visual information processing in BD, which is consistent with their increased reaction time to visual target stimuli.

Significance: Both bottom-up and top-down visual information processing are likely altered in BD.

Electrophysiological evidence of atypical visual change detection in adults with autism

Although atypical change detection processes have been highlighted in the auditory modality in autism spectrum disorder (ASD), little is known about these processes in the visual modality. The aim of the present study was therefore to investigate visual change detection in adults with ASD, taking into account the salience of change, in order to determine whether this ability is affected in this disorder. Thirteen adults with ASD and 13 controls were presented with a passive visual three stimuli oddball paradigm. The findings revealed atypical visual change processing in ASD. Whereas controls displayed a vMMN in response to deviant and a novelty P3 in response to novel stimuli, patients with ASD displayed a novelty P3 in response to both deviant and novel stimuli. These results thus suggested atypical orientation of attention toward unattended minor changes in ASD that might contribute to the intolerance of change.

Impact of lower- vs. upper-hemifield presentation on automatic colour-deviance detection: a visual mismatch negativity study

The automatic processing of deviances from the temporal context of the visual environment has become an important topic in visual cognitive sciences, which is often investigated using the visual mismatch negativity (vMMN). This event-related potential (ERP) component is elicited by an irregular stimulus (e.g., a red disc) presented in a series of stimuli (e.g., green discs) comprising a temporal regularity (e.g., colour repetition). We determined the influence of lower- vs. upper-hemifield presentation of the irregular stimulus on the vMMN while using whole-field stimulus displays controlling for sustained shifts in spatial attention. Deviances presented in the lower hemifield elicited a larger vMMN than the ones presented in the upper hemifield at a latency of 200-280ms. However, this asymmetry was preceded by deviance-related hemifield effects already emerging at an earlier latency (110-150ms), where upper-hemifield deviances elicited a positive potential but lower-hemifield deviances did not. With variable resolution electromagnetic tomography (VARETA) early deviance-related activity was localised to retinotopically organised regions of the visual cortex (BA 17/18) and vMMN-sources were localised to the middle/superior occipital gyrus, to higher areas along the temporal visual stream, but also to BA 17/18. We argue that the upper/lower-hemifield vMMN asymmetry relies at least partially on the hemifield-dependent differential sensitivity of early deviance-related activity generated in retinotopically organised regions of the visual cortex. However, a superior automatic processing of deviances presented in the lower visual hemifield may also contribute to the effect.

Unintentional temporal context-based prediction of emotional faces: an electrophysiological study

The ability to extract sequential regularities embedded in the temporal context or temporal structure of sensory events and to predict upcoming events based on the extracted sequential regularities plays a central role in human cognition. In the present study, we demonstrate that, without any intention, upcoming emotional faces can be predicted based on sequential regularities, by showing that prediction error responses as reflected by visual mismatch negativity (MMN), an event-related brain potential (ERP) component, were evoked in response to emotional faces that violated a regular alternation pattern of 2 emotional faces (fearful and happy faces) under a situation where the emotional faces themselves were unrelated to the participant's task. Face-inversion and negative-bias effects in the visual MMN further indicated the involvement of holistic face representations. In addition, through successive source analyses of the visual MMN, it was revealed that the prediction error responses were composed of activations mainly in the face-responsible visual extrastriate areas and the prefrontal areas. The present results provide primary evidence for the existence of the unintentional temporal context-based prediction of biologically relevant visual stimuli as well as empirical support for the major engagement of the visual and prefrontal areas in unintentional temporal context-based prediction in vision.

Human Visual System Automatically Encodes Sequential Regularities of Discrete Events

For our adaptive behavior in a dynamically changing environment, an essential task of the brain is to automatically encode sequential regularities inherent in the environment into a memory representation. Recent studies in neuroscience have suggested that sequential regularities embedded in discrete sensory events are automatically encoded into a memory representation at the level of the sensory system. This notion is largely supported by evidence from investigations using auditory mismatch negativity (auditory MMN), an event-related brain potential (ERP) correlate of an automatic memory-mismatch process in the auditory sensory system. However, it is still largely unclear whether or not this notion can be generalized to other sensory modalities. The purpose of the present study was to investigate the contribution of the visual sensory system to the automatic encoding of sequential regularities using visual mismatch negativity (visual MMN), an ERP correlate of an automatic memory-mismatch process in the visual sensory system. To this end, we conducted a sequential analysis of visual MMN in an oddball sequence consisting of infrequent deviant and frequent standard stimuli, and tested whether the underlying memory representation of visual MMN generation contains only a sensory memory trace of standard stimuli (trace-mismatch hypothesis) or whether it also contains sequential regularities extracted from the repetitive standard sequence (regularity-violation hypothesis). The results showed that visual MMN was elicited by first deviant (deviant stimuli following at least one standard stimulus), second deviant (deviant stimuli immediately following first deviant), and first standard (standard stimuli immediately following first deviant), but not by second standard (standard stimuli immediately following first standard). These results are consistent with the regularity-violation hypothesis, suggesting that the visual sensory system automatically encodes sequential regularities. In combination with a wide range of auditory MMN studies, the present study highlights the critical role of sensory systems in automatically encoding sequential regularities when modeling the world.

Cortical dynamics of the visual change detection process

In this study, the cortical dynamics of the visual change detection process were investigated using an oddball paradigm similar to that used in auditory mismatch negativity studies. When subjects watched a silent movie, color stimuli were presented using 280 dual color LEDs arranged along the frame of the video screen. Task-irrelevant red and blue color stimuli were presented randomly at a probability of 10% and 90%, respectively, in one session and vice versa for the other one, and we traced brain responses using magnetoencephalography. Results show that activation in the middle occipital gyrus (MOG) was significantly enhanced for the infrequent stimulus, while early activities in Brodmann's area 17/18 were comparable for the frequent and infrequent stimuli. These results suggest that automatic visual change detection is associated with the MOG activity.

Comparator and non-comparator mechanisms of change detection in the context of speech--an ERP study

Automatic change detection reflects a cognitive memory-based comparison mechanism as well as a sensorial non-comparator mechanism based on differential states of refractoriness. The purpose of this study was to examine whether the comparator mechanism of the mismatch negativity component (MMN) is differentially affected by the lexical status of the deviant. Event-related potential (ERP) data was collected during an "oddball" paradigm designed to elicit the MMN from 15 healthy subjects that were involved in a counting task. Topography pattern analysis and source estimation were utilized to examine the deviance (deviants vs. standards), cognitive (deviants vs. control counterparts) and refractoriness (standards vs. control counterparts) effects elicited by standard-deviant pairs ("deh-day"; "day-deh"; "teh-tay") embedded within "oddball" blocks. Our results showed that when the change was salient regardless of lexical status (i.e., the /e:/ to /eI/ transition) the response tapped the comparator based-mechanism of the MMN which was located in the cuneus/posterior cingulate, reflected sensitivity to the novelty of the auditory object, appeared in the P2 latency range and mainly involved topography modulations. In contrast, when the novelty was low (i.e., the /eI/ to /e:/ transition) an acoustic change complex was elicited which involved strength modulations over the P1/N1 range and implicated the middle temporal gyrus. This result pattern also resembled the one displayed by the non-comparator mechanism. These findings suggest spatially and temporally distinct brain activities of comparator mechanisms of change detection in the context of speech.

Error processing during online motor control depends on the response accuracy

We investigated which brain areas show error-related activity during online motor control while errors occur independently from decision making. During motor tasks, error is a deviation from accuracy or correctness. The effect of the accuracy level on error-related brain activity is unclear. Using functional Magnetic Resonance Imaging (fMRI), we investigated how error-related brain activity, especially in fronto-medial wall areas, depended on motor accuracy (MA). Subjects performed a force tracking task with the thumb-index grip: to continuously follow a moving target on a monitor with a cursor which position was controlled by the force amount produced by the fingers. Task difficulty varied with changes in the cursor size (the smaller the cursor, the more difficult the task). We measured the motor accuracy (mean distance between the cursor center and the target) and the error amount (cursor out of the target). Errors were produced when motor accuracy was low and also when motor accuracy was high. For fMRI data processing, we defined a model based on both the error amount and the motor accuracy. The results showed that supplementary motor area (SMA) and dorsal anterior cingulate cortex (ACC) activation increased with error and task difficulty independent of the accuracy of motor control. Interestingly, activity in the rostral part of left ACC only increased with error when the motor accuracy was low, independently from task difficulty. These results suggest a clear functional dissociation between dorsal and rostral ACC in error processing which depends on the amount of attentional resources allocated to motor accuracy.

Backward masking and visual mismatch negativity: Electrophysiological evidence for memory-based detection of deviant stimuli

Sequences composed of two different colored checkerboard patterns (standard and deviant) were presented to adults. Each pattern was followed by a mask with stimulus onset asynchronies (SOAs) varying between 14 and 174 ms. ERPs were recorded to the deviant and standard stimuli while the participants detected changes of a cross, which was continuously present at the center of the screen. In further experiments, the participants performed a Go-NoGo task detecting the deviant checkerboards. Deviant stimuli elicited an occipital negative component with 124-132 ms mean latency (the visual mismatch negativity, vMMN) at test (standard or deviant)-to-mask SOAs longer than 27 ms. No vMMN amplitude increase was observed beyond 40 ms test-to-mask intervals, whereas detection of deviant checkerboard patterns improved up to 174-ms SOA. Therefore the processes underlying vMMN elicitation cannot fully explain the overt detection of visual deviance.

Hierarchical error processing: Different errors, different systems

Error processing during motor control involves the evaluation of "high-level" errors (i.e., failures to meet a system goal) by a frontal system involving anterior cingulate cortex and the evaluation of "low-level" errors (i.e., discrepancies between actual and desired motor commands) by a posterior system involving posterior parietal cortex. We have recently demonstrated that high-level errors committed within the context of a continuous tracking task elicited an error-related negativity (ERN) -- a component of the event-related brain potential (ERP) generated within medial-frontal cortex that is sensitive to error commission. The purpose of the present study was to demonstrate that low-level motor errors do not elicit an ERN, but may instead evoke other ERP components associated with visual processing and online motor control. Participants performed a computer aiming task in which they manipulated a joystick to move a cursor from a start to a target position. On a random subset of trials the target jumped to a new position at movement onset, requiring the participants to modify their current motor command. Further, on one half of these "target perturbation" trials the cursor did not respond to corrective movements of the joystick. Consistent with our previous findings, we found that the uncorrectable errors elicited an ERN. We also found that the target perturbations on both correctable and uncorrectable trials did not elicit an ERN, but rather evoked two other ERP components, the N100 and P300. These results suggest that medial-frontal cortex is insensitive to low-level motor errors, and are in line with a recent theory that holds that the P300 reflects stimulus-response optimization by the impact of locus coeruleus activity on posterior cortex.

Vertical asymmetries in pre-attentive detection of changes in motion direction

Stimulus localization affects visual motion processing. Vertical asymmetries favouring lower visual field have been reported in event-related potentials (ERPs) and behavioural studies under different attention conditions. However, there are no studies examining such asymmetries to non-attended motion changes. The present study investigated whether the asymmetry in processing information from the upper and lower visual fields also affects the automatic detection of motion-direction changes as indexed by visual Mismatch Negativity (vMMN). We recorded vMMN to changes in sinusoidal gratings differing in motion direction presented in the periphery of visual field in three different locations: upper and lower (ULVF), upper (UVF) and lower (LVF) along the vertical meridian. The N2 component elicited to peripheral motion presented lower amplitudes when the UVF was stimulated. The vMMN elicited to infrequent motion-direction changes was present in all stimulation conditions. However, it was reduced to UVF stimulation. These results suggest that the visual system automatically detects motion-direction changes presented at both upper-lower visual fields; however they also indicate that the process is favoured when stimuli are presented in the LVF alone.

Visual Mismatch Negativity

The visual homolog of the (auditory) mismatch negativity, the vMMN, has already been reviewed ( Pazo-Alvarez, Cadaveira, & Amenedo, 2003 ), but a considerable body of more recent research exists. The present paper concentrates on two crucial issues of vMMN research. These issues are the memory-dependence of the vMMN and the problem of attentive vs. nonattentive processing in vMMN research. While both issues require further clarification, vMMN seems to be a promising index of the nonattentional registration of the violation of environmental rules in the visual word.

Mismatch Negativity

Since its discovery by Näätänen and colleagues in 1978, the mismatch negativity (MMN) has been used as an index of auditory sensory memory. The present paper explicates various possibilities of how MMN can assess memory functions, it reveals possible traps when interpreting MMN as an index of auditory memory, and it reviews recent developments of paradigms showing that memory on a short time-scale, consolidation of memory traces, and even implicit memory can be probed with MMN.

Visual temporal window of integration as revealed by the visual mismatch negativity event-related potential to stimulus omissions

We studied whether, similarly to the auditory modality, short-period temporal integration processes occur in vision. Event-related potentials (ERP) were recorded for occasional stimulus omissions from sequences of patterned visual stimuli. A posterior negative component emerged only when the constant stimulus onset asynchrony (SOA) was shorter than 150 ms. This upper limit is comparable with the duration of the temporal window of integration observed in the auditory modality (including experiments studying the effects of stimulus omissions). Parameters of the posterior negativity were highly similar irrespective of whether the stimuli were task-relevant or not (Experiment 1). Thus, we identified this potential as the visual mismatch negativity (vMMN) component, which reflects task-independent detection of violating regularities of the stimulation. vMMN was followed by an anterior positivity (the P3a), indicating attentional shifts induced by the stimulus omissions. In Experiment 2, a posterior negativity similar to that observed in Experiment 1 emerged after the termination of short trains of stimuli, again only when the SOA was shorter than 150 ms. These results support the notion of a temporal integration window in the visual modality, the duration of which is between 150 and 180 ms.

Probability-independent and -dependent ERPs reflecting visual change detection

In ERP studies, two posterior components with different polarities have been identified as ERP correlates of visual change detection. To compare these components in terms of sensitivity to the preceding stimulus sequence, two peripheral stimuli of different colors (red and blue) were presented with equal (50:50) or different probabilities (20:80 or 80:20), while 12 participants performed shape discrimination at a central location. A posterior positivity at around 90-140 ms was observed with similar amplitude to all stimuli immediately preceded by a different stimulus. In contrast, a posterior negativity at around 140-180 ms was observed to increase in amplitude with increasing number of preceding different stimuli. These results suggest the existence of probability-independent and -dependent change processing in the human visual system. The functional significance is discussed in terms of memory-based comparison and stimulus-specific refractoriness.

Visual distraction: a behavioral and event-related brain potential study in humans

Recent studies reported that the detection of changes in the visual stimulation results in distraction of cognitive processing. From event-related brain potentials it was argued that distraction is triggered by the automatic detection of deviants. We tested whether distraction effects are confined to the detection of a deviation or can be triggered by changes per se, namely by rare stimuli that were not deviant with respect to the stimulation. The results obtained comparable early event-related brain potential effects for rare and deviant stimuli, suggesting an automatic detection of these changes. In contrast, behavioral distraction and attention-related event-related brain potential components were confined to deviant stimuli. This finding suggests that deviancy from a given standard adds a genuine contribution to distraction.

An ERP study of visual change detection: effects of magnitude of spatial frequency changes on the change-related posterior positivity

In event-related brain potential (ERP) studies using a visual S1-S2 matching task, change stimuli elicit a posterior positivity at around 100-200 ms. In the present study, we investigated the effects of magnitude of spatial frequency changes on change-related positivity. Each trial consisted of two sequentially presented stimuli (S1-S2), where S2 was either (1) the same as S1 (i.e., NO-change, p=.40), (2) different from S1 in spatial frequency only (SF-change, .40), (3) different in orientation only (OR-change, .10), or (4) different in both spatial frequency and orientation (BOTH-change, .10). Further, three magnitude conditions (Large, Medium, and Small) were used to examine the effect of the magnitude of the spatial frequency change. Participant's (N=12) task was to respond to S2 with a change in orientation (from vertical to horizontal, or from horizontal to vertical) regardless of the spatial frequency of the stimulus. Changes in the spatial frequency elicited change-related positivity at a latency range of about 120-180 ms, which was followed by a central negativity (N270) and a late positive component (LPC). The amplitude of the change-related positivity tends to be enhanced as the magnitude of the change is increased. These results support the notion that the change-related positivity reflects memory-based change detection in the human visual system.

Positive difference in ERPs reflects independent processing of visual changes

To elucidate the nature of the processing of visual stimulus changes, ERPs were recorded while 12 participants performed an S1-S2 matching task with multifeature stimuli. Each trial consisted of two sequentially presented stimuli (S1-S2), where S2 was either the same as S1, different from S1 only in color, different only in shape, or different in both color and shape. The four trial types were presented in random order with equal probability, and participants responded to one of these types in separate blocks. Relative to the no-change stimuli, the change stimuli elicited posterior positivity with different topography according to changing features ranging from 100 to 180 ms in all tasks. The amplitude and topography of the positivity in response to the both changes were the respective sums of those to changes in the corresponding single features. These results suggest that a feature-specific change detection system exists in the human visual system.