Automatic change detection in vision: Adaptation, memory mismatch, or both? II: Oddball and adaptation effects on event-related potentials

Automatic Change Detection in Interwoven Sequences: A Visual Mismatch Negativity Study

In this study, we investigated whether the cognitive system, known to be able to register regular visual event sequences and the violation of these sequences automatically, had the capacity of processing two sequences simultaneously. To this end, we measured the visual mismatch negativity (vMMN) component of ERPs as interwoven event sequences simultaneously presented to the left and right side of the screen. One of the sequences consisted of geometric patterns (diamonds); the other, photographs of human faces. In successive cycles, parts of the stimuli vanished and then re-appeared (the OFF/ON method). The vanishing parts served as either standard (frequently vanishing parts) or infrequent (deviant) events, but these events were task-irrelevant. The 20 adult participants (age 21.40 ± 2.72 years) performed a visual tracking task, with the OFF/ON task being a passive oddball paradigm. According to the results, both OFF and ON events, and both diamond and face stimuli elicited the vMMN component, showing that the system underlying this activity is capable of processing two event sequences if the sequences consist of fairly different kind of objects as stimuli. The sLORETA analysis showed that the source of vMMN was more frequent contralaterally to the deviant event, and the sources comprised loci from ventral and dorsal structures, as well as some anterior loci.

A comparison of visual and acoustic mismatch negativity as potential biomarkers in schizophrenia

Mismatch negativity (MMN) is an event-related potential (ERP) component generated when an unexpected deviant stimulus occurs in a pattern of standard stimuli. Several studies showed that the MMN response to both auditory and visual stimuli is attenuated in schizophrenia. While previous studies investigated auditory and visual MMN in different cohorts, here we examined the potential clinical utility of MMN responses to auditory and visual stimuli within the same group of patients. Altogether 39 patients with schizophrenia and 39 healthy controls matched in age, gender, and education were enrolled. We recorded EEG using 64 channels in eight experimental blocks where we presented auditory and visual stimulus sequences. Mismatch responses were obtained by subtracting responses to standard from the physically identical deviant stimuli. We found a significant MMN response to the acoustic stimuli in the control group, whereas no significant mismatch response was observed in the patient group. The group difference was significant for the acoustic stimuli. The 12 vane windmill pattern evoked a significant MMN response in the early time window in the control group but not in the patient group. The 6 vane windmill pattern evoked MMN only in the patient group. However, we found no significant difference between the groups. Furthermore, we found no correlation between the clinical variables and the MMN amplitudes. Our results suggest that predictive processes underlying mismatch generation in patients with schizophrenia may be more affected in the acoustic compared to the visual domain. Acoustic MMN tends to be a more promising biomarker in schizophrenia.

The effect of hand motion and object orientation on the automatic detection of orientation: A visual mismatch negativity study

We investigated the effects of voluntary hand movements and continuously present objects on the automatic detection of deviant stimuli in a passive oddball paradigm. The visual mismatch negativity (vMMN) component of event-related potentials (ERPs) was measured as the index of automatic deviant detection. The stimuli were textures consisting of parallel, oblique bars with frequent (standard) and infrequent (deviant) orientation. Traditional vMMN was measured by the difference between ERPs to frequent (standard) and infrequent (deviant) textures. Additionally, we measured 'genuine' vMMN by comparing the ERPs to deviant and control textures in the equal probability procedure. Compatible and incompatible hand movement directions to the standard texture had no influence on 'traditional' vMMN and elicited no 'genuine' vMMN. However, the deviant texture elicited 'genuine' vMMN if the orientation of a continuously present rectangle was different from the standard (and identical to the deviant) texture orientation. Our results suggest that the direction of voluntary hand movement and the orientation of task-irrelevant visual patterns do not acquire common memory representation, but a continuously present object contributes to the detection of sequential regularity violation.

Visual mismatch negativity and stimulus-specific adaptation: the role of stimulus complexity

The present study investigated the function of the brain activity underlying the visual mismatch negativity (vMMN) event-related potential (ERP) component. Snowflake patterns (complex stimuli) were presented as deviants and oblique bar patterns (simple stimuli) as standards, and vice versa in a passive oddball paradigm. Control (equiprobable) sequences of either complex shape patterns or oblique bar patterns with various orientations were also presented. VMMN appeared as the difference between the ERP to the oddball deviant and the ERP to the control (deviant minus control ERP difference). Apart from the shorter latency of the vMMN to the oblique bar pattern as deviant, vMMN to both deviants was similar, i.e., there was no amplitude difference. We attributed the function of the brain processes underlying vMMN to the detection of the infrequent stimulus type (also represented in memory) instead of a call for further processing (a possibility for acquiring more precise representation) of the deviant. An unexpected larger adaptation (control minus standard ERP difference) to the snowflake pattern was also obtained. We suggest that this was due to the acquisition of a more elaborate memory representation of the more complex stimulus.

Visual mismatch negativity indicates automatic, task-independent detection of artistic image composition in abstract artworks

In complex abstract art, image composition (i.e., the artist's deliberate arrangement of pictorial elements) is an important aesthetic feature. We investigated whether the human brain detects image composition in abstract artworks automatically (i.e., independently of the experimental task). To this aim, we studied whether a group of 20 original artworks elicited a visual mismatch negativity when contrasted with a group of 20 images that were composed of the same pictorial elements as the originals, but in shuffled arrangements, which destroy artistic composition. We used a passive oddball paradigm with parallel electroencephalogram recordings to investigate the detection of image type-specific properties. We observed significant deviant-standard differences for the shuffled and original images, respectively. Furthermore, for both types of images, differences in amplitudes correlated with the behavioral ratings of the images. In conclusion, we show that the human brain can detect composition-related image properties in visual artworks in an automatic fashion.