Automatic change detection: Mismatch negativity and the now-classic Rensink, O’Reagan, and Clark (1997) stimuli

Change blindness experiments had demonstrated that detection of significant changes in natural images is extremely difficult when brief blank fields are placed between alternating displays of an original and a modified scene. On the other hand, research on the visual mismatch negativity (vMMN) component of the event-related potentials (ERPs) identified sensitivity to events (deviants) different from the regularity of stimulus sequences (standards), even if the deviant and standard events are non-attended. The present study sought to investigate the apparent controversy between the experience under the change blindness paradigm and the ERP results. To this end, the stimulus of Rensink, O’Reagen, and Clark (1997) was adapted to a passive oddball ERP paradigm to investigate the underlying processing differences between the standard (original) and deviant (altered) stimuli measured in 22 subjects. Posterior negativity within the 280–330 ms latency range emerged as the difference between ERPs elicited by standard and deviant stimuli, identified as visual mismatch negativity (vMMN). These results raise the possibility that change blindness is not based on the lack of detailed visual representations or the deficiency of comparing two representations. However, effective discrimination of the two scene versions requires considerable frequency differences between them.

Implicit Detection Observation in Different Features, Exposure Duration, and Delay During Change Blindness

To investigate whether implicit detection occurs uniformly during change blindness with single or combination feature stimuli, and whether implicit detection is affected by exposure duration and delay, two one-shot change detection experiments are designed. The implicit detection effect is measured by comparing the reaction times (RTs) of baseline trials, in which stimulus exhibits no change and participants report “same,” and change blindness trials, in which the stimulus exhibits a change but participants report “same.” If the RTs of blindness trials are longer than those of baseline trials, implicit detection has occurred. The strength of the implicit detection effect was measured by the difference in RTs between the baseline and change blindness trials, where the larger the difference, the stronger the implicit detection effect. In both Experiments 1 and 2, the results showed that the RTs of change blindness trials were significantly longer than those of baseline trials. Whether under set size 4, 6, or 8, the RTs of the change blindness trials were significantly longer than those in the baseline trials. In Experiment 1, the difference between the baseline trials’ RTs and change blindness trials’ RTs of the single features was significantly larger than that of the combination features. However, in Experiment 2, the difference between the baseline trials’ RTs and the change blindness trials’ RTs of single features was significantly smaller than that of the combination features. In Experiment 1a, when the exposure duration was shorter, the difference between the baseline and change blindness trials’ RTs was smaller. In Experiment 2, when the delay was longer, the difference between the two trials’ RTs was larger. These results suggest that regardless of whether the change occurs in a single or a combination of features and whether there is a long exposure duration or delay, implicit detection occurs uniformly during the change blindness period. Moreover, longer exposure durations and delays strengthen the implicit detection effect. Set sizes had no significant impact on implicit detection.

Phasic and sustained interactions of multisensory interplay and temporal expectation

Every moment organisms are confronted with complex streams of information which they use to generate a reliable mental model of the world. There is converging evidence for several optimization mechanisms instrumental in integrating (or segregating) incoming information; among them are multisensory interplay (MSI) and temporal expectation (TE). Both mechanisms can account for enhanced perceptual sensitivity and are well studied in isolation; how these two mechanisms interact is currently less well-known. Here, we tested in a series of four psychophysical experiments for TE effects in uni- and multisensory contexts with different levels of modality-related and spatial uncertainty. We found that TE enhanced perceptual sensitivity for the multisensory relative to the best unisensory condition (i.e. multisensory facilitation according to the max-criterion). In the latter TE effects even vanished if stimulus-related spatial uncertainty was increased. Accordingly, computational modelling indicated that TE, modality-related and spatial uncertainty predict multisensory facilitation. Finally, the analysis of stimulus history revealed that matching expectation at trial n-1 selectively improves multisensory performance irrespective of stimulus-related uncertainty. Together, our results indicate that benefits of multisensory stimulation are enhanced by TE especially in noisy environments, which allows for more robust information extraction to boost performance on both short and sustained time ranges.

The signature of undetected change: an exploratory electrotomographic investigation of gradual change blindness

Neuroimaging-based investigations of change blindness, a phenomenon in which seemingly obvious changes in visual scenes fail to be detected, have significantly advanced our understanding of visual awareness. The vast majority of prior investigations, however, utilize paradigms involving visual disruptions (e.g., intervening blank screens, saccadic movements, "mudsplashes"), making it difficult to isolate neural responses toward visual changes cleanly. To address this issue in this present study, high-density EEG data (256 channel) were collected from 25 participants using a paradigm in which visual changes were progressively introduced into detailed real-world scenes without the use of visual disruption. Oscillatory activity associated with undetected changes was contrasted with activity linked to their absence using standardized low-resolution brain electromagnetic tomography (sLORETA). Although an insufficient number of detections were present to allow for analysis of actual change detection, increased beta-2 activity in the right inferior parietal lobule (rIPL), a region repeatedly associated with change blindness in disruption paradigms, followed by increased theta activity in the right superior temporal gyrus (rSTG) was noted in undetected visual change responses relative to the absence of change. We propose the rIPL beta-2 activity to be associated with orienting attention toward visual changes, with the subsequent rise in rSTG theta activity being potentially linked with updating preconscious perceptual memory representations. NEW & NOTEWORTHY This study represents the first neuroimaging-based investigation of gradual change blindness, a visual phenomenon that has significant potential to shed light on the processes underlying visual detection and conscious perception. The use of gradual change materials is reflective of real-world visual phenomena and allows for cleaner isolation of signals associated with the neural registration of change relative to the use of abrupt change transients.

The role of multisensory interplay in enabling temporal expectations

Temporal regularities can guide our attention to focus on a particular moment in time and to be especially vigilant just then. Previous research provided evidence for the influence of temporal expectation on perceptual processing in unisensory auditory, visual, and tactile contexts. However, in real life we are often exposed to a complex and continuous stream of multisensory events. Here we tested - in a series of experiments - whether temporal expectations can enhance perception in multisensory contexts and whether this enhancement differs from enhancements in unisensory contexts. Our discrimination paradigm contained near-threshold targets (subject-specific 75% discrimination accuracy) embedded in a sequence of distractors. The likelihood of target occurrence (early or late) was manipulated block-wise. Furthermore, we tested whether spatial and modality-specific target uncertainty (i.e. predictable vs. unpredictable target position or modality) would affect temporal expectation (TE) measured with perceptual sensitivity (d^') and response times (RT). In all our experiments, hidden temporal regularities improved performance for expected multisensory targets. Moreover, multisensory performance was unaffected by spatial and modality-specific uncertainty, whereas unisensory TE effects on d^' but not RT were modulated by spatial and modality-specific uncertainty. Additionally, the size of the temporal expectation effect, i.e. the increase in perceptual sensitivity and decrease of RT, scaled linearly with the likelihood of expected targets. Finally, temporal expectation effects were unaffected by varying target position within the stream. Together, our results strongly suggest that participants quickly adapt to novel temporal contexts, that they benefit from multisensory (relative to unisensory) stimulation and that multisensory benefits are maximal if the stimulus-driven uncertainty is highest. We propose that enhanced informational content (i.e. multisensory stimulation) enables the robust extraction of temporal regularities which in turn boost (uni-)sensory representations.