Effects of discrepancy between imagined and perceived sounds on the N2 component of the event-related potential

Distinct Patterns of Automatic and Controlled Incongruent Information Processing in the Human Brain

It is a fundamental ability to discriminate incongruent information in daily activity. However, the underlying neural dynamics are still unclear. Using stereoelectroencephalography (SEEG), in this study, we investigated the fine-grained and different states of incongruent information processing in patients with refractory epilepsy who underwent intracranial electrode implantation. All patients performed a delayed match-to-sample paradigm in the sequential pairs of visual stimuli (S1 followed by S2). Participants were asked to discriminate whether the relevant feature of S2 was identical to S1 while ignoring the irrelevant feature. The spatiotemporal cortical responses evoked by different conditions were calculated and compared, respectively, in the context of brain intrinsic functional networks. In total, we obtained SEEG recordings from 241 contacts in gray matter. In the processing of irrelevant incongruent information, the activated brain areas included the superior parietal lobule, supramarginal gyrus, angular gyrus, inferior temporal gyrus, and fusiform gyrus. By comparing the relevant incongruent condition with the congruent condition, the activated brain areas included the middle frontal gyrus, superior temporal gyrus, middle temporal gyrus, posterior superior temporal sulcus, and posterior cingulate cortex. We demonstrated the dynamics of incongruent information processing with high spatiotemporal resolution and suggested that the process of automatic detection of irrelevant incongruent information requires the involvement of local regions and relatively few networks. Meanwhile, controlled discrimination of relevant incongruent information requires the participation of extensive regions and a wide range of nodes in the network. Furthermore, both the frontoparietal control network and default mode network were engaged in the incongruent information processing.

Using event related potentials to identify a user's behavioural intention aroused by product form design

The capacity of product form to arouse user's behavioural intention plays a decisive role in further user experience, even in purchase decision, while traditional methods rarely give a fully understanding of user experience evoked by product form, especially the feeling of anticipated use of product. Behavioural intention aroused by product form designs has not yet been investigated electrophysiologically. Hence event related potentials (ERPs) were applied to explore the process of behavioural intention when users browsed different smart phone form designs with brand and price not taken into account for mainly studying the brain activity evoked by variety of product forms. Smart phone pictures with different anticipated user experience were displayed with equiprobability randomly. Participants were asked to click the left mouse button when certain picture gave them a feeling of behavioural intention to interact with. The brain signal of each participant was recorded by Curry 7.0. The results show that pictures with an ability to arouse participants' behavioural intention for further experience can evoke enhanced N300 and LPPs (late positive potentials) in central-parietal, parietal and occipital regions. The scalp topography shows that central-parietal, parietal and occipital regions are more activated. The results indicate that the discrepancy of ERPs can reflect the neural activities of behavioural intention formed or not. Moreover, amplitude of ERPs occurred in corresponding brain areas can be used to measure user experience. The exploring of neural correlated with behavioural intention provide an accurate measurement method of user's perception and help marketers to know which product can arouse users' behavioural intention, maybe taken as an evaluating indicator of product design.

The effects of visual imagery on face identification: an ERP study

The present study tested the hypothesis that the effects of mental imagery on subsequent perception occur at a later matching stage in perceptual identification, but not in the early perceptual stage as in perceptual detection. The behavioral results suggested that the effect of visual imagery on visual identification is content-specific, i.e., imagining a congruent face facilitates face identification, whereas a mismatch between imagery and perception leads to an interference effect. More importantly, the ERP results revealed that a more negative N2 response to the subsequent visual face stimuli was elicited over fronto-central sites in the mismatch and no-imagery conditions as compared to that in the match condition, with the early P1 and N170 components independent of manipulations. The latency and distribution of the neural effects demonstrate that the matching step, but not the earlier perceptual process, is affected by the preceding visual imagery in the context of face identification. We discuss these results in a broader context that the imagery-perception interaction may depend on task demand.

Processing of audiovisual associations in the human brain: dependency on expectations and rule complexity

In order to respond to environmental changes appropriately, the human brain must not only be able to detect environmental changes but also to form expectations of forthcoming events. The events in the external environment often have a number of multisensory features such as pitch and form. For integrated percepts of objects and events, crossmodal processing, and crossmodally induced expectations of forthcoming events are needed. The aim of the present study was to determine whether the expectations created by visual stimuli can modulate the deviance detection in the auditory modality, as reflected by auditory event-related potentials (ERPs). Additionally, it was studied whether the complexity of the rules linking auditory and visual stimuli together affects this process. The N2 deflection of the ERP was observed in response to violations in the subjects’ expectation of a forthcoming tone. Both temporal aspects and cognitive demands during the audiovisual deviance detection task modulated the brain processes involved.

Pitch and loudness information encoded in auditory imagery as revealed by event-related potentials

Two experiments using the ERP method and a task that involved comparing an imagined-S1 (the first stimulus) with a perceived-S2 (the second stimulus) were conducted to investigate whether imagined auditory representations encode pitch and loudness information. It was found that the amplitude of the imagery-related late positive complex (LPC) decreased with pitch but increased with loudness of the imagined sound, which was consistent with amplitude modulations of the auditory perception-related N1 component, thereby providing the first neural evidence that auditory imagery encodes perceptual attributes of auditory experiences.