Beyond the real world: attention debates in auditory mismatch negativity

Measuring Task-Related Brain Activity With Event-Related Potentials in Dynamic Task Scenario With Immersive Virtual Reality Environment

Measurement of event-related potentials (ERPs) in simulated and real environments is advantageous for understanding cognition and behavior during practice of goal-directed activities. Recently, instead of using task-irrelevant “probe stimuli” to elicit ERPs, extraction of ERPs directly from events that occur in simulated and real environments has drawn increased attention. Among the previous ERP studies using immersive virtual reality, only a few cases elicited ERPs from task-related events in dynamic task settings. Furthermore, as far as we surveyed, there were no studies that examined the source of ERPs or correlation between ERPs and behavioral performance in 360-degree immersive virtual reality using head-mounted display. In this study, EEG signals were recorded from 16 participants while they were playing the first-person shooter game with immersive virtual reality environment. Error related negativity (ERN) and correct-(response)-related negativity (CRN) elicited by shooting-related events were successfully extracted. We found the ERN amplitudes to be correlated with the individual shooting performance. Interestingly, the main source of the ERN was the rostral anterior cingulate cortex (ACC), which is different from previous studies where the signal source was often estimated to be the more caudal part of ACC. The obtained results are expected to contribute to the evaluation of cognitive functions and behavioral performance by ERPs in a simulated environment.

Involuntary Attention Restoration During Exposure to Mobile-Based 360° Virtual Nature in Healthy Adults With Different Levels of Restorative Experience: Event-Related Potential Study

BACKGROUND

With the global trend of urbanization, there are increasing reports of a possible association between decreased exposure to nature and increased occurrence of mental disorders. New 360° virtual reality (VR) technology using smartphones and portable VR glasses can overcome spatial and temporal limitations to help people deal with mental fatigue in everyday life.

OBJECTIVE

On the basis of attention restoration theory (ART), this study aimed to investigate whether the amplitude of the mismatch negativity (MMN)/P3a complex could act as an event-related potential (ERP) biomarker of involuntary attention restoration during exposure to 360° virtual nature in healthy young adults with different levels of restorative VR experience.

METHODS

A total of 40 healthy adults completed prequestionnaires on demographics and simulator sickness and postquestionnaires on simulator sickness and perceived restorativeness before and after exposure to virtual nature, respectively. During the VR exposure, brain activity was measured by electroencephalography as participants were asked to conduct a 2-tone passive auditory oddball task.

RESULTS

The amplitude and latency of the MMN/P3a complex were compared between individuals reporting a highly restorative experience and those reporting a less restorative experience. Although viewing a virtual nature environment, the high restorative group (N=19) exhibited significantly reduced P3a amplitudes compared with the low restorative group (N=20; t₃₈=2.57; P=.02; d=0.59). Particularly, a moderate but significant negative correlation was found between the self-reported restorativeness scores and the P3a amplitudes at the fronto-central region (r=-.38; P=.02). However, the latency of the MMN/P3a complex did not significantly differ between the 2 groups (auditory mismatch negativity: t₃₈=-1.47; P=.15 and P3a: t₃₈=-0.31; P=.76).

CONCLUSIONS

Considering individuals' restorative experience, the amplitude of the fronto-central MMN/P3a complex can potentially be employed as a distinct ERP component of interest in involuntary attention restoration during virtual nature experience in healthy young adults. The findings for the 360° virtual nature experience seem to be consistent with those of previous ERP studies on the effects of meditation practice. This study extends the findings of previous ART and ERP studies of real-world meditation, restoration, and mental fatigue management into the virtual world created by mobile phone-based VR glasses and 360° video content.