EEG in motion: Using an oddball task to explore motor interference in active skateboarding

The moving wave: Applications of the mobile EEG approach to study human attention

Although historically confined to traditional research laboratories, electroencephalography (EEG) paradigms are now being applied to study a wide array of behaviors, from daily activities to specialized tasks in diverse fields such as sports science, neurorehabilitation, and education. This transition from traditional to real-world mobile research can provide new tools for understanding attentional processes as they occur naturally. Early mobile EEG research has made progress, despite the large size and wired connections. Recent developments in hardware and software have expanded the possibilities of mobile EEG, enabling a broader range of applications. Despite these advancements, limitations influencing mobile EEG remain that must be overcome to achieve adequate reliability and validity. In this review, we first assess the feasibility of mobile paradigms, including electrode selection, artifact correction techniques, and methodological considerations. This review underscores the importance of ecological, construct, and predictive validity in ensuring the trustworthiness and applicability of mobile EEG findings. Second, we explore studies on attention in naturalistic settings, focusing on replicating classic P3 component studies in mobile paradigms like stationary biking in our lab, and activities such as walking, cycling, and dual-tasking outside of the lab. We emphasize how the mobile approach complements traditional laboratory paradigms and the types of insights gained in naturalistic research settings. Third, we discuss promising applications of portable EEG in workplace safety and other areas including road safety, rehabilitation medicine, and brain-computer interfaces. In summary, this review explores the expanding possibilities of mobile EEG while recognizing the existing challenges in fully realizing its potential.

Mobile EEG for the study of cognitive-motor interference during swimming?

Research on brain function in natural environments has become a new interest in cognitive science. In this study, we aim to advance mobile electroencephalography (EEG) participant and device mobility. We investigated the feasibility of measuring human brain activity using mobile EEG during a full-body motion task as swimming, by the example of cognitive-motor interference (CMI). Eleven participants were given an auditory oddball task while sitting and swimming, with mobile EEG recording ongoing brain activity. Measures of interest were event-related potentials (ERPs) elicited by experimental stimuli. While the auditory N100 was measured to verify signal quality, the P300 to task-relevant stimuli served as a marker of CMI effects. Analyzes were first performed within subjects, while binomial tests assessed the proportion of significant effects. Event-related changes in the time-frequency domain around turns during swimming were analyzed in an exploratory fashion. The successful recording of the N100 in all conditions shows that the setup was functional throughout the experiment. Regarding CMI, we did not find reliable changes in P300 amplitude in different motor settings in all subjects. However, we found plausible modulations in the alpha/mu and beta bands before and after turns. This study shows that it is generally feasible to measure mobile EEG in the time and time-frequency domain in an aquatic environment while subjects are freely moving. We see promising potential in the use of mobile EEG in extreme settings, advancing toward the application of mobile EEG in more real-life situations.

Recording Neural Reward Signals in a Naturalistic Operant Task Using Mobile-EEG and Augmented Reality

The electrophysiological response to rewards recorded during laboratory tasks has been well documented, yet little is known about the neural response patterns in a more naturalistic setting. Here, we combined a mobile-EEG system with an augmented reality headset to record event-related brain potentials (ERPs) while participants engaged in a naturalistic operant task to find rewards. Twenty-five participants were asked to navigate toward a west or east goal location marked by floating orbs, and once participants reached the goal location, the orb would then signify a reward (5 cents) or no-reward (0 cents) outcome. Following the outcome, participants returned to a start location marked by floating purple rings, and once standing in the middle, a 3 s counter signaled the next trial, for a total of 200 trials. Consistent with previous research, reward feedback evoked the reward positivity, an ERP component believed to index the sensitivity of the anterior cingulate cortex to reward prediction error signals. The reward positivity peaked ∼230 ms with a maximal at channel FCz (M = -0.695 μV, ±0.23) and was significantly different than zero (p < 0.01). Participants took ∼3.38 s to reach the goal location and exhibited a general lose-shift (68.3% ±3.5) response strategy and posterror slowing. Overall, these novel findings provide support for the idea that combining mobile-EEG with augmented reality technology is a feasible solution to enhance the ecological validity of human electrophysiological studies of goal-directed behavior and a step toward a new era of human cognitive neuroscience research that blurs the line between laboratory and reality.

Shredding artifacts: extracting brain activity in EEG from extreme artifacts during skateboarding using ASR and ICA

Introduction

To understand brain function in natural real-world settings, it is crucial to acquire brain activity data in noisy environments with diverse artifacts. Electroencephalography (EEG), while susceptible to environmental and physiological artifacts, can be cleaned using advanced signal processing techniques like Artifact Subspace Reconstruction (ASR) and Independent Component Analysis (ICA). This study aims to demonstrate that ASR and ICA can effectively extract brain activity from the substantial artifacts occurring while skateboarding on a half-pipe ramp.

Methods

A dual-task paradigm was used, where subjects were presented with auditory stimuli during skateboarding and rest conditions. The effectiveness of ASR and ICA in cleaning artifacts was evaluated using a support vector machine to classify the presence or absence of a sound stimulus in single-trial EEG data. The study evaluated the effectiveness of ASR and ICA in artifact cleaning using five different pipelines: (1) Minimal cleaning (bandpass filtering), (2) ASR only, (3) ICA only, (4) ICA followed by ASR (ICAASR), and (5) ASR preceding ICA (ASRICA). Three skateboarders participated in the experiment.

Results

Results showed that all ICA-containing pipelines, especially ASRICA (69%, 68%, 63%), outperformed minimal cleaning (55%, 52%, 50%) in single-trial classification during skateboarding. The ASRICA pipeline performed significantly better than other pipelines containing ICA for two of the three subjects, with no other pipeline performing better than ASRICA. The superior performance of ASRICA likely results from ASR removing non-stationary artifacts, enhancing ICA decomposition. Evidenced by ASRICA identifying more brain components via ICLabel than ICA alone or ICAASR for all subjects. For the rest condition, with fewer artifacts, the ASRICA pipeline (71%, 82%, 75%) showed slight improvement over minimal cleaning (73%, 70%, 72%), performing significantly better for two subjects.

Discussion

This study demonstrates that ASRICA can effectively clean artifacts to extract single-trial brain activity during skateboarding. These findings affirm the feasibility of recording brain activity during physically demanding tasks involving substantial body movement, laying the groundwork for future research into the neural processes governing complex and coordinated body movements.

Investigating cognitive-motor effects during slacklining using mobile EEG

Balancing is a very important skill, supporting many daily life activities. Cognitive-motor interference (CMI) dual-tasking paradigms have been established to identify the cognitive load of complex natural motor tasks, such as running and cycling. Here we used wireless, smartphone-recorded electroencephalography (EEG) and motion sensors while participants were either standing on firm ground or on a slackline, either performing an auditory oddball task (dual-task condition) or no task simultaneously (single-task condition). We expected a reduced amplitude and increased latency of the P3 event-related potential (ERP) component to target sounds for the complex balancing compared to the standing on ground condition, and a further decrease in the dual-task compared to the single-task balancing condition. Further, we expected greater postural sway during slacklining while performing the concurrent auditory attention task. Twenty young, experienced slackliners performed an auditory oddball task, silently counting rare target tones presented in a series of frequently occurring standard tones. Results revealed similar P3 topographies and morphologies during both movement conditions. Contrary to our predictions we observed neither significantly reduced P3 amplitudes, nor significantly increased latencies during slacklining. Unexpectedly, we found greater postural sway during slacklining with no additional task compared to dual-tasking. Further, we found a significant correlation between the participant's skill level and P3 latency, but not between skill level and P3 amplitude or postural sway. This pattern of results indicates an interference effect for less skilled individuals, whereas individuals with a high skill level may have shown a facilitation effect. Our study adds to the growing field of research demonstrating that ERPs obtained in uncontrolled, daily-life situations can provide meaningful results. We argue that the individual CMI effects on the P3 ERP reflects how demanding the balancing task is for untrained individuals, which draws on limited resources that are otherwise available for auditory attention processing. In future work, the analysis of concurrently recorded motion-sensor signals will help to identify the cognitive demands of motor tasks executed in natural, uncontrolled environments.

Reduced occipital alpha power marks a movement induced state change that facilitates creative thinking

Walking and minimized movement restriction has a positive effect on creativity, such as divergent thinking. Walking is further known to reduce occipital alpha activity. We used mobile EEG during free and restricted movement, while subjects (N = 23) solved a Guilford's alternate uses test, to understand if occipital alpha power is also affected by movement restriction and if it is a neural marker for creativity. We found that, independent of the task, relative occipital alpha power was higher during movement restriction and showed a negative relationship with creativity scores even though the task was purely based on auditory information. Alpha lateralization was only modulated during the task related think-time (mainly during sitting) and showed a positive relationship with creativity scores but no correlation with the relative alpha power. This indicates that the ongoing alpha power and alpha lateralization mark two independent processes. Overall, our work shows that movement and movement restriction leads to a general change in state which affects cognitive processes. Specifically, limiting one's movements e.g. due to sitting and fixating on a screen can introduce a state of increased occipital alpha power and lowered creativity.

Virtual Reality Sickness Reduces Attention During Immersive Experiences

In this paper, we show that Virtual Reality (VR) sickness is associated with a reduction in attention, which was detected with the P3b Event-Related Potential (ERP) component from electroencephalography (EEG) measurements collected in a dual-task paradigm. We hypothesized that sickness symptoms such as nausea, eyestrain, and fatigue would reduce the users' capacity to pay attention to tasks completed in a virtual environment, and that this reduction in attention would be dynamically reflected in a decrease of the P3b amplitude while VR sickness was experienced. In a user study, participants were taken on a tour through a museum in VR along paths with varying amounts of rotation, shown previously to cause different levels of VR sickness. While paying attention to the virtual museum (the primary task), participants were asked to silently count tones of a different frequency (the secondary task). Control measurements for comparison against the VR sickness conditions were taken when the users were not wearing the Head-Mounted Display (HMD) and while they were immersed in VR but not moving through the environment. This exploratory study shows, across multiple analyses, that the effect mean amplitude of the P3b collected during the task is associated with both sickness severity measured after the task with a questionnaire (SSQ) and with the number of counting errors on the secondary task. Thus, VR sickness may impair attention and task performance, and these changes in attention can be tracked with ERP measures as they happen, without asking participants to assess their sickness symptoms in the moment.

Recording neural reward signals in the real-world using mobile-EEG and augmented reality

The electrophysiological response to rewards recorded during laboratory-based tasks has been well documented over the past two decades, yet little is known about the neural response patterns in 'real-world' settings. To address this issue, we combined a mobile-EEG system with an augmented reality headset (which blends high definition "holograms" within the real-world) to record event-related brain potentials (ERP) while participants navigated an operant chamber to find rewards. 25 participants (age = 18-43, Male=6, Female=19) were asked to choose between two floating holograms marking a west or east goal-location in a large room, and once participants reached the goal location, the hologram would turn into a reward (5 cents) or no-reward (0 cents) cue. Following the feedback cue, participants were required to return to a hologram marking the start location, and once standing in it, a 3 second counter hologram would initiate the next trial. This sequence was repeated until participants completed 200 trials. Consistent with previous research, reward feedback evoked the reward positivity, an ERP component believed to index the sensitivity of the anterior cingulate cortex to reward prediction error signals. The reward positivity peaked around 235ms post-feedback with a maximal at channel FCz (M=-2.60μV, SD=1.73μV) and was significantly different than zero (p < 0.01). At a behavioral level, participants took approximately 3.38 seconds to reach the goal-location and exhibited a general lose-shift (68.3% ± 3.5) response strategy and were slightly slower to return to the start location following negative feedback (2.43 sec) compared to positive feedback (2.38 sec), evidence of post-error slowing. Overall, these findings provide the first evidence that combining mobile-EEG with augmented reality technology is a feasible solution to enhance the ecological validity of human electrophysiological studies of goal-directed behavior and a step towards a new era of human cognitive neuroscience research that blurs the line between laboratory and reality.

Mental Fatigue-Associated Decrease in Table Tennis Performance: Is There an Electrophysiological Signature?

Mental fatigue (MF) is a psychobiological state negatively impacting both cognitive and physical performance. Although recent research implies that some table tennis (TT) performance outcomes are impaired by MF, open skill sports such as TT require a more detailed overview of MF-related performance decrements. Moreover, research into MF and sport-specific psychomotor performance lacks the inclusion of brain-related measurements to identify MF mechanisms. Eleven experienced TT players participated in this randomized counterbalanced crossover trial. Participants were either required to perform an individualized Stroop task (MF condition) or watch a documentary (control condition). The primary outcomes were reaction time on a sport-specific visuomotor task and EEG activity throughout the trial. The subjective feeling of MF was significantly different between both conditions and confirmed that the MF condition induced the mentally fatigue state of participants (p < 0.001), though no behavioral indicators (i.e., decrease in performance on Stroop and flanker task) of MF. MF worsened reaction time on the visuomotor task, while other secondary measurements remained largely ambiguous. Spectral power (i.e., decreases in upper α band and θ band) was influenced by MF, while ERPs measured during the visuomotor task remained unaltered. The present study confirms that MF negatively impacts table tennis performance, specifically inhibitory stimuli during the visuomotor task. These findings also further augment our understanding of the effects of MF on human performance.

Time to move: Brain dynamics underlying natural action and cognition

Advances in Mobile Brain/Body Imaging (MoBI) technology allows for real-time measurements of human brain dynamics during every day, natural, real-life situations. This special issue Time to Move brings together a collection of experimental papers, targeted reviews and opinion articles that lay out the latest MoBI findings. A wide range of topics across different fields are covered including art, athletics, virtual reality, and mobility. What unites these diverse topics is the common goal to enhance and restore human abilities by reaching a better understanding on how cognition is implemented by the brain-body relationship. The breadth and novelty of paradigms and findings reported here positions MoBI as a new frontier in the field of human cognitive neuroscience.

EEG and behavioral correlates of attentional processing while walking and navigating naturalistic environments

The capacity to regulate one's attention in accordance with fluctuating task demands and environmental contexts is an essential feature of adaptive behavior. Although the electrophysiological correlates of attentional processing have been extensively studied in the laboratory, relatively little is known about the way they unfold under more variable, ecologically-valid conditions. Accordingly, this study employed a 'real-world' EEG design to investigate how attentional processing varies under increasing cognitive, motor, and environmental demands. Forty-four participants were exposed to an auditory oddball task while (1) sitting in a quiet room inside the lab, (2) walking around a sports field, and (3) wayfinding across a university campus. In each condition, participants were instructed to either count or ignore oddball stimuli. While behavioral performance was similar across the lab and field conditions, oddball count accuracy was significantly reduced in the campus condition. Moreover, event-related potential components (mismatch negativity and P3) elicited in both 'real-world' settings differed significantly from those obtained under laboratory conditions. These findings demonstrate the impact of environmental factors on attentional processing during simultaneously-performed motor and cognitive tasks, highlighting the value of incorporating dynamic and unpredictable contexts within naturalistic designs.