Eye movement-related brain potentials during assisted navigation in real-world environments

The moving wave: Applications of the mobile EEG approach to study human attention

Although historically confined to traditional research laboratories, electroencephalography (EEG) paradigms are now being applied to study a wide array of behaviors, from daily activities to specialized tasks in diverse fields such as sports science, neurorehabilitation, and education. This transition from traditional to real-world mobile research can provide new tools for understanding attentional processes as they occur naturally. Early mobile EEG research has made progress, despite the large size and wired connections. Recent developments in hardware and software have expanded the possibilities of mobile EEG, enabling a broader range of applications. Despite these advancements, limitations influencing mobile EEG remain that must be overcome to achieve adequate reliability and validity. In this review, we first assess the feasibility of mobile paradigms, including electrode selection, artifact correction techniques, and methodological considerations. This review underscores the importance of ecological, construct, and predictive validity in ensuring the trustworthiness and applicability of mobile EEG findings. Second, we explore studies on attention in naturalistic settings, focusing on replicating classic P3 component studies in mobile paradigms like stationary biking in our lab, and activities such as walking, cycling, and dual-tasking outside of the lab. We emphasize how the mobile approach complements traditional laboratory paradigms and the types of insights gained in naturalistic research settings. Third, we discuss promising applications of portable EEG in workplace safety and other areas including road safety, rehabilitation medicine, and brain-computer interfaces. In summary, this review explores the expanding possibilities of mobile EEG while recognizing the existing challenges in fully realizing its potential.

A systematic review of mobile brain/body imaging studies using the P300 event-related potentials to investigate cognition beyond the laboratory

The P300 ERP component, related to the onset of task-relevant or infrequent stimuli, has been widely used in the Mobile Brain/Body Imaging (MoBI) literature. This systematic review evaluates the quality and breadth of P300 MoBI studies, revealing a maturing field with well-designed research yet grappling with standardization and global representation challenges. While affirming the reliability of measuring P300 ERP components in mobile settings, the review identifies significant hurdles in standardizing data cleaning and processing techniques, impacting comparability and reproducibility. Geographical disparities emerge, with studies predominantly in the Global North and a dearth of research from the Global South, emphasizing the need for broader inclusivity to counter the WEIRD bias in psychology. Collaborative projects and mobile EEG systems showcase the feasibility of reaching diverse populations, which is essential to advance precision psychiatry and to integrate varied data streams. Methodologically, a trend toward ecological validity is noted, shifting from lab-based to real-world settings with portable EEG system advancements. Future hardware developments are expected to balance signal quality and sensor intrusiveness, enriching data collection in everyday contexts. Innovative methodologies reflect a move toward more natural experimental settings, prompting critical questions about the applicability of traditional ERP markers, such as the P300 outside structured paradigms. The review concludes by highlighting the crucial role of integrating mobile technologies, physiological sensors, and machine learning to advance cognitive neuroscience. It advocates for an operational definition of ecological validity to bridge the gap between controlled experiments and the complexity of embodied cognitive experiences, enhancing both theoretical understanding and practical application in study design.

Getting closer to social interactions using electroencephalography in developmental cognitive neuroscience

The field of developmental cognitive neuroscience is advancing rapidly, with large-scale, population-wide, longitudinal studies emerging as a key means of unraveling the complexity of the developing brain and cognitive processes in children. While numerous neuroscientific techniques like functional magnetic resonance imaging (fMRI), functional near-infrared spectroscopy (fNIRS), magnetoencephalography (MEG), and transcranial magnetic stimulation (TMS) have proved advantageous in such investigations, this perspective proposes a renewed focus on electroencephalography (EEG), leveraging underexplored possibilities of EEG. In addition to its temporal precision, low costs, and ease of application, EEG distinguishes itself with its ability to capture neural activity linked to social interactions in increasingly ecologically valid settings. Specifically, EEG can be measured during social interactions in the lab, hyperscanning can be used to study brain activity in two (or more) people simultaneously, and mobile EEG can be used to measure brain activity in real-life settings. This perspective paper summarizes research in these three areas, making a persuasive argument for the renewed inclusion of EEG into the toolkit of developmental cognitive and social neuroscientists.

Fixation-related potentials during mobile map assisted navigation in the real world: The effect of landmark visualization style

An often-proposed enhancement for mobile maps to aid assisted navigation is the presentation of landmark information, yet understanding of the manner in which they should be displayed is limited. In this study, we investigated whether the visualization of landmarks as 3D map symbols with either an abstract or realistic style influenced the subsequent processing of those landmarks during route navigation. We utilized a real-world mobile electroencephalography approach to this question by combining several tools developed to overcome the challenges typically encountered in real-world neuroscience research. We coregistered eye-movement and EEG recordings from 45 participants as they navigated through a real-world environment using a mobile map. Analyses of fixation event-related potentials revealed that the amplitude of the parietal P200 component was enhanced when participants fixated landmarks in the real world that were visualized on the mobile map in a realistic style, and that frontal P200 latencies were prolonged for landmarks depicted in either a realistic or abstract style compared with features of the environment that were not presented on the map, but only for the male participants. In contrast, we did not observe any significant effects of landmark visualization style on visual P1-N1 peaks or the parietal late positive component. Overall, the findings indicate that the cognitive matching process between landmarks seen in the environment and those previously seen on a map is facilitated by more realistic map display, while low-level perceptual processing of landmarks and recall of associated information are unaffected by map visualization style.

Evaluation of a headphones-fitted EEG system for the recording of auditory evoked potentials and mental workload assessment

Advancements in portable neuroimaging technologies open up new opportunities to gain insight into the neural dynamics and cognitive processes underlying day-to-day behaviors. In this study, we evaluated the relevance of a headphone- mounted electroencephalogram (EEG) system for monitoring mental workload. The participants (N = 12) were instructed to pay attention to auditory alarms presented sporadically while performing the Multi-Attribute Task Battery (MATB) whose difficulty was staged across three conditions to manipulate mental workload. The P300 Event-Related Potentials (ERP) elicited by the presentation of auditory alarms were used as probes of attentional resources available. The amplitude and latency of P300 ERPs were compared across experimental conditions. Our findings indicate that the P300 ERP component can be captured using a headphone-mounted EEG system. Moreover, neural responses to alarm could be used to classify mental workload with high accuracy (over 80%) at a single-trial level. Our analyses indicated that the signal-to-noise ratio acquired by the sponge-based sensors remained stable throughout the recordings. These results highlight the potential of portable neuroimaging technology for the development of neuroassistive applications while underscoring the current limitations and challenges associated with the integration of EEG sensors in everyday-life wearable technologies. Overall, our study contributes to the growing body of research exploring the feasibility and validity of wearable neuroimaging technologies for the study of human cognition and behavior in real-world settings.

Multimodal pre-screening can predict BCI performance variability: A novel subject-specific experimental scheme

BACKGROUND

Brain-computer interface (BCI) systems currently lack the required robustness for long-term daily use due to inter- and intra-subject performance variability. In this study, we propose a novel personalized scheme for a multimodal BCI system, primarily using functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG), to identify, predict, and compensate for factors affecting competence-related and interfering factors associated with performance.

METHOD

11 (out of 13 recruited) participants, including five participants with motor deficits, completed four sessions on average. During the training sessions, the subjects performed a short pre-screening phase, followed by three variations of a novel visou-mental (VM) protocol. Features extracted from the pre-screening phase were used to construct predictive platforms using stepwise multivariate linear regression (MLR) models. In the test sessions, we employed a task-correction phase where our predictive models were used to predict the ideal task variation to maximize performance, followed by an interference-correction phase. We then investigated the associations between predicted and actual performances and evaluated the outcome of correction strategies.

RESULT

The predictive models resulted in respective adjusted R-squared values of 0.942, 0.724, and 0.939 for the first, second, and third variation of the task, respectively. The statistical analyses showed significant associations between the performances predicted by predictive models and the actual performances for the first two task variations, with rhos of 0.7289 (p-value = 0.011) and 0.6970 (p-value = 0.017), respectively. For 81.82 % of the subjects, the task/workload correction stage correctly determined which task variation provided the highest accuracy, with an average performance gain of 5.18 % when applying the correction strategies.

CONCLUSION

Our proposed method can lead to an integrated multimodal predictive framework to compensate for BCI performance variability, particularly, for people with severe motor deficits.

Can cognitive neuroscience solve the lab-dilemma by going wild?

Reproducibility, measurability, and refutability are the foundation of the scientific method applied to empirical work. In the study of animal and human behavior, experimental protocols conducted in the lab are the most reliable means by which scientists can operationalize behaviors using controlled and parameterized setups. However, whether observations in the lab fully generalize in the real world remain legitimately disputed. The notion of "experimental design" was originally intended to ensure the generalizability of experimental findings to real-world situations. Experiments in the wild are more frequently explored and significant technological advances have been made allowing mobile neuroimaging. Yet some methodological limitations remain when testing scientific hypotheses in ecological conditions. Herein, we discuss the limitations of inferential processes derive from empirical observations in the wild. The multi-causal property of an ecological situation often lacks controls, and this major concern may prevent the replication and the reliability of behavioral observations. We discuss the epistemological and historical grounds of the induction process for behavioral and cognitive neurosciences and provide some possible heuristics for In situ experimental designs compatible with psychophysics in the wild.

Blink-related EEG activity measures cognitive load during proactive and reactive driving

Assessing drivers' cognitive load is crucial for driving safety in challenging situations. This research employed the occurrence of drivers' natural eye blinks as cues in continuously recorded EEG data to assess the cognitive workload while reactive or proactive driving. Twenty-eight participants performed either a lane-keeping task with varying levels of crosswind (reactive) or curve road (proactive). The blink event-related potentials (bERPs) and spectral perturbations (bERSPs) were analyzed to assess cognitive load variations. The study found that task load during reactive driving did not significantly impact bERPs or bERSPs, possibly due to enduring alertness for vehicle control. The proactive driving revealed significant differences in the occipital N1 component with task load, indicating the necessity to adapt the attentional resources allocation based on road demands. Also, increased steering complexity led to decreased frontal N2, parietal P3, occipital P2 amplitudes, and alpha power, requiring more cognitive resources for processing relevant information. Interestingly, the proactive and reactive driving scenarios demonstrated a significant interaction at the parietal P2 and occipital N1 for three difficulty levels. The study reveals that EEG measures related to natural eye blink behavior provide insights into the effect of cognitive load on different driving tasks, with implications for driver safety.

Tracking drivers' minds: Continuous evaluation of mental load and cognitive processing in a realistic driving simulator scenario by means of the EEG

Driving safety strongly depends on the driver's mental states and attention to the driving situation. Previous studies demonstrate a clear relationship between EEG measures and mental states, such as alertness and drowsiness, but often only map their mental state for a longer period of time. In this driving simulation study, we exploit the high temporal resolution of the EEG to capture fine-grained modulations in cognitive processes occurring before and after eye activity in the form of saccades, fixations, and eye blinks. A total of 15 subjects drove through an approximately 50-km course consisting of highway, country road, and urban passages. Based on the ratio of brain oscillatory alpha and theta activity, the total distance was classified into 10-m-long sections with low, medium, and high task loads. Blink-evoked and fixation-evoked event-related potentials, spectral perturbations, and lateralizations were analyzed as neuro-cognitive correlates of cognition and attention. Depending on EEG-based estimation of task load, these measures showed distinct patterns associated with driving behavior parameters such as speed and steering acceleration and represent a temporally highly resolved image of specific cognitive processes during driving. In future applications, combinations of these EEG measures could form the basis for driver warning systems which increase overall driving safety by considering rapid fluctuations in driver's attention and mental states.

Using spontaneous eye blink-related brain activity to investigate cognitive load during mobile map-assisted navigation

The continuous assessment of pedestrians' cognitive load during a naturalistic mobile map-assisted navigation task is challenging because of limited experimental control over stimulus presentation, human-map-interactions, and other participant responses. To overcome this challenge, the present study takes advantage of navigators' spontaneous eye blinks during navigation to serve as event markers in continuously recorded electroencephalography (EEG) data to assess cognitive load in a mobile map-assisted navigation task. We examined if and how displaying different numbers of landmarks (3 vs. 5 vs. 7) on mobile maps along a given route would influence navigators' cognitive load during navigation in virtual urban environments. Cognitive load was assessed by the peak amplitudes of the blink-related fronto-central N2 and parieto-occipital P3. Our results show increased parieto-occipital P3 amplitude indicating higher cognitive load in the 7-landmark condition, compared to showing 3 or 5 landmarks. Our prior research already demonstrated that participants acquire more spatial knowledge in the 5- and 7-landmark conditions compared to the 3-landmark condition. Together with the current study, we find that showing 5 landmarks, compared to 3 or 7 landmarks, improved spatial learning without overtaxing cognitive load during navigation in different urban environments. Our findings also indicate a possible cognitive load spillover effect during map-assisted wayfinding whereby cognitive load during map viewing might have affected cognitive load during goal-directed locomotion in the environment or vice versa. Our research demonstrates that users' cognitive load and spatial learning should be considered together when designing the display of future navigation aids and that navigators' eye blinks can serve as useful event makers to parse continuous human brain dynamics reflecting cognitive load in naturalistic settings.

Virtual Reality for Spatial Navigation

Immersive virtual reality (VR) allows its users to experience physical space in a non-physical world. It has developed into a powerful research tool to investigate the neural basis of human spatial navigation as an embodied experience. The task of wayfinding can be carried out by using a wide range of strategies, leading to the recruitment of various sensory modalities and brain areas in real-life scenarios. While traditional desktop-based VR setups primarily focus on vision-based navigation, immersive VR setups, especially mobile variants, can efficiently account for motor processes that constitute locomotion in the physical world, such as head-turning and walking. When used in combination with mobile neuroimaging methods, immersive VR affords a natural mode of locomotion and high immersion in experimental settings, designing an embodied spatial experience. This in turn facilitates ecologically valid investigation of the neural underpinnings of spatial navigation.

Evidence in Support of Analogical Reasoning Improvements with Executive Attention Intervention in Healthy Young Adults

Analogical reasoning improvement is important in educational outcome improvement. Inspired by recent ideas and evidence, we applied anti-saccade task training as an executive attention intervention and tested whether it could improve analogical reasoning performance. A serial-task paradigm was applied where participants performed an anti-saccade followed by an analogical reasoning task including a perception condition. The experimental group finished the anti-saccade task in which the ratio of anti-saccade trials to pro-saccade trials was 5:1 while the counterpart was 1:1 in the active control group. Also, a blank control group was established where participants merely finished the analogical reasoning task. Event-related electroencephalographic (EEG) data were recorded when participants were performing the executive attention and analogical reasoning tasks. In addition, their resting state EEG was collected before and after the executive attention intervention. Behaviorally, the experimental group reacted significantly faster than the other two groups in analogical reasoning but not in perception. At the neural level, in the experimental group alone, the anti-saccade trials elicited a smaller N2 than pro-saccade trials and the resting alpha power was improved after executive attention intervention. No significant difference in P2 was found between the two groups in analogical reasoning or perception but the experimental group showed a larger late positive component than the active control group in analogical reasoning. We also found that the late positive component mediated the relationship between the N2 of anti-saccade trials and analogical reasoning reaction times in the experimental group. We further discussed the role of executive attention in the analogical reasoning process, which may pave the way for the future reliable improvement of fluid intelligence.

Visual Demands of Walking Are Reflected in Eye-Blink-Evoked EEG-Activity

Blinking is a natural user-induced response which paces visual information processing. This study investigates whether blinks are viable for segmenting continuous electroencephalography (EEG) activity, for inferring cognitive demands in ecologically valid work environments. We report the blink-related EEG measures of participants who performed auditory tasks either standing, walking on grass, or whilst completing an obstacle course. Blink-related EEG activity discriminated between different levels of cognitive demand during walking. Both behavioral parameters (e.g., blink duration or head motion) and blink-related EEG activity varied with walking conditions. Larger occipital N1 was observed during walking, relative to standing and traversing an obstacle course, which reflects differences in bottom-up visual perception. In contrast, the amplitudes of top-down components (N2, P3) significantly decreased with increasing walking demands, which reflected narrowing attention. This is consistent with blink-related EEG, specifically in Theta and Alpha power that, respectively, increased and decreased with increasing demands of the walking task. This work presents a novel and robust analytical approach to evaluate the cognitive demands experienced in natural work settings, which precludes the use of artificial task manipulations for data segmentation.

Continuous table tennis is associated with processing in frontal brain areas: an EEG approach

Coordinative challenging exercises in changing environments referred to as open-skill exercises seem to be beneficial on cognitive function. Although electroencephalographic research allows to investigate changes in cortical processing during movement, information about cortical dynamics during open-skill exercise is lacking. Therefore, the present study examines frontal brain activation during table tennis as an open-skill exercise compared to cycling exercise and a cognitive task. 21 healthy young adults conducted three blocks of table tennis, cycling and n-back task. Throughout the experiment, cortical activity was measured using 64-channel EEG system connected to a wireless amplifier. Cortical activity was analyzed calculating theta power (4-7.5 Hz) in frontocentral clusters revealed from independent component analysis. Repeated measures ANOVA was used to identify within subject differences between conditions (table tennis, cycling, n-back; p < .05). ANOVA revealed main-effects of condition on theta power in frontal (p < .01, ηp2 = 0.35) and frontocentral (p < .01, ηp2 = 0.39) brain areas. Post-hoc tests revealed increased theta power in table tennis compared to cycling in frontal brain areas (p < .05, d = 1.42). In frontocentral brain areas, theta power was significant higher in table tennis compared to cycling (p < .01, d = 1.03) and table tennis compared to the cognitive task (p < .01, d = 1.06). Increases in theta power during continuous table tennis may reflect the increased demands in perception and processing of environmental stimuli during open-skill exercise. This study provides important insights that support the beneficial effect of open-skill exercise on brain function and suggest that using open-skill exercise may serve as an intervention to induce activation of the frontal cortex.

Ecological validity in exercise neuroscience research: A systematic investigation

The contribution of cortical processes to adaptive motor behaviour is of great interest in the field of exercise neuroscience. Next to established criteria of objectivity, reliability and validity, ecological validity refers to the concerns of whether measurements and behaviour in research settings are representative of the real world. Because exercise neuroscience investigations using mobile electroencephalography are oftentimes conducted in laboratory settings under controlled environments, methodological approaches may interfere with the idea of ecological validity. This review utilizes an original ecological validity tool to assess the degree of ecological validity in current exercise neuroscience research. A systematic literature search was conducted to identify articles investigating cortical dynamics during goal-directed sports movement. To assess ecological validity, five elements (environment, stimulus, response, body and mind) were assessed on a continuum of artificiality-naturality and simplicity-complexity. Forty-seven studies were included in the present review. Results indicate lowest average ratings for the element of environment. The elements stimulus, body and mind had mediocre ratings, and the element of response had the highest overall ratings. In terms of the type of sport, studies that assessed closed-skill indoor sports had the highest ratings, whereas closed-skill outdoor sports had the lowest overall rating. Our findings identify specific elements that are lacking in ecological validity and areas of improvement in current exercise neuroscience literature. Future studies may potentially increase ecological validity by moving from reductionist, artificial environments towards complex, natural environments and incorporating real-world sport elements such as adaptive responses and competition.