Mobile EEG identifies the re-allocation of attention during real-world activity

Cortical activation among young adults during mobility in an indoor real-world environment: A mobile EEG approach

Human mobility requires neurocognitive inputs to safely navigate the environment. Previous research has examined neural processes that underly walking using mobile neuroimaging technologies, yet few studies have incorporated true real-world methods without a specific task imposed on participants (e.g., dual-task, motor demands). The present study included 40 young adults (M = 22.60, SD = 2.63, 24 female) and utilized mobile electroencephalography (EEG) to examine and compare theta, alpha, and beta frequency band power (μV2) during sitting and walking in laboratory and real-world environments. EEG data was recorded using the Muse S brain sensing headband, a portable system equipped with four electrodes (two frontal, two temporal) and one reference sensor. Qualitative data detailing the thoughts of each participant were collected after each condition. For the quantitative data, a 2 × 2 repeated measures ANOVA with within subject factors of environment and mobility was conducted with full participant datasets (n = 17, M = 22.59, SD = 2.97, 10 female). Thematic analysis was performed on the qualitative data (n = 40). Our findings support that mobility and environment may modulate neural activity, as we observed increased brain activation for walking compared to sitting, and for real-world walking compared to laboratory walking. We identified five qualitative themes across the four conditions 1) physical sensations and bodily awareness, 2) responsibilities and planning, 3) environmental awareness, 4) mobility, and 5) spotlight effect. Our study highlights the importance and potential for real-world methods to supplement standard research practices to increase the ecological validity of studies conducted in the fields of neuroscience and kinesiology.

Right visual field advantage in orientation discrimination is influenced by biased suppression

Visual input is not equally processed over space. In recent years, a right visual field advantage during free walking and standing in orientation discrimination and contrast detection task was reported. The current study investigated the underlying mechanism of the previously reported right visual field advantage. It particularly tested if the advantage is driven by a stronger suppression of distracting input from the left visual field or improved processing of targets from the right visual field. Combing behavioural and electrophysiological measurements in a mobile EEG and augmented reality setup, human participants (n = 30) in a standing and a walking condition performed a line orientation discrimination task with stimulus eccentricity and distractor status being manipulated. The right visual field advantage, as demonstrated in accuracy and reaction time, was influenced by the distractor status. Specifically, the right visual field advantage was only observed when the target had an incongruent line orientation with the distractor. Neural data further showed that the right visual field advantage was paralleled by a strong modulation of neural activity in the right hemisphere (i.e. contralateral to the distractor). A significant positive correlation between this right hemispheric event related potential (ERP) and behavioural measures (accuracy and reaction time) was found exclusively for trials in which a target was presented on the right and an incongruent distractor was presented on the left. The right hemispheric ERP component further predicted the strength of the right visual field advantage. Notably, the lateralised brain activity and the right visual field advantage were both independent of stimulus eccentricity and the movement state of participants. Overall, our findings suggest an important role of spatially biased suppression of left distracting input in the right visual field advantage as found in orientation discrimination.

Mobile EEG for the study of cognitive-motor interference during swimming?

Research on brain function in natural environments has become a new interest in cognitive science. In this study, we aim to advance mobile electroencephalography (EEG) participant and device mobility. We investigated the feasibility of measuring human brain activity using mobile EEG during a full-body motion task as swimming, by the example of cognitive-motor interference (CMI). Eleven participants were given an auditory oddball task while sitting and swimming, with mobile EEG recording ongoing brain activity. Measures of interest were event-related potentials (ERPs) elicited by experimental stimuli. While the auditory N100 was measured to verify signal quality, the P300 to task-relevant stimuli served as a marker of CMI effects. Analyzes were first performed within subjects, while binomial tests assessed the proportion of significant effects. Event-related changes in the time-frequency domain around turns during swimming were analyzed in an exploratory fashion. The successful recording of the N100 in all conditions shows that the setup was functional throughout the experiment. Regarding CMI, we did not find reliable changes in P300 amplitude in different motor settings in all subjects. However, we found plausible modulations in the alpha/mu and beta bands before and after turns. This study shows that it is generally feasible to measure mobile EEG in the time and time-frequency domain in an aquatic environment while subjects are freely moving. We see promising potential in the use of mobile EEG in extreme settings, advancing toward the application of mobile EEG in more real-life situations.

A systematic review of mobile brain/body imaging studies using the P300 event-related potentials to investigate cognition beyond the laboratory

The P300 ERP component, related to the onset of task-relevant or infrequent stimuli, has been widely used in the Mobile Brain/Body Imaging (MoBI) literature. This systematic review evaluates the quality and breadth of P300 MoBI studies, revealing a maturing field with well-designed research yet grappling with standardization and global representation challenges. While affirming the reliability of measuring P300 ERP components in mobile settings, the review identifies significant hurdles in standardizing data cleaning and processing techniques, impacting comparability and reproducibility. Geographical disparities emerge, with studies predominantly in the Global North and a dearth of research from the Global South, emphasizing the need for broader inclusivity to counter the WEIRD bias in psychology. Collaborative projects and mobile EEG systems showcase the feasibility of reaching diverse populations, which is essential to advance precision psychiatry and to integrate varied data streams. Methodologically, a trend toward ecological validity is noted, shifting from lab-based to real-world settings with portable EEG system advancements. Future hardware developments are expected to balance signal quality and sensor intrusiveness, enriching data collection in everyday contexts. Innovative methodologies reflect a move toward more natural experimental settings, prompting critical questions about the applicability of traditional ERP markers, such as the P300 outside structured paradigms. The review concludes by highlighting the crucial role of integrating mobile technologies, physiological sensors, and machine learning to advance cognitive neuroscience. It advocates for an operational definition of ecological validity to bridge the gap between controlled experiments and the complexity of embodied cognitive experiences, enhancing both theoretical understanding and practical application in study design.

Shredding artifacts: extracting brain activity in EEG from extreme artifacts during skateboarding using ASR and ICA

Introduction

To understand brain function in natural real-world settings, it is crucial to acquire brain activity data in noisy environments with diverse artifacts. Electroencephalography (EEG), while susceptible to environmental and physiological artifacts, can be cleaned using advanced signal processing techniques like Artifact Subspace Reconstruction (ASR) and Independent Component Analysis (ICA). This study aims to demonstrate that ASR and ICA can effectively extract brain activity from the substantial artifacts occurring while skateboarding on a half-pipe ramp.

Methods

A dual-task paradigm was used, where subjects were presented with auditory stimuli during skateboarding and rest conditions. The effectiveness of ASR and ICA in cleaning artifacts was evaluated using a support vector machine to classify the presence or absence of a sound stimulus in single-trial EEG data. The study evaluated the effectiveness of ASR and ICA in artifact cleaning using five different pipelines: (1) Minimal cleaning (bandpass filtering), (2) ASR only, (3) ICA only, (4) ICA followed by ASR (ICAASR), and (5) ASR preceding ICA (ASRICA). Three skateboarders participated in the experiment.

Results

Results showed that all ICA-containing pipelines, especially ASRICA (69%, 68%, 63%), outperformed minimal cleaning (55%, 52%, 50%) in single-trial classification during skateboarding. The ASRICA pipeline performed significantly better than other pipelines containing ICA for two of the three subjects, with no other pipeline performing better than ASRICA. The superior performance of ASRICA likely results from ASR removing non-stationary artifacts, enhancing ICA decomposition. Evidenced by ASRICA identifying more brain components via ICLabel than ICA alone or ICAASR for all subjects. For the rest condition, with fewer artifacts, the ASRICA pipeline (71%, 82%, 75%) showed slight improvement over minimal cleaning (73%, 70%, 72%), performing significantly better for two subjects.

Discussion

This study demonstrates that ASRICA can effectively clean artifacts to extract single-trial brain activity during skateboarding. These findings affirm the feasibility of recording brain activity during physically demanding tasks involving substantial body movement, laying the groundwork for future research into the neural processes governing complex and coordinated body movements.

Optimizing EEG ICA decomposition with data cleaning in stationary and mobile experiments

Electroencephalography (EEG) studies increasingly utilize more mobile experimental protocols, leading to more and stronger artifacts in the recorded data. Independent Component Analysis (ICA) is commonly used to remove these artifacts. It is standard practice to remove artifactual samples before ICA to improve the decomposition, for example using automatic tools such as the sample rejection option of the AMICA algorithm. However, the effects of movement intensity and the strength of automatic sample rejection on ICA decomposition have not been systematically evaluated. We conducted AMICA decompositions on eight open-access datasets with varying degrees of motion intensity using varying sample rejection criteria. We evaluated decomposition quality using mutual information of the components, the proportion of brain, muscle, and 'other' components, residual variance, and an exemplary signal-to-noise ratio. Within individual studies, increased movement significantly decreased decomposition quality, though this effect was not found across different studies. Cleaning strength significantly improved the decomposition, but the effect was smaller than expected. Our results suggest that the AMICA algorithm is robust even with limited data cleaning. Moderate cleaning, such as 5 to 10 iterations of the AMICA sample rejection, is likely to improve the decomposition of most datasets, regardless of motion intensity.

Investigating cognitive-motor effects during slacklining using mobile EEG

Balancing is a very important skill, supporting many daily life activities. Cognitive-motor interference (CMI) dual-tasking paradigms have been established to identify the cognitive load of complex natural motor tasks, such as running and cycling. Here we used wireless, smartphone-recorded electroencephalography (EEG) and motion sensors while participants were either standing on firm ground or on a slackline, either performing an auditory oddball task (dual-task condition) or no task simultaneously (single-task condition). We expected a reduced amplitude and increased latency of the P3 event-related potential (ERP) component to target sounds for the complex balancing compared to the standing on ground condition, and a further decrease in the dual-task compared to the single-task balancing condition. Further, we expected greater postural sway during slacklining while performing the concurrent auditory attention task. Twenty young, experienced slackliners performed an auditory oddball task, silently counting rare target tones presented in a series of frequently occurring standard tones. Results revealed similar P3 topographies and morphologies during both movement conditions. Contrary to our predictions we observed neither significantly reduced P3 amplitudes, nor significantly increased latencies during slacklining. Unexpectedly, we found greater postural sway during slacklining with no additional task compared to dual-tasking. Further, we found a significant correlation between the participant's skill level and P3 latency, but not between skill level and P3 amplitude or postural sway. This pattern of results indicates an interference effect for less skilled individuals, whereas individuals with a high skill level may have shown a facilitation effect. Our study adds to the growing field of research demonstrating that ERPs obtained in uncontrolled, daily-life situations can provide meaningful results. We argue that the individual CMI effects on the P3 ERP reflects how demanding the balancing task is for untrained individuals, which draws on limited resources that are otherwise available for auditory attention processing. In future work, the analysis of concurrently recorded motion-sensor signals will help to identify the cognitive demands of motor tasks executed in natural, uncontrolled environments.

Evaluation of a headphones-fitted EEG system for the recording of auditory evoked potentials and mental workload assessment

Advancements in portable neuroimaging technologies open up new opportunities to gain insight into the neural dynamics and cognitive processes underlying day-to-day behaviors. In this study, we evaluated the relevance of a headphone- mounted electroencephalogram (EEG) system for monitoring mental workload. The participants (N = 12) were instructed to pay attention to auditory alarms presented sporadically while performing the Multi-Attribute Task Battery (MATB) whose difficulty was staged across three conditions to manipulate mental workload. The P300 Event-Related Potentials (ERP) elicited by the presentation of auditory alarms were used as probes of attentional resources available. The amplitude and latency of P300 ERPs were compared across experimental conditions. Our findings indicate that the P300 ERP component can be captured using a headphone-mounted EEG system. Moreover, neural responses to alarm could be used to classify mental workload with high accuracy (over 80%) at a single-trial level. Our analyses indicated that the signal-to-noise ratio acquired by the sponge-based sensors remained stable throughout the recordings. These results highlight the potential of portable neuroimaging technology for the development of neuroassistive applications while underscoring the current limitations and challenges associated with the integration of EEG sensors in everyday-life wearable technologies. Overall, our study contributes to the growing body of research exploring the feasibility and validity of wearable neuroimaging technologies for the study of human cognition and behavior in real-world settings.

Quantifying motor adaptation in a sport-specific table tennis setting

Studies on motor adaptation aim to better understand the remarkable, largely implicit capacity of humans to adjust to changing environmental conditions. So far, this phenomenon has mainly been investigated in highly controlled laboratory setting, allowing only limited conclusions and consequences for everyday life scenarios. Natural movement tasks performed under externally valid conditions would provide important support on the transferability of recent laboratory findings. Therefore, one major goal of the current study was to create and assess a new table tennis paradigm mapping motor adaptation in a more natural and sport-specific setting. High-speed cinematographic measurements were used to determine target accuracy in a motor adaptation table tennis paradigm in 30 right-handed participants. In addition, we investigated if motor adaptation was affected by temporal order of perturbations (serial vs. random practice). In summary, we were able to confirm and reproduce typical motor adaptation effects in a sport-specific setting. We found, according to previous findings, an increase in target errors with perturbation onset that decreased during motor adaptation. Furthermore, we observed an increase in target errors with perturbation offset (after-effect) that decrease subsequently during washout phase. More importantly, this motor adaptation phenomenon did not differ when comparing serial vs. random perturbation conditions.

Maintaining Task Performance Levels Under Cognitive Load While Walking Requires Widespread Reallocation of Neural Resources

This study elucidates the neural mechanisms underlying increasing cognitive load while walking by employing 2 versions of a response inhibition task, the '1-back' version and the more cognitively demanding '2-back' version. By using the Mobile Brain/Body Imaging (MoBI) modality, electroencephalographic (EEG) activity, three-dimensional (3D) gait kinematics and task-related behavioral responses were collected while young adults (n = 61) performed either the 1-back or 2-back response inhibition task. Interestingly, increasing inhibitory difficulty from 1-back to 2-back during walking was not associated with any detectable costs in response accuracy, response speed, or gait consistency. However, the more difficult cognitive task was associated with distinct EEG component changes during both successful inhibitions (correct rejections) and successful executions (hits) of the motor response. During correct rejections, ERP changes were found over frontal regions, during latencies related to sensory gain control, conflict monitoring and working memory storage and processing. During hits, ERP changes were found over left-parietal regions during latencies related to orienting attention and subsequent selection and execution of the motor plan. The pattern of attenuation in walking-related EEG amplitude changes, during 2-back task performance, is thought to reflect more effortful recalibration of neural processes, a mechanism which might be a key driver of performance maintenance in the face of increased cognitive demands while walking. Overall, the present findings shed light on the extent of the neurocognitive capacity of young adults and may lead to a better understanding of how factors such as aging or neurological disorders could impinge on this capacity.

Virtual Reality Sickness Reduces Attention During Immersive Experiences

In this paper, we show that Virtual Reality (VR) sickness is associated with a reduction in attention, which was detected with the P3b Event-Related Potential (ERP) component from electroencephalography (EEG) measurements collected in a dual-task paradigm. We hypothesized that sickness symptoms such as nausea, eyestrain, and fatigue would reduce the users' capacity to pay attention to tasks completed in a virtual environment, and that this reduction in attention would be dynamically reflected in a decrease of the P3b amplitude while VR sickness was experienced. In a user study, participants were taken on a tour through a museum in VR along paths with varying amounts of rotation, shown previously to cause different levels of VR sickness. While paying attention to the virtual museum (the primary task), participants were asked to silently count tones of a different frequency (the secondary task). Control measurements for comparison against the VR sickness conditions were taken when the users were not wearing the Head-Mounted Display (HMD) and while they were immersed in VR but not moving through the environment. This exploratory study shows, across multiple analyses, that the effect mean amplitude of the P3b collected during the task is associated with both sickness severity measured after the task with a questionnaire (SSQ) and with the number of counting errors on the secondary task. Thus, VR sickness may impair attention and task performance, and these changes in attention can be tracked with ERP measures as they happen, without asking participants to assess their sickness symptoms in the moment.

Smartphone-based ear-electroencephalography to study sound processing in everyday life

In everyday life, people differ in their sound perception and thus sound processing. Some people may be distracted by construction noise, while others do not even notice. With smartphone-based mobile ear-electroencephalography (ear-EEG), we can measure and quantify sound processing in everyday life by analysing presented sounds and also naturally occurring ones. Twenty-four participants completed four controlled conditions in the lab (1 h) and one condition in the office (3 h). All conditions used the same paired-click stimuli. In the lab, participants listened to click tones under four different instructions: no task towards the sounds, reading a newspaper article, listening to an audio article or counting a rare deviant sound. In the office recording, participants followed daily activities while they were sporadically presented with clicks, without any further instruction. In the beyond-the-lab condition, in addition to the presented sounds, environmental sounds were recorded as acoustic features (i.e., loudness, power spectral density and sounds onsets). We found task-dependent differences in the auditory event-related potentials (ERPs) to the presented click sounds in all lab conditions, which underline that neural processes related to auditory attention can be differentiated with ear-EEG. In the beyond-the-lab condition, we found ERPs comparable to some of the lab conditions. The N1 amplitude to the click sounds beyond the lab was dependent on the background noise, probably due to energetic masking. Contrary to our expectation, we did not find a clear ERP in response to the environmental sounds. Overall, we showed that smartphone-based ear-EEG can be used to study sound processing of well defined-stimuli in everyday life.

Context effects on object recognition in real-world environments: A study protocol

Background: The environments that we live in impact on our ability to recognise objects, with recognition being facilitated when objects appear in expected locations (congruent) compared to unexpected locations (incongruent). However, these findings are based on experiments where the object is isolated from its environment. Moreover, it is not clear which components of the recognition process are impacted by the environment. In this experiment, we seek to examine the impact real world environments have on object recognition. Specifically, we will use mobile electroencephalography (mEEG) and augmented reality (AR) to investigate how the visual and semantic processing aspects of object recognition are changed by the environment. Methods: We will use AR to place congruent and incongruent virtual objects around indoor and outdoor environments. During the experiment a total of 34 participants will walk around the environments and find these objects while we record their eye movements and neural signals. We will perform two primary analyses. First, we will analyse the event-related potential (ERP) data using paired samples t-tests in the N300/400 time windows in an attempt to replicate congruency effects on the N300/400. Second, we will use representational similarity analysis (RSA) and computational models of vision and semantics to determine how visual and semantic processes are changed by congruency. Conclusions: Based on previous literature, we hypothesise that scene-object congruence would facilitate object recognition. For ERPs, we predict a congruency effect in the N300/N400, and for RSA we predict that higher level visual and semantic information will be represented earlier for congruent scenes than incongruent scenes. By collecting mEEG data while participants are exploring a real-world environment, we will be able to determine the impact of a natural context on object recognition, and the different processing stages of object recognition.

The brain in motion-cognitive effects of simultaneous motor activity

During the last 30 years, a large number of behavioral studies have investigated the effect of simultaneous exercise on cognitive functions. The heterogeneity of the results has been attributed to different parameters, such as intensity or modality of physical activity, and the investigated cognitive processes. More recent methodological improvements have enabled to record electroencephalography (EEG) during physical exercise. EEG studies combining cognitive tasks with exercise have described predominantly detrimental effects on cognitive processes and EEG parameters. However, differences in the underlying rationale and the design of EEG versus behavioral studies make direct comparisons between both types of studies difficult. In this narrative review of dual-task experiments we evaluated behavioral and EEG studies and discuss possible explanations for the heterogeneity of results and for the discrepancy between behavioral and EEG studies. Furthermore, we provide a proposal for future EEG studies on simultaneous motion to be a useful complement to behavioral studies. A crucial factor might be to find for each cognitive function the motor activity that matches this function in terms of attentional focus. This hypothesis should be investigated systematically in future studies.

Wireless EEG: A survey of systems and studies

The popular brain monitoring method of electroencephalography (EEG) has seen a surge in commercial attention in recent years, focusing mostly on hardware miniaturization. This has led to a varied landscape of portable EEG devices with wireless capability, allowing them to be used by relatively unconstrained users in real-life conditions outside of the laboratory. The wide availability and relative affordability of these devices provide a low entry threshold for newcomers to the field of EEG research. The large device variety and the at times opaque communication from their manufacturers, however, can make it difficult to obtain an overview of this hardware landscape. Similarly, given the breadth of existing (wireless) EEG knowledge and research, it can be challenging to get started with novel ideas. Therefore, this paper first provides a list of 48 wireless EEG devices along with a number of important-sometimes difficult-to-obtain-features and characteristics to enable their side-by-side comparison, along with a brief introduction to each of these aspects and how they may influence one's decision. Secondly, we have surveyed previous literature and focused on 110 high-impact journal publications making use of wireless EEG, which we categorized by application and analyzed for device used, number of channels, sample size, and participant mobility. Together, these provide a basis for informed decision making with respect to hardware and experimental precedents when considering new, wireless EEG devices and research. At the same time, this paper provides background material and commentary about pitfalls and caveats regarding this increasingly accessible line of research.

Wearable, high-density fNIRS and diffuse optical tomography technologies: a perspective

Recent progress in optoelectronics has made wearable and high-density functional near-infrared spectroscopy (fNIRS) and diffuse optical tomography (DOT) technologies possible for the first time. These technologies have the potential to open new fields of real-world neuroscience by enabling functional neuroimaging of the human cortex at a resolution comparable to fMRI in almost any environment and population. In this perspective article, we provide a brief overview of the history and the current status of wearable high-density fNIRS and DOT approaches, discuss the greatest ongoing challenges, and provide our thoughts on the future of this remarkable technology.

Young adults who improve performance during dual-task walking show more flexible reallocation of cognitive resources: a mobile brain-body imaging (MoBI) study

INTRODUCTION

In young adults, pairing a cognitive task with walking can have different effects on gait and cognitive task performance. In some cases, performance clearly declines whereas in others compensatory mechanisms maintain performance. This study investigates the preliminary finding of behavioral improvement in Go/NoGo response inhibition task performance during walking compared with sitting, which was observed at the piloting stage.

MATERIALS AND METHODS

Mobile brain/body imaging (MoBI) was used to record electroencephalographic (EEG) activity, 3-dimensional (3D) gait kinematics and behavioral responses in the cognitive task, during sitting or walking on a treadmill.

RESULTS

In a cohort of 26 young adults, 14 participants improved in measures of cognitive task performance while walking compared with sitting. These participants exhibited walking-related EEG amplitude reductions over frontal scalp regions during key stages of inhibitory control (conflict monitoring, control implementation, and pre-motor stages), accompanied by reduced stride-to-stride variability and faster responses to stimuli compared with those who did not improve. In contrast, 12 participants who did not improve exhibited no EEG amplitude differences across physical condition.

DISCUSSION

The neural activity changes associated with performance improvement during dual tasking hold promise as cognitive flexibility markers that can potentially help assess cognitive decline in aging and neurodegeneration.

"Unattended, distracting or irrelevant": Theoretical implications of terminological choices in auditory selective attention research

For seventy years, auditory selective attention research has focused on studying the cognitive mechanisms of prioritizing the processing a 'main' task-relevant stimulus, in the presence of 'other' stimuli. However, a closer look at this body of literature reveals deep empirical inconsistencies and theoretical confusion regarding the extent to which this 'other' stimulus is processed. We argue that many key debates regarding attention arise, at least in part, from inappropriate terminological choices for experimental variables that may not accurately map onto the cognitive constructs they are meant to describe. Here we critically review the more common or disruptive terminological ambiguities, differentiate between methodology-based and theory-derived terms, and unpack the theoretical assumptions underlying different terminological choices. Particularly, we offer an in-depth analysis of the terms 'unattended' and 'distractor' and demonstrate how their use can lead to conflicting theoretical inferences. We also offer a framework for thinking about terminology in a more productive and precise way, in hope of fostering more productive debates and promoting more nuanced and accurate cognitive models of selective attention.

Neuroergonomics on the Go: An Evaluation of the Potential of Mobile EEG for Workplace Assessment and Design

OBJECTIVE

We demonstrate and discuss the use of mobile electroencephalogram (EEG) for neuroergonomics. Both technical state of the art as well as measures and cognitive concepts are systematically addressed.

BACKGROUND

Modern work is increasingly characterized by information processing. Therefore, the examination of mental states, mental load, or cognitive processing during work is becoming increasingly important for ergonomics.

RESULTS

Mobile EEG allows to measure mental states and processes under real live conditions. It can be used for various research questions in cognitive neuroergonomics. Besides measures in the frequency domain that have a long tradition in the investigation of mental fatigue, task load, and task engagement, new approaches-like blink-evoked potentials-render event-related analyses of the EEG possible also during unrestricted behavior.

CONCLUSION

Mobile EEG has become a valuable tool for evaluating mental states and mental processes on a highly objective level during work. The main advantage of this technique is that working environments don't have to be changed while systematically measuring brain functions at work. Moreover, the workflow is unaffected by such neuroergonomic approaches.

Walking humans and running mice: perception and neural encoding of optic flow during self-motion

Locomotion produces full-field optic flow that often dominates the visual motion inputs to an observer. The perception of optic flow is in turn important for animals to guide their heading and interact with moving objects. Understanding how locomotion influences optic flow processing and perception is therefore essential to understand how animals successfully interact with their environment. Here, we review research investigating how perception and neural encoding of optic flow are altered during self-motion, focusing on locomotion. Self-motion has been found to influence estimation and sensitivity for optic flow speed and direction. Nonvisual self-motion signals also increase compensation for self-driven optic flow when parsing the visual motion of moving objects. The integration of visual and nonvisual self-motion signals largely follows principles of Bayesian inference and can improve the precision and accuracy of self-motion perception. The calibration of visual and nonvisual self-motion signals is dynamic, reflecting the changing visuomotor contingencies across different environmental contexts. Throughout this review, we consider experimental research using humans, non-human primates and mice. We highlight experimental challenges and opportunities afforded by each of these species and draw parallels between experimental findings. These findings reveal a profound influence of locomotion on optic flow processing and perception across species. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

Experiment protocols for brain-body imaging of locomotion: A systematic review

Introduction

Human locomotion is affected by several factors, such as growth and aging, health conditions, and physical activity levels for maintaining overall health and well-being. Notably, impaired locomotion is a prevalent cause of disability, significantly impacting the quality of life of individuals. The uniqueness and high prevalence of human locomotion have led to a surge of research to develop experimental protocols for studying the brain substrates, muscle responses, and motion signatures associated with locomotion. However, from a technical perspective, reproducing locomotion experiments has been challenging due to the lack of standardized protocols and benchmarking tools, which impairs the evaluation of research quality and the validation of previous findings.

Methods

This paper addresses the challenges by conducting a systematic review of existing neuroimaging studies on human locomotion, focusing on the settings of experimental protocols, such as locomotion intensity, duration, distance, adopted brain imaging technologies, and corresponding brain activation patterns. Also, this study provides practical recommendations for future experiment protocols.

Results

The findings indicate that EEG is the preferred neuroimaging sensor for detecting brain activity patterns, compared to fMRI, fNIRS, and PET. Walking is the most studied human locomotion task, likely due to its fundamental nature and status as a reference task. In contrast, running has received little attention in research. Additionally, cycling on an ergometer at a speed of 60 rpm using fNIRS has provided some research basis. Dual-task walking tasks are typically used to observe changes in cognitive function. Moreover, research on locomotion has primarily focused on healthy individuals, as this is the scenario most closely resembling free-living activity in real-world environments.

Discussion

Finally, the paper outlines the standards and recommendations for setting up future experiment protocols based on the review findings. It discusses the impact of neurological and musculoskeletal factors, as well as the cognitive and locomotive demands, on the experiment design. It also considers the limitations imposed by the sensing techniques used, including the acceptable level of motion artifacts in brain-body imaging experiments and the effects of spatial and temporal resolutions on brain sensor performance. Additionally, various experiment protocol constraints that need to be addressed and analyzed are explained.

Embodiment for Robotic Lower-Limb Exoskeletons: A Narrative Review

Research on embodiment of objects external to the human body has revealed important information about how the human nervous system interacts with robotic lower limb exoskeletons. Typical robotic exoskeleton control approaches view the controllers as an external agent intending to move in coordination with the human. However, principles of embodiment suggest that the exoskeleton controller should ideally coordinate with the human such that the nervous system can adequately model the input-output dynamics of the exoskeleton controller. Measuring embodiment of exoskeletons should be a necessary step in the exoskeleton development and prototyping process. Researchers need to establish high fidelity quantitative measures of embodiment, rather than relying on current qualitative survey measures. Mobile brain imaging techniques, such as high-density electroencephalography, is likely to provide a deeper understanding of embodiment during human-machine interactions and advance exoskeleton research and development. In this review we show why future exoskeleton research should include quantitative measures of embodiment as a metric of success.

The influence of job burnout on the attention ability of army soldiers and officers: Evidence from ERP

Job burnout is one of the most widespread mental problems in today's society and seriously affects the mental health and combat effectiveness of soldiers and officers. Herein, the effect of burnout on individual attention is studied from the perspective of neuroelectrophysiology. A total of 1,155 army soldiers and officers were included in this investigation and completed the Job Burnout Scale for Military Personnel. A total of 42 soldiers and officers were randomly selected from those with and without burnout to participate in an event-related potential (ERP) study using a visual oddball task. The characteristics of visual P3a and P3b at Fz, FCz, Cz, CPz, and Pz were recorded and analyzed by repeated-measures analysis of variance (ANOVA). P < 0.05 was the criterion for a significant difference. The total average score on the Job Burnout Scale for Military Personnel among the participants was 0.74 ± 0.46, and the detection rate of job burnout was 29.85%. In the Oddball task, the average number of target stimuli counted in the burnout group was lower than that in the control group, but no significant difference was found. For P3a, the Fz, FCz, Cz, CPz, and Pz amplitudes in the burnout group were significantly lower than those in the control group. The average amplitude of P3a evoked in the central parietal area was larger than that in the prefrontal area. For P3b, the amplitudes of the five electrodes in the burnout group were significantly lower than those in the control group. The average amplitude of P3b evoked in the parietal region was larger than those in the prefrontal and central parietal regions. A certain degree of job burnout is evident in army soldiers and officers. The voluntary attention and involuntary attention of individuals with burnout are both affected to some extent, as reflected by the lower amplitudes of P3a and P3b. The results suggest that P3a and P3b can be used as indicators to monitor cognitive neural function in soldiers and officers with burnout and can also be used as references for evaluating the effects of cognitive training and screening methods. In this study, ERP was used to research the attention ability of soldiers and officers with job burnout, and related issues were discussed from the aspects of the burnout results, behavioral results, ERP results, compensation effect of cognitive resources, application in the military field, limitations, and prospects.

A mobile EEG study on the psychophysiological effects of walking and crowding in indoor and outdoor urban environments

Environmental psychologists have established multiple psychological benefits of interaction with natural, compared to urban, environments on emotion, cognition, and attention. Yet, given the increasing urbanisation worldwide, it is equally important to understand how differences within different urban environments influence human psychological experience. We developed a laboratory experiment to examine the psychophysiological effects of the physical (outdoor or indoor) and social (crowded versus uncrowded) environment in healthy young adults, and to validate the use of mobile electroencephalography (EEG) and electrodermal activity (EDA) measurements during active walking. Participants (N = 42) were randomly assigned into a walking or a standing group, and watched six 1-min walk-through videos of green, urban indoor and urban outdoor environments, depicting high or low levels of social density. Self-reported emotional states show that green spaces is perceived as more calm and positive, and reduce attentional demands. Further, the outdoor urban space is perceived more positively than the indoor environment. These findings are consistent with earlier studies on the psychological benefits of nature and confirm the effectiveness of our paradigm and stimuli. In addition, we hypothesised that even short-term exposure to crowded scenes would have negative psychological effects. We found that crowded scenes evoked higher self-reported arousal, more negative self-reported valence, and recruited more cognitive and attentional resources. However, in walking participants, they evoked higher frontal alpha asymmetry, suggesting more positive affective responses. Furthermore, we found that using recent signal-processing methods, the EEG data produced a comparable signal-to-noise ratio between walking and standing, and that despite differences between walking and standing, skin-conductance also captured effectively psychophysiological responses to stimuli. These results suggest that emotional responses to visually presented stimuli can be measured effectively using mobile EEG and EDA in ambulatory settings, and that there is complex interaction between active walking, the social density of urban spaces, and direct and indirect affective responses to such environments.

Estimating distribution shifts for predicting cross-subject generalization in electroencephalography-based mental workload assessment

Assessment of mental workload in real-world conditions is key to ensuring the performance of workers executing tasks that demand sustained attention. Previous literature has employed electroencephalography (EEG) to this end despite having observed that EEG correlates of mental workload vary across subjects and physical strain, thus making it difficult to devise models capable of simultaneously presenting reliable performance across users. Domain adaptation consists of a set of strategies that aim at allowing for improving machine learning systems performance on unseen data at training time. Such methods, however, might rely on assumptions over the considered data distributions, which typically do not hold for applications of EEG data. Motivated by this observation, in this work we propose a strategy to estimate two types of discrepancies between multiple data distributions, namely marginal and conditional shifts, observed on data collected from different subjects. Besides shedding light on the assumptions that hold for a particular dataset, the estimates of statistical shifts obtained with the proposed approach can be used for investigating other aspects of a machine learning pipeline, such as quantitatively assessing the effectiveness of domain adaptation strategies. In particular, we consider EEG data collected from individuals performing mental tasks while running on a treadmill and pedaling on a stationary bike and explore the effects of different normalization strategies commonly used to mitigate cross-subject variability. We show the effects that different normalization schemes have on statistical shifts and their relationship with the accuracy of mental workload prediction as assessed on unseen participants at training time.

Visual Demands of Walking Are Reflected in Eye-Blink-Evoked EEG-Activity

Blinking is a natural user-induced response which paces visual information processing. This study investigates whether blinks are viable for segmenting continuous electroencephalography (EEG) activity, for inferring cognitive demands in ecologically valid work environments. We report the blink-related EEG measures of participants who performed auditory tasks either standing, walking on grass, or whilst completing an obstacle course. Blink-related EEG activity discriminated between different levels of cognitive demand during walking. Both behavioral parameters (e.g., blink duration or head motion) and blink-related EEG activity varied with walking conditions. Larger occipital N1 was observed during walking, relative to standing and traversing an obstacle course, which reflects differences in bottom-up visual perception. In contrast, the amplitudes of top-down components (N2, P3) significantly decreased with increasing walking demands, which reflected narrowing attention. This is consistent with blink-related EEG, specifically in Theta and Alpha power that, respectively, increased and decreased with increasing demands of the walking task. This work presents a novel and robust analytical approach to evaluate the cognitive demands experienced in natural work settings, which precludes the use of artificial task manipulations for data segmentation.

Context effects on object recognition in real-world environments: A study protocol

Background: The environments that we live in impact on our ability to recognise objects, with recognition being facilitated when objects appear in expected locations (congruent) compared to unexpected locations (incongruent). However, these findings are based on experiments where the object is isolated from its environment. Moreover, it is not clear which components of the recognition process are impacted by the environment. In this experiment, we seek to examine the impact real world environments have on object recognition. Specifically, we will use mobile electroencephalography (mEEG) and augmented reality (AR) to investigate how the visual and semantic processing aspects of object recognition are changed by the environment. Methods: We will use AR to place congruent and incongruent virtual objects around indoor and outdoor environments. During the experiment a total of 34 participants will walk around the environments and find these objects while we record their eye movements and neural signals. We will perform two primary analyses. First, we will analyse the event-related potential (ERP) data using paired samples t-tests in the N300/400 time windows in an attempt to replicate congruency effects on the N300/400. Second, we will use representational similarity analysis (RSA) and computational models of vision and semantics to determine how visual and semantic processes are changed by congruency. Conclusions: Based on previous literature, we hypothesise that scene-object congruence would facilitate object recognition. For ERPs, we predict a congruency effect in the N300/N400, and for RSA we predict that higher level visual and semantic information will be represented earlier for congruent scenes than incongruent scenes. By collecting mEEG data while participants are exploring a real-world environment, we will be able to determine the impact of a natural context on object recognition, and the different processing stages of object recognition.

Did you even see that? visual sensory processing of single stimuli under different locomotor loads

Modern living and working environments are more and more interspersed with the concurrent execution of locomotion and sensory processing, most often in the visual domain. Many job profiles involve the presentation of visual information while walking, for example in warehouse logistics work, where a worker has to manage walking to the correct aisle to pick up a package while being presented with visual information over data-glasses concerning the next order. Similar use-cases can be found in manufacturing jobs, for example in car montage assembly lines where next steps are presented via augmented reality headsets while walking at a slow pace. Considering the overall scarcity of cognitive resources available to be deployed to either the cognitive or motor processes, task performance decrements were found when increasing load in either domain. Interestingly, the walking motion also had beneficial effects on peripheral contrast detection and the inhibition of visual stream information. Taking these findings into account, we conducted a study that comprised the detection of single visual targets (Landolt Cs) within a broad range of the visual field (-40° to +40° visual angle) while either standing, walking, or walking with concurrent perturbations. We used questionnaire (NASA-TLX), behavioral (response times and accuracy), and neurophysiological data (ERPs and ERSPs) to quantify the effects of cognitive-motor interference. The study was conducted in a Gait Real-time Analysis Interactive Laboratory (GRAIL), using a 180° projection screen and a swayable and tiltable dual-belt treadmill. Questionnaire and behavioral measures showed common patterns. We found increasing subjective physical workload and behavioral decrements with increasing stimulus eccentricity and motor complexity. Electrophysiological results also indicated decrements in stimulus processing with higher stimulus eccentricity and movement complexity (P3, Theta), but highlighted a beneficial role when walking without perturbations and processing more peripheral stimuli regarding earlier sensory components (N1pc/N2pc, N2). These findings suggest that walking without impediments can enhance the visual processing of peripheral information and therefore help with perceiving non-foveal sensory content. Also, our results could help with re-evaluating previous findings in the context of cognitive-motor interference, as increased motor complexity might not always impede cognitive processing and performance.

Characterization of Indicators for Adaptive Human-Swarm Teaming

Swarm systems consist of large numbers of agents that collaborate autonomously. With an appropriate level of human control, swarm systems could be applied in a variety of contexts ranging from urban search and rescue situations to cyber defence. However, the successful deployment of the swarm in such applications is conditioned by the effective coupling between human and swarm. While adaptive autonomy promises to provide enhanced performance in human-machine interaction, distinct factors must be considered for its implementation within human-swarm interaction. This paper reviews the multidisciplinary literature on different aspects contributing to the facilitation of adaptive autonomy in human-swarm interaction. Specifically, five aspects that are necessary for an adaptive agent to operate properly are considered and discussed, including mission objectives, interaction, mission complexity, automation levels, and human states. We distill the corresponding indicators in each of the five aspects, and propose a framework, named MICAH (i.e., Mission-Interaction-Complexity-Automation-Human), which maps the primitive state indicators needed for adaptive human-swarm teaming.

Towards real-world neuroscience using mobile EEG and augmented reality

Our visual environment impacts multiple aspects of cognition including perception, attention and memory, yet most studies traditionally remove or control the external environment. As a result, we have a limited understanding of neurocognitive processes beyond the controlled lab environment. Here, we aim to study neural processes in real-world environments, while also maintaining a degree of control over perception. To achieve this, we combined mobile EEG (mEEG) and augmented reality (AR), which allows us to place virtual objects into the real world. We validated this AR and mEEG approach using a well-characterised cognitive response-the face inversion effect. Participants viewed upright and inverted faces in three EEG tasks (1) a lab-based computer task, (2) walking through an indoor environment while seeing face photographs, and (3) walking through an indoor environment while seeing virtual faces. We find greater low frequency EEG activity for inverted compared to upright faces in all experimental tasks, demonstrating that cognitively relevant signals can be extracted from mEEG and AR paradigms. This was established in both an epoch-based analysis aligned to face events, and a GLM-based approach that incorporates continuous EEG signals and face perception states. Together, this research helps pave the way to exploring neurocognitive processes in real-world environments while maintaining experimental control using AR.

Measuring Task-Related Brain Activity With Event-Related Potentials in Dynamic Task Scenario With Immersive Virtual Reality Environment

Measurement of event-related potentials (ERPs) in simulated and real environments is advantageous for understanding cognition and behavior during practice of goal-directed activities. Recently, instead of using task-irrelevant “probe stimuli” to elicit ERPs, extraction of ERPs directly from events that occur in simulated and real environments has drawn increased attention. Among the previous ERP studies using immersive virtual reality, only a few cases elicited ERPs from task-related events in dynamic task settings. Furthermore, as far as we surveyed, there were no studies that examined the source of ERPs or correlation between ERPs and behavioral performance in 360-degree immersive virtual reality using head-mounted display. In this study, EEG signals were recorded from 16 participants while they were playing the first-person shooter game with immersive virtual reality environment. Error related negativity (ERN) and correct-(response)-related negativity (CRN) elicited by shooting-related events were successfully extracted. We found the ERN amplitudes to be correlated with the individual shooting performance. Interestingly, the main source of the ERN was the rostral anterior cingulate cortex (ACC), which is different from previous studies where the signal source was often estimated to be the more caudal part of ACC. The obtained results are expected to contribute to the evaluation of cognitive functions and behavioral performance by ERPs in a simulated environment.

Electrocortical Activity in Older Adults Is More Influenced by Cognitive Task Complexity Than Concurrent Walking

Human cognitive-motor performance largely depends on how brain resources are allocated during simultaneous tasks. Nonetheless, little is known regarding the age-related changes in electrocortical activity when dual-task during walking presents higher complexity levels. Thus, the aim of this study was to investigate whether there are distinct changes in walking performance and electrocortical activation between young and older adults performing simple and complex upper limb response time tasks. Physically active young (23 ± 3 years, n = 21) and older adults (69 ± 5 years, n = 19) were asked to respond as fast as possible to a single stimuli or a double stimuli appearing on a touch screen during standing and walking. Response time, step frequency, step frequency variability and electroencephalographic (EEG) N200 and P300 amplitudes and latencies from frontal central and parietal brain regions were recorded. The results demonstrated that older adults were 23% slower to respond to double stimuli, whereas younger adults were only 12% slower (p < 0.01). The longer response time for older adults was accompanied by greater step frequency variability following double-stimuli presentations (p < 0.01). Older adults presented reduced N200 and P300 amplitudes compared to younger participants across all conditions (p < 0.001), with no effects of posture (standing vs walking) on both groups (p > 0.05). More importantly, the P300 amplitude was significantly reduced for older adults when responding to double stimuli regardless of standing or walking tasks (p < 0.05), with no changes in younger participants. Therefore, physically active older adults can attenuate potential walking deficits experienced during dual-task walking in simple cognitive tasks. However, cognitive tasks involving decision making influence electrocortical activation due to reduced cognitive resources to cope with the task demands.

On the psychological origins of tool use

The ubiquity of tool use in human life has generated multiple lines of scientific and philosophical investigation to understand the development and expression of humans' engagement with tools and its relation to other dimensions of human experience. However, existing literature on tool use faces several epistemological challenges in which the same set of questions generate many different answers. At least four critical questions can be identified, which are intimately intertwined-(1) What constitutes tool use? (2) What psychological processes underlie tool use in humans and nonhuman animals? (3) Which of these psychological processes are exclusive to tool use? (4) Which psychological processes involved in tool use are exclusive to Homo sapiens? To help advance a multidisciplinary scientific understanding of tool use, six author groups representing different academic disciplines (e.g., anthropology, psychology, neuroscience) and different theoretical perspectives respond to each of these questions, and then point to the direction of future work on tool use. We find that while there are marked differences among the responses of the respective author groups to each question, there is a surprising degree of agreement about many essential concepts and questions. We believe that this interdisciplinary and intertheoretical discussion will foster a more comprehensive understanding of tool use than any one of these perspectives (or any one of these author groups) would (or could) on their own.

Future trends in brain aging research: Visuo-cognitive functions at stake during mobility and spatial navigation

Aging leads to a complex pattern of structural and functional changes, gradually affecting sensorimotor, perceptual, and cognitive processes. These multiscale changes can hinder older adults' interaction with their environment, progressively reducing their autonomy in performing tasks relevant to everyday life. Autonomy loss can further be aggravated by the onset and progression of neurodegenerative disorders (e.g., age-related macular degeneration at the sensory input level; and Alzheimer's disease at the cognitive level). In this context, spatial cognition offers a representative case of high-level brain function that involves multimodal sensory processing, postural control, locomotion, spatial orientation, and wayfinding capabilities. Hence, studying spatial behavior and its neural bases can help identify early markers of pathogenic age-related processes. Until now, the neural correlates of spatial cognition have mostly been studied in static conditions thereby disregarding perceptual (other than visual) and motor aspects of natural navigation. In this review, we first demonstrate how visuo-motor integration and the allocation of cognitive resources during locomotion lie at the heart of real-world spatial navigation. Second, we present how technological advances such as immersive virtual reality and mobile neuroimaging solutions can enable researchers to explore the interplay between perception and action. Finally, we argue that the future of brain aging research in spatial navigation demands a widespread shift toward the use of naturalistic, ecologically valid experimental paradigms to address the challenges of mobility and autonomy decline across the lifespan.

Neural tracking to go: auditory attention decoding and saliency detection with mobile EEG

OBJECTIVE

Neuro-steered assistive technologies have been suggested to offer a major advancement in future devices like neuro-steered hearing aids. Auditory attention decoding methods would in that case allow for identification of an attended speaker within complex auditory environments, exclusively from neural data. Decoding the attended speaker using neural information has so far only been done in controlled laboratory settings. Yet, it is known that ever-present factors like distraction and movement are reflected in the neural signal parameters related to attention.

APPROACH

Thus, in the current study we applied a two-competing speaker paradigm to investigate performance of a commonly applied EEG-based auditory attention decoding (AAD) model outside of the laboratory during leisure walking and distraction. Unique environmental sounds were added to the auditory scene and served as distractor events.

MAIN RESULTS

The current study shows, for the first time, that the attended speaker can be accurately decoded during natural movement. At a temporal resolution of as short as 5-seconds and without artifact attenuation, decoding was found to be significantly above chance level. Further, as hypothesized, we found a decrease in attention to the to-be-attended and the to-be-ignored speech stream after the occurrence of a salient event. Additionally, we demonstrate that it is possible to predict neural correlates of distraction with a computational model of auditory saliency based on acoustic features.

CONCLUSION

Taken together, our study shows that auditory attention tracking outside of the laboratory in ecologically valid conditions is feasible and a step towards the development of future neural-steered hearing aids.

Using mobile brain/body imaging to advance research in arts, health, and related therapeutics

The uses of mobile brain/body imaging (MoBI) are expanding and allow for more direct study of the neurophysiological signals associated with behavior in psychotherapeutic encounters. Neuroaesthetics is concerned with the cognitive and neural basis of art appreciation, and scientific correlations are being made in the field that might help to clarify theories claimed in the creative arts therapies. Yet, most neuroaesthetics studies are confined to the laboratory and do not propose a translation for research methods and clinical applications. The creative arts therapies have a long history of clinical success with various patient populations and will benefit from increased scientific explanation to support intervention strategies. Examining the brain dynamics and motor behaviors that are associated with the higher complex processes involved in artistic expression offers MoBI as a promising instrumentation to move forward in linking ideas from neuroaesthetics to the creative arts therapies. Tracking brain dynamics in association with behavioral change allows for more objective and quantitative physiological monitors to evaluate, and together with subjective patient reports provides insight into the psychological mechanisms of change in treatment. We outline a framework that shows how MoBI can be used to study the effectiveness of creative arts therapy interventions motivated by the 4E approach to cognition with a focus on visual art therapy. The article illuminates how a new partnership among the fields of art therapy, neuroscience, and neuroaesthetics might work together within the 4E/MoBI framework in efforts to advance transdisciplinary research for clinical health populations.

EEG and behavioral correlates of attentional processing while walking and navigating naturalistic environments

The capacity to regulate one's attention in accordance with fluctuating task demands and environmental contexts is an essential feature of adaptive behavior. Although the electrophysiological correlates of attentional processing have been extensively studied in the laboratory, relatively little is known about the way they unfold under more variable, ecologically-valid conditions. Accordingly, this study employed a 'real-world' EEG design to investigate how attentional processing varies under increasing cognitive, motor, and environmental demands. Forty-four participants were exposed to an auditory oddball task while (1) sitting in a quiet room inside the lab, (2) walking around a sports field, and (3) wayfinding across a university campus. In each condition, participants were instructed to either count or ignore oddball stimuli. While behavioral performance was similar across the lab and field conditions, oddball count accuracy was significantly reduced in the campus condition. Moreover, event-related potential components (mismatch negativity and P3) elicited in both 'real-world' settings differed significantly from those obtained under laboratory conditions. These findings demonstrate the impact of environmental factors on attentional processing during simultaneously-performed motor and cognitive tasks, highlighting the value of incorporating dynamic and unpredictable contexts within naturalistic designs.

Opportunities and Limitations of Mobile Neuroimaging Technologies in Educational Neuroscience

As the field of educational neuroscience continues to grow, questions have emerged regarding the ecological validity and applicability of this research to educational practice. Recent advances in mobile neuroimaging technologies have made it possible to conduct neuroscientific studies directly in naturalistic learning environments. We propose that embedding mobile neuroimaging research in a cycle (Matusz, Dikker, Huth, & Perrodin, 2019), involving lab-based, seminaturalistic, and fully naturalistic experiments, is well suited for addressing educational questions. With this review, we take a cautious approach, by discussing the valuable insights that can be gained from mobile neuroimaging technology, including electroencephalography and functional near-infrared spectroscopy, as well as the challenges posed by bringing neuroscientific methods into the classroom. Research paradigms used alongside mobile neuroimaging technology vary considerably. To illustrate this point, studies are discussed with increasingly naturalistic designs. We conclude with several ethical considerations that should be taken into account in this unique area of research.

Motion artefact removal in electroencephalography and electrocardiography by using multichannel inertial measurement units and adaptive filtering

This paper presents a new active electrode design for electroencephalogram (EEG) and electrocardiogram (ECG) sensors based on inertial measurement units to remove motion artefacts during signal acquisition. Rather than measuring motion data from a single source for the entire recording unit, inertial measurement units are attached to each individual EEG or ECG electrode to collect local movement data. This data is then used to remove the motion artefact by using normalised least mean square adaptive filtering. Results show that the proposed active electrode design can reduce motion contamination from EEG and ECG signals in chest movement and head swinging motion scenarios. However, it is found that the performance varies, necessitating the need for the algorithm to be paired with more sophisticated signal processing to identify scenarios where it is beneficial in terms of improving signal quality. The new instrumentation hardware allows data driven artefact removal to be performed, providing a new data driven approach compared to widely used blind-source separation methods, and helps enable in the wild EEG recordings to be performed.

P300 as a Potential Indicator in the Evaluation of Neurocognitive Disorders After Traumatic Brain Injury

Few objective indices can be used when evaluating neurocognitive disorders after a traumatic brain injury (TBI). P300 has been widely studied in mental disorders, cognitive dysfunction, and brain injury. Daily life ability and social function are key indices in the assessment of neurocognitive disorders after a TBI. The present study focused on the correlation between P300 and impairment of daily living activity and social function. We enrolled 234 patients with neurocognitive disorders after a TBI according to ICD-10 and 277 age- and gender-matched healthy volunteers. The daily living activity and social function were assessed by the social disability screening schedule (SDSS) scale, activity of daily living (ADL) scale, and scale of personality change following a TBI. P300 was evoked by a visual oddball paradigm. The results showed that the scores of the ADL scale, SDSS scale, and scale of personality change in the patient group were significantly higher than those in the control group. The amplitudes of Fz, Cz, and Pz in the patient group were significantly lower than those in the control group and were negatively correlated with the scores of the ADL and SDSS scales. In conclusion, a lower P300 amplitude means a greater impairment of daily life ability and social function, which suggested more severity of neurocognitive disorders after a TBI. P300 could be a potential indicator in evaluating the severity of neurocognitive disorders after a TBI.

The Cognitive Science of Technology

Technology is central to human life but hard to define and study. This review synthesizes advances in fields from anthropology to evolutionary biology and neuroscience to propose an interdisciplinary cognitive science of technology. The foundation of this effort is an evolutionarily motivated definition of technology that highlights three key features: material production, social collaboration, and cultural reproduction. This broad scope respects the complexity of the subject but poses a challenge for theoretical unification. Addressing this challenge requires a comparative approach to reduce the diversity of real-world technological cognition to a smaller number of recurring processes and relationships. To this end, a synthetic perceptual-motor hypothesis (PMH) for the evolutionary-developmental-cultural construction of technological cognition is advanced as an initial target for investigation.

Towards Neuroscience of the Everyday World (NEW) using functional Near-Infrared Spectroscopy

Functional Near-Infrared Spectroscopy (fNIRS) assesses human brain activity by noninvasively measuring changes of cerebral hemoglobin concentrations caused by modulation of neuronal activity. Recent progress in signal processing and advances in system design, such as miniaturization, wearability and system sensitivity, have strengthened fNIRS as a viable and cost-effective complement to functional Magnetic Resonance Imaging (fMRI), expanding the repertoire of experimental studies that can be performed by the neuroscience community. The availability of fNIRS and Electroencephalography (EEG) for routine, increasingly unconstrained, and mobile brain imaging is leading towards a new domain that we term "Neuroscience of the Everyday World" (NEW). In this light, we review recent advances in hardware, study design and signal processing, and discuss challenges and future directions towards achieving NEW.

Affective Neurofeedback Under Naturalistic Conditions: A Mini-Review of Current Achievements and Open Challenges

Affective neurofeedback training allows for the self-regulation of the putative circuits of emotion regulation. This approach has recently been studied as a possible additional treatment for psychiatric disorders, presenting positive effects in symptoms and behaviors. After neurofeedback training, a critical aspect is the transference of the learned self-regulation strategies to outside the laboratory and how to continue reinforcing these strategies in non-controlled environments. In this mini-review, we discuss the current achievements of affective neurofeedback under naturalistic setups. For this, we first provide a brief overview of the state-of-the-art for affective neurofeedback protocols. We then discuss virtual reality as a transitional step toward the final goal of "in-the-wild" protocols and current advances using mobile neurotechnology. Finally, we provide a discussion of open challenges for affective neurofeedback protocols in-the-wild, including topics such as convenience and reliability, environmental effects in attention and workload, among others.

Effect of Static Posture on Online Performance of P300-Based BCIs for TV Control

To implement a practical brain–computer interface (BCI) for daily use, continuing changes in postures while performing daily tasks must be considered in the design of BCIs. To examine whether the performance of a BCI could depend on postures, we compared the online performance of P300-based BCIs built to select TV channels when subjects took sitting, recline, supine, and right lateral recumbent postures during BCI use. Subjects self-reported the degrees of interference, comfort, and familiarity after BCI control in each posture. We found no significant difference in the BCI performance as well as the amplitude and latency of P300 and N200 among the four postures. However, when we compared BCI accuracy outcomes normalized within individuals between two cases where subjects reported relatively more positively or more negatively about using the BCI in a particular posture, we found higher BCI accuracy in those postures for which individual subjects reported more positively. As a result, although the change of postures did not affect the overall performance of P300-based BCIs, the BCI performance varied depending on the degree of postural comfort felt by individual subjects. Our results suggest considering the postural comfort felt by individual BCI users when using a P300-based BCI at home.

Mobile brain/body imaging of landmark-based navigation with high-density EEG

Coupling behavioral measures and brain imaging in naturalistic, ecological conditions is key to comprehend the neural bases of spatial navigation. This highly integrative function encompasses sensorimotor, cognitive, and executive processes that jointly mediate active exploration and spatial learning. However, most neuroimaging approaches in humans are based on static, motion‐constrained paradigms and they do not account for all these processes, in particular multisensory integration. Following the Mobile Brain/Body Imaging approach, we aimed to explore the cortical correlates of landmark‐based navigation in actively behaving young adults, solving a Y‐maze task in immersive virtual reality. EEG analysis identified a set of brain areas matching state‐of‐the‐art brain imaging literature of landmark‐based navigation. Spatial behavior in mobile conditions additionally involved sensorimotor areas related to motor execution and proprioception usually overlooked in static fMRI paradigms. Expectedly, we located a cortical source in or near the posterior cingulate, in line with the engagement of the retrosplenial complex in spatial reorientation. Consistent with its role in visuo‐spatial processing and coding, we observed an alpha‐power desynchronization while participants gathered visual information. We also hypothesized behavior‐dependent modulations of the cortical signal during navigation. Despite finding few differences between the encoding and retrieval phases of the task, we identified transient time–frequency patterns attributed, for instance, to attentional demand, as reflected in the alpha/gamma range, or memory workload in the delta/theta range. We confirmed that combining mobile high‐density EEG and biometric measures can help unravel the brain structures and the neural modulations subtending ecological landmark‐based navigation.

Mobile ear-EEG to study auditory attention in everyday life

Most research investigating auditory perception is conducted in controlled laboratory settings, potentially restricting its generalizability to the complex acoustic environment outside the lab. The present study, in contrast, investigated auditory attention with long-term recordings (> 6 h) beyond the lab using a fully mobile, smartphone-based ear-centered electroencephalography (EEG) setup with minimal restrictions for participants. Twelve participants completed iterations of two variants of an oddball task where they had to react to target tones and to ignore standard tones. A rapid variant of the task (tones every 2 s, 5 min total time) was performed seated and with full focus in the morning, around noon and in the afternoon under controlled conditions. A sporadic variant (tones every minute, 160 min total time) was performed once in the morning and once in the afternoon while participants followed their normal office day routine. EEG data, behavioral data, and movement data (with a gyroscope) were recorded and analyzed. The expected increased amplitude of the P3 component in response to the target tone was observed for both the rapid and the sporadic oddball. Miss rates were lower and reaction times were faster in the rapid oddball compared to the sporadic one. The movement data indicated that participants spent most of their office day at relative rest. Overall, this study demonstrated that it is feasible to study auditory perception in everyday life with long-term ear-EEG.

An Analysis of the External Validity of EEG Spectral Power in an Uncontrolled Outdoor Environment during Default and Complex Neurocognitive States

Traditionally, quantitative electroencephalography (QEEG) studies collect data within controlled laboratory environments that limit the external validity of scientific conclusions. To probe these validity limits, we used a mobile EEG system to record electrophysiological signals from human participants while they were located within a controlled laboratory environment and an uncontrolled outdoor environment exhibiting several moderate background influences. Participants performed two tasks during these recordings, one engaging brain activity related to several complex cognitive functions (number sense, attention, memory, executive function) and the other engaging two default brain states. We computed EEG spectral power over three frequency bands (theta: 4-7 Hz, alpha: 8-13 Hz, low beta: 14-20 Hz) where EEG oscillatory activity is known to correlate with the neurocognitive states engaged by these tasks. Null hypothesis significance testing yielded significant EEG power effects typical of the neurocognitive states engaged by each task, but only a beta-band power difference between the two background recording environments during the default brain state. Bayesian analysis showed that the remaining environment null effects were unlikely to reflect measurement insensitivities. This overall pattern of results supports the external validity of laboratory EEG power findings for complex and default neurocognitive states engaged within moderately uncontrolled environments.

EEG in motion: Using an oddball task to explore motor interference in active skateboarding

Recent advancements in portable computer devices have opened new avenues in the study of human cognition outside research laboratories. This flexibility in methodology has led to the publication of several electroencephalography studies recording brain responses in real-world scenarios such as cycling and walking outside. In the present study, we tested the classic auditory oddball task while participants moved around an indoor running track using an electric skateboard. This novel approach allows for the study of attention in motion while virtually removing body movement. Using the skateboard auditory oddball paradigm, we found reliable and expected standard-target differences in the P3 and MMN/N2b event-related potentials. We also recorded baseline electroencephalography activity and found that, compared to this baseline, alpha power is attenuated in frontal and parietal regions during skateboarding. In order to explore the influence of motor interference in cognitive resources during skateboarding, we compared participants' preferred riding stance (baseline level of riding difficulty) versus their non-preferred stance (increased level of riding difficulty). We found that an increase in riding difficulty did not modulate the P3 and tonic alpha amplitude during skateboard motion. These results suggest that increases in motor demands might not lead to reductions in cognitive resources as shown in previous literature.

Make a Left Turn: Cortico-Striatal Circuitry Mediating the Attentional Control of Complex Movements

BACKGROUND

In movement disorders such as Parkinson's disease (PD), cholinergic signaling is disrupted by the loss of basal forebrain cholinergic neurons, as well as aberrant activity in striatal cholinergic interneurons (ChIs). Several lines of evidence suggest that gait imbalance, a key disabling symptom of PD, may be driven by alterations in high-level frontal cortical and cortico-striatal processing more typically associated with cognitive dysfunction.

METHODS

Here we describe the corticostriatal circuitry that mediates the cognitive-motor interactions underlying such complex movement control. The ability to navigate dynamic, obstacle-rich environments requires the continuous integration of information about the environment with movement selection and sequencing. The cortical-attentional processing of extero- and interoceptive cues requires modulation by cholinergic activity to guide striatal movement control. Cue-derived information is "transferred" to striatal circuitry primarily via fronto-striatal glutamatergic projections.

RESULT

Evidence from parkinsonian fallers and from a rodent model reproducing the dual cholinergic-dopaminergic losses observed in these patients supports the main hypotheses derived from this neuronal circuitry-guided conceptualization of parkinsonian falls. Furthermore, in the striatum, ChIs constitute a particularly critical node for the integration of cortical with midbrain dopaminergic afferents and thus for cues to control movements.

CONCLUSION

Procholinergic treatments that enhance or rescue cortical and striatal mechanisms may improve complex movement control in parkinsonian fallers and perhaps also in older persons suffering from gait disorders and a propensity for falls. © 2021 International Parkinson and Movement Disorder Society.