Mobile Brain/Body Imaging (MoBI) of Physical Interaction with Dynamically Moving Objects

The moving wave: Applications of the mobile EEG approach to study human attention

Although historically confined to traditional research laboratories, electroencephalography (EEG) paradigms are now being applied to study a wide array of behaviors, from daily activities to specialized tasks in diverse fields such as sports science, neurorehabilitation, and education. This transition from traditional to real-world mobile research can provide new tools for understanding attentional processes as they occur naturally. Early mobile EEG research has made progress, despite the large size and wired connections. Recent developments in hardware and software have expanded the possibilities of mobile EEG, enabling a broader range of applications. Despite these advancements, limitations influencing mobile EEG remain that must be overcome to achieve adequate reliability and validity. In this review, we first assess the feasibility of mobile paradigms, including electrode selection, artifact correction techniques, and methodological considerations. This review underscores the importance of ecological, construct, and predictive validity in ensuring the trustworthiness and applicability of mobile EEG findings. Second, we explore studies on attention in naturalistic settings, focusing on replicating classic P3 component studies in mobile paradigms like stationary biking in our lab, and activities such as walking, cycling, and dual-tasking outside of the lab. We emphasize how the mobile approach complements traditional laboratory paradigms and the types of insights gained in naturalistic research settings. Third, we discuss promising applications of portable EEG in workplace safety and other areas including road safety, rehabilitation medicine, and brain-computer interfaces. In summary, this review explores the expanding possibilities of mobile EEG while recognizing the existing challenges in fully realizing its potential.

A systematic review of mobile brain/body imaging studies using the P300 event-related potentials to investigate cognition beyond the laboratory

The P300 ERP component, related to the onset of task-relevant or infrequent stimuli, has been widely used in the Mobile Brain/Body Imaging (MoBI) literature. This systematic review evaluates the quality and breadth of P300 MoBI studies, revealing a maturing field with well-designed research yet grappling with standardization and global representation challenges. While affirming the reliability of measuring P300 ERP components in mobile settings, the review identifies significant hurdles in standardizing data cleaning and processing techniques, impacting comparability and reproducibility. Geographical disparities emerge, with studies predominantly in the Global North and a dearth of research from the Global South, emphasizing the need for broader inclusivity to counter the WEIRD bias in psychology. Collaborative projects and mobile EEG systems showcase the feasibility of reaching diverse populations, which is essential to advance precision psychiatry and to integrate varied data streams. Methodologically, a trend toward ecological validity is noted, shifting from lab-based to real-world settings with portable EEG system advancements. Future hardware developments are expected to balance signal quality and sensor intrusiveness, enriching data collection in everyday contexts. Innovative methodologies reflect a move toward more natural experimental settings, prompting critical questions about the applicability of traditional ERP markers, such as the P300 outside structured paradigms. The review concludes by highlighting the crucial role of integrating mobile technologies, physiological sensors, and machine learning to advance cognitive neuroscience. It advocates for an operational definition of ecological validity to bridge the gap between controlled experiments and the complexity of embodied cognitive experiences, enhancing both theoretical understanding and practical application in study design.

Maintaining Task Performance Levels Under Cognitive Load While Walking Requires Widespread Reallocation of Neural Resources

This study elucidates the neural mechanisms underlying increasing cognitive load while walking by employing 2 versions of a response inhibition task, the '1-back' version and the more cognitively demanding '2-back' version. By using the Mobile Brain/Body Imaging (MoBI) modality, electroencephalographic (EEG) activity, three-dimensional (3D) gait kinematics and task-related behavioral responses were collected while young adults (n = 61) performed either the 1-back or 2-back response inhibition task. Interestingly, increasing inhibitory difficulty from 1-back to 2-back during walking was not associated with any detectable costs in response accuracy, response speed, or gait consistency. However, the more difficult cognitive task was associated with distinct EEG component changes during both successful inhibitions (correct rejections) and successful executions (hits) of the motor response. During correct rejections, ERP changes were found over frontal regions, during latencies related to sensory gain control, conflict monitoring and working memory storage and processing. During hits, ERP changes were found over left-parietal regions during latencies related to orienting attention and subsequent selection and execution of the motor plan. The pattern of attenuation in walking-related EEG amplitude changes, during 2-back task performance, is thought to reflect more effortful recalibration of neural processes, a mechanism which might be a key driver of performance maintenance in the face of increased cognitive demands while walking. Overall, the present findings shed light on the extent of the neurocognitive capacity of young adults and may lead to a better understanding of how factors such as aging or neurological disorders could impinge on this capacity.

Investigation of brain mechanisms underlying upper limb function in bilateral cerebral palsy using EEG

OBJECTIVE

Few studies focus on upper limbs in bilateral cerebral palsy (CP) despite potential bimanual deficits. Electroencephalography (EEG) was utilized to investigate brain mechanisms underlying upper limb tasks in bilateral CP and typical development (TD) and relationships to function.

METHODS

26 (14 CP; 12 TD) completed the Box and Blocks Test and transport task with paper, sponge or mixed blocks, while recording EEG and motion data.

RESULTS

Group effects for path time, path length and Box and Blocks Test revealed bimanual deficits. Four sensorimotor-related EEG clusters were identified. Group effects were found in premotor and dominant motor clusters with greater beta event-related desynchronization (ERD) in CP. Hand and hand by group effects were found in the dominant motor cluster, showing greater ERD with the more affected hand in CP. Condition effects were prominent in the posterior parietal cluster with higher ERD reflecting greater difficulty in force modulation.

CONCLUSIONS

Higher brain activation associated with greater bimanual deficits is similar to our lower limb findings but contrasts studies in TD or unilateral CP linking higher ERD to greater proficiency.

SIGNIFICANCE

Bilateral CP shows overreliance on the dominant hemisphere with the less functional hand and higher brain activity presumably related to excessive intracortical connectivity.

The brain in motion-cognitive effects of simultaneous motor activity

During the last 30 years, a large number of behavioral studies have investigated the effect of simultaneous exercise on cognitive functions. The heterogeneity of the results has been attributed to different parameters, such as intensity or modality of physical activity, and the investigated cognitive processes. More recent methodological improvements have enabled to record electroencephalography (EEG) during physical exercise. EEG studies combining cognitive tasks with exercise have described predominantly detrimental effects on cognitive processes and EEG parameters. However, differences in the underlying rationale and the design of EEG versus behavioral studies make direct comparisons between both types of studies difficult. In this narrative review of dual-task experiments we evaluated behavioral and EEG studies and discuss possible explanations for the heterogeneity of results and for the discrepancy between behavioral and EEG studies. Furthermore, we provide a proposal for future EEG studies on simultaneous motion to be a useful complement to behavioral studies. A crucial factor might be to find for each cognitive function the motor activity that matches this function in terms of attentional focus. This hypothesis should be investigated systematically in future studies.

Paradoxical improvement of cognitive control in older adults under dual-task walking conditions is associated with more flexible reallocation of neural resources: A Mobile Brain-Body Imaging (MoBI) study

Combining walking with a demanding cognitive task is traditionally expected to elicit decrements in gait and/or cognitive task performance. However, it was recently shown that, in a cohort of young adults, most participants improved performance when walking was added to performance of a Go/NoGo response inhibition task. The present study aims to extend these previous findings to an older adult cohort, to investigate whether this improvement when dual-tasking is observed in healthy older adults. Mobile Brain/Body Imaging (MoBI) was used to record electroencephalographic (EEG) activity, three-dimensional (3D) gait kinematics and behavioral responses in the Go/NoGo task, during sitting or walking on a treadmill, in 34 young adults and 37 older adults. Increased response accuracy during walking, independent of age, was found to correlate with slower responses to stimuli (r = 0.44) and with walking-related EEG amplitude modulations over frontocentral regions (r = 0.47) during the sensory gating (N1) and conflict monitoring (N2) stages of inhibition, and over left-lateralized prefrontal regions (r = 0.47) during the stage of inhibitory control implementation. These neural activity changes are related to the cognitive component of inhibition, and they were interpreted as signatures of behavioral improvement during walking. On the other hand, aging, independent of response accuracy during walking, was found to correlate with slower treadmill walking speeds (r = -0.68) and attenuation in walking-related EEG amplitude modulations over left-dominant frontal (r = -0.44) and parietooccipital regions (r = 0.48) during the N2 stage, and over centroparietal regions (r = 0.48) during the P3 stage. These neural activity changes are related to the motor component of inhibition, and they were interpreted as signatures of aging. Older adults whose response accuracy 'paradoxically' improved during walking manifested neural signatures of both behavioral improvement and aging, suggesting that their flexibility in reallocating neural resources while walking might be maintained for the cognitive but not for the motor inhibitory component. These distinct neural signatures of aging and behavior can potentially be used to identify 'super-agers', or individuals at risk for cognitive decline due to aging or neurodegenerative disease.

Neuroergonomics on the Go: An Evaluation of the Potential of Mobile EEG for Workplace Assessment and Design

OBJECTIVE

We demonstrate and discuss the use of mobile electroencephalogram (EEG) for neuroergonomics. Both technical state of the art as well as measures and cognitive concepts are systematically addressed.

BACKGROUND

Modern work is increasingly characterized by information processing. Therefore, the examination of mental states, mental load, or cognitive processing during work is becoming increasingly important for ergonomics.

RESULTS

Mobile EEG allows to measure mental states and processes under real live conditions. It can be used for various research questions in cognitive neuroergonomics. Besides measures in the frequency domain that have a long tradition in the investigation of mental fatigue, task load, and task engagement, new approaches-like blink-evoked potentials-render event-related analyses of the EEG possible also during unrestricted behavior.

CONCLUSION

Mobile EEG has become a valuable tool for evaluating mental states and mental processes on a highly objective level during work. The main advantage of this technique is that working environments don't have to be changed while systematically measuring brain functions at work. Moreover, the workflow is unaffected by such neuroergonomic approaches.

Functional near-infrared spectroscopy is a useful tool for multi-perspective psychobiological study of neurophysiological correlates of parenting behaviour

The quality of the relationship between caregiver and child has long-term effects on the cognitive and socio-emotional development of children. A process involved in human parenting is the bio-behavioural synchrony that occurs between the partners in the relationship during interaction. Through interaction, bio-behavioural synchronicity allows the adaptation of the physiological systems of the parent to those of the child and promotes the positive development and modelling of the child's social brain. The role of bio-behavioural synchrony in building social bonds could be investigated using functional near-infrared spectroscopy (fNIRS). In this paper we have (a) highlighted the importance of the quality of the caregiver-child relationship for the child's cognitive and socio-emotional development, as well as the relevance of infantile stimuli in the activation of parenting behaviour; (b) discussed the tools used in the study of the neurophysiological substrates of the parental response; (c) proposed fNIRS as a particularly suitable tool for the study of parental responses; and (d) underlined the need for a multi-systemic psychobiological approach to understand the mechanisms that regulate caregiver-child interactions and their bio-behavioural synchrony. We propose to adopt a multi-system psychobiological approach to the study of parental behaviour and social interaction.

Virtual Reality for Spatial Navigation

Immersive virtual reality (VR) allows its users to experience physical space in a non-physical world. It has developed into a powerful research tool to investigate the neural basis of human spatial navigation as an embodied experience. The task of wayfinding can be carried out by using a wide range of strategies, leading to the recruitment of various sensory modalities and brain areas in real-life scenarios. While traditional desktop-based VR setups primarily focus on vision-based navigation, immersive VR setups, especially mobile variants, can efficiently account for motor processes that constitute locomotion in the physical world, such as head-turning and walking. When used in combination with mobile neuroimaging methods, immersive VR affords a natural mode of locomotion and high immersion in experimental settings, designing an embodied spatial experience. This in turn facilitates ecologically valid investigation of the neural underpinnings of spatial navigation.

Exergaming in older adults: the effects of game characteristics on brain activity and physical activity

Introduction

Exergames are increasingly used in rehabilitation settings for older adults to train physical and cognitive abilities. To meet the potential that exergames hold, they need to be adapted to the individual abilities of the player and their training objectives. Therefore, it is important to know whether and how game characteristics affect their playing. The aim of this study is to investigate the effect of two different kinds of exergame (step game and balance game) played at two difficulty levels on brain activity and physical activity.

Methods

Twenty-eight older independently living adults played two different exergames at two difficulty levels each. In addition, the same movements as during gaming (leaning sideways with feet in place and stepping sideways) were performed as reference movements. Brain activity was recorded using a 64-channel EEG system to assess brain activity, while physical activity was recorded using an accelerometer at the lower back and a heart rate sensor. Source-space analysis was applied to analyze the power spectral density in theta (4 Hz-7 Hz) and alpha-2 (10 Hz-12 Hz) frequency bands. Vector magnitude was applied to the acceleration data.

Results

Friedman ANOVA revealed significantly higher theta power for the exergaming conditions compared to the reference movement for both games. Alpha-2 power showed a more diverse pattern which might be attributed to task-specific conditions. Acceleration decreased significantly from the reference movement to the easy condition to the hard condition for both games.

Discussion

The results indicate that exergaming increases frontal theta activity irrespective of type of game or difficulty level, while physical activity decreases with increasing difficulty level. Heart rate was found to be an inappropriate measure in this population older adults. These findings contribute to understanding of how game characteristics affect physical and cognitive activity and consequently need to be taken into account when choosing appropriate games and game settings for exergame interventions.

HArtMuT-modeling eye and muscle contributors in neuroelectric imaging

Objective.Magneto- and electroencephalography (M/EEG) measurements record a mix of signals from the brain, eyes, and muscles. These signals can be disentangled for artifact cleaning e.g. using spatial filtering techniques. However, correctly localizing and identifying these components relies on head models that so far only take brain sources into account.Approach.We thus developed the Head Artifact Model using Tripoles (HArtMuT). This volume conduction head model extends to the neck and includes brain sources as well as sources representing eyes and muscles that can be modeled as single dipoles, symmetrical dipoles, and tripoles. We compared a HArtMuT four-layer boundary element model (BEM) with the EEGLAB standard head model on their localization accuracy and residual variance (RV) using a HArtMuT finite element model (FEM) as ground truth. We also evaluated the RV on real-world data of mobile participants, comparing different HArtMuT BEM types with the EEGLAB standard head model.Main results.We found that HArtMuT improves localization for all sources, especially non-brain, and localization error and RV of non-brain sources were in the same range as those of brain sources. The best results were achieved by using cortical dipoles, muscular tripoles, and ocular symmetric dipoles, but dipolar sources alone can already lead to convincing results.Significance.We conclude that HArtMuT is well suited for modeling eye and muscle contributions to the M/EEG signal. It can be used to localize sources and to identify brain, eye, and muscle components. HArtMuT is freely available and can be integrated into standard software.

Embodiment for Robotic Lower-Limb Exoskeletons: A Narrative Review

Research on embodiment of objects external to the human body has revealed important information about how the human nervous system interacts with robotic lower limb exoskeletons. Typical robotic exoskeleton control approaches view the controllers as an external agent intending to move in coordination with the human. However, principles of embodiment suggest that the exoskeleton controller should ideally coordinate with the human such that the nervous system can adequately model the input-output dynamics of the exoskeleton controller. Measuring embodiment of exoskeletons should be a necessary step in the exoskeleton development and prototyping process. Researchers need to establish high fidelity quantitative measures of embodiment, rather than relying on current qualitative survey measures. Mobile brain imaging techniques, such as high-density electroencephalography, is likely to provide a deeper understanding of embodiment during human-machine interactions and advance exoskeleton research and development. In this review we show why future exoskeleton research should include quantitative measures of embodiment as a metric of success.

Understanding action concepts from videos and brain activity through subjects' consensus

In this paper, we investigate brain activity associated with complex visual tasks, showing that electroencephalography (EEG) data can help computer vision in reliably recognizing actions from video footage that is used to stimulate human observers. Notably, we consider not only typical "explicit" video action benchmarks, but also more complex data sequences in which action concepts are only referred to, implicitly. To this end, we consider a challenging action recognition benchmark dataset-Moments in Time-whose video sequences do not explicitly visualize actions, but only implicitly refer to them (e.g., fireworks in the sky as an extreme example of "flying"). We employ such videos as stimuli and involve a large sample of subjects to collect a high-definition, multi-modal EEG and video data, designed for understanding action concepts. We discover an agreement among brain activities of different subjects stimulated by the same video footage. We name it as subjects consensus, and we design a computational pipeline to transfer knowledge from EEG to video, sharply boosting the recognition performance.

IC-U-Net: A U-Net-based Denoising Autoencoder Using Mixtures of Independent Components for Automatic EEG Artifact Removal

Electroencephalography (EEG) signals are often contaminated with artifacts. It is imperative to develop a practical and reliable artifact removal method to prevent the misinterpretation of neural signals and the underperformance of brain-computer interfaces. Based on the U-Net architecture, we developed a new artifact removal model, IC-U-Net, for removing pervasive EEG artifacts and reconstructing brain signals. IC-U-Net was trained using mixtures of brain and non-brain components decomposed by independent component analysis. It uses an ensemble of loss functions to model complex signal fluctuations in EEG recordings. The effectiveness of the proposed method in recovering brain activities and removing various artifacts (e.g., eye blinks/movements, muscle activities, and line/channel noise) was demonstrated in a simulation study and four real-world EEG experiments. IC-U-Net can reconstruct a multi-channel EEG signal and is applicable to most artifact types, offering a promising end-to-end solution for automatically removing artifacts from EEG recordings. It also meets the increasing need to image natural brain dynamics in a mobile setting. The code and pre-trained IC-U-Net model are available at https://github.com/roseDwayane/AIEEG.

Changes in brain activity of trainees during laparoscopic surgical virtual training assessed with electroencephalography

OBJECTIVE

Evaluate changes in brain activity of trainees during laparoscopic surgical training from electroencephalographic (EEG) signals in an ecological scenario with few restrictions for the user. Design Longitudinal study with two follow-up measurements in the first and last session of a 4-week training with LapSim laparoscopic surgery simulator. Variables analyzed include EEG neuronal activations in theta and alpha bands, tasks performance measures, and subjective measures such as perception of mental workload. Setting Medical School, Universidad de Antioquia, Medellin, Colombia. Participants First-year surgical residents (n = 16, age = 28.0 ± 2.6 years old, right-handed, 9 females) RESULTS: Significant improvements in tasks performance were found together with changes in neuronal activity over frontal and parietal cortex. These changes were also correlated with task performance through training sessions.

CONCLUSIONS

The use of neurophysiological measures such as electroencephalography combined with source separation techniques allows evaluating neural changes associated with motor training. The experiment proposed in this work establishes less controlled recording conditions leading to a more realistic analysis scenario to cognitive assessment in residents training.

Using OPMs to measure neural activity in standing, mobile participants

Optically pumped magnetometer-based magnetoencephalography (OP-MEG) can be used to measure neuromagnetic fields while participants move in a magnetically shielded room. Head movements in previous OP-MEG studies have been up to 20 cm translation and ∼30° rotation in a sitting position. While this represents a step-change over stationary MEG systems, naturalistic head movement is likely to exceed these limits, particularly when participants are standing up. In this proof-of-concept study, we sought to push the movement limits of OP-MEG even further. Using a 90 channel (45-sensor) whole-head OP-MEG system and concurrent motion capture, we recorded auditory evoked fields while participants were: (i) sitting still, (ii) standing up and still, and (iii) standing up and making large natural head movements continuously throughout the recording - maximum translation 120 cm, maximum rotation 198°. Following pre-processing, movement artefacts were substantially reduced but not eliminated. However, upon utilisation of a beamformer, the M100 event-related field localised to primary auditory regions. Furthermore, the event-related fields from auditory cortex were remarkably consistent across the three conditions. These results suggest that a wide range of movement is possible with current OP-MEG systems. This in turn underscores the exciting potential of OP-MEG for recording neural activity during naturalistic paradigms that involve movement (e.g. navigation), and for scanning populations who are difficult to study with stationary MEG (e.g. young children).

Correcting whole-body motion capture data using rigid body transformation

Using motion capture data as a part of mobile brain-body imaging (MoBI) recording has been increasing. With minimal linear algebra background, this paper explains how the rigid body transformation can be a useful preprocessing step for denoising and missing marker recovery. Such a transformation can provide insight and necessary-and-sufficient solutions requiring no assumption other than the minimum number of markers present. First, a simulation test using the empirical datasets from the AudioMaze project published from this journal's same volume demonstrates theoretical accuracy. The simulation results show that the rigid-body method perfectly recovers missing markers on a rigid body if a minimum of three marker positions is available. Second, the same transformation is applied to the empirical dataset. Before preprocessing, the raw data show that 15-80% of data frames had all markers present for rigid-body defined body parts. After using the rigid-body correction, most body parts recovered full markers in 90-95% of the data frames. The result also suggests the necessity for performing across-trial corrections for within-participant (42% missing detected in one of the body parts) and across-participants (11% missing). The discussion section introduces a solution and a performance summary for non-rigid-body marker correction using a neural network. Data support that the rigid body transformation is an intuitive and powerful correction method necessary for preprocessing motion capture data for neurocognitive experiments. The supporting information section contains a URL link to Matlab code and example data.

EEG in motion: Using an oddball task to explore motor interference in active skateboarding

Recent advancements in portable computer devices have opened new avenues in the study of human cognition outside research laboratories. This flexibility in methodology has led to the publication of several electroencephalography studies recording brain responses in real-world scenarios such as cycling and walking outside. In the present study, we tested the classic auditory oddball task while participants moved around an indoor running track using an electric skateboard. This novel approach allows for the study of attention in motion while virtually removing body movement. Using the skateboard auditory oddball paradigm, we found reliable and expected standard-target differences in the P3 and MMN/N2b event-related potentials. We also recorded baseline electroencephalography activity and found that, compared to this baseline, alpha power is attenuated in frontal and parietal regions during skateboarding. In order to explore the influence of motor interference in cognitive resources during skateboarding, we compared participants' preferred riding stance (baseline level of riding difficulty) versus their non-preferred stance (increased level of riding difficulty). We found that an increase in riding difficulty did not modulate the P3 and tonic alpha amplitude during skateboard motion. These results suggest that increases in motor demands might not lead to reductions in cognitive resources as shown in previous literature.

Stance leg and surface stability modulate cortical activity during human single leg stance

Mobile Electroencephalography (EEG) provides insights into cortical contributions to postural control. Although changes in theta (4–8 Hz) and alpha frequency power (8–12 Hz) were shown to reflect attentional and sensorimotor processing during balance tasks, information about the effect of stance leg on cortical processing related to postural control is lacking. Therefore, the aim was to examine patterns of cortical activity during single-leg stance with varying surface stability. EEG and force plate data from 21 healthy males (22.43 ± 2.23 years) was recorded during unipedal stance (left/right) on a stable and unstable surface. Using source-space analysis, power spectral density was analyzed in the theta, alpha-1 (8–10 Hz) and alpha-2 (10–12 Hz) frequency bands. Repeated measures ANOVA with the factors leg and surface stability revealed significant interaction effects in the left (p = 0.045, η_p² = 0.13) and right motor clusters (F = 16.156; p = 0.001, η_p² = 0.41). Furthermore, significant main effects for surface stability were observed for the fronto-central cluster (theta), left and right motor (alpha-1), as well as for the right parieto-occipital cluster (alpha-1/alpha-2). Leg dependent changes in alpha-2 power may indicate lateralized patterns of cortical processing in motor areas during single-leg stance. Future studies may therefore consider lateralized patterns of cortical activity for the interpretation of postural deficiencies in unilateral lower limb injuries.

Dance on the Brain: Enhancing Intra- and Inter-Brain Synchrony

Dance has traditionally been viewed from a Eurocentric perspective as a mode of self-expression that involves the human body moving through space, performed for the purposes of art, and viewed by an audience. In this Hypothesis and Theory article, we synthesize findings from anthropology, sociology, psychology, dance pedagogy, and neuroscience to propose The Synchronicity Hypothesis of Dance, which states that humans dance to enhance both intra- and inter-brain synchrony. We outline a neurocentric definition of dance, which suggests that dance involves neurobehavioral processes in seven distinct areas including sensory, motor, cognitive, social, emotional, rhythmic, and creative. We explore The Synchronicity Hypothesis of Dance through several avenues. First, we examine evolutionary theories of dance, which suggest that dance drives interpersonal coordination. Second, we examine fundamental movement patterns, which emerge throughout development and are omnipresent across cultures of the world. Third, we examine how each of the seven neurobehaviors increases intra- and inter-brain synchrony. Fourth, we examine the neuroimaging literature on dance to identify the brain regions most involved in and affected by dance. The findings presented here support our hypothesis that we engage in dance for the purpose of intrinsic reward, which as a result of dance-induced increases in neural synchrony, leads to enhanced interpersonal coordination. This hypothesis suggests that dance may be helpful to repattern oscillatory activity, leading to clinical improvements in autism spectrum disorder and other disorders with oscillatory activity impairments. Finally, we offer suggestions for future directions and discuss the idea that our consciousness can be redefined not just as an individual process but as a shared experience that we can positively influence by dancing together.

The impact of hand movement velocity on cognitive conflict processing in a 3D object selection task in virtual reality

Detecting and correcting incorrect body movements is an essential part of everyday interaction with one's environment. The human brain provides a monitoring system that constantly controls and adjusts our actions according to our surroundings. However, when our brain's predictions about a planned action do not match the sensory inputs resulting from that action, cognitive conflict occurs. Much is known about cognitive conflict in 1D/2D environments; however, less is known about the role of movement characteristics associated with cognitive conflict in 3D environment. Hence, we devised an object selection task in a virtual reality (VR) environment to test how the velocity of hand movements impacts human brain responses. From a series of analyses of EEG recordings synchronized with motion capture, we found that the velocity of the participants' hand movements modulated the brain's response to proprioceptive feedback during the task and induced a prediction error negativity (PEN). Additionally, the PEN originates in the anterior cingulate cortex and is itself modulated by the ballistic phase of the hand's movement. These findings suggest that velocity is an essential component of integrating hand movements with visual and proprioceptive information during interactions with real and virtual objects.

Using the MoBI motion capture system to rapidly and accurately localize EEG electrodes in anatomic space

During mobile brain/body imaging (MoBI) experiments, electroencephalography and motion capture systems are used in concert to record high temporal resolution neural activity and movement kinematics while participants perform demanding perceptual and cognitive tasks in a naturalistic environment. A typical MoBI setup involves positioning multi‐channel electrode caps based on anatomical fiducials as well as experimenter and participant intuition regarding the scalp midpoint location (i.e., Cz). Researchers often use the “template” electrode locations provided by the manufacturer, however, the “actual” electrode locations can vary based on each participant's head morphology. Accounting for differences in head morphologies could provide more accurate clinical diagnostic information when using MoBI to identify neurological deficits in patients with motor, sensory, or cognitive impairments. Here, we asked whether the existing motion capture system used in a MoBI setup could be easily adapted to improve spatial localization of electrodes across participants without requiring additional or specialized equipment that might impede clinical adoption. Using standard electrode configurations, infrared markers were placed on a subset of electrodes and anatomical fiducials, and the remaining electrode locations were estimated using spherical or ellipsoid models. We identified differences in event‐related potentials between “template” and “actual” electrode locations during a Go/No‐Go task (p < 9.8e–5) and an object‐manipulation task (p < 9.8e–5). Thus, the motion capture system already used in MoBI experiments can be effectively deployed to accurately register and quantify the neural activity. Improving the spatial localization without needing specialized hardware or additional setup time to the workflow has important real‐world implications for translating MoBI to clinical environments.

Peripheral visual perception during natural overground dual-task walking in older and younger adults

Little is known about the neurophysiological processes underlying visual processing during active behavior and how these change over the life span. This study investigated early (P1) and later (P3) event-related potentials of the electroencephalogram associated with visual perception in older and younger adults while sitting, standing, and walking. While sitting and standing, accurate performance in both groups was not associated with event-related potential characteristics. During walking, in contrast, prolonged latencies and reduced amplitudes of the P1 were related to slower responses and increased misses, respectively. No covariations of behavior and P3 characteristics were observed. However, prolonged P3 latencies with increasing motor task complexity were present for both age groups, and reduced amplitudes while walking were replicated in younger participants. Older participants were more affected by walking in general as reflected in slower walking speeds as well as reduced accuracy and relative P1 amplitudes. These results provide further insights into cognitive-motor interference during natural walking in younger and older adults on early attentional-perceptual processing stages, even for simple additional visual tasks.

Imaging the human hippocampus with optically-pumped magnetoencephalography

Optically-pumped (OP) magnetometers allow magnetoencephalography (MEG) to be performed while a participant's head is unconstrained. To fully leverage this new technology, and in particular its capacity for mobility, the activity of deep brain structures which facilitate explorative behaviours such as navigation, must be detectable using OP-MEG. One such crucial brain region is the hippocampus. Here we had three healthy adult participants perform a hippocampal-dependent task - the imagination of novel scene imagery - while being scanned using OP-MEG. A conjunction analysis across these three participants revealed a significant change in theta power in the medial temporal lobe. The peak of this activated cluster was located in the anterior hippocampus. We repeated the experiment with the same participants in a conventional SQUID-MEG scanner and found similar engagement of the medial temporal lobe, also with a peak in the anterior hippocampus. These OP-MEG findings indicate exciting new opportunities for investigating the neural correlates of a range of crucial cognitive functions in naturalistic contexts including spatial navigation, episodic memory and social interactions.

Utilizing High-Density Electroencephalography and Motion Capture Technology to Characterize Sensorimotor Integration While Performing Complex Actions

Studies of sensorimotor integration often use sensory stimuli that require a simple motor response, such as a reach or a grasp. Recent advances in neural recording techniques, motion capture technologies, and time-synchronization methods enable studying sensorimotor integration using more complex sensory stimuli and performed actions. Here, we demonstrate that prehensile actions that require using complex sensory instructions for manipulating different objects can be characterized using high-density electroencephalography and motion capture systems. In 20 participants, we presented stimuli in different sensory modalities (visual, auditory) containing different contextual information about the object with which to interact. Neural signals recorded near motor cortex and posterior parietal cortex discharged based on both the instruction delivered and object manipulated. Additionally, kinematics of the wrist movements could be discriminated between participants. These findings demonstrate a proof-of-concept behavioral paradigm for studying sensorimotor integration of multidimensional sensory stimuli to perform complex movements. The designed framework will prove vital for studying neural control of movements in clinical populations in which sensorimotor integration is impaired due to information no longer being communicated correctly between brain regions (e.g. stroke). Such a framework is the first step towards developing a neural rehabilitative system for restoring function more effectively.

Dry EEG in Sports Sciences: A Fast and Reliable Tool to Assess Individual Alpha Peak Frequency Changes Induced by Physical Effort

Novel state-of-the-art amplifier and cap systems enable Electroencephalography (EEG) recording outside of stationary lab systems during physical exercise and body motion. However, extensive preparation time, cleaning, and limited long-term stability of conventional gel-based electrode systems pose significant limitations in out-of-the-lab conditions. Dry electrode systems may contribute to rapid and repetitive mobile EEG acquisition with significantly reduced preparation time, reduced cleaning requirements, and possible self-application by the volunteer but are known for higher channel failure probability and increased sensitivity to movement artifacts. We performed a counterbalanced repeated measure endurance cycling study to objectively validate the performance and applicability of a novel commercially available 64-channel dry electrode cap for sport science. A total of 17 healthy volunteers participated in the study, performing an endurance cycling paradigm comprising five phases: (I) baseline EEG, (II) pre-cycling EEG, (III) endurance cycling, (IV) active recovery, and (V) passive recovery. We compared the performance of the 64-channel dry electrode cap with a commercial gel-based cap system in terms of usability metrics, reliability, and signal characteristics. Furthermore, we validated the performance of the dry cap during a realistic sport science investigation, verifying the hypothesis of a systematic, reproducible shift of the individual alpha peak frequency (iAPF) induced by physical effort. The average preparation time of the dry cap was one-third of the gel-based electrode caps. The average channel reliability of the dry cap varied between 80 ± 15% (Phase I), 66 ± 19% (Phase III), and 91 ± 10% (Phase V). In comparison, the channel reliability of the gel-based cap varied between 95 ± 3, 85 ± 9, and 82 ± 9%, respectively. No considerable differences were evident for the comfort evaluations nor the signal characteristics of both caps. A within-volunteers repeated measure analysis of variance (RM-ANOVA) did not show significant effects of the electrode type on the iAPF [F(1,12) = 1.670, p = 0.221, ηp2 = 0.122, Power = 0.222]. However, a significant increase of the iAPF exists from Phase II to Phases IV and V due to exhaustive physical task. In conclusion, we demonstrated that dry electrode cap is equivalent to the gel-based electrode cap based on signal characteristics, comfort, and signal information content, thereby confirming the usefulness of dry electrodes in sports science and other mobile applications involving ample movement.

A Riemannian Modification of Artifact Subspace Reconstruction for EEG Artifact Handling

Artifact Subspace Reconstruction (ASR) is an adaptive method for the online or offline correction of artifacts comprising multichannel electroencephalography (EEG) recordings. It repeatedly computes a principal component analysis (PCA) on covariance matrices to detect artifacts based on their statistical properties in the component subspace. We adapted the existing ASR implementation by using Riemannian geometry for covariance matrix processing. EEG data that were recorded on smartphone in both outdoors and indoors conditions were used for evaluation (N = 27). A direct comparison between the original ASR and Riemannian ASR (rASR) was conducted for three performance measures: reduction of eye-blinks (sensitivity), improvement of visual-evoked potentials (VEPs) (specificity), and computation time (efficiency). Compared to ASR, our rASR algorithm performed favorably on all three measures. We conclude that rASR is suitable for the offline and online correction of multichannel EEG data acquired in laboratory and in field conditions.

Eye Tracking in Virtual Reality

The intent of this paper is to provide an introduction into the bourgeoning field of eye tracking in Virtual Reality (VR). VR itself is an emerging technology on the consumer market, which will create many new opportunities in research. It offers a lab environment with high immersion and close alignment with reality. An experiment which is using VR takes place in a highly controlled environment and allows for a more in-depth amount of information to be gathered about the actions of a subject. Techniques for eye tracking were introduced more than a century ago and are now an established technique in psychological experiments, yet recent development makes it versatile and affordable. In combination, these two techniques allow unprecedented monitoring and control of human behavior in semi-realistic conditions. This paper will explore the methods and tools which can be applied in the implementation of experiments using eye tracking in VR following the example of one case study. Accompanying the technical descriptions, we present research that displays the effectiveness of the technology and show what kind of results can be obtained when using eye tracking in VR. It is meant to guide the reader through the process of bringing VR in combination with eye tracking into the lab and to inspire ideas for new experiments.

Mobile EEG in research on neurodevelopmental disorders: Opportunities and challenges

Mobile electroencephalography (mobile EEG) represents a next-generation neuroscientific technology – to study real-time brain activity – that is relatively inexpensive, non-invasive and portable. Mobile EEG leverages state-of-the-art hardware alongside established advantages of traditional EEG and recent advances in signal processing. In this review, we propose that mobile EEG could open unprecedented possibilities for studying neurodevelopmental disorders. We first present a brief overview of recent developments in mobile EEG technologies, emphasising the proliferation of studies in several neuroscientific domains. As these developments have yet to be exploited by neurodevelopmentalists, we then identify three research opportunities: 1) increase in the ease and flexibility of brain data acquisition in neurodevelopmental populations; 2) integration into powerful developmentally-informative research designs; 3) development of innovative non-stationary EEG-based paradigms. Critically, we address key challenges that should be considered to fully realise the potential of mobile EEG for neurodevelopmental research and for understanding developmental psychopathology more broadly, and suggest future research directions.

Tracking Economic Value of Products in Natural Settings: A Wireless EEG Study

Economic decision making refers to the process of individuals translating their preference into subjective value (SV). Little is known about the dynamics of the neural processes that underpin this form of value-based decision making and no studies have investigated these processes outside of controlled laboratory settings. The current study investigated the spatio-temporal dynamics that accompany economic valuation of products using mobile electroencephalography (EEG) and eye tracking techniques. Participants viewed and rated images of household products in a gallery setting while EEG and eye tracking data were collected wirelessly. A Becker-DeGroot-Marschak (BDM) auction task was subsequently used to quantify the individual's willingness to pay (WTP) for each product. WTP was used to classify products into low, low medium, high medium and high economic value conditions. Eye movement related potentials (EMRP) were examined, and independent component analysis (ICA) was used to separate sources of activity from grand averaged EEG data. Four independent components (ICs) of EMRPs were modulated by WTP (i.e., SV) in the latency range of 150-250 ms. Of the four value-sensitive ICs, one IC displayed enhanced amplitude for all value conditions excluding low value, and another IC presented enhanced amplitude for low value products only. The remaining two value-sensitive ICs resolved inter-mediate levels of SV. Our study quantified, for the first time, the neural processes involved in economic value based decisions in a natural setting. Results suggest that multiple spatio-temporal brain activation patterns mediate the attention and aversion of products which could reflect an early valuation system. The EMRP parietal P200 component could reflect an attention allocation mechanism that separates the lowest-value products (IC7) from products of all other value (IC4), suggesting that low-value items are categorized early on as being aversive. While none of the ICs showed linear amplitude changes that parallel SV's of products, results suggest that a combination of multiple components may sub-serve a fine-grained resolution of the SV of products.

Investigating Established EEG Parameter During Real-World Driving

In real life, behavior is influenced by dynamically changing contextual factors and is rarely limited to simple tasks and binary choices. For a meaningful interpretation of brain dynamics underlying more natural cognitive processing in active humans, ecologically valid test scenarios are essential. To understand whether brain dynamics in restricted artificial lab settings reflect the neural activity in complex natural environments, we systematically tested the auditory event-related P300 in both settings. We developed an integrative approach comprising an initial P300-study in a highly controlled laboratory set-up and a subsequent validation within a realistic driving scenario. Using a simulated dialog with a speech-based input system, increased P300 amplitudes reflected processing of infrequent and incorrect auditory feedback events in both the laboratory setting and the real world setup. Environmental noise and movement-related activity in the car driving scenario led to higher data rejection rates but revealed comparable theta and alpha frequency band pattern. Our results demonstrate the possibility to investigate cognitive functions like context updating in highly artifact prone driving scenarios and encourage the consideration of more realistic task settings in prospective brain imaging approaches.

Navigation in Real-World Environments: New Opportunities Afforded by Advances in Mobile Brain Imaging

A central question in neuroscience and psychology is how the mammalian brain represents the outside world and enables interaction with it. Significant progress on this question has been made in the domain of spatial cognition, where a consistent network of brain regions that represent external space has been identified in both humans and rodents. In rodents, much of the work to date has been done in situations where the animal is free to move about naturally. By contrast, the majority of work carried out to date in humans is static, due to limitations imposed by traditional laboratory based imaging techniques. In recent years, significant progress has been made in bridging the gap between animal and human work by employing virtual reality (VR) technology to simulate aspects of real-world navigation. Despite this progress, the VR studies often fail to fully simulate important aspects of real-world navigation, where information derived from self-motion is integrated with representations of environmental features and task goals. In the current review article, we provide a brief overview of animal and human imaging work to date, focusing on commonalties and differences in findings across species. Following on from this we discuss VR studies of spatial cognition, outlining limitations and developments, before introducing mobile brain imaging techniques and describe technical challenges and solutions for real-world recording. Finally, we discuss how these advances in mobile brain imaging technology, provide an unprecedented opportunity to illuminate how the brain represents complex multifaceted information during naturalistic navigation.

Assessing Brain-Muscle Connectivity in Human Locomotion through Mobile Brain/Body Imaging: Opportunities, Pitfalls, and Future Directions

Assessment of the cortical role during bipedalism has been a methodological challenge. While surface electroencephalography (EEG) is capable of non-invasively measuring cortical activity during human locomotion, it is associated with movement artifacts obscuring cerebral sources of activity. Recently, statistical methods based on blind source separation revealed potential for resolving this issue, by segregating non-cerebral/artifactual from cerebral sources of activity. This step marked a new opportunity for the investigation of the brains' role while moving and was tagged mobile brain/body imaging (MoBI). This methodology involves simultaneous mobile recording of brain activity with several other body behavioral variables (e.g., muscle activity and kinematics), through wireless recording wearable devices/sensors. Notably, several MoBI studies using EEG-EMG approaches recently showed that the brain is functionally connected to the muscles and active throughout the whole gait cycle and, thus, rejecting the long-lasting idea of a solely spinal-driven bipedalism. However, MoBI and brain/muscle connectivity assessments during human locomotion are still in their fledgling state of investigation. Mobile brain/body imaging approaches hint toward promising opportunities; however, there are some remaining pitfalls that need to be resolved before considering their routine clinical use. This article discusses several of these pitfalls and proposes research to address them. Examples relate to the validity, reliability, and reproducibility of this method in ecologically valid scenarios and in different populations. Furthermore, whether brain/muscle connectivity within the MoBI framework represents a potential biomarker in neuromuscular syndromes where gait disturbances are evident (e.g., age-related sarcopenia) remains to be determined.

Categorisation of Mobile EEG: A Researcher's Perspective

Researchers are increasingly attempting to undertake electroencephalography (EEG) recordings in novel environments and contexts outside of the traditional static laboratory setting. The term “mobile EEG,” although commonly used to describe many of these undertakings, is ambiguous, since it attempts to encompass a wide range of EEG device mobility, participant mobility, and system specifications used across investigations. To provide quantitative parameters for “mobile EEG,” we developed a Categorisation of Mobile EEG (CoME) scheme based upon scoring of device mobility (D, from 0, off-body, to 5, head-mounted with no additional equipment), participant mobility (P, from 0, static, to 5, unconstrained running), system specification (S, from 4, lowest, to 20, highest), and number of channels (C) used. The CoME scheme was applied to twenty-nine published mobile EEG studies. Device mobility scores ranged from 0D to 4D, participant mobility scores from 0P to 4P, and system specification scores from 6S to 17S. The format of the scores for the four parameters is given, for example, as (2D, 4P, 17S, 32C) and readily enables comparisons across studies. Our CoME scheme enables researchers to quantify the degree of device mobility, participant mobility, and system specification used in their “mobile EEG” investigations in a standardised way.

Deployment of Mobile EEG Technology in an Art Museum Setting: Evaluation of Signal Quality and Usability

Electroencephalography (EEG) has emerged as a powerful tool for quantitatively studying the brain that enables natural and mobile experiments. Recent advances in EEG have allowed for the use of dry electrodes that do not require a conductive medium between the recording electrode and the scalp. The overall goal of this research was to gain an understanding of the overall usability and signal quality of dry EEG headsets compared to traditional gel-based systems in an unconstrained environment. EEG was used to collect Mobile Brain-body Imaging (MoBI) data from 432 people as they experienced an art exhibit in a public museum. The subjects were instrumented with either one of four dry electrode EEG systems or a conventional gel electrode EEG system. Each of the systems was evaluated based on the signal quality and usability in a real-world setting. First, we describe the various artifacts that were characteristic of each of the systems. Second, we report on each system's usability and their limitations in a mobile setting. Third, to evaluate signal quality for task discrimination and characterization, we employed a data driven clustering approach on the data from 134 of the 432 subjects (those with reliable location tracking information and usable EEG data) to evaluate the power spectral density (PSD) content of the EEG recordings. The experiment consisted of a baseline condition in which the subjects sat quietly facing a white wall for 1 min. Subsequently, the participants were encouraged to explore the exhibit for as long as they wished (piece-viewing). No constraints were placed upon the individual in relation to action, time, or navigation of the exhibit. In this freely-behaving approach, the EEG systems varied in their capacity to record characteristic modulations in the EEG data, with the gel-based system more clearly capturing stereotypical alpha and beta-band modulations.

Walking through Architectural Spaces: The Impact of Interior Forms on Human Brain Dynamics

Neuroarchitecture uses neuroscientific tools to better understand architectural design and its impact on human perception and subjective experience. The form or shape of the built environment is fundamental to architectural design, but not many studies have shown the impact of different forms on the inhabitants’ emotions. This study investigated the neurophysiological correlates of different interior forms on the perceivers’ affective state and the accompanying brain activity. To understand the impact of naturalistic three-dimensional (3D) architectural forms, it is essential to perceive forms from different perspectives. We computed clusters of form features extracted from pictures of residential interiors and constructed exemplary 3D room models based on and representing different formal clusters. To investigate human brain activity during 3D perception of architectural spaces, we used a mobile brain/body imaging (MoBI) approach recording the electroencephalogram (EEG) of participants while they naturally walk through different interior forms in virtual reality (VR). The results revealed a strong impact of curvature geometries on activity in the anterior cingulate cortex (ACC). Theta band activity in ACC correlated with specific feature types (r_s (14) = 0.525, p = 0.037) and geometry (r_s (14) = −0.579, p = 0.019), providing evidence for a role of this structure in processing architectural features beyond their emotional impact. The posterior cingulate cortex and the occipital lobe were involved in the perception of different room perspectives during the stroll through the rooms. This study sheds new light on the use of mobile EEG and VR in architectural studies and provides the opportunity to study human brain dynamics in participants that actively explore and realistically experience architectural spaces.

Understanding Minds in Real-World Environments: Toward a Mobile Cognition Approach

There is a growing body of evidence that important aspects of human cognition have been marginalized, or overlooked, by traditional cognitive science. In particular, the use of laboratory-based experiments in which stimuli are artificial, and response options are fixed, inevitably results in findings that are less ecologically valid in relation to real-world behavior. In the present review we highlight the opportunities provided by a range of new mobile technologies that allow traditionally lab-bound measurements to now be collected during natural interactions with the world. We begin by outlining the theoretical support that mobile approaches receive from the development of embodied accounts of cognition, and we review the widening evidence that illustrates the importance of examining cognitive processes in their context. As we acknowledge, in practice, the development of mobile approaches brings with it fresh challenges, and will undoubtedly require innovation in paradigm design and analysis. If successful, however, the mobile cognition approach will offer novel insights in a range of areas, including understanding the cognitive processes underlying navigation through space and the role of attention during natural behavior. We argue that the development of real-world mobile cognition offers both increased ecological validity, and the opportunity to examine the interactions between perception, cognition and action-rather than examining each in isolation.