Mobile EEG and its potential to promote the theory and application of imagery-based motor rehabilitation

Neural correlates of motor imagery and execution in real-world dynamic behavior: evidence for similarities and differences

A large body of evidence shows that motor imagery and action execution behaviors result from overlapping neural substrates, even in the absence of overt movement during motor imagery. To date it is unclear how neural activations in motor imagery and execution compare for naturalistic whole-body movements, such as walking. Neuroimaging studies have not directly compared imagery and execution during dynamic walking movements. Here we recorded brain activation with mobile EEG during walking compared to during imagery of walking, with mental counting as a control condition. We asked 24 healthy participants to either walk six steps on a path, imagine taking six steps, or mentally count from one to six. We found beta and alpha power modulation during motor imagery resembling action execution patterns; a correspondence not found performing the control task of mental counting. Neural overlap occurred early in the execution and imagery walking actions, suggesting activation of shared action representations. Remarkably, a distinctive walking-related beta rebound occurred both during action execution and imagery at the end of the action suggesting that, like actual walking, motor imagery involves resetting or inhibition of motor processes. However, we also found that motor imagery elicits a distinct pattern of more distributed beta activity, especially at the beginning of the task. These results indicate that motor imagery and execution of naturalistic walking involve shared motor-cognitive activations, but that motor imagery requires additional cortical resources.

Evaluation of a headphones-fitted EEG system for the recording of auditory evoked potentials and mental workload assessment

Advancements in portable neuroimaging technologies open up new opportunities to gain insight into the neural dynamics and cognitive processes underlying day-to-day behaviors. In this study, we evaluated the relevance of a headphone- mounted electroencephalogram (EEG) system for monitoring mental workload. The participants (N = 12) were instructed to pay attention to auditory alarms presented sporadically while performing the Multi-Attribute Task Battery (MATB) whose difficulty was staged across three conditions to manipulate mental workload. The P300 Event-Related Potentials (ERP) elicited by the presentation of auditory alarms were used as probes of attentional resources available. The amplitude and latency of P300 ERPs were compared across experimental conditions. Our findings indicate that the P300 ERP component can be captured using a headphone-mounted EEG system. Moreover, neural responses to alarm could be used to classify mental workload with high accuracy (over 80%) at a single-trial level. Our analyses indicated that the signal-to-noise ratio acquired by the sponge-based sensors remained stable throughout the recordings. These results highlight the potential of portable neuroimaging technology for the development of neuroassistive applications while underscoring the current limitations and challenges associated with the integration of EEG sensors in everyday-life wearable technologies. Overall, our study contributes to the growing body of research exploring the feasibility and validity of wearable neuroimaging technologies for the study of human cognition and behavior in real-world settings.

Portable deep-learning decoder for motor imaginary EEG signals based on a novel compact convolutional neural network incorporating spatial-attention mechanism

Due to high computational requirements, deep-learning decoders for motor imaginary (MI) electroencephalography (EEG) signals are usually implemented on bulky and heavy computing devices that are inconvenient for physical actions. To date, the application of deep-learning techniques in independent portable brain-computer-interface (BCI) devices has not been extensively explored. In this study, we proposed a high-accuracy MI EEG decoder by incorporating spatial-attention mechanism into convolution neural network (CNN), and deployed it on fully integrated single-chip microcontroller unit (MCU). After the CNN model was trained on workstation computer using GigaDB MI datasets (52 subjects), its parameters were then extracted and converted to build deep-learning architecture interpreter on MCU. For comparison, EEG-Inception model was also trained using the same dataset, and was deployed on MCU. The results indicate that our deep-learning model can independently decode imaginary left-/right-hand motions. The mean accuracy of the proposed compact CNN reaches 96.75 ± 2.41% (8 channels: Frontocentral3 (FC3), FC4, Central1 (C1), C2, Central-Parietal1 (CP1), CP2, C3, and C4), versus 76.96 ± 19.08% of EEG-Inception (6 channels: FC3, FC4, C1, C2, CP1, and CP2). To the best of our knowledge, this is the first portable deep-learning decoder for MI EEG signals. The findings demonstrate high-accuracy deep-learning decoding of MI EEG in a portable mode, which has great implications for hand-disabled patients. Our portable system can be used for developing artificial-intelligent wearable BCI devices, as it is less computationally expensive and convenient for real-life application.

The brain in motion-cognitive effects of simultaneous motor activity

During the last 30 years, a large number of behavioral studies have investigated the effect of simultaneous exercise on cognitive functions. The heterogeneity of the results has been attributed to different parameters, such as intensity or modality of physical activity, and the investigated cognitive processes. More recent methodological improvements have enabled to record electroencephalography (EEG) during physical exercise. EEG studies combining cognitive tasks with exercise have described predominantly detrimental effects on cognitive processes and EEG parameters. However, differences in the underlying rationale and the design of EEG versus behavioral studies make direct comparisons between both types of studies difficult. In this narrative review of dual-task experiments we evaluated behavioral and EEG studies and discuss possible explanations for the heterogeneity of results and for the discrepancy between behavioral and EEG studies. Furthermore, we provide a proposal for future EEG studies on simultaneous motion to be a useful complement to behavioral studies. A crucial factor might be to find for each cognitive function the motor activity that matches this function in terms of attentional focus. This hypothesis should be investigated systematically in future studies.

Functional near-infrared spectroscopy is a useful tool for multi-perspective psychobiological study of neurophysiological correlates of parenting behaviour

The quality of the relationship between caregiver and child has long-term effects on the cognitive and socio-emotional development of children. A process involved in human parenting is the bio-behavioural synchrony that occurs between the partners in the relationship during interaction. Through interaction, bio-behavioural synchronicity allows the adaptation of the physiological systems of the parent to those of the child and promotes the positive development and modelling of the child's social brain. The role of bio-behavioural synchrony in building social bonds could be investigated using functional near-infrared spectroscopy (fNIRS). In this paper we have (a) highlighted the importance of the quality of the caregiver-child relationship for the child's cognitive and socio-emotional development, as well as the relevance of infantile stimuli in the activation of parenting behaviour; (b) discussed the tools used in the study of the neurophysiological substrates of the parental response; (c) proposed fNIRS as a particularly suitable tool for the study of parental responses; and (d) underlined the need for a multi-systemic psychobiological approach to understand the mechanisms that regulate caregiver-child interactions and their bio-behavioural synchrony. We propose to adopt a multi-system psychobiological approach to the study of parental behaviour and social interaction.

More creative ideas are associated with increased right posterior power and frontal-parietal/occipital coupling in the upper alpha band: A within-subjects study

The neurophysiological investigation of creative idea generation is a growing research area. EEG studies congruently reported the sensitivity of upper alpha power (10-12 Hz) for the creative ideation process and its outcome. However, the majority of studies were between-subject design studies and research directly comparing the neurophysiological activation pattern when generating more and less creative ideas within a person are rare. Therefore, the present study was specifically focused on investigating brain activation patterns associated with the generation of more vs. less creative ideas. We applied an alternate uses task (AU-task; i.e., finding original uses for everyday objects such as a brick) in a sample of 74 participants and recorded the brain activation during the AU-task and reference period. A portable EEG system with 21 dry electrodes arranged in the international 10-20 system and linked ear as reference was used. We found a higher increase of upper alpha power during creative ideation (relative to reference period, i.e., task-related power, TRP) over right posterior sites when people generated more compared to less creative ideas. This was accompanied by an increase of functional coupling (i.e., task-related coherence increase) between frontal and parietal/occipital sites, which suggests higher internal attention and more control over sensory processes. Taken together, these findings complement the existing creativity research literature and indicate the importance of alpha power for the creative ideation process also within people.

A Novel Method Based on Combination of Independent Component Analysis and Ensemble Empirical Mode Decomposition for Removing Electrooculogram Artifacts From Multichannel Electroencephalogram Signals

Electrooculogram (EOG) is one of common artifacts in recorded electroencephalogram (EEG) signals. Many existing methods including independent component analysis (ICA) and wavelet transform were applied to eliminate EOG artifacts but ignored the possible impact of the nature of EEG signal. Therefore, the removal of EOG artifacts still faces a major challenge in EEG research. In this paper, the ensemble empirical mode decomposition (EEMD) and ICA algorithms were combined to propose a novel EEMD-based ICA method (EICA) for removing EOG artifacts from multichannel EEG signals. First, the ICA method was used to decompose original EEG signals into multiple independent components (ICs), and the EOG-related ICs were automatically identified through the kurtosis method. Then, by performing the EEMD algorithm on EOG-related ICs, the intrinsic mode functions (IMFs) linked to EOG were discriminated and eliminated. Finally, artifact-free IMFs were projected to obtain the ICs without EOG artifacts, and the clean EEG signals were ultimately reconstructed by the inversion of ICA. Both EOGs correction from simulated EEG signals and real EEG data were studied, which verified that the proposed method could achieve an improved performance in EOG artifacts rejection. By comparing with other existing approaches, the EICA obtained the optimal performance with the highest increase in signal-to-noise ratio and decrease in root mean square error and correlation coefficient after EOG artifacts removal, which demonstrated that the proposed method could more effectively eliminate blink artifacts from multichannel EEG signals with less error influence. This study provided a novel promising method to eliminate EOG artifacts with high performance, which is of great importance for EEG signals processing and analysis.

The Impact of Context on EEG Motor Imagery Neurofeedback and Related Motor Domains

Neurofeedback (NF) is a versatile non-invasive neuromodulation technique. In combination with motor imagery (MI), NF has considerable potential for enhancing motor performance or supplementing motor rehabilitation. However, not all users achieve reliable NF control. While research has focused on various brain signal properties and the optimisation of signal processing to solve this issue, the impact of context, i.e. the conditions in which NF motor tasks occur, is comparatively unknown. We review current research on the impact of context on MI NF and related motor domains. We identify long-term factors that act at the level of the individual or of the intervention, and short-term factors, with levels before/after and during a session. The reviewed literature indicates that context plays a significant role. We propose considering context factors as well as within-level and across-level interactions when studying MI NF.

Overground Walking Decreases Alpha Activity and Entrains Eye Movements in Humans

Experiments in animal models have shown that running increases neuronal activity in early visual areas in light as well as in darkness. This suggests that visual processing is influenced by locomotion independent of visual input. Combining mobile electroencephalography, motion- and eye-tracking, we investigated the influence of overground free walking on cortical alpha activity (~10 Hz) and eye movements in healthy humans. Alpha activity has been considered a valuable marker of inhibition of sensory processing and shown to negatively correlate with neuronal firing rates. We found that walking led to a decrease in alpha activity over occipital cortex compared to standing. This decrease was present during walking in darkness as well as during light. Importantly, eye movements could not explain the change in alpha activity. Nevertheless, we found that walking and eye related movements were linked. While the blink rate increased with increasing walking speed independent of light or darkness, saccade rate was only significantly linked to walking speed in the light. Pupil size, on the other hand, was larger during darkness than during light, but only showed a modulation by walking in darkness. Analyzing the effect of walking with respect to the stride cycle, we further found that blinks and saccades preferentially occurred during the double support phase of walking. Alpha power, as shown previously, was lower during the swing phase than during the double support phase. We however could exclude the possibility that the alpha modulation was introduced by a walking movement induced change in electrode impedance. Overall, our work indicates that the human visual system is influenced by the current locomotion state of the body. This influence affects eye movement pattern as well as neuronal activity in sensory areas and might form part of an implicit strategy to optimally extract sensory information during locomotion.

Exploring the Limitations of Event-Related Potential Measures in Moving Subjects: Pilot Studies of Four Different Technical Modifications in Ergometer Rowing

Measuring brain activity in moving subjects is of great importance for investigating human behavior in ecological settings. For this purpose, EEG measures are applicable; however, technical modifications are required to reduce the typical massive movement artefacts. Four different approaches to measure EEG/ERPs during rowing were tested: (i) a purpose-built head-mounted preamplifier, (ii) a laboratory system with active electrodes, and a wireless headset combined with (iii) passive or (iv) active electrodes. A standard visual oddball task revealed very similar (within subjects) visual evoked potentials for rowing and rest (without movement). The small intraindividual differences between rowing and rest, in comparison to the typically larger interindividual differences in the ERP waveforms, revealed that ERPs can be measured reliably even in an athletic movement such as rowing. On the other hand, the expected modulation of the motor-related activity by force output was largely affected by movement artefacts. Therefore, for a successful application of ERP measures in movement research, further developments to differentiate between movement-related neuronal activity and movement-related artefacts are required. However, activities with small magnitudes related to motor learning and motor control may be difficult to detect because they are superimposed by the very large motor potential, which increases with force output.

A Usability Study of Low-cost Wireless Brain-Computer Interface for Cursor Control Using Online Linear Model

Computer cursor control using electroencephalogram (EEG) signals is a common and well-studied brain-computer interface (BCI). The emphasis of the literature has been primarily on evaluation of the objective measures of assistive BCIs such as accuracy of the neural decoder whereas the subjective measures such as user's satisfaction play an essential role for the overall success of a BCI. As far as we know, the BCI literature lacks a comprehensive evaluation of the usability of the mind-controlled computer cursor in terms of decoder efficiency (accuracy), user experience, and relevant confounding variables concerning the platform for the public use. To fill this gap, we conducted a two-dimensional EEG-based cursor control experiment among 28 healthy participants. The computer cursor velocity was controlled by the imagery of hand movement using a paradigm presented in the literature named imagined body kinematics (IBK) with a low-cost wireless EEG headset. We evaluated the usability of the platform for different objective and subjective measures while we investigated the extent to which the training phase may influence the ultimate BCI outcome. We conducted pre- and post- BCI experiment interview questionnaires to evaluate the usability. Analyzing the questionnaires and the testing phase outcome shows a positive correlation between the individuals' ability of visualization and their level of mental controllability of the cursor. Despite individual differences, analyzing training data shows the significance of electrooculogram (EOG) on the predictability of the linear model. The results of this work may provide useful insights towards designing a personalized user-centered assistive BCI.

A step forward in the quest for a mobile EEG-designed epoch for psychophysiological studies

The aim of this study was to compare a reconfigurable mobile electroencephalography (EEG) system (M-EMOTIV) based on the Emotiv Epoc® (which has the ability to record up to 14 electrode sites in the 10/20 International System) and a commercial, clinical-grade EEG system (Neuronic MEDICID-05®), and then validate the rationale and accuracy of recordings obtained with the prototype proposed. In this approach, an Emotiv Epoc® was modified to enable it to record in the parieto-central area. All subjects (15 healthy individuals) performed a visual oddball task while connected to both devices to obtain electrophysiological data and behavioral responses for comparative analysis. A Pearson's correlation analysis revealed a good between-devices correlation with respect to electrophysiological measures. The present study not only corroborates previous reports on the ability of the Emotiv Epoc® to suitably record EEG data but presents an alternative device that allows the study of a wide range of psychophysiological experiments with simultaneous behavioral and mobile EEG recordings.

Challenge Accepted? Individual Performance Gains for Motor Imagery Practice with Humanoid Robotic EEG Neurofeedback

Optimizing neurofeedback (NF) and brain–computer interface (BCI) implementations constitutes a challenge across many fields and has so far been addressed by, among others, advancing signal processing methods or predicting the user’s control ability from neurophysiological or psychological measures. In comparison, how context factors influence NF/BCI performance is largely unexplored. We here investigate whether a competitive multi-user condition leads to better NF/BCI performance than a single-user condition. We implemented a foot motor imagery (MI) NF with mobile electroencephalography (EEG). Twenty-five healthy, young participants steered a humanoid robot in a single-user condition and in a competitive multi-user race condition using a second humanoid robot and a pseudo competitor. NF was based on 8–30 Hz relative event-related desynchronization (ERD) over sensorimotor areas. There was no significant difference between the ERD during the competitive multi-user condition and the single-user condition but considerable inter-individual differences regarding which condition yielded a stronger ERD. Notably, the stronger condition could be predicted from the participants’ MI-induced ERD obtained before the NF blocks. Our findings may contribute to enhance the performance of NF/BCI implementations and highlight the necessity of individualizing context factors.

Walking enhances peripheral visual processing in humans

Cognitive processes are almost exclusively investigated under highly controlled settings during which voluntary body movements are suppressed. However, recent animal work suggests differences in sensory processing between movement states by showing drastically changed neural responses in early visual areas between locomotion and stillness. Does locomotion also modulate visual cortical activity in humans, and what are the perceptual consequences? Our study shows that walking increased the contrast-dependent influence of peripheral visual input on central visual input. This increase is prevalent in stimulus-locked electroencephalogram (EEG) responses (steady-state visual evoked potential [SSVEP]) alongside perceptual performance. Ongoing alpha oscillations (approximately 10 Hz) further positively correlated with the walking-induced changes of SSVEP amplitude, indicating the involvement of an altered inhibitory process during walking. The results predicted that walking leads to an increased processing of peripheral visual input. A second study indeed showed an increased contrast sensitivity for peripheral compared to central stimuli when subjects were walking. Our work shows complementary neurophysiological and behavioural evidence corroborating animal findings that walking leads to a change in early visual neuronal activity in humans. That neuronal modulation due to walking is indeed linked to specific perceptual changes extends the existing animal work.

Mobile EEG in research on neurodevelopmental disorders: Opportunities and challenges

Mobile electroencephalography (mobile EEG) represents a next-generation neuroscientific technology – to study real-time brain activity – that is relatively inexpensive, non-invasive and portable. Mobile EEG leverages state-of-the-art hardware alongside established advantages of traditional EEG and recent advances in signal processing. In this review, we propose that mobile EEG could open unprecedented possibilities for studying neurodevelopmental disorders. We first present a brief overview of recent developments in mobile EEG technologies, emphasising the proliferation of studies in several neuroscientific domains. As these developments have yet to be exploited by neurodevelopmentalists, we then identify three research opportunities: 1) increase in the ease and flexibility of brain data acquisition in neurodevelopmental populations; 2) integration into powerful developmentally-informative research designs; 3) development of innovative non-stationary EEG-based paradigms. Critically, we address key challenges that should be considered to fully realise the potential of mobile EEG for neurodevelopmental research and for understanding developmental psychopathology more broadly, and suggest future research directions.

An EEG Experimental Study Evaluating the Performance of Texas Instruments ADS1299

Texas Instruments ADS1299 is an attractive choice for low cost electroencephalography (EEG) devices owing to its low power consumption and low input referred noise. To date, there have been no rigorous evaluations of its performance. In this EEG experimental study we evaluated the performance of the ADS1299 against a high quality laboratory-based system. Two self-paced lower limb motor tasks were performed by 22 healthy participants. Recorded power across delta, theta, alpha, and beta EEG bands, the power ratio across the motor tasks, pre-movement noise, and signal-to-noise ratio were obtained for evaluation. The amplitude and time of the negative peak in the movement-related cortical potentials (MRCPs) extracted from the EEG data were also obtained. Using linear mixed models, no statistically significant differences (p > 0.05) were found in any of these measures across the two systems. These findings were further supported by evaluation of cosine similarity, waveform differences, and topographic maps. There were statistically significant differences in MRCPs across the motor tasks in both systems. We conclude that the performance of the ADS1299 in combination with wet Ag/AgCl electrodes is analogous to that of a laboratory-based system in a low frequency (<40 Hz) EEG recording.

Design and Development of a Portable Exoskeleton for Hand Rehabilitation

Improvement in hand function to promote functional recovery is one of the major goals of stroke rehabilitation. This paper introduces a newly developed exoskeleton for hand rehabilitation with a user-centered design concept, which integrates the requirements of practical use, mechanical structure, and control system. The paper also evaluated the function with two prototypes in a local hospital. Results of functional evaluation showed that significant improvements were found in ARAT (P = 0.014), WMFT (P = 0.020), and FMA_WH (P = 0.021). Increase in the mean values of FMA_SE was observed but without significant difference (P = 0.071). The improvement in ARAT score reflects the motor recovery in hand and finger functions. The increased FMA scores suggest there is a motor improvement in the whole upper limb, and especially in the hand after the training. The product met patients' requirements and has practical significance. It is portable, cost-effective, easy to use and supports multiple control modes to adapt to different rehabilitation phases.

Study of the Home-Auxiliary Robot Based on BCI

A home-auxiliary robot platform is developed in the current study which could assist patients with physical disabilities and older persons with mobility impairments. The robot, mainly controlled by brain computer interface (BCI) technology, can not only perform actions in a person's field of vision, but also work outside the field of vision. The wavelet decomposition (WD) is used in this study to extract the δ (0~4 Hz) and θ (4~8 Hz) sub-bands of subjects' electroencephalogram (EEG) signals. The correlation between pairs of 14 EEG channels is determined with synchronization likelihood (SL), and the brain network structure is generated. Then, the motion characteristics are analyzed using the brain network parameters clustering coefficient (C) and global efficiency (G). Meanwhile, the eye movement characteristics in the F3 and F4 channels are identified. Finally, the motion characteristics identified by brain networks and eye movement characteristics can be used to control the home-auxiliary robot platform. The experimental result shows that the accuracy rate of left and right motion recognition using this method is more than 93%. Additionally, the similarity between that autonomous return path and the real path of the home-auxiliary robot reaches up to 0.89.

Improved Volitional Recall of Motor-Imagery-Related Brain Activation Patterns Using Real-Time Functional MRI-Based Neurofeedback

Motor imagery (MI), a covert cognitive process where an action is mentally simulated but not actually performed, could be used as an effective neurorehabilitation tool for motor function improvement or recovery. Recent approaches employing brain–computer/brain–machine interfaces to provide online feedback of the MI during rehabilitation training have promising rehabilitation outcomes. In this study, we examined whether participants could volitionally recall MI-related brain activation patterns when guided using neurofeedback (NF) during training. The participants’ performance was compared to that without NF. We hypothesized that participants would be able to consistently generate the relevant activation pattern associated with the MI task during training with NF compared to that without NF. To assess activation consistency, we used the performance of classifiers trained to discriminate MI-related brain activation patterns. Our results showed significantly higher predictive values of MI-related activation patterns during training with NF. Additionally, this improvement in the classification performance tends to be associated with the activation of middle temporal gyrus/inferior occipital gyrus, a region associated with visual motion processing, suggesting the importance of performance monitoring during MI task training. Taken together, these findings suggest that the efficacy of MI training, in terms of generating consistent brain activation patterns relevant to the task, can be enhanced by using NF as a mechanism to enable participants to volitionally recall task-related brain activation patterns.

Real-Time ECG-Based Detection of Fatigue Driving Using Sample Entropy

In present work, the heart rate variability (HRV) characteristics, calculated by sample entropy (SampEn), were used to analyze the driving fatigue state at successive driving stages. Combined with the relative power spectrum ratio β/(θ + α), subjective questionnaire, and brain network parameters of electroencephalogram (EEG) signals, the relationships between the different characteristics for driving fatigue were discussed. Thus, it can conclude that the HRV characteristics (RR SampEn and R peaks SampEn), as well as the relative power spectrum ratio β/(θ + α) of the channels (C3, C4, P3, P4), the subjective questionnaire, and the brain network parameters, can effectively detect driving fatigue at various driving stages. In addition, the method for collecting ECG signals from the palm part does not need patch electrodes, is convenient, and will be practical to use in actual driving situations in the future.

Brain activity during a lower limb functional task in a real and virtual environment: A comparative study

BACKGROUND

Virtual Reality (VR) has been contributing to Neurological Rehabilitation because of its interactive and multisensory nature, providing the potential of brain reorganization. Given the use of mobile EEG devices, there is the possibility of investigating how the virtual therapeutic environment can influence brain activity.

OBJECTIVE

To compare theta, alpha, beta and gamma power in healthy young adults during a lower limb motor task in a virtual and real environment.

METHODS

Ten healthy adults were submitted to an EEG assessment while performing a one-minute task consisted of going up and down a step in a virtual environment - Nintendo Wii virtual game "Basic step" - and in a real environment.

RESULTS

Real environment caused an increase in theta and alpha power, with small to large size effects mainly in the frontal region. VR caused a greater increase in beta and gamma power, however, with small or negligible effects on a variety of regions regarding beta frequency, and medium to very large effects on the frontal and the occipital regions considering gamma frequency.

CONCLUSIONS

Theta, alpha, beta and gamma activity during the execution of a motor task differs according to the environment that the individual is exposed - real or virtual - and may have varying size effects if brain area activation and frequency spectrum in each environment are taken into consideration.

Categorisation of Mobile EEG: A Researcher's Perspective

Researchers are increasingly attempting to undertake electroencephalography (EEG) recordings in novel environments and contexts outside of the traditional static laboratory setting. The term “mobile EEG,” although commonly used to describe many of these undertakings, is ambiguous, since it attempts to encompass a wide range of EEG device mobility, participant mobility, and system specifications used across investigations. To provide quantitative parameters for “mobile EEG,” we developed a Categorisation of Mobile EEG (CoME) scheme based upon scoring of device mobility (D, from 0, off-body, to 5, head-mounted with no additional equipment), participant mobility (P, from 0, static, to 5, unconstrained running), system specification (S, from 4, lowest, to 20, highest), and number of channels (C) used. The CoME scheme was applied to twenty-nine published mobile EEG studies. Device mobility scores ranged from 0D to 4D, participant mobility scores from 0P to 4P, and system specification scores from 6S to 17S. The format of the scores for the four parameters is given, for example, as (2D, 4P, 17S, 32C) and readily enables comparisons across studies. Our CoME scheme enables researchers to quantify the degree of device mobility, participant mobility, and system specification used in their “mobile EEG” investigations in a standardised way.

High-Intensity Chronic Stroke Motor Imagery Neurofeedback Training at Home: Three Case Reports

Motor imagery (MI) with neurofeedback has been suggested as promising for motor recovery after stroke. Evidence suggests that regular training facilitates compensatory plasticity, but frequent training is difficult to integrate into everyday life. Using a wireless electroencephalogram (EEG) system, we implemented a frequent and efficient neurofeedback training at the patients' home. Aiming to overcome maladaptive changes in cortical lateralization patterns we presented a visual feedback, representing the degree of contralateral sensorimotor cortical activity and the degree of sensorimotor cortex lateralization. Three stroke patients practiced every other day, over a period of 4 weeks. Training-related changes were evaluated on behavioral, functional, and structural levels. All 3 patients indicated that they enjoyed the training and were highly motivated throughout the entire training regime. EEG activity induced by MI of the affected hand became more lateralized over the course of training in all three patients. The patient with a significant functional change also showed increased white matter integrity as revealed by diffusion tensor imaging, and a substantial clinical improvement of upper limb motor functions. Our study provides evidence that regular, home-based practice of MI neurofeedback has the potential to facilitate cortical reorganization and may also increase associated improvements of upper limb motor function in chronic stroke patients.

A Hybrid FPGA-Based System for EEG- and EMG-Based Online Movement Prediction

A current trend in the development of assistive devices for rehabilitation, for example exoskeletons or active orthoses, is to utilize physiological data to enhance their functionality and usability, for example by predicting the patient's upcoming movements using electroencephalography (EEG) or electromyography (EMG). However, these modalities have different temporal properties and classification accuracies, which results in specific advantages and disadvantages. To use physiological data analysis in rehabilitation devices, the processing should be performed in real-time, guarantee close to natural movement onset support, provide high mobility, and should be performed by miniaturized systems that can be embedded into the rehabilitation device. We present a novel Field Programmable Gate Array (FPGA) -based system for real-time movement prediction using physiological data. Its parallel processing capabilities allows the combination of movement predictions based on EEG and EMG and additionally a P300 detection, which is likely evoked by instructions of the therapist. The system is evaluated in an offline and an online study with twelve healthy subjects in total. We show that it provides a high computational performance and significantly lower power consumption in comparison to a standard PC. Furthermore, despite the usage of fixed-point computations, the proposed system achieves a classification accuracy similar to systems with double precision floating-point precision.

Long-term test-retest reliability of event-related potential (ERP) recordings during treadmill walking using the mobile brain/body imaging (MoBI) approach

Advancements in acquisition technology and signal-processing techniques have spurred numerous recent investigations on the electro-cortical signals generated during whole-body motion. This approach, termed Mobile Brain/Body Imaging (MoBI), has the potential to elucidate the neural correlates of perceptual and cognitive processes during real-life activities, such as locomotion. However, as of yet, no one has assessed the long-term stability of event-related potentials (ERPs) recorded under these conditions. Therefore, the objective of the current study was to evaluate the test-retest reliability of cognitive ERPs recorded while walking. High-density EEG was acquired from 12 young adults on two occasions, separated by an average of 2.3years, as they performed a Go/No-Go response inhibition paradigm. During each testing session, participants performed the task while walking on a treadmill and seated. Using the intraclass correlation coefficient (ICC) as a measure of agreement, we focused on two well-established neurophysiological correlates of cognitive control, the N2 and P3 ERPs. Following ICA-based artifact rejection, the earlier N2 yielded good to excellent levels of reliability for both amplitude and latency, while measurements for the later P3 component were generally less robust but still indicative of adequate to good levels of stability. Interestingly, the N2 was more consistent between walking sessions, compared to sitting, for both hits and correct rejection trials. In contrast, the P3 waveform tended to have a higher degree of consistency during sitting conditions. Overall, these results suggest that the electro-cortical signals obtained during active walking are representative of stable indices of neurophysiological function.

Understanding Minds in Real-World Environments: Toward a Mobile Cognition Approach

There is a growing body of evidence that important aspects of human cognition have been marginalized, or overlooked, by traditional cognitive science. In particular, the use of laboratory-based experiments in which stimuli are artificial, and response options are fixed, inevitably results in findings that are less ecologically valid in relation to real-world behavior. In the present review we highlight the opportunities provided by a range of new mobile technologies that allow traditionally lab-bound measurements to now be collected during natural interactions with the world. We begin by outlining the theoretical support that mobile approaches receive from the development of embodied accounts of cognition, and we review the widening evidence that illustrates the importance of examining cognitive processes in their context. As we acknowledge, in practice, the development of mobile approaches brings with it fresh challenges, and will undoubtedly require innovation in paradigm design and analysis. If successful, however, the mobile cognition approach will offer novel insights in a range of areas, including understanding the cognitive processes underlying navigation through space and the role of attention during natural behavior. We argue that the development of real-world mobile cognition offers both increased ecological validity, and the opportunity to examine the interactions between perception, cognition and action-rather than examining each in isolation.

Combined Action Observation and Motor Imagery Neurofeedback for Modulation of Brain Activity

Motor imagery (MI) and action observation have proven to be efficacious adjuncts to traditional physiotherapy for enhancing motor recovery following stroke. Recently, researchers have used a combined approach called imagined imitation (II), where an individual watches a motor task being performed, while simultaneously imagining they are performing the movement. While neurofeedback (NFB) has been used extensively with MI to improve patients' ability to modulate sensorimotor activity and enhance motor recovery, the effectiveness of using NFB with II to modulate brain activity is unknown. This project tested the ability of participants to modulate sensorimotor activity during electroencephalography-based II-NFB of a complex, multi-part unilateral handshake, and whether this ability transferred to a subsequent bout of MI. Moreover, given the goal of translating findings from NFB research into practical applications, such as rehabilitation, the II-NFB system was designed with several user interface and user experience features, in an attempt to both drive user engagement and match the level of challenge to the abilities of the subjects. In particular, at easy difficulty levels the II-NFB system incentivized contralateral sensorimotor up-regulation (via event related desynchronization of the mu rhythm), while at higher difficulty levels the II-NFB system incentivized sensorimotor lateralization (i.e., both contralateral up-regulation and ipsilateral down-regulation). Thirty-two subjects, receiving real or sham NFB attended four sessions where they engaged in II-NFB training and subsequent MI. Results showed the NFB group demonstrated more bilateral sensorimotor activity during sessions 2–4 during II-NFB and subsequent MI, indicating mixed success for the implementation of this particular II-NFB system. Here we discuss our findings in the context of the design features included in the II-NFB system, highlighting limitations that should be considered in future designs.

Ergonomic design of an EEG headset using 3D anthropometry

Although EEG experiments over the past decades have shown numerous applications for brain-computer interfacing (BCI), there is a need for user-friendly BCI devices that can be used in real-world situations. 3D anthropometry and statistical shape modeling have been shown to improve the fit of devices such as helmets and respirators, and thus they might also be suitable to design BCI headgear that better fits the size and shape variation of the human head. In this paper, a new design method for BCI devices is proposed and evaluated. A one-size-fits-all BCI headset frame is designed on the basis of three digital mannequins derived from a shape model of the human head. To verify the design, the geometric fit, stability and repeatability of the prototype were compared to an EEG cap and a commercial BCI headset in a preliminary experiment. Most design specifications were met, and all the results were found to be similar to those of the commercial headset. Therefore, the suggested design method is a feasible alternative to traditional anthropometric design for BCI headsets and similar headgear.

Performance analysis of a Principal Component Analysis ensemble classifier for Emotiv headset P300 spellers

The current trend to use Brain-Computer Interfaces (BCIs) with mobile devices mandates the development of efficient EEG data processing methods. In this paper, we demonstrate the performance of a Principal Component Analysis (PCA) ensemble classifier for P300-based spellers. We recorded EEG data from multiple subjects using the Emotiv neuroheadset in the context of a classical oddball P300 speller paradigm. We compare the performance of the proposed ensemble classifier to the performance of traditional feature extraction and classifier methods. Our results demonstrate the capability of the PCA ensemble classifier to classify P300 data recorded using the Emotiv neuroheadset with an average accuracy of 86.29% on cross-validation data. In addition, offline testing of the recorded data reveals an average classification accuracy of 73.3% that is significantly higher than that achieved using traditional methods. Finally, we demonstrate the effect of the parameters of the P300 speller paradigm on the performance of the method.

Proposing Metrics for Benchmarking Novel EEG Technologies Towards Real-World Measurements

Recent advances in electroencephalographic (EEG) acquisition allow for recordings using wet and dry sensors during whole-body motion. The large variety of commercially available EEG systems contrasts with the lack of established methods for objectively describing their performance during whole-body motion. Therefore, the aim of this study was to introduce methods for benchmarking the suitability of new EEG technologies for that context. Subjects performed an auditory oddball task using three different EEG systems (Biosemi wet—BSM, Cognionics Wet—Cwet, Conionics Dry—Cdry). Nine subjects performed the oddball task while seated and walking on a treadmill. We calculated EEG epoch rejection rate, pre-stimulus noise (PSN), signal-to-noise ratio (SNR) and EEG amplitude variance across the P300 event window (CV_ERP) from a subset of 12 channels common to all systems. We also calculated test-retest reliability and the subject’s level of comfort while using each system. Our results showed that using the traditional 75 μV rejection threshold BSM and Cwet epoch rejection rates are ~25% and ~47% in the seated and walking conditions respectively. However, this threshold rejects ~63% of epochs for Cdry in the seated condition and excludes 100% of epochs for the majority of subjects during walking. BSM showed predominantly no statistical differences between seated and walking condition for all metrics, whereas Cwet showed increases in PSN and CV_ERP, as well as reduced SNR in the walking condition. Data quality from Cdry in seated conditions were predominantly inferior in comparison to the wet systems. Test-retest reliability was mostly moderate/good for these variables, especially in seated conditions. In addition, subjects felt less discomfort and were motivated for longer recording periods while using wet EEG systems in comparison to the dry system. The proposed method was successful in identifying differences across systems that are mostly caused by motion-related artifacts and usability issues. We conclude that the extraction of the selected metrics from an auditory oddball paradigm may be used as a benchmark method for testing the performance of different EEG systems in mobile conditions. Moreover dry EEG systems may need substantial improvements to meet the quality standards of wet electrodes.

Upper Limb Immobilisation: A Neural Plasticity Model with Relevance to Poststroke Motor Rehabilitation

Advances in our understanding of the neural plasticity that occurs after hemiparetic stroke have contributed to the formulation of theories of poststroke motor recovery. These theories, in turn, have underpinned contemporary motor rehabilitation strategies for treating motor deficits after stroke, such as upper limb hemiparesis. However, a relative drawback has been that, in general, these strategies are most compatible with the recovery profiles of relatively high-functioning stroke survivors and therefore do not easily translate into benefit to those individuals sustaining low-functioning upper limb hemiparesis, who otherwise have poorer residual function. For these individuals, alternative motor rehabilitation strategies are currently needed. In this paper, we will review upper limb immobilisation studies that have been conducted with healthy adult humans and animals. Then, we will discuss how the findings from these studies could inspire the creation of a neural plasticity model that is likely to be of particular relevance to the context of motor rehabilitation after stroke. For instance, as will be elaborated, such model could contribute to the development of alternative motor rehabilitation strategies for treating poststroke upper limb hemiparesis. The implications of the findings from those immobilisation studies for contemporary motor rehabilitation strategies will also be discussed and perspectives for future research in this arena will be provided as well.

Investigation of the effect of EEG-BCI on the simultaneous execution of flight simulation and attentional tasks

Brain-computer interfaces (BCIs) are widely used for clinical applications and exploited to design robotic and interactive systems for healthy people. We provide evidence to control a sensorimotor electroencephalographic (EEG) BCI system while piloting a flight simulator and attending a double attentional task simultaneously. Ten healthy subjects were trained to learn how to manage a flight simulator, use the BCI system, and answer to the attentional tasks independently. Afterward, the EEG activity was collected during a first flight where subjects were required to concurrently use the BCI, and a second flight where they were required to simultaneously use the BCI and answer to the attentional tasks. Results showed that the concurrent use of the BCI system during the flight simulation does not affect the flight performances. However, BCI performances decrease from the 83 to 63 % while attending additional alertness and vigilance tasks. This work shows that it is possible to successfully control a BCI system during the execution of multiple tasks such as piloting a flight simulator with an extra cognitive load induced by attentional tasks. Such framework aims to foster the knowledge on BCI systems embedded into vehicles and robotic devices to allow the simultaneous execution of secondary tasks.

Uncorrelated Multiway Discriminant Analysis for Motor Imagery EEG Classification

Motor imagery-based brain–computer interfaces (BCIs) training has been proved to be an effective communication system between human brain and external devices. A practical problem in BCI-based systems is how to correctly and efficiently identify and extract subject-specific features from the blurred scalp electroencephalography (EEG) and translate those features into device commands in order to control external devices. In real BCI-based applications, we usually define frequency bands and channels configuration that related to brain activities beforehand. However, a steady configuration usually loses effects due to individual variability among different subjects in practical applications. In this study, a robust tensor-based method is proposed for a multiway discriminative subspace extraction from tensor-represented EEG data, which performs well in motor imagery EEG classification without the prior neurophysiologic knowledge like channels configuration and active frequency bands. Motor imagery EEG patterns in spatial-spectral-temporal domain are detected directly from the multidimensional EEG, which may provide insights to the underlying cortical activity patterns. Extensive experiment comparisons have been performed on a benchmark dataset from the famous BCI competition III as well as self-acquired data from healthy subjects and stroke patients. The experimental results demonstrate the superior performance of the proposed method over the contemporary methods.

Lateralization patterns of covert but not overt movements change with age: An EEG neurofeedback study

The mental practice of movements has been suggested as a promising add-on therapy to facilitate motor recovery after stroke. In the case of mentally practised movements, electroencephalogram (EEG) can be utilized to provide feedback about an otherwise covert act. The main target group for such an intervention are elderly patients, though research so far is largely focused on young populations (<30 years). The present study therefore aimed to examine the influence of age on the neural correlates of covert movements (CMs) in a real-time EEG neurofeedback framework. CM-induced event-related desynchronization (ERD) was studied in young (mean age: 23.6 years) and elderly (mean age: 62.7 years) healthy adults. Participants performed covert and overt hand movements. CMs were based on kinesthetic motor imagery (MI) or quasi-movements (QM). Based on previous studies investigating QM in the mu frequency range (8-13Hz) QM were expected to result in more lateralized ERD% patterns and accordingly higher classification accuracies. Independent of CM strategy the elderly were characterized by a significantly reduced lateralization of ERD%, due to stronger ipsilateral ERD%, and in consequence, reduced classification accuracies. QM were generally perceived as more vivid, but no differences were evident between MI and QM in ERD% or classification accuracies. EEG feedback enhanced task-related activity independently of strategy and age. ERD% measures of overt and covert movements were strongly related in young adults, whereas in the elderly ERD% lateralization is dissociated. In summary, we did not find evidence in support of more pronounced ERD% lateralization patterns in QM. Our finding of a less lateralized activation pattern in the elderly is in accordance to previous research and with the idea that compensatory processes help to overcome neurodegenerative changes related to normal ageing. Importantly, it indicates that EEG neurofeedback studies should place more emphasis on the age of the potential end-users.

Exploring miniaturized EEG electrodes for brain-computer interfaces. An EEG you do not see?

Electroencephalography (EEG) allows the study of the brain–behavior relationship in humans. Most of what we have learned with EEG was through observing the brain–behavior relationship under well-controlled laboratory conditions. However, by reducing “normal” behavior to a minimum the ecological validity of the results can be limited. Recent developments toward mobile EEG solutions allow to study the brain–behavior relationship outside the laboratory in more natural situations. Besides mobility and robustness with respect to motion, mobile EEG systems should also interfere as little as possible with the participant's behavior. For example, natural interaction with other people could be hindered when it is obvious that a participant wears an EEG cap. This study evaluates the signal quality obtained with an unobtrusive solution for EEG monitoring through the integration of miniaturized EEG ton-electrodes into both a discreet baseball cap and an individualized ear piece. We show that such mini electrodes located at scalp and ear locations can reliably record event related potentials in a P300 brain–computer–interface application.

Lab And/Or Field? Measuring Personality Processes and Their Social Consequences

How can researchers study personality processes and their social consequences? In our methodology overview, we first introduce ambulatory assessment methods, which repeatedly measure experiences, physiology and behaviour in people's daily lives based on real–time assessments of self–reports, physiological activity and behavioural observations. Then, we describe methods suitable for assessing personality processes in laboratory settings: self–reports on interpersonal perception, physiological measurements and behavioural observation. We discuss the combination of field and laboratory assessment methods based on their respective strengths and limitations and then highlight ethical issues surrounding the use of these methods. Finally, we propose future avenues for how developments in mobile technology can be used to advance personality research. The increasing availability and the decreasing costs of smartphones, wearable sensors and Internet connectivity offer unique potentials for further understanding the processes underlying how personality exerts broad and important social consequences. Copyright © 2015 European Association of Personality Psychology