Classifying EEG signals preceding right hand, left hand, tongue, and right foot movements and motor imageries

Detecting the Intention to Move Upper Limbs from Electroencephalographic Brain Signals

Early decoding of motor states directly from the brain activity is essential to develop brain-machine interfaces (BMI) for natural motor control of neuroprosthetic devices. Hence, this study aimed to investigate the detection of movement information before the actual movement occurs. This information piece could be useful to provide early control signals to drive BMI-based rehabilitation and motor assisted devices, thus providing a natural and active rehabilitation therapy. In this work, electroencephalographic (EEG) brain signals from six healthy right-handed participants were recorded during self-initiated reaching movements of the upper limbs. The analysis of these EEG traces showed that significant event-related desynchronization is present before and during the execution of the movements, predominantly in the motor-related α and β frequency bands and in electrodes placed above the motor cortex. This oscillatory brain activity was used to continuously detect the intention to move the limbs, that is, to identify the motor phase prior to the actual execution of the reaching movement. The results showed, first, significant classification between relax and movement intention and, second, significant detection of movement intention prior to the onset of the executed movement. On the basis of these results, detection of movement intention could be used in BMI settings to reduce the gap between mental motor processes and the actual movement performed by an assisted or rehabilitation robotic device.

Eliciting dual-frequency SSVEP using a hybrid SSVEP-P300 BCI

BACKGROUND

Steady-state visual-evoked potential (SSVEP)-based brain-computer interfaces (BCIs) generate weak SSVEP with a monitor and cannot use harmonic frequencies, whereas P300-based BCIs need multiple stimulation sequences. These issues can decrease the information transfer rate (ITR).

NEW METHOD

In this paper, we introduce a novel hybrid SSVEP-P300 speller that generates dual-frequency SSVEP, allowing it to overcome the abovementioned limitations and improve the performance. The hybrid speller consists of nine panels flickering at different frequencies. Each panel contains four different characters that appear in a random sequence. The flickering panel and the periodically updating character evoke the dual-frequency SSVEP, while the oddball stimulus of the target character evokes the P300. A canonical correlation analysis (CCA) and a step-wise linear discriminant analysis (SWLDA) classified SSVEP and P300, respectively. Ten subjects participated in offline and online experiments, in which accuracy and ITR were compared with those of conventional SSVEP and P300 spellers.

RESULTS

The offline analysis revealed not only the P300 potential but also SSVEP with peaks at sub-harmonic frequencies, demonstrating that the proposed speller elicited dual-frequency SSVEP. This dual-frequency stimulation improved SSVEP recognition, increased the number of targets by employing harmonic frequencies, reduced the stimulation time for P300, and consequently improved ITR as compared to the conventional spellers.

COMPARISON WITH EXISTING METHODS

The new method reduces the stimulation time and allows harmonic frequencies to be employed for different stimuli.

CONCLUSIONS

The results indicate that this study provides a promising approach to make the BCI speller more reliable and efficient.

Decoding human swallowing via electroencephalography: a state-of-the-art review

Swallowing and swallowing disorders have garnered continuing interest over the past several decades. Electroencephalography (EEG) is an inexpensive and non-invasive procedure with very high temporal resolution which enables analysis of short and fast swallowing events, as well as an analysis of the organizational and behavioral aspects of cortical motor preparation, swallowing execution and swallowing regulation. EEG is a powerful technique which can be used alone or in combination with other techniques for monitoring swallowing, detection of swallowing motor imagery for diagnostic or biofeedback purposes, or to modulate and measure the effects of swallowing rehabilitation. This paper provides a review of the existing literature which has deployed EEG in the investigation of oropharyngeal swallowing, smell, taste and texture related to swallowing, cortical pre-motor activation in swallowing, and swallowing motor imagery detection. Furthermore, this paper provides a brief review of the different modalities of brain imaging techniques used to study swallowing brain activities, as well as the EEG components of interest for studies on swallowing and on swallowing motor imagery. Lastly, this paper provides directions for future swallowing investigations using EEG.

Extending motor imagery by speech imagery for brain-computer interface

An electroencephalogram (EEG)-based brain computer interface (BCI) is a novel tool that translates brain intentions into control signals. As the operational dimensions of motor imagery are limited, we describe in this paper an extension of its capability by including speech imagery. Our new system was tested with the help of subjects, whose native language is Chinese. The tests were divided into two steps. The first step was speech imagery; consequently motor imagery and speech imagery were merged in the second step. Feature vectors of EEG signals were extracted from both common spatial patterns (CSP) and cross-correlation functions; then these vectors were classified by a support vector machine (SVM). The distinguishing accuracies of two intentions were found to be between 79.33% and 88.26%. This result shows that the capability of BCI for motor imagery can be extended by combining motor imagery and speech imagery.

Detection of attempted movement from the EEG during neuromuscular block: proof of principle study in awake volunteers

Brain-Computer Interfaces (BCIs) have the potential to detect intraoperative awareness during general anaesthesia. Traditionally, BCI research is aimed at establishing or improving communication and control for patients with permanent paralysis. Patients experiencing intraoperative awareness also lack the means to communicate after administration of a neuromuscular blocker, but may attempt to move. This study evaluates the principle of detecting attempted movements from the electroencephalogram (EEG) during local temporary neuromuscular blockade. EEG was obtained from four healthy volunteers making 3-second hand movements, both before and after local administration of rocuronium in one isolated forearm. Using offline classification analysis we investigated whether the attempted movements the participants made during paralysis could be distinguished from the periods when they did not move or attempt to move. Attempted movement trials were correctly identified in 81 (68-94)% (mean (95% CI)) and 84 (74-93)% of the cases using 30 and 9 EEG channels, respectively. Similar accuracies were obtained when training the classifier on the participants' actual movements. These results provide proof of the principle that a BCI can detect movement attempts during neuromuscular blockade. Based on this, in the future a BCI may serve as a communication channel between a patient under general anaesthesia and the anaesthesiologist.

Predictive classification of self-paced upper-limb analytical movements with EEG

The extent to which the electroencephalographic activity allows the characterization of movements with the upper limb is an open question. This paper describes the design and validation of a classifier of upper-limb analytical movements based on electroencephalographic activity extracted from intervals preceding self-initiated movement tasks. Features selected for the classification are subject specific and associated with the movement tasks. Further tests are performed to reject the hypothesis that other information different from the task-related cortical activity is being used by the classifiers. Six healthy subjects were measured performing self-initiated upper-limb analytical movements. A Bayesian classifier was used to classify among seven different kinds of movements. Features considered covered the alpha and beta bands. A genetic algorithm was used to optimally select a subset of features for the classification. An average accuracy of 62.9 ± 7.5% was reached, which was above the baseline level observed with the proposed methodology (30.2 ± 4.3%). The study shows how the electroencephalography carries information about the type of analytical movement performed with the upper limb and how it can be decoded before the movement begins. In neurorehabilitation environments, this information could be used for monitoring and assisting purposes.

Classification of Two Class Motor Imagery Tasks Using Hybrid GA-PSO Based K-Means Clustering

Transferring the brain computer interface (BCI) from laboratory condition to meet the real world application needs BCI to be applied asynchronously without any time constraint. High level of dynamism in the electroencephalogram (EEG) signal reasons us to look toward evolutionary algorithm (EA). Motivated by these two facts, in this work a hybrid GA-PSO based K-means clustering technique has been used to distinguish two class motor imagery (MI) tasks. The proposed hybrid GA-PSO based K-means clustering is found to outperform genetic algorithm (GA) and particle swarm optimization (PSO) based K-means clustering techniques in terms of both accuracy and execution time. The lesser execution time of hybrid GA-PSO technique makes it suitable for real time BCI application. Time frequency representation (TFR) techniques have been used to extract the feature of the signal under investigation. TFRs based features are extracted and relying on the concept of event related synchronization (ERD) and desynchronization (ERD) feature vector is formed.

Short-term kinesthetic training for sensorimotor rhythms: effects in experts and amateurs

The authors' aim was to examine whether short-term kinesthetic training affects the level of sensorimotor rhythm (SMR) in different frequency band: alpha (8-12 Hz), lower beta (12.5-16 Hz) and beta (16.5-20 Hz) during the execution of a motor imagery task of closing and opening the right and the left hand by experts (jugglers, practicing similar exercises on an everyday basis) and amateurs (individuals not practicing any sports). It was found that the performance of short kinesthetic training increases the power of alpha rhythm when executing imagery tasks only in the group of amateurs. Therefore, kinesthetic training may be successfully used as a method increasing the vividness of motor imagery, for example, in tasks involving the control of brain-computer interfaces based on SMR.

Sitting and standing intention can be decoded from scalp EEG recorded prior to movement execution

Low frequency signals recorded from non-invasive electroencephalography (EEG), in particular movement-related cortical potentials (MRPs), are associated with preparation and execution of movement and thus present a target for use in brain-machine interfaces. We investigated the ability to decode movement intent from delta-band (0.1-4 Hz) EEG recorded immediately before movement execution in healthy volunteers. We used data from epochs starting 1.5 s before movement onset to classify future movements into one of three classes: stand-up, sit-down, or quiet. We assessed classification accuracy in both externally triggered and self-paced paradigms. Movement onset was determined from electromyography (EMG) recordings synchronized with EEG signals. We employed an artifact subspace reconstruction (ASR) algorithm to eliminate high amplitude noise before building our time-embedded EEG features. We applied local Fisher's discriminant analysis to reduce the dimensionality of our spatio-temporal features and subsequently used a Gaussian mixture model classifier for our three class problem. Our results demonstrate significantly better than chance classification accuracy (chance level = 33.3%) for the self-initiated (78.0 ± 2.6%) and triggered (74.7 ± 5.7%) paradigms. Surprisingly, we found no significant difference in classification accuracy between the self-paced and cued paradigms when using the full set of non-peripheral electrodes. However, accuracy was significantly increased for self-paced movements when only electrodes over the primary motor area were used. Overall, this study demonstrates that delta-band EEG recorded immediately before movement carries discriminative information regarding movement type. Our results suggest that EEG-based classifiers could improve lower-limb neuroprostheses and neurorehabilitation techniques by providing earlier detection of movement intent, which could be used in robot-assisted strategies for motor training and recovery of function.

Continuous decoding of movement intention of upper limb self-initiated analytic movements from pre-movement EEG correlates

BACKGROUND

Brain-machine interfaces (BMI) have recently been integrated within motor rehabilitation therapies by actively involving the central nervous system (CNS) within the exercises. For instance, the online decoding of intention of motion of a limb from pre-movement EEG correlates is being used to convert passive rehabilitation strategies into active ones mediated by robotics. As early stages of upper limb motor rehabilitation usually focus on analytic single-joint mobilizations, this paper investigates the feasibility of building BMI decoders for these specific types of movements.

METHODS

Two different experiments were performed within this study. For the first one, six healthy subjects performed seven self-initiated upper-limb analytic movements, involving from proximal to distal articulations. For the second experiment, three spinal cord injury patients performed two of the previously studied movements with their healthy elbow and paralyzed wrist. In both cases EEG neural correlates such as the event-related desynchronization (ERD) and movement related cortical potentials (MRCP) were analyzed, as well as the accuracies of continuous decoders built using the pre-movement features of these correlates (i.e., the intention of motion was decoded before movement onset).

RESULTS

The studied movements could be decoded in both healthy subjects and patients. For healthy subjects there were significant differences in the EEG correlates and decoding accuracies, dependent on the moving joint. Percentages of correctly anticipated trials ranged from 75% to 40% (with chance level being around 20%), with better performances for proximal than for distal movements. For the movements studied for the SCI patients the accuracies were similar to the ones of the healthy subjects.

CONCLUSIONS

This paper shows how it is possible to build continuous decoders to detect movement intention from EEG correlates for seven different upper-limb analytic movements. Furthermore we report differences in accuracies among movements, which might have an impact on the design of the rehabilitation technologies that will integrate this new type of information. The applicability of the decoders was shown in a clinical population, with similar performances between healthy subjects and patients.

Detection of the onset of upper-limb movements based on the combined analysis of changes in the sensorimotor rhythms and slow cortical potentials

OBJECTIVE

Characterizing the intention to move by means of electroencephalographic activity can be used in rehabilitation protocols with patients' cortical activity taking an active role during the intervention. In such applications, the reliability of the intention estimation is critical both in terms of specificity 'number of misclassifications' and temporal accuracy. Here, a detector of the onset of voluntary upper-limb reaching movements based on the cortical rhythms and the slow cortical potentials is proposed. The improvement in detections due to the combination of these two cortical patterns is also studied.

APPROACH

Upper-limb movements and cortical activity were recorded in healthy subjects and stroke patients performing self-paced reaching movements. A logistic regression combined the output of two classifiers: (i) a naïve Bayes classifier trained to detect the event-related desynchronization preceding the movement onset and (ii) a matched filter detecting the bereitschaftspotential. The proposed detector was compared with the detectors by using each one of these cortical patterns separately. In addition, differences between the patients and healthy subjects were analysed.

MAIN RESULTS

On average, 74.5 ± 13.8% and 82.2 ± 10.4% of the movements were detected with 1.32 ± 0.87 and 1.50 ± 1.09 false detections generated per minute in the healthy subjects and the patients, respectively. A significantly better performance was achieved by the combined detector (as compared to the detectors of the two cortical patterns separately) in terms of true detections (p = 0.099) and false positives (p = 0.0083).

SIGNIFICANCE

A rationale is provided for combining information from cortical rhythms and slow cortical potentials to detect the onsets of voluntary upper-limb movements. It is demonstrated that the two cortical processes supply complementary information that can be summed up to boost the performance of the detector. Successful results have been also obtained with stroke patients, which supports the use of the proposed system in brain-computer interface applications with this group of patients.

Movement type prediction before its onset using signals from prefrontal area: an electrocorticography study

Power changes in specific frequency bands are typical brain responses during motor planning or preparation. Many studies have demonstrated that, in addition to the premotor, supplementary motor, and primary sensorimotor areas, the prefrontal area contributes to generating such responses. However, most brain-computer interface (BCI) studies have focused on the primary sensorimotor area and have estimated movements using postonset period brain signals. Our aim was to determine whether the prefrontal area could contribute to the prediction of voluntary movement types before movement onset. In our study, electrocorticography (ECoG) was recorded from six epilepsy patients while performing two self-paced tasks: hand grasping and elbow flexion. The prefrontal area was sufficient to allow classification of different movements through the area's premovement signals (−2.0 s to 0 s) in four subjects. The most pronounced power difference frequency band was the beta band (13–30 Hz). The movement prediction rate during single trial estimation averaged 74% across the six subjects. Our results suggest that premovement signals in the prefrontal area are useful in distinguishing different movement tasks and that the beta band is the most informative for prediction of movement type before movement onset.

Changes in hemodynamic signals accompanying motor imagery and motor execution of swallowing: a near-infrared spectroscopy study

In the present study we investigated hemodynamic changes in the brain in response to motor execution (ME) and motor imagery (MI) of swallowing using near-infrared spectroscopy (NIRS). Previous studies provide evidence that ME and MI of limb movements lead to comparable brain activation patterns indicating the potential value of MI for motor rehabilitation. In this context, identifying brain correlates of MI of swallowing may be potentially useful for the treatment of dysphagia. Fourteen healthy participants actively swallowed water (ME) and mentally imagined to swallow water (MI) in a randomized order while changes in concentration of oxygenated hemoglobin (oxy-Hb) and deoxygenated hemoglobin (deoxy-Hb) were assessed. MI and ME led to the strongest NIRS signal changes in the inferior frontal gyrus. During and after ME, oxy-Hb significantly increased, with a maximum peak around 15s after task onset. In contrast, oxy-Hb decreased during MI compared to a rest period probably because of motor inhibition mechanisms. Changes in deoxy-Hb were largely comparable between MI and ME, especially when participants used a kinesthetic motor imagery strategy during MI compared to no specific strategy. Hence, the present study provides new evidence concerning timing and topographical distribution of the hemodynamic response during ME and MI of swallowing.

Decoding intention at sensorimotor timescales

The ability to decode an individual's intentions in real time has long been a ‘holy grail’ of research on human volition. For example, a reliable method could be used to improve scientific study of voluntary action by allowing external probe stimuli to be delivered at different moments during development of intention and action. Several Brain Computer Interface applications have used motor imagery of repetitive actions to achieve this goal. These systems are relatively successful, but only if the intention is sustained over a period of several seconds; much longer than the timescales identified in psychophysiological studies for normal preparation for voluntary action. We have used a combination of sensorimotor rhythms and motor imagery training to decode intentions in a single-trial cued-response paradigm similar to those used in human and non-human primate motor control research. Decoding accuracy of over 0.83 was achieved with twelve participants. With this approach, we could decode intentions to move the left or right hand at sub-second timescales, both for instructed choices instructed by an external stimulus and for free choices generated intentionally by the participant. The implications for volition are considered.

Decoding individual finger movements from one hand using human EEG signals

Brain computer interface (BCI) is an assistive technology, which decodes neurophysiological signals generated by the human brain and translates them into control signals to control external devices, e.g., wheelchairs. One problem challenging noninvasive BCI technologies is the limited control dimensions from decoding movements of, mainly, large body parts, e.g., upper and lower limbs. It has been reported that complicated dexterous functions, i.e., finger movements, can be decoded in electrocorticography (ECoG) signals, while it remains unclear whether noninvasive electroencephalography (EEG) signals also have sufficient information to decode the same type of movements. Phenomena of broadband power increase and low-frequency-band power decrease were observed in EEG in the present study, when EEG power spectra were decomposed by a principal component analysis (PCA). These movement-related spectral structures and their changes caused by finger movements in EEG are consistent with observations in previous ECoG study, as well as the results from ECoG data in the present study. The average decoding accuracy of 77.11% over all subjects was obtained in classifying each pair of fingers from one hand using movement-related spectral changes as features to be decoded using a support vector machine (SVM) classifier. The average decoding accuracy in three epilepsy patients using ECoG data was 91.28% with the similarly obtained features and same classifier. Both decoding accuracies of EEG and ECoG are significantly higher than the empirical guessing level (51.26%) in all subjects (p<0.05). The present study suggests the similar movement-related spectral changes in EEG as in ECoG, and demonstrates the feasibility of discriminating finger movements from one hand using EEG. These findings are promising to facilitate the development of BCIs with rich control signals using noninvasive technologies.

Towards effective non-invasive brain-computer interfaces dedicated to gait rehabilitation systems

In the last few years, significant progress has been made in the field of walk rehabilitation. Motor cortex signals in bipedal monkeys have been interpreted to predict walk kinematics. Epidural electrical stimulation in rats and in one young paraplegic has been realized to partially restore motor control after spinal cord injury. However, these experimental trials are far from being applicable to all patients suffering from motor impairments. Therefore, it is thought that more simple rehabilitation systems are desirable in the meanwhile. The goal of this review is to describe and summarize the progress made in the development of non-invasive brain-computer interfaces dedicated to motor rehabilitation systems. In the first part, the main principles of human locomotion control are presented. The paper then focuses on the mechanisms of supra-spinal centers active during gait, including results from electroencephalography, functional brain imaging technologies [near-infrared spectroscopy (NIRS), functional magnetic resonance imaging (fMRI), positron-emission tomography (PET), single-photon emission-computed tomography (SPECT)] and invasive studies. The first brain-computer interface (BCI) applications to gait rehabilitation are then presented, with a discussion about the different strategies developed in the field. The challenges to raise for future systems are identified and discussed. Finally, we present some proposals to address these challenges, in order to contribute to the improvement of BCI for gait rehabilitation.

Detection and classification of movement-related cortical potentials associated with task force and speed

OBJECTIVE

In this study, the objective was to detect movement intentions and extract different levels of force and speed of the intended movement from scalp electroencephalography (EEG). We then estimated the performance of the closed loop system.

APPROACH

Cued movements were detected from continuous EEG recordings using a template of the initial phase of the movement-related cortical potential in 12 healthy subjects. The temporal features, extracted from the movement intention, were classified with an optimized support vector machine. The system performance was evaluated when combining detection with classification.

MAIN RESULTS

The system detected 81% of the movements and correctly classified 75 ± 9% and 80 ± 10% of these at the point of detection when varying the force and speed, respectively. When the detector was combined with the classifier, the system detected and correctly classified 64 ± 13% and 67 ± 13% of these movements. The system detected and incorrectly classified 21 ± 7% and 16 ± 9% of the movements. The movements were detected 317 ± 73 ms before the movement onset.

SIGNIFICANCE

The results indicate that it is possible to detect movement intentions with limited latencies, and extract and classify different levels of force and speed, which may be combined with assistive technologies for patient-driven neurorehabilitation.

Single-trial classification of gait and point movement preparation from human EEG

Neuroimaging studies provide evidence of cortical involvement immediately before and during gait and during gait-related behaviors such as stepping in place or motor imagery of gait. Here we attempt to perform single-trial classification of gait intent from another movement plan (point intent) or from standing in place. Subjects walked naturally from a starting position to a designated ending position, pointed at a designated position from the starting position, or remained standing at the starting position. The 700 ms of recorded electroencephalography (EEG) before movement onset was used for single-trial classification of trials based on action type and direction (left walk, forward walk, right walk, left point, right point, and stand) as well as action type regardless of direction (stand, walk, point). Classification using regularized LDA was performed on a principal components analysis (PCA) reduced feature space composed of coefficients from levels 1 to 9 of a discrete wavelet decomposition using the Daubechies 4 wavelet. We achieved significant classification for all conditions, with errors as low as 17% when averaged across nine subjects. LDA and PCA highly weighted frequency ranges that included movement related potentials (MRPs), with smaller contributions from frequency ranges that included mu and beta idle motor rhythms. Additionally, error patterns suggested a spatial structure to the EEG signal. Future applications of the cortical gait intent signal may include an additional dimension of control for prosthetics, preemptive corrective feedback for gait disturbances, or human computer interfaces (HCI).

Single trial analysis of slow cortical potentials: a study on anticipation related potentials

OBJECTIVE

Abundant literature suggests the use of slow cortical potentials (SCPs) in a wide spectrum of basic and applied neuroscience areas. Due to their low signal to noise ratio, these potentials are often studied using grand-average analysis, which conceals trial-to-trial information. Moreover, most of the single trial analysis methods in the literature are based on classical electroencephalogram (EEG) features ([1-30] Hz) and are likely to be unsuitable for SCPs that have different signal properties (such as having the signal's spectral content in the range [0.2-0.7] Hz). In this paper we provide insights into the selection of appropriate parameters for spectral and spatial filtering.

APPROACH

We study anticipation related SCPs recorded using a web-browser application protocol and a full-band EEG (FbEEG) setup from 11 subjects on two different days.

MAIN RESULTS

We first highlight the role of a bandpass with [0.1-1.0] Hz in comparison with common practices (e.g., either with full dc, just a lowpass, or with a minimal highpass cut-off around 0.05 Hz). Secondly, we suggest that a combination of spatial-smoothing filter and common average reference (CAR) is more suitable than the spatial filters often reported in the literature (e.g., re-referencing to an electrode, Laplacian or CAR alone). Thirdly, with the help of these preprocessing steps, we demonstrate the generalization capabilities of linear classifiers across several days (AUC of 0.88 ± 0.05 on average with a minimum of 0.81 ± 0.03 and a maximum of 0.97 ± 0.01). We also report the possibility of further improvements using a Bayesian fusion technique applied to electrode-specific classifiers.

SIGNIFICANCE

We believe the suggested spatial and spectral preprocessing methods are advantageous for grand-average and single trial analysis of SCPs obtained from EEG, MEG as well as for electrocorticogram. The use of these methods will impact basic neurophysiological studies as well as the use of SCPs in the design of neuroprosthetics.

How capable is non-invasive EEG data of predicting the next movement? A mini review

In this study we summarize the features that characterize the pre-movements and pre-motor imageries (before imagining the movement) electroencephalography (EEG) data in humans from both Neuroscientists' and Engineers' point of view. We demonstrate what the brain status is before a voluntary movement and how it has been used in practical applications such as brain computer interfaces (BCIs). Usually, in BCI applications, the focus of study is on the after-movement or motor imagery potentials. However, this study shows that it is possible to develop BCIs based on the before-movement or motor imagery potentials such as the Bereitschaftspotential (BP). Using the pre-movement or pre-motor imagery potentials, we can correctly predict the onset of the upcoming movement, its direction and even the limb that is engaged in the performance. This information can help in designing a more efficient rehabilitation tool as well as BCIs with a shorter response time which appear more natural to the users.

Frequency recognition methods for dual-frequency SSVEP based brain-computer interface

Dual-frequency steady-state visual evoked potential (SSVEP) was suggested to generate more stimuli using a few flickering frequencies for brain-computer interface. Dual--frequency SSVEP peaks at more than two frequencies-both main and harmonic frequencies. However multi-frequency recognition strategy has not been investigated for dual-frequency SSVEP. In this paper, three modified power spectral density analysis (PSDA) methods and two modified canonical correlation analysis (CCA) methods were tested for dual-frequency SSVEP classification. Three methods among the five methods used conventional features or classification techniques, and the other two methods used modified features for harmonic frequencies. As a result, CCA with novel features showed the best BCI performance. Also the use of harmonic frequencies improved BCI performance of dual-frequency SSVEP.

Classification of resting, anticipation and movement states in self-initiated arm movements for EEG brain computer interfaces

In the last years, there has been an increasing interest in using Brain Computer Interfaces (BCI) within motor rehabilitation therapies that use robotic devices or functional electro stimulation to help or guide the efforts of the patient to move her body. A crucial step of these therapies is to provide help to the user just when she is actually trying to accomplish a certain motion or task One of the most promising applications of BCI systems in this context is its ability to measure the user intentions and actions to trigger the rehabilitation devices accordingly. This paper studies the single-trial classification based on EEG measurements of three basic states during the execution of self-initiated motion: rest, motion preparation (or anticipation) and motion. We conducted an experiment where the participants had to reach at their will eight different locations from a fixed starting position. Results for seven healthy subjects show that it is possible to achieve good classification rates given that features are carefully selected for each subject and for each pair of states.

Source Detection and Functional Connectivity of the Sensorimotor Cortex during Actual and Imaginary Limb Movement: A Preliminary Study on the Implementation of eConnectome in Motor Imagery Protocols

Introduction. Sensorimotor cortex is activated similarly during motor execution and motor imagery. The study of functional connectivity networks (FCNs) aims at successfully modeling the dynamics of information flow between cortical areas.Materials and Methods. Seven healthy subjects performed 4 motor tasks (real foot, imaginary foot, real hand, and imaginary hand movements), while electroencephalography was recorded over the sensorimotor cortex. Event-Related Desynchronization/Synchronization (ERD/ERS) of the mu-rhythm was used to evaluate MI performance. Source detection and FCNs were studied with eConnectome.Results and Discussion. Four subjects produced similar ERD/ERS patterns between motor execution and imagery during both hand and foot tasks, 2 subjects only during hand tasks, and 1 subject only during foot tasks. All subjects showed the expected brain activation in well-performed MI tasks, facilitating cortical source estimation. Preliminary functional connectivity analysis shows formation of networks on the sensorimotor cortex during motor imagery and execution.Conclusions. Cortex activation maps depict sensorimotor cortex activation, while similar functional connectivity networks are formed in the sensorimotor cortex both during actual and imaginary movements. eConnectome is demonstrated as an effective tool for the study of cortex activation and FCN. The implementation of FCN in motor imagery could induce promising advancements in Brain Computer Interfaces.

Steering a tractor by means of an EMG-based human-machine interface

An electromiographic (EMG)-based human-machine interface (HMI) is a communication pathway between a human and a machine that operates by means of the acquisition and processing of EMG signals. This article explores the use of EMG-based HMIs in the steering of farm tractors. An EPOC, a low-cost human-computer interface (HCI) from the Emotiv Company, was employed. This device, by means of 14 saline sensors, measures and processes EMG and electroencephalographic (EEG) signals from the scalp of the driver. In our tests, the HMI took into account only the detection of four trained muscular events on the driver's scalp: eyes looking to the right and jaw opened, eyes looking to the right and jaw closed, eyes looking to the left and jaw opened, and eyes looking to the left and jaw closed. The EMG-based HMI guidance was compared with manual guidance and with autonomous GPS guidance. A driver tested these three guidance systems along three different trajectories: a straight line, a step, and a circumference. The accuracy of the EMG-based HMI guidance was lower than the accuracy obtained by manual guidance, which was lower in turn than the accuracy obtained by the autonomous GPS guidance; the computed standard deviations of error to the desired trajectory in the straight line were 16 cm, 9 cm, and 4 cm, respectively. Since the standard deviation between the manual guidance and the EMG-based HMI guidance differed only 7 cm, and this difference is not relevant in agricultural steering, it can be concluded that it is possible to steer a tractor by an EMG-based HMI with almost the same accuracy as with manual steering.

Prediction of human voluntary movement before it occurs

OBJECTIVE

Human voluntary movement is associated with two changes in electroencephalography (EEG) that can be observed as early as 1.5 s prior to movement: slow DC potentials and frequency power shifts in the alpha and beta bands. Our goal was to determine whether and when we can reliably predict human natural movement BEFORE it occurs from EEG signals ONLINE IN REAL-TIME.

METHODS

We developed a computational algorithm to support online prediction. Seven healthy volunteers participated in this study and performed wrist extensions at their own pace.

RESULTS

The average online prediction time was 0.62±0.25 s before actual movement monitored by EMG signals. There were also predictions that occurred without subsequent actual movements, where subjects often reported that they were thinking about making a movement.

CONCLUSION

Human voluntary movement can be predicted before movement occurs.

SIGNIFICANCE

The successful prediction of human movement intention will provide further insight into how the brain prepares for movement, as well as the potential for direct cortical control of a device which may be faster than normal physical control.

Electroencephalographic (EEG) control of three-dimensional movement

Brain-computer interfaces (BCIs) can use brain signals from the scalp (EEG), the cortical surface (ECoG), or within the cortex to restore movement control to people who are paralyzed. Like muscle-based skills, BCIs' use requires activity-dependent adaptations in the brain that maintain stable relationships between the person's intent and the signals that convey it. This study shows that humans can learn over a series of training sessions to use EEG for three-dimensional control. The responsible EEG features are focused topographically on the scalp and spectrally in specific frequency bands. People acquire simultaneous control of three independent signals (one for each dimension) and reach targets in a virtual three-dimensional space. Such BCI control in humans has not been reported previously. The results suggest that with further development noninvasive EEG-based BCIs might control the complex movements of robotic arms or neuroprostheses.

Multi-class filter bank common spatial pattern for four-class motor imagery BCI

This paper investigates the classification of multi-class motor imagery for electroencephalogram (EEG)-based Brain-Computer Interface (BCI) using the Filter Bank Common Spatial Pattern (FBCSP) algorithm. The FBCSP algorithm classifies EEG measurements from features constructed using subject-specific temporal-spatial filters. However, the FBCSP algorithm is limited to binary-class motor imagery. Hence, this paper proposes 3 approaches of multi-class extension to the FBCSP algorithm: One-versus-Rest, Pair-Wise and Divide-and-Conquer. These approaches decompose the multi-class problem into several binary-class problems. The study is conducted on the BCI Competition IV dataset IIa, which comprises single-trial EEG data from 9 subjects performing 4-class motor imagery of left-hand, right-hand, foot and tongue actions. The results showed that the multi-class FBCSP algorithm could extract features that matched neurophysiological knowledge, and yielded the best performance on the evaluation data compared to other international submissions.

Real-time decision fusion for multimodal neural prosthetic devices

BACKGROUND

The field of neural prosthetics aims to develop prosthetic limbs with a brain-computer interface (BCI) through which neural activity is decoded into movements. A natural extension of current research is the incorporation of neural activity from multiple modalities to more accurately estimate the user's intent. The challenge remains how to appropriately combine this information in real-time for a neural prosthetic device.

METHODOLOGY/PRINCIPAL FINDINGS

Here we propose a framework based on decision fusion, i.e., fusing predictions from several single-modality decoders to produce a more accurate device state estimate. We examine two algorithms for continuous variable decision fusion: the Kalman filter and artificial neural networks (ANNs). Using simulated cortical neural spike signals, we implemented several successful individual neural decoding algorithms, and tested the capabilities of each fusion method in the context of decoding 2-dimensional endpoint trajectories of a neural prosthetic arm. Extensively testing these methods on random trajectories, we find that on average both the Kalman filter and ANNs successfully fuse the individual decoder estimates to produce more accurate predictions.

CONCLUSIONS

Our results reveal that a fusion-based approach has the potential to improve prediction accuracy over individual decoders of varying quality, and we hope that this work will encourage multimodal neural prosthetics experiments in the future.

Buildup of choice-predictive activity in human motor cortex during perceptual decision making

Simple perceptual decisions are ideally suited for studying the sensorimotor transformations underlying flexible behavior. During perceptual detection, a noisy sensory signal is converted into a behavioral report of the presence or absence of a perceptual experience. Here, we used magnetoencephalography (MEG) to link the dynamics of neural population activity in human motor cortex to perceptual choices in a "yes/no" visual motion detection task. We found that (1) motor response-selective MEG activity in the "gamma" (64-100 Hz) and "beta" (12-36 Hz) frequency ranges predicted subjects' choices several seconds before their overt manual response; (2) this choice-predictive activity built up gradually during stimulus viewing toward both "yes" and "no" choices; and (3) the choice-predictive activity in motor cortex reflected the temporal integral of gamma-band activity in motion-sensitive area MT during stimulus viewing. Because gamma-band activity in MT reflects visual motion strength, these findings suggest that, during motion detection, motor plans for both "yes" and "no" choices result from continuously accumulating sensory evidence. We conclude that frequency-specific neural population activity at the cortical output stage of sensorimotor pathways provides a window into the mechanisms underlying perceptual decisions.