"You Have Reached Your Destination": A Single Trial EEG Classification Study

Bayesian learning from multi-way EEG feedback for robot navigation and target identification

Many brain-computer interfaces require a high mental workload. Recent research has shown that this could be greatly alleviated through machine learning, inferring user intentions via reactive brain responses. These signals are generated spontaneously while users merely observe assistive robots performing tasks. Using reactive brain signals, existing studies have addressed robot navigation tasks with a very limited number of potential target locations. Moreover, they use only binary, error-vs-correct classification of robot actions, leaving more detailed information unutilised. In this study a virtual robot had to navigate towards, and identify, target locations in both small and large grids, wherein any location could be the target. For the first time, we apply a system utilising detailed EEG information: 4-way classification of movements is performed, including specific information regarding when the target is reached. Additionally, we classify whether targets are correctly identified. Our proposed Bayesian strategy infers the most likely target location from the brain's responses. The experimental results show that our novel use of detailed information facilitates a more efficient and robust system than the state-of-the-art. Furthermore, unlike state-of-the-art approaches, we show scalability of our proposed approach: By tuning parameters appropriately, our strategy correctly identifies 98% of targets, even in large search spaces.

Visual Object Recognition from Single-Trial EEG Signals using Machine Learning Wrapper Techniques

Responses of the human brain to different visual stimuli elicit specific patterns in electroencephalography (EEG) signals. It is confirmed that by analyzing these patterns, we can recognize the category of the visited objects. However, high levels of noise and artifacts in EEG signals and the discrepancies between the recorded data from different subjects in visual object recognition task make classification of cognitive states of subjects a serious challenge. In this research, we present a framework for evaluating machine learning and wrapper channel selection algorithms used for classifying single-trial EEG signals recorded in response to photographic stimuli. It is shown that by correctly mapping the entire EEG data space to informative feature spaces (IFS), the performance of the classification methods can improve significantly. Results outperform the state-of-the-art results and confirm efficiency of the proposed feature selection methods in capturing the most informative EEG channels. This can help to achieve high separability of object categories in single-trial visual object recognition task.

A Multimodal Neuroprosthetic Interface to Record, Modulate and Classify Electrophysiological Biomarkers Relevant to Neuropsychiatric Disorders

Most mental disorders, such as addictive diseases or schizophrenia, are characterized by impaired cognitive function and behavior control originating from disturbances within prefrontal neural networks. Their often chronic reoccurring nature and the lack of efficient therapies necessitate the development of new treatment strategies. Brain-computer interfaces, equipped with multiple sensing and stimulation abilities, offer a new toolbox whose suitability for diagnosis and therapy of mental disorders has not yet been explored. This study, therefore, aimed to develop a biocompatible and multimodal neuroprosthesis to measure and modulate prefrontal neurophysiological features of neuropsychiatric symptoms. We used a 3D-printing technology to rapidly prototype customized bioelectronic implants through robot-controlled deposition of soft silicones and a conductive platinum ink. We implanted the device epidurally above the medial prefrontal cortex of rats and obtained auditory event-related brain potentials in treatment-naïve animals, after alcohol administration and following neuromodulation through implant-driven electrical brain stimulation and cortical delivery of the anti-relapse medication naltrexone. Towards smart neuroprosthetic interfaces, we furthermore developed machine learning algorithms to autonomously classify treatment effects within the neural recordings. The neuroprosthesis successfully captured neural activity patterns reflecting intact stimulus processing and alcohol-induced neural depression. Moreover, implant-driven electrical and pharmacological stimulation enabled successful enhancement of neural activity. A machine learning approach based on stepwise linear discriminant analysis was able to deal with sparsity in the data and distinguished treatments with high accuracy. Our work demonstrates the feasibility of multimodal bioelectronic systems to monitor, modulate and identify healthy and affected brain states with potential use in a personalized and optimized therapy of neuropsychiatric disorders.

Brain-Computer Interfaces for Children With Complex Communication Needs and Limited Mobility: A Systematic Review

Brain-computer interfaces (BCIs) represent a new frontier in the effort to maximize the ability of individuals with profound motor impairments to interact and communicate. While much literature points to BCIs' promise as an alternative access pathway, there have historically been few applications involving children and young adults with severe physical disabilities. As research is emerging in this sphere, this article aims to evaluate the current state of translating BCIs to the pediatric population. A systematic review was conducted using the Scopus, PubMed, and Ovid Medline databases. Studies of children and adolescents that reported BCI performance published in English in peer-reviewed journals between 2008 and May 2020 were included. Twelve publications were identified, providing strong evidence for continued research in pediatric BCIs. Research evidence was generally at multiple case study or exploratory study level, with modest sample sizes. Seven studies focused on BCIs for communication and five on mobility. Articles were categorized and grouped based on type of measurement (i.e., non-invasive and invasive), and the type of brain signal (i.e., sensory evoked potentials or movement-related potentials). Strengths and limitations of studies were identified and used to provide requirements for clinical translation of pediatric BCIs. This systematic review presents the state-of-the-art of pediatric BCIs focused on developing advanced technology to support children and youth with communication disabilities or limited manual ability. Despite a few research studies addressing the application of BCIs for communication and mobility in children, results are encouraging and future works should focus on customizable pediatric access technologies based on brain activity.

Shoulder kinematics plus contextual target information enable control of multiple distal joints of a simulated prosthetic arm and hand

Background

Prosthetic restoration of reach and grasp function after a trans-humeral amputation requires control of multiple distal degrees of freedom in elbow, wrist and fingers. However, such a high level of amputation reduces the amount of available myoelectric and kinematic information from the residual limb.

Methods

To overcome these limits, we added contextual information about the target’s location and orientation such as can now be extracted from gaze tracking by computer vision tools. For the task of picking and placing a bottle in various positions and orientations in a 3D virtual scene, we trained artificial neural networks to predict postures of an intact subject’s elbow, forearm and wrist (4 degrees of freedom) either solely from shoulder kinematics or with additional knowledge of the movement goal. Subjects then performed the same tasks in the virtual scene with distal joints predicted from the context-aware network.

Results

Average movement times of 1.22s were only slightly longer than the naturally controlled movements (0.82 s). When using a kinematic-only network, movement times were much longer (2.31s) and compensatory movements from trunk and shoulder were much larger. Integrating contextual information also gave rise to motor synergies closer to natural joint coordination.

Conclusions

Although notable challenges remain before applying the proposed control scheme to a real-world prosthesis, our study shows that adding contextual information to command signals greatly improves prediction of distal joint angles for prosthetic control.

Single-Option P300-BCI Performance Is Affected by Visual Stimulation Conditions

The P300 paradigm is one of the most promising techniques for its robustness and reliability in Brain-Computer Interface (BCI) applications, but it is not exempt from shortcomings. The present work studied single-trial classification effectiveness in distinguishing between target and non-target responses considering two conditions of visual stimulation and the variation of the number of symbols presented to the user in a single-option visual frame. In addition, we also investigated the relationship between the classification results of target and non-target events when training and testing the machine-learning model with datasets containing different stimulation conditions and different number of symbols. To this end, we designed a P300 experimental protocol considering, as conditions of stimulation: the color highlighting or the superimposing of a cartoon face and from four to nine options. These experiments were carried out with 19 healthy subjects in 3 sessions. The results showed that the Event-Related Potentials (ERP) responses and the classification accuracy are stronger with cartoon faces as stimulus type and similar irrespective of the amount of options. In addition, the classification performance is reduced when using datasets with different type of stimulus, but it is similar when using datasets with different the number of symbols. These results have a special connotation for the design of systems, in which it is intended to elicit higher levels of evoked potentials and, at the same time, optimize training time.

Four-Way Classification of EEG Responses To Virtual Robot Navigation

Studies have shown the possibility of using brain signals that are automatically generated while observing a navigation task as feedback for semi-autonomous control of a robot. This allows the robot to learn quasi-optimal routes to intended targets. We have combined the subclassification of two different types of navigational errors, with the subclassification of two different types of correct navigational actions, to create a 4-way classification strategy, providing detailed information about the type of action the robot performed. We used a 2-stage stepwise linear discriminant analysis approach, and tested this using brain signals from 8 and 14 participants observing two robot navigation tasks. Classification results were significantly above the chance level, with mean overall accuracy of 44.3% and 36.0% for the two datasets. As a proof of concept, we have shown that it is possible to perform fine-grained, 4-way classification of robot navigational actions, based on the electroencephalogram responses of participants who only had to observe the task. This study provides the next step towards comprehensive implicit brain-machine communication, and towards an efficient semi-autonomous brain-computer interface.

Brain-Computer Interface-Based Humanoid Control: A Review

A Brain-Computer Interface (BCI) acts as a communication mechanism using brain signals to control external devices. The generation of such signals is sometimes independent of the nervous system, such as in Passive BCI. This is majorly beneficial for those who have severe motor disabilities. Traditional BCI systems have been dependent only on brain signals recorded using Electroencephalography (EEG) and have used a rule-based translation algorithm to generate control commands. However, the recent use of multi-sensor data fusion and machine learning-based translation algorithms has improved the accuracy of such systems. This paper discusses various BCI applications such as tele-presence, grasping of objects, navigation, etc. that use multi-sensor fusion and machine learning to control a humanoid robot to perform a desired task. The paper also includes a review of the methods and system design used in the discussed applications.