User activity recognition system to improve the performance of environmental control interfaces: a pilot study with patients

BACKGROUND

Assistive technologies aim to increase quality of life, reduce dependence on care giver and on the long term care system. Several studies have demonstrated the effectiveness in the use of assistive technology for environment control and communication systems. The progress of brain-computer interfaces (BCI) research together with exoskeleton enable a person with motor impairment to interact with new elements in the environment. This paper aims to evaluate the environment control interface (ECI) developed under the AIDE project conditions, a multimodal interface able to analyze and extract relevant information from the environments as well as from the identification of residual abilities, behaviors, and intentions of the user.

METHODS

This study evaluated the ECI in a simulated scenario using a two screen layout: one with the ECI and the other with a simulated home environment, developed for this purpose. The sensorimotor rhythms and the horizontal oculoversion, acquired through BCI2000, a multipurpose standard BCI platform, were used to online control the ECI after the user training and system calibration. Eight subjects with different neurological diseases and spinal cord injury participated in this study. The subjects performed simulated activities of daily living (ADLs), i.e. actions in the simulated environment as drink, switch on a lamp or raise the bed head, during ten minutes in two different modes, AIDE mode, using a prediction model, to recognize the user intention facilitating the scan, and Manual mode, without a prediction model.

RESULTS

The results show that the mean task time spent in the AIDE mode was less than in the Manual, i.e the users were able to perform more tasks in the AIDE mode during the same time. The results showed a statistically significant differences with p<0.001. Regarding the steps, i.e the number of abstraction levels crossed in the ECI to perform an ADL, the users performed one step in the 90% of the tasks using the AIDE mode and three steps, at least, were necessary in the Manual mode. The user's intention prediction was performed through conditional random fields (CRF), with a global accuracy about 87%.

CONCLUSIONS

The environment analysis and the identification of the user's behaviors can be used to predict the user intention opening a new paradigm in the design of the ECIs. Although the developed ECI was tested only in a simulated home environment, it can be easily adapted to a real environment increasing the user independence at home.

Considering Augmentative and Alternative Communication Research for Brain-Computer Interface Practice

PURPOSE

Brain-computer interfaces (BCIs) aim to provide access to augmentative and alternative communication (AAC) devices via brain activity alone. However, while BCI technology is expanding in the laboratory setting there is minimal incorporation into clinical practice. Building upon established AAC research and clinical best practices may aid the clinical translation of BCI practice, allowing advancements in both fields to be fully leveraged.

METHOD

A multidisciplinary team developed considerations for how BCI products, practice, and policy may build upon existing AAC research, based upon published reports of existing AAC and BCI procedures.

OUTCOMES/BENEFITS

Within each consideration, a review of BCI research is provided, along with considerations regarding how BCI procedures may build upon existing AAC methods. The consistent use of clinical/research procedures across disciplines can help facilitate collaborative efforts, engaging a range-individuals within the AAC community in the transition of BCI into clinical practice.

Meningeal inflammatory response and fibrous tissue remodeling around intracortical implants: An in vivo two-photon imaging study

Meningeal inflammation and encapsulation of neural electrode arrays is a leading cause of device failure, yet little is known about how it develops over time or what triggers it. This work characterizes the dynamic changes of meningeal inflammatory cells and collagen-I in order to understand the meningeal tissue response to neural electrode implantation. We use in vivo two-photon microscopy of CX3CR1-GFP mice over the first month after electrode implantation to quantify changes in inflammatory cell behavior as well as meningeal collagen-I remodeling. We define a migratory window during the first day after electrode implantation hallmarked by robust inflammatory cell migration along electrodes in the meninges as well as cell trafficking through meningeal venules. This migratory window attenuates by 2 days post-implant, but over the next month, the meningeal collagen-I remodels to conform to the surface of the electrode and thickens. This work shows that there are distinct time courses for initial meningeal inflammatory cell infiltration and meningeal collagen-I remodeling. This may indicate a therapeutic window early after implantation for modulation and mitigation of meningeal inflammation.

Training set extension for SVM ensemble in P300-speller with familiar face paradigm

BACKGROUND

P300-spellers are brain-computer interface (BCI)-based character input systems. Support vector machine (SVM) ensembles are trained with large-scale training sets and used as classifiers in these systems. However, the required large-scale training data necessitate a prolonged collection time for each subject, which results in data collected toward the end of the period being contaminated by the subject's fatigue.

OBJECTIVE

This study aimed to develop a method for acquiring more training data based on a collected small training set.

METHODS

A new method was developed in which two corresponding training datasets in two sequences are superposed and averaged to extend the training set. The proposed method was tested offline on a P300-speller with the familiar face paradigm.

RESULTS

The SVM ensemble with extended training set achieved 85% classification accuracy for the averaged results of four sequences, and 100% for 11 sequences in the P300-speller. In contrast, the conventional SVM ensemble with non-extended training set achieved only 65% accuracy for four sequences, and 92% for 11 sequences.

CONCLUSION

The SVM ensemble with extended training set achieves higher classification accuracies than the conventional SVM ensemble, which verifies that the proposed method effectively improves the classification performance of BCI P300-spellers, thus enhancing their practicality.

Measuring and monitoring emotional changes in children who stutter

The assessment of clients with speech disorders presents challenges for speech-language pathologists. For example, having a reliable way of measuring the severity of the case, determining which remedial program is aligned with a patient's needs, and measuring of treatment processes. There is potential for brain-computer interface (BCI) applications to enhance speech therapy sessions by providing objective insights and real-time visualization of brain activity during the sessions. This paper presents a study on emotional state detection during speech pathology. The goal of this study is to investigate affective-motivational brain responses to stimuli in children who stutter. To this end, we conducted an experiment that involved recording frontal electroencephalography (EEG) activity from fifteen children with stuttering whilst they looked at visual stimuli. The contribution of our study is to provide a comprehensive background and a framework for emotional state detection experiments as assessment and monitoring tool in speech pathology. It mainly discusses the feasibility and potential benefits of applying EEG-based emotion detection in speech-language therapy contexts of use. The findings of our research indicate that emotional recognition using non-invasive EEG-based BCI system is sufficient to differentiate between affective states of individuals in treatment contexts.

A comparison of feature extraction strategies using wavelet dictionaries and feature selection methods for single trial P300-based BCI

The P300 component of event-related potentials (ERPs) is widely used in the implementation of brain computer interfaces (BCI). In this context, one of the main issues to solve is the binary classification problem that entails differentiating between electroencephalographic (EEG) signals with and without P300. Given the particularly unfavorable signal-to-noise ratio (SNR) in the single-trial detection scenario, this is a challenging problem in the pattern recognition field. To the best of our knowledge, there are no previous experimental studies comparing feature extraction and selection methods for single trial P300-based BCIs using unified criteria and data. In order to improve the performance and robustness of single-trial classifiers, we analyzed and compared different alternatives for the feature generation and feature selection blocks. We evaluated different orthogonal decompositions based on the wavelet transform for feature extraction, as well as different filter, wrapper, and embedded alternatives for feature selection. Accuracies over 75% were obtained for most of the analyzed strategies with a relatively low computational cost, making them attractive for a practical BCI implementation using inexpensive hardware. Graphical Abstract Experiments performed for P300 detection.

The control of a virtual automatic car based on multiple patterns of motor imagery BCI

Multiple degrees of freedom (DOF) commands are required for a brain-actuated virtual automatic car, which makes the brain-computer interface (BCI) control strategy a big challenge. In order to solve the challenging issue, a mixed model of BCI combining P300 potentials and motor imagery had been realized in our previous study. However, compared with single model BCI, more training procedures are needed for the mixed model and more mental workload for users to bear. In the present study, we propose a multiple patterns of motor imagery (MPMI) BCI method, which is based on the traditional two patterns of motor imagery. Our motor imagery BCI approach had been extended to multiple patterns: right-hand motor imagery, left-hand motor imagery, foot motor imagery, and both hands motor imagery resulting in turning right, turning left, acceleration, and deceleration for a virtual automatic car control. Ten healthy subjects participated in online experiments, the experimental results not only show the efficiency of our proposed MPMI-BCI strategy but also indicate that those users can control the virtual automatic car spontaneously and efficiently without any other visual attention. Furthermore, the metric of path length optimality ratio (1.23) is very encouraging and the time optimality ratio (1.28) is especially remarkable. Graphical Abstract The paradigm of multiple patterns of motor imagery detection and the relevant topographies of CSP weights for different MI patterns.

In vivo imaging of neuronal calcium during electrode implantation: Spatial and temporal mapping of damage and recovery

Implantable electrode devices enable long-term electrophysiological recordings for brain-machine interfaces and basic neuroscience research. Implantation of these devices, however, leads to neuronal damage and progressive neural degeneration that can lead to device failure. The present study uses in vivo two-photon microscopy to study the calcium activity and morphology of neurons before, during, and one month after electrode implantation to determine how implantation trauma injures neurons. We show that implantation leads to prolonged, elevated calcium levels in neurons within 150 μm of the electrode interface. These neurons show signs of mechanical distortion and mechanoporation after implantation, suggesting that calcium influx is related to mechanical trauma. Further, calcium-laden neurites develop signs of axonal injury at 1-3 h post-insert. Over the first month after implantation, physiological neuronal calcium activity increases, suggesting that neurons may be recovering. By defining the mechanisms of neuron damage after electrode implantation, our results suggest new directions for therapies to improve electrode longevity.

Visual Fixation Assessment in Patients with Disorders of Consciousness Based on Brain-Computer Interface

Visual fixation is an item in the visual function subscale of the Coma Recovery Scale-Revised (CRS-R). Sometimes clinicians using the behavioral scales find it difficult to detect because of the motor impairment in patients with disorders of consciousness (DOCs). Brain-computer interface (BCI) can be used to improve clinical assessment because it directly detects the brain response to an external stimulus in the absence of behavioral expression. In this study, we designed a BCI system to assist the visual fixation assessment of DOC patients. The results from 15 patients indicated that three showed visual fixation in both CRS-R and BCI assessments and one did not show such behavior in the CRS-R assessment but achieved significant online accuracy in the BCI assessment. The results revealed that electroencephalography-based BCI can detect the brain response for visual fixation. Therefore, the proposed BCI may provide a promising method for assisting behavioral assessment using the CRS-R.

Modulating functional connectivity after stroke with neurofeedback: Effect on motor deficits in a controlled cross-over study

Synchronization of neural activity as measured with functional connectivity (FC) is increasingly used to study the neural basis of brain disease and to develop new treatment targets. However, solid evidence for a causal role of FC in disease and therapy is lacking. Here, we manipulated FC of the ipsilesional primary motor cortex in ten chronic human stroke patients through brain-computer interface technology with visual neurofeedback. We conducted a double-blind controlled crossover study to test whether manipulation of FC through neurofeedback had a behavioral effect on motor performance. Patients succeeded in increasing FC in the motor cortex. This led to improvement in motor function that was significantly greater than during neurofeedback training of a control brain area and proportional to the degree of FC enhancement. This result provides evidence that FC has a causal role in neurological function and that it can be effectively targeted with therapy.

•

Stroke patients participated in clinical trial on neurofeedback of functional connectivity.

•

Patients learned to enhance synchrony of neural activity in their motor cortex.

•

This led to reduced motor impairment.

•

Evidence for a causal role of neural synchrony in neurological deficits and recovery.

A wearable system for olfactory electrophysiological recording and animal motion control

BACKGROUND

Bran-computer interface (BCI) is an important technique used in brain science. However, the large size of equipment and wires severely limit its practical applications.

NEW METHODS

This study presents a wearable system with bidirectional brain-computer interface based on Wi-Fi technology, which can be used for olfactory electrophysiological recording and animal motion control.

RESULTS

On the "brain-to-computer" side, the results show that the wireless system can record high-quality olfactory electrophysiological signals for over a month. By analyzing the recorded data, we find that the same mitral/tufted (M/T) cells can be activated by many odorants and different M/T cells can be activated by a single odorant. Further, we find neurons in dorsal lateral OB are highly sensitive to isoamyl acetate. On the "computer-to-brain" side, the results show that we can efficiently control rats' motions by applying electrical stimulations to electrodes implanted in specific brain regions.

COMPARISON WITH EXISTING METHODS

Most existing wireless BCI systems are designed for either recording or stimulating while our system is a bidirectional BCI featured with both functions. Taking advantage of our years of experience in olfactory decoding, we developed the first wireless system for olfactory electrophysiological recording and animal motion control. It provides high-quality recording and efficient motion control for a long time.

CONCLUSIONS

The system provides possibility of practical BCI applications, such as in vivo bioelectronic nose and "rat-robot".

Feasibility of an EEG-based brain-computer interface in the intensive care unit

OBJECTIVE

We tested the feasibility of deploying a commercially available EEG-based brain-computer interface (BCI) in the intensive care unit (ICU) to detect consciousness in patients with acute disorders of consciousness (DoC) or locked-in syndrome (LIS).

METHODS

Ten patients (9 DoC, 1 LIS) and 10 healthy subjects (HS) were enrolled. The BCI utilized oddball auditory evoked potentials, vibrotactile evoked potentials (VTP) and motor imagery (MoI) to assess consciousness. We recorded the assessment completion rate and the time required for assessment, and we calculated the sensitivity and specificity of each paradigm for detecting behavioral signs of consciousness.

RESULTS

All 10 patients completed the assessment, 9 of whom required less than 1 h. The LIS patient reported fatigue before the end of the session. The HS and LIS patient showed more consistent BCI responses than DoC patients, but overall there was no association between BCI responses and behavioral signs of consciousness.

CONCLUSIONS

The system is feasible to deploy in the ICU and may confirm consciousness in acute LIS, but it was unreliable in acute DoC.

SIGNIFICANCE

The accuracy of the paradigms for detecting consciousness must be improved and the duration of the protocol should be shortened before this commercially available BCI is ready for clinical implementation in the ICU in patients with acute DoC.

Improvements in event-related desynchronization and classification performance of motor imagery using instructive dynamic guidance and complex tasks

BACKGROUND AND OBJECTIVE

The motor-imagery based brain-computer interface supplies a potential approach for motor-impaired patients, not only to control rehabilitation facilities but also to promote recovery from motor dysfunctions. To improve event-related desynchronization during motor imagery and obtain improved brain-computer interface classification accuracy, we introduce dynamic video guidance and complex motor tasks to the motor imagery paradigm.

METHODS

Eleven participants were included in the experiment; 64-channel electroencephalographic data were collected and analyzed during four motor imagery tasks with different guidance. Time-frequency analysis, spectral-time variation analysis, topographical distribution maps, and statistical analysis were utilized to analyze the event-related desynchronization patterns. Common spatial patterns were used to extract spatial pattern features and support vector machines were used to discriminate the offline classification accuracies in three bands (the alpha band, beta band, alpha and beta band) for comparison.

RESULTS

The experimental outcomes showed that complex motor imagery tasks coupled with dynamic video guidance induced significantly stronger event-related desynchronization than other paradigms, which use simple motor imagery tasks or static guidance. Similar results were obtained during analysis of the motor imagery brain-computer interface classification performance; namely, the highest average classification accuracy in complex and dynamic guidance was improved by approximately 14%, compared with static guidance. For individually specified paradigms, all participants obtained a classification accuracy that exceeded or was equal to 87.5%.

CONCLUSIONS

This study provides an optional route to enhance the event-related desynchronization activities and classification accuracy of a motor imagery brain-computer interface through optimization of motor imagery tasks and instructive guidance.

Control of a 7-DOF Robotic Arm System With an SSVEP-Based BCI

Although robot technology has been successfully used to empower people who suffer from motor disabilities to increase their interaction with their physical environment, it remains a challenge for individuals with severe motor impairment, who do not have the motor control ability to move robots or prosthetic devices by manual control. In this study, to mitigate this issue, a noninvasive brain-computer interface (BCI)-based robotic arm control system using gaze based steady-state visual evoked potential (SSVEP) was designed and implemented using a portable wireless electroencephalogram (EEG) system. A 15-target SSVEP-based BCI using a filter bank canonical correlation analysis (FBCCA) method allowed users to directly control the robotic arm without system calibration. The online results from 12 healthy subjects indicated that a command for the proposed brain-controlled robot system could be selected from 15 possible choices in 4[Formula: see text]s (i.e. 2[Formula: see text]s for visual stimulation and 2[Formula: see text]s for gaze shifting) with an average accuracy of 92.78%, resulting in a 15 commands/min transfer rate. Furthermore, all subjects (even naive users) were able to successfully complete the entire move-grasp-lift task without user training. These results demonstrated an SSVEP-based BCI could provide accurate and efficient high-level control of a robotic arm, showing the feasibility of a BCI-based robotic arm control system for hand-assistance.

Towards correlation-based time window selection method for motor imagery BCIs

The start of the cue is often used to initiate the feature window used to control motor imagery (MI)-based brain-computer interface (BCI) systems. However, the time latency during an MI period varies between trials for each participant. Fixing the starting time point of MI features can lead to decreased system performance in MI-based BCI systems. To address this issue, we propose a novel correlation-based time window selection (CTWS) algorithm for MI-based BCIs. Specifically, the optimized reference signals for each class were selected based on correlation analysis and performance evaluation. Furthermore, the starting points of time windows for both training and testing samples were adjusted using correlation analysis. Finally, the feature extraction and classification algorithms were used to calculate the classification accuracy. With two datasets, the results demonstrate that the CTWS algorithm significantly improved the system performance when compared to directly using feature extraction approaches. Importantly, the average improvement in accuracy of the CTWS algorithm on the datasets of healthy participants and stroke patients was 16.72% and 5.24%, respectively when compared to traditional common spatial pattern (CSP) algorithm. In addition, the average accuracy increased 7.36% and 9.29%, respectively when the CTWS was used in conjunction with Sub-Alpha-Beta Log-Det Divergences (Sub-ABLD) algorithm. These findings suggest that the proposed CTWS algorithm holds promise as a general feature extraction approach for MI-based BCIs.

fNIRS-based Neurorobotic Interface for gait rehabilitation

BACKGROUND

In this paper, a novel functional near-infrared spectroscopy (fNIRS)-based brain-computer interface (BCI) framework for control of prosthetic legs and rehabilitation of patients suffering from locomotive disorders is presented.

METHODS

fNIRS signals are used to initiate and stop the gait cycle, while a nonlinear proportional derivative computed torque controller (PD-CTC) with gravity compensation is used to control the torques of hip and knee joints for minimization of position error. In the present study, the brain signals of walking intention and rest tasks were acquired from the left hemisphere's primary motor cortex for nine subjects. Thereafter, for removal of motion artifacts and physiological noises, the performances of six different filters (i.e. Kalman, Wiener, Gaussian, hemodynamic response filter (hrf), Band-pass, finite impulse response) were evaluated. Then, six different features were extracted from oxygenated hemoglobin signals, and their different combinations were used for classification. Also, the classification performances of five different classifiers (i.e. k-Nearest Neighbour, quadratic discriminant analysis, linear discriminant analysis (LDA), Naïve Bayes, support vector machine (SVM)) were tested.

RESULTS

The classification accuracies obtained from SVM using the hrf were significantly higher (p < 0.01) than those of the other classifier/ filter combinations. Those accuracies were 77.5, 72.5, 68.3, 74.2, 73.3, 80.8, 65, 76.7, and 86.7% for the nine subjects, respectively.

CONCLUSION

The control commands generated using the classifiers initiated and stopped the gait cycle of the prosthetic leg, the knee and hip torques of which were controlled using the PD-CTC to minimize the position error. The proposed scheme can be effectively used for neurofeedback training and rehabilitation of lower-limb amputees and paralyzed patients.

Brain-Computer Interfaces With Multi-Sensory Feedback for Stroke Rehabilitation: A Case Study

Conventional therapies do not provide paralyzed patients with closed-loop sensorimotor integration for motor rehabilitation. This work presents the recoveriX system, a hardware and software platform that combines a motor imagery (MI)-based brain-computer interface (BCI), functional electrical stimulation (FES), and visual feedback technologies for a complete sensorimotor closed-loop therapy system for poststroke rehabilitation. The proposed system was tested on two chronic stroke patients in a clinical environment. The patients were instructed to imagine the movement of either the left or right hand in random order. During these two MI tasks, two types of feedback were provided: a bar extending to the left or right side of a monitor as visual feedback and passive hand opening stimulated from FES as proprioceptive feedback. Both types of feedback relied on the BCI classification result achieved using common spatial patterns and a linear discriminant analysis classifier. After 10 sessions of recoveriX training, one patient partially regained control of wrist extension in her paretic wrist and the other patient increased the range of middle finger movement by 1 cm. A controlled group study is planned with a new version of the recoveriX system, which will have several improvements.

The SyBil-AA real-time fMRI neurofeedback study: protocol of a single-blind randomized controlled trial in alcohol use disorder

BACKGROUND

Alcohol Use Disorder is a highly prevalent mental disorder which puts a severe burden on individuals, families, and society. The treatment of Alcohol Use Disorder is challenging and novel and innovative treatment approaches are needed to expand treatment options. A promising neuroscience-based intervention method that allows targeting cortical as well as subcortical brain processes is real-time functional magnetic resonance imaging neurofeedback. However, the efficacy of this technique as an add-on treatment of Alcohol Use Disorder in a clinical setting is hitherto unclear and will be assessed in the Systems Biology of Alcohol Addiction (SyBil-AA) neurofeedback study.

METHODS

N = 100 patients with Alcohol Use Disorder will be randomized to 5 parallel groups in a single-blind fashion and receive real-time functional magnetic resonance imaging neurofeedback while they are presented pictures of alcoholic beverages. The groups will either downregulate the ventral striatum, upregulate the right inferior frontal gyrus, negatively modulate the connectivity between these regions, upregulate, or downregulate the auditory cortex as a control region. After receiving 3 sessions of neurofeedback training within a maximum of 2 weeks, participants will be followed up monthly for a period of 3 months and relapse rates will be assessed as the primary outcome measure.

DISCUSSION

The results of this study will provide insights into the efficacy of real-time functional magnetic resonance imaging neurofeedback training in the treatment of Alcohol Use Disorder as well as in the involved brain systems. This might help to identify predictors of successful neurofeedback treatment which could potentially be useful in developing personalized treatment approaches.

TRIAL REGISTRATION

The study was retrospectively registered in the German Clinical Trials Register (trial identifier: DRKS00010253 ; WHO Universal Trial Number (UTN): U1111-1181-4218) on May 10th, 2016.

The Empirical Mode Decomposition-Decision Tree Method to Recognize the Steady-State Visual Evoked Potentials with Wide Frequency Range

Background:

The empirical mode decomposition (EMD) is a technique to analyze the steady-state visual evoked potential (SSVEP) which decomposes the signal into its intrinsic mode functions (IMFs). Although for the limited stimulation frequency range, choosing the effective IMF leads to good results, but extending this range will seriously challenge the method so that even the combination of IMFs is associated with error.

Methods:

Stimulation frequencies ranged from 6 to 16 Hz with an interval of 0.5 Hz were generated using Psychophysics toolbox of MATLAB. SSVEP signal was recorded from six subjects. The EMD was used to extract the effective IMFs. Two features, including the frequency related to the peak of spectrum and normalized local energy in this frequency, were extracted for each of six conditions (each IMF, the combination of two consecutive IMFs and the combination of all three IMFs).

Results:

The instantaneous frequency histogram and the recognition accuracy diagram indicate that for wide stimulation frequency range, not only one IMF, but also the combination of IMFs does not have desirable efficiency. Total recognition accuracy of the proposed method was 79.75%, while the highest results obtained from the EMD-fast Fourier transform (FFT) and the CCA were 72.05% and 77.31%, respectively.

Conclusion:

The proposed method has improved the recognition rate more than 2.4% and 7.7% compared to the CCA and EMD-FFT, respectively, by providing the solution for situations with wide stimulation frequency range.

Enhancing performance of P300-Speller under mental workload by incorporating dual-task data during classifier training

As one of the most important brain-computer interface (BCI) paradigms, P300-Speller was shown to be significantly impaired once applied in practical situations due to effects of mental workload. This study aims to provide a new method of building training models to enhance performance of P300-Speller under mental workload. Three experiment conditions based on row-column P300-Speller paradigm were performed including speller-only, 3-back-speller and mental-arithmetic-speller. Data under dual-task conditions were introduced to speller-only data respectively to build new training models. Then performance of classifiers with different models was compared under the same testing condition. The results showed that when tasks of imported training data and testing data were the same, character recognition accuracies and round accuracies of P300-Speller with mixed-data training models significantly improved (FDR, p < 0.005). When they were different, performance significantly improved when tested on mental-arithmetic-speller (FDR, p < 0.05) while the improvement was modest when tested on n-back-speller (FDR, p < 0.1). The analysis of ERPs revealed that ERP difference between training data and testing data was significantly diminished when the dual-task data was introduced to training data (FDR, p < 0.05). The new method of training classifier on mixed data proved to be effective in enhancing performance of P300-Speller under mental workload, confirmed the feasibility to build a universal training model and overcome the effects of mental workload in its practical applications.

Ethical aspects of brain computer interfaces: a scoping review

BACKGROUND

Brain-Computer Interface (BCI) is a set of technologies that are of increasing interest to researchers. BCI has been proposed as assistive technology for individuals who are non-communicative or paralyzed, such as those with amyotrophic lateral sclerosis or spinal cord injury. The technology has also been suggested for enhancement and entertainment uses, and there are companies currently marketing BCI devices for those purposes (e.g., gaming) as well as health-related purposes (e.g., communication). The unprecedented direct connection created by BCI between human brains and computer hardware raises various ethical, social, and legal challenges that merit further examination and discussion.

METHODS

To identify and characterize the key issues associated with BCI use, we performed a scoping review of biomedical ethics literature, analyzing the ethics concerns cited across multiple disciplines, including philosophy and medicine.

RESULTS

Based on this investigation, we report that BCI research and its potential translation to therapeutic intervention generate significant ethical, legal, and social concerns, notably with regards to personhood, stigma, autonomy, privacy, research ethics, safety, responsibility, and justice. Our review of the literature determined, furthermore, that while these issues have been enumerated extensively, few concrete recommendations have been expressed.

CONCLUSIONS

We conclude that future research should focus on remedying a lack of practical solutions to the ethical challenges of BCI, alongside the collection of empirical data on the perspectives of the public, BCI users, and BCI researchers.

EEG sensorimotor rhythms' variation and functional connectivity measures during motor imagery: linear relations and classification approaches

Hands motor imagery (MI) has been reported to alter synchronization patterns amongst neurons, yielding variations in the mu and beta bands' power spectral density (PSD) of the electroencephalography (EEG) signal. These alterations have been used in the field of brain-computer interfaces (BCI), in an attempt to assign distinct MI tasks to commands of such a system. Recent studies have highlighted that information may be missing if knowledge about brain functional connectivity is not considered. In this work, we modeled the brain as a graph in which each EEG electrode represents a node. Our goal was to understand if there exists any linear correlation between variations in the synchronization patterns-that is, variations in the PSD of mu and beta bands-induced by MI and alterations in the corresponding functional networks. Moreover, we (1) explored the feasibility of using functional connectivity parameters as features for a classifier in the context of an MI-BCI; (2) investigated three different types of feature selection (FS) techniques; and (3) compared our approach to a more traditional method using the signal PSD as classifier inputs. Ten healthy subjects participated in this study. We observed significant correlations (p < 0.05) with values ranging from 0.4 to 0.9 between PSD variations and functional network alterations for some electrodes, prominently in the beta band. The PSD method performed better for data classification, with mean accuracies of (90 ± 8)% and (87 ± 7)% for the mu and beta band, respectively, versus (83 ± 8)% and (83 ± 7)% for the same bands for the graph method. Moreover, the number of features for the graph method was considerably larger. However, results for both methods were relatively close, and even overlapped when the uncertainties of the accuracy rates were considered. Further investigation regarding a careful exploration of other graph metrics may provide better alternatives.

Neuron-Type-Specific Utility in a Brain-Machine Interface: a Pilot Study

CONTEXT

Firing rates of single cortical neurons can be volitionally modulated through biofeedback (i.e. operant conditioning), and this information can be transformed to control external devices (i.e. brain-machine interfaces; BMIs). However, not all neurons respond to operant conditioning in BMI implementation. Establishing criteria that predict neuron utility will assist translation of BMI research to clinical applications.

FINDINGS

Single cortical neurons (n=7) were recorded extracellularly from primary motor cortex of a Long-Evans rat. Recordings were incorporated into a BMI involving up-regulation of firing rate to control the brightness of a light-emitting-diode and subsequent reward. Neurons were classified as 'fast-spiking', 'bursting' or 'regular-spiking' according to waveform-width and intrinsic firing patterns. Fast-spiking and bursting neurons were found to up-regulate firing rate by a factor of 2.43±1.16, demonstrating high utility, while regular-spiking neurons decreased firing rates on average by a factor of 0.73±0.23, demonstrating low utility.

CONCLUSION/CLINICAL RELEVANCE

The ability to select neurons with high utility will be important to minimize training times and maximize information yield in future clinical BMI applications. The highly contrasting utility observed between fast-spiking and bursting neurons versus regular-spiking neurons allows for the hypothesis to be advanced that intrinsic electrophysiological properties may be useful criteria that predict neuron utility in BMI implementation.

Decoding spoken phonemes from sensorimotor cortex with high-density ECoG grids

For people who cannot communicate due to severe paralysis or involuntary movements, technology that decodes intended speech from the brain may offer an alternative means of communication. If decoding proves to be feasible, intracranial Brain-Computer Interface systems can be developed which are designed to translate decoded speech into computer generated speech or to instructions for controlling assistive devices. Recent advances suggest that such decoding may be feasible from sensorimotor cortex, but it is not clear how this challenge can be approached best. One approach is to identify and discriminate elements of spoken language, such as phonemes. We investigated feasibility of decoding four spoken phonemes from the sensorimotor face area, using electrocorticographic signals obtained with high-density electrode grids. Several decoding algorithms including spatiotemporal matched filters, spatial matched filters and support vector machines were compared. Phonemes could be classified correctly at a level of over 75% with spatiotemporal matched filters. Support Vector machine analysis reached a similar level, but spatial matched filters yielded significantly lower scores. The most informative electrodes were clustered along the central sulcus. Highest scores were achieved from time windows centered around voice onset time, but a 500 ms window before onset time could also be classified significantly. The results suggest that phoneme production involves a sequence of robust and reproducible activity patterns on the cortical surface. Importantly, decoding requires inclusion of temporal information to capture the rapid shifts of robust patterns associated with articulator muscle group contraction during production of a phoneme. The high classification scores are likely to be enabled by the use of high density grids, and by the use of discrete phonemes. Implications for use in Brain-Computer Interfaces are discussed.

Analyzing text recognition from tactually evoked EEG

Tactual exploration of objects produce specific patterns in the human brain and hence objects can be recognized by analyzing brain signals during tactile exploration. The present work aims at analyzing EEG signals online for recognition of embossed texts by tactual exploration. EEG signals are acquired from the parietal region over the somatosensory cortex of blindfolded healthy subjects while they tactually explored embossed texts, including symbols, numbers, and alphabets. Classifiers based on the principle of supervised learning are trained on the extracted EEG feature space, comprising three features, namely, adaptive autoregressive parameters, Hurst exponents, and power spectral density, to recognize the respective texts. The pre-trained classifiers are used to classify the EEG data to identify the texts online and the recognized text is displayed on the computer screen for communication. Online classifications of two, four, and six classes of embossed texts are achieved with overall average recognition rates of 76.62, 72.31, and 67.62% respectively and the computational time is less than 2 s in each case. The maximum information transfer rate and utility of the system performance over all experiments are 0.7187 and 2.0529 bits/s respectively. This work presents a study that shows the possibility to classify 3D letters using tactually evoked EEG. In future, it will help the BCI community to design stimuli for better tactile augmentation n also opens new directions of research to facilitate 3D letters for visually impaired persons. Further, 3D maps can be generated for aiding tactual BCI in teleoperation.