A Convolutional Neural Network for SSVEP Identification by Using a Few-Channel EEG

The application of wearable electroencephalogram (EEG) devices is growing in brain-computer interfaces (BCI) owing to their good wearability and portability. Compared with conventional devices, wearable devices typically support fewer EEG channels. Devices with few-channel EEGs have been proven to be available for steady-state visual evoked potential (SSVEP)-based BCI. However, fewer-channel EEGs can cause the BCI performance to decrease. To address this issue, an attention-based complex spectrum-convolutional neural network (atten-CCNN) is proposed in this study, which combines a CNN with a squeeze-and-excitation block and uses the spectrum of the EEG signal as the input. The proposed model was assessed on a wearable 40-class dataset and a public 12-class dataset under subject-independent and subject-dependent conditions. The results show that whether using a three-channel EEG or single-channel EEG for SSVEP identification, atten-CCNN outperformed the baseline models, indicating that the new model can effectively enhance the performance of SSVEP-BCI with few-channel EEGs. Therefore, this SSVEP identification algorithm based on a few-channel EEG is particularly suitable for use with wearable EEG devices.

Formulation of Common Spatial Patterns for Multi-Task Hyperscanning BCI

This work proposes a new formulation for common spatial patterns (CSP), often used as a powerful feature extraction technique in brain-computer interfacing (BCI) and other neurological studies. In this approach, applied to multiple subjects' data and named as hyperCSP, the individual covariance and mutual correlation matrices between multiple simultaneously recorded subjects' electroencephalograms are exploited in the CSP formulation. This method aims at effectively isolating the common motor task between multiple heads and alleviate the effects of other spurious or undesired tasks inherently or intentionally performed by the subjects. This technique can provide a satisfactory classification performance while using small data size and low computational complexity. By using the proposed hyperCSP followed by support vector machines classifier, we obtained a classification accuracy of 81.82% over 8 trials in the presence of strong undesired tasks. We hope that this method could reduce the training error in multi-task BCI scenarios. The recorded valuable motor-related hyperscanning dataset is available for public use to promote the research in this area.

Augmented-reality based brain-computer interface of robot control

Brain Computer Interface (BCI) is a new approach to human-computer interaction. It can control the external devices directly with the brain without words and body movements. Brain-controlled robot is a major research area in the field of BCI, which organically integrates BCI with robotic systems to achieve safe and effective real-time control of robots using the user's electroencephalogram (EEG). Currently, there are two types of control methods for brain-controlled robots. One is direct control and the other is shared control. Direct brain control has its shortcomings, namely, low control efficiency and easy user fatigue. Shared control technique can effectively improve the control of brain-controlled robots and reduce the thinking ability of brain-controlled robots, thus making it the main control method of brain-controlled robots. The brain-computer collaborative control system based on augmented reality (AR) technology studied in this paper is a human-computer shared control method. In the experimental analysis of virtual reality (VR) systems and AR systems, this paper processes polylines through a series of control vertices with specific coordinates, using the relative distance measured between each point and the starting point as the relative coordinates, and calculates the operational errors of the two types of systems. In the system error of machining broken lines, when the relative coordinates are (10, 20), (40, 50), and (70, 80), the error values of the VR system are 0.17 mm, 0.36 mm, and 0.55 mm, respectively, while the error values of the AR system are 0.11 mm, 0.24 mm, and 0.41 mm, respectively. Therefore, the studies have illustrated the importance of AR systems for the study of brain-computer collaborative control of robots.

Community mobility and participation assessment of manual wheelchair users: a review of current techniques and challenges

According to the World Health Organization, hundreds of individuals commence wheelchair use daily, often due to an injury such as spinal cord injury or through a condition such as a stroke. However, manual wheelchair users typically experience reductions in individual community mobility and participation. In this review, articles from 2017 to 2023 were reviewed to identify means of measuring community mobility and participation of manual wheelchair users, factors that can impact these aspects, and current rehabilitation techniques for improving them. The selected articles document current best practices utilizing self-surveys, in-clinic assessments, and remote tracking through GPS and accelerometer data, which rehabilitation specialists can apply to track their patients' community mobility and participation accurately. Furthermore, rehabilitation methods such as wheelchair training programs, brain-computer interface triggered functional electric stimulation therapy, and community-based rehabilitation programs show potential to improve the community mobility and participation of manual wheelchair users. Recommendations were made to highlight potential avenues for future research.

Recent Progress in Wearable Brain-Computer Interface (BCI) Devices Based on Electroencephalogram (EEG) for Medical Applications: A Review

Importance: Brain-computer interface (BCI) decodes and converts brain signals into machine instructions to interoperate with the external world. However, limited by the implantation risks of invasive BCIs and the operational complexity of conventional noninvasive BCIs, applications of BCIs are mainly used in laboratory or clinical environments, which are not conducive to the daily use of BCI devices. With the increasing demand for intelligent medical care, the development of wearable BCI systems is necessary. Highlights: Based on the scalp-electroencephalogram (EEG), forehead-EEG, and ear-EEG, the state-of-the-art wearable BCI devices for disease management and patient assistance are reviewed. This paper focuses on the EEG acquisition equipment of the novel wearable BCI devices and summarizes the development direction of wearable EEG-based BCI devices. Conclusions: BCI devices play an essential role in the medical field. This review briefly summarizes novel wearable EEG-based BCIs applied in the medical field and the latest progress in related technologies, emphasizing its potential to help doctors, patients, and caregivers better understand and utilize BCI devices.

Domain knowledge-assisted multi-objective evolutionary algorithm for channel selection in brain-computer interface systems

Background

For non-invasive brain-computer interface systems (BCIs) with multiple electroencephalogram (EEG) channels, the key factor limiting their convenient application in the real world is how to perform reasonable channel selection while ensuring task accuracy, which can be modeled as a multi-objective optimization problem. Therefore, this paper proposed a two-objective problem model for the channel selection problem and introduced a domain knowledge-assisted multi-objective optimization algorithm (DK-MOEA) to solve the aforementioned problem.

Methods

The multi-objective optimization problem model was designed based on the channel connectivity matrix and comprises two objectives: one is the task accuracy and the other one can sensitively indicate the removal status of channels in BCIs. The proposed DK-MOEA adopted a two-space framework, consisting of the population space and the knowledge space. Furthermore, a knowledge-assisted update operator was introduced to enhance the search efficiency of the population space by leveraging the domain knowledge stored in the knowledge space.

Results

The proposed two-objective problem model and DK-MOEA were tested on a fatigue detection task and four state-of-the-art multi-objective evolutionary algorithms were used for comparison. The experimental results indicated that the proposed algorithm achieved the best results among all the comparative algorithms for most cases by the Wilcoxon rank sum test at a significance level of 0.05. DK-MOEA was also compared with a version without the utilization of domain knowledge and the experimental results validated the effectiveness of the knowledge-assisted mutation operator. Moreover, the comparison between DK-MOEA and a traditional classification algorithm using all channels demonstrated that DK-MOEA can strike the balance between task accuracy and the number of selected channels.

Conclusion

The formulated two-objective optimization model enabled the selection of a minimal number of channels without compromising classification accuracy. The utilization of domain knowledge improved the performance of DK-MOEA. By adopting the proposed two-objective problem model and DK-MOEA, a balance can be achieved between the number of the selected channels and the accuracy of the fatigue detection task. The methods proposed in this paper can reduce the complexity of subsequent data processing and enhance the convenience of practical applications.

Advances in Neurorestoratology-Current status and future developments

Neurorestoratology constitutes a novel discipline aimed at the restoration of damaged neural structures and impaired neurological functions. This area of knowledge integrates and compiles all concepts and strategies dealing with the neurorestoration. Although currently, this discipline has already been well recognized by physicians and scientists throughout the world, this article aimed at broadening its knowledge to the academic circle and the public society. Here we shortly introduced why and how Neurorestoratology was born since the fact that the central nervous system (CNS) can be repaired and the subsequent scientific evidence of the neurorestorative mechanisms behind, such as neurostimulation or neuromodulation, neuroprotection, neuroplasticity, neurogenesis, neuroregeneration or axonal regeneration or sprouting, neuroreplacement, loop reconstruction, remyelination, immunoregulation, angiogenesis or revascularization, and others. The scope of this discipline is the improvement of therapeutic approaches for neurological diseases and the development of neurorestorative strategies through the comprehensive efforts of experts in the different areas and all articulated by the associations of Neurorestoratology and its journals. Strikingly, this article additionally explores the "state of art" of the Neurorestoratology field. This includes the development process of the discipline, the achievements and advances of novel neurorestorative treatments, the most efficient procedures exploring and evaluating outcome after the application of pioneer therapies, all the joining of a multidisciplinary expert associations and the specialized journals being more and more impact. We believe that in a near future, this discipline will evolve fast, leading to a general application of cell-based comprehensive neurorestorative treatments to fulfill functional recovery demands for patients with neurological deficits or dysfunctions.

A comprehensive review on motion trajectory reconstruction for EEG-based brain-computer interface

The advance in neuroscience and computer technology over the past decades have made brain-computer interface (BCI) a most promising area of neurorehabilitation and neurophysiology research. Limb motion decoding has gradually become a hot topic in the field of BCI. Decoding neural activity related to limb movement trajectory is considered to be of great help to the development of assistive and rehabilitation strategies for motor-impaired users. Although a variety of decoding methods have been proposed for limb trajectory reconstruction, there does not yet exist a review that covers the performance evaluation of these decoding methods. To alleviate this vacancy, in this paper, we evaluate EEG-based limb trajectory decoding methods regarding their advantages and disadvantages from a variety of perspectives. Specifically, we first introduce the differences in motor execution and motor imagery in limb trajectory reconstruction with different spaces (2D and 3D). Then, we discuss the limb motion trajectory reconstruction methods including experiment paradigm, EEG pre-processing, feature extraction and selection, decoding methods, and result evaluation. Finally, we expound on the open problem and future outlooks.

Electroencephalogram based brain-computer interface: Applications, challenges, and opportunities

Brain-Computer Interfaces (BCI) is an exciting and emerging research area for researchers and scientists. It is a suitable combination of software and hardware to operate any device mentally. This review emphasizes the significant stages in the BCI domain, current problems, and state-of-the-art findings. This article also covers how current results can contribute to new knowledge about BCI, an overview of BCI from its early developments to recent advancements, BCI applications, challenges, and future directions. The authors pointed to unresolved issues and expressed how BCI is valuable for analyzing the human brain. Humans' dependence on machines has led humankind into a new future where BCI can play an essential role in improving this modern world.

EEG changes during passive movements improve the motor imagery feature extraction in BCIs-based sensory feedback calibration

Objective.This work proposes a method for two calibration schemes based on sensory feedback to extract reliable motor imagery (MI) features, and provide classification outputs more correlated to the user's intention.Method.After filtering the raw electroencephalogram (EEG), a two-step method for spatial feature extraction by using the Riemannian covariance matrices (RCM) method and common spatial patterns is proposed here. It uses EEG data from trials providing feedback, in an intermediate step composed of bothkth nearest neighbors and probability analyses, to find periods of time in which the user probably performed well the MI task without feedback. These periods are then used to extract features with better separability, and train a classifier for MI recognition. For evaluation, an in-house dataset with eight healthy volunteers and two post-stroke patients that performed lower-limb MI, and consequently received passive movements as feedback was used. Other popular public EEG datasets (such as BCI Competition IV dataset IIb, among others) from healthy subjects that executed upper-and lower-limbs MI tasks under continuous visual sensory feedback were further used.Results.The proposed system based on the Riemannian geometry method in two-steps (RCM-RCM) outperformed significantly baseline methods, reaching average accuracy up to 82.29%. These findings show that EEG data on periods providing passive movement can be used to contribute greatly during MI feature extraction.Significance.Unconscious brain responses elicited over the sensorimotor areas may be avoided or greatly reduced by applying our approach in MI-based brain-computer interfaces (BCIs). Therefore, BCI's outputs more correlated to the user's intention can be obtained.

Identifying Thematics in a Brain-Computer Interface Research

This umbrella review is motivated to understand the shift in research themes on brain-computer interfacing (BCI) and it determined that a shift away from themes that focus on medical advancement and system development to applications that included education, marketing, gaming, safety, and security has occurred. The background of this review examined aspects of BCI categorisation, neuroimaging methods, brain control signal classification, applications, and ethics. The specific area of BCI software and hardware development was not examined. A search using One Search was undertaken and 92 BCI reviews were selected for inclusion. Publication demographics indicate the average number of authors on review papers considered was 4.2 ± 1.8. The results also indicate a rapid increase in the number of BCI reviews from 2003, with only three reviews before that period, two in 1972, and one in 1996. While BCI authors were predominantly Euro-American in early reviews, this shifted to a more global authorship, which China dominated by 2020-2022. The review revealed six disciplines associated with BCI systems: life sciences and biomedicine (n = 42), neurosciences and neurology (n = 35), and rehabilitation (n = 20); (2) the second domain centred on the theme of functionality: computer science (n = 20), engineering (n = 28) and technology (n = 38). There was a thematic shift from understanding brain function and modes of interfacing BCI systems to more applied research novel areas of research-identified surround artificial intelligence, including machine learning, pre-processing, and deep learning. As BCI systems become more invasive in the lives of "normal" individuals, it is expected that there will be a refocus and thematic shift towards increased research into ethical issues and the need for legal oversight in BCI application.

Multisymbol Time Division Coding for High-Frequency Steady-State Visual Evoked Potential-Based Brain-Computer Interface

The optimization of coding stimulus is a crucial factor in the study of steady-state visual evoked potential (SSVEP)-based brain-computer interface(BCI).This study proposed an encoding approach named Multi-Symbol Time Division Coding (MSTDC). This approach is based on a protocol of maximizing the distance between neural responses, which aims to encode stimulation systems implementing any number of targets with finite stimulations of different frequencies and phases. Firstly, this study designed an SSVEP-based BCI system containing forty targets with this approach. The stimulation encoding of this system was achieved with four temporal-divided stimuli that adopt the same frequency of 30 Hz and different phases. During the online experiments of twelve subjects, this system achieved an average accuracy of 96.77 ±2.47 % and an average information transfer rate (ITR) of 119.05 ± 6.11 bits/min. This study also devised an SSVEP-based BCI system containing 72 targets and proposed a Template Splicing task-related component analysis (TRCA) algorithm that utilized the dataset of the previous system containing forty targets as the training dataset. The subjects acquired an average accuracy of 86.23 ± 7.75% and an average ITR of 95.68 ± 14.19 bits/min. It can be inferred that MSTDC can encode multiple targets with limited frequencies and phases of stimuli. Meanwhile, this protocol can be effortlessly expanded into other systems and sufficiently reduce the cost of collecting training data. This study provides a feasible technique for obtaining a comfortable SSVEP-based BCI with multiple targets while maintaining high information transfer rate.

SSVEP-Based Brain Computer Interface Controlled Soft Robotic Glove for Post-Stroke Hand Function Rehabilitation

Soft robotic glove with brain computer interfaces (BCI) control has been used for post-stroke hand function rehabilitation. Motor imagery (MI) based BCI with robotic aided devices has been demonstrated as an effective neural rehabilitation tool to improve post-stroke hand function. It is necessary for a user of MI-BCI to receive a long time training, while the user usually suffers unsuccessful and unsatisfying results in the beginning. To propose another non-invasive BCI paradigm rather than MI-BCI, steady-state visually evoked potentials (SSVEP) based BCI was proposed as user intension detection to trigger the soft robotic glove for post-stroke hand function rehabilitation. Thirty post-stroke patients with impaired hand function were randomly and equally divided into three groups to receive conventional, robotic, and BCI-robotic therapy in this randomized control trial (RCT). Clinical assessment of Fugl-Meyer Motor Assessment of Upper Limb (FMA-UL), Wolf Motor Function Test (WMFT) and Modified Ashworth Scale (MAS) were performed at pre-training, post-training and three months follow-up. In comparing to other groups, The BCI-robotic group showed significant improvement after training in FMA full score (10.05±8.03, p=0.001), FMA shoulder/elbow (6.2±5.94, p=0.0004) and FMA wrist/hand (4.3±2.83, p=0.007), and WMFT (5.1±5.53, p=0.037). The improvement of FMA was significantly correlated with BCI accuracy (r=0.714, p=0.032). Recovery of hand function after rehabilitation of SSVEP-BCI controlled soft robotic glove showed better result than solely robotic glove rehabilitation, equivalent efficacy as results from previous reported MI-BCI robotic hand rehabilitation. It proved the feasibility of SSVEP-BCI controlled soft robotic glove in post-stroke hand function rehabilitation.

Current Knowledge of Microglia in Traumatic Spinal Cord Injury

Microglia are the resident immune cells in the central nervous system (CNS). After traumatic spinal cord injury (SCI), microglia undergo activation, proliferation, and changes in gene and protein expression and morphology, with detrimental and beneficial effects. Activated microglia cause secondary neuronal injury via the production of proinflammatory cytokines, reactive oxygen species, and proteases. However, activated microglia also promote neuronal repair through the secretion of anti-inflammatory growth factors and cytokines. Proinflammatory cytokines increase endothelial permeability, promote A1 astrocyte activation and axonal demyelination, and reduce neural stem/progenitor cells (NSPCs), leading to the exacerbation of neuronal injury. In contrast, anti-inflammatory factors facilitate angiogenesis, reduce reactive astrocytes, and promote axonal remyelination and the propagation of NSPCs, contributing to tissue repair and locomotor recovery. Due to its limited regenerative capacity, the CNS requires beneficial microglia for continuous protection against injury. Understanding and regulating microglial activation status are beneficial to reducing detrimental effects and promoting repair behaviors and to obtain more information on efficient therapies for traumatic SCI. This review discusses microglial activation and the differences between microglia and similar immune cells, microglial interactions with other cells in the spinal cord, and the progress in the development of therapies targeting microglia in SCI.

Deep and Wide Transfer Learning with Kernel Matching for Pooling Data from Electroencephalography and Psychological Questionnaires

Motor imagery (MI) promotes motor learning and encourages brain–computer interface systems that entail electroencephalogram (EEG) decoding. However, a long period of training is required to master brain rhythms’ self-regulation, resulting in users with MI inefficiency. We introduce a parameter-based approach of cross-subject transfer-learning to improve the performances of poor-performing individuals in MI-based BCI systems, pooling data from labeled EEG measurements and psychological questionnaires via kernel-embedding. To this end, a Deep and Wide neural network for MI classification is implemented to pre-train the network from the source domain. Then, the parameter layers are transferred to initialize the target network within a fine-tuning procedure to recompute the Multilayer Perceptron-based accuracy. To perform data-fusion combining categorical features with the real-valued features, we implement stepwise kernel-matching via Gaussian-embedding. Finally, the paired source–target sets are selected for evaluation purposes according to the inefficiency-based clustering by subjects to consider their influence on BCI motor skills, exploring two choosing strategies of the best-performing subjects (source space): single-subject and multiple-subjects. Validation results achieved for discriminant MI tasks demonstrate that the introduced Deep and Wide neural network presents competitive performance of accuracy even after the inclusion of questionnaire data.

Interface, interaction, and intelligence in generalized brain-computer interfaces

A brain-computer interface (BCI) establishes a direct communication channel between a brain and an external device. With recent advances in neurotechnology and artificial intelligence (AI), the brain signals in BCI communication have been advanced from sensation and perception to higher-level cognition activities. While the field of BCI has grown rapidly in the past decades, the core technologies and innovative ideas behind seemingly unrelated BCI systems have never been summarized from an evolutionary point of view. Here, we review various BCI paradigms and present an evolutionary model of generalized BCI technology which comprises three stages: interface, interaction, and intelligence (I3). We also highlight challenges, opportunities, and future perspectives in the development of new BCI technology.

Optimization of Surface Electromyography-Based Neurofeedback Rehabilitation Intervention System

In this paper, we study the effects of the neurofeedback method of surface EMG on electrophysiology and evaluate its effects on postural control, balance, and motor function using relevant scales. We optimize the neurofeedback rehabilitation intervention system based on surface EMG, study the objective assessment of neurofeedback rehabilitation intervention of surface EMG, and initially try to apply mirror therapy to the treatment of surface EMG. According to the different treatment methods, they were divided into the drug-only group, drug combined with electroacupuncture group, drug combined with facial muscle function training group, and drug combined with electroacupuncture combined with facial muscle function training group. Starting from the 10th day of the disease course, a course of 15 days contains three courses of treatment with a 3-day break for each course. Patients were tested on day 10, day 25, and day 40 of the disease course and the results of each test were recorded and analyzed. The results of each test were recorded and analyzed. The efficacy of four different methods for simple neurofeedback rehabilitation was compared according to the mean ratio of the root mean square of the patient's affected and healthy sides. The close relationship between surface EMG neurofeedback rehabilitation intervention and rehabilitation efficacy was also investigated, and the effect of different feedback modes on neurofeedback rehabilitation intervention was explored for the neurofeedback protocol and whether the use of the optimized neurorehabilitation protocol could achieve improved efficacy and have a sustained effect. The study showed that neurofeedback training interventions based on optimized surface EMG can achieve good long-term results, as demonstrated by improved postural control, balance, and motor function of patients; optimized neurofeedback rehabilitation intervention systems; and guiding physicians or nurses to work more effective clinically.

Regression Networks for Neurophysiological Indicator Evaluation in Practicing Motor Imagery Tasks

Motor Imagery (MI) promotes motor learning in activities, like developing professional motor skills, sports gestures, and patient rehabilitation. However, up to 30% of users may not develop enough coordination skills after training sessions because of inter and intra-subject variability. Here, we develop a data-driven estimator, termed Deep Regression Network (DRN), which jointly extracts and performs the regression analysis in order to assess the efficiency of the individual brain networks in practicing MI tasks. The proposed double-stage estimator initially learns a pool of deep patterns, extracted from the input data, in order to feed a neural regression model, allowing for infering the distinctiveness between subject assemblies having similar variability. The results, which were obtained on real-world MI data, prove that the DRN estimator fosters pre-training neural desynchronization and initial training synchronization to predict the bi-class accuracy response, thus providing a better understanding of the Brain-Computer Interface inefficiency of subjects.