Clinical Applications of Brain-Computer Interfaces: Current State and Future Prospects

Brain-to-brain interface technology: A brief history, current state, and future goals

A brain-to-brain interface (BBI), defined as a combination of neuroimaging and neurostimulation methods to extract and deliver information between brains directly without the need for the peripheral nervous system, is a budding communication technique. A BBI system is made up of two parts known as the brain-computer interface part, which reads a sender's brain activity and digitalizes it, and the computer-brain interface part, which writes the delivered brain activity to a receiving brain. As with other technologies, BBI systems have gone through an evolutionary process since they first appeared. The BBI systems have been employed for numerous purposes, including rehabilitation for post-stroke patients, communicating with patients suffering from amyotrophic lateral sclerosis, locked-in syndrome and speech problems following stroke. Also, it has been proposed that a BBI system could play an important role on future battlefields. This technology was not only employed for communicating between two human brains but also for making a direct communication path among different species through which motor or sensory commands could be sent and received. However, the application of BBI systems has provoked significant challenges to human rights principles due to their ability to access and manipulate human brain information. In this study, we aimed to review the brain-computer interface and computer-brain interface technologies as components of BBI systems, the development of BBI systems, applications of this technology, arising ethical issues and expectations for future use.

Evaluating the Feasibility of Visual Imagery for an EEG-Based Brain-Computer Interface

Visual imagery, or the mental simulation of visual information from memory, could serve as an effective control paradigm for a brain-computer interface (BCI) due to its ability to directly convey the user's intention with many natural ways of envisioning an intended action. However, multiple initial investigations into using visual imagery as a BCI control strategies have been unable to fully evaluate the capabilities of true spontaneous visual mental imagery. One major limitation in these prior works is that the target image is typically displayed immediately preceding the imagery period. This paradigm does not capture spontaneous mental imagery as would be necessary in an actual BCI application but something more akin to short-term retention in visual working memory. Results from the present study show that short-term visual imagery following the presentation of a specific target image provides a stronger, more easily classifiable neural signature in EEG than spontaneous visual imagery from long-term memory following an auditory cue for the image. We also show that short-term visual imagery and visual perception share commonalities in the most predictive electrodes and spectral features. However, visual imagery received greater influence from frontal electrodes whereas perception was mostly confined to occipital electrodes. This suggests that visual perception is primarily driven by sensory information whereas visual imagery has greater contributions from areas associated with memory and attention. This work provides the first direct comparison of short-term and long-term visual imagery tasks and provides greater insight into the feasibility of using visual imagery as a BCI control strategy.

Invasive Brain Computer Interface for Motor Restoration in Spinal Cord Injury: A Systematic Review

STUDY DESIGN

Systematic review of the literature.

OBJECTIVES

In recent years, brain-computer interface (BCI) has emerged as a potential treatment for patients with spinal cord injury (SCI). This is the first systematic review of the literature on invasive closed-loop BCI technologies for the treatment of SCI in humans.

MATERIALS AND METHODS

A comprehensive search of PubMed MEDLINE, Web of Science, and Ovid EMBASE was conducted following Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.

RESULTS

Of 8316 articles collected, 19 studies met all the inclusion criteria. Data from 21 patients were extracted from these studies. All patients sustained a cervical SCI and were treated using either a BCI with intracortical microelectrode arrays (n = 18, 85.7%) or electrocorticography (n = 3, 14.3%). To decode these neural signals, machine learning and statistical models were used: support vector machine in eight patients (38.1%), linear estimator in seven patients (33.3%), Hidden Markov Model in three patients (14.3%), and other in three patients (14.3%). As the outputs, ten patients (47.6%) underwent noninvasive functional electrical stimulation (FES) with a cuff; one (4.8%) had an invasive FES with percutaneous stimulation, and ten (47.6%) used an external device (neuroprosthesis or virtual avatar). Motor function was restored in all patients for each assigned task. Clinical outcome measures were heterogeneous across all studies.

CONCLUSIONS

Invasive techniques of BCI show promise for the treatment of SCI, but there is currently no technology that can restore complete functional autonomy in patients with SCI. The current techniques and outcomes of BCI vary greatly. Because invasive BCIs are still in the early stages of development, further clinical studies should be conducted to optimize the prognosis for patients with SCI.

A two-stage transformer based network for motor imagery classification

Brain-computer interfaces (BCIs) are used to understand brain functioning and develop therapies for neurological and neurodegenerative disorders. Therefore, BCIs are crucial in rehabilitating motor dysfunction and advancing motor imagery applications. For motor imagery, electroencephalogram (EEG) signals are used to classify the subject's intention of moving a body part without actually moving it. This paper presents a two-stage transformer-based architecture that employs handcrafted features and deep learning techniques to enhance the classification performance on benchmarked EEG signals. Stage-1 is built on parallel convolution based EEGNet, multi-head attention, and separable temporal convolution networks for spatiotemporal feature extraction. Further, for enhanced classification, in stage-2, additional features and embeddings extracted from stage-1 are used to train TabNet. In addition, a novel channel cluster swapping data augmentation technique is also developed to handle the issue of limited samples for training deep learning architectures. The developed two-stage architecture offered an average classification accuracy of 88.5 % and 88.3 % on the BCI Competition IV-2a and IV-2b datasets, respectively, which is approximately 3.0 % superior over similar recent reported works.

A Time-Local Weighted Transformation Recognition Framework for Steady State Visual Evoked Potentials Based Brain-Computer Interfaces

Canonical correlation analysis (CCA), Multivariate synchronization index (MSI), and their extended methods have been widely used for target recognition in Brain-computer interfaces (BCIs) based on Steady State Visual Evoked Potentials (SSVEP), and covariance calculation is an important process for these algorithms. Some studies have proved that embedding time-local information into the covariance can optimize the recognition effect of the above algorithms. However, the optimization effect can only be observed from the recognition results and the improvement principle of time-local information cannot be explained. Therefore, we propose a time-local weighted transformation (TT) recognition framework that directly embeds the time-local information into the electroencephalography signal through weighted transformation. The influence mechanism of time-local information on the SSVEP signal can then be observed in the frequency domain. Low-frequency noise is suppressed on the premise of sacrificing part of the SSVEP fundamental frequency energy, the harmonic energy of SSVEP is enhanced at the cost of introducing a small amount of high-frequency noise. The experimental results show that the TT recognition framework can significantly improve the recognition ability of the algorithms and the separability of extracted features. Its enhancement effect is significantly better than the traditional time-local covariance extraction method, which has enormous application potential.

Improved empirical mode decomposition bagging RCSP combined with Fisher discriminant method for EEG feature extraction and classification

Background

Traditional Common Spatial Pattern (CSP) algorithms for Electroencephalogram (EEG) signal classification are sensitive to noise and can produce low accuracy in small sample datasets.

New method

To solve the problem, an improved Empirical Mode Decomposition (EMD) Bagging Regularized CSP (RCSP) algorithm is proposed. It filters EEG signals through improved EMD, inhibits high-frequency noise, retains effective information in the characteristic frequency band, and uses Bagging algorithm for data reconstruction. Feature extraction is performed with regularization of spatial patterns and Fisher linear discriminant analysis for feature classification. T-test is used for classification.

Results

The improved EMD Bagging RCSP algorithm has improved accuracy and robustness compared to CSP and its derivatives. The average classification rate is increased by about 6%, demonstrating the effectiveness and correctness of the proposed algorithm.Comparison with existing methods: The proposed algorithm outperforms CSP and its derivatives by retaining effective information and inhibiting high-frequency noise in small sample EEG datasets.

Conclusions

The proposed EMD Bagging RCSP algorithm provides a reliable and effective method for EEG signal classification and can be used in various applications, including brain-computer interfaces and clinical EEG diagnosis.

Enhancing SSVEP-BCI Performance Under Fatigue State Using Dynamic Stopping Strategy

Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) have emerged as a prominent technology due to their high information transfer rate, rapid calibration time, and robust signal-to-noise ratio. However, a critical challenge for practical applications is performance degradation caused by user fatigue during prolonged use. This work proposes novel methods to address this challenge by dynamically adjusting data acquisition length and updating detection models based on a fatigue-aware stopping strategy. Two 16-target SSVEP-BCIs were employed, one using low-frequency and the other using high-frequency stimulation. A self-recorded fatigue dataset from 24 subjects was utilized for extensive evaluation. A simulated online experiment demonstrated that the proposed methods outperform the conventional fixed stopping strategy in terms of classification accuracy, information transfer rate, and selection time, irrespective of stimulation frequency. These findings suggest that the proposed approach can significantly improve SSVEP-BCI performance under fatigue conditions, leading to superior performance during extended use.

Decoding the Debate: A Comparative Study of Brain-Computer Interface and Neurofeedback

Brain-Computer Interface (BCI) and Neurofeedback (NF) both rely on the technology to capture brain activity. However, the literature lacks a clear distinction between the two, with some scholars categorizing NF as a special case of BCI while others view BCI as a natural extension of NF, or classify them as fundamentally different entities. This ambiguity hinders the flow of information and expertise among scholars and can cause confusion. To address this issue, we conducted a study comparing BCI and NF from two perspectives: the background and context within which BCI and NF developed, and their system design. We utilized Functional Flow Block Diagram (FFBD) as a system modelling approach to visualize inputs, functions, and outputs to compare BCI and NF at a conceptual level. Our analysis revealed that while NF is a subset of the biofeedback method that requires data from the brain to be extracted and processed, the device performing these tasks is a BCI system by definition. Therefore, we conclude that NF should be considered a specific application of BCI technology. By clarifying the relationship between BCI and NF, we hope to facilitate better communication and collaboration among scholars in these fields.

Exploring EEG-based motor imagery decoding: a dual approach using spatial features and spectro-spatial Deep Learning model IFNet

Introduction

In recent years, the decoding of motor imagery (MI) from electroencephalography (EEG) signals has become a focus of research for brain-machine interfaces (BMIs) and neurorehabilitation. However, EEG signals present challenges due to their non-stationarity and the substantial presence of noise commonly found in recordings, making it difficult to design highly effective decoding algorithms. These algorithms are vital for controlling devices in neurorehabilitation tasks, as they activate the patient's motor cortex and contribute to their recovery.

Methods

This study proposes a novel approach for decoding MI during pedalling tasks using EEG signals. A widespread approach is based on feature extraction using Common Spatial Patterns (CSP) followed by a linear discriminant analysis (LDA) as a classifier. The first approach covered in this work aims to investigate the efficacy of a task-discriminative feature extraction method based on CSP filter and LDA classifier. Additionally, the second alternative hypothesis explores the potential of a spectro-spatial Convolutional Neural Network (CNN) to further enhance the performance of the first approach. The proposed CNN architecture combines a preprocessing pipeline based on filter banks in the frequency domain with a convolutional neural network for spectro-temporal and spectro-spatial feature extraction.

Results and discussion

To evaluate the approaches and their advantages and disadvantages, EEG data has been recorded from several able-bodied users while pedalling in a cycle ergometer in order to train motor imagery decoding models. The results show levels of accuracy up to 80% in some cases. The CNN approach shows greater accuracy despite higher instability.

Transferring a deep learning model from healthy subjects to stroke patients in a motor imagery brain-computer interface

Objective.Motor imagery (MI) brain-computer interfaces (BCIs) based on electroencephalogram (EEG) have been developed primarily for stroke rehabilitation, however, due to limited stroke data, current deep learning methods for cross-subject classification rely on healthy data. This study aims to assess the feasibility of applying MI-BCI models pre-trained using data from healthy individuals to detect MI in stroke patients.Approach.We introduce a new transfer learning approach where features from two-class MI data of healthy individuals are used to detect MI in stroke patients. We compare the results of the proposed method with those obtained from analyses within stroke data. Experiments were conducted using Deep ConvNet and state-of-the-art subject-specific machine learning MI classifiers, evaluated on OpenBMI two-class MI-EEG data from healthy subjects and two-class MI versus rest data from stroke patients.Main results.Results of our study indicate that through domain adaptation of a model pre-trained using healthy subjects' data, an average MI detection accuracy of 71.15% (±12.46%) can be achieved across 71 stroke patients. We demonstrate that the accuracy of the pre-trained model increased by 18.15% after transfer learning (p<0.001). Additionally, the proposed transfer learning method outperforms the subject-specific results achieved by Deep ConvNet and FBCSP, with significant enhancements of 7.64% (p<0.001) and 5.55% (p<0.001) in performance, respectively. Notably, the healthy-to-stroke transfer learning approach achieved similar performance to stroke-to-stroke transfer learning, with no significant difference (p>0.05). Explainable AI analyses using transfer models determined channel relevance patterns that indicate contributions from the bilateral motor, frontal, and parietal regions of the cortex towards MI detection in stroke patients.Significance.Transfer learning from healthy to stroke can enhance the clinical use of BCI algorithms by overcoming the challenge of insufficient clinical data for optimal training.

Classification of Targets and Distractors in an Audiovisual Attention Task Based on Electroencephalography

Within the broader context of improving interactions between artificial intelligence and humans, the question has arisen regarding whether auditory and rhythmic support could increase attention for visual stimuli that do not stand out clearly from an information stream. To this end, we designed an experiment inspired by pip-and-pop but more appropriate for eliciting attention and P3a-event-related potentials (ERPs). In this study, the aim was to distinguish between targets and distractors based on the subject's electroencephalography (EEG) data. We achieved this objective by employing different machine learning (ML) methods for both individual-subject (IS) and cross-subject (CS) models. Finally, we investigated which EEG channels and time points were used by the model to make its predictions using saliency maps. We were able to successfully perform the aforementioned classification task for both the IS and CS scenarios, reaching classification accuracies up to 76%. In accordance with the literature, the model primarily used the parietal-occipital electrodes between 200 ms and 300 ms after the stimulus to make its prediction. The findings from this research contribute to the development of more effective P300-based brain-computer interfaces. Furthermore, they validate the EEG data collected in our experiment.

A Neurobiological-Behavioral Approach to Predicting and Influencing Private Events

The primary goals of behavior analysis are the prediction and influence of behavior. These goals are largely achieved through the identification of functional relations between behaviors and the stimulating environment. Behavior-behavior relations are insufficient to meet these goals. Although this environment-behavior approach has been highly successful when applied to public behaviors, extensions to private events have been limited. This article discusses technical and conceptual challenges to the study of private events. We introduce a neurobiological-behavioral approach which seeks to understand private behavior as environmentally controlled in part by private neurobiological stimuli. These stimuli may enter into functional relations with both public and private behaviors. The analysis builds upon several current approaches to private events, delineates private behaviors and private stimulation, and emphasizes the reciprocal interaction between the two. By doing so, this approach can improve treatment and assessment of behavior and advance understanding of concepts such as motivating operations. We then describe the array of stimulus functions that neurobiological stimuli may acquire, including eliciting, discriminative, motivating, reinforcing, and punishing effects, and describe how the overall approach expands the concept of contextual influence. Finally, we describe how advances in behavioral neuroscience that enable the measurement and analysis of private behaviors and stimuli are allowing these once private events to affect the public world. Applications in the area of human-computer interfaces are discussed.

Prediction of Gait Kinematics and Kinetics: A Systematic Review of EMG and EEG Signal Use and Their Contribution to Prediction Accuracy

Human-machine interfaces hold promise in enhancing rehabilitation by predicting and responding to subjects' movement intent. In gait rehabilitation, neural network architectures utilize lower-limb muscle and brain activity to predict continuous kinematics and kinetics during stepping and walking. This systematic review, spanning five databases, assessed 16 papers meeting inclusion criteria. Studies predicted lower-limb kinematics and kinetics using electroencephalograms (EEGs), electromyograms (EMGs), or a combination with kinematic data and anthropological parameters. Long short-term memory (LSTM) and convolutional neural network (CNN) tools demonstrated highest accuracies. EEG focused on joint angles, while EMG predicted moments and torque joints. Useful EEG electrode locations included C3, C4, Cz, P3, F4, and F8. Vastus Lateralis, Rectus Femoris, and Gastrocnemius were the most commonly accessed muscles for kinematic and kinetic prediction using EMGs. No studies combining EEGs and EMGs to predict lower-limb kinematics and kinetics during stepping or walking were found, suggesting a potential avenue for future development in this technology.

Cross Domain Correlation Maximization for Enhancing the Target Recognition of SSVEP-Based Brain-Computer Interfaces

The target recognition performance of steady-state visual evoked potential (SSVEP)-based brain-computer interfaces can be significantly improved with a training-based approach. However, the training procedure is time consuming and often causes fatigue. Consequently, the number of training data should be limited, which may reduce the classification performance. Thus, how to improve classification accuracy without increasing the training time is crucial to SSVEP-based BCI system. This study proposes a transfer-related component analysis (TransRCA) method for addressing the above issue. In this method, the SSVEP-related components are extracted from a small number of training data of the current individual and combined with those extracted from a large number of existing training data of other individuals. The TransRCA method maximizes not only the inter-trial covariances between the source and target subjects, but also the correlation between the reference signals and SSVEP signals from the source and target subjects. The proposed method was validated on the SSVEP public Benchmark and BETA datasets, and the classification accuracy and information transmission rate of the ensemble version of the proposed TransRCA method were compared with those of the state-of-the-art eCCA, eTRCA, ttCCA, LSTeTRCA, and eIISMC methods on both datasets. The comparison results indicate that the proposed method provides a superior performance compared with these state-of-the-art methods, and thus has high potential for the development of a SSVEP-based brain-computer interface system with high classification performance that only uses a small number of training data.

A deep domain adaptation framework with correlation alignment for EEG-based motor imagery classification

It is impractical to collect sufficient and well-labeled EEG data in Brain-computer interface because of the time-consuming data acquisition and costly annotation. Conventional classification methods reusing EEG data from different subjects and time periods (across domains) significantly decrease the classification accuracy of motor imagery. In this paper, we propose a deep domain adaptation framework with correlation alignment (DDAF-CORAL) to solve the problem of distribution divergence for motor imagery classification across domains. Specifically, a two-stage framework is adopted to extract deep features for raw EEG data. The distribution divergence caused by subjected-related and time-related variations is further minimized by aligning the covariance of the source and target EEG feature distributions. Finally, the classification loss and adaptation loss are optimized simultaneously to achieve sufficient discriminative classification performance and low feature distribution divergence. Extensive experiments on three EEG datasets demonstrate that our proposed method can effectively reduce the distribution divergence between the source and target EEG data. The results show that our proposed method delivers outperformance (an average classification accuracy of 92.9% for within-session, an average kappa value of 0.761 for cross-session, and an average classification accuracy of 83.3% for cross-subject) in two-class classification tasks compared to other state-of-the-art methods.

Brain-computer interface: trend, challenges, and threats

Brain-computer interface (BCI), an emerging technology that facilitates communication between brain and computer, has attracted a great deal of research in recent years. Researchers provide experimental results demonstrating that BCI can restore the capabilities of physically challenged people, hence improving the quality of their lives. BCI has revolutionized and positively impacted several industries, including entertainment and gaming, automation and control, education, neuromarketing, and neuroergonomics. Notwithstanding its broad range of applications, the global trend of BCI remains lightly discussed in the literature. Understanding the trend may inform researchers and practitioners on the direction of the field, and on where they should invest their efforts more. Noting this significance, we have analyzed 25,336 metadata of BCI publications from Scopus to determine advancement of the field. The analysis shows an exponential growth of BCI publications in China from 2019 onwards, exceeding those from the United States that started to decline during the same period. Implications and reasons for this trend are discussed. Furthermore, we have extensively discussed challenges and threats limiting exploitation of BCI capabilities. A typical BCI architecture is hypothesized to address two prominent BCI threats, privacy and security, as an attempt to make the technology commercially viable to the society.

The Application of Deep Learning to Electroencephalograms, Magnetic Resonance Imaging, and Implants for the Detection of Epileptic Seizures: A Narrative Review

Epilepsy is a neurological disorder characterized by recurrent seizures affecting millions worldwide. Medically intractable seizures in epilepsy patients are not only detrimental to the quality of life but also pose a significant threat to their safety. Outcomes of epilepsy therapy can be improved by early detection and intervention during the interictal window period. Electroencephalography is the primary diagnostic tool for epilepsy, but accurate interpretation of seizure activity is challenging and highly time-consuming. Machine learning (ML) and deep learning (DL) algorithms enable us to analyze complex EEG data, which can not only help us diagnose but also locate epileptogenic zones and predict medical and surgical treatment outcomes. DL models such as convolutional neural networks (CNNs), inspired by visual processing, can be used to classify EEG activity. By applying preprocessing techniques, signal quality can be enhanced by denoising and artifact removal. DL can also be incorporated into the analysis of magnetic resonance imaging (MRI) data, which can help in the localization of epileptogenic zones in the brain. Proper detection of these zones can help in good neurosurgical outcomes. Recent advancements in DL have facilitated the implementation of these systems in neural implants and wearable devices, allowing for real-time seizure detection. This has the potential to transform the management of drug-refractory epilepsy. This review explores the application of ML and DL techniques to Electroencephalograms (EEGs), MRI, and wearable devices for epileptic seizure detection. This review briefly explains the fundamentals of both artificial intelligence (AI) and DL, highlighting these systems' potential advantages and undeniable limitations.

Magnetoencephalogram-based brain-computer interface for hand-gesture decoding using deep learning

Advancements in deep learning algorithms over the past decade have led to extensive developments in brain-computer interfaces (BCI). A promising imaging modality for BCI is magnetoencephalography (MEG), which is a non-invasive functional imaging technique. The present study developed a MEG sensor-based BCI neural network to decode Rock-Paper-scissors gestures (MEG-RPSnet). Unique preprocessing pipelines in tandem with convolutional neural network deep-learning models accurately classified gestures. On a single-trial basis, we found an average of 85.56% classification accuracy in 12 subjects. Our MEG-RPSnet model outperformed two state-of-the-art neural network architectures for electroencephalogram-based BCI as well as a traditional machine learning method, and demonstrated equivalent and/or better performance than machine learning methods that have employed invasive, electrocorticography-based BCI using the same task. In addition, MEG-RPSnet classification performance using an intra-subject approach outperformed a model that used a cross-subject approach. Remarkably, we also found that when using only central-parietal-occipital regional sensors or occipitotemporal regional sensors, the deep learning model achieved classification performances that were similar to the whole-brain sensor model. The MEG-RSPnet model also distinguished neuronal features of individual hand gestures with very good accuracy. Altogether, these results show that noninvasive MEG-based BCI applications hold promise for future BCI developments in hand-gesture decoding.

Relevance-based channel selection in motor imagery brain-computer interface

Objective.Channel selection in the electroencephalogram (EEG)-based brain-computer interface (BCI) has been extensively studied for over two decades, with the goal being to select optimal subject-specific channels that can enhance the overall decoding efficacy of the BCI. With the emergence of deep learning (DL)-based BCI models, there arises a need for fresh perspectives and novel techniques to conduct channel selection. In this regard, subject-independent channel selection is relevant, since DL models trained using cross-subject data offer superior performance, and the impact of inherent inter-subject variability of EEG characteristics on subject-independent DL training is not yet fully understood.Approach.Here, we propose a novel methodology for implementing subject-independent channel selection in DL-based motor imagery (MI)-BCI, using layer-wise relevance propagation (LRP) and neural network pruning. Experiments were conducted using Deep ConvNet and 62-channel MI data from the Korea University EEG dataset.Main Results.Using our proposed methodology, we achieved a 61% reduction in the number of channels without any significant drop (p = 0.09) in subject-independent classification accuracy, due to the selection of highly relevant channels by LRP. LRP relevance-based channel selections provide significantly better accuracies compared to conventional weight-based selections while using less than 40% of the total number of channels, with differences in accuracies ranging from 5.96% to 1.72%. The performance of the adapted sparse-LRP model using only 16% of the total number of channels is similar to that of the adapted baseline model (p = 0.13). Furthermore, the accuracy of the adapted sparse-LRP model using only 35% of the total number of channels exceeded that of the adapted baseline model by 0.53% (p = 0.81). Analyses of channels chosen by LRP confirm the neurophysiological plausibility of selection, and emphasize the influence of motor, parietal, and occipital channels in MI-EEG classification.Significance.The proposed method addresses a traditional issue in EEG-BCI decoding, while being relevant and applicable to the latest developments in the field of BCI. We believe that our work brings forth an interesting and important application of model interpretability as a problem-solving technique.

Identifying Thematics in a Brain-Computer Interface Research

This umbrella review is motivated to understand the shift in research themes on brain-computer interfacing (BCI) and it determined that a shift away from themes that focus on medical advancement and system development to applications that included education, marketing, gaming, safety, and security has occurred. The background of this review examined aspects of BCI categorisation, neuroimaging methods, brain control signal classification, applications, and ethics. The specific area of BCI software and hardware development was not examined. A search using One Search was undertaken and 92 BCI reviews were selected for inclusion. Publication demographics indicate the average number of authors on review papers considered was 4.2 ± 1.8. The results also indicate a rapid increase in the number of BCI reviews from 2003, with only three reviews before that period, two in 1972, and one in 1996. While BCI authors were predominantly Euro-American in early reviews, this shifted to a more global authorship, which China dominated by 2020-2022. The review revealed six disciplines associated with BCI systems: life sciences and biomedicine (n = 42), neurosciences and neurology (n = 35), and rehabilitation (n = 20); (2) the second domain centred on the theme of functionality: computer science (n = 20), engineering (n = 28) and technology (n = 38). There was a thematic shift from understanding brain function and modes of interfacing BCI systems to more applied research novel areas of research-identified surround artificial intelligence, including machine learning, pre-processing, and deep learning. As BCI systems become more invasive in the lives of "normal" individuals, it is expected that there will be a refocus and thematic shift towards increased research into ethical issues and the need for legal oversight in BCI application.

Evaluating the perspectives of those with severe physical impairments while learning BCI control of a commercial augmentative and alternative communication paradigm

Augmentative and alternative communication (AAC) techniques can provide access to communication for individuals with severe physical impairments. Brain-computer interface (BCI) access techniques may serve alongside existing AAC access methods to provide communication device control. However, there is limited information available about how individual perspectives change with motor-based BCI-AAC learning. Four individuals with ALS completed 12 BCI-AAC training sessions in which they made letter selections during an automatic row-column scanning pattern via a motor-based BCI-AAC. Recurring measures were taken before and after each BCI-AAC training session to evaluate changes associated with BCI-AAC performance, and included measures of fatigue, frustration, mental effort, physical effort, device satisfaction, and overall ease of device control. Levels of pre- to post-fatigue were low for use of the BCI-AAC system. However, participants indicated different perceptions of the term fatigue, with three participants discussing fatigue to be generally synonymous with physical effort, and one mental effort. Satisfaction with the BCI-AAC system was related to BCI-AAC performance for two participants, and levels of frustration for two participants. Considering a range of person-centered measures in future clinical BCI-AAC applications is important for optimizing and standardizing BCI-AAC assessment procedures.

Online adaptive group-wise sparse Penalized Recursive Exponentially Weighted N-way Partial Least Square for epidural intracranial BCI

Introduction

Motor Brain-Computer Interfaces (BCIs) create new communication pathways between the brain and external effectors for patients with severe motor impairments. Control of complex effectors such as robotic arms or exoskeletons is generally based on the real-time decoding of high-resolution neural signals. However, high-dimensional and noisy brain signals pose challenges, such as limitations in the generalization ability of the decoding model and increased computational demands.

Methods

The use of sparse decoders may offer a way to address these challenges. A sparsity-promoting penalization is a common approach to obtaining a sparse solution. BCI features are naturally structured and grouped according to spatial (electrodes), frequency, and temporal dimensions. Applying group-wise sparsity, where the coefficients of a group are set to zero simultaneously, has the potential to decrease computational time and memory usage, as well as simplify data transfer. Additionally, online closed-loop decoder adaptation (CLDA) is known to be an efficient procedure for BCI decoder training, taking into account neuronal feedback. In this study, we propose a new algorithm for online closed-loop training of group-wise sparse multilinear decoders using L _p -Penalized Recursive Exponentially Weighted N-way Partial Least Square (PREW-NPLS). Three types of sparsity-promoting penalization were explored using L _p with p = 0., 0.5, and 1.

Results

The algorithms were tested offline in a pseudo-online manner for features grouped by spatial dimension. A comparison study was conducted using an epidural ECoG dataset recorded from a tetraplegic individual during long-term BCI experiments for controlling a virtual avatar (left/right-hand 3D translation). Novel algorithms showed comparable or better decoding performance than conventional REW-NPLS, which was achieved with sparse models. The proposed algorithms are compatible with real-time CLDA.

Discussion

The proposed algorithm demonstrated good performance while drastically reducing the computational load and the memory consumption. However, the current study is limited to offline computation on data recorded with a single patient, with penalization restricted to the spatial domain only.

Speech decoding from a small set of spatially segregated minimally invasive intracranial EEG electrodes with a compact and interpretable neural network

Objective. Speech decoding, one of the most intriguing brain-computer interface applications, opens up plentiful opportunities from rehabilitation of patients to direct and seamless communication between human species. Typical solutions rely on invasive recordings with a large number of distributed electrodes implanted through craniotomy. Here we explored the possibility of creating speech prosthesis in a minimally invasive setting with a small number of spatially segregated intracranial electrodes.Approach. We collected one hour of data (from two sessions) in two patients implanted with invasive electrodes. We then used only the contacts that pertained to a single stereotactic electroencephalographic (sEEG) shaft or an electrocorticographic (ECoG) stripe to decode neural activity into 26 words and one silence class. We employed a compact convolutional network-based architecture whose spatial and temporal filter weights allow for a physiologically plausible interpretation.Mainresults. We achieved on average 55% accuracy using only six channels of data recorded with a single minimally invasive sEEG electrode in the first patient and 70% accuracy using only eight channels of data recorded for a single ECoG strip in the second patient in classifying 26+1 overtly pronounced words. Our compact architecture did not require the use of pre-engineered features, learned fast and resulted in a stable, interpretable and physiologically meaningful decision rule successfully operating over a contiguous dataset collected during a different time interval than that used for training. Spatial characteristics of the pivotal neuronal populations corroborate with active and passive speech mapping results and exhibit the inverse space-frequency relationship characteristic of neural activity. Compared to other architectures our compact solution performed on par or better than those recently featured in neural speech decoding literature.Significance. We showcase the possibility of building a speech prosthesis with a small number of electrodes and based on a compact feature engineering free decoder derived from a small amount of training data.

Brain Chip Implant: Public’s knowledge, Attitude, and Determinants. A Multi-Country Study, 2021

Background: In August 2020, a brain chip was announced as implantation in the human brain targeted to boost brain activity without significant side effects. The aim of this work was to examine the level of knowledge, awareness, and public concerns about the use of brain chip implants. Methods: An online cross-sectional survey targeted 326 adults from more than five countries in the Middle East and North Africa during the period from May 2021 to July 2021. The data was collected through a validated self-administrated questionnaire composed of five sections. The collected data were coded and analyzed using suitable tests and methods. Results: According to our results, 54.6% of the study participants mentioned that they had heard about the Brain Chip Implant; while only 6.1% stated that they knew its importance. The most common reported indication for the Brain Chip Implant was improving memory, followed by treatment of epilepsy and improving mental function. Brain Chip Implant safety seemed to be the most common public concern, as most of the participants were hesitant about using it and had concerns regarding its safety.  Conclusion: Medical personnel seems to be the most concerned about the use of the brain chip implant. Safety measures, confidentiality, and security procedures, respectively, are the major issues that might limit the broad use of the brain chip implant.

A multi-modal brain-computer interface based on threshold discrimination and its application in wheelchair control

In this study, we propose a novel multi-modal brain-computer interface (BCI) system based on the threshold discrimination, which is proposed for the first time to distinguish between SSVEP and MI potentials. The system combines these two heterogeneous signals to increase the number of control commands and improve the performance of asynchronous control of external devices. In this research, an electric wheelchair is controlled as an example. The user can continuously control the wheelchair to turn left/right through motion imagination (MI) by imagining left/right-hand movement and generate another 6 commands for the wheelchair control by focusing on the SSVEP stimulation panel. Ten subjects participated in a MI training session and eight of them completed a mobile obstacle-avoidance experiment in a complex environment requesting high control accuracy for successful manipulation. Comparing with the single-modal BCI-controlled wheelchair system, the results demonstrate that the proposed multi-modal method is effective by providing more satisfactory control accuracy, and show the potential of BCI-controlled systems to be applied in complex daily tasks.

Effects of Low Mental Energy from Long Periods of Work on Brain-Computer Interfaces

Brain-computer interfaces (BCIs) provide novel hands-free interaction strategies. However, the performance of BCIs is affected by the user’s mental energy to some extent. In this study, we aimed to analyze the combined effects of decreased mental energy and lack of sleep on BCI performance and how to reduce these effects. We defined the low-mental-energy (LME) condition as a combined condition of decreased mental energy and lack of sleep. We used a long period of work (>=18 h) to induce the LME condition, and then P300- and SSVEP-based BCI tasks were conducted in LME or normal conditions. Ten subjects were recruited in this study. Each subject participated in the LME- and normal-condition experiments within one week. For the P300-based BCI, we used two decoding algorithms: stepwise linear discriminant (SWLDA) and least square regression (LSR). For the SSVEP-based BCI, we used two decoding algorithms: canonical correlation analysis (CCA) and filter bank canonical correlation analysis (FBCCA). Accuracy and information transfer rate (ITR) were used as performance metrics. The experimental results showed that for the P300-based BCI, the average accuracy was reduced by approximately 35% (with a SWLDA classifier) and approximately 40% (with a LSR classifier); the average ITR was reduced by approximately 6 bits/min (with a SWLDA classifier) and approximately 7 bits/min (with an LSR classifier). For the SSVEP-based BCI, the average accuracy was reduced by approximately 40% (with a CCA classifier) and approximately 40% (with a FBCCA classifier); the average ITR was reduced by approximately 20 bits/min (with a CCA classifier) and approximately 19 bits/min (with a FBCCA classifier). Additionally, the amplitude and signal-to-noise ratio of the evoked electroencephalogram signals were lower in the LME condition, while the degree of fatigue and the task load of each subject were higher. Further experiments suggested that increasing stimulus size, flash duration, and flash number could improve BCI performance in LME conditions to some extent. Our experiments showed that the LME condition reduced BCI performance, the effects of LME on BCI did not rely on specific BCI types and specific decoding algorithms, and optimizing BCI parameters (e.g., stimulus size) can reduce these effects.

Neuroinflammatory Gene Expression Analysis Reveals Pathways of Interest as Potential Targets to Improve the Recording Performance of Intracortical Microelectrodes

Intracortical microelectrodes are a critical component of brain-machine interface (BMI) systems. The recording performance of intracortical microelectrodes used for both basic neuroscience research and clinical applications of BMIs decreases over time, limiting the utility of the devices. The neuroinflammatory response to the microelectrode has been identified as a significant contributing factor to its performance. Traditionally, pathological assessment has been limited to a dozen or so known neuroinflammatory proteins, and only a few groups have begun to explore changes in gene expression following microelectrode implantation. Our initial characterization of gene expression profiles of the neuroinflammatory response to mice implanted with non-functional intracortical probes revealed many upregulated genes that could inform future therapeutic targets. Emphasis was placed on the most significant gene expression changes and genes involved in multiple innate immune sets, including Cd14, C3, Itgam, and Irak4. In previous studies, inhibition of Cluster of Differentiation 14 (Cd14) improved microelectrode performance for up to two weeks after electrode implantation, suggesting CD14 can be explored as a potential therapeutic target. However, all measures of improvements in signal quality and electrode performance lost statistical significance after two weeks. Therefore, the current study investigated the expression of genes in the neuroinflammatory pathway at the tissue-microelectrode interface in Cd14-/- mice to understand better how Cd14 inhibition was connected to temporary improvements in recording quality over the initial 2-weeks post-surgery, allowing for the identification of potential co-therapeutic targets that may work synergistically with or after CD14 inhibition to improve microelectrode performance.

A Therapeutic Approach Using the Combined Application of Virtual Reality with Robotics for the Treatment of Patients with Spinal Cord Injury: A Systematic Review

Spinal cord injury (SCI) has been associated with high mortality rates. Thanks to the multidisciplinary vision and approach of SCI, including the application of new technologies in the field of neurorehabilitation, people with SCI can survive and prosper after injury. The main aim of this systematic review was to analyze the effectiveness of the combined use of VR and robotics in the treatment of patients with SCI. The literature search was performed between May and July 2021 in the Cochrane Central Register of Controlled Trials, Physiotherapy Evidence Database (PEDro), PubMed, and Web of Science. The methodological quality of each study was assessed using the SCIRE system and the PEDro scale, whereas the risk of bias was analyzed using the Cochrane Collaboration’s tool. A total of six studies, involving 63 participants, were included in this systematic review. Relevant changes were found in the upper limbs, with improvements of shoulder and upper arm mobility, as well as the strengthening of weaker muscles. Combined rehabilitation may be a valuable approach to improve motor function in SCI patients. Nonetheless, further research is necessary, with a larger patient sample and a longer duration.

Carbohydrate based biomaterials for neural interface applications

Neuroprosthetic devices that record and modulate neural activities have demonstrated immense potential for bypassing or restoring lost neurological functions due to neural injuries and disorders. However, implantable electrical devices interfacing with brain tissue are susceptible to a series of inflammatory tissue responses along with mechanical or electrical failures which can affect the device performance over time. Several biomaterial strategies have been implemented to improve device-tissue integration for high quality and stable performance. Ranging from developing smaller, softer, and more flexible electrode designs to introducing bioactive coatings and drug-eluting layers on the electrode surface, such strategies have shown different degrees of success but with limitations. With their hydrophilic properties and specific bioactivities, carbohydrates offer a potential solution for addressing some of the limitations of the existing biomolecular approaches. In this review, we summarize the role of polysaccharides in the central nervous system, with a primary focus on glycoproteins and proteoglycans, to shed light on their untapped potential as biomaterials for neural implants. Utilization of glycosaminoglycans for neural interface and tissue regeneration applications is comprehensively reviewed to provide the current state of carbohydrate-based biomaterials for neural implants. Finally, we will discuss the challenges and opportunities of applying carbohydrate-based biomaterials for neural tissue interfaces.

Development of a Brain-Computer Interface-Based Symbol Digit Modalities Test and Validation in Healthy Elderly Volunteers and Stroke Patients

Standard cognitive assessment tools often involve motor or verbal responses, making them impossible for severely motor-disabled individuals. Brain-computer interfaces (BCIs) are expected to help severely motor-impaired individuals to perform cognitive assessment because BCIs can circumvent motor and verbal requirements. Currently, the field of research to develop cognitive tasks based on BCI is still in its nascent stage and needs further development. This study explored the possibility of developing a BCI version of symbol digit modalities test (BCI-SDMT). Steady-state visual evoked potential (SSVEP) was adopted to build the BCI and a 9-target SSVEP-BCI was realized to send examinees' responses. A training-free algorithm (i.e., filter bank canonical correlation analysis) was used for SSVEP identification. Thus, examinees are able to start the proposed BCI-SDMT immediately. Eighty-nine healthy elderly volunteers and 9 stroke patients were enrolled to validate the technical feasibility of the developed BCI-SDMT. For all participants, the average recognition accuracies of the developed BCI and BCI-SDMT were 93.89 ± 8.48% and 92.58 ± 10.52%, respectively, were considerably above the chance level (i.e., 11.11%). These results indicated that both healthy elderly volunteers and stroke patients could elicit sufficient SSVEPs to control the BCI. Furthermore, patient use of the developed BCI-SDMT was unaffected by the presence of motor impairment. They could understand instructions, pair numbers with specific symbols, and send commands using the BCI. The proposed BCI-SDMT can be used as a complement to the existing versions of the SDMT and has the potential to evaluate cognitive abilities in individuals with severe motor disabilities.

An FPGA-Embedded Brain-Computer Interface System to Support Individual Autonomy in Locked-In Individuals

Brain-computer interfaces (BCI) can detect specific EEG patterns and translate them into control signals for external devices by providing people suffering from severe motor disabilities with an alternative/additional channel to communicate and interact with the outer world. Many EEG-based BCIs rely on the P300 event-related potentials, mainly because they require training times for the user relatively short and provide higher selection speed. This paper proposes a P300-based portable embedded BCI system realized through an embedded hardware platform based on FPGA (field-programmable gate array), ensuring flexibility, reliability, and high-performance features. The system acquires EEG data during user visual stimulation and processes them in a real-time way to correctly detect and recognize the EEG features. The BCI system is designed to allow to user to perform communication and domotic controls.

Efficacy of Brain-Computer Interface and the Impact of Its Design Characteristics on Poststroke Upper-limb Rehabilitation: A Systematic Review and Meta-analysis of Randomized Controlled Trials

Background. A number of recent randomized controlled trials reported the efficacy of brain-computer interface (BCI) for upper-limb stroke rehabilitation compared with other therapies. Despite the encouraging results reported, there is a significant variance in the reported outcomes. This paper aims to investigate the effectiveness of different BCI designs on poststroke upper-limb rehabilitation. Methods. The effect sizes of pooled and individual studies were assessed by computing Hedge's g values with a 95% confidence interval. Subgroup analyses were also performed to examine the impact of different BCI designs on the treatment effect. Results. The study included 12 clinical trials involving 298 patients. The analysis showed that the BCI yielded significant superior short-term and long-term efficacy in improving the upper-limb motor function compared to the control therapies (Hedge's g = 0.73 and 0.33, respectively). Based on our subgroup analyses, the BCI studies that used the intention of movement had a higher effect size compared to those used motor imagery (Hedge's g = 1.21 and 0.55, respectively). The BCI studies using band power features had a significantly higher effect size than those using filter bank common spatial patterns features (Hedge's g = 1.25 and - 0.23, respectively). Finally, the studies that used functional electrical stimulation as the BCI feedback had the highest effect size compared to other devices (Hedge's g = 1.2). Conclusion. This meta-analysis confirmed the effectiveness of BCI for upper-limb rehabilitation. Our findings support the use of band power features, the intention of movement, and the functional electrical stimulation in future BCI designs for poststroke upper-limb rehabilitation.

Mechanical properties of brain tissue based on microstructure

Research on the mechanical properties of brain tissue has gradually deepened recently. Two indentation protocols were used here to characterize the mechanical properties of cortical tissues. Further, histological staining was used to explore the correlation between the mechanical properties and microstructure on the basis of the density of cell nuclei and proteoglycan content. No significant difference was observed in transient contact stiffness between the cerebral cortex and cerebellar cortex at the depth interval of 0-600 μm under the cortical surface; however, the average shear modulus of the cerebral cortex was higher than that of the cerebellar cortex. The cerebral cortex responded more quickly to the change in load and released stress more thoroughly than the cerebellar cortex. In addition, the density of cell nuclei was related to both the transient contact stiffness and second time constant of cortical tissues. Proteoglycan content had a more significant impact on the shear modulus, second time constant, and stress relaxation rate of cortical tissues. Exploring mechanical properties thoroughly will provide more detailed mechanical information for future brain chip implantation. Alternatively, linking the mechanical properties of cortical tissues to the microstructure can provide basic data for the design and manufacture of substitute materials for brain tissue.

Neurodegenerative disorders management: state-of-art and prospects of nano-biotechnology

Neurodegenerative disorders (NDs) are highly prevalent among the aging population. It affects primarily the central nervous system (CNS) but the effects are also observed in the peripheral nervous system. Neural degeneration is a progressive loss of structure and function of neurons, which may ultimately involve cell death. Such patients suffer from debilitating memory loss and altered motor coordination which bring up non-affordable and unavoidable socio-economic burdens. Due to the unavailability of specific therapeutics and diagnostics, the necessity to control or manage NDs raised the demand to investigate and develop efficient alternative approaches. Keeping trends and advancements in view, this report describes both state-of-the-art and challenges in nano-biotechnology-based approaches to manage NDs, toward personalized healthcare management. Sincere efforts are being made to customize nano-theragnostics to control: therapeutic cargo packaging, delivery to the brain, nanomedicine of higher efficacy, deep brain stimulation, implanted stimulation, and managing brain cell functioning. These advancements are useful to design future therapy based on the severity of the patient's neurodegenerative disease. However, we observe a lack of knowledge shared among scientists of a variety of expertise to explore this multi-disciplinary research field for NDs management. Consequently, this review will provide a guideline platform that will be useful in developing novel smart nano-therapies by considering the aspects and advantages of nano-biotechnology to manage NDs in a personalized manner. Nano-biotechnology-based approaches have been proposed as effective and affordable alternatives at the clinical level due to recent advancements in nanotechnology-assisted theragnostics, targeted delivery, higher efficacy, and minimal side effects.

Feasibility of using discrete Brain Computer Interface for people with Multiple Sclerosis

AIM

Brain-Computer Interfaces (BCIs) hold promise to provide people with partial or complete paralysis, the ability to control assistive technology. This study reports offline classification of imagined and executed movements of the upper and lower limb in one participant with multiple sclerosis and people with no limb function deficits.

METHODS

We collected neural signals using electroencephalography (EEG) while participants performed executed and imagined motor tasks as directed by prompts shown on a screen.

RESULTS

Participants with no limb function attained >70% decoding accuracy on their best-imagined task compared to rest and on at-least one task comparison. The participant with multiple sclerosis also achieved accuracies within the range of participants with no limb function loss.Clinical Relevance - While only one case study is provided it was promising that the participant with MS was able to achieve comparable classification to that of the seven healthy controls. Further studies are needed to assess whether people suffering from MS may be able to use a BCI to improve their quality of life.

EEG-Based Emotion Recognition for Modulating Social-Aware Robot Navigation

Companion robots play an important role to accompany humans and provide emotional support, such as reducing human social isolation and loneliness. Based on recognizing human partner's mental states, a companion robot is able to dynamically adjust its behaviors, and make human-robot interaction smoother and natural. Human emotion has been recognized by many modalities like facial expression and voice. Neurophysiological signals have shown promising results in emotion recognition, since it is an innate signal of human brain which cannot be faked. In this paper, emotional state recognition using a neurophysiology method is studied to guide and modulate companion-robot navigation to enhance its social capabilities. Electroencephalogram (EEG), a type of neurophysiological signals, is used to recognize human emotional state, and then feed into a navigation path planning algorithm for controlling a companion robot's routes. Simulation results show that mobile robot presents navigation behaviors modulated by dynamic human emotional states.

Vigilance Estimating in SSVEP-Based BCI Using Multimodal Signals

Brain-computer interface (BCI) is a communication system that allows a direct connection between the human brain and external devices. With the application of BCI, it is important to estimate vigilance for BCI users. In order to investigate the vigilance changes of the subjects during BCI tasks and develop a multimodal method to estimate the vigilance level, a high-speed 4-target BCI system for cursor control was built based on steady-state visual evoked potential (SSVEP). 18 participants were recruited and underwent a 90-min continuous cursor-control BCI task, when electroencephalogram (EEG), electrooculogram (EOG), electrocardiography (ECG), and electrodermal activity (EDA) were recorded simultaneously. Then, we extracted features from the multimodal signals and applied regression models to estimate vigilance. Experimental results showed that the differential entropy (DE) feature could effectively reflect the change of vigilance. The vigilance estimation method, which integrates DE and EOG features into the support vector regression (SVR) model, achieved a better performance than the compared methods. These results demonstrate the feasibility of our methods for estimating vigilance levels in BCI.

Investigation on Robustness of EEG-based Brain-Computer Interfaces

Electroencephalogram (EEG)-based brain-computer interface (BCI) systems tend to suffer from performance degradation due to the presence of noise and artifacts in EEG data. This study is aimed at systematically investigating the robustness of state-of-the-art machine learning and deep learning based EEG-BCI models for motor imagery classification against simulated channel-specific noise in EEG data, at various low values of signal-to-noise ratio (SNR). Our results illustrate higher robustness of deep learning based MI classification models compared to the traditional machine learning based model, while identifying a set of channels with large sensitivity to simulated channel-specific noise. The EEGNet is relatively more robust towards channel-specific noise than Shallow ConvNet and FBCSP. We propose a preliminary solution, based on activation function, to improve the robustness of the deep learning models. By using saturating nonlinearities, the percentage drop in classification accuracy for SNR of -18 dB had reduced from 10.99% to 6.53% for EEGNet and 14.05% to 3.57% for Shallow ConvNet. Through this study, we emphasize the need for a more precise solution for enhancing the robustness, and thereby usability of EEG-BCI systems.

A neuromimetic realization of hippocampal CA1 for theta wave generation

Recent advances in neural engineering allowed the development of neuroprostheses which facilitate functionality in people with neurological problems. In this research, a real-time neuromorphic system is proposed to artificially reproduce the theta wave and firing patterns of different neuronal populations in the CA1, a sub-region of the hippocampus. The hippocampal theta oscillations (4-12 Hz) are an important electrophysiological rhythm that contributes in various cognitive functions, including navigation, memory, and novelty detection. The proposed CA1 neuromimetic circuit includes 100 linearized Pinsky-Rinzel neurons and 668 excitatory and inhibitory synapses on a field programmable gate array (FPGA). The implemented spiking neural network of the CA1 includes the main neuronal populations for the theta rhythm generation: excitatory pyramidal cells, PV+ basket cells, and Oriens Lacunosum-Moleculare (OLM) cells which are inhibitory interneurons. Moreover, the main inputs to the CA1 region from the entorhinal cortex via the perforant pathway, the CA3 via Schaffer collaterals, and the medial septum via fimbria-fornix are also implemented on the FPGA using a bursting leaky-integrate and fire (LIF) neuron model. The results of hardware realization show that the proposed CA1 neuromimetic circuit successfully reconstructs the theta oscillations and functionally illustrates the phase relations between firing responses of the different neuronal populations. It is also evaluated the impact of medial septum elimination on the firing patterns of the CA1 neuronal population and the theta wave's characteristics. This neuromorphic system can be considered as a potential platform that opens opportunities for neuroprosthetic applications in future works.

Exploring the Use of Brain-Computer Interfaces in Stroke Neurorehabilitation

With the continuous development of artificial intelligence technology, "brain-computer interfaces" are gradually entering the field of medical rehabilitation. As a result, brain-computer interfaces (BCIs) have been included in many countries' strategic plans for innovating this field, and subsequently, major funding and talent have been invested in this technology. In neurological rehabilitation for stroke patients, the use of BCIs opens up a new chapter in "top-down" rehabilitation. In our study, we first reviewed the latest BCI technologies, then presented recent research advances and landmark findings in BCI-based neurorehabilitation for stroke patients. Neurorehabilitation was focused on the areas of motor, sensory, speech, cognitive, and environmental interactions. Finally, we summarized the shortcomings of BCI use in the field of stroke neurorehabilitation and the prospects for BCI technology development for rehabilitation.

Habituation of P300 in the Use of P300-based Brain-Computer Interface Spellers: Individuals With Amyotrophic Lateral Sclerosis Versus Age-Matched Controls

The P300-based brain-computer interface speller can provide motor independent communication to individuals with amyotrophic lateral sclerosis (ALS), a progressive neurodegenerative disorder that affects the motor system. P300 amplitude stability is critical for operation of the P300 speller. The P300 has good long-term stability, but to our knowledge, short-term habituation in the P300 speller has not been studied. In the current study, 15 participants: 8 ALS patients and 7 age-matched healthy volunteers (HVs), used 2 versions of P300 spellers, Face speller and Flash speller, each for 30 minutes. The ALS group performed as well as the HVs in both spellers and HVs did better with the Face speller than Flash speller while the ALS group performed equally well in both spellers. Neither intra-run P300 habituation nor inter-run P300 habituation was found. The P300 speller could be a reliable communication device for individuals with ALS.

Edge deep learning for neural implants: a case study of seizure detection and prediction

Objective.Implanted devices providing real-time neural activity classification and control are increasingly used to treat neurological disorders, such as epilepsy and Parkinson's disease. Classification performance is critical to identifying brain states appropriate for the therapeutic action (e.g. neural stimulation). However, advanced algorithms that have shown promise in offline studies, in particular deep learning (DL) methods, have not been deployed on resource-restrained neural implants. Here, we designed and optimized three DL models or edge deployment and evaluated their inference performance in a case study of seizure detection.Approach.A deep neural network (DNN), a convolutional neural network (CNN), and a long short-term memory (LSTM) network were designed and trained with TensorFlow to classify ictal, preictal, and interictal phases from the CHB-MIT scalp EEG database. A sliding window based weighted majority voting algorithm was developed to detect seizure events based on each DL model's classification results. After iterative model compression and coefficient quantization, the algorithms were deployed on a general-purpose, off-the-shelf microcontroller for real-time testing. Inference sensitivity, false positive rate (FPR), execution time, memory size, and power consumption were quantified.Main results.For seizure event detection, the sensitivity and FPR for the DNN, CNN, and LSTM models were 87.36%/0.169 h^-1, 96.70%/0.102 h^-1, and 97.61%/0.071 h^-1, respectively. Predicting seizures for early warnings was also feasible. The LSTM model achieved the best overall performance at the expense of the highest power. The DNN model achieved the shortest execution time. The CNN model showed advantages in balanced performance and power with minimum memory requirement. The implemented model compression and quantization achieved a significant saving of power and memory with an accuracy degradation of less than 0.5%.Significance.Inference with embedded DL models achieved performance comparable to many prior implementations that had no time or computational resource limitations. Generic microcontrollers can provide the required memory and computational resources, while model designs can be migrated to application-specific integrated circuits for further optimization and power saving. The results suggest that edge DL inference is a feasible option for future neural implants to improve classification performance and therapeutic outcomes.

Filter Bank-Driven Multivariate Synchronization Index for Training-Free SSVEP BCI

In recent years, multivariate synchronization index (MSI) algorithm, as a novel frequency detection method, has attracted increasing attentions in the study of brain-computer interfaces (BCIs) based on steady state visual evoked potential (SSVEP). However, MSI algorithm is hard to fully exploit SSVEP-related harmonic components in the electroencephalogram (EEG), which limits the application of MSI algorithm in BCI systems. In this paper, we propose a novel filter bank-driven MSI algorithm (FBMSI) to overcome the limitation and further improve the accuracy of SSVEP recognition. We evaluate the efficacy of the FBMSI method by developing a 6-command SSVEP-NAO robot system with extensive experimental analyses. An offline experimental study is first performed with EEG collected from nine subjects to investigate the effects of varying parameters on the model performance. Offline results show that the proposed method has achieved a stable improvement effect. We further conduct an online experiment with six subjects to assess the efficacy of the developed FBMSI algorithm in a real-time BCI application. The online experimental results show that the FBMSI algorithm yields a promising average accuracy of 83.56% using a data length of even only one second, which was 12.26% higher than the standard MSI algorithm. These extensive experimental results confirmed the effectiveness of the FBMSI algorithm in SSVEP recognition and demonstrated its potential application in the development of improved BCI systems.

Converging Robotic Technologies in Targeted Neural Rehabilitation: A Review of Emerging Solutions and Challenges

Recent advances in the field of neural rehabilitation, facilitated through technological innovation and improved neurophysiological knowledge of impaired motor control, have opened up new research directions. Such advances increase the relevance of existing interventions, as well as allow novel methodologies and technological synergies. New approaches attempt to partially overcome long-term disability caused by spinal cord injury, using either invasive bridging technologies or noninvasive human-machine interfaces. Muscular dystrophies benefit from electromyography and novel sensors that shed light on underlying neuromotor mechanisms in people with Duchenne. Novel wearable robotics devices are being tailored to specific patient populations, such as traumatic brain injury, stroke, and amputated individuals. In addition, developments in robot-assisted rehabilitation may enhance motor learning and generate movement repetitions by decoding the brain activity of patients during therapy. This is further facilitated by artificial intelligence algorithms coupled with faster electronics. The practical impact of integrating such technologies with neural rehabilitation treatment can be substantial. They can potentially empower nontechnically trained individuals-namely, family members and professional carers-to alter the programming of neural rehabilitation robotic setups, to actively get involved and intervene promptly at the point of care. This narrative review considers existing and emerging neural rehabilitation technologies through the perspective of replacing or restoring functions, enhancing, or improving natural neural output, as well as promoting or recruiting dormant neuroplasticity. Upon conclusion, we discuss the future directions for neural rehabilitation research, diagnosis, and treatment based on the discussed technologies and their major roadblocks. This future may eventually become possible through technological evolution and convergence of mutually beneficial technologies to create hybrid solutions.

The MindGomoku: An Online P300 BCI Game Based on Bayesian Deep Learning

In addition to helping develop products that aid the disabled, brain-computer interface (BCI) technology can also become a modality of entertainment for all people. However, most BCI games cannot be widely promoted due to the poor control performance or because they easily cause fatigue. In this paper, we propose a P300 brain-computer-interface game (MindGomoku) to explore a feasible and natural way to play games by using electroencephalogram (EEG) signals in a practical environment. The novelty of this research is reflected in integrating the characteristics of game rules and the BCI system when designing BCI games and paradigms. Moreover, a simplified Bayesian convolutional neural network (SBCNN) algorithm is introduced to achieve high accuracy on limited training samples. To prove the reliability of the proposed algorithm and system control, 10 subjects were selected to participate in two online control experiments. The experimental results showed that all subjects successfully completed the game control with an average accuracy of 90.7% and played the MindGomoku an average of more than 11 min. These findings fully demonstrate the stability and effectiveness of the proposed system. This BCI system not only provides a form of entertainment for users, particularly the disabled, but also provides more possibilities for games.

Progress in Brain Computer Interface: Challenges and Opportunities

Brain computer interfaces (BCI) provide a direct communication link between the brain and a computer or other external devices. They offer an extended degree of freedom either by strengthening or by substituting human peripheral working capacity and have potential applications in various fields such as rehabilitation, affective computing, robotics, gaming, and neuroscience. Significant research efforts on a global scale have delivered common platforms for technology standardization and help tackle highly complex and non-linear brain dynamics and related feature extraction and classification challenges. Time-variant psycho-neurophysiological fluctuations and their impact on brain signals impose another challenge for BCI researchers to transform the technology from laboratory experiments to plug-and-play daily life. This review summarizes state-of-the-art progress in the BCI field over the last decades and highlights critical challenges.

Enhancing SSVEP-Based Brain-Computer Interface with Two-Step Task-Related Component Analysis

Among various methods for frequency recognition of the steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) study, a task-related component analysis (TRCA), which extracts discriminative spatial filters for classifying electroencephalogram (EEG) signals, has gathered much interest. The TRCA-based SSVEP method yields lower computational cost and higher classification performance compared to existing SSVEP methods. In spite of its utility, the TRCA-based SSVEP method still suffers from the degradation of the frequency recognition rate in cases where EEG signals with a short length window are used. To address this issue, here, we propose an improved strategy for decoding SSVEPs, which is insensitive to a window length by carrying out two-step TRCA. The proposed method reuses the spatial filters corresponding to target frequencies generated by the TRCA. Followingly, the proposed method accentuates features for target frequencies by correlating individual template and test data. For the evaluation of the performance of the proposed method, we used a benchmark dataset with 35 subjects and confirmed significantly improved performance comparing with other existing SSVEP methods. These results imply the suitability as an efficient frequency recognition strategy for SSVEP-based BCI applications.

An Intracortical Implantable Brain-Computer Interface for Telemetric Real-Time Recording and Manipulation of Neuronal Circuits for Closed-Loop Intervention

Recording and manipulating neuronal ensemble activity is a key requirement in advanced neuromodulatory and behavior studies. Devices capable of both recording and manipulating neuronal activity brain-computer interfaces (BCIs) should ideally operate un-tethered and allow chronic longitudinal manipulations in the freely moving animal. In this study, we designed a new intracortical BCI feasible of telemetric recording and stimulating local gray and white matter of visual neural circuit after irradiation exposure. To increase the translational reliance, we put forward a Göttingen minipig model. The animal was stereotactically irradiated at the level of the visual cortex upon defining the target by a fused cerebral MRI and CT scan. A fully implantable neural telemetry system consisting of a 64 channel intracortical multielectrode array, a telemetry capsule, and an inductive rechargeable battery was then implanted into the visual cortex to record and manipulate local field potentials, and multi-unit activity. We achieved a 3-month stability of the functionality of the un-tethered BCI in terms of telemetric radio-communication, inductive battery charging, and device biocompatibility for 3 months. Finally, we could reliably record the local signature of sub- and suprathreshold neuronal activity in the visual cortex with high bandwidth without complications. The ability to wireless induction charging combined with the entirely implantable design, the rather high recording bandwidth, and the ability to record and stimulate simultaneously put forward a wireless BCI capable of long-term un-tethered real-time communication for causal preclinical circuit-based closed-loop interventions.

Decoding and interpreting cortical signals with a compact convolutional neural network

OBJECTIVE

Brain-computer interfaces (BCIs) decode information from neural activity and send it to external devices. The use of Deep Learning approaches for decoding allows for automatic feature engineering within the specific decoding task. Physiologically plausible interpretation of the network parameters ensures the robustness of the learned decision rules and opens the exciting opportunity for automatic knowledge discovery.

APPROACH

We describe a compact convolutional network-based architecture for adaptive decoding of electrocorticographic (ECoG) data into finger kinematics. We also propose a novel theoretically justified approach to interpreting the spatial and temporal weights in the architectures that combine adaptation in both space and time. The obtained spatial and frequency patterns characterizing the neuronal populations pivotal to the specific decoding task can then be interpreted by fitting appropriate spatial and dynamical models.

MAIN RESULTS

We first tested our solution using realistic Monte-Carlo simulations. Then, when applied to the ECoG data from Berlin BCI competition IV dataset, our architecture performed comparably to the competition winners without requiring explicit feature engineering. Using the proposed approach to the network weights interpretation we could unravel the spatial and the spectral patterns of the neuronal processes underlying the successful decoding of finger kinematics from an ECoG dataset. Finally we have also applied the entire pipeline to the analysis of a 32-channel EEG motor-imagery dataset and observed physiologically plausible patterns specific to the task.

SIGNIFICANCE

We described a compact and interpretable CNN architecture derived from the basic principles and encompassing the knowledge in the field of neural electrophysiology. For the first time in the context of such multibranch architectures with factorized spatial and temporal processing we presented theoretically justified weights interpretation rules. We verified our recipes using simulations and real data and demonstrated that the proposed solution offers a good decoder and a tool for investigating motor control neural mechanisms.