Brain computer interfaces, a review

Olfactory stimulation in newborns: Regional differences in cerebral oxygenation

BACKGROUND

The sense of smell is fully developed in newborns and plays an important role in their early development. There are several approaches to studying olfactory processing in the newborn brain, including EEG, fMRI, and near-infrared spectroscopy (NIRS). Understanding the processing of olfactory stimuli in the newborn brain is of fundamental importance for the development of supportive therapeutic odorant delivery, e.g. for weaning by gavage, and for adapting it to the developing brain. This study aimed to investigate the effect of different odors (milk, farnesol odor, and water as a control) on changes in brain activation in newborns in two different brain regions.

METHODS

Newborns older than 72 h and below an age of seven days were divided into two groups with different optode positioning strategies of NIRS, group I parietal and group II frontal. Olfactory stimulation was administered using milk, farnesol (floral odor), and water as a control.

RESULTS

A total of 26 newborns participated in the study. In the final analysis, 19 children were included. Allthough the optode positioning does not differ significantly, in group I, farnesol stimulation resulted in a significant increase in oxygenated hemoglobin compared to the control, while milk odor showed a decreased amplitude, particularly in the more parietal optode position. In group II, a significant difference was observed between the milk odor and the control, in the frontal areas.

CONCLUSIONS

This study revealed significant changes in hemoglobin oxygenation, indicating neuronal activation following different olfactory stimulation in both optode positionings. Whereas milk had more impact in frontal areas, the floral odor caused an effect in parietal areas.

Decoding lower-limb kinematic parameters during pedaling tasks using deep learning approaches and EEG

Stroke is a neurological condition that usually results in the loss of voluntary control of body movements, making it difficult for individuals to perform activities of daily living (ADLs). Brain-computer interfaces (BCIs) integrated into robotic systems, such as motorized mini exercise bikes (MMEBs), have been demonstrated to be suitable for restoring gait-related functions. However, kinematic estimation of continuous motion in BCI systems based on electroencephalography (EEG) remains a challenge for the scientific community. This study proposes a comparative analysis to evaluate two artificial neural network (ANN)-based decoders to estimate three lower-limb kinematic parameters: x- and y-axis position of the ankle and knee joint angle during pedaling tasks. Long short-term memory (LSTM) was used as a recurrent neural network (RNN), which reached Pearson correlation coefficient (PCC) scores close to 0.58 by reconstructing kinematic parameters from the EEG features on the delta band using a time window of 250 ms. These estimates were evaluated through kinematic variance analysis, where our proposed algorithm showed promising results for identifying pedaling and rest periods, which could increase the usability of classification tasks. Additionally, negative linear correlations were found between pedaling speed and decoder performance, thereby indicating that kinematic parameters between slower speeds may be easier to estimate. The results allow concluding that the use of deep learning (DL)-based methods is feasible for the estimation of lower-limb kinematic parameters during pedaling tasks using EEG signals. This study opens new possibilities for implementing controllers most robust for MMEBs and BCIs based on continuous decoding, which may allow for maximizing the degrees of freedom and personalized rehabilitation.

Decoding motor imagery loaded on steady-state somatosensory evoked potential based on complex task-related component analysis

BACKGROUND AND OBJECTIVE

Motor Imagery (MI) recognition is one of the most critical decoding problems in brain- computer interface field. Combined with the steady-state somatosensory evoked potential (MI-SSSEP), this new paradigm can achieve higher recognition accuracy than the traditional MI paradigm. Typical algorithms do not fully consider the characteristics of MI-SSSEP signals. Developing an algorithm that fully captures the paradigm's characteristics to reduce false triggering rate is the new step in improving performance.

METHODS

The idea to use complex signal task-related component analysis (cTRCA) algorithm for spatial filtering processing has been proposed in this paper according to the features of SSSEP signal. In this research, it's proved from the analysis of simulation signals that task-related component analysis (TRCA) as typical method is affected when the response between stimuli has reduced correlation and the proposed algorithm can effectively overcome this problem. The experimental data under the MI-SSSEP paradigm have been used to identify right-handed target tasks and three unique interference tasks are used to test the false triggering rate. cTRCA demonstrates superior performance as confirmed by the Wilcoxon signed-rank test.

RESULTS

The recognition algorithm of cTRCA combined with mutual information-based best individual feature (MIBIF) and minimum distance to mean (MDM) can obtain AUC value up to 0.89, which is much higher than traditional algorithm common spatial pattern (CSP) combined with support vector machine (SVM) (the average AUC value is 0.77, p < 0.05). Compared to CSP+SVM, this algorithm model reduced the false triggering rate from 38.69 % to 20.74 % (p < 0.001).

CONCLUSIONS

The research prove that TRCA is influenced by MI-SSSEP signals. The results further prove that the motor imagery task in the new paradigm MI-SSSEP causes the phase change in evoked potential. and the cTRCA algorithm based on such phase change is more suitable for this hybrid paradigm and more conducive to decoding the motor imagery task and reducing false triggering rate.

Using data from cue presentations results in grossly overestimating semantic BCI performance

Neuroimaging studies have reported the possibility of semantic neural decoding to identify specific semantic concepts from neural activity. This offers promise for brain-computer interfaces (BCIs) for communication. However, translating these findings into a BCI paradigm has proven challenging. Existing EEG-based semantic decoding studies often rely on neural activity recorded when a cue is present, raising concerns about decoding reliability. To address this, we investigate the effects of cue presentation on EEG-based semantic decoding. In an experiment with a clear separation between cue presentation and mental task periods, we attempt to differentiate between semantic categories of animals and tools in four mental tasks. By using state-of-the-art decoding analyses, we demonstrate significant mean classification accuracies up to 71.3% during cue presentation but not during mental tasks, even with adapted analyses from previous studies. These findings highlight a potential issue when using neural activity recorded during cue presentation periods for semantic decoding. Additionally, our results show that semantic decoding without external cues may be more challenging than current state-of-the-art research suggests. By bringing attention to these issues, we aim to stimulate discussion and drive advancements in the field toward more effective semantic BCI applications.

Gamma oscillation optimally predicts finger movements

Our fingers are the most dexterous and complicated parts of our body and play a significant role in our daily activities. Non-invasive techniques, such as Electroencephalography (EEG) and Electromyography (EMG) can be used to collect neural and muscular signals related to finger movements. In this study, we combined an 8-channel EMG and a 31-channel EEG while the human subject moved one of the five fingers on the right hand. To identify the best EEG frequency features that encode distinct finger movements, we systematically examined the decoding accuracies of the slow-cortical potentials and three types of sensorimotor rhythms, namely the Mu, beta, and gamma oscillations. For both EMG and EEG, we came up with a simple and unified root mean square or power approach that avoided the complex signal features used by previous studies. The signal features were then fed into a feedforward artificial-neural-network (ANN) classifier. We found that the low-gamma oscillation provided the best decoding performance over the other frequency bands, ranging from 65.0% to 89.0%, which was comparable to the EMG performance. Combining EMG and low gamma into a single ANN can further improve the outcome for subjects who had showed suboptimal performances with EMG or EEG alone. This study provided a simple and efficient algorithm for prosthetics that assist patients with sensorimotor impairments.

A temporal-spectral fusion transformer with subject-specific adapter for enhancing RSVP-BCI decoding

The Rapid Serial Visual Presentation (RSVP)-based Brain-Computer Interface (BCI) is an efficient technology for target retrieval using electroencephalography (EEG) signals. The performance improvement of traditional decoding methods relies on a substantial amount of training data from new test subjects, which increases preparation time for BCI systems. Several studies introduce data from existing subjects to reduce the dependence of performance improvement on data from new subjects, but their optimization strategy based on adversarial learning with extensive data increases training time during the preparation procedure. Moreover, most previous methods only focus on the single-view information of EEG signals, but ignore the information from other views which may further improve performance. To enhance decoding performance while reducing preparation time, we propose a Temporal-Spectral fusion transformer with Subject-specific Adapter (TSformer-SA). Specifically, a cross-view interaction module is proposed to facilitate information transfer and extract common representations across two-view features extracted from EEG temporal signals and spectrogram images. Then, an attention-based fusion module fuses the features of two views to obtain comprehensive discriminative features for classification. Furthermore, a multi-view consistency loss is proposed to maximize the feature similarity between two views of the same EEG signal. Finally, we propose a subject-specific adapter to rapidly transfer the knowledge of the model trained on data from existing subjects to decode data from new subjects. Experimental results show that TSformer-SA significantly outperforms comparison methods and achieves outstanding performance with limited training data from new subjects. This facilitates efficient decoding and rapid deployment of BCI systems in practical use.

IMH-Net: a convolutional neural network for end-to-end EEG motor imagery classification

As the main component of Brain-computer interface (BCI) technology, the classification algorithm based on EEG has developed rapidly. The previous algorithms were often based on subject-dependent settings, resulting in BCI needing to be calibrated for new users. In this work, we propose IMH-Net, an end-to-end subject-independent model. The model first uses Inception blocks extracts the frequency domain features of the data, then further compresses the feature vectors to extract the spatial domain features, and finally learns the global information and classification through Multi-Head Attention mechanism. On the OpenBMI dataset, IMH-Net obtained 73.90 ± 13.10% accuracy and 73.09 ± 14.99% F1-score in subject-independent manner, which improved the accuracy by 1.96% compared with the comparison model. On the BCI competition IV dataset 2a, this model also achieved the highest accuracy and F1-score in subject-dependent manner. The IMH-Net model we proposed can improve the accuracy of subject-independent Motor Imagery (MI), and the robustness of the algorithm is high, which has strong practical value in the field of BCI.

Adversarial artifact detection in EEG-based brain-computer interfaces

Objective. machine learning has achieved significant success in electroencephalogram (EEG) based brain-computer interfaces (BCIs), with most existing research focusing on improving the decoding accuracy. However, recent studies have shown that EEG-based BCIs are vulnerable to adversarial attacks, where small perturbations added to the input can cause misclassification. Detecting adversarial examples is crucial for both understanding this phenomenon and developing effective defense strategies.Approach. this paper, for the first time, explores adversarial detection in EEG-based BCIs. We extend several popular adversarial detection approaches from computer vision to BCIs. Two new Mahalanobis distance based adversarial detection approaches, and three cosine distance based adversarial detection approaches, are also proposed, which showed promising performance in detecting three kinds of white-box attacks.Main results. we evaluated the performance of eight adversarial detection approaches on three EEG datasets, three neural networks, and four types of adversarial attacks. Our approach achieved an area under the curve score of up to 99.99% in detecting white-box attacks. Additionally, we assessed the transferability of different adversarial detectors to unknown attacks.Significance. through extensive experiments, we found that white-box attacks may be easily detected, and differences exist in the distributions of different types of adversarial examples. Our work should facilitate understanding the vulnerability of existing BCI models and developing more secure BCIs in the future.

Compact convolutional transformer for subject-independent motor imagery EEG-based BCIs

Motor imagery electroencephalography (EEG) analysis is crucial for the development of effective brain-computer interfaces (BCIs), yet it presents considerable challenges due to the complexity of the data and inter-subject variability. This paper introduces EEGCCT, an application of compact convolutional transformers designed specifically to improve the analysis of motor imagery tasks in EEG. Unlike traditional approaches, EEGCCT model significantly enhances generalization from limited data, effectively addressing a common limitation in EEG datasets. We validate and test our models using the open-source BCI Competition IV datasets 2a and 2b, employing a Leave-One-Subject-Out (LOSO) strategy to ensure subject-independent performance. Our findings demonstrate that EEGCCT not only outperforms conventional models like EEGNet in standard evaluations but also achieves better performance compared to other advanced models such as Conformer, Hybrid s-CViT, and Hybrid t-CViT, while utilizing fewer parameters and achieving an accuracy of 70.12%. Additionally, the paper presents a comprehensive ablation study that includes targeted data augmentation, hyperparameter optimization, and architectural improvements.

DO NOT LOSE SLEEP OVER IT: IMPLANTED BRAIN-COMPUTER INTERFACE FUNCTIONALITY DURING NIGHTTIME IN LATE-STAGE AMYOTROPHIC LATERAL SCLEROSIS

Background and objectives

Brain-computer interfaces (BCIs) hold promise as augmentative and alternative communication technology for people with severe motor and speech impairment (locked-in syndrome) due to neural disease or injury. Although such BCIs should be available 24/7, to enable communication at all times, feasibility of nocturnal BCI use has not been investigated. Here, we addressed this question using data from an individual with amyotrophic lateral sclerosis (ALS) who was implanted with an electrocorticography-based BCI that enabled the generation of click-commands for spelling words and call-caregiver signals.

Methods

We investigated nocturnal dynamics of neural signal features used for BCI control, namely low (LFB: 10-30Hz) and high frequency band power (HFB: 65-95Hz). Additionally, we assessed the nocturnal performance of a BCI decoder that was trained on daytime data by quantifying the number of unintentional BCI activations at night. Finally, we developed and implemented a nightmode decoder that allowed the participant to call a caregiver at night, and assessed its performance.

Results

Power and variance in HFB and LFB were significantly higher at night than during the day in the majority of the nights, with HFB variance being higher in 88% of nights. Daytime decoders caused 245 unintended selection-clicks and 13 unintended caregiver-calls per hour when applied to night data. The developed nightmode decoder functioned error-free in 79% of nights over a period of ±1.5 years, allowing the user to reliably call the caregiver, with unintended activations occurring only once every 12 nights.

Discussion

Reliable nighttime use of a BCI requires decoders that are adjusted to sleep-related signal changes. This demonstration of a reliable BCI nightmode and its long-term use by an individual with advanced ALS underscores the importance of 24/7 BCI reliability.

Trial registration

This trial is registered in clinicaltrials.gov under number NCT02224469 (https://clinicaltrials.gov/study/NCT02224469?term=NCT02224469&rank=1). Date of submission to registry: August 21, 2014. Enrollment of first participant: September 7, 2015.

Support matrix machine: A review

Support vector machine (SVM) is one of the most studied paradigms in the realm of machine learning for classification and regression problems. It relies on vectorized input data. However, a significant portion of the real-world data exists in matrix format, which is given as input to SVM by reshaping the matrices into vectors. The process of reshaping disrupts the spatial correlations inherent in the matrix data. Also, converting matrices into vectors results in input data with a high dimensionality, which introduces significant computational complexity. To overcome these issues in classifying matrix input data, support matrix machine (SMM) is proposed. It represents one of the emerging methodologies tailored for handling matrix input data. SMM preserves the structural information of the matrix data by using the spectral elastic net property which is a combination of the nuclear norm and Frobenius norm. This article provides the first in-depth analysis of the development of the SMM model, which can be used as a thorough summary by both novices and experts. We discuss numerous SMM variants, such as robust, sparse, class-imbalance, and multi-class classification models. We also analyze the applications of the SMM and conclude the article by outlining potential future research avenues and possibilities that may motivate researchers to advance the SMM algorithm.

Filter banks guided correlational convolutional neural network for SSVEPs based BCI classification

Objective.In the field of steady-state visual evoked potential brain computer interfaces (SSVEP-BCIs) research, convolutional neural networks (CNNs) have gradually been proved to be an effective method. Whereas, majority works apply the frequency domain characteristics in long time window to train the network, thus lead to insufficient performance of those networks in short time window. Furthermore, only the frequency domain information for classification lacks of other task-related information.Approach.To address these issues, we propose a time-frequency domain generalized filter-bank convolutional neural network (FBCNN-G) to improve the SSVEP-BCIs classification performance. The network integrates multiple frequency information of electroencephalogram (EEG) with template and predefined prior of sine-cosine signals to perform feature extraction, which contains correlation analyses in both template and signal aspects. Then the classification is performed at the end of the network. In addition, the method proposes the use of filter banks divided into specific frequency bands as pre-filters in the network to fully consider the fundamental and harmonic frequency characteristics of the signal.Main results.The proposed FBCNN-G model is compared with other methods on the public dataset Benchmark. The results manifest that this model has higher accuracy of character recognition accuracy and information transfer rates in several time windows. Particularly, in the 0.2 s time window, the mean accuracy of the proposed method reaches62.02%±5.12%, indicating its superior performance.Significance.The proposed FBCNN-G model is critical for the exploitation of SSVEP-BCIs character recognition models.

Cross-Channel Specific-Mutual Feature Transfer Learning for Motor Imagery EEG Signals Decoding

In recent years, with the rapid development of deep learning, various deep learning frameworks have been widely used in brain-computer interface (BCI) research for decoding motor imagery (MI) electroencephalogram (EEG) signals to understand brain activity accurately. The electrodes, however, record the mixed activities of neurons. If different features are directly embedded in the same feature space, the specific and mutual features of different neuron regions are not considered, which will reduce the expression ability of the feature itself. We propose a cross-channel specific-mutual feature transfer learning (CCSM-FT) network model to solve this problem. The multibranch network extracts the specific and mutual features of brain's multiregion signals. Effective training tricks are used to maximize the distinction between the two kinds of features. Suitable training tricks can also improve the effectiveness of the algorithm compared with novel models. Finally, we transfer two kinds of features to explore the potential of mutual and specific features to enhance the expressive power of the feature and use the auxiliary set to improve identification performance. The experimental results show that the network has a better classification effect in the BCI Competition IV-2a and the HGD datasets.

Brain-Computer Interface for Patients with Spinal Cord Injury: A Bibliometric Study

BACKGROUND

Spinal cord injury (SCI) is a debilitating condition with profound implications on patients' quality of life. Recent advancements in brain-computer interface (BCI) technology have provided novel opportunities for individuals with paralysis due to SCI. Consequently, research on the application of BCI for treating SCI has received increasing attention from scholars worldwide. However, there is a lack of rigorous bibliometric studies on the evolution and trends in this field. Hence, the present study aimed to use bibliometric methods to investigate the current status and emerging trends in the field of applying BCI for treating SCI and thus identify novel therapeutic options for SCI.

METHODS

We conducted a comprehensive review of the relevant literature on BCI applications for treating SCI published between 2005 and 2024 by using the Web of Science Core Collection database. To facilitate visualization and quantitative analysis of the published literature, we used VOSviewer and CiteSpace software tools. These tools enabled the assessment of co-authorships, co-occurrences, citations, and co-citations in the selected literature, thereby providing an overview of the current trends and predictive insights into the field.

RESULTS

The literature search yielded 714 publications from the Web of Science Core Collection database. The findings indicated a significant upward trend in the number of publications, yielding a total of 24,804 citations, with an average citation rate of 34.74 per publication and an H-index of 75. Research contributions were identified from 54 countries/regions, and the United States, China, and Germany emerged as the predominant contributors. A total of 1114 research institutions contributed to the retrieved literature, with Harvard Medical School, Brown University, and Northwestern University producing the highest number of publications. The published literature was predominantly distributed across 258 academic journals, and the Journal of Neural Engineering was the most frequently utilized publication source. Hochberg, Leigh, Henderson, Jaimie, and Collinger were the prominent authors in this field.

CONCLUSIONS

In recent years, there has been a steep increase in research on the use of BCI for treating SCI. Existing research focuses on the application of BCI for improving rehabilitation and quality of life of patients with SCI. Interdisciplinary collaboration is the current trend in this field.

Case report: Novel use of clinical brain-computer interfaces in recreation programming for an autistic adolescent with co-occurring attention deficit hyperactivity disorder

Background

In recent years, several autistic children and youth have shown interest in Holland Bloorview Kids Rehabilitation Hospital's clinical brain computer interface (BCI) program. Existing literature about BCI use among autistic individuals has focused solely on cognitive skill development and remediation of challenging behaviors. To date, the benefits of recreational BCI programming with autistic children and youth have not been documented.

Purpose

This case report summarizes the experiences of an autistic male adolescent with co-occurring attention deficit hyperactivity disorder using a BCI for recreation and considers possible benefits with this novel user population.

Methods

A single retrospective chart review was completed with parental guardian's consent.

Findings

The participant demonstrated enjoyment in BCI sessions and requested continued opportunities to engage in BCI programming. This enjoyment correlated with improved Canadian Occupational Performance Measure (COPM) scores in BCI programming, outperforming scores from other recreational programs. Additionally, clinicians observed changes in social communication efforts and self-advocacy in this first autistic participant.

Conclusion

The use of brain computer interfaces in recreational programming provides a novel opportunity for engagement for autistic children and youth that may also support skill development.

A multistrategy differential evolution algorithm combined with Latin hypercube sampling applied to a brain-computer interface to improve the effect of node displacement

Injection molding is a common plastic processing technique that allows melted plastic to be injected into a mold through pressure to form differently shaped plastic parts. In injection molding, in-mold electronics (IME) can include various circuit components, such as sensors, amplifiers, and filters. These components can be injected into the mold to form a whole within the melted plastic and can therefore be very easily integrated into the molded part. The brain-computer interface (BCI) is a direct connection pathway between a human or animal brain and an external device. Through BCIs, individuals can use their own brain signals to control these components, enabling more natural and intuitive interactions. In addition, brain-computer interfaces can also be used to assist in medical treatments, such as controlling prosthetic limbs or helping paralyzed patients regain mobility. Brain-computer interfaces can be realized in two ways: invasively and noninvasively, and in this paper, we adopt a noninvasive approach. First, a helmet model is designed according to head shape, and second, a printed circuit film is made to receive EEG signals and an IME injection mold for the helmet plastic parts. In the electronic film, conductive ink is printed to connect each component. However, improper parameterization during the injection molding process can lead to node displacements and residual stress changes in the molded part, which can damage the circuits in the electronic film and affect its performance. Therefore, in this paper, the use of the BCI molding process to ensure that the node displacement reaches the optimal value is studied. Second, the multistrategy differential evolutionary algorithm is used to optimize the injection molding parameters in the process of brain-computer interface formation. The relationship between the injection molding parameters and the actual target value is investigated through Latin hypercubic sampling, and the optimized parameters are compared with the target parameters to obtain the optimal parameter combination. Under the optimal parameters, the node displacement can be optimized from 0.585 to 0.027 mm, and the optimization rate can reach 95.38%. Ultimately, by detecting whether the voltage difference between the output inputs is within the permissible range, the reliability of the brain-computer interface after node displacement optimization can be evaluated.

Brain Emotion Perception Inspired EEG Emotion Recognition With Deep Reinforcement Learning

Inspired by the well-known Papez circuit theory and neuroscience knowledge of reinforcement learning, a double dueling deep Q network (DQN) is built incorporating the electroencephalogram (EEG) signals of the frontal lobe as prior information, which is named frontal lobe double dueling DQN (FLD3QN). The framework of FLD3QN is constructed in accord with the brain emotion mechanism which takes the frontal lobe and the thalamus as the core, in which the part of the Papez circuit is simulated by the bifrontal lobe residual convolution neural network (BiFRCNN). Moreover, a step penalty factor is designed to constrain the number of mistakes of the agent. The ablation studies results on the public EEG emotion dataset DEAP verified the important roles of the frontal lobe and the Papez circuit in modeling the procedure of learning rewards during the perception of emotions, with a great increase in the average accuracies by 25.24% and 23.31% in valence and arousal dimensions.

Application of artificial hibernation technology in acute brain injury

Controlling intracranial pressure, nerve cell regeneration, and microenvironment regulation are the key issues in reducing mortality and disability in acute brain injury. There is currently a lack of effective treatment methods. Hibernation has the characteristics of low temperature, low metabolism, and hibernation rhythm, as well as protective effects on the nervous, cardiovascular, and motor systems. Artificial hibernation technology is a new technology that can effectively treat acute brain injury by altering the body's metabolism, lowering the body's core temperature, and allowing the body to enter a state similar to hibernation. This review introduces artificial hibernation technology, including mild hypothermia treatment technology, central nervous system regulation technology, and artificial hibernation-inducer technology. Upon summarizing the relevant research on artificial hibernation technology in acute brain injury, the research results show that artificial hibernation technology has neuroprotective, anti-inflammatory, and oxidative stress-resistance effects, indicating that it has therapeutic significance in acute brain injury. Furthermore, artificial hibernation technology can alleviate the damage of ischemic stroke, traumatic brain injury, cerebral hemorrhage, cerebral infarction, and other diseases, providing new strategies for treating acute brain injury. However, artificial hibernation technology is currently in its infancy and has some complications, such as electrolyte imbalance and coagulation disorders, which limit its use. Further research is needed for its clinical application.

Robotics in Physical Rehabilitation: Systematic Review

As the global prevalence of motor disabilities continues to rise, there is a pressing need for advanced solutions in physical rehabilitation. This systematic review examines the progress and challenges of implementing robotic technologies in the motor rehabilitation of patients with physical disabilities. The integration of robotic technologies such as exoskeletons, assistive training devices, and brain-computer interface systems holds significant promise for enhancing functional recovery and patient autonomy. The review synthesizes findings from the most important studies, focusing on the clinical effectiveness of robotic interventions in comparison to traditional rehabilitation methods. The analysis reveals that robotic therapies can significantly improve motor function, strength, co-ordination, and dexterity. Robotic systems also support neuroplasticity, enabling patients to relearn lost motor skills through precise, controlled, and repetitive exercises. However, the adoption of these technologies is hindered by high costs, the need for specialized training, and limited accessibility. Key insights from the review highlight the necessity of personalizing robotic therapies to meet individual patient needs, alongside addressing technical, economic, social, and cultural barriers. The review also underscores the importance of continued research to optimize these technologies and develop effective implementation strategies. By overcoming these challenges, robotic technologies can revolutionize motor rehabilitation, improving quality of life and social integration for individuals with motor disabilities.

Application of hybrid SSVEP + P300 brain computer interface to control avatar movement in mobile virtual reality gaming environment

INTRODUCTION

This research evaluated the feasibility of a hybrid SSVEP + P300 brain computer interface (BCI) for controlling the movement of an avatar in a virtual reality (VR) gaming environment (VR + BCI). Existing VR + BCI gaming environments have limitations, such as visual fatigue, a lower communication rate, minimum accuracy, and poor system comfort. Hence, there is a need for an optimized hybrid BCI system that can simultaneously evoke the strongest P300 and SSVEP potentials in the cortex.

METHODS

A BCI headset was coupled with a VR headset to generate a VR + BCI environment. The author developed a VR game in which the avatar's movement is controlled using the user's cortical responses with the help of a BCI headset. Specifically designed visual stimuli were used in the proposed system to elicit the strongest possible responses from the user's brain. The proposed system also includes an auditory feedback mechanism to facilitate precise avatar movement.

RESULTS AND CONCLUSIONS

Conventional P300 BCI and SSVEP BCI were also used to control the movements of the avatar, and their performance metrics were compared to those of the proposed system. The results demonstrated that the hybrid SSVEP + P300 BCI system was superior to the other systems for controlling avatar movement.

Brain-to-brain interface technology: A brief history, current state, and future goals

A brain-to-brain interface (BBI), defined as a combination of neuroimaging and neurostimulation methods to extract and deliver information between brains directly without the need for the peripheral nervous system, is a budding communication technique. A BBI system is made up of two parts known as the brain-computer interface part, which reads a sender's brain activity and digitalizes it, and the computer-brain interface part, which writes the delivered brain activity to a receiving brain. As with other technologies, BBI systems have gone through an evolutionary process since they first appeared. The BBI systems have been employed for numerous purposes, including rehabilitation for post-stroke patients, communicating with patients suffering from amyotrophic lateral sclerosis, locked-in syndrome and speech problems following stroke. Also, it has been proposed that a BBI system could play an important role on future battlefields. This technology was not only employed for communicating between two human brains but also for making a direct communication path among different species through which motor or sensory commands could be sent and received. However, the application of BBI systems has provoked significant challenges to human rights principles due to their ability to access and manipulate human brain information. In this study, we aimed to review the brain-computer interface and computer-brain interface technologies as components of BBI systems, the development of BBI systems, applications of this technology, arising ethical issues and expectations for future use.

The use of happy faces as visual stimuli improves the performance of the hybrid SSVEP+P300 brain computer interface

BACKGROUND

This study illustrates a hybrid brain-computer interface (BCI) in which steady-state visual evoked potentials (SSVEP) and event-related potentials (P300) are evoked simultaneously. The goal of this study was to improve the performance of the current hybrid SSVEP+P300 BCI systems by incorporating a happy face into visual stimuli.

NEW METHOD

In this study, happy and sad faces were added to a visual stimulus to induce stronger cortical signals in a hybrid SSVEP+P300 BCI. Additionally, we developed a paradigm in which SSVEP responses were triggered by non-face stimuli, whereas P300 responses were triggered by face stimuli. We tested four paradigms: happy face paradigm (HF), sad face paradigm (SF), happy face and flicker paradigm (HFF), and sad face and flicker paradigm (SFF).

RESULTS AND CONCLUSIONS

The results demonstrated that the HFF paradigm elicited more robust cortical responses, which resulted in enhanced system accuracy and information transfer rate (ITR). The HFF paradigm has a system communication rate of 25.9 bits per second and an average accuracy of 96.1%. Compared with other paradigms, the HFF paradigm is the best choice for BCI applications because it has the highest ITR and maximum level of comfort.

A review on the performance of brain-computer interface systems used for patients with locked-in and completely locked-in syndrome

Patients with locked-in syndrome (LIS) and complete locked-in syndrome (CLIS) own a fully functional brain restricted within a non-functional body. In order to help LIS patients stay connected with their surroundings, brain-computer interfaces (BCIs) and related technologies have emerged. BCIs translate brain activity into actions that can be performed by external devices enabling LIS patients to communicate, leading to an increase in their quality of life. The past decade has seen the rapid development of BCIs that have the potential to be used for patients with locked-in syndrome, from which a great deal is tested only on healthy subjects and not on actual patients. This study aims to (1) provide the readers with a comprehensive study that contributes to this growing area of research by exploring the performance of BCIs tested specifically on LIS and CLIS patients, (2) give an overview of different modalities and paradigms used in different stages of the locked-in syndrome, and (3) discuss the contributions and limitations of BCIs introduced for the LIS and CLIS patients in the state-of-the-art and lay a groundwork for researchers interested in this field.

Recording Neural Reward Signals in a Naturalistic Operant Task Using Mobile-EEG and Augmented Reality

The electrophysiological response to rewards recorded during laboratory tasks has been well documented, yet little is known about the neural response patterns in a more naturalistic setting. Here, we combined a mobile-EEG system with an augmented reality headset to record event-related brain potentials (ERPs) while participants engaged in a naturalistic operant task to find rewards. Twenty-five participants were asked to navigate toward a west or east goal location marked by floating orbs, and once participants reached the goal location, the orb would then signify a reward (5 cents) or no-reward (0 cents) outcome. Following the outcome, participants returned to a start location marked by floating purple rings, and once standing in the middle, a 3 s counter signaled the next trial, for a total of 200 trials. Consistent with previous research, reward feedback evoked the reward positivity, an ERP component believed to index the sensitivity of the anterior cingulate cortex to reward prediction error signals. The reward positivity peaked ∼230 ms with a maximal at channel FCz (M = -0.695 μV, ±0.23) and was significantly different than zero (p < 0.01). Participants took ∼3.38 s to reach the goal location and exhibited a general lose-shift (68.3% ±3.5) response strategy and posterror slowing. Overall, these novel findings provide support for the idea that combining mobile-EEG with augmented reality technology is a feasible solution to enhance the ecological validity of human electrophysiological studies of goal-directed behavior and a step toward a new era of human cognitive neuroscience research that blurs the line between laboratory and reality.

Electrical and Magnetic Neuromodulation Technologies and Brain-Computer Interfaces: Ethical Considerations for Enhancement of Brain Function in Healthy People - A Systematic Scoping Review

INTRODUCTION

This scoping review aimed to synthesize the fragmented evidence on ethical concerns related to the use of electrical and magnetic neuromodulation technologies, as well as brain-computer interfaces for enhancing brain function in healthy individuals, addressing the gaps in understanding spurred by rapid technological advancements and ongoing ethical debates.

METHODS

The following databases and interfaces were queried: MEDLINE (via PubMed), Web of Science, PhilPapers, and Google Scholar. Additional references were identified via bibliographies of included citations. References included experimental studies, reviews, opinion papers, and letters to editors published in peer-reviewed journals that explored the ethical implications of electrical and magnetic neuromodulation technologies and brain-computer interfaces for enhancement of brain function in healthy adult or pediatric populations.

RESULTS

A total of 23 articles were included in the review, of which the majority explored expert opinions in the form of qualitative studies or surveys as well as reviews. Two studies explored the view of laypersons on the topic. The majority of evidence pointed to ethical concerns relating to a lack of sufficient efficacy and safety data for these new technologies, with the risks of invasive procedures potentially outweighing the benefits. Additionally, concerns about potential socioeconomic consequences were raised that could further exacerbate existing socioeconomic inequalities, as well as the risk of changes to person and environment.

CONCLUSION

This scoping review highlights a critical shortage of ethical research on electrical and magnetic neuromodulation technologies and brain-computer interfaces for enhancement of brain function in healthy individuals, with key concerns regarding the safety, efficacy, and socioeconomic impacts of neuromodulation technologies. It underscores the urgent need for integrating ethical considerations into neuroscientific research to address significant gaps and ensure equitable access and outcomes.

Filter bank temporally local multivariate synchronization index for SSVEP-based BCI

BACKGROUND

Multivariate synchronization index (MSI) has been successfully applied for frequency detection in steady state visual evoked potential (SSVEP) based brain-computer interface (BCI) systems. However, the standard MSI algorithm and its variants cannot simultaneously take full advantage of the time-local structure and the harmonic components in SSVEP signals, which are both crucial for frequency detection performance. To overcome the limitation, we propose a novel filter bank temporally local MSI (FBTMSI) algorithm to further improve SSVEP frequency detection accuracy. The method explicitly utilizes the temporal information of signal for covariance matrix estimation and employs filter bank decomposition to exploits SSVEP-related harmonic components.

RESULTS

We employed the cross-validation strategy on the public Benchmark dataset to optimize the parameters and evaluate the performance of the FBTMSI algorithm. Experimental results show that FBTMSI outperforms the standard MSI, temporally local MSI (TMSI) and filter bank driven MSI (FBMSI) algorithms across multiple experimental settings. In the case of data length of one second, the average accuracy of FBTMSI is 9.85% and 3.15% higher than that of the FBMSI and the TMSI, respectively.

CONCLUSIONS

The promising results demonstrate the effectiveness of the FBTMSI algorithm for frequency recognition and show its potential in SSVEP-based BCI applications.

Materials Strategies to Overcome the Foreign Body Response

The foreign body response (FBR) is an immune-mediated reaction that can occur with most biomaterials and biomedical devices. The FBR initiates a deterioration in the performance of implantable devices, representing a longstanding challenge that consistently hampers their optimal utilization. Over the last decade, significant strides are achieved based on either hydrogel design or surface modifications to mitigate the FBR. This review delves into recent material strategies aimed at mitigating the FBR. Further, the authors look forward to future novel anti-FBR materials from the perspective of clinical translation needs. Such prospective materials hold the potential to attenuate local immune responses, thereby significantly enhancing the overall performance of implantable devices.

Evaluating the performance of the cognitive workload model with subjective endorsement in addition to EEG

The aptitude-oriented exercises from almost all domains impose cognitive load on their operators. Evaluating such load poses several challenges owing to many factors like measurement mode and complexity, nature of the load, overloading conditions, etc. Nevertheless, the physiological measurement of a specific genre of cognitive load and subjective measurement have not been reported along with each other. In this study, the electroencephalography (EEG)-driven machine learning (Support Vector Machine (SVM)) model is sought along with the support of NASA's Task Load Index (NASA-TLX) rating scale for a novel purpose in workload exploration of operators. The Cognitive Load Theory (CLT) was used as the foundation to design the intrinsic stimulus (Spot the Difference task), as most workloads operators are exposed to are notably intrinsic. The SVM-based three-level classification accuracy ranged from 85.4 to 97.4% (p < 0.05), and the NASA-TLX-based three-level classification accuracy ranged from 88.33 to 97.33%. The t-test results show that the neurometric indices contributing to the classification significantly differed (p < 0.05) for every level. The NASA-TLX scale was utilised for validation in its basic form after the validity (Pearson correlation coefficients 0.338 to 0.805 (p < 0.05)) and reliability (Cronbach's α = 0.753) test. This modeling is beneficial to phase out particular-level cognitive exercises from the curriculum during under or overload workload (critical) conditions.

A novel feature extraction method PSS-CSP for binary motor imagery - based brain-computer interfaces

In order to improve the performance of binary motor imagery (MI) - based brain-computer interfaces (BCIs) using electroencephalography (EEG), a novel method (PSS-CSP) is proposed, which combines spectral subtraction with common spatial pattern. Spectral subtraction is an effective denoising method which is initially adopted to process MI-based EEG signals for binary BCIs in this work. On this basis, we proposed a novel feature extraction method called power spectral subtraction-based common spatial pattern (PSS-CSP) , which calculates the differences in power spectrum between binary classes of EEG signals and uses the differences in the feature extraction process. Additionally, support vector machine (SVM) algorithm is used for signal classification. Results show the proposed method (PSS-CSP) outperforms certain existing methods, achieving a classification accuracy of 76.8% on the BCIIV dataset 2b, and 76.25% and 77.38% on the OpenBMI dataset session 1 and session 2, respectively.

Narrow band-pass filtered canonical correlation analysis for frequency identification in SSVEP signals

Steady-state visual evoked potentials (SSVEP) are generated in the parieto-occipital regions, accompanied by background noise and artifacts. A strong pre-processing method is required to reduce this background noise and artifacts. This study proposed a narrow band-pass filtered canonical correlation analysis (NBPFCCA) to recognize frequency components in SSVEP signals. The proposed method is tested on the publicly available 40 stimulus frequencies dataset recorded from 35 subjects and 4 class in-house dataset acquired from 10 subjects. The performance of the proposed NBPFCCA method is compared with the standard canonical correlation analysis (CCA) and the filter bank CCA (FBCCA). The mean frequency detection accuracy of the standard CCA is 86.21% for the benchmark dataset, and it is improved to 95.58% in the proposed method. Results indicate that the proposed method significantly outperforms the standard canonical correlation analysis with an increase of 9.37% and 17% in frequency recognition accuracy of the benchmark and in-house datasets, respectively.

Effect of inverted faces as visual stimuli on the performance of the hybrid SSVEP + P300 brain computer interface

INTRODUCTION

This study proposes a hybrid brain-computer interface (BCI) system that simultaneously evokes steady-state visual evoked potentials (SSVEP) and event-related potentials (P300). The goal of this study was to improve the performance of the current hybrid SSVEP + P300 BCI systems by incorporating inverted faces into visual stimuli.

METHODS

In this study, upright and inverted faces were added to visual stimulus to elicit stronger cortical responses in a hybrid SSVEP + P300 BCI. We also considered triggering the P300 signals with facial stimuli and the SSVEP signals with non-facial stimuli. We have tested four paradigms: the upright face paradigm (UF), the inverted face paradigm (IF), the upright face and flicker paradigm (UFF), and the inverted face and flicker paradigm (IFF).

RESULTS AND CONCLUSIONS

The results showed that the IFF paradigm evoked more robust cortical responses, which led to enhanced system accuracy and ITR. The IFF paradigm had an average accuracy of 96.6% and a system communication rate of 26.45 bits per second. The UFF paradigm is the best candidate for BCI applications among other paradigms because it provides maximum comfort while maintaining a reasonable ITR.

Comprehensive evaluation methods for translating BCI into practical applications: usability, user satisfaction and usage of online BCI systems

Although brain-computer interface (BCI) is considered a revolutionary advancement in human-computer interaction and has achieved significant progress, a considerable gap remains between the current technological capabilities and their practical applications. To promote the translation of BCI into practical applications, the gold standard for online evaluation for classification algorithms of BCI has been proposed in some studies. However, few studies have proposed a more comprehensive evaluation method for the entire online BCI system, and it has not yet received sufficient attention from the BCI research and development community. Therefore, the qualitative leap from analyzing and modeling for offline BCI data to the construction of online BCI systems and optimizing their performance is elaborated, and then user-centred is emphasized, and then the comprehensive evaluation methods for translating BCI into practical applications are detailed and reviewed in the article, including the evaluation of the usability (including effectiveness and efficiency of systems), the evaluation of the user satisfaction (including BCI-related aspects, etc.), and the evaluation of the usage (including the match between the system and user, etc.) of online BCI systems. Finally, the challenges faced in the evaluation of the usability and user satisfaction of online BCI systems, the efficacy of online BCI systems, and the integration of BCI and artificial intelligence (AI) and/or virtual reality (VR) and other technologies to enhance the intelligence and user experience of the system are discussed. It is expected that the evaluation methods for online BCI systems elaborated in this review will promote the translation of BCI into practical applications.

Representation of internal speech by single neurons in human supramarginal gyrus

Speech brain-machine interfaces (BMIs) translate brain signals into words or audio outputs, enabling communication for people having lost their speech abilities due to diseases or injury. While important advances in vocalized, attempted and mimed speech decoding have been achieved, results for internal speech decoding are sparse and have yet to achieve high functionality. Notably, it is still unclear from which brain areas internal speech can be decoded. Here two participants with tetraplegia with implanted microelectrode arrays located in the supramarginal gyrus (SMG) and primary somatosensory cortex (S1) performed internal and vocalized speech of six words and two pseudowords. In both participants, we found significant neural representation of internal and vocalized speech, at the single neuron and population level in the SMG. From recorded population activity in the SMG, the internally spoken and vocalized words were significantly decodable. In an offline analysis, we achieved average decoding accuracies of 55% and 24% for each participant, respectively (chance level 12.5%), and during an online internal speech BMI task, we averaged 79% and 23% accuracy, respectively. Evidence of shared neural representations between internal speech, word reading and vocalized speech processes was found in participant 1. SMG represented words as well as pseudowords, providing evidence for phonetic encoding. Furthermore, our decoder achieved high classification with multiple internal speech strategies (auditory imagination/visual imagination). Activity in S1 was modulated by vocalized but not internal speech in both participants, suggesting no articulator movements of the vocal tract occurred during internal speech production. This work represents a proof-of-concept for a high-performance internal speech BMI.

Advances in conductive hydrogels for neural recording and stimulation

The brain-computer interface (BCI) allows the human or animal brain to directly interact with the external environment through the neural interfaces, thus playing the role of monitoring, protecting, improving/restoring, enhancing, and replacing. Recording electrophysiological information such as brain neural signals is of great importance in health monitoring and disease diagnosis. According to the electrode position, it can be divided into non-implantable, semi-implantable, and implantable. Among them, implantable neural electrodes can obtain the highest-quality electrophysiological information, so they have the most promising application. However, due to the chemo-mechanical mismatch between devices and tissues, the adverse foreign body response and performance loss over time seriously restrict the development and application of implantable neural electrodes. Given the challenges, conductive hydrogel-based neural electrodes have recently attracted much attention, owing to many advantages such as good mechanical match with the native tissues, negligible foreign body response, and minimal signal attenuation. This review mainly focuses on the current development of conductive hydrogels as a biocompatible framework for neural tissue and conductivity-supporting substrates for the transmission of electrical signals of neural tissue to speed up electrical regeneration and their applications in neural sensing and recording as well as stimulation.

Cortical signals analysis to recognize intralimb mobility using modified RNN and various EEG quantities

Electroencephalogram (EEG) signals are critical in interpreting sensorimotor activities for predicting body movements. However, their efficacy in identifying intralimb movements, such as the dorsiflexion and plantar flexion of the foot, remains suboptimal. This study aims to explore whether various EEG signal quantities can effectively recognize intralimb movements to facilitate the development of Brain-Computer Interface (BCI) devices for foot rehabilitation. This research involved twenty-two healthy, right-handed participants. EEG data were collected using 21 electrodes positioned over the motor cortex, while two electromyography (EMG) electrodes recorded the onset of ankle joint movements. The study focused on analyzing slow cortical potential (SCP) and sensorimotor rhythms (SMR) in alpha and beta bands from the EEG. Five key features-fourth-order Autoregressive feature, variance, waveform length, standard deviation, and permutation entropy-were extracted. A modified Recurrent Neural Network (RNN) including Long Short-term Memory (LSTM) and Gated Recurrent Unit (GRU) algorithms was developed for movement recognition. These were compared against conventional machine learning algorithms, including nonlinear Support Vector Machine (SVM) and k Nearest Neighbourhood (kNN) classifiers. The performance of the proposed models was assessed using two data schemes: within-subject and across-subjects. The findings demonstrated that the GRU and LSTM models significantly outperformed traditional machine learning algorithms in recognizing different EEG signal quantities for intralimb movement. The study indicates that deep learning models, particularly GRU and LSTM, hold superior potential over standard machine learning techniques in identifying intralimb movements using EEG signals. Where the accuracies of LSTM for within and across subjects were 98.87 ± 1.80 % and 87.38 ± 0.86 % respectively. Whereas the accuracy of GRU within and across subjects were 99.18 ± 1.28 % and 86.44 ± 0.69 % respectively. This advancement could significantly benefit the development of BCI devices aimed at foot rehabilitation, suggesting a new avenue for enhancing physical therapy outcomes.

A Scoping Review of the Effect of EEG Neurofeedback on Pain Complaints in Adults with Chronic Pain

Background and Aim: Non-pharmacological treatments such as electroencephalogram (EEG) neurofeedback have become more important in multidisciplinary approaches to treat chronic pain. The aim of this scoping review is to identify the literature on the effects of EEG neurofeedback in reducing pain complaints in adult chronic-pain patients and to elaborate on the neurophysiological rationale for using specific frequency bands as targets for EEG neurofeedback. Methods: A pre-registered scoping review was set up and reported following the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) extension for Scoping Reviews (PRISMA-ScR). The data were collected by searching for studies published between 1985 and January 2023 in PubMed, EMBASE, and PsycINFO. Results: Thirty-two studies on various types of chronic pain were included. The intervention was well-tolerated. Approximately half of the studies used a protocol that reinforced alpha or sensorimotor rhythms and suppressed theta or beta activity. However, the underlying neurophysiological rationale behind these specific frequency bands remains unclear. Conclusions: There are indications that neurofeedback in patients with chronic pain probably has short-term analgesic effects; however, the long-term effects are less clear. In order to draw more stable conclusions on the effectiveness of neurofeedback in chronic pain, additional research on the neurophysiological mechanisms of targeted frequency bands is definitely worthwhile. Several recommendations for setting up and evaluating the effect of neurofeedback protocols are suggested.

A comparison of visual and auditory EEG interfaces for robot multi-stage task control

Shared autonomy holds promise for assistive robotics, whereby physically-impaired people can direct robots to perform various tasks for them. However, a robot that is capable of many tasks also introduces many choices for the user, such as which object or location should be the target of interaction. In the context of non-invasive brain-computer interfaces for shared autonomy-most commonly electroencephalography-based-the two most common choices are to provide either auditory or visual stimuli to the user-each with their respective pros and cons. Using the oddball paradigm, we designed comparable auditory and visual interfaces to speak/display the choices to the user, and had users complete a multi-stage robotic manipulation task involving location and object selection. Users displayed differing competencies-and preferences-for the different interfaces, highlighting the importance of considering modalities outside of vision when constructing human-robot interfaces.

Advancements in brain-computer interfaces for the rehabilitation of unilateral spatial neglect: a concise review

This short review examines recent advancements in neurotechnologies within the context of managing unilateral spatial neglect (USN), a common condition following stroke. Despite the success of brain-computer interfaces (BCIs) in restoring motor function, there is a notable absence of effective BCI devices for treating cerebral visual impairments, a prevalent consequence of brain lesions that significantly hinders rehabilitation. This review analyzes current non-invasive BCIs and technological solutions dedicated to cognitive rehabilitation, with a focus on visuo-attentional disorders. We emphasize the need for further research into the use of BCIs for managing cognitive impairments and propose a new potential solution for USN rehabilitation, by combining the clinical subtleties of this syndrome with the technological advancements made in the field of neurotechnologies.

A New Framework Combining Diffusion Models and the Convolution Classifier for Generating Images from EEG Signals

The generation of images from electroencephalography (EEG) signals has become a popular research topic in recent research because it can bridge the gap between brain signals and visual stimuli and has wide application prospects in neuroscience and computer vision. However, due to the high complexity of EEG signals, the reconstruction of visual stimuli through EEG signals continues to pose a challenge. In this work, we propose an EEG-ConDiffusion framework that involves three stages: feature extraction, fine-tuning of the pretrained model, and image generation. In the EEG-ConDiffusion framework, classification features of EEG signals are first obtained through the feature extraction block. Then, the classification features are taken as conditions to fine-tune the stable diffusion model in the image generation block to generate images with corresponding semantics. This framework combines EEG classification and image generation means to enhance the quality of generated images. Our proposed framework was tested on an EEG-based visual classification dataset. The performance of our framework is measured by classification accuracy, 50-way top-k accuracy, and inception score. The results indicate that the proposed EEG-Condiffusion framework can extract effective classification features and generate high-quality images from EEG signals to realize EEG-to-image conversion.

Alignment-Based Adversarial Training (ABAT) for Improving the Robustness and Accuracy of EEG-Based BCIs

Machine learning has achieved great success in electroencephalogram (EEG) based brain-computer interfaces (BCIs). Most existing BCI studies focused on improving the decoding accuracy, with only a few considering the adversarial security. Although many adversarial defense approaches have been proposed in other application domains such as computer vision, previous research showed that their direct extensions to BCIs degrade the classification accuracy on benign samples. This phenomenon greatly affects the applicability of adversarial defense approaches to EEG-based BCIs. To mitigate this problem, we propose alignment-based adversarial training (ABAT), which performs EEG data alignment before adversarial training. Data alignment aligns EEG trials from different domains to reduce their distribution discrepancies, and adversarial training further robustifies the classification boundary. The integration of data alignment and adversarial training can make the trained EEG classifiers simultaneously more accurate and more robust. Experiments on five EEG datasets from two different BCI paradigms (motor imagery classification, and event related potential recognition), three convolutional neural network classifiers (EEGNet, ShallowCNN and DeepCNN) and three different experimental settings (offline within-subject cross-block/-session classification, online cross-session classification, and pre-trained classifiers) demonstrated its effectiveness. It is very intriguing that adversarial attacks, which are usually used to damage BCI systems, can be used in ABAT to simultaneously improve the model accuracy and robustness.

The convergence of naturalistic paradigms and cognitive neuroscience methods to investigate memory and its development

Studies that involve lab-based stimuli (e.g., words, pictures) are fundamental in the memory literature. At the same time, there is growing acknowledgment that memory processes assessed in the lab may not be analogous to how memory operates in the real world. Naturalistic paradigms can bridge this gap and over the decades a growing proportion of memory research has involved more naturalistic events. However, there is significant variation in the types of naturalistic studies used to study memory and its development, each with various advantages and limitations. Further, there are notable gaps in how often different types of naturalistic approaches have been combined with cognitive neuroscience methods (e.g., fMRI, EEG) to elucidate the neural processes and substrates involved in memory encoding and retrieval in the real world. Here we summarize and discuss what we identify as progressively more naturalistic methodologies used in the memory literature (movie, virtual reality, staged-events inside and outside of the lab, photo-taking, and naturally occurring event studies). Our goal is to describe each approach's benefits (e.g., naturalistic quality, feasibility), limitations (e.g., viability of neuroimaging method for event encoding versus event retrieval), and discuss possible future directions with each approach. We focus on child studies, when available, but also highlight past adult studies. Although there is a growing body of child memory research, naturalistic approaches combined with cognitive neuroscience methodologies in this domain remain sparse. Overall, this viewpoint article reviews how we can study memory through the lens of developmental cognitive neuroscience, while utilizing naturalistic and real-world events.

Exploring Aesthetic Perception in Impaired Aging: A Multimodal Brain-Computer Interface Study

In the field of neuroscience, brain-computer interfaces (BCIs) are used to connect the human brain with external devices, providing insights into the neural mechanisms underlying cognitive processes, including aesthetic perception. Non-invasive BCIs, such as EEG and fNIRS, are critical for studying central nervous system activity and understanding how individuals with cognitive deficits process and respond to aesthetic stimuli. This study assessed twenty participants who were divided into control and impaired aging (AI) groups based on MMSE scores. EEG and fNIRS were used to measure their neurophysiological responses to aesthetic stimuli that varied in pleasantness and dynamism. Significant differences were identified between the groups in P300 amplitude and late positive potential (LPP), with controls showing greater reactivity. AI subjects showed an increase in oxyhemoglobin in response to pleasurable stimuli, suggesting hemodynamic compensation. This study highlights the effectiveness of multimodal BCIs in identifying the neural basis of aesthetic appreciation and impaired aging. Despite its limitations, such as sample size and the subjective nature of aesthetic appreciation, this research lays the groundwork for cognitive rehabilitation tailored to aesthetic perception, improving the comprehension of cognitive disorders through integrated BCI methodologies.

A calibration-free c-VEP based BCI employing narrow-band random sequences

Objective.Code-modulated visual evoked potential (c-VEP) based brain-computer interfaces (BCIs) exhibit high encoding efficiency. Nevertheless, the majority of c-VEP based BCIs necessitate an initial training or calibration session, particularly when the number of targets expands, which impedes the practicality. To address this predicament, this study introduces a calibration-free c-VEP based BCI employing narrow-band random sequences.Approach.For the encoding method, a series of random sequences were generated within a specific frequency band. The c-VEP signals were subsequently elicited through the application of on-type grid flashes that were modulated by these sequences. For the calibration-free decoding algorithm, filter-bank canonical correlation analysis (FBCCA) was utilized with the reference templates generated from the original sequences. Thirty-five subjects participated into an online BCI experiment. The performances of c-VEP based BCIs utilizing narrow-band random sequences with frequency bands of 15-25 Hz (NBRS-15) and 8-16 Hz (NBRS-8) were compared with that of a steady-state visual evoked potential (SSVEP) based BCI within a frequency range of 8-15.8 Hz.Main results.The offline analysis results demonstrated a substantial correlation between the c-VEPs and the original narrow-band random sequences. After parameter optimization, the calibration-free system employing the NBRS-15 frequency band achieved an average information transfer rate (ITR) of 78.56 ± 37.03 bits/min, which exhibited no significant difference compared to the performance of the SSVEP based system when utilizing FBCCA. The proposed system achieved an average ITR of 102.1 ± 57.59 bits/min in a simulation of a 1000-target BCI system.Significance.This study introduces a novel calibration-free c-VEP based BCI system employing narrow-band random sequences and shows great potential of the proposed system in achieving a large number of targets and high ITR.

EEG rhythm separation and time-frequency analysis of fast multivariate empirical mode decomposition for motor imagery BCI

Motor imagery electroencephalogram (EEG) is widely employed in brain-computer interface (BCI) systems. As a time-frequency analysis method for nonlinear and non-stationary signals, multivariate empirical mode decomposition (MEMD) and its noise-assisted version (NA-MEMD) has been widely used in the preprocessing step of BCI systems for separating EEG rhythms corresponding to specific brain activities. However, when applied to multichannel EEG signals, MEMD or NA-MEMD often demonstrate low robustness to noise and high computational complexity. To address these issues, we have explored the advantages of our recently proposed fast multivariate empirical mode decomposition (FMEMD) and its noise-assisted version (NA-FMEMD) for analyzing motor imagery data. We emphasize that FMEMD enables a more accurate estimation of EEG frequency information and exhibits a more noise-robust decomposition performance with improved computational efficiency. Comparative analysis with MEMD on simulation data and real-world EEG validates the above assertions. The joint average frequency measure is employed to automatically select intrinsic mode functions that correspond to specific frequency bands. Thus, FMEMD-based classification architecture is proposed. Using FMEMD as a preprocessing algorithm instead of MEMD can improve the classification accuracy by 2.3% on the BCI Competition IV dataset. On the Physiobank Motor/Mental Imagery dataset and BCI Competition IV Dataset 2a, FMEMD-based architecture also attained a comparable performance to complex algorithms. The results indicate that FMEMD proficiently extracts feature information from small benchmark datasets while mitigating dimensionality constraints resulting from computational complexity. Hence, FMEMD or NA-FMEMD can be a powerful time-frequency preprocessing method for BCI.

Applying Common Spatial Pattern and Convolutional Neural Network to Classify Movements via EEG Signals

Developing an electroencephalography (EEG)-based brain-computer interface (BCI) system is crucial to enhancing the control of external prostheses by accurately distinguishing various movements through brain signals. This innovation can provide comfortable circumstances for the populace who have movement disabilities. This study combined the most prospering methods used in BCI systems, including one-versus-rest common spatial pattern (OVR-CSP) and convolutional neural network (CNN), to automatically extract features and classify eight different movements of the shoulder, wrist, and elbow via EEG signals. The number of subjects who participated in the experiment was 10, and their EEG signals were recorded while performing movements at fast and slow speeds. We used preprocessing techniques before transforming EEG signals into another space by OVR-CSP, followed by sending signals into the CNN architecture consisting of four convolutional layers. Moreover, we extracted feature vectors after applying OVR-CSP and considered them as inputs to KNN, SVM, and MLP classifiers. Then, the performance of these classifiers was compared with the CNN method. The results demonstrated that the classification of eight movements using the proposed CNN architecture obtained an average accuracy of 97.65% for slow movements and 96.25% for fast movements in the subject-independent model. This method outperformed other classifiers with a substantial difference; ergo, it can be useful in improving BCI systems for better control of prostheses.

A novel brain-controlled prosthetic hand method integrating AR-SSVEP augmentation, asynchronous control, and machine vision assistance

Background and objective

The brain-computer interface (BCI) system based on steady-state visual evoked potentials (SSVEP) is expected to help disabled patients achieve alternative prosthetic hand assistance. However, the existing study still has some shortcomings in interaction aspects such as stimulus paradigm and control logic. The purpose of this study is to innovate the visual stimulus paradigm and asynchronous decoding/control strategy by integrating augmented reality technology, and propose an asynchronous pattern recognition algorithm, thereby improving the interaction logic and practical application capabilities of the prosthetic hand with the BCI system.

Methods

An asynchronous visual stimulus paradigm based on an augmented reality (AR) interface was proposed in this paper, in which there were 8 control modes, including Grasp, Put down, Pinch, Point, Fist, Palm push, Hold pen, and Initial. According to the attentional orienting characteristics of the paradigm, a novel asynchronous pattern recognition algorithm that combines center extended canonical correlation analysis and support vector machine (Center-ECCA-SVM) was proposed. Then, this study proposed an intelligent BCI system switch based on a deep learning object detection algorithm (YOLOv4) to improve the level of user interaction. Finally, two experiments were designed to test the performance of the brain-controlled prosthetic hand system and its practical performance in real scenarios.

Results

Under the AR paradigm of this study, compared with the liquid crystal display (LCD) paradigm, the average SSVEP spectrum amplitude of multiple subjects increased by 17.41%, and the signal-noise ratio (SNR) increased by 3.52%. The average stimulus pattern recognition accuracy was 96.71 ± 3.91%, which was 2.62% higher than the LCD paradigm. Under the data analysis time of 2s, the Center-ECCA-SVM classifier obtained 94.66 ± 3.87% and 97.40 ± 2.78% asynchronous pattern recognition accuracy under the Normal metric and the Tolerant metric, respectively. And the YOLOv4-tiny model achieves a speed of 25.29fps and a 96.4% confidence in the prosthetic hand in real-time detection. Finally, the brain-controlled prosthetic hand helped the subjects to complete 4 kinds of daily life tasks in the real scene, and the time-consuming were all within an acceptable range, which verified the effectiveness and practicability of the system.

Conclusion

This research is based on improving the user interaction level of the prosthetic hand with the BCI system, and has made improvements in the SSVEP paradigm, asynchronous pattern recognition, interaction, and control logic. Furthermore, it also provides support for BCI areas for alternative prosthetic control, and movement disorder rehabilitation programs.

A scoping review on the use of consumer-grade EEG devices for research

BACKGROUND

Commercial electroencephalography (EEG) devices have become increasingly available over the last decade. These devices have been used in a wide variety of fields ranging from engineering to cognitive neuroscience.

PURPOSE

The aim of this study was to chart peer-review articles that used consumer-grade EEG devices to collect neural data. We provide an overview of the research conducted with these relatively more affordable and user-friendly devices. We also inform future research by exploring the current and potential scope of consumer-grade EEG.

METHODS

We followed a five-stage methodological framework for a scoping review that included a systematic search using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR) guidelines. We searched the following online databases: PsycINFO, MEDLINE, Embase, Web of Science, and IEEE Xplore. We charted study data according to application (BCI, experimental research, validation, signal processing, and clinical) and location of use as indexed by the first author's country.

RESULTS

We identified 916 studies that used data recorded with consumer-grade EEG: 531 were reported in journal articles and 385 in conference papers. Emotiv devices were used most, followed by the NeuroSky MindWave, OpenBCI, interaXon Muse, and MyndPlay Mindband. The most common usage was for brain-computer interfaces, followed by experimental research, signal processing, validation, and clinical purposes.

CONCLUSIONS

Consumer-grade EEG is a useful tool for neuroscientific research and will likely continue to be used well into the future. Our study provides a comprehensive review of their application, as well as future directions for researchers who plan to use these devices.

A low-cost, wireless, 4-channel EEG measurement system used in virtual reality environments

The combination of Virtual Reality (VR) technology and Electroencephalography (EEG) measurements has shown tremendous potential in the fields of psychology and neuroscience research. However, the majority of EEG measurement devices currently available are expensive, bulky, uncomfortable to wear, and difficult to integrate with VR headsets. These limitations have hindered the development of related research fields. This study describes a low-cost (60.07 USD), small-sized, wireless, high-precision, low-power consumption 4-channel EEG measurement system (NeuroVista) for frontal area EEG measurements, which can be used with a VR headset, enabling EEG measurements in VR environments. The system has an input-referred noise of less than 0.9480 μ V r m s , a common mode rejection ratio of over 96 dB, a measurement resolution of less than 0.1 μ V , a bandwidth of 0.5 ∼ 45 Hz, and works at a sampling rate of 250 Hz. It also supports metal dry electrodes and includes a built-in analog bandpass filter, right-leg drive circuit, and built-in digital lowpass filter and notch filter, which can reduce noise during measurement. Researchers can reconstruct the electrode system to measure regions of interest according to their needs.

Towards unlocking motor control in spinal cord injured by applying an online EEG-based framework to decode motor intention, trajectory and error processing

Brain-computer interfaces (BCIs) can translate brain signals directly into commands for external devices. Electroencephalography (EEG)-based BCIs mostly rely on the classification of discrete mental states, leading to unintuitive control. The ERC-funded project "Feel Your Reach" aimed to establish a novel framework based on continuous decoding of hand/arm movement intention, for a more natural and intuitive control. Over the years, we investigated various aspects of natural control, however, the individual components had not yet been integrated. Here, we present a first implementation of the framework in a comprehensive online study, combining (i) goal-directed movement intention, (ii) trajectory decoding, and (iii) error processing in a unique closed-loop control paradigm. Testing involved twelve able-bodied volunteers, performing attempted movements, and one spinal cord injured (SCI) participant. Similar movement-related cortical potentials and error potentials to previous studies were revealed, and the attempted movement trajectories were overall reconstructed. Source analysis confirmed the involvement of sensorimotor and posterior parietal areas for goal-directed movement intention and trajectory decoding. The increased experiment complexity and duration led to a decreased performance than each single BCI. Nevertheless, the study contributes to understanding natural motor control, providing insights for more intuitive strategies for individuals with motor impairments.

A scoping review of gaze and eye tracking-based control methods for assistive robotic arms

Background: Assistive Robotic Arms are designed to assist physically disabled people with daily activities. Existing joysticks and head controls are not applicable for severely disabled people such as people with Locked-in Syndrome. Therefore, eye tracking control is part of ongoing research. The related literature spans many disciplines, creating a heterogeneous field that makes it difficult to gain an overview. Objectives: This work focuses on ARAs that are controlled by gaze and eye movements. By answering the research questions, this paper provides details on the design of the systems, a comparison of input modalities, methods for measuring the performance of these controls, and an outlook on research areas that gained interest in recent years. Methods: This review was conducted as outlined in the PRISMA 2020 Statement. After identifying a wide range of approaches in use the authors decided to use the PRISMA-ScR extension for a scoping review to present the results. The identification process was carried out by screening three databases. After the screening process, a snowball search was conducted. Results: 39 articles and 6 reviews were included in this article. Characteristics related to the system and study design were extracted and presented divided into three groups based on the use of eye tracking. Conclusion: This paper aims to provide an overview for researchers new to the field by offering insight into eye tracking based robot controllers. We have identified open questions that need to be answered in order to provide people with severe motor function loss with systems that are highly useable and accessible.