Comparison of recognition methods for an asynchronous (un-cued) BCI system: an investigation with 40-class SSVEP dataset

Steady-state visual evoked potential (SSVEP)-based brain-computer Interface (BCI) has demonstrated the potential to manage multi-command targets to achieve high-speed communication. Recent studies on multi-class SSVEP-based BCI have focused on synchronous systems, which rely on predefined time and task indicators; thus, these systems that use passive approaches may be less suitable for practical applications. Asynchronous systems recognize the user's intention (whether or not the user is willing to use systems) from brain activity; then, after recognizing the user's willingness, they begin to operate by switching swiftly for real-time control. Consequently, various methodologies have been proposed to capture the user's intention. However, in-depth investigation of recognition methods in asynchronous BCI system is lacking. Thus, in this work, three recognition methods (power spectral density analysis, canonical correlation analysis (CCA), and support vector machine (SVM)) used widely in asynchronous SSVEP BCI systems were explored to compare their performance. Further, we categorized asynchronous systems into two approaches (1-stage and 2-stage) based upon the recognition process's design, and compared their performance. To do so, a 40-class SSVEP dataset collected from 40 subjects was introduced. Finally, we found that the CCA-based method in the 2-stage approach demonstrated statistically significantly higher performance with a sensitivity of 97.62 ± 02.06%, specificity of 76.50 ± 23.50%, and accuracy of 75.59 ± 10.09%. Thus, it is expected that the 2-stage approach together with CCA-based recognition and FB-CCA classification have good potential to be implemented in practical asynchronous SSVEP BCI systems.

Assessment of visual fatigue in SSVEP-based brain-computer interface: a comprehensive study

Fatigue deteriorates the performance of a brain-computer interface (BCI) system; thus, reliable detection of fatigue is the first step to counter this problem. The fatigue evaluated by means of electroencephalographic (EEG) signals has been studied in many research projects, but widely different results have been reported. Moreover, there is scant research when considering the fatigue on steady-state visually evoked potential (SSVEP)-based BCI. Therefore, nowadays, fatigue detection is not a completely solved topic. In the current work, the issues found in the literature that led to the differences in the results are identified and saved by performing a new experiment on an SSVEP-based BCI system. The experiment was long enough to produce fatigue in the users, and different SSVEP stimulation ranges were used. Additionally, the EEG features commonly reported in the literature (EEG rhythms powers, SNR, etc.) were calculated as well as newly proposed features (spectral features and Lempel-Ziv complexity). The analysis was carried out on O1, Oz and O2 channels. This work found a tendency of displacement from high-frequency rhythms to low-frequency ones, and thus, better EEG features should present a similar behaviour. Then, the 'relative power' of EEG rhythms, the rates (θ + α)/β, α/β and θ/β, some spectral features (central and mean frequencies, asymmetry and kurtosis coefficients, etc.) and Lempel-Ziv complexity are proposed as reliable EEG features for fatigue detection. Hence, this set of features may be used to construct a more trustworthy fatigue index.

Considerations for implanting speech brain computer interfaces based on functional magnetic resonance imaging

PURPOSE

Brain-Computer Interfaces (BCIs) have the potential to reinstate lost communication faculties. Results from speech decoding studies indicate that a usable speech BCI based on activity in the sensorimotor cortex (SMC) can be achieved using subdurally implanted electrodes. However, the optimal characteristics for a successful speech implant are largely unknown. We address this topic in a high field blood oxygenation level dependent (BOLD) functional Magnetic Resonance Imaging (fMRI) study, by assessing the decodability of spoken words as a function of hemisphere, gyrus, sulcal depth, and position along the ventral/dorsal-axis. Methods: Twelve subjects conducted a 7T fMRI experiment in which they pronounced 6 different pseudo-words over 6 runs. We divided the SMC by hemisphere, gyrus, sulcal depth, and position along the ventral/dorsal axis. Classification was performed on in these SMC areas using multiclass Support Vector Machine (SVM). Results: Significant classification was possible from the SMC, but no preference for the left or right hemisphere, nor for the precentral or postcentral gyrus for optimal word classification was detected. Classification while using information from the cortical surface was slightly better than when using information from deep in the central sulcus, and was highest within the ventral 50% of SMC. Confusion matrices where highly similar across the entire SMC. An SVM-searchlight analysis revealed significant classification in the superior temporal gyrus in addition to the SMC. Conclusion: The current results support a unilateral implant using surface electrodes, covering the ventral 50% of the SMC. The added value of depth electrodes is unclear. We did not observe evidence for variations in the qualitative nature of information across SMC. The current results need to be confirmed in paralyzed patients performing attempted speech.

Neural signatures of imaginary motivational states: desire for music, movement and social play

The literature has demonstrated the potential for detecting accurate electrical signals that correspond to the will or intention to move, as well as decoding the thoughts of individuals who imagine houses, faces or objects. This investigation examines the presence of precise neural markers of imagined motivational states through the combining of electrophysiological and neuroimaging methods. 20 participants were instructed to vividly imagine the desire to move, listen to music or engage in social activities. Their EEG was recorded from 128 scalp sites and analysed using individual standardized Low-Resolution Brain Electromagnetic Tomographies (LORETAs) in the N400 time window (400-600 ms). The activation of 1056 voxels was examined in relation to the 3 motivational states. The most active dipoles were grouped in eight regions of interest (ROI), including Occipital, Temporal, Fusiform, Premotor, Frontal, OBF/IF, Parietal, and Limbic areas. The statistical analysis revealed that all motivational imaginary states engaged the right hemisphere more than the left hemisphere. Distinct markers were identified for the three motivational states. Specifically, the right temporal area was more relevant for "Social Play", the orbitofrontal/inferior frontal cortex for listening to music, and the left premotor cortex for the "Movement" desire. This outcome is encouraging in terms of the potential use of neural indicators in the realm of brain-computer interface, for interpreting the thoughts and desires of individuals with locked-in syndrome.

Artifact removal and motor imagery classification in EEG using advanced algorithms and modified DNN

This paper presents an advanced approach for EEG artifact removal and motor imagery classification using a combination of Four Class Iterative Filtering and Filter Bank Common Spatial Pattern Algorithm with a Modified Deep Neural Network (DNN) classifier. The research aims to enhance the accuracy and reliability of BCI systems by addressing the challenges posed by EEG artifacts and complex motor imagery tasks. The methodology begins by introducing FCIF, a novel technique for ocular artifact removal, utilizing iterative filtering and filter banks. FCIF's mathematical formulation allows for effective artifact mitigation, thereby improving the quality of EEG data. In tandem, the FC-FBCSP algorithm is introduced, extending the Filter Bank Common Spatial Pattern approach to handle four-class motor imagery classification. The Modified DNN classifier enhances the discriminatory power of the FC-FBCSP features, optimizing the classification process. The paper showcases a comprehensive experimental setup, featuring the utilization of BCI Competition IV Dataset 2a & 2b. Detailed preprocessing steps, including filtering and feature extraction, are presented with mathematical rigor. Results demonstrate the remarkable artifact removal capabilities of FCIF and the classification prowess of FC-FBCSP combined with the Modified DNN classifier. Comparative analysis highlights the superiority of the proposed approach over baseline methods and the method achieves the mean accuracy of 98.575%.

Exploring Aesthetic Perception in Impaired Aging: A Multimodal Brain-Computer Interface Study

In the field of neuroscience, brain-computer interfaces (BCIs) are used to connect the human brain with external devices, providing insights into the neural mechanisms underlying cognitive processes, including aesthetic perception. Non-invasive BCIs, such as EEG and fNIRS, are critical for studying central nervous system activity and understanding how individuals with cognitive deficits process and respond to aesthetic stimuli. This study assessed twenty participants who were divided into control and impaired aging (AI) groups based on MMSE scores. EEG and fNIRS were used to measure their neurophysiological responses to aesthetic stimuli that varied in pleasantness and dynamism. Significant differences were identified between the groups in P300 amplitude and late positive potential (LPP), with controls showing greater reactivity. AI subjects showed an increase in oxyhemoglobin in response to pleasurable stimuli, suggesting hemodynamic compensation. This study highlights the effectiveness of multimodal BCIs in identifying the neural basis of aesthetic appreciation and impaired aging. Despite its limitations, such as sample size and the subjective nature of aesthetic appreciation, this research lays the groundwork for cognitive rehabilitation tailored to aesthetic perception, improving the comprehension of cognitive disorders through integrated BCI methodologies.

Applying the IEEE BRAIN neuroethics framework to intra-cortical brain-computer interfaces

Objective. Brain-computer interfaces (BCIs) are neuroprosthetic devices that allow for direct interaction between brains and machines. These types of neurotechnologies have recently experienced a strong drive in research and development, given, in part, that they promise to restore motor and communication abilities in individuals experiencing severe paralysis. While a rich literature analyzes the ethical, legal, and sociocultural implications (ELSCI) of these novel neurotechnologies, engineers, clinicians and BCI practitioners often do not have enough exposure to these topics.Approach. Here, we present the IEEE Neuroethics Framework, an international, multiyear, iterative initiative aimed at developing a robust, accessible set of considerations for diverse stakeholders.Main results. Using the framework, we provide practical examples of ELSCI considerations for BCI neurotechnologies. We focus on invasive technologies, and in particular, devices that are implanted intra-cortically for medical research applications.Significance. We demonstrate the utility of our framework in exposing a wide range of implications across different intra-cortical BCI technology modalities and conclude with recommendations on how to utilize this knowledge in the development and application of ethical guidelines for BCI neurotechnologies.

Neural interface-based motor neuroprosthesis in post-stroke upper limb neurorehabilitation: An individual patient data meta-analysis

OBJECTIVE

To determine the efficacy of neural interface-, including brain-computer interface (BCI), based neurorehabilitation through conventional and individual patient data (IPD) meta-analysis, and to assess clinical parameters associated with positive response to neural interface-based neurorehabilitation.

DATA SOURCES

PubMed, EMBASE, and Cochrane Library databases up to February 2022 were reviewed.

STUDY SELECTION

Studies using neural interface-controlled physical effectors (FES and/or powered exoskeletons) and reported Fugl-Meyer Assessment-upper extremity (FMA-UE) scores were identified. This meta-analysis was prospectively registered on PROSPERO (#CRD42022312428). PRISMA guidelines were followed.

DATA EXTRACTION

Change in FMA-UE scores were pooled to estimate the mean effect size. Subgroup analyses were performed on clinical parameters and neural interface parameters with both study-level variables and IPD.

DATA SYNTHESIS

Forty-six studies containing 617 patients were included. Twenty-nine studies involving 214 patients reported IPD. FMA-UE score increased by a mean of 5.23 (95% CI: 3.85 to 6.61). Systems that used motor attempt resulted in greater FMA-UE gain than motor imagery, as did training lasting >4 versus ≤4 weeks. On IPD analysis, the mean time-to-improvement above MCID was 12 weeks (95% CI: 7 to not reached). At 6 months, 58% improved above MCID (95% CI: 41 to 70%). Patients with severe impairment (p=0.042) and age >50 years (p=0.0022) correlated with the failure to improve above the MCID on univariate log-rank tests. However, these factors were only borderline significant on multivariate Cox analysis (HR 0.15, p = 0.08 and HR 0.47, p = 0.06, respectively).

CONCLUSION

Neural interface-based motor rehabilitation resulted in significant though modest reductions in post-stroke impairment and should be considered for wider applications in stroke neurorehabilitation.

Multi-scale spatiotemporal attention network for neuron based motor imagery EEG classification

BACKGROUND

In recent times, the expeditious expansion of Brain-Computer Interface (BCI) technology in neuroscience, which relies on electroencephalogram (EEG) signals associated with motor imagery, has yielded outcomes that rival conventional approaches, notably due to the triumph of deep learning. Nevertheless, the task of developing and training a comprehensive network to extract the underlying characteristics of motor imagining EEG data continues to pose challenges.

NEW METHOD

This paper presents a multi-scale spatiotemporal self-attention (SA) network model that relies on an attention mechanism. This model aims to classify motor imagination EEG signals into four classes (left hand, right hand, foot, tongue/rest) by considering the temporal and spatial properties of EEG. It is employed to autonomously allocate greater weights to channels linked to motor activity and lesser weights to channels not related to movement, thus choosing the most suitable channels. Neuron utilises parallel multi-scale Temporal Convolutional Network (TCN) layers to extract feature information in the temporal domain at various scales, effectively eliminating temporal domain noise.

RESULTS

The suggested model achieves accuracies of 79.26%, 85.90%, and 96.96% on the BCI competition datasets IV-2a, IV-2b, and HGD, respectively.

COMPARISON WITH EXISTING METHODS

In terms of single-subject classification accuracy, this strategy demonstrates superior performance compared to existing methods.

CONCLUSION

The results indicate that the proposed strategy exhibits favourable performance, resilience, and transfer learning capabilities.

Individual-finger motor imagery classification: a data-driven approach with Shapley-informed augmentation

Objective. Classifying motor imagery (MI) tasks that involve fine motor control of the individual five fingers presents unique challenges when utilizing electroencephalography (EEG) data. In this paper, we systematically assess the classification of MI functions for the individual five fingers using single-trial time-domain EEG signals. This assessment encompasses both within-subject and cross-subject scenarios, supported by data-driven analysis that provides statistical validation of the neural correlate that could potentially discriminate between the five fingers.Approach. We present Shapley-informed augmentation, an informed approach to enhance within-subject classification accuracy. This method is rooted in insights gained from our data-driven analysis, which revealed inconsistent temporal features encoding the five fingers MI across sessions of the same subject. To evaluate its impact, we compare within-subject classification performance both before and after implementing this augmentation technique.Main results. Both the data-driven approach and the model explainability analysis revealed that the parietal cortex contains neural information that helps discriminate the individual five fingers' MI apart. Shapley-informed augmentation successfully improved classification accuracy in sessions severely affected by inconsistent temporal features. The accuracy for sessions impacted by inconsistency in their temporal features increased by an average of26.3%±6.70, thereby enabling a broader range of subjects to benefit from brain-computer interaction (BCI) applications involving five-fingers MI classification. Conversely, non-impacted sessions experienced only a negligible average accuracy decrease of2.01±5.44%. The average classification accuracy achieved is around 60.0% (within-session), 50.0% (within-subject) and 40.0% (leave-one-subject-out).Significance. This research offers data-driven evidence of neural correlates that could discriminate between the individual five fingers MI and introduces a novel Shapley-informed augmentation method to address temporal variability of features, ultimately contributing to the development of personalized systems.

On decoding of rapid motor imagery in a diverse population using a high-density NIRS device

Introduction

Functional near-infrared spectroscopy (fNIRS) aims to infer cognitive states such as the type of movement imagined by a study participant in a given trial using an optical method that can differentiate between oxygenation states of blood in the brain and thereby indirectly between neuronal activity levels. We present findings from an fNIRS study that aimed to test the applicability of a high-density (>3000 channels) NIRS device for use in short-duration (2 s) left/right hand motor imagery decoding in a diverse, but not explicitly balanced, subject population. A side aim was to assess relationships between data quality, self-reported demographic characteristics, and brain-computer interface (BCI) performance, with no subjects rejected from recruitment or analysis.

Methods

BCI performance was quantified using several published methods, including subject-specific and subject-independent approaches, along with a high-density fNIRS decoder previously validated in a separate study.

Results

We found that decoding of motor imagery on this population proved extremely challenging across all tested methods. Overall accuracy of the best-performing method (the high-density decoder) was 59.1 +/- 6.7% after excluding subjects where almost no optode-scalp contact was made over motor cortex and 54.7 +/- 7.6% when all recorded sessions were included. Deeper investigation revealed that signal quality, hemodynamic responses, and BCI performance were all strongly impacted by the hair phenotypical and demographic factors under investigation, with over half of variance in signal quality explained by demographic factors alone.

Discussion

Our results contribute to the literature reporting on challenges in using current-generation NIRS devices on subjects with long, dense, dark, and less pliable hair types along with the resulting potential for bias. Our findings confirm the need for increased focus on these populations, accurate reporting of data rejection choices across subject intake, curation, and final analysis in general, and signal a need for NIRS optode designs better optimized for the general population to facilitate more robust and inclusive research outcomes.

PMF-CNN: parallel multi-band fusion convolutional neural network for SSVEP-EEG decoding

Steady-state visual evoked potential (SSVEP) is a key technique of electroencephalography (EEG)-based brain-computer interfaces (BCI), which has been widely applied to neurological function assessment and postoperative rehabilitation. However, accurate decoding of the user's intended based on the SSVEP-EEG signals is challenging due to the low signal-to-noise ratio and large individual variability of the signals. To address these issues, we proposed a parallel multi-band fusion convolutional neural network (PMF-CNN). Multi frequency band signals were served as the input of PMF-CNN to fully utilize the time-frequency information of EEG. Three parallel modules, spatial self-attention (SAM), temporal self-attention (TAM), and squeeze-excitation (SEM), were proposed to automatically extract multi-dimensional features from spatial, temporal, and frequency domains, respectively. A novel spatial-temporal-frequency representation were designed to capture the correlation of electrode channels, time intervals, and different sub-harmonics by using SAM, TAM, and SEM, respectively. The three parallel modules operate independently and simultaneously. A four layers CNN classification module was designed to fuse parallel multi-dimensional features and achieve the accurate classification of SSVEP-EEG signals. The PMF-CNN was further interpreted by using brain functional connectivity analysis. The proposed method was validated using two large publicly available datasets. After trained using our proposed dual-stage training pattern, the classification accuracies were 99.37% and 93.96%, respectively, which are superior to the current state-of-the-art SSVEP-EEG classification algorithms. The algorithm exhibits high classification accuracy and good robustness, which has the potential to be applied to postoperative rehabilitation.

A toolbox for decoding BCI commands based on event-related potentials

Commands in brain-computer interface (BCI) applications often rely on the decoding of event-related potentials (ERP). For instance, the P300 potential is frequently used as a marker of attention to an oddball event. Error-related potentials and the N2pc signal are further examples of ERPs used for BCI control. One challenge in decoding brain activity from the electroencephalogram (EEG) is the selection of the most suitable channels and appropriate features for a particular classification approach. Here we introduce a toolbox that enables ERP-based decoding using the full set of channels, while automatically extracting informative components from relevant channels. The strength of our approach is that it handles sequences of stimuli that encode multiple items using binary classification, such as target vs. nontarget events typically used in ERP-based spellers. We demonstrate examples of application scenarios and evaluate the performance of four openly available datasets: a P300-based matrix speller, a P300-based rapid serial visual presentation (RSVP) speller, a binary BCI based on the N2pc, and a dataset capturing error potentials. We show that our approach achieves performances comparable to those in the original papers, with the advantage that only conventional preprocessing is required by the user, while channel weighting and decoding algorithms are internally performed. Thus, we provide a tool to reliably decode ERPs for BCI use with minimal programming requirements.

Investigating critical brain area for EEG-based binocular color fusion and rivalry with EEGNet

Introduction

Binocular color fusion and rivalry are two specific phenomena in binocular vision, which could be used as experimental tools to study how the brain processes conflicting information. There is a lack of objective evaluation indexes to distinguish the fusion or rivalry for dichoptic color.

Methods

This paper introduced EEGNet to construct an EEG-based model for binocular color fusion and rivalry classification. We developed an EEG dataset from 10 subjects.

Results

By dividing the EEG data from five different brain areas to train the corresponding models, experimental results showed that: (1) the brain area represented by the back area had a large difference on EEG signals, the accuracy of model reached the highest of 81.98%, and more channels decreased the model performance; (2) there was a large effect of inter-subject variability, and the EEG-based recognition is still a very challenge across subjects; and (3) the statistics of EEG data are relatively stationary at different time for the same individual, the EEG-based recognition is highly reproducible for an individual.

Discussion

The critical channels for EEG-based binocular color fusion and rivalry could be meaningful for developing the brain computer interfaces (BCIs) based on color-related visual evoked potential (CVEP).

Multi-source domain adaptation based tempo-spatial convolution network for cross-subject EEG classification in RSVP task

Objective.Many subject-dependent methods were proposed for electroencephalogram (EEG) classification in rapid serial visual presentation (RSVP) task, which required a large amount of data from new subject and were time-consuming to calibrate system. Cross-subject classification can realize calibration reduction or zero calibration. However, cross-subject classification in RSVP task is still a challenge.Approach.This study proposed a multi-source domain adaptation based tempo-spatial convolution (MDA-TSC) network for cross-subject RSVP classification. The proposed network consisted of three modules. First, the common feature extraction with multi-scale tempo-spatial convolution was constructed to extract domain-invariant features across all subjects, which could improve generalization of the network. Second, the multi-branch domain-specific feature extraction and alignment was conducted to extract and align domain-specific feature distributions of source and target domains in pairs, which could consider feature distribution differences among source domains. Third, the domain-specific classifier was exploited to optimize the network through loss functions and obtain prediction for the target domain.Main results.The proposed network was evaluated on the benchmark RSVP dataset, and the cross-subject classification results showed that the proposed MDA-TSC network outperformed the reference methods. Moreover, the effectiveness of the MDA-TSC network was verified through both ablation studies and visualization.Significance.The proposed network could effectively improve cross-subject classification performance in RSVP task, and was helpful to reduce system calibration time.

Identifying temporal correlations between natural single-shot videos and EEG signals

Objective.Electroencephalography (EEG) is a widely used technology for recording brain activity in brain-computer interface (BCI) research, where understanding the encoding-decoding relationship between stimuli and neural responses is a fundamental challenge. Recently, there is a growing interest in encoding-decoding natural stimuli in a single-trial setting, as opposed to traditional BCI literature where multi-trial presentations of synthetic stimuli are commonplace. While EEG responses to natural speech have been extensively studied, such stimulus-following EEG responses to natural video footage remain underexplored.Approach.We collect a new EEG dataset with subjects passively viewing a film clip and extract a few video features that have been found to be temporally correlated with EEG signals. However, our analysis reveals that these correlations are mainly driven by shot cuts in the video. To avoid the confounds related to shot cuts, we construct another EEG dataset with natural single-shot videos as stimuli and propose a new set of object-based features.Main results.We demonstrate that previous video features lack robustness in capturing the coupling with EEG signals in the absence of shot cuts, and that the proposed object-based features exhibit significantly higher correlations. Furthermore, we show that the correlations obtained with these proposed features are not dominantly driven by eye movements. Additionally, we quantitatively verify the superiority of the proposed features in a match-mismatch task. Finally, we evaluate to what extent these proposed features explain the variance in coherent stimulus responses across subjects.Significance.This work provides valuable insights into feature design for video-EEG analysis and paves the way for applications such as visual attention decoding.

Competing Visual Cues Revealed by Electroencephalography: Sensitivity to Motion Speed and Direction

Motion speed and direction are two fundamental cues for the mammalian visual system. Neurons in various places of the neocortex show tuning properties in term of firing frequency to both speed and direction. The present study applied a 32-channel electroencephalograph (EEG) system to 13 human subjects while they were observing a single object moving with different speeds in various directions from the center of view to the periphery on a computer monitor. Depending on the experimental condition, the subjects were either required to fix their gaze at the center of the monitor while the object was moving or to track the movement with their gaze; eye-tracking glasses were used to ensure that they followed instructions. In each trial, motion speed and direction varied randomly and independently, forming two competing visual features. EEG signal classification was performed for each cue separately (e.g., 11 speed values or 11 directions), regardless of variations in the other cue. Under the eye-fixed condition, multiple subjects showed distinct preferences to motion direction over speed; however, two outliers showed superb sensitivity to speed. Under the eye-tracking condition, in which the EEG signals presumably contained ocular movement signals, all subjects showed predominantly better classification for motion direction. There was a trend that speed and direction were encoded by different electrode sites. Since EEG is a noninvasive and portable approach suitable for brain-computer interfaces (BCIs), this study provides insights on fundamental knowledge of the visual system as well as BCI applications based on visual stimulation.

fNIRS Dataset During Complex Scene Analysis

When analyzing complex scenes, humans often focus their attention on an object at a particular spatial location. The ability to decode the attended spatial location would facilitate brain computer interfaces for complex scene analysis (CSA). Here, we investigated capability of functional near-infrared spectroscopy (fNIRS) to decode audio-visual spatial attention in the presence of competing stimuli from multiple locations. We targeted dorsal frontoparietal network including frontal eye field (FEF) and intra-parietal sulcus (IPS) as well as superior temporal gyrus/planum temporal (STG/PT). They all were shown in previous functional magnetic resonance imaging (fMRI) studies to be activated by auditory, visual, or audio-visual spatial tasks. To date, fNIRS has not been applied to decode auditory and visual-spatial attention during CSA, and thus, no such dataset exists yet. This report provides an open-access fNIRS dataset that can be used to develop, test, and compare machine learning algorithms for classifying attended locations based on the fNIRS signals on a single trial basis.

Brain-computer interface paradigms and neural coding

Brain signal patterns generated in the central nervous system of brain-computer interface (BCI) users are closely related to BCI paradigms and neural coding. In BCI systems, BCI paradigms and neural coding are critical elements for BCI research. However, so far there have been few references that clearly and systematically elaborated on the definition and design principles of the BCI paradigm as well as the definition and modeling principles of BCI neural coding. Therefore, these contents are expounded and the existing main BCI paradigms and neural coding are introduced in the review. Finally, the challenges and future research directions of BCI paradigm and neural coding were discussed, including user-centered design and evaluation for BCI paradigms and neural coding, revolutionizing the traditional BCI paradigms, breaking through the existing techniques for collecting brain signals and combining BCI technology with advanced AI technology to improve brain signal decoding performance. It is expected that the review will inspire innovative research and development of the BCI paradigm and neural coding.

An auditory brain-computer interface to detect changes in sound pressure level for automatic volume control

Volume control is necessary to adjust sound levels for a comfortable audio or video listening experience. This study aims to develop an automatic volume control system based on a brain-computer interface (BCI). We thus focused on a BCI using an auditory oddball paradigm, and conducted two types of experiments. In the first experiment, the participant was asked to pay attention to a target sound where the sound level was high (70 dB) compared with the other sounds (60 dB). The brain activity measured by electroencephalogram showed large positive activity (P300) for the target sound, and classification of the target and nontarget sounds achieved an accuracy of 0.90. The second experiment adopted a two-target paradigm where a low sound level (50 dB) was introduced as the second target sound. P300 was also observed in the second experiment, and a value of 0.76 was obtained for the binary classification of the target and nontarget sounds. Further, we found that better accuracy was observed in large sound levels compared to small ones. These results suggest the possibility of using BCI for automatic volume control; however, it is necessary to improve its accuracy for application in daily life.

U.S. public perceptions of the sensitivity of brain data

As we approach an era of potentially widespread consumer neurotechnology, scholars and organizations worldwide have started to raise concerns about the data privacy issues these devices will present. Notably absent in these discussions is empirical evidence about how the public perceives that same information. This article presents the results of a nationwide survey on public perceptions of brain data, to inform discussions of law and policy regarding brain data governance. The survey reveals that the public may perceive certain brain data as less sensitive than other 'private' information, like social security numbers, but more sensitive than some 'public' information, like media preferences. The findings also reveal that not all inferences about mental experiences may be perceived as equally sensitive, and perhaps not all data should be treated alike in ethical and policy discussions. An enhanced understanding of public perceptions of brain data could advance the development of ethical and legal norms concerning consumer neurotechnology.

Conversion of a medical implant into a versatile computer-brain interface

BACKGROUND

Information transmission into the human nervous system is the basis for a variety of prosthetic applications. Spinal cord stimulation (SCS) systems are widely available, have a well documented safety record, can be implanted minimally invasively, and are known to stimulate afferent pathways. Nonetheless, SCS devices are not yet used for computer-brain-interfacing applications.

OBJECTIVE

Here we aimed to establish computer-to-brain communication via medical SCS implants in a group of 20 individuals who had been operated for the treatment of chronic neuropathic pain.

METHODS

In the initial phase, we conducted interface calibration with the aim of determining personalized stimulation settings that yielded distinct and reproducible sensations. These settings were subsequently utilized to generate inputs for a range of behavioral tasks. We evaluated the required calibration time, task training duration, and the subsequent performance in each task.

RESULTS

We could establish a stable spinal computer-brain interface in 18 of the 20 participants. Each of the 18 then performed one or more of the following tasks: A rhythm-discrimination task (n = 13), a Morse-decoding task (n = 3), and/or two different balance/body-posture tasks (n = 18; n = 5). The median calibration time was 79 min. The median training time for learning to use the interface in a subsequent task was 1:40 min. In each task, every participant demonstrated successful performance, surpassing chance levels.

CONCLUSION

The results constitute the first proof-of-concept of a general purpose computer-brain interface paradigm that could be deployed on present-day medical SCS platforms.

Sneaky emotions: impact of data partitions in affective computing experiments with brain-computer interfacing

Brain-Computer Interfacing (BCI) has shown promise in Machine Learning (ML) for emotion recognition. Unfortunately, how data are partitioned in training/test splits is often overlooked, which makes it difficult to attribute research findings to actual modeling improvements or to partitioning issues. We introduce the "data transfer rate" construct (i.e., how much data of the test samples are seen during training) and use it to examine data partitioning effects under several conditions. As a use case, we consider emotion recognition in videos using electroencephalogram (EEG) signals. Three data splits are considered, each representing a relevant BCI task: subject-independent (affective decoding), video-independent (affective annotation), and time-based (feature extraction). Model performance may change significantly (ranging e.g. from 50% to 90%) depending on how data is partitioned, in classification accuracy. This was evidenced in all experimental conditions tested. Our results show that (1) for affective decoding, it is hard to achieve performance above the baseline case (random classification) unless some data of the test subjects are considered in the training partition; (2) for affective annotation, having data from the same subject in training and test partitions, even though they correspond to different videos, also increases performance; and (3) later signal segments are generally more discriminative, but it is the number of segments (data points) what matters the most. Our findings not only have implications in how brain data are managed, but also in how experimental conditions and results are reported.

Fog Computing for Control of Cyber-Physical Systems in Industry Using BCI

Brain-computer interfaces use signals from the brain, such as EEG, to determine brain states, which in turn can be used to issue commands, for example, to control industrial machinery. While Cloud computing can aid in the creation and operation of industrial multi-user BCI systems, the vast amount of data generated from EEG signals can lead to slow response time and bandwidth problems. Fog computing reduces latency in high-demand computation networks. Hence, this paper introduces a fog computing solution for BCI processing. The solution consists in using fog nodes that incorporate machine learning algorithms to convert EEG signals into commands to control a cyber-physical system. The machine learning module uses a deep learning encoder to generate feature images from EEG signals that are subsequently classified into commands by a random forest. The classification scheme is compared using various classifiers, being the random forest the one that obtained the best performance. Additionally, a comparison was made between the fog computing approach and using only cloud computing through the use of a fog computing simulator. The results indicate that the fog computing method resulted in less latency compared to the solely cloud computing approach.

Evaluation of an English language phoneme-based imagined speech brain computer interface with low-cost electroencephalography

Introduction

Paralyzed and physically impaired patients face communication difficulties, even when they are mentally coherent and aware. Electroencephalographic (EEG) brain-computer interfaces (BCIs) offer a potential communication method for these people without invasive surgery or physical device controls.

Methods

Although virtual keyboard protocols are well documented in EEG BCI paradigms, these implementations are visually taxing and fatiguing. All English words combine 44 unique phonemes, each corresponding to a unique EEG pattern. In this study, a complete phoneme-based imagined speech EEG BCI was developed and tested on 16 subjects.

Results

Using open-source hardware and software, machine learning models, such as k-nearest neighbor (KNN), reliably achieved a mean accuracy of 97 ± 0.001%, a mean F1 of 0.55 ± 0.01, and a mean AUC-ROC of 0.68 ± 0.002 in a modified one-versus-rest configuration, resulting in an information transfer rate of 304.15 bits per minute. In line with prior literature, the distinguishing feature between phonemes was the gamma power on channels F3 and F7.

Discussion

However, adjustments to feature selection, trial window length, and classifier algorithms may improve performance. In summary, these are iterative changes to a viable method directly deployable in current, commercially available systems and software. The development of an intuitive phoneme-based EEG BCI with open-source hardware and software demonstrates the potential ease with which the technology could be deployed in real-world applications.

A Brain Computer Interface Neuromodulatory Device for Stroke Rehabilitation: Iterative User-Centered Design Approach

BACKGROUND

Rehabilitation technologies for people with stroke are rapidly evolving. These technologies have the potential to support higher volumes of rehabilitation to improve outcomes for people with stroke. Despite growing evidence of their efficacy, there is a lack of uptake and sustained use in stroke rehabilitation and a call for user-centered design approaches during technology design and development. This study focuses on a novel rehabilitation technology called exciteBCI, a complex neuromodulatory wearable technology in the prototype stage that augments locomotor rehabilitation for people with stroke. The exciteBCI consists of a brain computer interface, a muscle electrical stimulator, and a mobile app.

OBJECTIVE

This study presents the evaluation phase of an iterative user-centered design approach supported by a qualitative descriptive methodology that sought to (1) explore users' perspectives and experiences of exciteBCI and how well it fits with rehabilitation, and (2) facilitate modifications to exciteBCI design features.

METHODS

The iterative usability evaluation of exciteBCI was conducted in 2 phases. Phase 1 consisted of 3 sprint cycles consisting of single usability sessions with people with stroke (n=4) and physiotherapists (n=4). During their interactions with exciteBCI, participants used a "think-aloud" approach, followed by a semistructured interview. At the end of each sprint cycle, device requirements were gathered and the device was modified in preparation for the next cycle. Phase 2 focused on a "near-live" approach in which 2 people with stroke and 1 physiotherapist participated in a 3-week program of rehabilitation augmented by exciteBCI (n=3). Participants completed a semistructured interview at the end of the program. Data were analyzed from both phases using conventional content analysis.

RESULTS

Overall, participants perceived and experienced exciteBCI positively, while providing guidance for iterative changes. Five interrelated themes were identified from the data: (1) "This is rehab" illustrated that participants viewed exciteBCI as having a good fit with rehabilitation practice; (2) "Getting the most out of rehab" highlighted that exciteBCI was perceived as a means to enhance rehabilitation through increased engagement and challenge; (3) "It is a tool not a therapist," revealed views that the technology could either enhance or disrupt the therapeutic relationship; and (4) "Weighing up the benefits versus the burden" and (5) "Don't make me look different" emphasized important design considerations related to device set-up, use, and social acceptability.

CONCLUSIONS

This study offers several important findings that can inform the design and implementation of rehabilitation technologies. These include (1) the design of rehabilitation technology should support the therapeutic relationship between the patient and therapist, (2) social acceptability is a design priority in rehabilitation technology but its importance varies depending on the use context, and (3) there is value in using design research methods that support understanding usability in the context of sustained use.

Perspective of Signal Processing-Based on Brain-Computer Interfaces Using Machine Learning Methods

The application of artificial intelligence (AI) algorithms is an indispensable portion of developing brain-computer interfaces (BCI). With the continuous development of AI concepts and related technologies. AI algorithms such as neural networks play an increasingly powerful and extensive role in brain-computer interfaces. However, brain-computer interfaces are still facing many technical challenges. Due to the limitations of AI algorithms, brain-computer interfaces not only work with limited accuracy, but also can only be applied to certain simple scenarios. In order to explore the future directions and improvements of AI algorithms in the area of brain-computer interfaces, this paper will review and analyse the advanced applications of AI algorithms in the field of brain-computer interfaces in recent years and give possible future enhancements and development directions for the controversial parts of them. This review first presents the effects of different AI algorithms in BCI applications. A multi-objective classification method is compared with evolutionary algorithms in feature extraction of data. Then, a kind of supervised learning algorithm based on Event Related Potential (ERP) tags is presented to achieve a high accuracy in the process of pattern recognition. Finally, as an important experimental paradigm for BCI, a combined TFD-PSR-CSP feature extraction method, is explained for the problem of motor imagery. The "Discussion" part comprehensively analyses the advantages and disadvantages of the above algorithms and proposes a deep learning-based artificial intelligence algorithm in order to solve the problems arising from the above algorithms.

VEPdgets: Towards Richer Interaction Elements Based on Visually Evoked Potentials

For brain-computer interfaces, a variety of technologies and applications already exist. However, current approaches use visual evoked potentials (VEP) only as action triggers or in combination with other input technologies. This paper shows that the losing visually evoked potentials after looking away from a stimulus is a reliable temporal parameter. The associated latency can be used to control time-varying variables using the VEP. In this context, we introduced VEP interaction elements (VEP widgets) for a value input of numbers, which can be applied in various ways and is purely based on VEP technology. We carried out a user study in a desktop as well as in a virtual reality setting. The results for both settings showed that the temporal control approach using latency correction could be applied to the input of values using the proposed VEP widgets. Even though value input is not very accurate under untrained conditions, users could input numerical values. Our concept of applying latency correction to VEP widgets is not limited to the input of numbers.

Brief Visual Deprivation Effects on Brain Oscillations During Kinesthetic and Visual-motor Imagery

It is widely recognized that opening and closing the eyes can direct attention to external or internal stimuli processing. This has been confirmed by studies showing the effects of changes in visual stimulation changes on cerebral activity during different tasks, e.g., motor imagery and execution. However, an essential aspect of creating a mental representation of motion, such as imagery perspective, has not yet been investigated in the present context. Our study aimed to verify the effect of brief visual deprivation (under eyes open [EO] and eyes closed [EC] conditions) on brain wave oscillations and behavioral performance during kinesthetic imagery (KMI) and visual-motor imagery (VMI) tasks. We focused on the alpha and beta rhythms from visual- and motor-related EEG activity sources. Additionally, we used machine learning algorithms to establish whether the registered differences in brain oscillations might affect motor imagery brain-computer interface (MI-BCI) performance. The results showed that the occipital areas in the EC condition presented significantly stronger desynchronization during VMI tasks, which is typical for enhanced visual stimuli processing. Furthermore, the stronger desynchronization of alpha rhythms from motor areas in the EO, than EC condition confirmed previous effects obtained during real movements. It was also found that simulating movement under EC/EO conditions affected signal classification accuracy, which has practical implications for MI-BCI effectiveness. These findings suggest that shifting processing toward external or internal stimuli modulates brain rhythm oscillations associated with different perspectives on the mental representation of movement.

Two is better? combining EEG and fMRI for BCI and neurofeedback: a systematic review

Electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) are two commonly used non-invasive techniques for measuring brain activity in neuroscience and brain-computer interfaces (BCI).Objective. In this review, we focus on the use of EEG and fMRI in neurofeedback (NF) and discuss the challenges of combining the two modalities to improve understanding of brain activity and achieve more effective clinical outcomes. Advanced technologies have been developed to simultaneously record EEG and fMRI signals to provide a better understanding of the relationship between the two modalities. However, the complexity of brain processes and the heterogeneous nature of EEG and fMRI present challenges in extracting useful information from the combined data.Approach. We will survey existing EEG-fMRI combinations and recent studies that exploit EEG-fMRI in NF, highlighting the experimental and technical challenges.Main results. We made a classification of the different combination of EEG-fMRI for NF, we provide a review of multimodal analysis methods for EEG-fMRI features. We also survey the current state of research on EEG-fMRI in the different existing NF paradigms. Finally, we also identify some of the remaining challenges in this field.Significance. By exploring EEG-fMRI combinations in NF, we are advancing our knowledge of brain function and its applications in clinical settings. As such, this review serves as a valuable resource for researchers, clinicians, and engineers working in the field of neural engineering and rehabilitation, highlighting the promising future of EEG-fMRI-based NF.

A tale of two instructional experiences: student engagement in active learning and emergency remote learning of biomechanics

This study documents student engagement in face-to-face low-tech active learning and student perceptions of emergency remote instruction due to the COVID-19 pandemic in introductory biomechanics. Students in two classes received 8 weeks of face-to-face instruction with five low-tech active learning techniques and then received 6 weeks of emergency remote, online instruction. Learning was measured using pre-test and post-test administrations of the biomechanics concept inventory (BCI). A survey of engagement in active learning with additional questions on active learning and online instruction were collected with the post-test. No student perceptions of engagement in active learning or online instruction were correlated with learning measured by normalised gain. Student's perception of the 'value of group activity' factor from survey was significantly correlated (r2 = 12%) with the number of students typically in active learning groups. There was a significant correlation (r2 = 46%) between student perception of reading the textbook before online video lessons and perception of value of the video lessons in the online portion of the course. Most students (59%) preferred face-to-face instruction in biomechanics. While up to 28% of students may have reported resistance to group-based active learning, low-tech active learning significantly improved mastery of biomechanics concepts above levels previously reported for lecture alone.

Recommendations for promoting user agency in the design of speech neuroprostheses

Brain-computer interfaces (BCI) that directly decode speech from brain activity aim to restore communication in people with paralysis who cannot speak. Despite recent advances, neural inference of speech remains imperfect, limiting the ability for speech BCIs to enable experiences such as fluent conversation that promote agency - that is, the ability for users to author and transmit messages enacting their intentions. Here, we make recommendations for promoting agency based on existing and emerging strategies in neural engineering. The focus is on achieving fast, accurate, and reliable performance while ensuring volitional control over when a decoder is engaged, what exactly is decoded, and how messages are expressed. Additionally, alongside neuroscientific progress within controlled experimental settings, we argue that a parallel line of research must consider how to translate experimental successes into real-world environments. While such research will ultimately require input from prospective users, here we identify and describe design choices inspired by human-factors work conducted in existing fields of assistive technology, which address practical issues likely to emerge in future real-world speech BCI applications.

Brain-computer interface treatment for gait rehabilitation in stroke patients

The use of Brain-Computer Interfaces (BCI) as rehabilitation tools for chronically ill neurological patients has become more widespread. BCIs combined with other techniques allow the user to restore neurological function by inducing neuroplasticity through real-time detection of motor-imagery (MI) as patients perform therapy tasks. Twenty-five stroke patients with gait disability were recruited for this study. Participants performed 25 sessions with the MI-BCI and assessment visits to track functional changes during the therapy. The results of this study demonstrated a clinically significant increase in walking speed of 0.19 m/s, 95%CI [0.13-0.25], p < 0.001. Patients also reduced spasticity and improved their range of motion and muscle contraction. The BCI treatment was effective in promoting long-lasting functional improvements in the gait speed of chronic stroke survivors. Patients have more movements in the lower limb; therefore, they can walk better and safer. This functional improvement can be explained by improved neuroplasticity in the central nervous system.

A gap between reasons for skilled use of BCI speech devices and reasons for utterances, with implications for speech ownership

The skilled use of a speech BCI device will draw upon practical experience gained through the use of that very device. The reasons a user may have for using a device in a particular way, reflecting that skill gained via familiarity with the device, may differ significantly from the reasons that a speaker might have for their utterances. The potential divergence between reasons constituting skilled use and BCI-mediated speech output may serve to make clear an instrumental relationship between speaker and BCI speech device. This will affect the way in which the device and the speech it produces for the user can be thought of as being "reasons responsive", hence the way in which the user can be said to be in control of their device. Ultimately, this divergence will come down to how ownership of produced speech can be considered. The upshot will be that skillful use of a synthetic speech device might include practices that diverge from standard speech in significant ways. This might further indicate that synthetic speech devices ought to be considered as different from, not continuous with, standard speech.

Spectrum-Enhanced TRCA (SE-TRCA): A novel approach for direction detection in SSVEP-based BCI

The Steady State Visual Evoked Potential (SSVEP) is a widely used component in BCIs due to its high noise resistance and low equipment requirements. Recently, a novel SSVEP-based paradigm has been introduced for direction detection, in which, unlike the common SSVEP paradigms that use several frequency stimuli, only one flickering stimulus is used and it makes direction detection very challenging. So far, only the CCA method has been used for direction detection using SSVEP component analysis. Since Canonical Correlation Analysis (CCA) has some limitations, a Task-Related Component Analysis (TRCA) based method has been introduced for feature extraction to improve the direction detection performance. Although these methods have been proven efficient, they do not utilize the latent frequency information in the EEG signal. Therefore, the performance of direction detection using SSVEP component analysis is still suboptimal. For further improvement, the TRCA-based algorithm is enhanced by incorporating frequency information and introducing Spectrum-Enhanced TRCA (SE-TRCA). SE-TRCA method can utilize frequency information in conjunction with spatial information by concatenating the EEG signal and its shifted version. Accordingly, the obtained spatio-spectral filters perform as a Finite Impulse Response (FIR) filter. To evaluate the proposed SE-TRCA method, two different sorts of datasets (1) a hybrid BCI dataset (including SSVEP component for direction detection) and (2) a pure benchmark SSVEP dataset (including SSVEP component for frequency detection) have been used. Our experiments showed that the accuracy of direction detection using the proposed SE-TRCA and TRCA approaches compared to CCA-based approach have been increased by 23.35% and 28.24%, respectively. Furthermore, the accuracy of character recognition obtained from integrating P300 and SSVEP components in CCA, TRCA, and SETRCA approaches are 54.01%, 56.02%, and 58.56%, on the hybrid dataset, respectively. The evaluation of the SE-TRCA method on the benchmark SSVEP dataset demonstrates that the SE-TRCA method outperforms both CCA and TRCA, particularly regarding frequency detection accuracy. In this specific dataset, the SE-TRCA method achieved an impressive frequency detection accuracy of 98.19% for a 3-s signal, surpassing the accuracies of TRCA and CCA, which were 97.91% and 90.47%, respectively. These results demonstrated that the TRCA-based approach is more efficient than the CCA approach to extracting spatial filters. Moreover, SE-TRCA, extracting both Spectral and spatial information from the EEG signal, can capture more discriminative features from the SSVEP component and increase the accuracy of classification. The results of this study emphasize the effectiveness of the proposed SE-TRCA approach across different SSVEP paradigms and tasks. These findings provide strong evidence for the method's ability to generalize well in SSVEP analysis.

In Vitro and In Silico Investigation of BCI Anticancer Properties and Its Potential for Chemotherapy-Combined Treatments

BACKGROUND

DUSP6 phosphatase serves as a negative regulator of MAPK kinases involved in numerous cellular processes. BCI has been identified as a potential allosteric inhibitor with anticancer activity. Our study was designed to test the anticancer properties of BCI in colon cancer cells, to characterize the effect of this compound on chemotherapeutics such as irinotecan and oxaliplatin activity, and to identify potential molecular targets for this inhibitor.

METHODS

BCI cytotoxicity, proapoptotic activity, and cell cycle distribution were investigated in vitro on three colon cancer cell lines (DLD1, HT-29, and Caco-2). In silico investigation was prepared to assess BCI drug-likeness and identify potential molecular targets.

RESULTS

The exposure of colorectal cancer cells with BCI resulted in antitumor effects associated with cell cycle arrest and induction of apoptosis. BCI exhibited strong cytotoxicity on DLD1, HT-29, and Caco-2 cells. BCI showed no significant interaction with irinotecan, but strongly attenuated the anticancer activity of oxaliplatin when administered together. Analysis of synergy potential further confirmed the antagonistic interaction between these two compounds. In silico investigation indicated CDK5 as a potential new target of BCI.

CONCLUSIONS

Our studies point to the anticancer potential of BCI but note the need for a precise mechanism of action.

Brain-Computer Interface to Deliver Individualized Multisensory Intervention for Neuropathic Pain

To unravel the complexity of the neuropathic pain experience, researchers have tried to identify reliable pain signatures (biomarkers) using electroencephalography (EEG) and skin conductance (SC). Nevertheless, their use as a clinical aid to design personalized therapies remains scarce and patients are prescribed with common and inefficient painkillers. To address this need, novel non-pharmacological interventions, such as transcutaneous electrical nerve stimulation (TENS) to activate peripheral pain relief via neuromodulation and virtual reality (VR) to modulate patients' attention, have emerged. However, all present treatments suffer from the inherent bias of the patient's self-reported pain intensity, depending on their predisposition and tolerance, together with unspecific, pre-defined scheduling of sessions which does not consider the timing of pain episodes onset. Here, we show a Brain-Computer Interface (BCI) detecting in real-time neurophysiological signatures of neuropathic pain from EEG combined with SC and accordingly triggering a multisensory intervention combining TENS and VR. After validating that the multisensory intervention effectively decreased experimentally induced pain, the BCI was tested with thirteen healthy subjects by electrically inducing pain and showed 82% recall in decoding pain in real time. Such constructed BCI was then validated with eight neuropathic patients reaching 75% online pain precision, and consequently releasing the intervention inducing a significant decrease (50% NPSI score) in neuropathic patients' pain perception. Our results demonstrate the feasibility of real-time pain detection from objective neurophysiological signals, and the effectiveness of a triggered combination of VR and TENS to decrease neuropathic pain. This paves the way towards personalized, data-driven pain therapies using fully portable technologies.

Assessing Consciousness through Neurofeedback and Neuromodulation: Possibilities and Challenges

Neurofeedback is a non-invasive therapeutic approach that has gained traction in recent years, showing promising results for various neurological and psychiatric conditions. It involves real-time monitoring of brain activity, allowing individuals to gain control over their own brainwaves and improve cognitive performance or alleviate symptoms. The use of electroencephalography (EEG), such as brain-computer interface (BCI), transcranial direct current stimulation (tDCS), and transcranial magnetic stimulation (TMS), has been instrumental in developing neurofeedback techniques. However, the application of these tools in patients with disorders of consciousness (DoC) presents unique challenges. In this narrative review, we explore the use of neurofeedback in treating patients with DoC. More specifically, we discuss the advantages and challenges of using tools such as EEG neurofeedback, tDCS, TMS, and BCI for these conditions. Ultimately, we hope to provide the neuroscientific community with a comprehensive overview of neurofeedback and emphasize its potential therapeutic applications in severe cases of impaired consciousness levels.

Intracortical brain-computer interfaces in primates: a review and outlook

Brain-computer interfaces (BCI) translate brain signals into artificial output to restore or replace natural central nervous system (CNS) functions. Multiple processes, including sensorimotor integration, decision-making, motor planning, execution, and updating, are involved in any movement. For example, a BCI may be better able to restore naturalistic motor behaviors if it uses signals from multiple brain areas and decodes natural behaviors' cognitive and motor aspects. This review provides an overview of the preliminary information necessary to plan a BCI project focusing on intracortical implants in primates. Since the brain structure and areas of non-human primates (NHP) are similar to humans, exploring the result of NHP studies will eventually benefit human BCI studies. The different types of BCI systems based on the target cortical area, types of signals, and decoding methods will be discussed. In addition, various successful state-of-the-art cases will be reviewed in more detail, focusing on the general algorithm followed in the real-time system. Finally, an outlook for improving the current BCI research studies will be debated.

Subject-Independent EEG Classification of Motor Imagery Based on Dual-Branch Feature Fusion

A brain computer interface (BCI) system helps people with motor dysfunction interact with the external environment. With the advancement of technology, BCI systems have been applied in practice, but their practicability and usability are still greatly challenged. A large amount of calibration time is often required before BCI systems are used, which can consume the patient's energy and easily lead to anxiety. This paper proposes a novel motion-assisted method based on a novel dual-branch multiscale auto encoder network (MSAENet) to decode human brain motion imagery intentions, while introducing a central loss function to compensate for the shortcomings of traditional classifiers that only consider inter-class differences and ignore intra-class coupling. The effectiveness of the method is validated on three datasets, namely BCIIV2a, SMR-BCI and OpenBMI, to achieve zero calibration of the MI-BCI system. The results show that our proposed network displays good results on all three datasets. In the case of subject-independence, the MSAENet outperformed the other four comparison methods on the BCIIV2a and SMR-BCI datasets, while achieving F1_score values as high as 69.34% on the OpenBMI dataset. Our method maintains better classification accuracy with a small number of parameters and short prediction times, and the method achieves zero calibration of the MI-BCI system.

Adaptive P300-Based Brain-Computer Interface for Attention Training: Protocol for a Randomized Controlled Trial

BACKGROUND

The number of people with cognitive deficits and diseases, such as stroke, dementia, or attention-deficit/hyperactivity disorder, is rising due to an aging, or in the case of attention-deficit/hyperactivity disorder, a growing population. Neurofeedback training using brain-computer interfaces is emerging as a means of easy-to-use and noninvasive cognitive training and rehabilitation. A novel application of neurofeedback training using a P300-based brain-computer interface has previously shown potential to improve attention in healthy adults.

OBJECTIVE

This study aims to accelerate attention training using iterative learning control to optimize the task difficulty in an adaptive P300 speller task. Furthermore, we hope to replicate the results of a previous study using a P300 speller for attention training, as a benchmark comparison. In addition, the effectiveness of personalizing the task difficulty during training will be compared to a nonpersonalized task difficulty adaptation.

METHODS

In this single-blind, parallel, 3-arm randomized controlled trial, 45 healthy adults will be recruited and randomly assigned to the experimental group or 1 of 2 control groups. This study involves a single training session, where participants receive neurofeedback training through a P300 speller task. During this training, the task's difficulty is progressively increased, which makes it more difficult for the participants to maintain their performance. This encourages the participants to improve their focus. Task difficulty is either adapted based on the participants' performance (in the experimental group and control group 1) or chosen randomly (in control group 2). Changes in brain patterns before and after training will be analyzed to study the effectiveness of the different approaches. Participants will complete a random dot motion task before and after the training so that any transfer effects of the training to other cognitive tasks can be evaluated. Questionnaires will be used to estimate the participants' fatigue and compare the perceived workload of the training between groups.

RESULTS

This study has been approved by the Maynooth University Ethics Committee (BSRESC-2022-2474456) and is registered on ClinicalTrials.gov (NCT05576649). Participant recruitment and data collection began in October 2022, and we expect to publish the results in 2023.

CONCLUSIONS

This study aims to accelerate attention training using iterative learning control in an adaptive P300 speller task, making it a more attractive training option for individuals with cognitive deficits due to its ease of use and speed. The successful replication of the results from the previous study, which used a P300 speller for attention training, would provide further evidence to support the effectiveness of this training tool.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05576649; https://clinicaltrials.gov/ct2/show/NCT05576649.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/46135.

Design and implementation of high sampling rate and multichannel wireless recorder for EEG monitoring and SSVEP response detection

Introduction

The collection and process of human brain activity signals play an essential role in developing brain-computer interface (BCI) systems. A portable electroencephalogram (EEG) device has become an important tool for monitoring brain activity and diagnosing mental diseases. However, the miniaturization, portability, and scalability of EEG recorder are the current bottleneck in the research and application of BCI.

Methods

For scalp EEG and other applications, the current study designs a 32-channel EEG recorder with a sampling rate up to 30 kHz and 16-bit accuracy, which can meet both the demands of scalp and intracranial EEG signal recording. A fully integrated electrophysiology microchip RHS2116 controlled by FPGA is employed to build the EEG recorder, and the design meets the requirements of high sampling rate, high transmission rate and channel extensive.

Results

The experimental results show that the developed EEG recorder provides a maximum 30 kHz sampling rate and 58 Mbps wireless transmission rate. The electrophysiological experiments were performed on scalp and intracranial EEG collection. An inflatable helmet with adjustable contact impedance was designed, and the pressurization can improve the SNR by approximately 4 times, the average accuracy of steady-state visual evoked potential (SSVEP) was 93.12%. Animal experiments were also performed on rats, and spike activity was captured successfully.

Conclusion

The designed multichannel wireless EEG collection system is simple and comfort, the helmet-EEG recorder can capture the bioelectric signals without noticeable interference, and it has high measurement performance and great potential for practical application in BCI systems.

Eye-tracking control of an adjustable electric bed: construction and validation by immobile patients with multiple sclerosis

BACKGROUND

In severe conditions of limited motor abilities, frequent position changes for work or passive and active rest are essential bedside activities to prevent further health complications. We aimed to develop a system using eye movements for bed positioning and to verify its functionality in a control group and a group of patients with significant motor limitation caused by multiple sclerosis.

METHODS

The eye-tracking system utilized an innovative digital-to-analog converter module to control the positioning bed via a novel graphical user interface. We verified the ergonomics and usability of the system by performing a fixed sequence of positioning tasks, in which the leg and head support was repeatedly raised and then lowered. Fifteen women and eleven men aged 42.7 ± 15.9 years in the control group and nine women and eight men aged 60.3 ± 9.14 years in the patient group participated in the experiment. The degree of disability, according to the Expanded Disability Status Scale (EDSS), ranged from 7 to 9.5 points in the patients. We assessed the speed and efficiency of the bed control and the improvement during testing. In a questionnaire, we evaluated satisfaction with the system.

RESULTS

The control group mastered the task in 40.2 s (median) with an interquartile interval from 34.5 to 45.5 s, and patients mastered the task in in 56.5 (median) with an interquartile interval from 46.5 to 64.9 s. The efficiency of solving the task (100% corresponds to an optimal performance) was 86.3 (81.6; 91.0) % for the control group and 72.1 (63.0; 75.2) % for the patient group. Throughout testing, the patients learned to communicate with the system, and their efficiency and task time improved. A correlation analysis showed a negative relationship (rho = - 0.587) between efficiency improvement and the degree of impairment (EDSS). In the control group, the learning was not significant. On the questionnaire survey, sixteen patients reported gaining confidence in bed control. Seven patients preferred the offered form of bed control, and in six cases, they would choose another form of interface.

CONCLUSIONS

The proposed system and communication through eye movements are reliable for positioning the bed in people affected by advanced multiple sclerosis. Seven of 17 patients indicated that they would choose this system for bed control and wished to extend it for another application.

A case for hybrid BCIs: combining optical and electrical modalities improves accuracy

Near-infrared spectroscopy (NIRS) is a promising research tool that found its way into the field of brain-computer interfacing (BCI). BCI is crucially dependent on maximized usability thus demanding lightweight, compact, and low-cost hardware. We designed, built, and validated a hybrid BCI system incorporating one optical and two electrical modalities ameliorating usability issues. The novel hardware consisted of a NIRS device integrated with an electroencephalography (EEG) system that used two different types of electrodes: Regular gelled gold disk electrodes and tri-polar concentric ring electrodes (TCRE). BCI experiments with 16 volunteers implemented a two-dimensional motor imagery paradigm in off- and online sessions. Various non-canonical signal processing methods were used to extract and classify useful features from EEG, tEEG (EEG through TCRE electrodes), and NIRS. Our analysis demonstrated evidence of improvement in classification accuracy when using the TCRE electrodes compared to disk electrodes and the NIRS system. Based on our synchronous hybrid recording system, we could show that the combination of NIRS-EEG-tEEG performed significantly better than either single modality only.

Dynamic pruning group equivariant network for motor imagery EEG recognition

Introduction: The decoding of the motor imaging electroencephalogram (MI-EEG) is the most critical part of the brain-computer interface (BCI) system. However, the inherent complexity of EEG signals makes it challenging to analyze and model them. Methods: In order to effectively extract and classify the features of EEG signals, a classification algorithm of motor imagery EEG signals based on dynamic pruning equal-variant group convolutional network is proposed. Group convolutional networks can learn powerful representations based on symmetric patterns, but they lack clear methods to learn meaningful relationships between them. The dynamic pruning equivariant group convolution proposed in this paper is used to enhance meaningful symmetric combinations and suppress unreasonable and misleading symmetric combinations. At the same time, a new dynamic pruning method is proposed to dynamically evaluate the importance of parameters, which can restore the pruned connections. Results and Discussion: The experimental results show that the pruning group equivariant convolution network is superior to the traditional benchmark method in the benchmark motor imagery EEG data set. This research can also be transferred to other research areas.

Motor Imagery Classification Based on EEG Sensing with Visual and Vibrotactile Guidance

Motor imagery (MI) is a technique of imagining the performance of a motor task without actually using the muscles. When employed in a brain-computer interface (BCI) supported by electroencephalographic (EEG) sensors, it can be used as a successful method of human-computer interaction. In this paper, the performance of six different classifiers, namely linear discriminant analysis (LDA), support vector machine (SVM), random forest (RF), and three classifiers from the family of convolutional neural networks (CNN), is evaluated using EEG MI datasets. The study investigates the effectiveness of these classifiers on MI, guided by a static visual cue, dynamic visual guidance, and a combination of dynamic visual and vibrotactile (somatosensory) guidance. The effect of filtering passband during data preprocessing was also investigated. The results show that the ResNet-based CNN significantly outperforms the competing classifiers on both vibrotactile and visually guided data when detecting different directions of MI. Preprocessing the data using low-frequency signal features proves to be a better solution to achieve higher classification accuracy. It has also been shown that vibrotactile guidance has a significant impact on classification accuracy, with the associated improvement particularly evident for architecturally simpler classifiers. These findings have important implications for the development of EEG-based BCIs, as they provide valuable insight into the suitability of different classifiers for different contexts of use.