Neuroimaging-based approaches in the brain–computer interface

Three-dimensional-printed headcap with embedded microdrive system for customizable multi-region brain recordings with neural probes

Electrophysiological recordings from single neurons are crucial for understanding the complex functioning of the brain and for developing eventual therapeutic interventions. For electrophysiology, the accuracy and fidelity of invasive implantations of small devices remains unmatched. This study introduces an innovative, cost-efficient, 3D-printed headcap with embedded microdrive (THEM) system designed to streamline the manual labor-intensive in-vivo electrode implantation process for efficient and precise multi-region brain neural probe implantations. A custom bregma-referenced headcap design and fabrication, embedded microdrive integration, and upper support structure for probe packaging are described. With the Sprague Dawley rat as test species and medial prefrontal cortex and CA1 of the dorsal hippocampus as targets, surgeries and electrophysiological recordings were conducted to test the capability of the THEM system as compared to conventional surgical methods. By shifting manual stereotaxic alignment work to pre-surgical preparation of a fully assembled headcap system, incorporating fully preassembled upper support framework for packaging management, and easy customization for specific experiment designs and probe types, our system significantly reduces the surgical time, simplifies multi-implant procedures, and enhances procedural accuracy and repeatability. The THEM system demonstrates a significant improvement over conventional surgical implantation methods and offers a promising tool for future neuroscience research.

An EEG motor imagery dataset for brain computer interface in acute stroke patients

The brain-computer interface (BCI) is a technology that involves direct communication with parts of the brain and has evolved rapidly in recent years; it has begun to be used in clinical practice, such as for patient rehabilitation. Patient electroencephalography (EEG) datasets are critical for algorithm optimization and clinical applications of BCIs but are rare at present. We collected data from 50 acute stroke patients with wireless portable saline EEG devices during the performance of two tasks: 1) imagining right-handed movements and 2) imagining left-handed movements. The dataset consists of four types of data: 1) the motor imagery instructions, 2) raw recording data, 3) pre-processed data after removing artefacts and other manipulations, and 4) patient characteristics. This is the first open dataset to address left- and right-handed motor imagery in acute stroke patients. We believe that the dataset will be very helpful for analysing brain activation and designing decoding methods that are more applicable for acute stroke patients, which will greatly facilitate research in the field of motor imagery-BCI.

Towards hippocampal navigation for brain-computer interfaces

Automatic wheelchairs directly controlled by brain activity could provide autonomy to severely paralyzed individuals. Current approaches mostly rely on non-invasive measures of brain activity and translate individual commands into wheelchair movements. For example, an imagined movement of the right hand would steer the wheelchair to the right. No research has investigated decoding higher-order cognitive processes to accomplish wheelchair control. We envision an invasive neural prosthetic that could provide input for wheelchair control by decoding navigational intent from hippocampal signals. Navigation has been extensively investigated in hippocampal recordings, but not for the development of neural prostheses. Here we show that it is possible to train a decoder to classify virtual-movement speeds from hippocampal signals recorded during a virtual-navigation task. These results represent the first step toward exploring the feasibility of an invasive hippocampal BCI for wheelchair control.

The Emergence of Functional Ultrasound for Noninvasive Brain-Computer Interface

A noninvasive brain-computer interface is a central task in the comprehensive analysis and understanding of the brain and is an important challenge in international brain-science research. Current implanted brain-computer interfaces are cranial and invasive, which considerably limits their applications. The development of new noninvasive reading and writing technologies will advance substantial innovations and breakthroughs in the field of brain-computer interfaces. Here, we review the theory and development of the ultrasound brain functional imaging and its applications. Furthermore, we introduce latest advancements in ultrasound brain modulation and its applications in rodents, primates, and human; its mechanism and closed-loop ultrasound neuromodulation based on electroencephalograph are also presented. Finally, high-frequency acoustic noninvasive brain-computer interface is prospected based on ultrasound super-resolution imaging and acoustic tweezers.

A case for hybrid BCIs: combining optical and electrical modalities improves accuracy

Near-infrared spectroscopy (NIRS) is a promising research tool that found its way into the field of brain-computer interfacing (BCI). BCI is crucially dependent on maximized usability thus demanding lightweight, compact, and low-cost hardware. We designed, built, and validated a hybrid BCI system incorporating one optical and two electrical modalities ameliorating usability issues. The novel hardware consisted of a NIRS device integrated with an electroencephalography (EEG) system that used two different types of electrodes: Regular gelled gold disk electrodes and tri-polar concentric ring electrodes (TCRE). BCI experiments with 16 volunteers implemented a two-dimensional motor imagery paradigm in off- and online sessions. Various non-canonical signal processing methods were used to extract and classify useful features from EEG, tEEG (EEG through TCRE electrodes), and NIRS. Our analysis demonstrated evidence of improvement in classification accuracy when using the TCRE electrodes compared to disk electrodes and the NIRS system. Based on our synchronous hybrid recording system, we could show that the combination of NIRS-EEG-tEEG performed significantly better than either single modality only.

Sparse Logistic Regression-Based EEG Channel Optimization Algorithm for Improved Universality across Participants

Electroencephalogram (EEG) channel optimization can reduce redundant information and improve EEG decoding accuracy by selecting the most informative channels. This article aims to investigate the universality regarding EEG channel optimization in terms of how well the selected EEG channels can be generalized to different participants. In particular, this study proposes a sparse logistic regression (SLR)-based EEG channel optimization algorithm using a non-zero model parameter ranking method. The proposed channel optimization algorithm was evaluated in both individual analysis and group analysis using the raw EEG data, compared with the conventional channel selection method based on the correlation coefficients (CCS). The experimental results demonstrate that the SLR-based EEG channel optimization algorithm not only filters out most redundant channels (filters 75-96.9% of channels) with a 1.65-5.1% increase in decoding accuracy, but it can also achieve a satisfactory level of decoding accuracy in the group analysis by employing only a few (2-15) common EEG electrodes, even for different participants. The proposed channel optimization algorithm can realize better universality for EEG decoding, which can reduce the burden of EEG data acquisition and enhance the real-world application of EEG-based brain-computer interface (BCI).

Electroencephalogram based brain-computer interface: Applications, challenges, and opportunities

Brain-Computer Interfaces (BCI) is an exciting and emerging research area for researchers and scientists. It is a suitable combination of software and hardware to operate any device mentally. This review emphasizes the significant stages in the BCI domain, current problems, and state-of-the-art findings. This article also covers how current results can contribute to new knowledge about BCI, an overview of BCI from its early developments to recent advancements, BCI applications, challenges, and future directions. The authors pointed to unresolved issues and expressed how BCI is valuable for analyzing the human brain. Humans' dependence on machines has led humankind into a new future where BCI can play an essential role in improving this modern world.

Translational opportunities and challenges of invasive electrodes for neural interfaces

Invasive brain-machine interfaces can restore motor, sensory and cognitive functions. However, their clinical adoption has been hindered by the surgical risk of implantation and by suboptimal long-term reliability. In this Review, we highlight the opportunities and challenges of invasive technology for clinically relevant electrophysiology. Specifically, we discuss the characteristics of neural probes that are most likely to facilitate the clinical translation of invasive neural interfaces, describe the neural signals that can be acquired or produced by intracranial electrodes, the abiotic and biotic factors that contribute to their failure, and emerging neural-interface architectures.

Deep learning-based electroencephalic diagnosis of tinnitus symptom

Tinnitus is a neuropathological phenomenon caused by the recognition of external sound that does not actually exist. Existing diagnostic methods for tinnitus are rather subjective and complicated medical examination procedures. The present study aimed to diagnose tinnitus using deep learning analysis of electroencephalographic (EEG) signals while patients performed auditory cognitive tasks. We found that, during an active oddball task, patients with tinnitus could be identified with an area under the curve of 0.886 through a deep learning model (EEGNet) using EEG signals. Furthermore, using broadband (0.5 to 50 Hz) EEG signals, an analysis of the EEGNet convolutional kernel feature maps revealed that alpha activity might play a crucial role in identifying patients with tinnitus. A subsequent time-frequency analysis of the EEG signals indicated that the tinnitus group had significantly reduced pre-stimulus alpha activity compared with the healthy group. These differences were observed in both the active and passive oddball tasks. Only the target stimuli during the active oddball task yielded significantly higher evoked theta activity in the healthy group compared with the tinnitus group. Our findings suggest that task-relevant EEG features can be considered as a neural signature of tinnitus symptoms and support the feasibility of EEG-based deep-learning approach for the diagnosis of tinnitus.

Lower Limb Exoskeleton Sensors: State-of-the-Art

Due to the ever-increasing proportion of older people in the total population and the growing awareness of the importance of protecting workers against physical overload during long-time hard work, the idea of supporting exoskeletons progressed from high-tech fiction to almost commercialized products within the last six decades. Sensors, as part of the perception layer, play a crucial role in enhancing the functionality of exoskeletons by providing as accurate real-time data as possible to generate reliable input data for the control layer. The result of the processed sensor data is the information about current limb position, movement intension, and needed support. With the help of this review article, we want to clarify which criteria for sensors used in exoskeletons are important and how standard sensor types, such as kinematic and kinetic sensors, are used in lower limb exoskeletons. We also want to outline the possibilities and limitations of special medical signal sensors detecting, e.g., brain or muscle signals to improve data perception at the human-machine interface. A topic-based literature and product research was done to gain the best possible overview of the newest developments, research results, and products in the field. The paper provides an extensive overview of sensor criteria that need to be considered for the use of sensors in exoskeletons, as well as a collection of sensors and their placement used in current exoskeleton products. Additionally, the article points out several types of sensors detecting physiological or environmental signals that might be beneficial for future exoskeleton developments.

EEG temporal-spatial transformer for person identification

An increasing number of studies have been devoted to electroencephalogram (EEG) identity recognition since EEG signals are not easily stolen. Most of the existing studies on EEG person identification have only addressed brain signals in a single state, depending upon specific and repetitive sensory stimuli. However, in reality, human states are diverse and rapidly changing, which limits their practicality in realistic settings. Among many potential solutions, transformer is widely used and achieves an excellent performance in natural language processing, which demonstrates the outstanding ability of the attention mechanism to model temporal signals. In this paper, we propose a transformer-based approach for the EEG person identification task that extracts features in the temporal and spatial domains using a self-attention mechanism. We conduct an extensive study to evaluate the generalization ability of the proposed method among different states. Our method is compared with the most advanced EEG biometrics techniques and the results show that our method reaches state-of-the-art results. Notably, we do not need to extract any features manually.

Recommendations for machine learning benchmarks in neuroimaging

The field of neuroimaging has embraced methods from machine learning in a variety of ways. Although an increasing number of initiatives have published open-access neuroimaging datasets, specifically designed benchmarks are rare in the field. In this article, we first describe how benchmarks in computer science and biomedical imaging have fostered methodological progress in machine learning. Second, we identify the special characteristics of neuroimaging data and outline what researchers have to ensure when establishing a neuroimaging benchmark, how datasets should be composed and how adequate evaluation criteria can be chosen. Based on lessons learned from machine learning benchmarks, we argue for an extended evaluation procedure that, next to applying suitable performance metrics, focuses on scientifically relevant aspects such as explainability, robustness, uncertainty, computational efficiency and code quality. Lastly, we envision a collaborative neuroimaging benchmarking platform that combines the discussed aspects in a collaborative and agile framework, allowing researchers across disciplines to work together on the key predictive problems of the field of neuroimaging and psychiatry.

Spike-Representation of EEG Signals for Performance Enhancement of Brain-Computer Interfaces

Brain-computer interfaces (BCI) relying on electroencephalography (EEG) based neuroimaging mode has shown prospects for real-world usage due to its portability and optional selectivity of fewer channels for compactness. However, noise and artifacts often limit the capacity of BCI systems especially for event-related potentials such as P300 and error-related negativity (ERN), whose biomarkers are present in short time segments at the time-series level. Contrary to EEG, invasive recording is less prone to noise but requires a tedious surgical procedure. But EEG signal is the result of aggregation of neuronal spiking information underneath the scalp surface and transforming the relevant BCI task's EEG signal to spike representation could potentially help improve the BCI performance. In this study, we designed an approach using a spiking neural network (SNN) which is trained using surrogate-gradient descent to generate task-related multi-channel EEG template signals of all classes. The trained model is in turn leveraged to obtain the latent spike representation for each EEG sample. Comparing the classification performance of EEG signal and its spike-representation, the proposed approach enhanced the performance of ERN dataset from 79.22 to 82.27% with naive bayes and for P300 dataset, the accuracy was improved from 67.73 to 69.87% using xGboost. In addition, principal component analysis and correlation metrics were evaluated on both EEG signals and their spike-representation to identify the reason for such improvement.

PARTICLE RIDER OPTIMIZATION DRIVEN CLASSIFICATION FOR BRAIN-COMPUTER INTERFACE

The emerging technology for translating the intention of human into control signals is the Brain–computer interface (BCI). The BCI helps the patients with complete motor dysfunction to interact with the people. In this research, a method for abnormality assessment in humans from the perspective of the BCI was proposed by developing a hybrid optimization algorithm based on Electroencephalography (EEG). The hybrid optimization algorithm, called Particle Rider Optimization Algorithm (PROA) is designed through the incorporation of Particle Swarm Optimization (PSO) and Rider Optimization algorithm (ROA). The pre-processing is done for filtering the noise and removal of artefact. In pre-processing, the noise is removed through the Common Average Referencing (CAR) and Laplacian filters, whereas the artifacts are eliminated by Principle component analysis (PCA).

Crossing time windows optimization based on mutual information for hybrid BCI

Hybrid EEG-fNIRS brain-computer interface (HBCI) is widely employed to enhance BCI performance. EEG and fNIRS signals are combined to increase the dimensionality of the information. Time windows are used to select EEG and fNIRS singles synchronously. However, it ignores that specific modal signals have their own characteristics, when the task is stimulated, the information between the modalities will mismatch at the moment, which has a significant impact on the classification performance. Here we propose a novel crossing time windows optimization for mental arithmetic (MA) based BCI. The EEG and fNIRS signals were segmented separately by sliding time windows. Then crossing time windows (CTW) were combined with each one segment from EEG and fNIRS selected independently. Furthermore, EEG and fNIRS features were extracted using Filter Bank Common Spatial Pattern (FBCSP) and statistical methods from each sample. Mutual information was calculated for FBCSP and statistical features to characterize the discrimination of crossing time windows, and the optimal window would be selected based on the largest mutual information. Finally, a sparse structured framework of Fisher Lasso feature selection (FLFS) was designed to select the joint features, and conventional Linear Discriminant Analysis (LDA) was employed to perform classification. We used proposed method for a MA dataset. The classification accuracy of the proposed method is 92.52 ± 5.38% and higher than other methods, which shows the rationality and superiority of the proposed method.

Electrophysiological Decoding of Spatial and Color Processing in Human Prefrontal Cortex

The prefrontal cortex (PFC) plays a pivotal role in goal-directed cognition, yet its representational code remains an open problem with decoding techniques ineffective in disentangling task-relevant variables from PFC. Here we applied regularized linear discriminant analysis to human scalp EEG data and were able to distinguish a mental-rotation task versus a color-perception task with 87% decoding accuracy. Dorsal and ventral areas in lateral PFC provided the dominant features dissociating the two tasks. Our findings show that EEG can reliably decode two independent task states from PFC and emphasize the PFC dorsal/ventral functional specificity in processing the where rotation task versus the what color task.

Neurofeedback and the Aging Brain: A Systematic Review of Training Protocols for Dementia and Mild Cognitive Impairment

Dementia describes a set of symptoms that occur in neurodegenerative disorders and that is characterized by gradual loss of cognitive and behavioral functions. Recently, non-invasive neurofeedback training has been explored as a potential complementary treatment for patients suffering from dementia or mild cognitive impairment. Here we systematically reviewed studies that explored neurofeedback training protocols based on electroencephalography or functional magnetic resonance imaging for these groups of patients. From a total of 1,912 screened studies, 10 were included in our final sample (N = 208 independent participants in experimental and N = 81 in the control groups completing the primary endpoint). We compared the clinical efficacy across studies, and evaluated their experimental designs and reporting quality. In most studies, patients showed improved scores in different cognitive tests. However, data from randomized controlled trials remains scarce, and clinical evidence based on standardized metrics is still inconclusive. In light of recent meta-research developments in the neurofeedback field and beyond, quality and reporting practices of individual studies are reviewed. We conclude with recommendations on best practices for future studies that investigate the effects of neurofeedback training in dementia and cognitive impairment.

Interface, interaction, and intelligence in generalized brain-computer interfaces

A brain-computer interface (BCI) establishes a direct communication channel between a brain and an external device. With recent advances in neurotechnology and artificial intelligence (AI), the brain signals in BCI communication have been advanced from sensation and perception to higher-level cognition activities. While the field of BCI has grown rapidly in the past decades, the core technologies and innovative ideas behind seemingly unrelated BCI systems have never been summarized from an evolutionary point of view. Here, we review various BCI paradigms and present an evolutionary model of generalized BCI technology which comprises three stages: interface, interaction, and intelligence (I3). We also highlight challenges, opportunities, and future perspectives in the development of new BCI technology.

Classification of Prefrontal Cortex Activity Based on Functional Near-Infrared Spectroscopy Data upon Olfactory Stimulation

The sense of smell is one of the most important organs in humans, and olfactory imaging can detect signals in the anterior orbital frontal lobe. This study assessed olfactory stimuli using support vector machines (SVMs) with signals from functional near-infrared spectroscopy (fNIRS) data obtained from the prefrontal cortex. These data included odor stimuli and air state, which triggered the hemodynamic response function (HRF), determined from variations in oxyhemoglobin (oxyHb) and deoxyhemoglobin (deoxyHb) levels; photoplethysmography (PPG) of two wavelengths (raw optical red and near-infrared data); and the ratios of data from two optical datasets. We adopted three SVM kernel functions (i.e., linear, quadratic, and cubic) to analyze signals and compare their performance with the HRF and PPG signals. The results revealed that oxyHb yielded the most efficient single-signal data with a quadratic kernel function, and a combination of HRF and PPG signals yielded the most efficient multi-signal data with the cubic function. Our results revealed superior SVM analysis of HRFs for classifying odor and air status using fNIRS data during olfaction in humans. Furthermore, the olfactory stimulation can be accurately classified by using quadratic and cubic kernel functions in SVM, even for an individual participant data set.

Motor Training Using Mental Workload (MWL) With an Assistive Soft Exoskeleton System: A Functional Near-Infrared Spectroscopy (fNIRS) Study for Brain-Machine Interface (BMI)

Mental workload is a neuroergonomic human factor, which is widely used in planning a system's safety and areas like brain-machine interface (BMI), neurofeedback, and assistive technologies. Robotic prosthetics methodologies are employed for assisting hemiplegic patients in performing routine activities. Assistive technologies' design and operation are required to have an easy interface with the brain with fewer protocols, in an attempt to optimize mobility and autonomy. The possible answer to these design questions may lie in neuroergonomics coupled with BMI systems. In this study, two human factors are addressed: designing a lightweight wearable robotic exoskeleton hand that is used to assist the potential stroke patients with an integrated portable brain interface using mental workload (MWL) signals acquired with portable functional near-infrared spectroscopy (fNIRS) system. The system may generate command signals for operating a wearable robotic exoskeleton hand using two-state MWL signals. The fNIRS system is used to record optical signals in the form of change in concentration of oxy and deoxygenated hemoglobin (HbO and HbR) from the pre-frontal cortex (PFC) region of the brain. Fifteen participants participated in this study and were given hand-grasping tasks. Two-state MWL signals acquired from the PFC region of the participant's brain are segregated using machine learning classifier-support vector machines (SVM) to utilize in operating a robotic exoskeleton hand. The maximum classification accuracy is 91.31%, using a combination of mean-slope features with an average information transfer rate (ITR) of 1.43. These results show the feasibility of a two-state MWL (fNIRS-based) robotic exoskeleton hand (BMI system) for hemiplegic patients assisting in the physical grasping tasks.

Progress in Brain Computer Interface: Challenges and Opportunities

Brain computer interfaces (BCI) provide a direct communication link between the brain and a computer or other external devices. They offer an extended degree of freedom either by strengthening or by substituting human peripheral working capacity and have potential applications in various fields such as rehabilitation, affective computing, robotics, gaming, and neuroscience. Significant research efforts on a global scale have delivered common platforms for technology standardization and help tackle highly complex and non-linear brain dynamics and related feature extraction and classification challenges. Time-variant psycho-neurophysiological fluctuations and their impact on brain signals impose another challenge for BCI researchers to transform the technology from laboratory experiments to plug-and-play daily life. This review summarizes state-of-the-art progress in the BCI field over the last decades and highlights critical challenges.

Using Transcranial Direct Current Stimulation to Augment the Effect of Motor Imagery-Assisted Brain-Computer Interface Training in Chronic Stroke Patients-Cortical Reorganization Considerations

Introduction: Transcranial direct current stimulation (tDCS) has been shown to modulate cortical plasticity, enhance motor learning and post-stroke upper extremity motor recovery. It has also been demonstrated to facilitate activation of brain-computer interface (BCI) in stroke patients. We had previously demonstrated that BCI-assisted motor imagery (MI-BCI) can improve upper extremity impairment in chronic stroke participants. This study was carried out to investigate the effects of priming with tDCS prior to MI-BCI training in chronic stroke patients with moderate to severe upper extremity paresis and to investigate the cortical activity changes associated with training. Methods: This is a double-blinded randomized clinical trial. Participants were randomized to receive 10 sessions of 20-min 1 mA tDCS or sham-tDCS before MI-BCI, with the anode applied to the ipsilesional, and the cathode to the contralesional primary motor cortex (M1). Upper extremity sub-scale of the Fugl-Meyer Assessment (UE-FM) and corticospinal excitability measured by transcranial magnetic stimulation (TMS) were assessed before, after and 4 weeks after intervention. Results: Ten participants received real tDCS and nine received sham tDCS. UE-FM improved significantly in both groups after intervention. Of those with unrecordable motor evoked potential (MEP-) to the ipsilesional M1, significant improvement in UE-FM was found in the real-tDCS group, but not in the sham group. Resting motor threshold (RMT) of ipsilesional M1 decreased significantly after intervention in the real-tDCS group. Short intra-cortical inhibition (SICI) in the contralesional M1 was reduced significantly following intervention in the sham group. Correlation was found between baseline UE-FM score and changes in the contralesional SICI for all, as well as between changes in UE-FM and changes in contralesional RMT in the MEP- group. Conclusion: MI-BCI improved the motor function of the stroke-affected arm in chronic stroke patients with moderate to severe impairment. tDCS did not confer overall additional benefit although there was a trend toward greater benefit. Cortical activity changes in the contralesional M1 associated with functional improvement suggests a possible role for the contralesional M1 in stroke recovery in more severely affected patients. This has important implications in designing neuromodulatory interventions for future studies and tailoring treatment. Clinical Trial Registration: The study was registered at https://clinicaltrials.gov (NCT01897025).

A Computationally Efficient Method for Hybrid EEG-fNIRS BCI Based on the Pearson Correlation

A hybrid brain computer interface (BCI) system considered here is a combination of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). EEG-fNIRS signals are simultaneously recorded to achieve high motor imagery task classification. This integration helps to achieve better system performance, but at the cost of an increase in system complexity and computational time. In hybrid BCI studies, channel selection is recognized as the key element that directly affects the system's performance. In this paper, we propose a novel channel selection approach using the Pearson product-moment correlation coefficient, where only highly correlated channels are selected from each hemisphere. Then, four different statistical features are extracted, and their different combinations are used for the classification through KNN and Tree classifiers. As far as we know, there is no report available that explored the Pearson product-moment correlation coefficient for hybrid EEG-fNIRS BCI channel selection. The results demonstrate that our hybrid system significantly reduces computational burden while achieving a classification accuracy with high reliability comparable to the existing literature.

Quantification of anticipation of excitement with a three-axial model of emotion with EEG

OBJECTIVE

Multiple facets of human emotion underlie diverse and sparse neural mechanisms. Among the many existing models of emotion, the two-dimensional circumplex model of emotion is an important theory. The use of the circumplex model allows us to model variable aspects of emotion; however, such momentary expressions of one's internal mental state still lacks a notion of the third dimension of time. Here, we report an exploratory attempt to build a three-axis model of human emotion to model our sense of anticipatory excitement, 'Waku-Waku' (in Japanese), in which people predictively code upcoming emotional events.

APPROACH

Electroencephalography (EEG) data were recorded from 28 young adult participants while they mentalized upcoming emotional pictures. Three auditory tones were used as indicative cues, predicting the likelihood of the valence of an upcoming picture: positive, negative, or unknown. While seeing an image, the participants judged its emotional valence during the task and subsequently rated their subjective experiences on valence, arousal, expectation, and Waku-Waku immediately after the experiment. The collected EEG data were then analyzed to identify contributory neural signatures for each of the three axes.

MAIN RESULTS

A three-axis model was built to quantify Waku-Waku. As expected, this model revealed the considerable contribution of the third dimension over the classical two-dimensional model. Distinctive EEG components were identified. Furthermore, a novel brain-emotion interface was proposed and validated within the scope of limitations.

SIGNIFICANCE

The proposed notion may shed new light on the theories of emotion and support multiplex dimensions of emotion. With the introduction of the cognitive domain for a brain-computer interface, we propose a novel brain-emotion interface. Limitations of the study and potential applications of this interface are discussed.

Neural Representations of Procedural Knowledge

Although declarative concepts (e.g., apple) have been shown to be identifiable from their functional MRI (fMRI) signatures, the correspondence has yet to be established for executing a complex procedure such as tying a knot. In this study, 7 participants were trained to tie seven knots. Their neural representations of these seven procedures were assessed with fMRI as they imagined tying each knot. A subset of the trained participants physically tied each knot in a later fMRI session. Findings demonstrated that procedural knowledge of tying a particular knot can be reliably identified from its fMRI signature, and such procedural signatures were found here in frontal, parietal, motor, and cerebellar regions. In addition, a classifier trained on mental tying signatures was able to reliably identify when participants were planning to tie knots before they physically tied them, which suggests that the mental-tying and physical-tying procedural signatures are similar. These findings indicate that fMRI activation patterns can illuminate the representation and organization of procedural knowledge.

A probabilistic approach for calibration time reduction in hybrid EEG-fTCD brain-computer interfaces

Background

Generally, brain–computer interfaces (BCIs) require calibration before usage to ensure efficient performance. Therefore, each BCI user has to attend a certain number of calibration sessions to be able to use the system. However, such calibration requirements may be difficult to fulfill especially for patients with disabilities. In this paper, we introduce a probabilistic transfer learning approach to reduce the calibration requirements of our EEG–fTCD hybrid BCI designed using motor imagery (MI) and flickering mental rotation (MR)/word generation (WG) paradigms. The proposed approach identifies the top similar datasets from previous BCI users to a small training dataset collected from a current BCI user and uses these datasets to augment the training data of the current BCI user. To achieve such an aim, EEG and fTCD feature vectors of each trial were projected into scalar scores using support vector machines. EEG and fTCD class conditional distributions were learnt separately using the scores of each class. Bhattacharyya distance was used to identify similarities between class conditional distributions obtained using training trials of the current BCI user and those obtained using trials of previous users.

Results

Experimental results showed that the performance obtained using the proposed transfer learning approach outperforms the performance obtained without transfer learning for both MI and flickering MR/WG paradigms. In particular, it was found that the calibration requirements can be reduced by at least 60.43% for the MI paradigm, while at most a reduction of 17.31% can be achieved for the MR/WG paradigm.

Conclusions

Data collected using the MI paradigm show better generalization across subjects.

Bacomics: a comprehensive cross area originating in the studies of various brain-apparatus conversations

The brain is the most important organ of the human body, and the conversations between the brain and an apparatus can not only reveal a normally functioning or a dysfunctional brain but also can modulate the brain. Here, the apparatus may be a nonbiological instrument, such as a computer, and the consequent brain-computer interface is now a very popular research area with various applications. The apparatus may also be a biological organ or system, such as the gut and muscle, and their efficient conversations with the brain are vital for a healthy life. Are there any common bases that bind these different scenarios? Here, we propose a new comprehensive cross area: Bacomics, which comes from brain-apparatus conversations (BAC) + omics. We take Bacomics to cover at least three situations: (1) The brain is normal, but the conversation channel is disabled, as in amyotrophic lateral sclerosis. The task is to reconstruct or open up new channels to reactivate the brain function. (2) The brain is in disorder, such as in Parkinson's disease, and the work is to utilize existing or open up new channels to intervene, repair and modulate the brain by medications or stimulation. (3) Both the brain and channels are in order, and the goal is to enhance coordinated development between the brain and apparatus. In this paper, we elaborate the connotation of BAC into three aspects according to the information flow: the issue of output to the outside (BAC-1), the issue of input to the brain (BAC-2) and the issue of unity of brain and apparatus (BAC-3). More importantly, there are no less than five principles that may be taken as the cornerstones of Bacomics, such as feedforward and feedback control, brain plasticity, harmony, the unity of opposites and systems principles. Clearly, Bacomics integrates these seemingly disparate domains, but more importantly, opens a much wider door for the research and development of the brain, and the principles further provide the general framework in which to realize or optimize these various conversations.

Development of a Brain-Computer Interface Toggle Switch with Low False-Positive Rate Using Respiration-Modulated Photoplethysmography

Asynchronous brain-computer interfaces (BCIs) based on electroencephalography (EEG) generally suffer from poor performance in terms of classification accuracy and false-positive rate (FPR). Thus, BCI toggle switches based on electrooculogram (EOG) signals were developed to toggle on/off synchronous BCI systems. The conventional BCI toggle switches exhibit fast responses with high accuracy; however, they have a high FPR or cannot be applied to patients with oculomotor impairments. To circumvent these issues, we developed a novel BCI toggle switch that users can employ to toggle on or off synchronous BCIs by holding their breath for a few seconds. Two states-normal breath and breath holding-were classified using a linear discriminant analysis with features extracted from the respiration-modulated photoplethysmography (PPG) signals. A real-time BCI toggle switch was implemented with calibration data trained with only 1-min PPG data. We evaluated the performance of our PPG switch by combining it with a steady-state visual evoked potential-based BCI system that was designed to control four external devices, with regard to the true-positive rate and FPR. The parameters of the PPG switch were optimized through an offline experiment with five subjects, and the performance of the switch system was evaluated in an online experiment with seven subjects. All the participants successfully turned on the BCI by holding their breath for approximately 10 s (100% accuracy), and the switch system exhibited a very low FPR of 0.02 false operations per minute, which is the lowest FPR reported thus far. All participants could successfully control external devices in the synchronous BCI mode. Our results demonstrated that the proposed PPG-based BCI toggle switch can be used to implement practical BCIs.

Machine learning: assessing neurovascular signals in the prefrontal cortex with non-invasive bimodal electro-optical neuroimaging in opiate addiction

Chronic and recurrent opiate use injuries brain tissue and cause serious pathophysiological changes in hemodynamic and subsequent inflammatory responses. Prefrontal cortex (PFC) has been implicated in drug addiction. However, the mechanism underlying systems-level neuroadaptations in PFC during abstinence has not been fully characterized. The objective of our study was to determine what neural oscillatory activity contributes to the chronic effect of opiate exposure and whether the activity could be coupled to neurovascular information in the PFC. We employed resting-state functional connectivity to explore alterations in 8 patients with heroin dependency who stayed abstinent (>3 months; HD) compared with 11 control subjects. A non-invasive neuroimaging strategy was applied to combine electrophysiological signals through electroencephalography (EEG) with hemodynamic signals through functional near-infrared spectroscopy (fNIRS). The electrophysiological signals indicate neural synchrony and the oscillatory activity, and the hemodynamic signals indicate blood oxygenation in small vessels in the PFC. A supervised machine learning method was used to obtain associations between EEG and fNIRS modalities to improve precision and localization. HD patients demonstrated desynchronized lower alpha rhythms and decreased connectivity in PFC networks. Asymmetric excitability and cerebrovascular injury were also observed. This pilot study suggests that cerebrovascular injury in PFC may result from chronic opiate intake.

Brain-Machine Interface-Based Rat-Robot Behavior Control

Brain-machine interface (BMI) provides a bidirectional pathway between the brain and external facilities. The machine-to-brain pathway makes it possible to send artificial information back into the biological brain, interfering neural activities and generating sensations. The idea of the BMI-assisted bio-robotic animal system is accomplished by stimulations on specific sites of the nervous system. With the technology of BMI, animals' locomotion behavior can be precisely controlled as robots, which made the animal turning into bio-robot. In this chapter, we reviewed our lab works focused on rat-robot navigation. The principles of rat-robot system have been briefly described first, including the target brain sites chosen for locomotion control and the design of remote control system. Some methodological advances made by optogenetic technologies for better modulation control have then been introduced. Besides, we also introduced our implementation of "mind-controlled" rat navigation system. Moreover, we have presented our efforts made on combining biological intelligence with artificial intelligence, with developments of automatic control and training system assisted with images or voices inputs. We concluded this chapter by discussing further developments to acquire environmental information as well as promising applications with write-in BMIs.

A Newcomer's Guide to Functional Near Infrared Spectroscopy Experiments

This review presents a practical primer for functional near-infrared spectroscopy (fNIRS) with respect to technology, experimentation, and analysis software. Its purpose is to jump-start interested practitioners considering utilizing a non-invasive, versatile, nevertheless challenging window into the brain using optical methods. We briefly recapitulate relevant anatomical and optical foundations and give a short historical overview. We describe competing types of illumination (trans-illumination, reflectance, and differential reflectance) and data collection methods (continuous wave, time domain and frequency domain). Basic components (light sources, detection, and recording components) of fNIRS systems are presented. Advantages and limitations of fNIRS techniques are offered, followed by a list of very practical recommendations for its use. A variety of experimental and clinical studies with fNIRS are sampled, shedding light on many brain-related ailments. Finally, we describe and discuss a number of freely available analysis and presentation packages suited for data analysis. In conclusion, we recommend fNIRS due to its ever-growing body of clinical applications, state-of-the-art neuroimaging technique and manageable hardware requirements. It can be safely concluded that fNIRS adds a new arrow to the quiver of neuro-medical examinations due to both its great versatility and limited costs.

BrainNet: A Multi-Person Brain-to-Brain Interface for Direct Collaboration Between Brains

We present BrainNet which, to our knowledge, is the first multi-person non-invasive direct brain-to-brain interface for collaborative problem solving. The interface combines electroencephalography (EEG) to record brain signals and transcranial magnetic stimulation (TMS) to deliver information noninvasively to the brain. The interface allows three human subjects to collaborate and solve a task using direct brain-to-brain communication. Two of the three subjects are designated as "Senders" whose brain signals are decoded using real-time EEG data analysis. The decoding process extracts each Sender's decision about whether to rotate a block in a Tetris-like game before it is dropped to fill a line. The Senders' decisions are transmitted via the Internet to the brain of a third subject, the "Receiver," who cannot see the game screen. The Senders' decisions are delivered to the Receiver's brain via magnetic stimulation of the occipital cortex. The Receiver integrates the information received from the two Senders and uses an EEG interface to make a decision about either turning the block or keeping it in the same orientation. A second round of the game provides an additional chance for the Senders to evaluate the Receiver's decision and send feedback to the Receiver's brain, and for the Receiver to rectify a possible incorrect decision made in the first round. We evaluated the performance of BrainNet in terms of (1) Group-level performance during the game, (2) True/False positive rates of subjects' decisions, and (3) Mutual information between subjects. Five groups, each with three human subjects, successfully used BrainNet to perform the collaborative task, with an average accuracy of 81.25%. Furthermore, by varying the information reliability of the Senders by artificially injecting noise into one Sender's signal, we investigated how the Receiver learns to integrate noisy signals in order to make a correct decision. We found that like conventional social networks, BrainNet allows Receivers to learn to trust the Sender who is more reliable, in this case, based solely on the information transmitted directly to their brains. Our results point the way to future brain-to-brain interfaces that enable cooperative problem solving by humans using a "social network" of connected brains.

Common spatial pattern and wavelet decomposition for motor imagery EEG- fTCD brain-computer interface

BACKGROUND

Recently, hybrid brain-computer interfaces (BCIs) combining more than one modality have been investigated with the aim of boosting the performance of the existing single-modal BCIs in terms of accuracy and information transfer rate (ITR). Previously, we introduced a novel hybrid BCI in which EEG and fTCD modalities are used simultaneously to measure electrical brain activity and cerebral blood velocity during motor imagery (MI) tasks.

NEW METHOD

In this paper, we used multi-scale analysis and common spatial pattern algorithm to extract EEG and fTCD features. Moreover, we proposed probabilistic fusion of EEG and fTCD evidences instead of concatenating EEG and fTCD feature vectors corresponding to each trial. A Bayesian approach was proposed to fuse EEG and fTCD evidences under 3 different assumptions.

RESULTS

Experimental results showed that 93.85%, 93.71%, and 100% average accuracies and 19.89, 26.55, and 40.83 bits/min average ITRs were achieved for right MI vs baseline, left MI versus baseline, and right MI versus left MI respectively.

COMPARISON WITH EXISTING METHODS

These performance measures outperformed the results we obtained before in our preliminary study in which average accuracies of 88.33%, 89.48%, and 82.38% and average ITRs of 4.17, 5.45, and 10.57 bits/min were achieved for right MI versus baseline, left MI versus baseline, and right MI versus left MI respectively. Moreover, in terms of both accuracy and speed, the EEG- fTCD BCI with the proposed analysis techniques outperformed all EEG- fNIRS studies in comparison.

CONCLUSIONS

The proposed system is a more accurate and faster alternative to EEG-fNIRS systems.

Human Mind Control of Rat Cyborg's Continuous Locomotion with Wireless Brain-to-Brain Interface

Brain-machine interfaces (BMIs) provide a promising information channel between the biological brain and external devices and are applied in building brain-to-device control. Prior studies have explored the feasibility of establishing a brain-brain interface (BBI) across various brains via the combination of BMIs. However, using BBI to realize the efficient multidegree control of a living creature, such as a rat, to complete a navigation task in a complex environment has yet to be shown. In this study, we developed a BBI from the human brain to a rat implanted with microelectrodes (i.e., rat cyborg), which integrated electroencephalogram-based motor imagery and brain stimulation to realize human mind control of the rat’s continuous locomotion. Control instructions were transferred from continuous motor imagery decoding results with the proposed control models and were wirelessly sent to the rat cyborg through brain micro-electrical stimulation. The results showed that rat cyborgs could be smoothly and successfully navigated by the human mind to complete a navigation task in a complex maze. Our experiments indicated that the cooperation through transmitting multidimensional information between two brains by computer-assisted BBI is promising.

A novel motor imagery hybrid brain computer interface using EEG and functional transcranial Doppler ultrasound

BACKGROUND

Hybrid brain computer interfaces (BCIs) combining multiple brain imaging modalities have been proposed recently to boost the performance of single modality BCIs.

NEW METHOD

In this paper, we propose a novel motor imagery (MI) hybrid BCI that uses electrical brain activity recorded using Electroencephalography (EEG) as well as cerebral blood flow velocity measured using functional transcranial Doppler ultrasound (fTCD). Features derived from the power spectrum for both EEG and fTCD signals were calculated. Mutual information and linear support vector machines (SVM) were employed for feature selection and classification.

RESULTS

Using the EEG-fTCD combination, average accuracies of 88.33%, 89.48%, and 82.38% were achieved for right arm MI versus baseline, left arm MI versus baseline, and right arm MI versus left arm MI respectively. Compared to performance measures obtained using EEG only, the hybrid system provided significant improvement in terms of accuracy by 4.48%, 5.36%, and 4.76% respectively. In addition, average transmission rates of 4.17, 5.45, and 10.57 bits/min were achieved for right arm MI versus baseline, left arm MI versus baseline, and right arm MI versus left arm MI respectively.

COMPARISON WITH EXISTING METHODS

Compared to EEG-fNIRS hybrid BCIs in literature, we achieved similar or higher accuracies with shorter task duration.

CONCLUSIONS

The proposed hybrid system is a promising candidate for real-time BCI applications.

Decoding Voluntary Movement of Single Hand Based on Analysis of Brain Connectivity by Using EEG Signals

Research about decoding neurophysiological signals mainly aims to elucidate the details of human motion control from the perspective of neural activity. We performed brain connectivity analysis with EEG to propose a brain functional network (BFN) and used a feature extraction algorithm for decoding the voluntary hand movement of a subject. By analyzing the characteristic parameters obtained from the BFN, we extracted the most important electrode nodes and frequencies for identifying the direction of movement of a hand. The results demonstrated that the most sensitive EEG components were for frequencies delta, theta, and gamma1 from electrodes F4, F8, C3, Cz, C4, CP4, T3, and T4. Finally, we proposed a model for decoding voluntary movement of the right hand by using a hierarchical linear model (HLM). Through a voluntary hand movement experiment in a spiral trajectory, the Poisson coefficient between the measurement trajectory and the decoding trajectory was used as a test standard to compare the HLM with the traditional multiple linear regression model. It was found that the decoding model based on the HLM obtained superior results. This paper contributes a feature extraction method based on brain connectivity analysis that can mine more comprehensive feature information related to a specific mental state of a subject. The decoding model based on the HLM possesses a strong structure for data manipulation that facilitates precise decoding.

Towards optimal visual presentation design for hybrid EEG-fTCD brain-computer interfaces

OBJECTIVE

In this paper, we introduce a novel hybrid brain-computer interface (BCI) system that measures electrical brain activity as well as cerebral blood velocity using electroencephalography (EEG) and functional transcranial Doppler ultrasound (fTCD) respectively in response to flickering mental rotation (MR) and flickering word generation (WG) cognitive tasks as well as a fixation cross that represents the baseline. This work extends our previous approach, in which we showed that motor imagery induces simultaneous changes in EEG and fTCD to enable task discrimination; and hence, provides a design approach for a hybrid BCI. Here, we show that instead of using motor imagery, the proposed visual stimulation technique enables the design of an EEG-fTCD based BCI with higher accuracy.

APPROACH

Features based on the power spectrum of EEG and fTCD signals were calculated. Mutual information and support vector machines were used for feature selection and classification purposes.

MAIN RESULTS

EEG-fTCD combination outperformed EEG by 4.05% accuracy for MR versus baseline problem and by 5.81% accuracy for WG versus baseline problem. An average accuracy of 92.38% was achieved for MR versus WG problem using the hybrid combination. Average transmission rates of 4.39, 3.92, and 5.60 bits min^-1 were obtained for MR versus baseline, WG versus baseline, and MR versus WG problems respectively.

SIGNIFICANCE

In terms of accuracy, the current visual presentation outperforms the motor imagery visual presentation we designed before for the EEG-fTCD system by 10% accuracy for task versus task problem. Moreover, the proposed system outperforms the state of the art hybrid EEG-fNIRS BCIs in terms of accuracy and/or information transfer rate. Even though there are still limitations of the proposed system, such promising results show that the proposed hybrid system is a feasible candidate for real-time BCIs.

Feature Extraction and Classification Methods for Hybrid fNIRS-EEG Brain-Computer Interfaces

In this study, a brain-computer interface (BCI) framework for hybrid functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) for locked-in syndrome (LIS) patients is investigated. Brain tasks, channel selection methods, and feature extraction and classification algorithms available in the literature are reviewed. First, we categorize various types of patients with cognitive and motor impairments to assess the suitability of BCI for each of them. The prefrontal cortex is identified as a suitable brain region for imaging. Second, the brain activity that contributes to the generation of hemodynamic signals is reviewed. Mental arithmetic and word formation tasks are found to be suitable for use with LIS patients. Third, since a specific targeted brain region is needed for BCI, methods for determining the region of interest are reviewed. The combination of a bundled-optode configuration and threshold-integrated vector phase analysis turns out to be a promising solution. Fourth, the usable fNIRS features and EEG features are reviewed. For hybrid BCI, a combination of the signal peak and mean fNIRS signals and the highest band powers of EEG signals is promising. For classification, linear discriminant analysis has been most widely used. However, further research on vector phase analysis as a classifier for multiple commands is desirable. Overall, proper brain region identification and proper selection of features will improve classification accuracy. In conclusion, five future research issues are identified, and a new BCI scheme, including brain therapy for LIS patients and using the framework of hybrid fNIRS-EEG BCI, is provided.

Electro-deposited Nanoporous Platinum Electrode for EEG Monitoring

BACKGROUND

One of the key issues in electroencephalogram (EEG) monitoring is accurate signal acquisition with less cumbersome electrodes. In this study, the L2 phase electro-deposited nanoporous platinum (L2-ePt) electrode is introduced, which is a new type of electrode that utilizes a stable nanoporous platinum surface to reduce the skin-electrode impedance.

METHODS

L2-ePt electrodes were fabricated using electro-deposition technique. Then, the effect of the nanoporous surface on the surface roughness and the electrode impedance were observed from the L2-ePt electrodes and the flat platinum (FlatPt) electrode. The skin-electrode impedances of the L2-ePt electrodes, a gold cup electrode, and the FlatPt electrode were evaluated when placed on the hairy occipital area of the head in ten subjects. For the validation of using the L2-ePt electrode, a correlational analysis of the alpha rhythms was performed in the same subjects for simultaneous EEG recordings using the L2-ePt and clinically-used EEG electrodes.

RESULTS

The results indicated that the L2-ePt electrode with a roughness factor of 200 had the lowest mean impedance performance. Moreover, the proposed L2-ePt electrode showed a significantly lower mean skin-electrode impedance than the FlatPt electrode. Finally, the EEG signal quality recorded by the L2-ePt electrode (r = 0.94) was comparable to that of the clinically-used gold cup electrode.

CONCLUSION

Based on these results, the proposed L2-ePt electrode is suitable for use in various high-quality EEG applications.

Multimodal 2D Brain Computer Interface

In this work we used multimodal, non-invasive brain signal recording systems, namely Near Infrared Spectroscopy (NIRS), disc electrode electroencephalography (EEG) and tripolar concentric ring electrodes (TCRE) electroencephalography (tEEG). 7 healthy subjects participated in our experiments to control a 2-D Brain Computer Interface (BCI). Four motor imagery task were performed, imagery motion of the left hand, the right hand, both hands and both feet. The signal slope (SS) of the change in oxygenated hemoglobin concentration measured by NIRS was used for feature extraction while the power spectrum density (PSD) of both EEG and tEEG in the frequency band 8-30Hz was used for feature extraction. Linear Discriminant Analysis (LDA) was used to classify different combinations of the aforementioned features. The highest classification accuracy (85.2%) was achieved by using features from all the three brain signals recording modules. The improvement in classification accuracy was highly significant (p = 0.0033) when using the multimodal signals features as compared to pure EEG features.

Assessment and Communication for People with Disorders of Consciousness

In this experiment, we demonstrate a suite of hybrid Brain-Computer Interface (BCI)-based paradigms that are designed for two applications: assessing the level of consciousness of people unable to provide motor response and, in a second stage, establishing a communication channel for these people that enables them to answer questions with either 'yes' or 'no'. The suite of paradigms is designed to test basic responses in the first step and to continue to more comprehensive tasks if the first tests are successful. The latter tasks require more cognitive functions, but they could provide communication, which is not possible with the basic tests. All assessment tests produce accuracy plots that show whether the algorithms were able to detect the patient's brain's response to the given tasks. If the accuracy level is beyond the significance level, we assume that the subject understood the task and was able to follow the sequence of commands presented via earphones to the subject. The tasks require users to concentrate on certain stimuli or to imagine moving either the left or right hand. All tasks are designed around the assumption that the user is unable to use the visual modality, and thus, all stimuli presented to the user (including instructions, cues, and feedback) are auditory or tactile.

Non-invasive transmission of sensorimotor information in humans using an EEG/focused ultrasound brain-to-brain interface

We present non-invasive means that detect unilateral hand motor brain activity from one individual and subsequently stimulate the somatosensory area of another individual, thus, enabling the remote hemispheric link between each brain hemisphere in humans. Healthy participants were paired as a sender and a receiver. A sender performed a motor imagery task of either right or left hand, and associated changes in the electroencephalogram (EEG) mu rhythm (8-10 Hz) originating from either hemisphere were programmed to move a computer cursor to a target that appeared in either left or right of the computer screen. When the cursor reaches its target, the outcome was transmitted to another computer over the internet, and actuated the focused ultrasound (FUS) devices that selectively and non-invasively stimulated either the right or left hand somatosensory area of the receiver. Small FUS transducers effectively allowed for the independent administration of stimulatory ultrasonic waves to somatosensory areas. The stimulation elicited unilateral tactile sensation of the hand from the receiver, thus establishing the hemispheric brain-to-brain interface (BBI). Although there was a degree of variability in task accuracy, six pairs of volunteers performed the BBI task in high accuracy, transferring approximately eight commands per minute. Linkage between the hemispheric brain activities among individuals suggests the possibility for expansion of the information bandwidth in the context of BBI.

Decoding of top-down cognitive processing for SSVEP-controlled BMI

We present a fast and accurate non-invasive brain-machine interface (BMI) based on demodulating steady-state visual evoked potentials (SSVEPs) in electroencephalography (EEG). Our study reports an SSVEP-BMI that, for the first time, decodes primarily based on top-down and not bottom-up visual information processing. The experimental setup presents a grid-shaped flickering line array that the participants observe while intentionally attending to a subset of flickering lines representing the shape of a letter. While the flickering pixels stimulate the participant’s visual cortex uniformly with equal probability, the participant’s intention groups the strokes and thus perceives a ‘letter Gestalt’. We observed decoding accuracy of 35.81% (up to 65.83%) with a regularized linear discriminant analysis; on average 2.05-fold, and up to 3.77-fold greater than chance levels in multi-class classification. Compared to the EEG signals, an electrooculogram (EOG) did not significantly contribute to decoding accuracies. Further analysis reveals that the top-down SSVEP paradigm shows the most focalised activation pattern around occipital visual areas; Granger causality analysis consistently revealed prefrontal top-down control over early visual processing. Taken together, the present paradigm provides the first neurophysiological evidence for the top-down SSVEP BMI paradigm, which potentially enables multi-class intentional control of EEG-BMIs without using gaze-shifting.

PET Mapping for Brain-Computer Interface Stimulation of the Ventroposterior Medial Nucleus of the Thalamus in Rats with Implanted Electrodes

Brain-computer interface (BCI) technology has great potential for improving the quality of life for neurologic patients. This study aimed to use PET mapping for BCI-based stimulation in a rat model with electrodes implanted in the ventroposterior medial (VPM) nucleus of the thalamus.

METHODS

PET imaging studies were conducted before and after stimulation of the right VPM.

RESULTS

Stimulation induced significant orienting performance. (18)F-FDG uptake increased significantly in the paraventricular thalamic nucleus, septohippocampal nucleus, olfactory bulb, left crus II of the ansiform lobule of the cerebellum, and bilaterally in the lateral septum, amygdala, piriform cortex, endopiriform nucleus, and insular cortex, but it decreased in the right secondary visual cortex, right simple lobule of the cerebellum, and bilaterally in the somatosensory cortex.

CONCLUSION

This study demonstrated that PET mapping after VPM stimulation can identify specific brain regions associated with orienting performance. PET molecular imaging may be an important approach for BCI-based research and its clinical applications.