Evaluation of color modulation in visual P300-speller using new stimulus patterns

Objective The stimulus color of P300-BCI systems has been successfully modified. However, the effects of different color combinations have not been widely investigated. In this study, we designed new stimulus patterns to evaluate the influence of color modulation on the BCI performance and waveforms of the evoked related potential (ERP).Methods Comparison was performed for three new stimulus patterns consisting of red face and colored block-shape, namely, red face with a white rectangle (RFW), red face with a blue rectangle (RFB), and red face with a red rectangle (RFR). Bayesian linear discriminant analysis (BLDA) was used to construct the individual classifier model. Repeated-measures ANOVA and Bonferroni correction were applied for statistical analysis. Results The RFW pattern obtained the highest average online accuracy with 96.94%, and those of RFR and RFB patterns were 93.61% and of 92.22% respectively. Significant differences in online accuracy and information transfer rate (ITR) were found between RFW and RFR patterns (p < 0.05). Conclusion Compared with RFR and RFB patterns, RFW yielded the best performance in P300-BCI. These new stimulus patterns with different color combinations have considerable importance to BCI applications and user-friendliness.

Prosthetic control system based on motor imagery

A brain-computer interface (BCI) can be used for function replacement through the control of devices, such as prostheses, by identifying the subject's intent from brain activity. We process electroencephalography (EEG) signals related to motor imagery to improve the accuracy of intent classification. The original signals are decomposed into three layers based on db4 wavelet basis. The wavelet soft threshold denoising method is used to improve the signal-to-noise ratio. The sample entropy algorithm is used to extract the features of the signal after noise reduction and reconstruction. Combined with event-related synchronisation/desynchronisation (ERS/ERD) phenomenon, the sample entropy in the motor imagery time periods of C3, C4 and Cz is selected as the feature value. Feature vectors are then used as the input of three classifiers. From the evaluated classifiers, the backpropagation (BP) neural network provides the best EEG signal classification (93% accuracy). BP neural network is thus selected as the final classifier and used to design a prosthetic control system based on motor imagery. The classification results are wirelessly transmitted to control a prosthesis successfully via commands of hand opening, fist clenching, and external wrist rotation. Such functionality may allow amputees to complete simple activities of daily living. Thus, this study is valuable for subsequent developments in rehabilitation.

Discriminating three motor imagery states of the same joint for brain-computer interface

The classification of electroencephalography (EEG) induced by the same joint is one of the major challenges for brain-computer interface (BCI) systems. In this paper, we propose a new framework, which includes two parts, feature extraction and classification. Based on local mean decomposition (LMD), cloud model, and common spatial pattern (CSP), a feature extraction method called LMD-CSP is proposed to extract distinguishable features. In order to improve the classification results multi-objective grey wolf optimization twin support vector machine (MOGWO-TWSVM) is applied to discriminate the extracted features. We evaluated the performance of the proposed framework on our laboratory data sets with three motor imagery (MI) tasks of the same joint (shoulder abduction, extension, and flexion), and the average classification accuracy was 91.27%. Further comparison with several widely used methods showed that the proposed method had better performance in feature extraction and pattern classification. Overall, this study can be used for developing high-performance BCI systems, enabling individuals to control external devices intuitively and naturally.

Automatic feature extraction and fusion recognition of motor imagery EEG using multilevel multiscale CNN

A motor imagery EEG (MI-EEG) signal is often selected as the driving signal in an active brain computer interface (BCI) system, and it has been a popular field to recognize MI-EEG images via convolutional neural network (CNN), which poses a potential problem for maintaining the integrity of the time-frequency-space information in MI-EEG images and exploring the feature fusion mechanism in the CNN. However, information is excessively compressed in the present MI-EEG image, and the sequential CNN is unfavorable for the comprehensive utilization of local features. In this paper, a multidimensional MI-EEG imaging method is proposed, which is based on time-frequency analysis and the Clough-Tocher (CT) interpolation algorithm. The time-frequency matrix of each electrode is generated via continuous wavelet transform (WT), and the relevant section of frequency is extracted and divided into nine submatrices, the longitudinal sums and lengths of which are calculated along the directions of frequency and time successively to produce a 3 × 3 feature matrix for each electrode. Then, feature matrix of each electrode is interpolated to coincide with their corresponding coordinates, thereby yielding a WT-based multidimensional image, called WTMI. Meanwhile, a multilevel and multiscale feature fusion convolutional neural network (MLMSFFCNN) is designed for WTMI, which has dense information, low signal-to-noise ratio, and strong spatial distribution. Extensive experiments are conducted on the BCI Competition IV 2a and 2b datasets, and accuracies of 92.95% and 97.03% are yielded based on 10-fold cross-validation, respectively, which exceed those of the state-of-the-art imaging methods. The kappa values and p values demonstrate that our method has lower class skew and error costs. The experimental results demonstrate that WTMI can fully represent the time-frequency-space features of MI-EEG and that MLMSFFCNN is beneficial for improving the collection of multiscale features and the fusion recognition of general and abstract features for WTMI.

Evoking highly focal percepts in the fingertips through targeted stimulation of sulcal regions of the brain for sensory restoration

Background:

Paralysis and neuropathy, affecting millions of people worldwide, can be accompanied by significant loss of somatosensation. With tactile sensation being central to achieving dexterous movement, brain-computer interface (BCI) researchers have used intracortical and cortical surface electrical stimulation to restore somatotopically-relevant sensation to the hand. However, these approaches are restricted to stimulating the gyral areas of the brain. Since representation of distal regions of the hand extends into the sulcal regions of human primary somatosensory cortex (S1), it has been challenging to evoke sensory percepts localized to the fingertips.

Objective/hypothesis:

Targeted stimulation of sulcal regions of S1, using stereoelectroencephalography (SEEG) depth electrodes, can evoke focal sensory percepts in the fingertips.

Methods:

Two participants with intractable epilepsy received cortical stimulation both at the gyri via high-density electrocorticography (HD-ECoG) grids and in the sulci via SEEG depth electrode leads. We characterized the evoked sensory percepts localized to the hand.

Results:

We show that highly focal percepts can be evoked in the fingertips of the hand through sulcal stimulation. fMRI, myelin content, and cortical thickness maps from the Human Connectome Project elucidated specific cortical areas and sub-regions within S1 that evoked these focal percepts. Within-participant comparisons showed that percepts evoked by sulcal stimulation via SEEG electrodes were significantly more focal (80% less area; p = 0.02) and localized to the fingertips more often, than by gyral stimulation via HD-ECoG electrodes. Finally, sulcal locations with consistent modulation of high-frequency neural activity during mechanical tactile stimulation of the fingertips showed the same somatotopic correspondence as cortical stimulation.

Conclusions:

Our findings indicate minimally invasive sulcal stimulation via SEEG electrodes could be a clinically viable approach to restoring sensation.

Sub-band target alignment common spatial pattern in brain-computer interface

BACKGROUND AND OBJECTIVE

In the brain computer interface (BCI) field, using sub-band common spatial pattern (SBCSP) and filter bank common spatial pattern (FBCSP) can improve the accuracy of classification by selection a specific frequency band. However, in the cross-subject classification, due to the individual differences between different subjects, the performance is limited.

METHODS

This paper introduces the idea of transfer learning and presents the sub-band target alignment common spatial pattern (SBTACSP) method and applies it to the cross-subject classification of motor imagery (MI) EEG signals. First, the EEG signals are bandpass-filtered into multiple frequency bands (sub-band filtering). Subsequently, the source domain trails are aligned into the target domain space in each frequency band. The CSP algorithm is then employed to extract features among which more representative features are selected by the minimum redundancy maximum relevance (mRMR) approach from each sub-band. Then the features of all sub-bands are fused. Finally, conventional linear discriminant analysis (LDA) algorithm is used for MI classification.

RESULTS

Our method is evaluated on Datasets Ⅱa and Ⅱb of the BCI Competition Ⅳ. Compared with six state-of-the-art algorithms, the proposed SBTACSP method performed relatively the best and achieved a mean classification accuracy of 75.15% and 66.85% in cross-subject classification of Datasets Ⅱa and Ⅱb respectively.

CONCLUSION

Therefore, the combination of sub-band filtering and transfer learning achieves superior classification performance compared to either one. The proposed algorithms will greatly promote the practical application of MI based BCIs.

Enhancing P300 based character recognition performance using a combination of ensemble classifiers and a fuzzy fusion method

BACKGROUND

P300-based brain-computer interfaces provide communication pathways without the need for muscle activity by recognizing electrical signals from the brain. The P300 speller is one of the most commonly used BCI applications, as it is very simple and reliable, and it is capable of reaching satisfactory communication performance. However, as with other BCIs, it remains a challenge to improve the P300 speller's performance to increase its practical usability.

NEW METHODS

In this study, we propose a novel multi-feature subset fuzzy fusion (MSFF) framework for the P300 speller to recognize the users' spelling intention. This method includes two parts: 1) feature selection by the Lasso algorithm and feature division; 2) the construction of ensemble LDA classifiers and the fuzzy fusion of those classifiers to recognize user intention.

RESULTS

The proposed framework is evaluated in three public datasets and achieves an average accuracy of 100% after 4 epochs for BCI Competition II Dataset IIb, 96% for BCI Competition III dataset II and 98.3% for the BNCI Horizon Dataset. It indicates that the proposed MSFF method can make use of temporal information of signals and helps to enhance classification performance.

COMPARISON WITH EXISTING METHODS

The proposed MSFF method yields better or comparable performance than previously reported machine learning algorithms.

CONCLUSIONS

The proposed MSFF method is able to improve the performance of P300-based BCIs.

Ensemble Regularized Common Spatio-Spectral Pattern (ensemble RCSSP) model for motor imagery-based EEG signal classification

The Brain-Computer interface system provides a communication path among the brain and computer, and recently, it is the subject of increasing attention. One of the most common paradigms of BCI systems is motor imagery. Currently, to classify motor imagery EEG signals, Common Spatial Patterns (CSP) are extensively used. Generally, the recorded motor imagery EEG signals in BCI are noisy, non-stationary, thus significantly reducing the BCI system's performance. It is shown that the CSP algorithm has a good performance in the classification of various types of motor imagery data. However, once the number of trials is low, or the data are noisy, overfitting will probably occur, which precludes extracting an appropriate spatial filter. Another drawback of the CSP is that it only extracts spatial-based filters. Therefore, the current study attempts to decrease the probability of overfitting in the CSP algorithm by presenting an improved method called Ensemble Regularized Common Spatio-Spectral Pattern (Ensemble RCSSP). Compared with other CSP and improved versions of CSP algorithms, our proposed models indicate a better accuracy, robustness, and reliability for motor imagery EEG data. The performance of the proposed Ensemble RCSSP has been tested for BCI Competition IV, Dataset 1, and BCI Competition III, Dataset Iva. Compared with other methods, performance is improved, and on average, the accuracy for all subjects is reached to 82.64% and 86.91% for the first and second datasets, respectively.

Effortless Retaliation: the Neural Dynamics of Interpersonal Intentions in a Chicken Game Using Brain-Computer Interface

The desire for retaliation is a common response across a majority of human societies. However, the neural mechanisms underlying aggression and retaliation remain unclear. Previous studies on social intentions are confounded by a low-level response-related brain activity. Using an Electroencephalogram (EEG)-based brain–computer interface combined with the Chicken Game, our study examined the neural dynamics of aggression and retaliation after controlling for nonessential response-related neural signals. Our results show that aggression is associated with reduced alpha event-related desynchronization (alpha-ERD), indicating reduced mental effort. Moreover, retaliation and tit-for-tat strategy use are also linked with smaller alpha-ERD. Our study provides a novel method to minimize motor confounds and demonstrates that choosing aggression and retaliation is less effortful in social conflicts.

Space-time filter for SSVEP brain-computer interface based on the minimum variance distortionless response

Brain-computer interfaces (BCI) based on steady-state visually evoked potentials (SSVEP) have been increasingly used in different applications, ranging from entertainment to rehabilitation. Filtering techniques are crucial to detect the SSVEP response since they can increase the accuracy of the system. Here, we present an analysis of a space-time filter based on the Minimum Variance Distortionless Response (MVDR). We have compared the performance of a BCI-SSVEP using the MVDR filter to other classical approaches: Common Average Reference (CAR) and Canonical Correlation Analysis (CCA). Moreover, we combined the CAR and MVDR techniques, totalling four filtering scenarios. Feature extraction was performed using Welch periodogram, Fast Fourier transform, and CCA (as extractor) with one and two harmonics. Feature selection was performed by forward wrappers, and a linear classifier was employed for discrimination. The main analyses were carried out over a database of ten volunteers, considering two cases: four and six visual stimuli. The results show that the BCI-SSVEP using the MVDR filter achieves the best performance among the analysed scenarios. Interestingly, the system's accuracy using the MVDR filter is practically constant even when the number of visual stimuli was increased, whereas degradation was observed for the other techniques.

Adding Tactile Feedback and Changing ISI to Improve BCI Systems' Robustness: An Error-Related Potential Study

Nowadays, the brain-computer interface (BCI) systems attract much more attention than before, yet they have not found their ways into our lives since their accuracy is not satisfying. Error Related Potential (ErRP) is a potential that occurs in human brain signals when an unintended event happens, against ones' will and thoughts. An example is the occurrence of an error in BCI systems. Investigation of the ErRP could enable researchers to increase the accuracy of BCI systems by detecting instances of inaccuracy in the system. In this research the effects of two parameters on the ErRP are studied: (1) The Motor Imagery Time, also known as Inter-Stimulus Interval (ISI) and (2) different types of feedback (Visual and Tactile). The statistical analysis of the ErRP characteristics showed that feedback type meaningfully affects the ErRP in a cue-paced BCI system and it will affect the time of occurrence of this potential. To validate the proposed idea, different feature extraction, and classification techniques were used for the classification of the BCI system responses. It was shown that by proper selection of the parameters and features, the accuracy of the system could be improved. Tactile feedback together with higher ISI could increase the accuracy of finding erroneous trials up to 90%. The proposed method's accuracy was significantly higher (p-value < 0.05) compared to other methods of feature extraction.

Exploration of illusory visual motion stimuli: An EEG-based brain-computer interface for practical assistive communication systems

This paper presents an illusory visual motion stimulus-based brain-computer interface (BCI). We aim to use the proposed system to enhance the motor imagery (MI) modality. Since motor imagery requires a long time for training, a stimulation method with external stimuli through the sensory system is an alternative method for increasing efficiency. The research is divided into two parts. First, we observed the visual motion illusion pattern based on brain topographic maps for the novel BCI modality. Second, we implemented the illusory visual motion stimulus-based BCI system. Arrow and moving-arrow patterns were used to modulate alpha rhythms at the visual and motor cortex. The arrow pattern had an average classification accuracy of approximately 78.5%. Additionally, illusory visual motion stimulus-based BCI systems are proposed using the proposed feature extraction and decision-making algorithm. This proposed BCI system can control the cursor moving in the left or right direction with the designed algorithm to create five commands for assistive communication. Ten volunteers participated in the experiment, and a brain-computer interface system with motor imagery and an illusory visual motion stimulus were used to compare efficiencies. The results showed that the proposed method achieved approximately 4% higher accuracy than motor imagery. The accuracy of the proposed illusory visual motion stimulus and algorithm was approximately 80.3%. Therefore, an illusory visual motion stimulus hybrid BCI system can be incorporated into the MI-based BCI system for beginner motor imagery. Based on the results, the proposed assistive communication system can be used to enhance communication in people with severe disabilities.

A multi-modal modified feedback self-paced BCI to control the gait of an avatar

Brain-computer interfaces (BCI) have been used to control the gait of a virtual self-avatar with a proposed application in the field of gait rehabilitation.

OBJECTIVE

to develop a high performance multi-modal BCI to control single steps and forward walking of an immersive virtual reality avatar. This system will overcome the limitation of existing systems.

APPROACH

This system used MI of these actions, in cue-paced and self-paced modes. Twenty healthy participants participated in this 4 sessions study across 4 different days. They were cued to imagine a single step forward with their right or left foot, or to imagine walking forward. They were instructed to reach a target by using the MI of multiple steps (self-paced switch-control mode) or by maintaining MI of forward walking (continuous-control mode). The movement of the avatar was controlled by two calibrated RLDA classifiers that used the µ power spectral density (PSD) over the foot area of the motor cortex as a feature. The classifiers were retrained after every session. For a subset of the trials, positive modified feedback was presented to half of the participants.

MAIN RESULTS

All participants were able to operate the BCI. Their average offline performance, after retraining the classifiers was 86.0 ± 6.1%, showing that the recalibration of the classifiers enhanced the offline performance of the BCI (p < 0.01). The average online performance was 85.9 ± 8.4% showing that modified feedback enhanced BCI performance (p =0.001). The average performance was 83% at self-paced switch control and 92% at continuous control mode.

SIGNIFICANCE

This study reports on the first novel integration of different design approaches, different control modes and different performance enhancement techniques, all in parallel in one single high performance and multi-modal BCI system, to control single steps and forward walking of an immersive virtual reality avatar.

Optical brain imaging and its application to neurofeedback

Besides passive recording of brain electric or magnetic activity, also non-ionizing electromagnetic or optical radiation can be used for real-time brain imaging. Here, changes in the radiation's absorption or scattering allow for continuous in vivo assessment of regional neurometabolic and neurovascular activity. Besides magnetic resonance imaging (MRI), over the last years, also functional near-infrared spectroscopy (fNIRS) was successfully established in real-time metabolic brain imaging. In contrast to MRI, fNIRS is portable and can be applied at bedside or in everyday life environments, e.g., to restore communication and movement. Here we provide a comprehensive overview of the history and state-of-the-art of real-time optical brain imaging with a special emphasis on its clinical use towards neurofeedback and brain-computer interface (BCI) applications. Besides pointing to the most critical challenges in clinical use, also novel approaches that combine real-time optical neuroimaging with other recording modalities (e.g. electro- or magnetoencephalography) are described, and their use in the context of neuroergonomics, neuroenhancement or neuroadaptive systems discussed.

The Influence of Visual Attention on The Performance of A Novel Tactile P300 Brain-Computer Interface with Cheeks-Stim Paradigm

Tactile P300 brain-computer interface (BCI) generally has a worse accuracy and information transfer rate (ITR) than the visual-based BCI. It may be due to the fact that human beings have a relatively poor tactile perception. This study investigated the influence of visual attention on the performance of a tactile P300 BCI. We designed our paradigms based on a novel cheeks-stim paradigm which attached the stimulators on the subject's cheeks. Two paradigms were designed as follows: a paradigm with no visual attention and another paradigm with visual attention to the target position. Eleven subjects were invited to perform the two paradigms. We also recorded and analyzed the eyeball movement data during the paradigm with visual attention to explore whether the eyeball movement would have an effect on the BCI classification. The average online accuracy was 89.09% for the paradigm with visual attention, which was significantly higher than that of the paradigm with no visual attention (70.45%). Significant difference in ITR was also found between the two paradigms ([Formula: see text]). The results demonstrated that visual attention was an effective method to improve the performance of tactile P300 BCI. Our findings suggested that it may be feasible to complete an efficient tactile BCI system by adding visual attention.

A Training Data-Driven Canonical Correlation Analysis Algorithm for Designing Spatial Filters to Enhance Performance of SSVEP-Based BCIs

Canonical correlation analysis (CCA) is an effective spatial filtering algorithm widely used in steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs). In existing CCA methods, training data are used for constructing templates of stimulus targets and the spatial filters are created between the template signals and a single-trial testing signal. The fact that spatial filters rely on testing data, however, results in low classification performance of CCA compared to other state-of-the-art algorithms such as task-related component analysis (TRCA). In this study, we proposed a novel CCA method in which spatial filters are estimated using training data only. This is achieved by using observed EEG training data and their SSVEP components as the two inputs of CCA and the objective function is optimized by averaging multiple training trials. In this case, we proved in theory that the two spatial filters estimated by the CCA are equivalent, and that the CCA and TRCA are also equivalent under certain hypotheses. A benchmark SSVEP data set from 35 subjects was used to compare the performance of the two algorithms according to different lengths of data, numbers of channels and numbers of training trials. In addition, the CCA was also compared with power spectral density analysis (PSDA). The experimental results suggest that the CCA is equivalent to TRCA if the signal-to-noise ratio of training data is high enough; otherwise, the CCA outperforms TRCA in terms of classification accuracy. The CCA is much faster than PSDA in detecting time of targets. The robustness of the training data-driven CCA to noise gives it greater potential in practical applications.

In vivo spatiotemporal patterns of oligodendrocyte and myelin damage at the neural electrode interface

Intracortical microelectrodes with the ability to detect intrinsic electrical signals and/or deliver electrical stimulation into local brain regions have been a powerful tool to understand brain circuitry and for therapeutic applications to neurological disorders. However, the chronic stability and sensitivity of these intracortical microelectrodes are challenged by overwhelming biological responses, including severe neuronal loss and thick glial encapsulation. Unlike microglia and astrocytes whose activity have been extensively examined, oligodendrocytes and their myelin processes remain poorly studied within the neural interface field. Oligodendrocytes have been widely recognized to modulate electrical signal conductance along axons through insulating myelin segments. Emerging evidence offers an alternative perspective on neuron-oligodendrocyte coupling where oligodendrocytes provide metabolic and neurotrophic support to neurons through cytoplasmic myelin channels and monocarboxylate transporters. This study uses in vivo multi-photon microscopy to gain insights into the dynamics of oligodendrocyte soma and myelin processes in response to chronic device implantation injury over 4 weeks. We observe that implantation induces acute oligodendrocyte injury including initial deformation and substantial myelinosome formation, an early sign of myelin injury. Over chronic implantation periods, myelin and oligodendrocyte soma suffer severe degeneration proximal to the interface. Interestingly, wound healing attempts such as oligodendrogenesis are initiated over time, however they are hampered by continued degeneration near the implant. Nevertheless, this detailed characterization of oligodendrocyte spatiotemporal dynamics during microelectrode-induced inflammation may provide insights for novel intervention targets to facilitate oligodendrogenesis, enhance the integration of neural-electrode interfaces, and improve long-term functional performance.

Human mind has microwave electromagnetic nature and can be recorded and processed

INTRODUCTION

In 2014 and 2015 Professor of neurology Andrey Bryukhovetskiy published a novel theory of the information-commutation organization of the human brain in Russia, China and the USA. The theory posits the hypothesis that the higher nervous activity (cognitive, intellectual, mnestic) of the humans and their mind are material and have microwave electromagnetic nature. The theory perceives the human mind as a result of dynamic extracortical information-commutation relations of the super-positions of the electromagnetic waves of ultra high frequency emitted by different areas of the human brain in the inter-membrane cerebrospinal fluid space of the human head at a certain period of time. The inter-membrane cerebrospinal fluid space of the human head (the space between the dura, arachnoid and pia mater filled with the cerebrospinal fluid) of about 10mm size, has all morphological attributes to realize the holography. It is a universal natural bioprocessor for processing, analysis and synthesis of the input data and their record or reproduction on the pia as on the biological holographic membrane. The theory suggested that the processes of the mind can be recorded and digitalized with the last generation contemporary microwave receptors of the UHF band.

GOAL

The goal is to experimentally test the theory of the information-commutation organization of the human brain, particularly, the postulate that the human mind has material, and, namely, electromagnetic nature represented by the microwave bioelectric activity; it must be detected, recorded and statistically processed, i.e. its existence must be confirmed.

METHODS

On their own initiative, the team of mathematicians, radioengineers and neurologists performed the non-invasive research of the electromagnetic radiation of human brain in the broad frequency range varying from 850MHz to 26.5GHz with the last generation specialized measuring equipment with high sensitivity and recording speed, specialized measuring antennas and low noise amplifying equipment in the anechoic chamber of the 1st class of protection according to the Russian system of certification GOST R 50414-92.

RESULTS

The previously unknown microwave electromagnetic radiation of the EHF/UHF range (from 1.5GHz to 4.5GHz) with signal strength of -130dBm .. -100dBm (1e^-15 .. 1e^-13 W) are discovered. The detected electromagnetic waves have zonal variations in the different areas of the human head and are absent in other areas of the human body. The method of recording of the microwave electromagnetic activity of the human brain is patented in the Russian Federation. The microwave electromagnetic activity of the brain is billion-fold different from the bioelectric activity recorded by the encephalography.

CONCLUSION

Discovery of the phenomenon of the microwave radiation of the human brain provides evidence to the idea that thinking and mind are material. This phenomenon has the potential to become a new informational channel of the diagnostics of the functional and pathological state of the higher nervous activity of the human brain. It can provide the basis for the development of the equipment for real-time analysis of the microwave bioelectric activity of the brain in norm and pathology, for objective early diagnostics of the functional and emotional conditions as well as of the psychiatric disorders at the preclinical stage, for the biocontrol of the human brain and the artificial simulators of the human brain. It also can provide the foundation for new systems of the artificial intellect, brain-computer interface and systems of the closed-loop biomanagement of the damaged brain.

Spatial-temporal aspects of continuous EEG-based neurorobotic control

Objective.The goal of this work is to identify the spatio-temporal facets of state-of-the-art electroencephalography (EEG)-based continuous neurorobotics that need to be addressed, prior to deployment in practical applications at home and in the clinic.Approach.Nine healthy human subjects participated in five sessions of one-dimensional (1D) horizontal (LR), 1D vertical (UD) and two-dimensional (2D) neural tracking from EEG. Users controlled a robotic arm and virtual cursor to continuously track a Gaussian random motion target using EEG sensorimotor rhythm modulation via motor imagery (MI) commands. Continuous control quality was analyzed in the temporal and spatial domains separately.Main results.Axis-specific errors during 2D tasks were significantly larger than during 1D counterparts. Fatigue rates were larger for control tasks with higher cognitive demand (LR, left- and right-hand MI) compared to those with lower cognitive demand (UD, both hands MI and rest). Additionally robotic arm and virtual cursor control exhibited equal tracking error during all tasks. However, further spatial error analysis of 2D control revealed a significant reduction in tracking quality that was dependent on the visual interference of the physical device. In fact, robotic arm performance was significantly greater than that of virtual cursor control when the users' sightlines were not obstructed.Significance.This work emphasizes the need for practical interfaces to be designed around real-world tasks of increased complexity. Here, the dependence of control quality on cognitive task demand emphasizes the need for decoders that facilitate the translation of 1D task mastery to 2D control. When device footprint was accounted for, the introduction of a physical robotic arm improved control quality, likely due to increased user engagement. In general, this work demonstrates the need to consider both the physical footprint of devices, the complexity of training tasks, and the synergy of control strategies during the development of neurorobotic control.

Effects of fatigue on steady state motion visual evoked potentials: Optimised stimulus parameters for a zoom motion-based brain-computer interface

BACKGROUND AND OBJECTIVE

In flicker-based steady-state visual evoked potentials (SSVEP) brain-computer interface (BCI), the system performance decreases due to prolonged repeated visual stimulation. To reduce the performance decrease due to visual fatigue, the zoom motion based steady-state motion visual evoked potentials (SSMVEPs) paradigm had been proposed. In this study, the stimulation parameters of the paradigm are optimised to mitigate the decrease in detection accuracy for SSMVEP due to visual fatigue.

METHODS

Eight zoom motion-based SSMVEP paradigms with different stimulation parameters were compared. The graph size, luminance, colour, and shape, as well as the frequency range and interval of the stimulation and refresh rate of the screen was changed to determine the optimal paradigm with high recognition accuracy and reduced fatigue effects. The signal-to-noise ratio (SNR) of SSMVEP was also calculated for four fatigue levels. Moreover, the power spectral density of electroencephalograph (EEG) alpha and theta bands during ongoing activity was calculated for the stimulation experiment to evaluate fatigue at the start and end of the stimulation task.

RESULTS

All stimulation SSMVEP paradigms exhibited high accuracies. Changes in luminance, colour, and shape did not impact the recognition accuracy, nor did a higher stimulation frequency or lower frequency interval of each stimulation block. However, the paradigm with smaller stimulus achieved the highest average target selection accuracy of 97.2%, compared to 94.9% for the standard paradigm. Furthermore, it exhibited almost zero reduction in recognition accuracy due to fatigue. From fatigue level 1 to level 4, the smaller zoom motion-based SSMVEP exhibited a lower decrease in the SNR of SSMVEP and a lower alpha/theta ratio decrease during ongoing stimulation activity compared to the standard paradigm.

CONCLUSIONS

For a zoom motion-based SSMVEP paradigm, changing multiple stimulation parameters can lead to the same high performance as the standard paradigm. Moreover, using a smaller stimulus can reduce the accuracy decrease caused by fatigue because the SNR decrease in the evoked SSMVEP state was negligible and the alpha/theta index decrease during ongoing activity was lower than that for the standard paradigm.

Improving performance in motor imagery BCI-based control applications via virtually embodied feedback

OBJECTIVE

Brain-computer interfaces (BCIs) based on motor imagery (MI) are commonly used for control applications. However, these applications require strong and discriminant neural patterns for which extensive experience in MI may be necessary. Inspired by the field of rehabilitation where embodiment is a key element for improving cortical activity, our study proposes a novel control scheme in which virtually embodiable feedback is provided during control to enhance performance.

METHODS

Subjects underwent two immersive virtual reality control scenarios in which they controlled the two-dimensional movement of a device using electroencephalography (EEG). The two scenarios only differ on whether embodiable feedback, which mirrors the movement of the classified intention, is provided. After undergoing each scenario, subjects also answered a questionnaire in which they rated how immersive the scenario and embodiable the feedback were.

RESULTS

Subjects exhibited higher control performance, greater discriminability in brain activity patterns, and enhanced cortical activation when using our control scheme compared to the standard control scheme in which embodiable feedback is absent. Moreover, the self-rated embodiment and presence scores showed significantly positive linear relationships with performance.

SIGNIFICANCE

The findings in our study provide evidence that providing embodiable feedback as guidance on how intention is classified may be effective for control applications by inducing enhanced neural activity and patterns with greater discriminability. By applying embodiable feedback to immersive virtual reality, our study also serves as another instance in which virtual reality is shown to be a promising tool for improving MI.

Implementation of an SSVEP-based intelligent home service robot system

BACKGROUND

People with severe neuromuscular disorders caused by an accident or congenital disease cannot normally interact with the physical environment. The intelligent robot technology offers the possibility to solve this problem. However, the robot can hardly carry out the task without understanding the subject's intention as it relays on speech or gestures. Brain-computer interface (BCI), a communication system that operates external devices by directly converting brain activity into digital signals, provides a solution for this.

OBJECTIVE

In this study, a noninvasive BCI-based humanoid robotic system was designed and implemented for home service.

METHODS

A humanoid robot that is equipped with multi-sensors navigates to the object placement area under the guidance of a specific symbol "Naomark", which has a unique ID, and then sends the information of the scanned object back to the user interface. Based on this information, the subject gives commands to the robot to grab the wanted object and give it to the subject. To identify the subject's intention, the channel projection-based canonical correlation analysis (CP-CCA) method was utilized for the steady state visual evoked potential-based BCI system.

RESULTS

The offline results showed that the average classification accuracy of all subjects reached 90%, and the online task completion rate was over 95%.

CONCLUSION

Users can complete the grab task with minimum commands, avoiding the control burden caused by complex commands. This would provide a useful assistance means for people with severe motor impairment in their daily life.

Upregulating excitability of corticospinal pathways in stroke patients using TMS neurofeedback; A pilot study

Upper limb weakness following a stroke affects 80% of survivors and is a key factor in preventing their return to independence. State-of-the art approaches to rehabilitation often require that the patient can generate some activity in the paretic limb, which is not possible for many patients in the early period following stroke. Approaches that enable more patients to engage with upper limb therapy earlier are urgently needed. Motor imagery has shown promise as a potential means to maintain activity in the brain's motor network, when the patient is incapable of generating functional movement. However, as imagery is a hidden mental process, it is impossible for individuals to gauge what impact this is having upon their neural activity. Here we used a novel brain-computer interface (BCI) approach allowing patients to gain an insight into the effect of motor imagery on their brain-muscle pathways, in real-time. Seven patients 2-26 weeks post stroke were provided with neurofeedback (NF) of their corticospinal excitability measured by the size of motor evoked potentials (MEP) in response to transcranial magnetic stimulation (TMS). The aim was to train patients to use motor imagery to increase the size of MEPs, using the BCI with a computer game displaying neurofeedback. Patients training finger muscles learned to elevate MEP amplitudes above their resting baseline values for the first dorsal interosseous (FDI) and abductor digiti minimi (ADM) muscles. By day 3 for ADM and day 4 for FDI, MEP amplitudes were sustained above baseline in all three NF blocks. Here we have described the first clinical implementation of TMS NF in a population of sub-acute stroke patients. The results show that in the context of severe upper limb paralysis, patients are capable of using neurofeedback to elevate corticospinal excitability in the affected muscles. This may provide a new training modality for early intervention following stroke.

DIY hybrid SSVEP-P300 LED stimuli for BCI platform using EMOTIV EEG headset

A fully customisable chip-on board (COB) LED design to evoke two brain responses simultaneously (steady state visual evoked potential (SSVEP) and transient evoked potential, P300) is discussed in this paper. Considering different possible modalities in brain-computer interfacing (BCI), SSVEP is widely accepted as it requires a lesser number of electroencephalogram (EEG) electrodes and minimal training time. The aim of this work was to produce a hybrid BCI hardware platform to evoke SSVEP and P300 precisely with reduced fatigue and improved classification performance. The system comprises of four independent radial green visual stimuli controlled individually by a 32-bit microcontroller platform to evoke SSVEP and four red LEDs flashing at random intervals to generate P300 events. The system can also record the P300 event timestamps that can be used in classification, to improve the accuracy and reliability. The hybrid stimulus was tested for real-time classification accuracy by controlling a LEGO robot to move in four directions.

Low power switched-resistor band-pass filter for neural recording channels in 130nm CMOS

In this work, we present a low-power 2^nd order band-pass filter for neural recording applications. The central frequency of the passband is set to 375Hz and the quality factor to 5 to properly process the neural signals related to the onset of epileptic seizure, and to strongly attenuate all the out of band biological signals and electrical disturbances. The biquad filter is based on a fully differential Tow Thomas architecture in which high-valued resistors are implemented through switched high-resistivity polysilicon resistors. A supply voltage as low as 0.8V and MOS transistors operating in the sub-threshold region are exploited to achieve a power consumption as low as 170nW, when driving a 1pF load capacitance. The filter exhibits a tuning range of the resonance frequency from 200Hz to 400Hz, and an area footprint of only 0.021 mm². Very low power consumption and area occupation are key specifications for integrated, multiple-sensors, neural recording systems.