Use of high-frequency visual stimuli above the critical flicker frequency in a SSVEP-based BMI

A user-friendly visual brain-computer interface based on high-frequency steady-state visual evoked fields recorded by OPM-MEG

Objective. Magnetoencephalography (MEG) shares a comparable time resolution with electroencephalography. However, MEG excels in spatial resolution, enabling it to capture even the subtlest and weakest brain signals for brain-computer interfaces (BCIs). Leveraging MEG's capabilities, specifically with optically pumped magnetometers (OPM-MEG), proves to be a promising avenue for advancing MEG-BCIs, owing to its exceptional sensitivity and portability. This study harnesses the power of high-frequency steady-state visual evoked fields (SSVEFs) to build an MEG-BCI system that is flickering-imperceptible, user-friendly, and highly accurate.Approach.We have constructed a nine-command BCI that operates on high-frequency SSVEF (58-62 Hz with a 0.5 Hz interval) stimulation. We achieved this by placing the light source inside and outside the magnetic shielding room, ensuring compliance with non-magnetic and visual stimulus presentation requirements. Five participants took part in offline experiments, during which we collected six-channel multi-dimensional MEG signals along both the vertical (Z-axis) and tangential (Y-axis) components. Our approach leveraged the ensemble task-related component analysis algorithm for SSVEF identification and system performance evaluation.Main Results.The offline average accuracy of our proposed system reached an impressive 92.98% when considering multi-dimensional conjoint analysis using data from both theZandYaxes. Our method achieved a theoretical average information transfer rate (ITR) of 58.36 bits min-1with a data length of 0.7 s, and the highest individual ITR reached an impressive 63.75 bits min-1.Significance.This study marks the first exploration of high-frequency SSVEF-BCI based on OPM-MEG. These results underscore the potential and feasibility of MEG in detecting subtle brain signals, offering both theoretical insights and practical value in advancing the development and application of MEG in BCI systems.

High-Frequency Discrete-Interval Binary Sequence in Asynchronous C-VEP-Based BCI for Visual Fatigue Reduction

In code-modulated visual evoked potential (c-VEP) based BCI systems, flickering visual stimuli may result in visual fatigue. Thus, we introduced a discrete-interval binary sequence (DIBS) as visual stimulus modulation, with its power spectrum optimized to emphasize high-frequency components (40 Hz-60 Hz). 8 and 17 subjects participated, respectively, in offline and online experiments on a 4-target asynchronous c-VEP-based BCI system designed to realize a high positive predictive value (PPV), a low false positive rate (FPR) during idle states, and a high true positive rate (TPR) in control states, while minimizing visual fatigue level. Two visual stimuli modulations were introduced and compared: a maximum length sequence (m-sequence) and the high-frequency discrete-interval binary sequence (DIBS). The decoding algorithm was compared among the canonical correlation analysis (CCA), the task-related component analysis (TRCA), and two approaches of sub-band component weight calculation (the traditional method and the proportional method) for FBCCA and FBTRCA. In the online experiments, the average PPV, FPR and TPR achieved, respectively [Formula: see text], [Formula: see text], [Formula: see text] with m-sequence, while [Formula: see text], [Formula: see text] and [Formula: see text] with DIBS. Estimated by objective eye-related metrics and a subjective questionnaire, the visual fatigue in DIBS cases is significantly smaller than that in m-sequence cases. In this study, the feasibility of a novel modulation approach for visual fatigue reduction was proved in an asynchronous c-VEP system, while maintaining comparable performance to existing methods, which provides further insights towards enhancing this field's long-term viability and user-friendliness.

Enhancing SSVEP-BCI Performance Under Fatigue State Using Dynamic Stopping Strategy

Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) have emerged as a prominent technology due to their high information transfer rate, rapid calibration time, and robust signal-to-noise ratio. However, a critical challenge for practical applications is performance degradation caused by user fatigue during prolonged use. This work proposes novel methods to address this challenge by dynamically adjusting data acquisition length and updating detection models based on a fatigue-aware stopping strategy. Two 16-target SSVEP-BCIs were employed, one using low-frequency and the other using high-frequency stimulation. A self-recorded fatigue dataset from 24 subjects was utilized for extensive evaluation. A simulated online experiment demonstrated that the proposed methods outperform the conventional fixed stopping strategy in terms of classification accuracy, information transfer rate, and selection time, irrespective of stimulation frequency. These findings suggest that the proposed approach can significantly improve SSVEP-BCI performance under fatigue conditions, leading to superior performance during extended use.

Detecting passive and active response in patients with behaviourally diagnosed unresponsive wakefulness syndrome

The diagnosis of unresponsive wakefulness syndrome depends mostly on the motor response following verbal commands. However, there is a potential for misdiagnosis in patients who understand verbal commands (passive response) but cannot perform voluntary movements (active response). To evaluate passive and active responses in such patients, this study used an approach combining functional magnetic resonance imaging and passive listening tasks to evaluate the level of speech comprehension, with portable brain-computer interface modalities that were applied to elicit an active response to attentional modulation tasks at the bedside. We included ten patients who were clinically diagnosed as unresponsive wakefulness syndrome. Two of ten patients showed no significant activation, while limited activation in the auditory cortex was found in six patients. The remaining two patients showed significant activation in language areas, and were able to control the brain-computer interface with reliable accuracy. Using a combined passive/active approach, we identified unresponsive wakefulness syndrome patients who showed both active and passive neural responses. This suggests that some patients with unresponsive wakefulness syndrome diagnosed behaviourally are both wakeful and responsive, and the combined approach is useful for distinguishing a minimally conscious state from unresponsive wakefulness syndrome physiologically.

A high-frequency SSVEP-BCI system based on a 360 Hz refresh rate

Objective. Steady-state visual evoked potential (SSVEP) based brain-computer interfaces (BCIs) often struggle to balance user experience and system performance. To address this challenge, this study employed stimuli in the 55-62.8 Hz frequency range to implement a 40-target BCI speller that offered both high-performance and user-friendliness.Approach. This study proposed a method that presents stable multi-target stimuli on a monitor with a 360 Hz refresh rate. Real-time generation of stimulus matrix and stimulus rendering was used to ensure stable presentation while reducing the computational load. The 40 targets were encoded using the joint frequency and phase modulation method, offline and online BCI experiments were conducted on 16 subjects using the task discriminant component analysis algorithm for feature extraction and classification.Main results. The online BCI system achieved an average accuracy of 88.87% ± 3.05% and an information transfer rate of 51.83 ± 2.77 bits min-1under the low flickering perception condition.Significance. These findings suggest the feasibility and significant practical value of the proposed high-frequency SSVEP BCI system in advancing the visual BCI technology.

Decoding Emotion From High-frequency Steady State Visual Evoked Potential (SSVEP)

BACKGROUND

Steady-state visual evoked potential (SSVEP) by flickering sensory stimuli has been widely applied in the brain-machine interface (BMI). Yet, it remains largely unexplored whether affective information could be decoded from the signal of SSVEP, especially from the frequencies higher than the critical flicker frequency (an upper-frequency limit one can see the flicker).

NEW METHOD

Participants fixated on visual stimuli presented at 60Hz above the critical flicker frequency. The stimuli were pictures with different affective valance (positive, neutral, negative) in distinctive semantic categories (human, animal, scene). SSVEP entrainment in the brain evoked by the flickering stimuli at 60Hz was used to decode the affective and semantic information.

RESULTS

During the presentation of stimuli (1s), the affective valance could be decoded from the SSVEP signals at 60Hz, while the semantic categories could not. In contrast, neither the affective nor the semantic information could be decoded from the brain signal 1second before the onset of stimuli.

COMPARISON WITH EXISTING METHOD(S)

Previous studies focused mainly on EEG activity tagged at frequencies lower than the critical flickering frequency and investigated whether the affective valence of stimuli drew participants' attention. The current study was the first to use SSVEP signals from high-frequency (60Hz) above the critical flickering frequency to decode affective information from stimuli. The high-frequency flickering was invisible and thus substantially reduced the fatigue of participants.

CONCLUSIONS

We found that affective information could be decoded from high-frequency SSVEP and the current finding could be added to designing affective BMI in the future.

A high-performance SSVEP-based BCI using imperceptible flickers

Objective.Existing steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) struggle to balance user experience and system performance. This study proposed an individualized space and phase modulation method to code imperceptible flickers at 60 Hz towards a user-friendly SSVEP-based BCI with high performance.Approach.The individualized customization of visual stimulation took the subject-to-subject variability in cortex geometry into account. An annulus global-stimulation was divided into local-stimulations of eight annular sectors and presented to subjects separately. The local-stimulation SSVEPs were superimposed to simulate global-stimulation SSVEPs with 4⁷space and phase coding combinations. A four-class phase-coded BCI diagram was used to evaluate the simulated classification performance. The performance ranking of all simulated global-stimulation SSVEPs were obtained and three performance levels (optimal, medium, worst) of individualized modulation groups were searched for each subject. The standard-modulation group conforming to the V1 'cruciform' geometry and the non-modulation group were involved as controls. A four-target phase-coded BCI system with SSVEPs at 60 Hz was implemented with the five modulation groups and questionnaires were used to evaluate user experience.Main results.The proposed individualized space and phase modulation method effectively modulated the SSVEP intensity without affecting the user experience. The online BCI system using the 60 Hz stimuli achieved mean information transfer rates of 52.8 ± 1.9 bits min^-1, 16.8 ± 2.4 bits min^-1, and 42.4 ± 3.0 bits min^-1with individualized optimal-modulation, individualized worst-modulation, and non-modulation groups, respectively.Significance.Structural and functional characteristics of the human visual cortex were exploited to enhance the response intensity of SSVEPs at 60 Hz, resulting in a high-performance BCI system with good user experience. This study has important theoretical significance and application value for promoting the development of the visual BCI technology.

Training the spatially-coded SSVEP BCI on the fly

BACKGROUND

The spatially-coded SSVEP BCI employs the retinotopic map in the human visual pathway to infer the gaze direction of the operator relative to a flicker stimulus inducing steady-state visual evoked potentials (SSVEPs) in the brain. It has been shown that with this method, up to 16 channels can be encoded using only a single flicker stimulus. Another advantage over conventional frequency-coded SSVEP BCIs, in which channels are encoded by different combinations of frequencies and phases, is that the operator does not have to gaze directly at flickering lights. This can reduce visual fatigue and improve user comfort. Whereas the frequency of the SSVEP response is well predictable, which has enabled the development of frequency-coded SSVEP BCIs which do not require training data, the spatial distribution of the SSVEP response over the scalp differs much more between different people. This requires collecting a substantial amount of training data before the spatially-coded BCI could be put into operation.

NEW METHOD

In this study we address this issue by combining the spatially-coded BCI with a feedback channel which the operator uses to flag classification errors, and which allows the system to accumulate valid training data while the BCI is used to solve a spatial navigation task.

RESULTS

Starting from the minimal number of samples required by the classification method, the approach achieved an average accuracy of 69 ± 15 %, corresponding to an ITR of 31 ± 17 bits/min, in solving the task for the first time. This accuracy improved to 87 ± 9 % (ITR: 54 ± 14 bits/min) after completing the task 2 more times. Further we show that participants with a stable SSVEP topography over repeated stimulation enable the BCI to achieve higher accuracies.

COMPARISON WITH EXISTING METHODS

Compared to a similar system with separate training and application phases, the time to achieve the same output is reduced by more than 50 %.

CONCLUSIONS

Evaluating the approach in 17 participants suggests that the performance of the spatially-coded BCI with a minimal set of training samples is sufficient to be operational, and that performance keeps improving in the course of its application.

Improving user experience of SSVEP BCI through low amplitude depth and high frequency stimuli design

Steady-States Visually Evoked Potentials (SSVEP) refer to the sustained rhythmic activity observed in surface electroencephalography (EEG) in response to the presentation of repetitive visual stimuli (RVS). Due to their robustness and rapid onset, SSVEP have been widely used in Brain Computer Interfaces (BCI). However, typical SSVEP stimuli are straining to the eyes and present risks of triggering epileptic seizures. Reducing visual stimuli contrast or extending their frequency range both appear as relevant solutions to address these issues. It however remains sparsely documented how BCI performance is impacted by these features and to which extent user experience can be improved. We conducted two studies to systematically characterize the effects of frequency and amplitude depth reduction on SSVEP response. The results revealed that although high frequency stimuli improve visual comfort, their classification performance were not competitive enough to design a reliable/responsive BCI. Importantly, we found that the amplitude depth reduction of low frequency RVS is an effective solution to improve user experience while maintaining high classification performance. These findings were further validated by an online T9 SSVEP-BCI in which stimuli with 40% amplitude depth reduction achieved comparable results (>90% accuracy) to full amplitude stimuli while significantly improving user experience.

Instant classification for the spatially-coded BCI

The spatially-coded SSVEP BCI exploits changes in the topography of the steady-state visual evoked response to visual flicker stimulation in the extrafoveal field of view. In contrast to frequency-coded SSVEP BCIs, the operator does not gaze into any flickering lights; therefore, this paradigm can reduce visual fatigue. Other advantages include high classification accuracies and a simplified stimulation setup. Previous studies of the paradigm used stimulation intervals of a fixed duration. For frequency-coded SSVEP BCIs, it has been shown that dynamically adjusting the trial duration can increase the system’s information transfer rate (ITR). We therefore investigated whether a similar increase could be achieved for spatially-coded BCIs by applying dynamic stopping methods. To this end we introduced a new stopping criterion which combines the likelihood of the classification result and its stability across larger data windows. Whereas the BCI achieved an average ITR of 28.4±6.4 bits/min with fixed intervals, dynamic intervals increased the performance to 81.1±44.4 bits/min. Users were able to maintain performance up to 60 minutes of continuous operation. We suggest that the dynamic response time might have worked as a kind of temporal feedback which allowed operators to optimize their brain signals and compensate fatigue.

Distraction classification during target tracking tasks involving target and cursor flickering using EEGNet

Keeping patients from being distracted while performing motor rehabilitation is important. An EEG-based biofeedback strategy has been introduced to help encourage participants to focus their attention on rehabilitation tasks. Here, we suggest a BCI-based monitoring method using a flickering cursor and target that can evoke a steady-state visually evoked potential (SSVEP) using the fact that the SSVEP is modulated by a patient's attention. Fifteen healthy individuals performed a tracking task where the target and cursor flickered. There were two tracking sessions, one with and one without flickering stimuli, and each session had four conditions in which each had no distractor (non-D), a visual (vis-D) or cognitive distractor (cog-D), and both distractors (both-D). An EEGNet was trained as a classifier using only non-D and both-D conditions to classify whether it was distracted and validated with a leave-one-subject-out scheme. The results reveal that the proposed classifier demonstrates superior performance when using data from the task with the flickering stimuli compared to the case without the flickering stimuli. Furthermore, the observed classification likelihood was between those corresponding to the non-D and both-D when using the trained EEGNet. This suggests that the classifier trained for the two conditions could also be used to measure the level of distraction by windowing and averaging the outcomes. Therefore, the proposed method is advantageous because it can reveal a robust and continuous level of patient distraction. This facilitates its successful application to the rehabilitation systems that use computerized technology, such as virtual reality to encourage patient engagement.

Multiplexed lighting system using time-division multiplexing

Improvements in lighting and other indoor environmental conditions have gained considerable attention in different areas, including health and economics. Controlling the lighting environment is essential because, among the indoor factors, visual stimulation affects numerous human characteristics. Further, visual stimulation, including peripheral vision, affects people differently. Therefore, to improve the indoor environment with multiple occupants, each occupant must have an independent lighting environment. However, this cannot be achieved through conventional approaches. In this study, we propose a multiplexed lighting environment that can simultaneously realize multiple mutually independent lighting environments within a single space. We developed the proposed system using time-division multiplexing and conducted an experiment to clarify the influence of light multiplexing on human behavior and impression of the indoor environment. The experimental results showed that the proposed method changed the lighting operations of the users and improved their impression of the lighting environment. Furthermore, the proposed method provides a desirable lighting environment for all people within a single space, even when people in the same space desire different lighting environments.

The Influence of the Modulation Index on Frequency-Modulated Steady-State Visual Evoked Potentials

Based on increased user experience during stimulation, frequency-modulated steady-state visual evoked potentials (FM-SSVEPs) have been suggested as an improved stimulation method for brain-computer interfaces. Adapting such a novel stimulation paradigm requires in-depth analyses of all different stimulation parameters and their influence on brain responses as well as the user experience during the stimulation. In the current manuscript, we assess the influence of different values for the modulation index, which determine the spectral distribution in the stimulation signal on FM-SSVEPs. We visually stimulated 14 participants at different target frequencies with four different values for the modulation index. Our results reveal that changing the modulation index in a way that elevates the stimulation power in the targeted sideband leads to increased FM-SSVEP responses. There is, however, a tradeoff with user experience as increased modulation indices also lead to increased perceived flicker intensity as well as decreased stimulation comfort in our participants. Our results can guide the choice of parameters in future FM-SSVEP implementations.

A Novel Approach to Decode Covert Spatial Attention Using SSVEP and Single-Frequency Phase-Coded Stimuli

This paper investigates for the first time the use of single-frequency phase-coded stimuli to detect covert visuo-spatial attention (CVSA) with steady-state visual evoked potentials (SSVEP). Two 15Hz pattern-onset stimulations were encoded with opposite phases and simultaneously presented on a LCD monitor. The effects of attending each stimulus on the amplitudes and phases of the evoked SSVEPs across the visual cortex are explored. A real-time CVSA classification experiment was simulated offline with 9 BCI-naive subjects, achieving an average classification accuracy of 88.4 ± 8% SE. Our results are, to our knowledge, the first report that CVSA can be decoded with SSVEP using single-frequency phase-coded stimuli. This opens opportunities for attention-tracking applications with largely increased number of targets.

Optimizing spatial properties of a new checkerboard-like visual stimulus for user-friendly SSVEP-based BCIs

Objective.Low-frequency steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) systems with high performance are prone to cause visual discomfort and fatigue. High-frequency SSVEP-based BCI systems can alleviate the discomfort, but always obtain lower performance. This study optimized the spatial properties of a proposed checkerboard-like visual stimulus toward high-performance and user-friendly SSVEP-based BCI systems.Approach.On the one hand, two checkerboard-like stimuli with distinct spatial contrasts (the black- and white-background) were designed to balance the tradeoff between BCI performance and user experience and compared with the traditional flickering stimulus. On the other hand, the impacts of the spatial frequency of the new checkerboard-like stimulus on the flicker perception and the intensity of the elicited SSVEP were clarified. The SSVEP-based BCI systems were implemented based on the checkerboard-like stimuli under low-frequency and high-frequency conditions. The user experience for each stimulation pattern was estimated by questionnaires for subjective evaluation.Main results.The comparison results indicate that the black-background checkerboard-like stimulus with an optimized spatial frequency achieved comparable performance and enhanced visual comfort compared with the flickering stimulus. Furthermore, the online nine-target BCI system using the black-background checkerboard-like stimuli achieved averaged information transfer rates of 124.0 ± 2.3 and 109.0 ± 20.4 bits min^-1with low-frequency and high-frequency stimulation respectively.Significance.The new checkerboard-like stimuli with optimized properties show superiority of system performance and user experience in implementing SSVEP-based BCI, which will promote its practical applications in communication and control.

Detection of fixation points using a small visual landmark for brain-computer interfaces

Objective.The speed of visual brain-computer interfaces (v-BCIs) has been greatly improved in recent years. However, the traditional v-BCI paradigms require users to directly gaze at the intensive flickering items, which would cause severe problems such as visual fatigue and excessive visual resource consumption in practical applications. Therefore, it is imperative to develop a user-friendly v-BCI.Approach.According to the retina-cortical relationship, this study developed a novel BCI paradigm to detect the fixation point of eyes using a small visual stimulus that subtended only 0.6° in visual angle and was out of the central visual field. Specifically, the visual stimulus was treated as a landmark to judge the eccentricity and polar angle of the fixation point. Sixteen different fixation points were selected around the visual landmark, i.e. different combinations of two eccentricities (2° and 4°) and eight polar angles (0,π4,π2,3π4,π,5π4,3π2and7π4). Twelve subjects participated in this study, and they were asked to gaze at one out of the 16 points for each trial. A multi-class discriminative canonical pattern matching (Multi-DCPM) algorithm was proposed to decode the user's fixation point.Main results.We found the visual stimulation landmark elicited different spatial event-related potential patterns for different fixation points. Multi-DCPM could achieve an average accuracy of 66.2% with a standard deviation of 15.8% for the classification of the sixteen fixation points, which was significantly higher than traditional algorithms (p⩽0.001). Experimental results of this study demonstrate the feasibility of using a small visual stimulus as a landmark to track the relative position of the fixation point.Significance.The proposed new paradigm provides a potential approach to alleviate the problem of irritating stimuli in v-BCIs, which can broaden the applications of BCIs.

Similarity-constrained task-related component analysis for enhancing SSVEP detection

Objective. Task-related component analysis (TRCA) is a representative subject-specific training algorithm in steady-state visual evoked potential (SSVEP)-based brain-computer interfaces. Task-related components (TRCs), extracted by the TRCA-based spatial filtering from electroencephalogram (EEG) signals through maximizing the reproducibility across trials, may contain some task-related inherent noise that is still trial-reproducible.Approach. To address this problem, this study proposed a similarity-constrained TRCA (scTRCA) algorithm to remove the task-related noise and extract TRCs maximally correlated with SSVEPs for enhancing SSVEP detection. Similarity constraints, which were created by introducing covariance matrices between EEG training data and an artificial SSVEP template, were added to the objective function of TRCA. Therefore, a better spatial filter was obtained by maximizing not only the reproducibility across trials but also the similarity between TRCs and SSVEPs. The proposed scTRCA was compared with TRCA, multi-stimulus TRCA, and sine-cosine reference signal based on two public datasets.Main results. The performance of TRCA in target identification of SSVEPs is improved by introducing similarity constraints. The proposed scTRCA significantly outperformed the other three methods, and the improvement was more significant especially with insufficient training data.Significance. The proposed scTRCA algorithm is promising for enhancing SSVEP detection considering its better performance and robustness against insufficient calibration.

Brain Oscillation Entrainment by Perceptible and Non-perceptible Rhythmic Light Stimulation

Objective and Background: Decades of research in the field of steady-state visual evoked potentials (SSVEPs) have revealed great potential of rhythmic light stimulation for brain-computer interfaces. Additionally, rhythmic light stimulation provides a non-invasive method for entrainment of oscillatory activity in the brain. Especially effective protocols enabling non-perceptible rhythmic stimulation and, thereby, reducing eye fatigue and user discomfort are favorable. Here, we investigate effects of (1) perceptible and (2) non-perceptible rhythmic light stimulation as well as attention-based effects of the stimulation by asking participants to focus (a) on the stimulation source directly in an overt attention condition or (b) on a cross-hair below the stimulation source in a covert attention condition. Method: SSVEPs at 10 Hz were evoked with a light-emitting diode (LED) driven by frequency-modulated signals and amplitudes of the current intensity either below or above a previously estimated individual threshold. Furthermore, we explored the effect of attention by asking participants to fixate on the LED directly in the overt attention condition and indirectly attend it in the covert attention condition. By measuring electroencephalography, we analyzed differences between conditions regarding the detection of reliable SSVEPs via the signal-to-noise ratio (SNR) and functional connectivity in occipito-frontal(-central) regions. Results: We could observe SSVEPs at 10 Hz for the perceptible and non-perceptible rhythmic light stimulation not only in the overt but also in the covert attention condition. The SNR and SSVEP amplitudes did not differ between the conditions and SNR values were in all except one participant above significance thresholds suggested by previous literature indicating reliable SSVEP responses. No difference between the conditions could be observed in the functional connectivity in occipito-frontal(-central) regions. Conclusion: The finding of robust SSVEPs even for non-intrusive rhythmic stimulation protocols below an individual perceptibility threshold and without direct fixation on the stimulation source reveals strong potential as a safe stimulation method for oscillatory entrainment in naturalistic applications.

SSVEP phase synchronies and propagation during repetitive visual stimulation at high frequencies

Steady-state visual evoked potentials (SSVEPs), the brain response to visual flicker stimulation, have proven beneficial in both research and clinical applications. Despite the practical advantages of stimulation at high frequencies in terms of visual comfort and safety, high frequency-SSVEPs have not received enough attention and little is known about the mechanisms behind their generation and propagation in time and space. In this study, we investigated the origin and propagation of SSVEPs in the gamma frequency band (40-60 Hz) by studying the dynamic properties of EEG in 32 subjects. Using low-resolution brain electromagnetic tomography (sLORETA) we identified the cortical sources involved in SSVEP generation in that frequency range to be in the primary visual cortex, Brodmann areas 17, 18 and 19 with minor contribution from sources in central and frontal sites. We investigated the SSVEP propagation as measured on the scalp in the framework of the existing theories regarding the neurophysiological mechanism through which the SSVEP spreads through the cortex. We found a progressive phase shift from posterior parieto-occipital sites over the cortex with a phase velocity of approx. 8-14 m/s and wavelength of about 21 and 24 cm. The SSVEP spatial properties appear sensitive to input frequency with higher stimulation frequencies showing a faster propagation speed.

Toward New Modalities in VEP-Based BCI Applications Using Dynamical Stimuli: Introducing Quasi-Periodic and Chaotic VEP-Based BCI

Visual evoked potentials (VEPs) to periodic stimuli are commonly used in brain computer interfaces for their favorable properties such as high target identification accuracy, less training time, and low surrounding target interference. Conventional periodic stimuli can lead to subjective visual fatigue due to continuous and high contrast stimulation. In this study, we compared quasi-periodic and chaotic complex stimuli to common periodic stimuli for use with VEP-based brain computer interfaces (BCIs). Canonical correlation analysis (CCA) and coherence methods were used to evaluate the performance of the three stimulus groups. Subjective fatigue caused by the presented stimuli was evaluated by the Visual Analogue Scale (VAS). Using CCA with the M2 template approach, target identification accuracy was highest for the chaotic stimuli (M = 86.8, SE = 1.8) compared to the quasi-periodic (M = 78.1, SE = 2.6, p = 0.008) and periodic (M = 64.3, SE = 1.9, p = 0.0001) stimulus groups. The evaluation of fatigue rates revealed that the chaotic stimuli caused less fatigue compared to the quasi-periodic (p = 0.001) and periodic (p = 0.0001) stimulus groups. In addition, the quasi-periodic stimuli led to lower fatigue rates compared to the periodic stimuli (p = 0.011). We conclude that the target identification results were better for the chaotic group compared to the other two stimulus groups with CCA. In addition, the chaotic stimuli led to a less subjective visual fatigue compared to the periodic and quasi-periodic stimuli and can be suitable for designing new comfortable VEP-based BCIs.

Comparison of Different Visual Feedback Methods for SSVEP-Based BCIs

In this paper we compared different visual feedback methods, informing users about classification progress in a steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) speller application. According to results from our previous studies, changes in stimulus size and contrast as online feedback of classification progress have great impact on BCI performance in SSVEP-based spellers. In this experiment we further investigated these effects, and tested a 4-target SSVEP speller interface with a much higher number of subjects. Five different scenarios were used with variations in stimulus size and contrast, "no feedback", "size increasing", "size decreasing", "contrast increasing", and "contrast decreasing". With each of the five scenarios, 24 participants had to spell six letter words (at least 18 selections with this three-steps speller). The fastest feedback modalities were different for the users, there was no visual feedback which was generally better than the others. With the used interface, six users achieved significantly better Information Transfer Rates (ITRs) compared to the "no feedback" condition. Their average improvement by using the individually fastest feedback method was 46.52%. This finding is very important for BCI experiments, as by determining the optimal feedback for the user, the speed of the BCI can be improved without impairing the accuracy.

Five Shades of Grey: Exploring Quintary m-Sequences for More User-Friendly c-VEP-Based BCIs

Responsive EEG-based communication systems have been implemented with brain-computer interfaces (BCIs) based on code-modulated visual evoked potentials (c-VEPs). The BCI targets are typically encoded with binary m-sequences because of their autocorrelation property; the digits one and zero correspond to different target colours (usually black and white), which are updated every frame according to the code. While binary flickering patterns enable high communication speeds, they are perceived as annoying by many users. Quintary (base 5) m-sequences, where the five digits correspond to different shades of grey, may yield a more subtle visual stimulation. This study explores two approaches to reduce the flickering sensation: (1) adjusting the flickering speed via refresh rates and (2) applying quintary codes. In this respect, six flickering modalities are tested using an eight-target spelling application: binary patterns and quintary patterns generated with 60, 120, and 240 Hz refresh rates. This study was conducted with 18 nondisabled participants. For all six flickering modalities, a copy-spelling task was conducted. According to questionnaire results, most users favoured the proposed quintary over the binary pattern while achieving similar performance to it (no statistical differences between the patterns were found). Mean accuracies across participants were above 95%, and information transfer rates were above 55 bits/min for all patterns and flickering speeds.

A Hybrid Speller Design Using Eye Tracking and SSVEP Brain-Computer Interface

Steady-state visual evoked potentials (SSVEPs) have been extensively utilized to develop brain-computer interfaces (BCIs) due to the advantages of robustness, large number of commands, high classification accuracies, and information transfer rates (ITRs). However, the use of several simultaneous flickering stimuli often causes high levels of user discomfort, tiredness, annoyingness, and fatigue. Here we propose to design a stimuli-responsive hybrid speller by using electroencephalography (EEG) and video-based eye-tracking to increase user comfortability levels when presented with large numbers of simultaneously flickering stimuli. Interestingly, a canonical correlation analysis (CCA)-based framework was useful to identify target frequency with a 1 s duration of flickering signal. Our proposed BCI-speller uses only six frequencies to classify forty-eight targets, thus achieve greatly increased ITR, whereas basic SSVEP BCI-spellers use an equal number of frequencies to the number of targets. Using this speller, we obtained an average classification accuracy of 90.35 ± 3.597% with an average ITR of 184.06 ± 12.761 bits per minute in a cued-spelling task and an ITR of 190.73 ± 17.849 bits per minute in a free-spelling task. Consequently, our proposed speller is superior to the other spellers in terms of targets classified, classification accuracy, and ITR, while producing less fatigue, annoyingness, tiredness and discomfort. Together, our proposed hybrid eye tracking and SSVEP BCI-based system will ultimately enable a truly high-speed communication channel.

A Four-Class Phase-Coded SSVEP BCI at 60Hz Using Refresh Rate

A four-class brain-computer interface (BCI) system based on steady-state visual evoked potentials (SSVEPs) was developed by presenting phase-coded 60Hz stimulations on a 240Hz LCD monitor. The task-related component analysis (TRCA) algorithm was used to detect SSVEPs with individual training data. In the BCI experiment with 10 subjects, the system achieved high classification accuracy of 94.50±6.70% and 92.71±7.56% in offline and online BCI experiments, resulting in information transfer rates (ITR) of 19.95±4.36 and 18.81±4.74 bpm, respectively. The behavioral tests on visual comfortableness and perception of flickering reveal that the proposed BCI system is very comfortable to use without any perception of flicker.

A multi-day and multi-band dataset for a steady-state visual-evoked potential-based brain-computer interface

BACKGROUND

A steady-state visual-evoked potential (SSVEP) is a brain response to visual stimuli modulated at certain frequencies; it has been widely used in electroencephalography (EEG)-based brain-computer interface research. However, there are few published SSVEP datasets for brain-computer interface. In this study, we obtained a new SSVEP dataset based on measurements from 30 participants, performed on 2 days; our dataset complements existing SSVEP datasets: (i) multi-band SSVEP datasets are provided, and all 3 possible frequency bands (low, middle, and high) were used for SSVEP stimulation; (ii) multi-day datasets are included; and (iii) the EEG datasets include simultaneously obtained physiological measurements, such as respiration, electrocardiography, electromyography, and head motion (accelerator).

FINDINGS

To validate our dataset, we estimated the spectral powers and classification performance for the EEG (SSVEP) datasets and created an example plot to visualize the physiological time-series data. Strong SSVEP responses were observed at stimulation frequencies, and the mean classification performance of the middle frequency band was significantly higher than the low- and high-frequency bands. Other physiological data also showed reasonable results.

CONCLUSIONS

Our multi-band, multi-day SSVEP datasets can be used to optimize stimulation frequencies because they enable simultaneous investigation of the characteristics of the SSVEPs evoked in each of the 3 frequency bands, and solve session-to-session (day-to-day) transfer problems by enabling investigation of the non-stationarity of SSVEPs measured on different days. Additionally, auxiliary physiological data can be used to explore the relationship between SSVEP characteristics and physiological conditions, providing useful information for optimizing experimental paradigms to achieve high performance.

Comparison of Visual Stimuli for Steady-State Visual Evoked Potential-Based Brain-Computer Interfaces in Virtual Reality Environment in terms of Classification Accuracy and Visual Comfort

Recent studies on brain-computer interfaces (BCIs) based on the steady-state visual evoked potential (SSVEP) have demonstrated their use to control objects or generate commands in virtual reality (VR) environments. However, most SSVEP-based BCI studies performed in VR environments have adopted visual stimuli that are typically used in conventional LCD environments without considering the differences in the rendering devices (head-mounted displays (HMDs) used in the VR environments). The proximity between the visual stimuli and the eyes in HMDs can readily cause eyestrain, degrading the overall performance of SSVEP-based BCIs. Therefore, in the present study, we have tested two different types of visual stimuli—pattern-reversal checkerboard stimulus (PRCS) and grow/shrink stimulus (GSS)—on young healthy participants wearing HMDs. Preliminary experiments were conducted to investigate the visual comfort of each participant during the presentation of the visual stimuli. In subsequent online avatar control experiments, we observed considerable differences in the classification accuracy of individual participants based on the type of visual stimuli used to elicit SSVEP. Interestingly, there was a close relationship between the subjective visual comfort score and the online performance of the SSVEP-based BCI: most participants showed better classification accuracy under visual stimulus they were more comfortable with. Our experimental results suggest the importance of an appropriate visual stimulus to enhance the overall performance of the SSVEP-based BCIs in VR environments. In addition, it is expected that the appropriate visual stimulus for a certain user might be readily selected by surveying the user's visual comfort for different visual stimuli, without the need for the actual BCI experiments.

Enhancing the Usability of Brain-Computer Interface Systems

Brain-computer interfaces (BCIs) aim to enable people to interact with the external world through an alternative, nonmuscular communication channel that uses brain signal responses to complete specific cognitive tasks. BCIs have been growing rapidly during the past few years, with most of the BCI research focusing on system performance, such as improving accuracy or information transfer rate. Despite these advances, BCI research and development is still in its infancy and requires further consideration to significantly affect human experience in most real-world environments. This paper reviews the most recent studies and findings about ergonomic issues in BCIs. We review dry electrodes that can be used to detect brain signals with high enough quality to apply in BCIs and discuss their advantages, disadvantages, and performance. Also, an overview is provided of the wide range of recent efforts to create new interface designs that do not induce fatigue or discomfort during everyday, long-term use. The basic principles of each technique are described, along with examples of current applications in BCI research. Finally, we demonstrate a user-friendly interface paradigm that uses dry capacitive electrodes that do not require any preparation procedure for EEG signal acquisition. We explore the capacitively measured steady-state visual evoked potential (SSVEP) response to an amplitude-modulated visual stimulus and the auditory steady-state response (ASSR) to an auditory stimulus modulated by familiar natural sounds to verify their availability for BCI. We report the first results of an online demonstration that adopted this ergonomic approach to evaluating BCI applications. We expect BCI to become a routine clinical, assistive, and commercial tool through advanced EEG monitoring techniques and innovative interface designs.

Enhanced Plasticity of Human Evoked Potentials by Visual Noise During the Intervention of Steady-State Stimulation Based Brain-Computer Interface

Neuroplasticity, also known as brain plasticity, is an inclusive term that covers the permanent changes in the brain during the course of an individual's life, and neuroplasticity can be broadly defined as the changes in function or structure of the brain in response to the external and/or internal influences. Long-term potentiation (LTP), a well-characterized form of functional synaptic plasticity, could be influenced by rapid-frequency stimulation (or "tetanus") within in vivo human sensory pathways. Also, stochastic resonance (SR) has brought new insight into the field of visual processing for the study of neuroplasticity. In the present study, a brain-computer interface (BCI) intervention based on rapid and repetitive motion-reversal visual stimulation (i.e., a "tetanizing" stimulation) associated with spatiotemporal visual noise was implemented. The goal was to explore the possibility that the induction of LTP-like plasticity in the visual cortex may be enhanced by the SR formalism via changes in the amplitude of visual evoked potentials (VEPs) measured non-invasively from the scalp of healthy subjects. Changes in the absolute amplitude of P1 and N1 components of the transient VEPs during the initial presentation of the steady-state stimulation were used to evaluate the LTP-like plasticity between the non-noise and noise-tagged BCI interventions. We have shown that after adding a moderate visual noise to the rapid-frequency visual stimulation, the degree of the N1 negativity was potentiated following an ~40-min noise-tagged visual tetani. This finding demonstrated that the SR mechanism could enhance the plasticity-like changes in the human visual cortex.

Long-term use of a neural prosthesis in progressive paralysis

Brain–computer interfaces (BCIs) enable communication with others and allow machines or computers to be controlled in the absence of motor activity. Clinical studies evaluating neural prostheses in amyotrophic lateral sclerosis (ALS) patients have been performed; however, to date, no study has reported that ALS patients who progressed from locked-in syndrome (LIS), which has very limited voluntary movement, to a completely locked-in state (CLIS), characterized by complete loss of voluntary movements, were able to continue controlling neural prostheses. To clarify this, we used a BCI system to evaluate three late-stage ALS patients over 27 months. We employed steady-state visual evoked brain potentials elicited by flickering green and blue light-emitting diodes to control the BCI system. All participants reliably controlled the system throughout the entire period (median accuracy: 83.3%). One patient who progressed to CLIS was able to continue operating the system with high accuracy. Furthermore, this patient successfully used the system to respond to yes/no questions. Thus, this CLIS patient was able to operate a neuroprosthetic device, suggesting that the BCI system confers advantages for patients with severe paralysis, including those exhibiting complete loss of muscle movement.

An Adaptive SSVEP-Based Brain-Computer Interface to Compensate Fatigue-Induced Decline of Performance in Practical Application

Brain-computer interfaces based on steady-state visual evoked potentials are promising communication systems for people with speech and motor disabilities. However, reliable SSVEP response requires user's attention, which degrades over time due to significant eye-fatigue when low-frequency visual stimuli (5-15 Hz) are used. Previous studies have shown that eye-fatigue can be reduced using high-frequency flickering stimuli (>25 Hz). Here, it is quantitatively demonstrated that the performance of a high-frequency SSVEP BCI decreases over time, but this amount of decrease can be compensated effectively by using two proposed adaptive algorithms. This leaded to a robust alternative communication system for practical applications. The asynchronous spelling system implemented in this study uses a threshold-based version of LASSO algorithm for frequency recognition. In long online experiments, when participants typed a sentence with the BCI system for 16 times, accuracy of the system was close to its maximum along the experiment. However, regression analysis on typing speed of each sentence demonstrated a significant decrease in all 7 subjects ( ) when thresholds obtained from a calibration test were kept fixed over the experiment. In comparison, no significant change in typing speed was observed when the proposed adaptive algorithms were used. The analysis of variances revealed that the average typing speed of the last four sentences when using adaptive relational algorithm (8.7 char/min) was significantly higher than the tolerance-based algorithm (8.1 char/min) and significantly above 6 char/min when the fixed thresholds were used. Therefore, the relational algorithm proposed in this paper could successfully compensate for the effect of fatigue on performance of the SSVEP BCI system.

Use of Sine Shaped High-Frequency Rhythmic Visual Stimuli Patterns for SSVEP Response Analysis and Fatigue Rate Evaluation in Normal Subjects

Background: Recent EEG-SSVEP signal based BCI studies have used high frequency square pulse visual stimuli to reduce subjective fatigue. However, the effect of total harmonic distortion (THD) has not been considered. Compared to CRT and LCD monitors, LED screen displays high-frequency wave with better refresh rate. In this study, we present high frequency sine wave simple and rhythmic patterns with low THD rate by LED to analyze SSVEP responses and evaluate subjective fatigue in normal subjects. Materials and Methods: We used patterns of 3-sequence high-frequency sine waves (25, 30, and 35 Hz) to design our visual stimuli. Nine stimuli patterns, 3 simple (repetition of each of above 3 frequencies e.g., P25-25-25) and 6 rhythmic (all of the frequencies in 6 different sequences e.g., P25-30-35) were chosen. A hardware setup with low THD rate (<0.1%) was designed to present these patterns on LED. Twenty two normal subjects (aged 23-30 (25 ± 2.1) yrs) were enrolled. Visual analog scale (VAS) was used for subjective fatigue evaluation after presentation of each stimulus pattern. PSD, CCA, and LASSO methods were employed to analyze SSVEP responses. The data including SSVEP features and fatigue rate for different visual stimuli patterns were statistically evaluated. Results: All 9 visual stimuli patterns elicited SSVEP responses. Overall, obtained accuracy rates were 88.35% for PSD and > 90% for CCA and LASSO (for TWs > 1 s). High frequency rhythmic patterns group with low THD rate showed higher accuracy rate (99.24%) than simple patterns group (98.48%). Repeated measure ANOVA showed significant difference between rhythmic pattern features (P < 0.0005). Overall, there was no significant difference between the VAS of rhythmic [3.85 ± 2.13] compared to the simple patterns group [3.96 ± 2.21], (P = 0.63). Rhythmic group had lower within group VAS variation (min = P25-30-35 [2.90 ± 2.45], max = P35-25-30 [4.81 ± 2.65]) as well as least individual pattern VAS (P25-30-35). Discussion and Conclusion: Overall, rhythmic and simple pattern groups had higher and similar accuracy rates. Rhythmic stimuli patterns showed insignificantly lower fatigue rate than simple patterns. We conclude that both rhythmic and simple visual high frequency sine wave stimuli require further research for human subject SSVEP-BCI studies.

Evaluating the Influence of Chromatic and Luminance Stimuli on SSVEPs from Behind-the-Ears and Occipital Areas

This work presents a study of chromatic and luminance stimuli in low-, medium-, and high-frequency stimulation to evoke steady-state visual evoked potential (SSVEP) in the behind-the-ears area. Twelve healthy subjects participated in this study. The electroencephalogram (EEG) was measured on occipital (Oz) and left and right temporal (TP9 and TP10) areas. The SSVEP was evaluated in terms of amplitude, signal-to-noise ratio (SNR), and detection accuracy using power spectral density analysis (PSDA), canonical correlation analysis (CCA), and temporally local multivariate synchronization index (TMSI) methods. It was found that stimuli based on suitable color and luminance elicited stronger SSVEP in the behind-the-ears area, and that the response of the SSVEP was related to the flickering frequency and the color of the stimuli. Thus, green-red stimulus elicited the highest SSVEP in medium-frequency range, and green-blue stimulus elicited the highest SSVEP in high-frequency range, reaching detection accuracy rates higher than 80%. These findings will aid in the development of more comfortable, accurate and stable BCIs with electrodes positioned on the behind-the-ears (hairless) areas.

Operation of a P300-based brain-computer interface in patients with Duchenne muscular dystrophy

A brain-computer interface (BCI) or brain-machine interface is a technology that enables the control of a computer and other external devices using signals from the brain. This technology has been tested in paralysed patients, such as those with cervical spinal cord injuries or amyotrophic lateral sclerosis, but it has not been tested systematically in Duchenne muscular dystrophy (DMD), which is a severe type of muscular dystrophy due to the loss of dystrophin and is often accompanied by progressive muscle weakness and wasting. Here, we investigated the efficacy of a P300-based BCI for patients with DMD. Eight bedridden patients with DMD and eight age- and gender-matched able-bodied controls were instructed to input hiragana characters. We used a region-based, two-step P300-based BCI with green/blue flicker stimuli. EEG data were recorded, and a linear discriminant analysis distinguished the target from other non-targets. The mean online accuracy of inputted characters (accuracy for the two-step procedure) was 71.6% for patients with DMD and 80.6% for controls, with no significant difference between the patients and controls. The P300-based BCI was operated successfully by individuals with DMD in an advanced stage and these findings suggest that this technology may be beneficial for patients with this disease.

An Efficient Asynchronous High-Frequency Steady-State Visual Evoked Potential-Based Brain-Computer Interface speller: The Problem of Individual Differences

Background

Brain-computer interfaces (BCIs) based on steady-state visual evoked potentials (SSVEPs) provide high rates of accuracy and information transfer rate, but need user's attention to flickering visual stimuli. This quickly leads to eye-fatigue when the flickering frequency is in the low-frequency range. High-frequency flickering stimuli (>30 Hz) have been proposed with significantly lower eye-fatigue. However, SSVEP responses in this frequency range are remarkably weaker, leading to doubts about usability of high-frequency stimuli to develop efficient BCI systems. The purpose of this study was to evaluate if a practical SSVEP Speller can be developed with Repetitive Visual Stimuli in the high-frequency range.

Methods

An asynchronous high-frequency (35-40 Hz) speller for typing in Persian language was developed using five flickering visual stimuli. Least absolute shrinkage and selection operator algorithm with two user-calibrated thresholds was used to detect the user's selections. A total of 14 volunteers evaluated the system in an ordinary office environment to type 9 sentences consist of 81 characters with a multistage virtual keyboard.

Results

Despite very high performance of 6.9 chars/min overall typing speed, average accuracy of 98.3%, and information transfer rate of 64.9 bpm for eight of the participants, the other six participants had serious difficulty in spelling with the system and could not complete the typing experiment.

Conclusions

The results of this study in accordance with some previous studies suggest that high rate of illiteracy in high-frequency SSVEP-based BCI systems may be a major burden for their practical application.

Tradeoff between User Experience and BCI Classification Accuracy with Frequency Modulated Steady-State Visual Evoked Potentials

Steady-state visual evoked potentials (SSVEPs) have been widely employed for the control of brain-computer interfaces (BCIs) because they are very robust, lead to high performance, and allow for a high number of commands. However, such flickering stimuli often also cause user discomfort and fatigue, especially when several light sources are used simultaneously. Different variations of SSVEP driving signals have been proposed to increase user comfort. Here, we investigate the suitability of frequency modulation of a high frequency carrier for SSVEP-BCIs. We compared BCI performance and user experience between frequency modulated (FM) and traditional sinusoidal (SIN) SSVEPs in an offline classification paradigm with four independently flickering light-emitting diodes which were overtly attended (fixated). While classification performance was slightly reduced with the FM stimuli, the user comfort was significantly increased. Comparing the SSVEPs for covert attention to the stimuli (without fixation) was not possible, as no reliable SSVEPs were evoked. Our results reveal that several, simultaneously flickering, light emitting diodes can be used to generate FM-SSVEPs with different frequencies and the resulting occipital electroencephalography (EEG) signals can be classified with high accuracy. While the performance we report could be further improved with adjusted stimuli and algorithms, we argue that the increased comfort is an important result and suggest the use of FM stimuli for future SSVEP-BCI applications.

Operation of a P300-based brain-computer interface by patients with spinocerebellar ataxia

Objective

We investigated the efficacy of a P300-based brain-computer interface (BCI) for patients with spinocerebellar ataxia (SCA), which is often accompanied by cerebellar impairment.

Methods

Eight patients with SCA and eight age- and gender-matched healthy controls were instructed to input Japanese hiragana characters using the P300-based BCI with green/blue flicker. All patients depended on some assistance in their daily lives (modified Rankin scale: mean 3.5). The chief symptom was cerebellar ataxia; no cognitive deterioration was present. A region-based, two-step P300-based BCI was used. During the P300 task, eight-channel EEG data were recorded, and a linear discriminant analysis distinguished the target from other nontarget regions of the matrix.

Results

The mean online accuracy in BCI operation was 82.9% for patients with SCA and 83.2% for controls; no significant difference was detected.

Conclusion

The P300-based BCI was operated successfully not only by healthy controls but also by individuals with SCA.

Significance

These results suggest that the P300-based BCI may be applicable for patients with SCA.

Application of a single-flicker online SSVEP BCI for spatial navigation

A promising approach for brain-computer interfaces (BCIs) employs the steady-state visual evoked potential (SSVEP) for extracting control information. Main advantages of these SSVEP BCIs are a simple and low-cost setup, little effort to adjust the system parameters to the user and comparatively high information transfer rates (ITR). However, traditional frequency-coded SSVEP BCIs require the user to gaze directly at the selected flicker stimulus, which is liable to cause fatigue or even photic epileptic seizures. The spatially coded SSVEP BCI we present in this article addresses this issue. It uses a single flicker stimulus that appears always in the extrafoveal field of view, yet it allows the user to control four control channels. We demonstrate the embedding of this novel SSVEP stimulation paradigm in the user interface of an online BCI for navigating a 2-dimensional computer game. Offline analysis of the training data reveals an average classification accuracy of 96.9±1.64%, corresponding to an information transfer rate of 30.1±1.8 bits/min. In online mode, the average classification accuracy reached 87.9±11.4%, which resulted in an ITR of 23.8±6.75 bits/min. We did not observe a strong relation between a subject’s offline and online performance. Analysis of the online performance over time shows that users can reliably control the new BCI paradigm with stable performance over at least 30 minutes of continuous operation.

Polychromatic SSVEP stimuli with subtle flickering adapted to brain-display interactions

OBJECTIVE

Interactive displays armed with natural user interfaces (NUIs) will likely lead the next breakthrough in consumer electronics, and brain-computer interfaces (BCIs) are often regarded as the ultimate NUI-enabling machines to respond to human emotions and mental states. Steady-state visual evoked potentials (SSVEPs) are a commonly used BCI modality due to the ease of detection and high information transfer rates. However, the presence of flickering stimuli may cause user discomfort and can even induce migraines and seizures. With the aim of designing visual stimuli that can be embedded into video images, this study developed a novel approach to induce detectable SSVEPs using a composition of red/green/blue flickering lights.

APPROACH

Based on the opponent theory of colour vision, this study used 32 Hz/40 Hz rectangular red-green or red-blue LED light pulses with a 50% duty cycle, balanced/equal luminance and 0°/180° phase shifts as the stimulating light sources and tested their efficacy in producing SSVEP responses with high signal-to-noise ratios (SNRs) while reducing the perceived flickering sensation.

MAIN RESULTS

The empirical results from ten healthy subjects showed that dual-colour lights flickering at 32 Hz/40 Hz with a 50% duty cycle and 180° phase shift achieved a greater than 90% detection accuracy with little or no flickering sensation.

SIGNIFICANCE

As a first step in developing an embedded SSVEP stimulus in commercial displays, this study provides a foundation for developing a combination of three primary colour flickering backlights with adjustable luminance proportions to create a subtle flickering polychromatic light that can elicit SSVEPs at the basic flickering frequency.

An Evaluation of Training with an Auditory P300 Brain-Computer Interface for the Japanese Hiragana Syllabary

Gaze-independent brain-computer interfaces (BCIs) are a possible communication channel for persons with paralysis. We investigated if it is possible to use auditory stimuli to create a BCI for the Japanese Hiragana syllabary, which has 46 Hiragana characters. Additionally, we investigated if training has an effect on accuracy despite the high amount of different stimuli involved. Able-bodied participants (N = 6) were asked to select 25 syllables (out of fifty possible choices) using a two step procedure: First the consonant (ten choices) and then the vowel (five choices). This was repeated on 3 separate days. Additionally, a person with spinal cord injury (SCI) participated in the experiment. Four out of six healthy participants reached Hiragana syllable accuracies above 70% and the information transfer rate increased from 1.7 bits/min in the first session to 3.2 bits/min in the third session. The accuracy of the participant with SCI increased from 12% (0.2 bits/min) to 56% (2 bits/min) in session three. Reliable selections from a 10 × 5 matrix using auditory stimuli were possible and performance is increased by training. We were able to show that auditory P300 BCIs can be used for communication with up to fifty symbols. This enables the use of the technology of auditory P300 BCIs with a variety of applications.

The Role of Audio-Visual Feedback in a Thought-Based Control of a Humanoid Robot: A BCI Study in Healthy and Spinal Cord Injured People

The efficient control of our body and successful interaction with the environment are possible through the integration of multisensory information. Brain-computer interface (BCI) may allow people with sensorimotor disorders to actively interact in the world. In this study, visual information was paired with auditory feedback to improve the BCI control of a humanoid surrogate. Healthy and spinal cord injured (SCI) people were asked to embody a humanoid robot and complete a pick-and-place task by means of a visual evoked potentials BCI system. Participants observed the remote environment from the robot's perspective through a head mounted display. Human-footsteps and computer-beep sounds were used as synchronous/asynchronous auditory feedback. Healthy participants achieved better placing accuracy when listening to human footstep sounds relative to a computer-generated sound. SCI people demonstrated more difficulty in steering the robot during asynchronous auditory feedback conditions. Importantly, subjective reports highlighted that the BCI mask overlaying the display did not limit the observation of the scenario and the feeling of being in control of the robot. Overall, the data seem to suggest that sensorimotor-related information may improve the control of external devices. Further studies are required to understand how the contribution of residual sensory channels could improve the reliability of BCI systems.

Neurofeedback Therapy for Enhancing Visual Attention: State-of-the-Art and Challenges

We have witnessed a rapid development of brain-computer interfaces (BCIs) linking the brain to external devices. BCIs can be utilized to treat neurological conditions and even to augment brain functions. BCIs offer a promising treatment for mental disorders, including disorders of attention. Here we review the current state of the art and challenges of attention-based BCIs, with a focus on visual attention. Attention-based BCIs utilize electroencephalograms (EEGs) or other recording techniques to generate neurofeedback, which patients use to improve their attention, a complex cognitive function. Although progress has been made in the studies of neural mechanisms of attention, extraction of attention-related neural signals needed for BCI operations is a difficult problem. To attain good BCI performance, it is important to select the features of neural activity that represent attentional signals. BCI decoding of attention-related activity may be hindered by the presence of different neural signals. Therefore, BCI accuracy can be improved by signal processing algorithms that dissociate signals of interest from irrelevant activities. Notwithstanding recent progress, optimal processing of attentional neural signals remains a fundamental challenge for the development of efficient therapies for disorders of attention.

High-speed spelling with a noninvasive brain-computer interface

The past 20 years have witnessed unprecedented progress in brain-computer interfaces (BCIs). However, low communication rates remain key obstacles to BCI-based communication in humans. This study presents an electroencephalogram-based BCI speller that can achieve information transfer rates (ITRs) up to 5.32 bits per second, the highest ITRs reported in BCI spellers using either noninvasive or invasive methods. Based on extremely high consistency of frequency and phase observed between visual flickering signals and the elicited single-trial steady-state visual evoked potentials, this study developed a synchronous modulation and demodulation paradigm to implement the speller. Specifically, this study proposed a new joint frequency-phase modulation method to tag 40 characters with 0.5-s-long flickering signals and developed a user-specific target identification algorithm using individual calibration data. The speller achieved high ITRs in online spelling tasks. This study demonstrates that BCIs can provide a truly naturalistic high-speed communication channel using noninvasively recorded brain activities.

Attention-level transitory response: a novel hybrid BCI approach

OBJECTIVE

People with disabilities may control devices such as a computer or a wheelchair by means of a brain-computer interface (BCI). BCI based on steady-state visual evoked potentials (SSVEP) requires visual stimulation of the user. However, this SSVEP-based BCI suffers from the 'Midas touch effect', i.e., the BCI can detect an SSVEP even when the user is not gazing at the stimulus. Then, these incorrect detections deteriorate the performance of the system, especially in asynchronous BCI because ongoing EEG is classified. In this paper, a novel transitory response of the attention-level of the user is reported. It was used to develop a hybrid BCI (hBCI).

APPROACH

Three methods are proposed to detect the attention-level of the user. They are based on the alpha rhythm and theta/beta rate. The proposed hBCI scheme is presented along with these methods. Hence, the hBCI sends a command only when the user is at a high-level of attention, or in other words, when the user is really focused on the task being performed. The hBCI was tested over two different EEG datasets.

MAIN RESULTS

The performance of the hybrid approach is superior to the standard one. Improvements of 20% in accuracy and 10 bits min(-1) are reported. Moreover, the attention-level is extracted from the same EEG channels used in SSVEP detection and this way, no extra hardware is needed.

SIGNIFICANCE

A transitory response of EEG signal is used to develop the attention-SSVEP hBCI which is capable of reducing the Midas touch effect.