Influence of the Number of Channels and Classification Algorithm on the Performance Robustness to Electrode Shift in Steady-State Visual Evoked Potential-Based Brain-Computer Interfaces

Spatial Variation Generation Algorithm for Motor Imagery Data Augmentation: Increasing the Density of Sample Vicinity

The imbalanced development between deep learning-based model design and motor imagery (MI) data acquisition raises concerns about the potential overfitting issue-models can identify training data well but fail to generalize test data. In this study, a Spatial Variation Generation (SVG) algorithm for MI data augmentation is proposed to alleviate the overfitting issue. In essence, SVG generates MI data using variations of electrode placement and brain spatial pattern, ultimately elevating the density of the raw sample vicinity. The proposed SVG prevents models from memorizing the training data by replacing the raw samples with the proper vicinal distribution. Moreover, SVG generates a uniform distribution and stabilizes the training process of models. In comparison studies involving five deep learning-based models across eight datasets, the proposed SVG algorithm exhibited a notable improvement of 0.021 in the area under the receiver operating characteristic curve (AUC). The improvement achieved by SVG outperforms other data augmentation algorithms. Further results from the ablation study verify the effectiveness of each component of SVG. Finally, the studies in the control group with varying numbers of samples show that the SVG algorithm consistently improves the AUC, with improvements ranging from approximately 0.02 to 0.15.

Novel hybrid visual stimuli incorporating periodic motions into conventional flickering or pattern-reversal visual stimuli for steady-state visual evoked potential-based brain-computer interfaces

In this study, we proposed a new type of hybrid visual stimuli for steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs), which incorporate various periodic motions into conventional flickering stimuli (FS) or pattern reversal stimuli (PRS). Furthermore, we investigated optimal periodic motions for each FS and PRS to enhance the performance of SSVEP-based BCIs. Periodic motions were implemented by changing the size of the stimulus according to four different temporal functions denoted by none, square, triangular, and sine, yielding a total of eight hybrid visual stimuli. Additionally, we developed the extended version of filter bank canonical correlation analysis (FBCCA), which is a state-of-the-art training-free classification algorithm for SSVEP-based BCIs, to enhance the classification accuracy for PRS-based hybrid visual stimuli. Twenty healthy individuals participated in the SSVEP-based BCI experiment to discriminate four visual stimuli with different frequencies. An average classification accuracy and information transfer rate (ITR) were evaluated to compare the performances of SSVEP-based BCIs for different hybrid visual stimuli. Additionally, the user's visual fatigue for each of the hybrid visual stimuli was also evaluated. As the result, for FS, the highest performances were reported when the periodic motion of the sine waveform was incorporated for all window sizes except for 3 s. For PRS, the periodic motion of the square waveform showed the highest classification accuracies for all tested window sizes. A significant statistical difference in the performance between the two best stimuli was not observed. The averaged fatigue scores were reported to be 5.3 ± 2.05 and 4.05 ± 1.28 for FS with sine-wave periodic motion and PRS with square-wave periodic motion, respectively. Consequently, our results demonstrated that FS with sine-wave periodic motion and PRS with square-wave periodic motion could effectively improve the BCI performances compared to conventional FS and PRS. In addition, thanks to its low visual fatigue, PRS with square-wave periodic motion can be regarded as the most appropriate visual stimulus for the long-term use of SSVEP-based BCIs, particularly for window sizes equal to or larger than 2 s.