Reaction Time Predicts Brain-Computer Interface Aptitude

Enhancing poststroke hand movement recovery: Efficacy of RehabSwift, a personalized brain-computer interface system

This study explores the efficacy of our novel and personalized brain-computer interface (BCI) therapy, in enhancing hand movement recovery among stroke survivors. Stroke often results in impaired motor function, posing significant challenges in daily activities and leading to considerable societal and economic burdens. Traditional physical and occupational therapies have shown limitations in facilitating satisfactory recovery for many patients. In response, our study investigates the potential of motor imagery-based BCIs (MI-BCIs) as an alternative intervention. In this study, MI-BCIs translate imagined hand movements into actions using a combination of scalp-recorded electrical brain activity and signal processing algorithms. Our prior research on MI-BCIs, which emphasizes the benefits of proprioceptive feedback over traditional visual feedback and the importance of customizing the delay between brain activation and passive hand movement, led to the development of RehabSwift therapy. In this study, we recruited 12 chronic-stage stroke survivors to assess the effectiveness of our solution. The primary outcome measure was the Fugl-Meyer upper extremity (FMA-UE) assessment, complemented by secondary measures including the action research arm test, reaction time, unilateral neglect, spasticity, grip and pinch strength, goal attainment scale, and FMA-UE sensation. Our findings indicate a remarkable improvement in hand movement and a clinically significant reduction in poststroke arm and hand impairment following 18 sessions of neurofeedback training. The effects persisted for at least 4 weeks posttreatment. These results underscore the potential of MI-BCIs, particularly our solution, as a prospective tool in stroke rehabilitation, offering a personalized and adaptable approach to neurofeedback training.

Can Inter-Subject Associativity Predict Data-Driven BCI Performance?

Intra- and inter-subject variability causes covariate shifts in training and testing feature spaces, resulting in low sensorimotor (SMR) brain-computer interface (BCI) performance for practical implementation. Studies involving data-driven transfer learning strategies demonstrated improving BCI performance by covariate shift adaptation. In this study, we aim to illustrate if inter-subject associativity (e.g., subjects having similar SMR brain dynamics) can predict data-driven inter-subject BCI performance. We implemented a BCI classification pipeline with a common spatial pattern, principal component analysis and linear discriminant analysis for performance evaluation. Both intra- and inter-subject BCI were evaluated in 5-Fold Validation settings. We further proposed a Bhattacharyya distance-based covariate shift score (CSS) for assessing the difference between training and testing feature domains. We performed Pearson correlation analysis to draw the relation-ship between BCI performance and CSS. Intra-subject BCI performances were significantly and negatively correlated with CSS (r = -0.94, p < 0.05). For the inter-subject experiment, BCI performances were also highly and negatively associated with CSS (r = -0.61, p < 0.05). However, this data-driven BCI evaluation framework does not necessarily manifest inter-subject associativity in BCI performance, requiring further investigations for a conclusion.Clinical relevance- If it predicts BCI performance successfully, inter-subject associativity could reduce time-consuming and annoying subject-specific calibration for the users.

Subject Separation Network for Reducing Calibration Time of MI-Based BCI

Motor imagery brain-computer interface (MI-based BCIs) have demonstrated great potential in various applications. However, to well generalize classifiers to new subjects, a time-consuming calibration process is necessary due to high inter-subject variabilities of EEG signals. This process is costly and tedious, hindering the further expansion of MI-based BCIs outside of the laboratory. To reduce the calibration time of MI-based BCIs, we propose a novel domain adaptation framework that adapts multiple source subjects' labeled data to the unseen trials of target subjects. Firstly, we train one Subject Separation Network(SSN) for each of the source subjects in the dataset. Based on adversarial domain adaptation, a shared encoder is constructed to learn similar representations for both domains. Secondly, to model the factors that cause subject variabilities and eliminate the correlated noise existing in common feature space, private feature spaces orthogonal to the shared counterpart are learned for each subject. We use a shared decoder to validate that the model is actually learning from task-relevant neurophysiological information. At last, an ensemble classifier is built by the integration of the SSNs using the information extracted from each subject's task-relevant characteristics. To quantify the efficacy of the framework, we analyze the accuracy-calibration cost trade-off in MI-based BCIs, and theoretically guarantee a generalization bound on the target error. Visualizations of the transformed features illustrate the effectiveness of domain adaptation. The experimental results on the BCI Competition IV-IIa dataset prove the effectiveness of the proposed framework compared with multiple classification methods. We infer from our results that users could learn to control MI-based BCIs without a heavy calibration process. Our study further shows how to design and train Neural Networks to decode task-related information from different subjects and highlights the potential of deep learning methods for inter-subject EEG decoding.

Vividness of Visual Imagery and Personality Impact Motor-Imagery Brain Computer Interfaces

Brain-computer interfaces (BCIs) are communication bridges between a human brain and external world, enabling humans to interact with their environment without muscle intervention. Their functionality, therefore, depends on both the BCI system and the cognitive capacities of the user. Motor-imagery BCIs (MI-BCI) rely on the users' mental imagination of body movements. However, not all users have the ability to sufficiently modulate their brain activity for control of a MI-BCI; a problem known as BCI illiteracy or inefficiency. The underlying mechanism of this phenomenon and the cause of such difference among users is yet not fully understood. In this study, we investigated the impact of several cognitive and psychological measures on MI-BCI performance. Fifty-five novice BCI-users participated in a left- versus right-hand motor imagery task. In addition to their BCI classification error rate and demographics, psychological measures including personality factors, affinity for technology, and motivation during the experiment, as well as cognitive measures including visuospatial memory and spatial ability and Vividness of Visual Imagery were collected. Factors that were found to have a significant impact on MI-BCI performance were Vividness of Visual Imagery, and the personality factors of orderliness and autonomy. These findings shed light on individual traits that lead to difficulty in BCI operation and hence can help with early prediction of inefficiency among users to optimize training for them.

A Comprehensive Review on Critical Issues and Possible Solutions of Motor Imagery Based Electroencephalography Brain-Computer Interface

Motor imagery (MI) based brain–computer interface (BCI) aims to provide a means of communication through the utilization of neural activity generated due to kinesthetic imagination of limbs. Every year, a significant number of publications that are related to new improvements, challenges, and breakthrough in MI-BCI are made. This paper provides a comprehensive review of the electroencephalogram (EEG) based MI-BCI system. It describes the current state of the art in different stages of the MI-BCI (data acquisition, MI training, preprocessing, feature extraction, channel and feature selection, and classification) pipeline. Although MI-BCI research has been going for many years, this technology is mostly confined to controlled lab environments. We discuss recent developments and critical algorithmic issues in MI-based BCI for commercial deployment.

Intra- and Inter-subject Variability in EEG-Based Sensorimotor Brain Computer Interface: A Review

Brain computer interfaces (BCI) for the rehabilitation of motor impairments exploit sensorimotor rhythms (SMR) in the electroencephalogram (EEG). However, the neurophysiological processes underpinning the SMR often vary over time and across subjects. Inherent intra- and inter-subject variability causes covariate shift in data distributions that impede the transferability of model parameters amongst sessions/subjects. Transfer learning includes machine learning-based methods to compensate for inter-subject and inter-session (intra-subject) variability manifested in EEG-derived feature distributions as a covariate shift for BCI. Besides transfer learning approaches, recent studies have explored psychological and neurophysiological predictors as well as inter-subject associativity assessment, which may augment transfer learning in EEG-based BCI. Here, we highlight the importance of measuring inter-session/subject performance predictors for generalized BCI frameworks for both normal and motor-impaired people, reducing the necessity for tedious and annoying calibration sessions and BCI training.

Development of a new high sensitivity mechanical switch for augmentative and alternative communication access in people with amyotrophic lateral sclerosis

BACKGROUND

People with Amyotrophic Lateral Sclerosis (PwALS) in the advanced phase are critically affected by an almost total loss of mobility and severe communication problems. Scanning access based on the patient's interaction with a sensor (or switch) that intercepts even a weak body movement is a valid communication aid. However, its use becomes limited with the progressive decline of residual movements. To overcome this problem, we designed a new sensor, the Lever Magnetic-spring Mechanical Switch (LeMMS), allowing repeated activation/release cycles requiring a very small activation force.

METHODS

The LeMMS was applied and validated in a group of 20 PwALS in an advanced stage of disease. All subjects were regular users of communication aids employing other sensors, but which they could no longer operate their sensors (different from LeMMS). Patients were assessed at baseline (t0) and after one (t1), 6 (t2) and 12 (t3) months. Assessment at t0 included administration of standardized clinical scales, the Click-Test-30 counting the maximum number of LeMMS activations in 30 s, and thumb/fingers strength assessment with the Kendall scale. The QUEST 2.0-Dev questionnaire was administered at t1. Some use-related information and the Click-Test-30 were collected at t1, t2 and t3.

RESULTS

After one training session, all patients could operate the LeMMS with minimal residual movement of one finger. At t1, they used it on average 5.45 h/day. The mean score of the QUEST 2.0-Dev was 4.63, suggesting strong satisfaction with the LeMMS. Regarding Click-Test-30 scores, no significant difference was found between t0 and t1, but performance at t2 and t3 declined significantly (p < 0.005 vs. t0). At t3, 9/20 patients were still able to use their communication aid.

CONCLUSIONS

This new switch sensor can enable PwALS to use their communication aids for a prolonged time even in the advanced phase of disease. It is easy to use, reliable and cheap, thus representing an intermediate alternative to more sophisticated and costly devices.