1
|
Kumar S, Alawieh H, Racz FS, Fakhreddine R, Millán JDR. Transfer learning promotes acquisition of individual BCI skills. PNAS NEXUS 2024; 3:pgae076. [PMID: 38426121 PMCID: PMC10903645 DOI: 10.1093/pnasnexus/pgae076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/05/2023] [Accepted: 02/05/2024] [Indexed: 03/02/2024]
Abstract
Subject training is crucial for acquiring brain-computer interface (BCI) control. Typically, this requires collecting user-specific calibration data due to high inter-subject neural variability that limits the usability of generic decoders. However, calibration is cumbersome and may produce inadequate data for building decoders, especially with naïve subjects. Here, we show that a decoder trained on the data of a single expert is readily transferrable to inexperienced users via domain adaptation techniques allowing calibration-free BCI training. We introduce two real-time frameworks, (i) Generic Recentering (GR) through unsupervised adaptation and (ii) Personally Assisted Recentering (PAR) that extends GR by employing supervised recalibration of the decoder parameters. We evaluated our frameworks on 18 healthy naïve subjects over five online sessions, who operated a customary synchronous bar task with continuous feedback and a more challenging car racing game with asynchronous control and discrete feedback. We show that along with improved task-oriented BCI performance in both tasks, our frameworks promoted subjects' ability to acquire individual BCI skills, as the initial neurophysiological control features of an expert subject evolved and became subject specific. Furthermore, those features were task-specific and were learned in parallel as participants practiced the two tasks in every session. Contrary to previous findings implying that supervised methods lead to improved online BCI control, we observed that longitudinal training coupled with unsupervised domain matching (GR) achieved similar performance to supervised recalibration (PAR). Therefore, our presented frameworks facilitate calibration-free BCIs and have immediate implications for broader populations-such as patients with neurological pathologies-who might struggle to provide suitable initial calibration data.
Collapse
Affiliation(s)
- Satyam Kumar
- Chandra Family Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX 78712, USA
| | - Hussein Alawieh
- Chandra Family Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX 78712, USA
| | - Frigyes Samuel Racz
- Department of Neurology, The University of Texas at Austin, Austin, TX 78712, USA
- Mulva Clinic for the Neurosciences, The University of Texas at Austin, Austin, TX 78712, USA
| | - Rawan Fakhreddine
- Chandra Family Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX 78712, USA
| | - José del R Millán
- Chandra Family Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX 78712, USA
- Department of Neurology, The University of Texas at Austin, Austin, TX 78712, USA
- Mulva Clinic for the Neurosciences, The University of Texas at Austin, Austin, TX 78712, USA
- Departement of Biomedical Engineering, The University of Texas at Austin, Austin, TX 78712, USA
| |
Collapse
|
2
|
Ivanov N, Lio A, Chau T. Towards user-centric BCI design: Markov chain-based user assessment for mental imagery EEG-BCIs. J Neural Eng 2023; 20:066037. [PMID: 38128128 DOI: 10.1088/1741-2552/ad17f2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Accepted: 12/21/2023] [Indexed: 12/23/2023]
Abstract
Objective.While electroencephalography (EEG)-based brain-computer interfaces (BCIs) have many potential clinical applications, their use is impeded by poor performance for many users. To improve BCI performance, either via enhanced signal processing or user training, it is critical to understand and describe each user's ability to perform mental control tasks and produce discernible EEG patterns. While classification accuracy has predominantly been used to assess user performance, limitations and criticisms of this approach have emerged, thus prompting the need to develop novel user assessment approaches with greater descriptive capability. Here, we propose a combination of unsupervised clustering and Markov chain models to assess and describe user skill.Approach.Using unsupervisedK-means clustering, we segmented the EEG signal space into regions representing pattern states that users could produce. A user's movement through these pattern states while performing different tasks was modeled using Markov chains. Finally, using the steady-state distributions and entropy rates of the Markov chains, we proposed two metricstaskDistinctandrelativeTaskInconsistencyto assess, respectively, a user's ability to (i) produce distinct task-specific patterns for each mental task and (ii) maintain consistent patterns during individual tasks.Main results.Analysis of data from 14 adolescents using a three-class BCI revealed significant correlations between thetaskDistinctandrelativeTaskInconsistencymetrics and classification F1 score. Moreover, analysis of the pattern states and Markov chain models yielded descriptive information regarding user performance not immediately apparent from classification accuracy.Significance.Our proposed user assessment method can be used in concert with classifier-based analysis to further understand the extent to which users produce task-specific, time-evolving EEG patterns. In turn, this information could be used to enhance user training or classifier design.
Collapse
Affiliation(s)
- Nicolas Ivanov
- Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada
| | - Aaron Lio
- Division of Engineering Science, University of Toronto, Toronto, ON, Canada
| | - Tom Chau
- Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
3
|
Vidaurre C, Irastorza-Landa N, Sarasola-Sanz A, Insausti-Delgado A, Ray AM, Bibián C, Helmhold F, Mahmoud WJ, Ortego-Isasa I, López-Larraz E, Lozano Peiteado H, Ramos-Murguialday A. Challenges of neural interfaces for stroke motor rehabilitation. Front Hum Neurosci 2023; 17:1070404. [PMID: 37789905 PMCID: PMC10543821 DOI: 10.3389/fnhum.2023.1070404] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Accepted: 08/28/2023] [Indexed: 10/05/2023] Open
Abstract
More than 85% of stroke survivors suffer from different degrees of disability for the rest of their lives. They will require support that can vary from occasional to full time assistance. These conditions are also associated to an enormous economic impact for their families and health care systems. Current rehabilitation treatments have limited efficacy and their long-term effect is controversial. Here we review different challenges related to the design and development of neural interfaces for rehabilitative purposes. We analyze current bibliographic evidence of the effect of neuro-feedback in functional motor rehabilitation of stroke patients. We highlight the potential of these systems to reconnect brain and muscles. We also describe all aspects that should be taken into account to restore motor control. Our aim with this work is to help researchers designing interfaces that demonstrate and validate neuromodulation strategies to enforce a contingent and functional neural linkage between the central and the peripheral nervous system. We thus give clues to design systems that can improve or/and re-activate neuroplastic mechanisms and open a new recovery window for stroke patients.
Collapse
Affiliation(s)
- Carmen Vidaurre
- TECNALIA, Basque Research and Technology Alliance (BRTA), San Sebastian, Spain
- Ikerbasque Science Foundation, Bilbao, Spain
| | | | | | | | - Andreas M. Ray
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Carlos Bibián
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Florian Helmhold
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Wala J. Mahmoud
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Iñaki Ortego-Isasa
- TECNALIA, Basque Research and Technology Alliance (BRTA), San Sebastian, Spain
| | - Eduardo López-Larraz
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
- Bitbrain, Zaragoza, Spain
| | | | - Ander Ramos-Murguialday
- TECNALIA, Basque Research and Technology Alliance (BRTA), San Sebastian, Spain
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| |
Collapse
|
4
|
Huang Y, Huan Y, Zou Z, Pei W, Gao X, Wang Y, Zheng L. A wearable group-synchronized EEG system for multi-subject brain-computer interfaces. Front Neurosci 2023; 17:1176344. [PMID: 37539380 PMCID: PMC10396297 DOI: 10.3389/fnins.2023.1176344] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Accepted: 06/26/2023] [Indexed: 08/05/2023] Open
Abstract
Objective The multi-subject brain-computer interface (mBCI) is becoming a key tool for the analysis of group behaviors. It is necessary to adopt a neural recording system for collaborative brain signal acquisition, which is usually in the form of a fixed wire. Approach In this study, we designed a wireless group-synchronized neural recording system that supports real-time mBCI and event-related potential (ERP) analysis. This system uses a wireless synchronizer to broadcast events to multiple wearable EEG amplifiers. The simultaneously received broadcast signals are marked in data packets to achieve real-time event correlation analysis of multiple targets in a group. Main results To evaluate the performance of the proposed real-time group-synchronized neural recording system, we conducted collaborative signal sampling on 10 wireless mBCI devices. The average signal correlation reached 99.8%, the amplitude of average noise was 0.87 μV, and the average common mode rejection ratio (CMRR) reached 109.02 dB. The minimum synchronization error is 237 μs. We also tested the system in real-time processing of the steady-state visual-evoked potential (SSVEP) ranging from 8 to 15.8 Hz. Under 40 target stimulators, with 2 s data length, the average information transfer rate (ITR) reached 150 ± 20 bits/min, and the highest reached 260 bits/min, which was comparable to the marketing leading EEG system (the average: 150 ± 15 bits/min; the highest: 280 bits/min). The accuracy of target recognition in 2 s was 98%, similar to that of the Synamps2 (99%), but a higher signal-to-noise ratio (SNR) of 5.08 dB was achieved. We designed a group EEG cognitive experiment; to verify, this system can be used in noisy settings. Significance The evaluation results revealed that the proposed real-time group-synchronized neural recording system is a high-performance tool for real-time mBCI research. It is an enabler for a wide range of future applications in collaborative intelligence, cognitive neurology, and rehabilitation.
Collapse
Affiliation(s)
- Yong Huang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China
- Brain-Inspired Computing Laboratory, Guangdong Institute of Intelligence Science and Technology, Hengqin, China
| | - Yuxiang Huan
- Brain-Inspired Computing Laboratory, Guangdong Institute of Intelligence Science and Technology, Hengqin, China
| | - Zhuo Zou
- School of Information Science and Technology, Fudan University, Shanghai, China
| | - Weihua Pei
- Institute of Semiconductors, Chinese Academy of Sciences (CAS), Beijing, China
| | - Xiaorong Gao
- Department of Biomedical Engineering, Tsinghua University, Beijing, China
| | - Yijun Wang
- Institute of Semiconductors, Chinese Academy of Sciences (CAS), Beijing, China
| | - Lirong Zheng
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China
- Brain-Inspired Computing Laboratory, Guangdong Institute of Intelligence Science and Technology, Hengqin, China
| |
Collapse
|
5
|
Gemborn Nilsson M, Tufvesson P, Heskebeck F, Johansson M. An open-source human-in-the-loop BCI research framework: method and design. Front Hum Neurosci 2023; 17:1129362. [PMID: 37441434 PMCID: PMC10335802 DOI: 10.3389/fnhum.2023.1129362] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Accepted: 06/08/2023] [Indexed: 07/15/2023] Open
Abstract
Brain-computer interfaces (BCIs) translate brain activity into digital commands for interaction with the physical world. The technology has great potential in several applied areas, ranging from medical applications to entertainment industry, and creates new conditions for basic research in cognitive neuroscience. The BCIs of today, however, offer only crude online classification of the user's current state of mind, and more sophisticated decoding of mental states depends on time-consuming offline data analysis. The present paper addresses this limitation directly by leveraging a set of improvements to the analytical pipeline to pave the way for the next generation of online BCIs. Specifically, we introduce an open-source research framework that features a modular and customizable hardware-independent design. This framework facilitates human-in-the-loop (HIL) model training and retraining, real-time stimulus control, and enables transfer learning and cloud computing for the online classification of electroencephalography (EEG) data. Stimuli for the subject and diagnostics for the researcher are shown on separate displays using web browser technologies. Messages are sent using the Lab Streaming Layer standard and websockets. Real-time signal processing and classification, as well as training of machine learning models, is facilitated by the open-source Python package Timeflux. The framework runs on Linux, MacOS, and Windows. While online analysis is the main target of the BCI-HIL framework, offline analysis of the EEG data can be performed with Python, MATLAB, and Julia through packages like MNE, EEGLAB, or FieldTrip. The paper describes and discusses desirable properties of a human-in-the-loop BCI research platform. The BCI-HIL framework is released under MIT license with examples at: bci.lu.se/bci-hil (or at: github.com/bci-hil/bci-hil).
Collapse
Affiliation(s)
| | - Pex Tufvesson
- Department of Automatic Control, Lund University, Lund, Sweden
- Ericsson Research, Lund, Sweden
| | - Frida Heskebeck
- Department of Automatic Control, Lund University, Lund, Sweden
| | | |
Collapse
|
6
|
Ivanov N, Chau T. Riemannian geometry-based metrics to measure and reinforce user performance changes during brain-computer interface user training. Front Comput Neurosci 2023; 17:1108889. [PMID: 36860616 PMCID: PMC9968793 DOI: 10.3389/fncom.2023.1108889] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2022] [Accepted: 01/25/2023] [Indexed: 02/15/2023] Open
Abstract
Despite growing interest and research into brain-computer interfaces (BCI), their usage remains limited outside of research laboratories. One reason for this is BCI inefficiency, the phenomenon where a significant number of potential users are unable to produce machine-discernible brain signal patterns to control the devices. To reduce the prevalence of BCI inefficiency, some have advocated for novel user-training protocols that enable users to more effectively modulate their neural activity. Important considerations for the design of these protocols are the assessment measures that are used for evaluating user performance and for providing feedback that guides skill acquisition. Herein, we present three trial-wise adaptations (running, sliding window and weighted average) of Riemannian geometry-based user-performance metrics (classDistinct reflecting the degree of class separability and classStability reflecting the level of within-class consistency) to enable feedback to the user following each individual trial. We evaluated these metrics, along with conventional classifier feedback, using simulated and previously recorded sensorimotor rhythm-BCI data to assess their correlation with and discrimination of broader trends in user performance. Analysis revealed that the sliding window and weighted average variants of our proposed trial-wise Riemannian geometry-based metrics more accurately reflected performance changes during BCI sessions compared to conventional classifier output. The results indicate the metrics are a viable method for evaluating and tracking user performance changes during BCI-user training and, therefore, further investigation into how these metrics may be presented to users during training is warranted.
Collapse
Affiliation(s)
- Nicolas Ivanov
- PRISM Lab, Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada
| | - Tom Chau
- PRISM Lab, Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
7
|
Al-Tahir I, Sensinger J, Scheme E. A Better Framework for the Assessment of Performance and Stability of Co-Adaptive Myoelectric Systems. IEEE Int Conf Rehabil Robot 2022; 2022:1-5. [PMID: 36176075 DOI: 10.1109/icorr55369.2022.9896541] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Co-adaptive myoelectric human-machine systems are a fairly recent, but promising, advancement in pattern recognition-based myoelectric control. Their performance and stability, however, are not fully understood due in part to a lack of proper assessment tools. Time-series based analyses are typically used despite the availability of techniques used in other fields that can robustly measure stability and performance. In this research, we leverage the success achieved by lower limb systems to improve the assessment framework of co-adaptive myoelectric systems by exploiting a key feature common between the two systems. The cyclical dynamics found in lower limbs are also apparent in co-adaptive myoelectric systems, allowing us to analyze their behavior using Poincaré maps. A 10-day experiment was designed and conducted to observe the effects of algorithm adaptation and myoelectric experience level on the performance of a co-adaptive myoelectric control system. Through Poincaré maps, we were able to identify learning effects, as well as oscillations and uncertainty in performance. Assessment of these seemingly random variations in performance led to the inference that co-adaptive systems can be chaotic. Modelling co-adaptive myoelectric systems as cyclical leads to the application of an improved framework to better assess and describe their dynamics and performance.
Collapse
|
8
|
Nawfel JL, Englehart KB, Scheme EJ. The Influence of Training with Visual Biofeedback on the Predictability of Myoelectric Control Usability. IEEE Trans Neural Syst Rehabil Eng 2022; 30:878-892. [PMID: 35333717 DOI: 10.1109/tnsre.2022.3162421] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Studies have shown that closed-loop myoelectric control schemes can lead to changes in user performance and behavior compared to open-loop systems. When users are placed within the control loop, such as during real-time use, they must correct for errors made by the controller and learn what behavior is necessary to produce desired outcomes. Augmented feedback, consequently, has been used to incorporate the user throughout the training process and to facilitate learning. This work explores the effect of visual feedback presented during user training on both the performance and predictability of a myoelectric classification-based control system. Our results suggest that properly designed feedback mechanisms and training tasks can influence the quality of the training data and the ability to predict usability using linear combinations of metrics derived from feature space. Furthermore, our results confirm that the most common in-lab training protocol, screen guided training, may yield training data that are less representative of online use than training protocols that incorporate the user in the loop. These results suggest that training protocols should be designed that better parallel the testing environment to more effectively prepare both the algorithms and users for real-time control.
Collapse
|
9
|
Yeung D, Guerra IM, Barner-Rasmussen I, Siponen E, Farina D, Vujaklija I. Co-adaptive control of bionic limbs via unsupervised adaptation of muscle synergies. IEEE Trans Biomed Eng 2022; 69:2581-2592. [PMID: 35157573 DOI: 10.1109/tbme.2022.3150665] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
OBJECTIVE In this work, we present a myoelectric interface that extracts natural motor synergies from multi-muscle signals and adapts in real-time with new user inputs. With this unsupervised adaptive myocontrol (UAM) system, optimal synergies for control are continuously co-adapted with changes in user motor control, or as a function of perturbed conditions via online non-negative matrix factorization guided by physiologically informed sparseness constraints in lieu of explicit data labelling. METHODS UAM was tested in a set of virtual target reaching tasks completed by able-bodied and amputee subjects. Tests were conducted under normative and electrode perturbed conditions to gauge control robustness with comparisons to non-adaptive and supervised adaptive myocontrol schemes. Furthermore, UAM was used to interface an amputee with a multi-functional powered hand prosthesis during standardized Clothespin Relocation Tests, also conducted in normative and perturbed conditions. RESULTS In virtual tests, UAM effectively mitigated performance degradation caused by electrode displacement, affording greater resilience over an existing supervised adaptive system for amputee subjects. Induced electrode shifts also had negligible effect on the real world control performance of UAM with consistent completion times (23.91±1.33 s) achieved across Clothespin Relocation Tests in the normative and electrode perturbed conditions. CONCLUSION UAM affords comparable robustness improvements to existing supervised adaptive myocontrol interfaces whilst providing additional practical advantages for clinical deployment. SIGNIFICANCE The proposed system uniquely incorporates neuromuscular control principles with unsupervised online learning methods and presents a working example of a freely co-adaptive bionic interface.
Collapse
|
10
|
Gao X, Wang Y, Chen X, Gao S. Interface, interaction, and intelligence in generalized brain-computer interfaces. Trends Cogn Sci 2021; 25:671-684. [PMID: 34116918 DOI: 10.1016/j.tics.2021.04.003] [Citation(s) in RCA: 52] [Impact Index Per Article: 17.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2020] [Revised: 03/07/2021] [Accepted: 04/05/2021] [Indexed: 11/16/2022]
Abstract
A brain-computer interface (BCI) establishes a direct communication channel between a brain and an external device. With recent advances in neurotechnology and artificial intelligence (AI), the brain signals in BCI communication have been advanced from sensation and perception to higher-level cognition activities. While the field of BCI has grown rapidly in the past decades, the core technologies and innovative ideas behind seemingly unrelated BCI systems have never been summarized from an evolutionary point of view. Here, we review various BCI paradigms and present an evolutionary model of generalized BCI technology which comprises three stages: interface, interaction, and intelligence (I3). We also highlight challenges, opportunities, and future perspectives in the development of new BCI technology.
Collapse
Affiliation(s)
- Xiaorong Gao
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China
| | - Yijun Wang
- Institute of Semiconductors, Chinese Academy of Sciences, Beijing, China
| | - Xiaogang Chen
- Institute of Biomedical Engineering, Chinese Academy of Medical Sciences, Tianjin, China
| | - Shangkai Gao
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China.
| |
Collapse
|
11
|
De Santis D. A Framework for Optimizing Co-adaptation in Body-Machine Interfaces. Front Neurorobot 2021; 15:662181. [PMID: 33967733 PMCID: PMC8097093 DOI: 10.3389/fnbot.2021.662181] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2021] [Accepted: 03/22/2021] [Indexed: 11/13/2022] Open
Abstract
The operation of a human-machine interface is increasingly often referred to as a two-learners problem, where both the human and the interface independently adapt their behavior based on shared information to improve joint performance over a specific task. Drawing inspiration from the field of body-machine interfaces, we take a different perspective and propose a framework for studying co-adaptation in scenarios where the evolution of the interface is dependent on the users' behavior and that do not require task goals to be explicitly defined. Our mathematical description of co-adaptation is built upon the assumption that the interface and the user agents co-adapt toward maximizing the interaction efficiency rather than optimizing task performance. This work describes a mathematical framework for body-machine interfaces where a naïve user interacts with an adaptive interface. The interface, modeled as a linear map from a space with high dimension (the user input) to a lower dimensional feedback, acts as an adaptive “tool” whose goal is to minimize transmission loss following an unsupervised learning procedure and has no knowledge of the task being performed by the user. The user is modeled as a non-stationary multivariate Gaussian generative process that produces a sequence of actions that is either statistically independent or correlated. Dependent data is used to model the output of an action selection module concerned with achieving some unknown goal dictated by the task. The framework assumes that in parallel to this explicit objective, the user is implicitly learning a suitable but not necessarily optimal way to interact with the interface. Implicit learning is modeled as use-dependent learning modulated by a reward-based mechanism acting on the generative distribution. Through simulation, the work quantifies how the system evolves as a function of the learning time scales when a user learns to operate a static vs. an adaptive interface. We show that this novel framework can be directly exploited to readily simulate a variety of interaction scenarios, to facilitate the exploration of the parameters that lead to optimal learning dynamics of the joint system, and to provide an empirical proof for the superiority of human-machine co-adaptation over user adaptation.
Collapse
Affiliation(s)
- Dalia De Santis
- Department of Robotics, Brain and Cognitive Sciences, Center for Human Technologies, Istituto Italiano di Tecnologia, Genova, Italy
| |
Collapse
|
12
|
Singh A, Hussain AA, Lal S, Guesgen HW. A Comprehensive Review on Critical Issues and Possible Solutions of Motor Imagery Based Electroencephalography Brain-Computer Interface. SENSORS 2021; 21:s21062173. [PMID: 33804611 PMCID: PMC8003721 DOI: 10.3390/s21062173] [Citation(s) in RCA: 36] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/28/2020] [Revised: 03/15/2021] [Accepted: 03/16/2021] [Indexed: 01/16/2023]
Abstract
Motor imagery (MI) based brain–computer interface (BCI) aims to provide a means of communication through the utilization of neural activity generated due to kinesthetic imagination of limbs. Every year, a significant number of publications that are related to new improvements, challenges, and breakthrough in MI-BCI are made. This paper provides a comprehensive review of the electroencephalogram (EEG) based MI-BCI system. It describes the current state of the art in different stages of the MI-BCI (data acquisition, MI training, preprocessing, feature extraction, channel and feature selection, and classification) pipeline. Although MI-BCI research has been going for many years, this technology is mostly confined to controlled lab environments. We discuss recent developments and critical algorithmic issues in MI-based BCI for commercial deployment.
Collapse
|
13
|
Rizzoglio F, Casadio M, De Santis D, Mussa-Ivaldi FA. Building an adaptive interface via unsupervised tracking of latent manifolds. Neural Netw 2021; 137:174-187. [PMID: 33636657 DOI: 10.1016/j.neunet.2021.01.009] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2020] [Revised: 11/16/2020] [Accepted: 01/14/2021] [Indexed: 01/05/2023]
Abstract
In human-machine interfaces, decoder calibration is critical to enable an effective and seamless interaction with the machine. However, recalibration is often necessary as the decoder off-line predictive power does not generally imply ease-of-use, due to closed loop dynamics and user adaptation that cannot be accounted for during the calibration procedure. Here, we propose an adaptive interface that makes use of a non-linear autoencoder trained iteratively to perform online manifold identification and tracking, with the dual goal of reducing the need for interface recalibration and enhancing human-machine joint performance. Importantly, the proposed approach avoids interrupting the operation of the device and it neither relies on information about the state of the task, nor on the existence of a stable neural or movement manifold, allowing it to be applied in the earliest stages of interface operation, when the formation of new neural strategies is still on-going. In order to more directly test the performance of our algorithm, we defined the autoencoder latent space as the control space of a body-machine interface. After an initial offline parameter tuning, we evaluated the performance of the adaptive interface versus that of a static decoder in approximating the evolving low-dimensional manifold of users simultaneously learning to perform reaching movements within the latent space. Results show that the adaptive approach increased the representational efficiency of the interface decoder. Concurrently, it significantly improved users' task-related performance, indicating that the development of a more accurate internal model is encouraged by the online co-adaptation process.
Collapse
Affiliation(s)
- Fabio Rizzoglio
- Department of Informatics, Bioengineering, Robotics and Systems Engineering, University of Genoa, 16145 Genoa, Italy; Department of Physiology, Feinberg School of Medicine, Northwestern University, Chicago, IL, 60611, USA; Shirley Ryan Ability Lab, Chicago, IL, 60611, USA.
| | - Maura Casadio
- Department of Informatics, Bioengineering, Robotics and Systems Engineering, University of Genoa, 16145 Genoa, Italy.
| | - Dalia De Santis
- Department of Physiology, Feinberg School of Medicine, Northwestern University, Chicago, IL, 60611, USA; Shirley Ryan Ability Lab, Chicago, IL, 60611, USA; Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Via Enrico Melen 83, 16152, Genoa, Italy.
| | - Ferdinando A Mussa-Ivaldi
- Department of Physiology, Feinberg School of Medicine, Northwestern University, Chicago, IL, 60611, USA; Shirley Ryan Ability Lab, Chicago, IL, 60611, USA.
| |
Collapse
|
14
|
Roc A, Pillette L, Mladenovic J, Benaroch C, N'Kaoua B, Jeunet C, Lotte F. A review of user training methods in brain computer interfaces based on mental tasks. J Neural Eng 2020; 18. [PMID: 33181488 DOI: 10.1088/1741-2552/abca17] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2020] [Accepted: 11/12/2020] [Indexed: 12/12/2022]
Abstract
Mental-Tasks based Brain-Computer Interfaces (MT-BCIs) allow their users to interact with an external device solely by using brain signals produced through mental tasks. While MT-BCIs are promising for many applications, they are still barely used outside laboratories due to their lack of reliability. MT-BCIs require their users to develop the ability to self-regulate specific brain signals. However, the human learning process to control a BCI is still relatively poorly understood and how to optimally train this ability is currently under investigation. Despite their promises and achievements, traditional training programs have been shown to be sub-optimal and could be further improved. In order to optimize user training and improve BCI performance, human factors should be taken into account. An interdisciplinary approach should be adopted to provide learners with appropriate and/or adaptive training. In this article, we provide an overview of existing methods for MT-BCI user training - notably in terms of environment, instructions, feedback and exercises. We present a categorization and taxonomy of these training approaches, provide guidelines on how to choose the best methods and identify open challenges and perspectives to further improve MT-BCI user training.
Collapse
Affiliation(s)
| | | | | | - Camille Benaroch
- Inria Centre de recherche Bordeaux Sud-Ouest, Talence, 33405, FRANCE
| | - Bernard N'Kaoua
- Handicap, Activity, Cognition, Health, Inserm / University of Bordeaux, Talence, FRANCE
| | | | | |
Collapse
|
15
|
Velasquez-Martinez L, Caicedo-Acosta J, Acosta-Medina C, Alvarez-Meza A, Castellanos-Dominguez G. Regression Networks for Neurophysiological Indicator Evaluation in Practicing Motor Imagery Tasks. Brain Sci 2020; 10:E707. [PMID: 33020435 PMCID: PMC7600302 DOI: 10.3390/brainsci10100707] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2020] [Revised: 09/21/2020] [Accepted: 09/25/2020] [Indexed: 11/21/2022] Open
Abstract
Motor Imagery (MI) promotes motor learning in activities, like developing professional motor skills, sports gestures, and patient rehabilitation. However, up to 30% of users may not develop enough coordination skills after training sessions because of inter and intra-subject variability. Here, we develop a data-driven estimator, termed Deep Regression Network (DRN), which jointly extracts and performs the regression analysis in order to assess the efficiency of the individual brain networks in practicing MI tasks. The proposed double-stage estimator initially learns a pool of deep patterns, extracted from the input data, in order to feed a neural regression model, allowing for infering the distinctiveness between subject assemblies having similar variability. The results, which were obtained on real-world MI data, prove that the DRN estimator fosters pre-training neural desynchronization and initial training synchronization to predict the bi-class accuracy response, thus providing a better understanding of the Brain-Computer Interface inefficiency of subjects.
Collapse
Affiliation(s)
- Luisa Velasquez-Martinez
- Signal Processing and Recognition Group, Universidad Nacional de Colombia, Manizales 170004, Colombia; (J.C.-A.); (C.A.-M.); (A.A.-M.); (G.C.-D.)
| | | | | | | | | |
Collapse
|
16
|
Schonleitner FM, Otter L, Ehrlich SK, Cheng G. Calibration-Free Error-Related Potential Decoding With Adaptive Subject-Independent Models: A Comparative Study. ACTA ACUST UNITED AC 2020. [DOI: 10.1109/tmrb.2020.3012436] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
17
|
Mladenovic J, Frey J, Joffily M, Maby E, Lotte F, Mattout J. Active inference as a unifying, generic and adaptive framework for a P300-based BCI. J Neural Eng 2020; 17:016054. [PMID: 31783392 DOI: 10.1088/1741-2552/ab5d5c] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Going adaptive is a major challenge for the field of brain-computer interface (BCI). This entails a machine that optimally articulates inference about the user's intentions and its own actions. Adaptation can operate over several dimensions which calls for a generic and flexible framework. APPROACH We appeal to one of the most comprehensive computational approach to brain (adaptive) functions: the active inference (AI) framework. It entails an explicit (probabilistic) model of the user that the machine interacts with, here involved in a P300-spelling task. This takes the form of a discrete input-output state-space model establishing the link between the machine's (i) observations-a P300 or error potential for instance, (ii) representations-of the user intentions to spell or pause, and (iii) actions-to flash, spell or switch-off the application. MAIN RESULTS Using simulations with real EEG data from 18 subjects, results demonstrate the ability of AI to yield a significant increase in bit rate (17%) over state-of-the-art approaches, such as dynamic stopping. SIGNIFICANCE Thanks to its flexibility, this one model enables to implement optimal (dynamic) stopping but also optimal flashing (i.e. active sampling), automated error correction, and switching off when the user does not look at the screen anymore. Importantly, this approach enables the machine to flexibly arbitrate between all these possible actions. We demonstrate AI as a unifying and generic framework to implement a flexible interaction behaviour in a given BCI context.
Collapse
Affiliation(s)
- Jelena Mladenovic
- Potioc Team, Inria Sud-Ouest, Bordeaux, France. Ullo, La Rochelle, France. Author to whom any correspondence should be addressed
| | | | | | | | | | | |
Collapse
|
18
|
Nierhaus T, Vidaurre C, Sannelli C, Mueller K, Villringer A. Immediate brain plasticity after one hour of brain–computer interface (BCI). J Physiol 2019; 599:2435-2451. [DOI: 10.1113/jp278118] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2019] [Accepted: 09/30/2019] [Indexed: 12/18/2022] Open
Affiliation(s)
- Till Nierhaus
- Department of Neurology Max Planck Institute for Human Cognitive and Brain Sciences Leipzig Germany
- Neurocomputation and Neuroimaging Unit (NNU), Department of Education and Psychology Freie Universität Berlin Berlin Germany
| | - Carmen Vidaurre
- Machine Learning Group EE & Computer Science Faculty TU‐Berlin Germany
- Department Statistics, Informatics and Mathematics Public University of Navarra Spain
| | - Claudia Sannelli
- Machine Learning Group EE & Computer Science Faculty TU‐Berlin Germany
| | - Klaus‐Robert Mueller
- Machine Learning Group EE & Computer Science Faculty TU‐Berlin Germany
- Department of Brain and Cognitive Engineering Korea University Anam‐dong Seongbuk‐gu Seoul 02841 Korea
- Max Planck Institute for Informatics Saarbrücken Germany
| | - Arno Villringer
- Department of Neurology Max Planck Institute for Human Cognitive and Brain Sciences Leipzig Germany
- MindBrainBody Institute at Berlin School of Mind and Brain Charité Universitätsmedizin Berlin and Humboldt‐University Berlin Germany
| |
Collapse
|
19
|
Abstract
State-of-the-art high-end prostheses are electro-mechanically able to provide a great variety of movements. Nevertheless, in order to functionally replace a human limb, it is essential that each movement is properly controlled. This is the goal of prosthesis control, which has become a growing research field in the last decades, with the ultimate goal of reproducing biological limb control. Therefore, exploration and development of prosthesis control are crucial to improve many aspects of an amputee’s life. Nowadays, a large divergence between academia and industry has become evident in commercial systems. Although several studies propose more natural control systems with promising results, basic one degree of freedom (DoF), a control switching system is the most widely used option in industry because of simplicity, robustness and inertia. A few classification controlled prostheses have emerged in the last years but they are still a low percentage of the used ones. One of the factors that generate this situation is the lack of robustness of more advanced control algorithms in daily life activities outside of laboratory conditions. Because of this, research has shifted towards more functional prosthesis control. This work reviews the most recent literature in upper limb prosthetic control. It covers commonly used variants of possible biological inputs, its processing and translation to actual control, mostly focusing on electromyograms as well as the problems it will have to overcome in near future.
Collapse
|
20
|
Abu-Rmileh A, Zakkay E, Shmuelof L, Shriki O. Co-adaptive Training Improves Efficacy of a Multi-Day EEG-Based Motor Imagery BCI Training. Front Hum Neurosci 2019; 13:362. [PMID: 31680914 PMCID: PMC6802491 DOI: 10.3389/fnhum.2019.00362] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2018] [Accepted: 09/26/2019] [Indexed: 11/13/2022] Open
Abstract
Motor imagery (MI) based brain computer interfaces (BCI) detect changes in brain activity associated with imaginary limb movements, and translate them into device commands. MI based BCIs require training, during which the user gradually learns how to control his or her brain activity with the help of feedback. Additionally, machine learning techniques are frequently used to boost BCI performance and to adapt the decoding algorithm to the user's brain. Thus, both the brain and the machine need to adapt in order to improve performance. To study the utility of co-adaptive training in the BCI paradigm and the time scales involved, we investigated the performance of two groups of subjects, in a 4-day MI experiment using EEG recordings. One group (control, n = 9 subjects) performed the BCI task using a fixed classifier based on MI data from day 1. In the second group (experimental, n = 9 subjects), the classifier was regularly adapted based on brain activity patterns during the experiment days. We found that the experimental group showed a significantly larger change in performance following training compared to the control group. Specifically, although the experimental group exhibited a decrease in performance between days, it showed an increase in performance within each day, which compensated for the decrease. The control group showed decreases both within and between days. A correlation analysis in subjects who had a notable improvement in performance following training showed that performance was mainly associated with modulation of power in the α frequency band. To conclude, continuous updating of the classification algorithm improves the performance of subjects in longitudinal BCI training.
Collapse
Affiliation(s)
- Amjad Abu-Rmileh
- Department of Cognitive and Brain Sciences, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Eyal Zakkay
- Department of Cognitive and Brain Sciences, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Lior Shmuelof
- Department of Cognitive and Brain Sciences, Ben-Gurion University of the Negev, Beer-Sheva, Israel.,Department of Physiology and Cell Biology, Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Oren Shriki
- Department of Cognitive and Brain Sciences, Ben-Gurion University of the Negev, Beer-Sheva, Israel.,Department of Computer Science, Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| |
Collapse
|
21
|
Enhancing sensorimotor BCI performance with assistive afferent activity: An online evaluation. Neuroimage 2019; 199:375-386. [DOI: 10.1016/j.neuroimage.2019.05.074] [Citation(s) in RCA: 23] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2019] [Revised: 05/08/2019] [Accepted: 05/28/2019] [Indexed: 12/26/2022] Open
|
22
|
Schwarz A, Brandstetter J, Pereira J, Müller-Putz GR. Direct comparison of supervised and semi-supervised retraining approaches for co-adaptive BCIs. Med Biol Eng Comput 2019; 57:2347-2357. [PMID: 31522355 PMCID: PMC6828633 DOI: 10.1007/s11517-019-02047-1] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2019] [Accepted: 09/05/2019] [Indexed: 11/25/2022]
Abstract
For Brain-Computer interfaces (BCIs), system calibration is a lengthy but necessary process for successful operation. Co-adaptive BCIs aim to shorten training and imply positive motivation to users by presenting feedback already at early stages: After just 5 min of gathering calibration data, the systems are able to provide feedback and engage users in a mutual learning process. In this work, we investigate whether the retraining stage of co-adaptive BCIs can be adapted to a semi-supervised concept, where only a small amount of labeled data is available and all additional data needs to be labeled by the BCI itself. The aim of the current work was to evaluate whether a semi-supervised co-adaptive BCI could successfully compete with a supervised co-adaptive BCI model. In a supporting two-class (190 trials per condition) BCI study based on motor imagery tasks, we evaluated both approaches in two separate groups of 10 participants online, while we simulated the other approach in each group offline. Our results indicate that despite the lack of true labeled data, the semi-supervised driven BCI did not perform significantly worse (p > 0.05) than the supervised counterpart. We believe that these findings contribute to developing BCIs for long-term use, where continuous adaptation becomes imperative for maintaining meaningful BCI performance. In this work, we investigate whether the retraining stage of a co-adaptive BCI can be adapted to a semi-supervised concept, where only a small amount of labeled data is available and all additional data needs to be labeled by the BCI itself. In two groups of 10 persons, we evaluate a supervised as well as a semi-supervised approach. Our results indicate that despite the lack of true labeled data, the semi-supervised driven BCI did not perform significantly worse (p > 0.05) than the supervised counterpart. ![]()
Collapse
Affiliation(s)
- Andreas Schwarz
- Institute of Neural Engineering, University of Technology, Stremayrgasse 16/IV, Graz, 8010, Austria
| | - Julia Brandstetter
- Institute of Neural Engineering, University of Technology, Stremayrgasse 16/IV, Graz, 8010, Austria
| | - Joana Pereira
- Institute of Neural Engineering, University of Technology, Stremayrgasse 16/IV, Graz, 8010, Austria
| | - Gernot R Müller-Putz
- Institute of Neural Engineering, University of Technology, Stremayrgasse 16/IV, Graz, 8010, Austria.
| |
Collapse
|
23
|
Togha MM, Salehi MR, Abiri E. Improving the performance of the motor imagery-based brain-computer interfaces using local activities estimation. Biomed Signal Process Control 2019. [DOI: 10.1016/j.bspc.2019.01.008] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
24
|
Nguyen CH, Karavas GK, Artemiadis P. Adaptive multi-degree of freedom Brain Computer Interface using online feedback: Towards novel methods and metrics of mutual adaptation between humans and machines for BCI. PLoS One 2019; 14:e0212620. [PMID: 30840712 PMCID: PMC6402657 DOI: 10.1371/journal.pone.0212620] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2018] [Accepted: 02/06/2019] [Indexed: 11/19/2022] Open
Abstract
This paper proposes a novel adaptive online-feedback methodology for Brain Computer Interfaces (BCI). The method uses ElectroEncephaloGraphic (EEG) signals and combines motor with speech imagery to allow for tasks that involve multiple degrees of freedom (DoF). The main approach utilizes the covariance matrix descriptor as feature, and the Relevance Vector Machines (RVM) classifier. The novel contributions include, (1) a new method to select representative data to update the RVM model, and (2) an online classifier which is an adaptively-weighted mixture of RVM models to account for the users' exploration and exploitation processes during the learning phase. Instead of evaluating the subjects' performance solely based on the conventional metric of accuracy, we analyze their skill's improvement based on 3 other criteria, namely the confusion matrix's quality, the separability of the data, and their instability. After collecting calibration data for 8 minutes in the first run, 8 participants were able to control the system while receiving visual feedback in the subsequent runs. We observed significant improvement in all subjects, including two of them who fell into the BCI illiteracy category. Our proposed BCI system complements the existing approaches in several aspects. First, the co-adaptation paradigm not only adapts the classifiers, but also allows the users to actively discover their own way to use the BCI through their exploration and exploitation processes. Furthermore, the auto-calibrating system can be used immediately with a minimal calibration time. Finally, this is the first work to combine motor and speech imagery in an online feedback experiment to provide multiple DoF for BCI control applications.
Collapse
Affiliation(s)
- Chuong H. Nguyen
- School for Engineering of Matter, Transport and Energy, Arizona State University, Tempe, Arizona, United States of America
| | - George K. Karavas
- School for Engineering of Matter, Transport and Energy, Arizona State University, Tempe, Arizona, United States of America
| | - Panagiotis Artemiadis
- School for Engineering of Matter, Transport and Energy, Arizona State University, Tempe, Arizona, United States of America
| |
Collapse
|
25
|
Sannelli C, Vidaurre C, Müller KR, Blankertz B. A large scale screening study with a SMR-based BCI: Categorization of BCI users and differences in their SMR activity. PLoS One 2019; 14:e0207351. [PMID: 30682025 PMCID: PMC6347432 DOI: 10.1371/journal.pone.0207351] [Citation(s) in RCA: 45] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2018] [Accepted: 10/30/2018] [Indexed: 11/18/2022] Open
Abstract
Brain-Computer Interfaces (BCIs) are inefficient for a non-negligible part of the population, estimated around 25%. To understand this phenomenon in Sensorimotor Rhythm (SMR) based BCIs, data from a large-scale screening study conducted on 80 novice participants with the Berlin BCI system and its standard machine-learning approach were investigated. Each participant performed one BCI session with resting state Encephalography, Motor Observation, Motor Execution and Motor Imagery recordings and 128 electrodes. A significant portion of the participants (40%) could not achieve BCI control (feedback performance > 70%). Based on the performance of the calibration and feedback runs, BCI users were stratified in three groups. Analyses directed to detect and elucidate the differences in the SMR activity of these groups were performed. Statistics on reactive frequencies, task prevalence and classification results are reported. Based on their SMR activity, also a systematic list of potential reasons leading to performance drops and thus hints for possible improvements of BCI experimental design are given. The categorization of BCI users has several advantages, allowing researchers 1) to select subjects for further analyses as well as for testing new BCI paradigms or algorithms, 2) to adopt a better subject-dependent training strategy and 3) easier comparisons between different studies.
Collapse
Affiliation(s)
- Claudia Sannelli
- Department of Neurotechnology, Technische Universität Berlin, Berlin, Germany
| | - Carmen Vidaurre
- Department of Machine Learning, Technische Universität Berlin, Berlin, Germany
- Department of Mathematics, Public University of Navarre, Pamplona, Spain
| | - Klaus-Robert Müller
- Department of Machine Learning, Technische Universität Berlin, Berlin, Germany
- Department of Brain and Cognitive Engineering, Korea University, Seoul, South Korea
- Max Planck Institute for Informatics, Saarbrücken, Germany
| | - Benjamin Blankertz
- Department of Neurotechnology, Technische Universität Berlin, Berlin, Germany
| |
Collapse
|
26
|
Igual C, Igual J, Hahne JM, Parra LC. Adaptive Auto-Regressive Proportional Myoelectric Control. IEEE Trans Neural Syst Rehabil Eng 2019; 27:314-322. [PMID: 30676969 DOI: 10.1109/tnsre.2019.2894464] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
In proportional myographic control, one can control either position or velocity of movement. Here, we propose to use adaptive auto-regressive filters, so as to gradually adjust between the two. We implemented this in an adaptive system with closed-loop feedback, where both the user and the machine simultaneously attempt to follow a cursor on a 2-D arena. We tested this on 15 able-bodied and three limb-deficient participants using an eight-channel myoelectric armband. The human-machine pairs learn to perform smoother cursor movements with a larger range of motion when using the auto-regressive filters, as compared with our previous effortswithmoving-average filters. Importantly, the human-machine system converges to an approximate velocity control strategy resulting in faster and more accuratemovements with lessmuscle effort. The method is not specific tomyoelectriccontroland could be used equally well for motion control using high-dimensional signals from reinnervatedmuscles or direct brain recordings.
Collapse
|
27
|
Lu Y, Bi L, Lian J, Li H. Mathematical Modeling of EEG Signals-Based Brain-Control Behavior. IEEE Trans Neural Syst Rehabil Eng 2018; 26:1535-1543. [PMID: 30010579 DOI: 10.1109/tnsre.2018.2855263] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Brain-control behaviors (BCBs) are behaviors of humans that communicate with external devices by means of the human brain rather than peripheral nerves or muscles. In this paper, to understand and simulate such behaviors, we propose a mathematical model by combining a queuing network-based encoding model with a brain-computer interface model. Experimental results under the static tests show the effectiveness of the proposed model in simulating real BCBs. Furthermore, we verify the effectiveness and applicability of the proposed model through the dynamic experimental tests in a simulated vehicle. This paper not only promotes the understanding and prediction of BCBs, but also provides some insights into assistive technology on brain-controlled systems and extends the scope of research on human behavior modeling.
Collapse
|
28
|
Lotte F, Bougrain L, Cichocki A, Clerc M, Congedo M, Rakotomamonjy A, Yger F. A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update. J Neural Eng 2018; 15:031005. [DOI: 10.1088/1741-2552/aab2f2] [Citation(s) in RCA: 848] [Impact Index Per Article: 141.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
|