1
|
Liu C, You J, Wang K, Zhang S, Huang Y, Xu M, Ming D. Decoding the EEG patterns induced by sequential finger movement for brain-computer interfaces. Front Neurosci 2023; 17:1180471. [PMID: 37706155 PMCID: PMC10495835 DOI: 10.3389/fnins.2023.1180471] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 07/26/2023] [Indexed: 09/15/2023] Open
Abstract
Objective In recent years, motor imagery-based brain-computer interfaces (MI-BCIs) have developed rapidly due to their great potential in neurological rehabilitation. However, the controllable instruction set limits its application in daily life. To extend the instruction set, we proposed a novel movement-intention encoding paradigm based on sequential finger movement. Approach Ten subjects participated in the offline experiment. During the experiment, they were required to press a key sequentially [i.e., Left→Left (LL), Right→Right (RR), Left→Right (LR), and Right→Left (RL)] using the left or right index finger at about 1 s intervals under an auditory prompt of 1 Hz. The movement-related cortical potential (MRCP) and event-related desynchronization (ERD) features were used to investigate the electroencephalography (EEG) variation induced by the sequential finger movement tasks. Twelve subjects participated in an online experiment to verify the feasibility of the proposed paradigm. Main results As a result, both the MRCP and ERD features showed the specific temporal-spatial EEG patterns of different sequential finger movement tasks. For the offline experiment, the average classification accuracy of the four tasks was 71.69%, with the highest accuracy of 79.26%. For the online experiment, the average accuracies were 83.33% and 82.71% for LL-versus-RR and LR-versus-RL, respectively. Significance This paper demonstrated the feasibility of the proposed sequential finger movement paradigm through offline and online experiments. This study would be helpful for optimizing the encoding method of motor-related EEG information and providing a promising approach to extending the instruction set of the movement intention-based BCIs.
Collapse
Affiliation(s)
- Chang Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Jia You
- School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Kun Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Shanshan Zhang
- School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Yining Huang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Minpeng Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan, China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
| |
Collapse
|
2
|
Al-Qazzaz NK, Aldoori AA, Ali SHBM, Ahmad SA, Mohammed AK, Mohyee MI. EEG Signal Complexity Measurements to Enhance BCI-Based Stroke Patients' Rehabilitation. SENSORS (BASEL, SWITZERLAND) 2023; 23:3889. [PMID: 37112230 PMCID: PMC10141766 DOI: 10.3390/s23083889] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/04/2023] [Revised: 03/01/2023] [Accepted: 03/09/2023] [Indexed: 06/19/2023]
Abstract
The second leading cause of death and one of the most common causes of disability in the world is stroke. Researchers have found that brain-computer interface (BCI) techniques can result in better stroke patient rehabilitation. This study used the proposed motor imagery (MI) framework to analyze the electroencephalogram (EEG) dataset from eight subjects in order to enhance the MI-based BCI systems for stroke patients. The preprocessing portion of the framework comprises the use of conventional filters and the independent component analysis (ICA) denoising approach. Fractal dimension (FD) and Hurst exponent (Hur) were then calculated as complexity features, and Tsallis entropy (TsEn) and dispersion entropy (DispEn) were assessed as irregularity parameters. The MI-based BCI features were then statistically retrieved from each participant using two-way analysis of variance (ANOVA) to demonstrate the individuals' performances from four classes (left hand, right hand, foot, and tongue). The dimensionality reduction algorithm, Laplacian Eigenmap (LE), was used to enhance the MI-based BCI classification performance. Utilizing k-nearest neighbors (KNN), support vector machine (SVM), and random forest (RF) classifiers, the groups of post-stroke patients were ultimately determined. The findings show that LE with RF and KNN obtained 74.48% and 73.20% accuracy, respectively; therefore, the integrated set of the proposed features along with ICA denoising technique can exactly describe the proposed MI framework, which may be used to explore the four classes of MI-based BCI rehabilitation. This study will help clinicians, doctors, and technicians make a good rehabilitation program for people who have had a stroke.
Collapse
Affiliation(s)
- Noor Kamal Al-Qazzaz
- Department of Biomedical Engineering, Al-Khwarizmi College of Engineering, University of Baghdad, Baghdad 47146, Iraq
| | - Alaa A. Aldoori
- Department of Biomedical Engineering, Al-Khwarizmi College of Engineering, University of Baghdad, Baghdad 47146, Iraq
| | - Sawal Hamid Bin Mohd Ali
- Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia, UKM, Bangi 43600, Selangor, Malaysia
- Centre of Advanced Electronic and Communication Engineering, Department of Electrical, Electronic and Systems Engineering, Universiti Kebangsaan Malaysia, UKM, Bangi 43600, Selangor, Malaysia
| | - Siti Anom Ahmad
- Department of Electrical and Electronic Engineering, Faculty of Engineering, Universiti Putra Malaysia, UPM, Serdang 43400, Selangor, Malaysia
- Malaysian Research Institute of Ageing (MyAgeing), University Putra Malaysia, Serdang 43400, Selangor, Malaysia
| | - Ahmed Kazem Mohammed
- Department of Biomedical Engineering, Al-Khwarizmi College of Engineering, University of Baghdad, Baghdad 47146, Iraq
| | - Mustafa Ibrahim Mohyee
- Department of Biomedical Engineering, Al-Khwarizmi College of Engineering, University of Baghdad, Baghdad 47146, Iraq
| |
Collapse
|
3
|
Vecchiato G, Del Vecchio M, Ambeck-Madsen J, Ascari L, Avanzini P. EEG–EMG coupling as a hybrid method for steering detection in car driving settings. Cogn Neurodyn 2022; 16:987-1002. [PMID: 36237409 PMCID: PMC9508316 DOI: 10.1007/s11571-021-09776-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2021] [Revised: 12/03/2021] [Accepted: 12/23/2021] [Indexed: 11/28/2022] Open
Abstract
AbstractUnderstanding mental processes in complex human behavior is a key issue in driving, representing a milestone for developing user-centered assistive driving devices. Here, we propose a hybrid method based on electroencephalographic (EEG) and electromyographic (EMG) signatures to distinguish left and right steering in driving scenarios. Twenty-four participants took part in the experiment consisting of recordings of 128-channel EEG and EMG activity from deltoids and forearm extensors in non-ecological and ecological steering tasks. Specifically, we identified the EEG mu rhythm modulation correlates with motor preparation of self-paced steering actions in the non-ecological task, while the concurrent EMG activity of the left (right) deltoids correlates with right (left) steering. Consequently, we exploited the mu rhythm de-synchronization resulting from the non-ecological task to detect the steering side using cross-correlation analysis with the ecological EMG signals. Results returned significant cross-correlation values showing the coupling between the non-ecological EEG feature and the muscular activity collected in ecological driving conditions. Moreover, such cross-correlation patterns discriminate the steering side earlier relative to the single EMG signal. This hybrid system overcomes the limitation of the EEG signals collected in ecological settings such as low reliability, accuracy, and adaptability, thus adding to the EMG the characteristic predictive power of the cerebral data. These results prove how it is possible to complement different physiological signals to control the level of assistance needed by the driver.
Collapse
Affiliation(s)
- Giovanni Vecchiato
- Institute of Neuroscience, National Research Council of Italy, Via Volturno 39/E, 43125 Parma, Italy
| | - Maria Del Vecchio
- Institute of Neuroscience, National Research Council of Italy, Via Volturno 39/E, 43125 Parma, Italy
| | | | - Luca Ascari
- Camlin Italy S.R.L., Parma, Italy
- Henesis s.r.l., 43123 Parma, Italy
| | - Pietro Avanzini
- Institute of Neuroscience, National Research Council of Italy, Via Volturno 39/E, 43125 Parma, Italy
| |
Collapse
|
4
|
Jia X, Song Y, Yang L, Xie L. Joint spatial and temporal features extraction for multi-classification of motor imagery EEG. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103247] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
5
|
Hallett M, DelRosso LM, Elble R, Ferri R, Horak FB, Lehericy S, Mancini M, Matsuhashi M, Matsumoto R, Muthuraman M, Raethjen J, Shibasaki H. Evaluation of movement and brain activity. Clin Neurophysiol 2021; 132:2608-2638. [PMID: 34488012 PMCID: PMC8478902 DOI: 10.1016/j.clinph.2021.04.023] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2021] [Revised: 04/07/2021] [Accepted: 04/25/2021] [Indexed: 11/25/2022]
Abstract
Clinical neurophysiology studies can contribute important information about the physiology of human movement and the pathophysiology and diagnosis of different movement disorders. Some techniques can be accomplished in a routine clinical neurophysiology laboratory and others require some special equipment. This review, initiating a series of articles on this topic, focuses on the methods and techniques. The methods reviewed include EMG, EEG, MEG, evoked potentials, coherence, accelerometry, posturography (balance), gait, and sleep studies. Functional MRI (fMRI) is also reviewed as a physiological method that can be used independently or together with other methods. A few applications to patients with movement disorders are discussed as examples, but the detailed applications will be the subject of other articles.
Collapse
Affiliation(s)
- Mark Hallett
- Human Motor Control Section, National Institute of Neurological Disorders and Stroke, NIH, Bethesda, MD, USA.
| | | | - Rodger Elble
- Department of Neurology, Southern Illinois University School of Medicine, Springfield, IL, USA
| | | | - Fay B Horak
- Department of Neurology, Oregon Health & Science University, Portland, OR, USA
| | - Stephan Lehericy
- Paris Brain Institute (ICM), Centre de NeuroImagerie de Recherche (CENIR), Team "Movement, Investigations and Therapeutics" (MOV'IT), INSERM U 1127, CNRS UMR 7225, Sorbonne Université, Paris, France
| | - Martina Mancini
- Department of Neurology, Oregon Health & Science University, Portland, OR, USA
| | - Masao Matsuhashi
- Department of Epilepsy, Movement Disorders and Physiology, Kyoto University Graduate, School of Medicine, Japan
| | - Riki Matsumoto
- Division of Neurology, Kobe University Graduate School of Medicine, Japan
| | - Muthuraman Muthuraman
- Section of Movement Disorders and Neurostimulation, Biomedical Statistics and Multimodal Signal Processing unit, Department of Neurology, Focus Program Translational Neuroscience (FTN), University Medical Center of the Johannes Gutenberg-University Mainz, Mainz, Germany
| | - Jan Raethjen
- Neurology Outpatient Clinic, Preusserstr. 1-9, 24105 Kiel, Germany
| | | |
Collapse
|
6
|
Aliakbaryhosseinabadi S, Dosen S, Savic AM, Blicher J, Farina D, Mrachacz-Kersting N. Participant-specific classifier tuning increases the performance of hand movement detection from EEG in patients with amyotrophic lateral sclerosis. J Neural Eng 2021; 18. [PMID: 34280899 DOI: 10.1088/1741-2552/ac15e3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2021] [Accepted: 07/19/2021] [Indexed: 11/11/2022]
Abstract
Objective.Brain-computer interface (BCI) systems can be employed to provide motor and communication assistance to patients suffering from neuromuscular diseases, such as amyotrophic lateral sclerosis (ALS). Movement related cortical potentials (MRCPs), which are naturally generated during movement execution, can be used to implement a BCI triggered by motor attempts. Such BCI could assist impaired motor functions of ALS patients during disease progression, and facilitate the training for the generation of reliable MRCPs. The training aspect is relevant to establish a communication channel in the late stage of the disease. Therefore, the aim of this study was to investigate the possibility of detecting MRCPs associated to movement intention in ALS patients with different levels of disease progression from slight to complete paralysis.Approach.Electroencephalography signals were recorded from nine channels in 30 ALS patients at various stages of the disease while they performed or attempted to perform hand movements timed to a visual cue. The movement detection was implemented using offline classification between movement and rest phase. Temporal and spectral features were extracted using 500 ms sliding windows with 50% overlap. The detection was tested for each individual channel and two surrogate channels by performing feature selection followed by classification using linear and non-linear support vector machine and linear discriminant analysis.Main results.The results demonstrated that the detection performance was high in all patients (accuracy 80.5 ± 5.6%) but that the classification parameters (channel, features and classifier) leading to the best performance varied greatly across patients. When the same channel and classifier were used for all patients (participant-generic analysis), the performance significantly decreased (accuracy 74 ± 8.3%).Significance.The present study demonstrates that to maximize the detection of brain waves across ALS patients at different stages of the disease, the classification pipeline should be tuned to each patient individually.
Collapse
Affiliation(s)
| | - Strahinja Dosen
- Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| | - Andrej M Savic
- Science and Research Centre, University of Belgrade-School of Electrical Engineering, Belgrade 11000, Serbia
| | - Jakob Blicher
- Department of Clinical Medicine, Center of Functionally Integrative Neuroscience, Århus University, Aarhus, Denmark
| | - Dario Farina
- Department of Bioengineering, Imperial College London, London, United Kingdom
| | - Natalie Mrachacz-Kersting
- Department of Sport and Sport Science, Albert-Ludwigs University Freiburg, Freiburg im Breisgau, Germany
| |
Collapse
|
7
|
Savić AM, Aliakbaryhosseinabadi S, Blicher JU, Farina D, Mrachacz-Kersting N, Došen S. Online control of an assistive active glove by slow cortical signals in patients with amyotrophic lateral sclerosis. J Neural Eng 2021; 18. [PMID: 34030137 DOI: 10.1088/1741-2552/ac0488] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2020] [Accepted: 05/24/2021] [Indexed: 02/08/2023]
Abstract
Objective.A brain-computer interface (BCI) allows users to control external devices using brain signals that can be recorded non-invasively via electroencephalography (EEG). Movement related cortical potentials (MRCPs) are an attractive option for BCI control since they arise naturally during movement execution and imagination, and therefore, do not require an extensive training. This study tested the feasibility of online detection of reaching and grasping using MRCPs for the application in patients suffering from amyotrophic lateral sclerosis (ALS).Approach.A BCI system was developed to trigger closing of a soft assistive glove by detecting a reaching movement. The custom-made software application included data collection, a novel method for collecting the input data for classifier training from the offline recordings based on a sliding window approach, and online control of the glove. Eight healthy subjects and two ALS patients were recruited to test the developed BCI system. They performed assessment blocks without the glove active (NG), in which the movement detection was indicated by a sound feedback, and blocks (G) in which the glove was controlled by the BCI system. The true positive rate (TPR) and the positive predictive value (PPV) were adopted as the outcome measures. Correlation analysis between forehead EEG detecting ocular artifacts and sensorimotor area EEG was conducted to confirm the validity of the results.Main results.The overall median TPR and PPV were >0.75 for online BCI control, in both healthy individuals and patients, with no significant difference across the blocks (NG versus G).Significance.The results demonstrate that cortical activity during reaching can be detected and used to control an external system with a limited amount of training data (30 trials). The developed BCI system can be used to provide grasping assistance to ALS patients.
Collapse
Affiliation(s)
- Andrej M Savić
- Science and Research Centre, University of Belgrade-School of Electrical Engineering, Belgrade, Serbia
| | | | - Jakob U Blicher
- Department of Neurology, Aarhus University Hospital, Aarhus, Denmark.,Center of Functionally Integrative Neuroscience, Aarhus University, Aarhus, Denmark
| | - Dario Farina
- Department of Bioengineering, Imperial College London, London, United Kingdom
| | - Natalie Mrachacz-Kersting
- Department of Information Technology, University of Applied Sciences and Arts Dortmund, Dortmund, Germany.,Institut für Sport und Sportwissenschaft, Albert-Ludwigs Universität Freiburg, Freiburg, Germany
| | - Strahinja Došen
- Department of Health Science and Technology, The Faculty of Medicine, Aalborg University, Aalborg, Denmark
| |
Collapse
|
8
|
Wang L, Zhang Z, Han D, Zhang Z, Liu Z, Liu W. Single stimulus location for two inputs: A combined brain-computer interface based on Steady-State Visual Evoked Potential (SSVEP). Eur J Neurosci 2020; 53:861-875. [PMID: 33128787 DOI: 10.1111/ejn.15030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2020] [Revised: 10/20/2020] [Accepted: 10/21/2020] [Indexed: 11/26/2022]
Abstract
Brain-computer interfaces (BCI) help severely paralyzed people communicate with the outside world. One type of BCI depends on eye movements and has high information transfer (ITR) but is tiring for users and not applicable to people with eye dyskinesia. Conversely, independent BCIs enable attention shifts across visual stimuli without eye movement, but at the cost of a lower ITR. Steady-state visual evoked potential (SSVEP) is an oscillatory brain response and typically used as BCI signal sources because of high signal-to-noise ratio (SNR). Considering the effect of attentional modulation on the SSVEP, we proposed the novel concept of one-to-two BCI to optimize existing problems, wherein the target and other stimuli shared the same location. Specifically, two spatially overlapping stimuli were displayed in the center-of-view field, as in the independent BCI, and participants were required to divide their attention between the right and left visual fields, as in the dependent BCI. Using three different design schemes in two experiments, we aimed to provide a new framework for BCI design by exploring the feasibility of a combined BCI that can realize a single stimulus location for two inputs. The results strongly demonstrated that, even when the targets and distractors overlapped spatially, the former evoked stronger SSVEP responses. Notably, the BCI scheme based on the object-based attention could achieve a recognition rate as high as 83.2% and an ITR of 12.5 bits per minute. The feasibility of a one-to-two BCI design, which simplified the keyboard layout, reduced the attention shift, and relieved user fatigue, was established.
Collapse
Affiliation(s)
- Lu Wang
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Zhenhao Zhang
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Dan Han
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Zhijun Zhang
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Zhifang Liu
- Department of Psychology and Special Education, Hangzhou Normal University, Hangzhou, China
| | - Wei Liu
- Department of Education, Dali University, Dali, China
| |
Collapse
|