1
|
Lee J, Miri S, Bayro A, Kim M, Jeong H, Yeo WH. Biosignal-integrated robotic systems with emerging trends in visual interfaces: A systematic review. BIOPHYSICS REVIEWS 2024; 5:011301. [PMID: 38510371 PMCID: PMC10903439 DOI: 10.1063/5.0185568] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 01/29/2024] [Indexed: 03/22/2024]
Abstract
Human-machine interfaces (HMI) are currently a trendy and rapidly expanding area of research. Interestingly, the human user does not readily observe the interface between humans and machines. Instead, interactions between the machine and electrical signals from the user's body are obscured by complex control algorithms. The result is effectively a one-way street, wherein data is only transmitted from human to machine. Thus, a gap remains in the literature: how can information be effectively conveyed to the user to enable mutual understanding between humans and machines? Here, this paper reviews recent advancements in biosignal-integrated wearable robotics, with a particular emphasis on "visualization"-the presentation of relevant data, statistics, and visual feedback to the user. This review article covers various signals of interest, such as electroencephalograms and electromyograms, and explores novel sensor architectures and key materials. Recent developments in wearable robotics are examined from control and mechanical design perspectives. Additionally, we discuss current visualization methods and outline the field's future direction. While much of the HMI field focuses on biomedical and healthcare applications, such as rehabilitation of spinal cord injury and stroke patients, this paper also covers less common applications in manufacturing, defense, and other domains.
Collapse
Affiliation(s)
| | - Sina Miri
- Department of Mechanical and Industrial Engineering, The University of Illinois at Chicago, Chicago, Illinois 60607, USA
| | - Allison Bayro
- School of Biological and Health Systems Engineering, Ira A. Fulton Schools of Engineering, Arizona State University, Tempe, Arizona 85287, USA
| | - Myunghee Kim
- Department of Mechanical and Industrial Engineering, The University of Illinois at Chicago, Chicago, Illinois 60607, USA
| | - Heejin Jeong
- Authors to whom correspondence should be addressed:; ; and
| | - Woon-Hong Yeo
- Authors to whom correspondence should be addressed:; ; and
| |
Collapse
|
2
|
Wang F, Wen Y, Bi J, Li H, Sun J. A portable SSVEP-BCI system for rehabilitation exoskeleton in augmented reality environment. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104664] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/09/2023]
|
3
|
Belkacem AN, Jamil N, Khalid S, Alnajjar F. On closed-loop brain stimulation systems for improving the quality of life of patients with neurological disorders. Front Hum Neurosci 2023; 17:1085173. [PMID: 37033911 PMCID: PMC10076878 DOI: 10.3389/fnhum.2023.1085173] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Accepted: 03/06/2023] [Indexed: 04/11/2023] Open
Abstract
Emerging brain technologies have significantly transformed human life in recent decades. For instance, the closed-loop brain-computer interface (BCI) is an advanced software-hardware system that interprets electrical signals from neurons, allowing communication with and control of the environment. The system then transmits these signals as controlled commands and provides feedback to the brain to execute specific tasks. This paper analyzes and presents the latest research on closed-loop BCI that utilizes electric/magnetic stimulation, optogenetic, and sonogenetic techniques. These techniques have demonstrated great potential in improving the quality of life for patients suffering from neurodegenerative or psychiatric diseases. We provide a comprehensive and systematic review of research on the modalities of closed-loop BCI in recent decades. To achieve this, the authors used a set of defined criteria to shortlist studies from well-known research databases into categories of brain stimulation techniques. These categories include deep brain stimulation, transcranial magnetic stimulation, transcranial direct-current stimulation, transcranial alternating-current stimulation, and optogenetics. These techniques have been useful in treating a wide range of disorders, such as Alzheimer's and Parkinson's disease, dementia, and depression. In total, 76 studies were shortlisted and analyzed to illustrate how closed-loop BCI can considerably improve, enhance, and restore specific brain functions. The analysis revealed that literature in the area has not adequately covered closed-loop BCI in the context of cognitive neural prosthetics and implanted neural devices. However, the authors demonstrate that the applications of closed-loop BCI are highly beneficial, and the technology is continually evolving to improve the lives of individuals with various ailments, including those with sensory-motor issues or cognitive deficiencies. By utilizing emerging techniques of stimulation, closed-loop BCI can safely improve patients' cognitive and affective skills, resulting in better healthcare outcomes.
Collapse
Affiliation(s)
- Abdelkader Nasreddine Belkacem
- Department of Computer and Network Engineering, College of Information Technology, UAE University, Al-Ain, United Arab Emirates
- *Correspondence: Abdelkader Nasreddine Belkacem
| | - Nuraini Jamil
- Department of Computer Science and Software Engineering, College of Information Technology, UAE University, Al-Ain, United Arab Emirates
| | - Sumayya Khalid
- Department of Computer Science and Software Engineering, College of Information Technology, UAE University, Al-Ain, United Arab Emirates
| | - Fady Alnajjar
- Department of Computer Science and Software Engineering, College of Information Technology, UAE University, Al-Ain, United Arab Emirates
- Center for Brain Science, RIKEN, Saitama, Japan
- Fady Alnajjar
| |
Collapse
|
4
|
An Adaptive EEG Classification Algorithm Based on CSSD and ELM_Kernel for Small Training Samples. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:4509612. [PMID: 36619242 PMCID: PMC9812636 DOI: 10.1155/2022/4509612] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Revised: 12/03/2022] [Accepted: 12/10/2022] [Indexed: 12/30/2022]
Abstract
Rehabilitation technologies based on brain-computer interface (BCI) have become a promising approach for patients with dyskinesia to regain movement. In BCI experiment, there is often a necessary stage of calibration measurement before the feedback applications. To reduce the time required for initial training, it is of great importance to have a method which can learn to classify electroencephalogram (EEG) signals with a little amount of training data. In this paper, the novel combination of feature extraction and classification algorithm is proposed for classification of EEG signals with a small number of training samples. For feature extraction, the motor imagery EEG signals are pre-processed, and a relative distance criterion is defined to select the optimal combination of channels. Subsequently, common spatial subspace decomposition (CSSD) algorithm and extreme learning machine with kernel (ELM_Kernel) algorithm are used to perform the types of tasks classification of motor imagery EEG signals. Simulation results demonstrate that the proposed method produces a high average classification accuracy of 99.1% on BCI Competition III dataset IVa and 76.92% on BCI Competition IV dataset IIa outperforming state-of-the-art algorithms and obtains a good classification accuracy.
Collapse
|
5
|
Feng L, Shan H, Zhang Y, Zhu Z. An Efficient Model-Compressed EEGNet Accelerator for Generalized Brain-Computer Interfaces With Near Sensor Intelligence. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2022; 16:1239-1249. [PMID: 36264734 DOI: 10.1109/tbcas.2022.3215962] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
Brain-computer interfaces (BCIs) is promising in interacting with machines through electroencephalogram (EEG) signal. The compact end-to-end neural network model for generalized BCIs, EEGNet, has been implemented in hardware to get near sensor intelligence, but without enough efficiency. To utilize EEGNet in low-power wearable device for long-term use, this paper proposes an efficient EEGNet inference accelerator. Firstly, the EEGNet model is compressed by embedded channel selection, normalization merging, and product quantization. The customized accelerator based on the compressed model is then designed. The multilayer convolutions are achieved by reusing multiplying-accumulators and processing elements (PEs) to minimize area of logic circuits, and the weights and intermediate results are quantized to minimize memory sizes. The PEs are clock-gated to save power. Experimental results in FPGA on three datasets show the good generalizing ability of the proposed design across three BCI diagrams, which only consumes 3.31% area and 1.35% power compared to the one-to-one parallel design. The speedup factors of 1.4, 3.5, and 3.7 are achieved by embedded channel selection with negligible loss of accuracy (-0.80%). The presented accelerator is also synthesized in 65 nm CMOS low power (LP) process and consumes 0.23M gates, 24.4 ms/inference, 0.267 mJ/inference, which is 87.22% more efficient than the implementation of EEGNet in a RISC-V MCU realized in 40 nm CMOS LP process in terms of area, and 20.77% more efficient in terms of energy efficiency on BCIC-IV-2a dataset.
Collapse
|
6
|
Cheng C, Duan S, He H, Li X, Chen Y. A Generalized Robot Navigation Analysis Platform (RoNAP) with Visual Results Using Multiple Navigation Algorithms. SENSORS (BASEL, SWITZERLAND) 2022; 22:9036. [PMID: 36501739 PMCID: PMC9737631 DOI: 10.3390/s22239036] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/20/2022] [Revised: 11/11/2022] [Accepted: 11/17/2022] [Indexed: 06/17/2023]
Abstract
The robotic navigation task is to find a collision-free path among a mass of stationary or migratory obstacles. Various well-established algorithms have been applied to solve navigation tasks. It is necessary to test the performance of designed navigation algorithms in practice. However, it seems an extremely unwise choice to implement them in a real environment directly unless their performance is guaranteed to be acceptable. Otherwise, it takes time to test navigation algorithms because of a long training process, and imperfect performance may cause damage if the robot collides with obstacles. Hence, it is of key significance to develop a mobile robot analysis platform to simulate the real environment which has the ability to replicate the exact application scenario and be operated in a simple manner. This paper introduces a brand new analysis platform named robot navigation analysis platform (RoNAP), which is an open-source platform developed using the Python environment. A user-friendly interface supports its realization for the evaluation of various navigation algorithms. A variety of existing algorithms were able to achieve desired test results on this platform, indicating its feasibility and efficiency for navigation algorithm analysis.
Collapse
Affiliation(s)
- Chuanxin Cheng
- School of Mechanical and Electrical Engineering, Soochow University, Suzhou 215031, China
| | - Shuang Duan
- School of Mechanical and Electrical Engineering, Soochow University, Suzhou 215031, China
| | - Haidong He
- School of Mechanical and Electrical Engineering, Soochow University, Suzhou 215031, China
| | - Xinlin Li
- Department of Digital Media, Soochow University, Suzhou 215031, China
| | - Yiyang Chen
- School of Mechanical and Electrical Engineering, Soochow University, Suzhou 215031, China
| |
Collapse
|
7
|
Li P, Su J, Belkacem AN, Cheng L, Chen C. Steady-state visually evoked potential collaborative BCI system deep learning classification algorithm based on multi-person feature fusion transfer learning-based convolutional neural network. Front Neurosci 2022; 16:971039. [PMID: 35958998 PMCID: PMC9360603 DOI: 10.3389/fnins.2022.971039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Accepted: 07/07/2022] [Indexed: 11/13/2022] Open
Abstract
ObjectiveThe conventional single-person brain–computer interface (BCI) systems have some intrinsic deficiencies such as low signal-to-noise ratio, distinct individual differences, and volatile experimental effect. To solve these problems, a centralized steady-state visually evoked potential collaborative BCI system (SSVEP-cBCI), which characterizes multi-person electroencephalography (EEG) feature fusion was constructed in this paper. Furthermore, three different feature fusion methods compatible with this new system were developed and applied to EEG classification, and a comparative analysis of their classification accuracy was performed with transfer learning-based convolutional neural network (TL-CNN) approach.ApproachAn EEG-based SSVEP-cBCI system was set up to merge different individuals’ EEG features stimulated by the instructions for the same task, and three feature fusion methods were adopted, namely parallel connection, serial connection, and multi-person averaging. The fused features were then input into CNN for classification. Additionally, transfer learning (TL) was applied first to a Tsinghua University (THU) benchmark dataset, and then to a collected dataset, so as to meet the CNN training requirement with a much smaller size of collected dataset and increase the classification accuracy. Ten subjects were recruited for data collection, and both datasets were used to gauge the three fusion algorithms’ performance.Main resultsThe results predicted by TL-CNN approach in single-person mode and in multi-person mode with the three feature fusion methods were compared. The experimental results show that each multi-person mode is superior to single-person mode. Within the 3 s time window, the classification accuracy of the single-person CNN is only 90.6%, while the same measure of the two-person parallel connection fusion method can reach 96.6%, achieving better classification effect.SignificanceThe results show that the three multi-person feature fusion methods and the deep learning classification algorithm based on TL-CNN can effectively improve the SSVEP-cBCI classification performance. The feature fusion method of multi -person parallel feature connection achieves better classification results. Different feature fusion methods can be selected in different application scenarios to further optimize cBCI.
Collapse
Affiliation(s)
- Penghai Li
- School of Integrated Circuit Science and Engineering, Tianjin University of Technology, Tianjin, China
| | - Jianxian Su
- School of Integrated Circuit Science and Engineering, Tianjin University of Technology, Tianjin, China
| | - Abdelkader Nasreddine Belkacem
- Department of Computer and Network Engineering, College of Information Technology, UAE University, Al Ain, United Arab Emirates
| | - Longlong Cheng
- China Electronics Cloud Brain Technology Co., Ltd., Tianjin, China
- *Correspondence: Longlong Cheng,
| | - Chao Chen
- Key Laboratory of Complex System Control Theory and Application, Tianjin University of Technology, Tianjin, China
- Chao Chen,
| |
Collapse
|
8
|
Toward a Brain-Computer Interface- and Internet of Things-Based Smart Ward Collaborative System Using Hybrid Signals. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:6894392. [PMID: 35480157 PMCID: PMC9038386 DOI: 10.1155/2022/6894392] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Accepted: 03/26/2022] [Indexed: 11/24/2022]
Abstract
This study proposes a brain-computer interface (BCI)- and Internet of Things (IoT)-based smart ward collaborative system using hybrid signals. The system is divided into hybrid asynchronous electroencephalography (EEG)-, electrooculography (EOG)- and gyro-based BCI control system and an IoT monitoring and management system. The hybrid BCI control system proposes a GUI paradigm with cursor movement. The user uses the gyro to control the cursor area selection and uses blink-related EOG to control the cursor click. Meanwhile, the attention-related EEG signals are classified based on a support-vector machine (SVM) to make the final judgment. The judgment of the cursor area and the judgment of the attention state are reduced, thereby reducing the false operation rate in the hybrid BCI system. The accuracy in the hybrid BCI control system was 96.65 ± 1.44%, and the false operation rate and command response time were 0.89 ± 0.42 events/min and 2.65 ± 0.48 s, respectively. These results show the application potential of the hybrid BCI control system in daily tasks. In addition, we develop an architecture to connect intelligent things in a smart ward based on narrowband Internet of Things (NB-IoT) technology. The results demonstrate that our system provides superior communication transmission quality.
Collapse
|
9
|
Neghabi M, Marateb HR, Mahnam A. Novel frequency-based approach for detection of steady-state visual evoked potentials for realization of practical brain computer interfaces. BRAIN-COMPUTER INTERFACES 2022. [DOI: 10.1080/2326263x.2022.2050513] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
- Mehrnoosh Neghabi
- Biomedical Engineering Department, Engineering Faculty, University of Isfahan, Isfahan, Iran
| | - Hamid Reza Marateb
- Biomedical Engineering Department, Engineering Faculty, University of Isfahan, Isfahan, Iran
- Biomedical Engineering Research Centre (CREB), Automatic Control Department (ESAII), Universitat Politècnica de Catalunya, Barcelona, Spain
| | - Amin Mahnam
- Biomedical Engineering Department, Engineering Faculty, University of Isfahan, Isfahan, Iran
| |
Collapse
|
10
|
Vargas GV, Carvalho SN, Boccato L. Analysis of the spatiotemporal MVDR filter applied to BCI-SSVEP and a filter bank extension. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103459] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
11
|
KARADUMAN M, KARCİ A. Determining the Demands of Disabled People by Artificial Intelligence Methods. COMPUTER SCIENCE 2021. [DOI: 10.53070/bbd.990485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
|
12
|
Woo S, Lee J, Kim H, Chun S, Lee D, Gwon D, Ahn M. An Open Source-Based BCI Application for Virtual World Tour and Its Usability Evaluation. Front Hum Neurosci 2021; 15:647839. [PMID: 34349630 PMCID: PMC8326327 DOI: 10.3389/fnhum.2021.647839] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2020] [Accepted: 06/16/2021] [Indexed: 01/04/2023] Open
Abstract
Brain-computer interfaces can provide a new communication channel and control functions to people with restricted movements. Recent studies have indicated the effectiveness of brain-computer interface (BCI) applications. Various types of applications have been introduced so far in this field, but the number of those available to the public is still insufficient. Thus, there is a need to expand the usability and accessibility of BCI applications. In this study, we introduce a BCI application for users to experience a virtual world tour. This software was built on three open-source environments and is publicly available through the GitHub repository. For a usability test, 10 healthy subjects participated in an electroencephalography (EEG) experiment and evaluated the system through a questionnaire. As a result, all the participants successfully played the BCI application with 96.6% accuracy with 20 blinks from two sessions and gave opinions on its usability (e.g., controllability, completeness, comfort, and enjoyment) through the questionnaire. We believe that this open-source BCI world tour system can be used in both research and entertainment settings and hopefully contribute to open science in the BCI field.
Collapse
Affiliation(s)
- Sanghum Woo
- School of Computer Science and Electrical Engineering, Handong Global University, Pohang, South Korea
| | - Jongmin Lee
- Department of Information and Communication Engineering, Handong Global University, Pohang, South Korea
| | - Hyunji Kim
- Department of Information and Communication Engineering, Handong Global University, Pohang, South Korea
| | - Sungwoo Chun
- School of Computer Science and Electrical Engineering, Handong Global University, Pohang, South Korea
| | - Daehyung Lee
- School of Computer Science and Electrical Engineering, Handong Global University, Pohang, South Korea
| | - Daeun Gwon
- Department of Information and Communication Engineering, Handong Global University, Pohang, South Korea
| | - Minkyu Ahn
- School of Computer Science and Electrical Engineering, Handong Global University, Pohang, South Korea
- Department of Information and Communication Engineering, Handong Global University, Pohang, South Korea
| |
Collapse
|
13
|
Jamil N, Belkacem AN, Ouhbi S, Lakas A. Noninvasive Electroencephalography Equipment for Assistive, Adaptive, and Rehabilitative Brain-Computer Interfaces: A Systematic Literature Review. SENSORS (BASEL, SWITZERLAND) 2021; 21:4754. [PMID: 34300492 PMCID: PMC8309653 DOI: 10.3390/s21144754] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/06/2021] [Revised: 06/28/2021] [Accepted: 07/09/2021] [Indexed: 11/30/2022]
Abstract
Humans interact with computers through various devices. Such interactions may not require any physical movement, thus aiding people with severe motor disabilities in communicating with external devices. The brain-computer interface (BCI) has turned into a field involving new elements for assistive and rehabilitative technologies. This systematic literature review (SLR) aims to help BCI investigator and investors to decide which devices to select or which studies to support based on the current market examination. This examination of noninvasive EEG devices is based on published BCI studies in different research areas. In this SLR, the research area of noninvasive BCIs using electroencephalography (EEG) was analyzed by examining the types of equipment used for assistive, adaptive, and rehabilitative BCIs. For this SLR, candidate studies were selected from the IEEE digital library, PubMed, Scopus, and ScienceDirect. The inclusion criteria (IC) were limited to studies focusing on applications and devices of the BCI technology. The data used herein were selected using IC and exclusion criteria to ensure quality assessment. The selected articles were divided into four main research areas: education, engineering, entertainment, and medicine. Overall, 238 papers were selected based on IC. Moreover, 28 companies were identified that developed wired and wireless equipment as means of BCI assistive technology. The findings of this review indicate that the implications of using BCIs for assistive, adaptive, and rehabilitative technologies are encouraging for people with severe motor disabilities and healthy people. With an increasing number of healthy people using BCIs, other research areas, such as the motivation of players when participating in games or the security of soldiers when observing certain areas, can be studied and collaborated using the BCI technology. However, such BCI systems must be simple (wearable), convenient (sensor fabrics and self-adjusting abilities), and inexpensive.
Collapse
Affiliation(s)
- Nuraini Jamil
- Department of Computer Science and Software Engineering, College of Information Technology, United Arab Emirates University, Al Ain P.O. Box 15551, United Arab Emirates; (N.J.); (S.O.)
| | - Abdelkader Nasreddine Belkacem
- Department of Computer and Network Engineering, College of Information Technology, United Arab Emirates University, Al Ain P.O. Box 15551, United Arab Emirates;
| | - Sofia Ouhbi
- Department of Computer Science and Software Engineering, College of Information Technology, United Arab Emirates University, Al Ain P.O. Box 15551, United Arab Emirates; (N.J.); (S.O.)
| | - Abderrahmane Lakas
- Department of Computer and Network Engineering, College of Information Technology, United Arab Emirates University, Al Ain P.O. Box 15551, United Arab Emirates;
| |
Collapse
|
14
|
Ha J, Park S, Im CH, Kim L. A Hybrid Brain-Computer Interface for Real-Life Meal-Assist Robot Control. SENSORS 2021; 21:s21134578. [PMID: 34283122 PMCID: PMC8271393 DOI: 10.3390/s21134578] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/30/2021] [Revised: 06/30/2021] [Accepted: 07/01/2021] [Indexed: 11/16/2022]
Abstract
Assistant devices such as meal-assist robots aid individuals with disabilities and support the elderly in performing daily activities. However, existing meal-assist robots are inconvenient to operate due to non-intuitive user interfaces, requiring additional time and effort. Thus, we developed a hybrid brain-computer interface-based meal-assist robot system following three features that can be measured using scalp electrodes for electroencephalography. The following three procedures comprise a single meal cycle. (1) Triple eye-blinks (EBs) from the prefrontal channel were treated as activation for initiating the cycle. (2) Steady-state visual evoked potentials (SSVEPs) from occipital channels were used to select the food per the user's intention. (3) Electromyograms (EMGs) were recorded from temporal channels as the users chewed the food to mark the end of a cycle and indicate readiness for starting the following meal. The accuracy, information transfer rate, and false positive rate during experiments on five subjects were as follows: accuracy (EBs/SSVEPs/EMGs) (%): (94.67/83.33/97.33); FPR (EBs/EMGs) (times/min): (0.11/0.08); ITR (SSVEPs) (bit/min): 20.41. These results revealed the feasibility of this assistive system. The proposed system allows users to eat on their own more naturally. Furthermore, it can increase the self-esteem of disabled and elderly peeople and enhance their quality of life.
Collapse
Affiliation(s)
- Jihyeon Ha
- Center for Bionics, Korea Institute of Science and Technology, Seoul 02792, Korea; (J.H.); (S.P.)
- Department of Biomedical Engineering, Hanyang University, Seoul 04763, Korea;
| | - Sangin Park
- Center for Bionics, Korea Institute of Science and Technology, Seoul 02792, Korea; (J.H.); (S.P.)
| | - Chang-Hwan Im
- Department of Biomedical Engineering, Hanyang University, Seoul 04763, Korea;
| | - Laehyun Kim
- Center for Bionics, Korea Institute of Science and Technology, Seoul 02792, Korea; (J.H.); (S.P.)
- Department of HY-KIST Bio-Convergence, Hanyang University, Seoul 04763, Korea
- Correspondence: ; Tel.: +82-2-958-6726
| |
Collapse
|
15
|
Yin X, Meng M, She Q, Gao Y, Luo Z. Optimal channel-based sparse time-frequency blocks common spatial pattern feature extraction method for motor imagery classification. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2021; 18:4247-4263. [PMID: 34198435 DOI: 10.3934/mbe.2021213] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Common spatial pattern (CSP) as a spatial filtering method has been most widely applied to electroencephalogram (EEG) feature extraction to classify motor imagery (MI) in brain-computer interface (BCI) applications. The effectiveness of CSP is determined by the quality of interception in a specific time window and frequency band. Although numerous algorithms have been designed to optimize CSP by splitting the EEG data with a sliding time window and dividing the frequency bands with a set of band-pass filters, simultaneously. However, they did not consider the drawbacks of the rapid increase in data volume and feature dimensions brought about by this method, which would reduce the classification accuracy and calculation efficiency of the model. Therefore, we propose an optimal channel-based sparse time-frequency blocks common spatial pattern (OCSB-CSP) feature extraction method to improve the model classification accuracy and computational efficiency. Comparative experiments on two public EEG datasets show that the proposed method can quickly select significant time-frequency blocks and improve classification performance. The average classification accuracies are higher than those of other winners' methods, providing a new idea for the improvement of BCI applications.
Collapse
Affiliation(s)
- Xu Yin
- Institute of Intelligent Control and Robotics, Hangzhou Dianzi University, Hangzhou 310018, China
| | - Ming Meng
- Institute of Intelligent Control and Robotics, Hangzhou Dianzi University, Hangzhou 310018, China
- Key Laboratory of Brain Machine Collaborative Intelligence of Zhejiang Province, Hangzhou 310018, China
| | - Qingshan She
- Institute of Intelligent Control and Robotics, Hangzhou Dianzi University, Hangzhou 310018, China
- Key Laboratory of Brain Machine Collaborative Intelligence of Zhejiang Province, Hangzhou 310018, China
| | - Yunyuan Gao
- Institute of Intelligent Control and Robotics, Hangzhou Dianzi University, Hangzhou 310018, China
- Key Laboratory of Brain Machine Collaborative Intelligence of Zhejiang Province, Hangzhou 310018, China
| | - Zhizeng Luo
- Institute of Intelligent Control and Robotics, Hangzhou Dianzi University, Hangzhou 310018, China
| |
Collapse
|
16
|
Alhade BA, Ahmed IS, Kamil BZ. Brain Computer Interface using EEG Based Sequential Minimal Optimization algorithms. JOURNAL OF PHYSICS: CONFERENCE SERIES 2021; 1879:022092. [DOI: 10.1088/1742-6596/1879/2/022092] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
Abstract
Abstract
The concept of interfacing brains with robots/machines has been capturing human interests for a long time. The technology of the Brain-computer interface (BCI) has been aimed at building an interface between the brain and any electronic/electrical device (such as, smart home appliance, a wheelchair, and robotics devices) with the use of the electroencephalogram (EEG) that can be defined as a non-invasive approach for the measurement of the electrical potentials from the electrodes that have been placed on the scalp, produced by the activity of the brain. Over the past years, pattern classification was a highly challenging research field. Presently, the tasks of the pattern classification. In this paper, we chose motor imagery with the use of the single trial EEG signal, the SOM has been utilized to classify the signal processing algorithm ( FICA). In comparison to other algorithms of the EEG signal analyses. It has achieved a classification accuracy of up to 88.% in comparison with the other method where the reported accuracy has been 65%. The SOM classification algorithm has been fast, simple, efficient, and easy to use. It achieved satisfactory results at the BCI.
Collapse
|
17
|
Lee HK, Choi YS. Enhancing SSVEP-Based Brain-Computer Interface with Two-Step Task-Related Component Analysis. SENSORS 2021; 21:s21041315. [PMID: 33673137 PMCID: PMC7918701 DOI: 10.3390/s21041315] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/12/2021] [Revised: 02/06/2021] [Accepted: 02/09/2021] [Indexed: 11/16/2022]
Abstract
Among various methods for frequency recognition of the steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) study, a task-related component analysis (TRCA), which extracts discriminative spatial filters for classifying electroencephalogram (EEG) signals, has gathered much interest. The TRCA-based SSVEP method yields lower computational cost and higher classification performance compared to existing SSVEP methods. In spite of its utility, the TRCA-based SSVEP method still suffers from the degradation of the frequency recognition rate in cases where EEG signals with a short length window are used. To address this issue, here, we propose an improved strategy for decoding SSVEPs, which is insensitive to a window length by carrying out two-step TRCA. The proposed method reuses the spatial filters corresponding to target frequencies generated by the TRCA. Followingly, the proposed method accentuates features for target frequencies by correlating individual template and test data. For the evaluation of the performance of the proposed method, we used a benchmark dataset with 35 subjects and confirmed significantly improved performance comparing with other existing SSVEP methods. These results imply the suitability as an efficient frequency recognition strategy for SSVEP-based BCI applications.
Collapse
|
18
|
The Time Course of Perceptual Closure of Incomplete Visual Objects: An Event-Related Potential Study. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2020; 2020:8825197. [PMID: 33082776 PMCID: PMC7559784 DOI: 10.1155/2020/8825197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/09/2020] [Revised: 07/30/2020] [Accepted: 09/02/2020] [Indexed: 11/18/2022]
Abstract
Perceptual organization is an important part of visual and auditory information processing. In the case of visual occlusion, whether the loss of information in images could be recovered and thus perceptually closed affects object recognition. In particular, many elderly subjects have defects in object recognition ability, which may be closely related to the abnormalities of perceptual functions. This phenomenon even can be observed in the early stage of dementia. Therefore, studying the neural mechanism of perceptual closure and its relationship with sensory and cognitive processing is important for understanding how the human brain recognizes objects, inspiring the development of neuromorphic intelligent algorithms of object recognition. In this study, a new experiment was designed to explore the realistic process of perceptual closure under occlusion and intact conditions of faces and building. The analysis of the differences in ERP components P1, N1, and Ncl indicated that the subjective awareness of perceptual closure mainly occurs in Ncl, but incomplete information has been processed and showed different manners compared to complete stimuli in N170 for facial materials. Although occluded, faces, but not buildings, still maintain the specificity of perceptual processing. The Ncl by faces and buildings did not show significant differences in both amplitude and latency, suggesting a “completing” process regardless of categorical features.
Collapse
|
19
|
Jin J, Liu C, Daly I, Miao Y, Li S, Wang X, Cichocki A. Bispectrum-Based Channel Selection for Motor Imagery Based Brain-Computer Interfacing. IEEE Trans Neural Syst Rehabil Eng 2020; 28:2153-2163. [PMID: 32870796 DOI: 10.1109/tnsre.2020.3020975] [Citation(s) in RCA: 50] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
The performance of motor imagery (MI) based Brain-computer interfacing (BCI) is easily affected by noise and redundant information that exists in the multi-channel electroencephalogram (EEG). To solve this problem, many temporal and spatial feature based channel selection methods have been proposed. However, temporal and spatial features do not accurately reflect changes in the power of the oscillatory EEG. Thus, spectral features of MI-related EEG signals may be useful for channel selection. Bispectrum analysis is a technique developed for extracting non-linear and non-Gaussian information from non-linear and non-Gaussian signals. The features extracted from bispectrum analysis can provide frequency domain information about the EEG. Therefore, in this study, we propose a bispectrum-based channel selection (BCS) method for MI-based BCI. The proposed method uses the sum of logarithmic amplitudes (SLA) and the first order spectral moment (FOSM) features extracted from bispectrum analysis to select EEG channels without redundant information. Three public BCI competition datasets (BCI competition IV dataset 1, BCI competition III dataset IVa and BCI competition III dataset IIIa) were used to validate the effectiveness of our proposed method. The results indicate that our BCS method outperforms use of all channels (83.8% vs 69.4%, 86.3% vs 82.9% and 77.8% vs 68.2%, respectively). Furthermore, compared to the other state-of-the-art methods, our BCS method also can achieve significantly better classification accuracies for MI-based BCI (Wilcoxon signed test, p < 0.05).
Collapse
|
20
|
Chen C, Chen P, Belkacem AN, Lu L, Xu R, Tan W, Li P, Gao Q, Shin D, Wang C, Ming D. Neural activities classification of left and right finger gestures during motor execution and motor imagery. BRAIN-COMPUTER INTERFACES 2020. [DOI: 10.1080/2326263x.2020.1782124] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Affiliation(s)
- Chao Chen
- Key Laboratory of Complex System Control Theory and Application, Tianjin University of Technology, Tianjin, China
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Peiji Chen
- Key Laboratory of Complex System Control Theory and Application, Tianjin University of Technology, Tianjin, China
| | - Abdelkader Nasreddine Belkacem
- Department of Computer and Network Engineering, College of Information Technology, UAE University, Al Ain, United Arab Emirates
| | - Lin Lu
- Department of Computer Science and Technology, Zhonghuan Information College Tianjin University of Technology, Tianjin, China
| | - Rui Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Wenjun Tan
- School of Computer Science and Engineering, Northeastern University, Shenyang, China
| | - Penghai Li
- Key Laboratory of Complex System Control Theory and Application, Tianjin University of Technology, Tianjin, China
| | - Qiang Gao
- Key Laboratory of Complex System Control Theory and Application, Tianjin University of Technology, Tianjin, China
| | - Duk Shin
- Department of Electronics and Mechatronics, Tokyo Polytechnic University, Japan
| | - Changming Wang
- Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing, China
- North China University of Science and Technology, Tangshan, Hebei, China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| |
Collapse
|
21
|
Belkacem AN, Jamil N, Palmer JA, Ouhbi S, Chen C. Brain Computer Interfaces for Improving the Quality of Life of Older Adults and Elderly Patients. Front Neurosci 2020; 14:692. [PMID: 32694979 PMCID: PMC7339951 DOI: 10.3389/fnins.2020.00692] [Citation(s) in RCA: 34] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2020] [Accepted: 06/08/2020] [Indexed: 02/01/2023] Open
Abstract
All people experience aging, and the related physical and health changes, including changes in memory and brain function. These changes may become debilitating leading to an increase in dependence as people get older. Many external aids and tools have been developed to allow older adults and elderly patients to continue to live normal and comfortable lives. This mini-review describes some of the recent studies on cognitive decline and motor control impairment with the goal of advancing non-invasive brain computer interface (BCI) technologies to improve health and wellness of older adults and elderly patients. First, we describe the state of the art in cognitive prosthetics for psychiatric diseases. Then, we describe the state of the art of possible assistive BCI applications for controlling an exoskeleton, a wheelchair and smart home for elderly people with motor control impairments. The basic age-related brain and body changes, the effects of age on cognitive and motor abilities, and several BCI paradigms with typical tasks and outcomes are thoroughly described. We also discuss likely future trends and technologies to assist healthy older adults and elderly patients using innovative BCI applications with minimal technical oversight.
Collapse
Affiliation(s)
- Abdelkader Nasreddine Belkacem
- Department of Computer and Network Engineering, College of Information Technology, United Arab Emirates University, Al Ain, United Arab Emirates
| | - Nuraini Jamil
- Department of Computer Science and Software Engineering, College of Information Technology, United Arab Emirates University, Al Ain, United Arab Emirates
| | - Jason A. Palmer
- Department of Neurological Diagnosis and Restoration, Osaka University, Suita, Japan
| | - Sofia Ouhbi
- Department of Computer Science and Software Engineering, College of Information Technology, United Arab Emirates University, Al Ain, United Arab Emirates
| | - Chao Chen
- Key Laboratory of Complex System Control Theory and Application, Tianjin University of Technology, Tianjin, China
| |
Collapse
|