1
|
Llorella FR, Azorín JM, Patow G. Black hole algorithm with convolutional neural networks for the creation of brain-computer interface based in visual perception and visual imagery. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07542-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
Abstract
AbstractNon-invasive brain-computer interfaces can be implemented through different paradigms, the most used one being motor imagery and evoked potentials, although recently there has been an interest in paradigms based on perception and visual imagery. Following this approach, this work demonstrates the classification of visual imagery, visual perception and also the possibility of knowledge transfer between these two domains from EEG signals using convolutional neural networks. Also, we propose an adequate framework for such classification, which uses convolutional neural networks and the black hole heuristic algorithm for the search for optimal neural network structures.
Collapse
|
2
|
Palumbo A, Gramigna V, Calabrese B, Ielpo N. Motor-Imagery EEG-Based BCIs in Wheelchair Movement and Control: A Systematic Literature Review. SENSORS (BASEL, SWITZERLAND) 2021; 21:6285. [PMID: 34577493 PMCID: PMC8473300 DOI: 10.3390/s21186285] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/07/2021] [Revised: 09/09/2021] [Accepted: 09/14/2021] [Indexed: 02/07/2023]
Abstract
The pandemic emergency of the coronavirus disease 2019 (COVID-19) shed light on the need for innovative aids, devices, and assistive technologies to enable people with severe disabilities to live their daily lives. EEG-based Brain-Computer Interfaces (BCIs) can lead individuals with significant health challenges to improve their independence, facilitate participation in activities, thus enhancing overall well-being and preventing impairments. This systematic review provides state-of-the-art applications of EEG-based BCIs, particularly those using motor-imagery (MI) data, to wheelchair control and movement. It presents a thorough examination of the different studies conducted since 2010, focusing on the algorithm analysis, features extraction, features selection, and classification techniques used as well as on wheelchair components and performance evaluation. The results provided in this paper could highlight the limitations of current biomedical instrumentations applied to people with severe disabilities and bring focus to innovative research topics.
Collapse
Affiliation(s)
- Arrigo Palumbo
- Department of Medical and Surgical Sciences, “Magna Græcia” University, 88100 Catanzaro, Italy; (A.P.); (B.C.); (N.I.)
| | - Vera Gramigna
- Neuroscience Research Center, Magna Græcia University, 88100 Catanzaro, Italy
| | - Barbara Calabrese
- Department of Medical and Surgical Sciences, “Magna Græcia” University, 88100 Catanzaro, Italy; (A.P.); (B.C.); (N.I.)
| | - Nicola Ielpo
- Department of Medical and Surgical Sciences, “Magna Græcia” University, 88100 Catanzaro, Italy; (A.P.); (B.C.); (N.I.)
| |
Collapse
|
3
|
Deep learning helps EEG signals predict different stages of visual processing in the human brain. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102996] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
4
|
Alhade BA, Ahmed IS, Kamil BZ. Brain Computer Interface using EEG Based Sequential Minimal Optimization algorithms. JOURNAL OF PHYSICS: CONFERENCE SERIES 2021; 1879:022092. [DOI: 10.1088/1742-6596/1879/2/022092] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
Abstract
Abstract
The concept of interfacing brains with robots/machines has been capturing human interests for a long time. The technology of the Brain-computer interface (BCI) has been aimed at building an interface between the brain and any electronic/electrical device (such as, smart home appliance, a wheelchair, and robotics devices) with the use of the electroencephalogram (EEG) that can be defined as a non-invasive approach for the measurement of the electrical potentials from the electrodes that have been placed on the scalp, produced by the activity of the brain. Over the past years, pattern classification was a highly challenging research field. Presently, the tasks of the pattern classification. In this paper, we chose motor imagery with the use of the single trial EEG signal, the SOM has been utilized to classify the signal processing algorithm ( FICA). In comparison to other algorithms of the EEG signal analyses. It has achieved a classification accuracy of up to 88.% in comparison with the other method where the reported accuracy has been 65%. The SOM classification algorithm has been fast, simple, efficient, and easy to use. It achieved satisfactory results at the BCI.
Collapse
|
5
|
Abstract
Recent advances in brain-computer interface technology to restore and rehabilitate neurologic function aim to enable persons with disabling neurologic conditions to communicate, interact with the environment, and achieve other key activities of daily living and personal goals. Here we evaluate the principles, benefits, challenges, and future directions of brain-computer interfaces in the context of neurorehabilitation. We then explore the clinical translation of these technologies and propose an approach to facilitate implementation of brain-computer interfaces for persons with neurologic disease.
Collapse
Affiliation(s)
- Michael J Young
- Department of Neurology, Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| | - David J Lin
- Department of Neurology, Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
- School of Engineering and Carney Institute for Brain Science, Brown University, Providence, Rhode Island
- Department of Veterans Affairs Medical Center, VA RR&D Center for Neurorestoration and Neurotechnology, Providence, Rhode Island
| | - Leigh R Hochberg
- Department of Neurology, Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
- School of Engineering and Carney Institute for Brain Science, Brown University, Providence, Rhode Island
- Department of Veterans Affairs Medical Center, VA RR&D Center for Neurorestoration and Neurotechnology, Providence, Rhode Island
| |
Collapse
|
6
|
A BCI System Based on Motor Imagery for Assisting People with Motor Deficiencies in the Limbs. Brain Sci 2020; 10:brainsci10110864. [PMID: 33212777 PMCID: PMC7697603 DOI: 10.3390/brainsci10110864] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2020] [Revised: 10/27/2020] [Accepted: 11/06/2020] [Indexed: 12/26/2022] Open
Abstract
Motor deficiencies constitute a significant problem affecting millions of people worldwide. Such people suffer from a debility in daily functioning, which may lead to decreased and incoherence in daily routines and deteriorate their quality of life (QoL). Thus, there is an essential need for assistive systems to help those people achieve their daily actions and enhance their overall QoL. This study proposes a novel brain–computer interface (BCI) system for assisting people with limb motor disabilities in performing their daily life activities by using their brain signals to control assistive devices. The extraction of useful features is vital for an efficient BCI system. Therefore, the proposed system consists of a hybrid feature set that feeds into three machine-learning (ML) classifiers to classify motor Imagery (MI) tasks. This hybrid feature selection (FS) system is practical, real-time, and an efficient BCI with low computation cost. We investigate different combinations of channels to select the combination that has the highest impact on performance. The results indicate that the highest achieved accuracies using a support vector machine (SVM) classifier are 93.46% and 86.0% for the BCI competition III–IVa dataset and the autocalibration and recurrent adaptation dataset, respectively. These datasets are used to test the performance of the proposed BCI. Also, we verify the effectiveness of the proposed BCI by comparing its performance with recent studies. We show that the proposed system is accurate and efficient. Future work can apply the proposed system to individuals with limb motor disabilities to assist them and test their capability to improve their QoL. Moreover, the forthcoming work can examine the system’s performance in controlling assistive devices such as wheelchairs or artificial limbs.
Collapse
|
7
|
A Novel Approach to Shadow Boundary Detection Based on an Adaptive Direction-Tracking Filter for Brain-Machine Interface Applications. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10196761] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
In this paper, a Brain-Machine Interface (BMI) system is proposed to automatically control the navigation of wheelchairs by detecting the shadows on their route. In this context, a new algorithm to detect shadows in a single image is proposed. Specifically, a novel adaptive direction tracking filter (ADT) is developed to extract feature information along the direction of shadow boundaries. The proposed algorithm avoids extraction of features around all directions of pixels, which significantly improves the efficiency and accuracy of shadow features extraction. Higher-order statistics (HOS) features such as skewness and kurtosis in addition to other optical features are used as input to different Machine Learning (ML) based classifiers, specifically, a Multilayer Perceptron (MLP), Autoencoder (AE), 1D-Convolutional Neural Network (1D-CNN) and Support Vector Machine (SVM), to perform the shadow boundaries detection task. Comparative results demonstrate that the proposed MLP-based system outperforms all the other state-of-the-art approaches, reporting accuracy rates up to 84.63%.
Collapse
|
8
|
Rashid M, Sulaiman N, P P Abdul Majeed A, Musa RM, Ab Nasir AF, Bari BS, Khatun S. Current Status, Challenges, and Possible Solutions of EEG-Based Brain-Computer Interface: A Comprehensive Review. Front Neurorobot 2020; 14:25. [PMID: 32581758 PMCID: PMC7283463 DOI: 10.3389/fnbot.2020.00025] [Citation(s) in RCA: 102] [Impact Index Per Article: 25.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2019] [Accepted: 04/08/2020] [Indexed: 12/12/2022] Open
Abstract
Brain-Computer Interface (BCI), in essence, aims at controlling different assistive devices through the utilization of brain waves. It is worth noting that the application of BCI is not limited to medical applications, and hence, the research in this field has gained due attention. Moreover, the significant number of related publications over the past two decades further indicates the consistent improvements and breakthroughs that have been made in this particular field. Nonetheless, it is also worth mentioning that with these improvements, new challenges are constantly discovered. This article provides a comprehensive review of the state-of-the-art of a complete BCI system. First, a brief overview of electroencephalogram (EEG)-based BCI systems is given. Secondly, a considerable number of popular BCI applications are reviewed in terms of electrophysiological control signals, feature extraction, classification algorithms, and performance evaluation metrics. Finally, the challenges to the recent BCI systems are discussed, and possible solutions to mitigate the issues are recommended.
Collapse
Affiliation(s)
- Mamunur Rashid
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Norizam Sulaiman
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Anwar P P Abdul Majeed
- Innovative Manufacturing, Mechatronics and Sports Laboratory, Faculty of Manufacturing and Mechatronic Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Rabiu Muazu Musa
- Centre for Fundamental and Continuing Education, Universiti Malaysia Terengganu, Kuala Nerus, Malaysia
| | - Ahmad Fakhri Ab Nasir
- Innovative Manufacturing, Mechatronics and Sports Laboratory, Faculty of Manufacturing and Mechatronic Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Bifta Sama Bari
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Sabira Khatun
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| |
Collapse
|
9
|
Xiaoxiao X, Bin L, Ramkumar S, Saravanan S, Balaji MSP, Dhanasekaran S, Thimmiaraja J. Electroencephalogram based communication system for locked in state person using mentally spelled tasks with optimized network model. Artif Intell Med 2020; 102:101766. [PMID: 31980103 DOI: 10.1016/j.artmed.2019.101766] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2019] [Revised: 11/16/2019] [Accepted: 11/18/2019] [Indexed: 12/14/2022]
Abstract
Due to growth in population, Individual persons with disabilities are increasing daily. To overcome the disability especially in Locked in State (LIS) due to Spinal Cord Injury (SCI), we planned to design four states moving robot from four imagery tasks signals acquired from three electrode systems by placing the electrodes in three positions namely T1, T3 and FP1. At the time of the study we extract the features from Continuous Wavelet Transform (CWT) and trained with Optimized Neural Network model to analyze the features. The proposed network model showed the highest performances with an accuracy of 93.86 % then that of conventional network model. To confirm the performances we conduct offline test. The offline test also proved that new network model recognizing accuracy was higher than the conventional network model with recognizing accuracy of 97.50 %. To verify our result we conducted Information Transfer Rate (ITR), from this analysis we concluded that optimized network model outperforms the other network models like conventional ordinary Feed Forward Neural Network, Time Delay Neural Network and Elman Neural Networks with an accuracy of 21.67 bits per sec. By analyzing classification performances, recognizing accuracy and Information Transformation Rate (ITR), we concluded that CWT features with optimized neural network model performances were comparably greater than that of normal or conventional neural network model and also the study proved that performances of male subjects was appreciated compared to female subjects.
Collapse
Affiliation(s)
- Xu Xiaoxiao
- School of Entrepreneurship, Wuhan University of Technology, Wuhan Hubei Province, 430070, China.
| | - Luo Bin
- School of Foreign Languages, Wuhan Business University, Wuhan, 430056, China
| | - S Ramkumar
- School of Computing, Kalasalingam Academy of Research and Education, Krishnankoil, Virudhunagar (Dt), India
| | - S Saravanan
- Department of Information Science and Engineering, CMR Institute of Technology, Bangalore, India
| | | | - S Dhanasekaran
- School of Computing, Kalasalingam Academy of Research and Education, Krishnankoil, Virudhunagar (Dt), India
| | - J Thimmiaraja
- School of Computing, Kalasalingam Academy of Research and Education, Krishnankoil, Virudhunagar (Dt), India
| |
Collapse
|
10
|
Al-Qaysi ZT, Zaidan BB, Zaidan AA, Suzani MS. A review of disability EEG based wheelchair control system: Coherent taxonomy, open challenges and recommendations. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2018; 164:221-237. [PMID: 29958722 DOI: 10.1016/j.cmpb.2018.06.012] [Citation(s) in RCA: 36] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/03/2018] [Revised: 05/27/2018] [Accepted: 06/14/2018] [Indexed: 06/08/2023]
Abstract
CONTEXT Intelligent wheelchair technology has recently been utilised to address several mobility problems. Techniques based on brain-computer interface (BCI) are currently used to develop electric wheelchairs. Using human brain control in wheelchairs for people with disability has elicited widespread attention due to its flexibility. OBJECTIVE This study aims to determine the background of recent studies on wheelchair control based on BCI for disability and map the literature survey into a coherent taxonomy. The study intends to identify the most important aspects in this emerging field as an impetus for using BCI for disability in electric-powered wheelchair (EPW) control, which remains a challenge. The study also attempts to provide recommendations for solving other existing limitations and challenges. METHODS We systematically searched all articles about EPW control based on BCI for disability in three popular databases: ScienceDirect, IEEE and Web of Science. These databases contain numerous articles that considerably influenced this field and cover most of the relevant theoretical and technical issues. RESULTS We selected 100 articles on the basis of our inclusion and exclusion criteria. A large set of articles (55) discussed on developing real-time wheelchair control systems based on BCI for disability signals. Another set of articles (25) focused on analysing BCI for disability signals for wheelchair control. The third set of articles (14) considered the simulation of wheelchair control based on BCI for disability signals. Four articles designed a framework for wheelchair control based on BCI for disability signals. Finally, one article reviewed concerns regarding wheelchair control based on BCI for disability signals. DISCUSSION Since 2007, researchers have pursued the possibility of using BCI for disability in EPW control through different approaches. Regardless of type, articles have focused on addressing limitations that impede the full efficiency of BCI for disability and recommended solutions for these limitations. CONCLUSIONS Studies on wheelchair control based on BCI for disability considerably influence society due to the large number of people with disability. Therefore, we aim to provide researchers and developers with a clear understanding of this platform and highlight the challenges and gaps in the current and future studies.
Collapse
Affiliation(s)
- Z T Al-Qaysi
- Department of Computing, University Pendidikan Sultan Idris, Tanjong Malim, Perak, Malaysia; Department of Computer Science, Computer Science and Mathematics College, Tikrit University, Tikrit
| | - B B Zaidan
- Department of Computing, University Pendidikan Sultan Idris, Tanjong Malim, Perak, Malaysia
| | - A A Zaidan
- Department of Computing, University Pendidikan Sultan Idris, Tanjong Malim, Perak, Malaysia.
| | - M S Suzani
- Department of Computing, University Pendidikan Sultan Idris, Tanjong Malim, Perak, Malaysia
| |
Collapse
|
11
|
Ashley D, Ashley K, Alqasemi R, Dubey R. Semi-autonomous mobility assistance for power wheelchair users navigating crowded environments. IEEE Int Conf Rehabil Robot 2017; 2017:1025-1030. [PMID: 28813956 DOI: 10.1109/icorr.2017.8009384] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Power wheelchair users suffering from cognitive or physical impairment often face difficulties in maneuvering their wheelchairs through crowded environments. Currently, users need to be continuously aware of all traffic around them to actively avoid all collisions. This is an especially difficult task since many wheelchair users are unable to accurately view or perceive their surroundings. Additionally, imprecise joystick control, slowed reaction time, or imperfect interpretation of the environment can lead to unintended collisions with objects in the environment. This work looks to augment user's input with data gathered from an ultrasonic sensor ring to prevent accidental collisions. Using data gathered from the sensors, we detect objects within a certain radius of the chair. This sensor information is combined with the user input from a joystick to generate a potential field description for the intended motion of the wheelchair. An optimal motion vector is calculated which works to avoid collision with obstacles. Ultimately, this control method reduces the cognitive load on the user and enables them to navigate complex environments by providing simple and/or imprecise input to the system.
Collapse
|