1
|
Alshehri H, Al-Nafjan A, Aldayel M. Decoding Pain: A Comprehensive Review of Computational Intelligence Methods in Electroencephalography-Based Brain-Computer Interfaces. Diagnostics (Basel) 2025; 15:300. [PMID: 39941230 PMCID: PMC11816796 DOI: 10.3390/diagnostics15030300] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2024] [Revised: 01/18/2025] [Accepted: 01/23/2025] [Indexed: 02/16/2025] Open
Abstract
Objective pain evaluation is crucial for determining appropriate treatment strategies in clinical settings. Studies have demonstrated the potential of using brain-computer interface (BCI) technology for pain classification and detection. Collating knowledge and insights from prior studies, this review explores the extensive work on pain detection based on electroencephalography (EEG) signals. It presents the findings, methodologies, and advancements reported in 20 peer-reviewed articles that utilize machine learning and deep learning (DL) approaches for EEG-based pain detection. We analyze various ML and DL techniques, support vector machines, random forests, k-nearest neighbors, and convolution neural network recurrent neural networks and transformers, and their effectiveness in decoding pain neural signals. The motivation for combining AI with BCI technology lies in the potential for significant advancements in the real-time responsiveness and adaptability of these systems. We reveal that DL techniques effectively analyze EEG signals and recognize pain-related patterns. Moreover, we discuss advancements and challenges associated with EEG-based pain detection, focusing on BCI applications in clinical settings and functional requirements for effective pain classification systems. By evaluating the current research landscape, we identify gaps and opportunities for future research to provide valuable insights for researchers and practitioners.
Collapse
Affiliation(s)
- Hadeel Alshehri
- Computer Science Department, College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia
| | - Abeer Al-Nafjan
- Computer Science Department, College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia
| | - Mashael Aldayel
- Information Technology Department, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia
| |
Collapse
|
2
|
Wei Q, Li C, Wang Y, Gao X. Enhancing the performance of SSVEP-based BCIs by combining task-related component analysis and deep neural network. Sci Rep 2025; 15:365. [PMID: 39748063 PMCID: PMC11697369 DOI: 10.1038/s41598-024-84534-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2024] [Accepted: 12/24/2024] [Indexed: 01/04/2025] Open
Abstract
Steady-State Visually Evoked Potential (SSVEP) signals can be decoded by either a traditional machine learning algorithm or a deep learning network. Combining the two methods is expected to enhance the performance of an SSVEP-based brain-computer interface (BCI) by exploiting their advantages. However, an efficient strategy for integrating the two methods has not yet been established. To address this issue, we propose a classification framework named eTRCA + sbCNN that combines an ensemble task-related component analysis (eTRCA) algorithm and a sub-band convolutional neural network (sbCNN) for recognizing the frequency of SSVEP signals. The two models are first trained separately, then their classification score vectors are added together, and finally the frequency corresponding to the maximal summed score is decided as the frequency of SSVEP signals. The proposed framework can effectively exploit the complementarity between the two kinds of feature signals and significantly improve the classification performance of SSVEP-based BCIs. The performance of the proposed method is validated on two SSVEP BCI datasets and compared with that of eTRCA, sbCNN and other state-of-the-art models. Experimental results indicate that the proposed method significantly outperform the compared algorithms, and thus helps to promote the practical application of SSVEP- BCI systems.
Collapse
Affiliation(s)
- Qingguo Wei
- Jiangxi Provincial Key Laboratory of Intelligent Systems and Human-Machine Interaction, Department of Electronic Engineering, School of Information Engineering, Nanchang University, Nanchang, 330031, China.
| | - Chang Li
- Jiangxi Provincial Key Laboratory of Intelligent Systems and Human-Machine Interaction, Department of Electronic Engineering, School of Information Engineering, Nanchang University, Nanchang, 330031, China
| | - Yijun Wang
- State Key Laboratory on Integrated Optoelectronics, Institute Semiconductors, Chinese Academy of Science, Beijing, 100083, China
| | - Xiaorong Gao
- Department of Biomedical Engineering, School of Biomedical Engineering, Tsinghua University, Beijing, 100084, China
| |
Collapse
|
3
|
Ding X, Zhang Z, Wang K, Xiao X, Xu M. A Lightweight Network with Domain Adaptation for Motor Imagery Recognition. ENTROPY (BASEL, SWITZERLAND) 2024; 27:14. [PMID: 39851633 PMCID: PMC11764293 DOI: 10.3390/e27010014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/28/2024] [Revised: 12/07/2024] [Accepted: 12/13/2024] [Indexed: 01/26/2025]
Abstract
Brain-computer interfaces (BCI) are an effective tool for recognizing motor imagery and have been widely applied in the motor control and assistive operation domains. However, traditional intention-recognition methods face several challenges, such as prolonged training times and limited cross-subject adaptability, which restrict their practical application. This paper proposes an innovative method that combines a lightweight convolutional neural network (CNN) with domain adaptation. A lightweight feature extraction module is designed to extract key features from both the source and target domains, effectively reducing the model's parameters and improving the real-time performance and computational efficiency. To address differences in sample distributions, a domain adaptation strategy is introduced to optimize the feature alignment. Furthermore, domain adversarial training is employed to promote the learning of domain-invariant features, significantly enhancing the model's cross-subject generalization ability. The proposed method was evaluated on an fNIRS motor imagery dataset, achieving an average accuracy of 87.76% in a three-class classification task. Additionally, lightweight experiments were conducted from two perspectives: model structure optimization and data feature selection. The results demonstrated the potential advantages of this method for practical applications in motor imagery recognition systems.
Collapse
Affiliation(s)
- Xinmin Ding
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300384, China; (X.D.); (Z.Z.); (K.W.); (X.X.)
- West China Tianfu Hospital, Sichuan University, Chengdu 610041, China
| | - Zenghui Zhang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300384, China; (X.D.); (Z.Z.); (K.W.); (X.X.)
| | - Kun Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300384, China; (X.D.); (Z.Z.); (K.W.); (X.X.)
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin 300392, China
| | - Xiaolin Xiao
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300384, China; (X.D.); (Z.Z.); (K.W.); (X.X.)
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin 300392, China
| | - Minpeng Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300384, China; (X.D.); (Z.Z.); (K.W.); (X.X.)
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin 300392, China
| |
Collapse
|
4
|
Sitaram R, Sanchez-Corzo A, Vargas G, Cortese A, El-Deredy W, Jackson A, Fetz E. Mechanisms of brain self-regulation: psychological factors, mechanistic models and neural substrates. Philos Trans R Soc Lond B Biol Sci 2024; 379:20230093. [PMID: 39428875 PMCID: PMC11491850 DOI: 10.1098/rstb.2023.0093] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2023] [Revised: 03/22/2024] [Accepted: 06/26/2024] [Indexed: 10/22/2024] Open
Abstract
While neurofeedback represents a promising tool for neuroscience and a brain self-regulation approach to psychological rehabilitation, the field faces several problems and challenges. Current research has shown great variability and even failure among human participants in learning to self-regulate target features of brain activity with neurofeedback. A better understanding of cognitive mechanisms, psychological factors and neural substrates underlying self-regulation might help improve neurofeedback's scientific and clinical practices. This article reviews the current understanding of the neural mechanisms of brain self-regulation by drawing on findings from human and animal studies in neurofeedback, brain-computer/machine interfaces and neuroprosthetics. In this article, we look closer at the following topics: cognitive processes and psychophysiological factors affecting self-regulation, theoretical models and neural substrates underlying self-regulation, and finally, we provide an outlook on the outstanding gaps in knowledge and technical challenges. This article is part of the theme issue 'Neurofeedback: new territories and neurocognitive mechanisms of endogenous neuromodulation'.
Collapse
Affiliation(s)
- Ranganatha Sitaram
- Multimodal Functional Brain Imaging and Neurorehabilitation Hub, Diagnostic Imaging Department, Saint Jude Children’s Research Hospital, 262 Danny Thomas Place Memphis, TN38105, USA
| | - Andrea Sanchez-Corzo
- Multimodal Functional Brain Imaging and Neurorehabilitation Hub, Diagnostic Imaging Department, Saint Jude Children’s Research Hospital, 262 Danny Thomas Place Memphis, TN38105, USA
| | - Gabriela Vargas
- Institute of Biological and Medical Engineering, Pontificia Universidad Católica de Chile, Diagonal Paraguay 362, Santiago de Chile8330074, Chile
| | - Aurelio Cortese
- Department of Decoded Neurofeedback, ATR Computational Neuroscience Laboratories, Kyoto619-0288, Japan
| | - Wael El-Deredy
- Brain Dynamics Lab, Universidad de Valparaíso, Valparaiso, Chile
- ValgrAI: Valencian Graduate School and Research Network of Artificial Intelligence – University of Valencia, Spain, Spain
| | - Andrew Jackson
- Biosciences Institute, Newcastle University, NewcastleNE2 4HH, UK
| | - Eberhard Fetz
- Department of Physiology and Biophysics, Washington National Primate Research Center, University of Washington, Seattle, WA, USA
| |
Collapse
|
5
|
Feng J, Gao S, Hu Y, Sun G, Sheng W. Brain-Computer Interface for Patients with Spinal Cord Injury: A Bibliometric Study. World Neurosurg 2024; 192:170-187.e1. [PMID: 39245135 DOI: 10.1016/j.wneu.2024.08.163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2024] [Revised: 08/29/2024] [Accepted: 08/30/2024] [Indexed: 09/10/2024]
Abstract
BACKGROUND Spinal cord injury (SCI) is a debilitating condition with profound implications on patients' quality of life. Recent advancements in brain-computer interface (BCI) technology have provided novel opportunities for individuals with paralysis due to SCI. Consequently, research on the application of BCI for treating SCI has received increasing attention from scholars worldwide. However, there is a lack of rigorous bibliometric studies on the evolution and trends in this field. Hence, the present study aimed to use bibliometric methods to investigate the current status and emerging trends in the field of applying BCI for treating SCI and thus identify novel therapeutic options for SCI. METHODS We conducted a comprehensive review of the relevant literature on BCI applications for treating SCI published between 2005 and 2024 by using the Web of Science Core Collection database. To facilitate visualization and quantitative analysis of the published literature, we used VOSviewer and CiteSpace software tools. These tools enabled the assessment of co-authorships, co-occurrences, citations, and co-citations in the selected literature, thereby providing an overview of the current trends and predictive insights into the field. RESULTS The literature search yielded 714 publications from the Web of Science Core Collection database. The findings indicated a significant upward trend in the number of publications, yielding a total of 24,804 citations, with an average citation rate of 34.74 per publication and an H-index of 75. Research contributions were identified from 54 countries/regions, and the United States, China, and Germany emerged as the predominant contributors. A total of 1114 research institutions contributed to the retrieved literature, with Harvard Medical School, Brown University, and Northwestern University producing the highest number of publications. The published literature was predominantly distributed across 258 academic journals, and the Journal of Neural Engineering was the most frequently utilized publication source. Hochberg, Leigh, Henderson, Jaimie, and Collinger were the prominent authors in this field. CONCLUSIONS In recent years, there has been a steep increase in research on the use of BCI for treating SCI. Existing research focuses on the application of BCI for improving rehabilitation and quality of life of patients with SCI. Interdisciplinary collaboration is the current trend in this field.
Collapse
Affiliation(s)
- Jingsheng Feng
- Department of Spinal Surgery, The First Affiliated Hospital of Xinjiang Medical University, Urumqi, China
| | - Shutao Gao
- Department of Spinal Surgery, The First Affiliated Hospital of Xinjiang Medical University, Urumqi, China
| | - Yukun Hu
- Department of Spinal Surgery, The First Affiliated Hospital of Xinjiang Medical University, Urumqi, China
| | - Guangxu Sun
- Department of Spinal Surgery, The First Affiliated Hospital of Xinjiang Medical University, Urumqi, China
| | - Weibin Sheng
- Department of Spinal Surgery, The First Affiliated Hospital of Xinjiang Medical University, Urumqi, China.
| |
Collapse
|
6
|
Yan ZN, Liu PR, Zhou H, Zhang JY, Liu SX, Xie Y, Wang HL, Yu JB, Zhou Y, Ni CM, Huang L, Ye ZW. Brain-computer Interaction in the Smart Era. Curr Med Sci 2024; 44:1123-1131. [PMID: 39347924 DOI: 10.1007/s11596-024-2927-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2024] [Accepted: 08/18/2024] [Indexed: 10/01/2024]
Abstract
The brain-computer interface (BCI) system serves as a critical link between external output devices and the human brain. A monitored object's mental state, sensory cognition, and even higher cognition are reflected in its electroencephalography (EEG) signal. Nevertheless, unprocessed EEG signals are frequently contaminated with a variety of artifacts, rendering the analysis and elimination of impurities from the collected EEG data exceedingly challenging, not to mention the manual adjustment thereof. Over the last few decades, the rapid advancement of artificial intelligence (AI) technology has contributed to the development of BCI technology. Algorithms derived from AI and machine learning have significantly enhanced the ability to analyze and process EEG electrical signals, thereby expanding the range of potential interactions between the human brain and computers. As a result, the present BCI technology with the help of AI can assist physicians in gaining a more comprehensive understanding of their patients' physical and psychological status, thereby contributing to improvements in their health and quality of life.
Collapse
Affiliation(s)
- Zi-Neng Yan
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Peng-Ran Liu
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Hong Zhou
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Jia-Yao Zhang
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Song-Xiang Liu
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Yi Xie
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Hong-Lin Wang
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Jin-Bo Yu
- Wuhan Neuracom Technology Development Co., Ltd, Wuhan, 430200, China
| | - Yu Zhou
- Wuhan Neuracom Technology Development Co., Ltd, Wuhan, 430200, China
| | - Chang-Mao Ni
- Wuhan Neuracom Technology Development Co., Ltd, Wuhan, 430200, China
| | - Li Huang
- Wuhan Neuracom Technology Development Co., Ltd, Wuhan, 430200, China.
| | - Zhe-Wei Ye
- Intelligent Medical Laboratory, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China.
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China.
| |
Collapse
|
7
|
Lin RR, Zhang K. Survey of real-time brainmedia in artistic exploration. Vis Comput Ind Biomed Art 2024; 7:27. [PMID: 39551888 PMCID: PMC11570570 DOI: 10.1186/s42492-024-00179-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2024] [Accepted: 10/29/2024] [Indexed: 11/19/2024] Open
Abstract
This survey examines the evolution and impact of real-time brainmedia on artistic exploration, contextualizing developments within a historical framework. To enhance knowledge on the entanglement between the brain, mind, and body in an increasingly mediated world, this work defines a clear scope at the intersection of bio art and interactive art, concentrating on real-time brainmedia artworks developed in the 21st century. It proposes a set of criteria and a taxonomy based on historical notions, interaction dynamics, and media art representations. The goal is to provide a comprehensive overview of real-time brainmedia, setting the stage for future explorations of new paradigms in communication between humans, machines, and the environment.
Collapse
Affiliation(s)
- Rem RunGu Lin
- Computational Media and Art, Hong Kong University of Science and Technology (Guangzhou), Guangzhou 510000, Guangdong, China
| | - Kang Zhang
- Computational Media and Art, Hong Kong University of Science and Technology (Guangzhou), Guangzhou 510000, Guangdong, China.
| |
Collapse
|
8
|
Zhao X, Xu S, Geng K, Zhou T, Xu T, Wang Z, Feng S, Hu H. MP: A steady-state visual evoked potential dataset based on multiple paradigms. iScience 2024; 27:111030. [PMID: 39759080 PMCID: PMC11700636 DOI: 10.1016/j.isci.2024.111030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2024] [Revised: 08/27/2024] [Accepted: 09/10/2024] [Indexed: 01/07/2025] Open
Abstract
In the field of steady-state visual evoked potential (SSVEP), stimulus paradigms are regularly arranged or mimic the style of a keyboard with the same size. However, stimulation paradigms have important effects on the performance of SSVEP systems, which correlate with the electroencephalogram (EEG) signal amplitude and recognition accuracy. This paper provides MP dataset that was acquired using a 12-target BCI speller. MP dataset contains 9-channel EEG signals from the occipital region of 24 subjects under 5 stimulation paradigms with different stimulus sizes and arrangements. Stimuli were encoded using joint frequency and phase modulation (JFPM) method. Subjects completed an offline prompted spelling task using a speller under 5 paradigms. Each experiment contains 8 blocks, and each block contains 12 trials. Designers can use this dataset to test the performance of algorithms considering "stimulus size" and "stimulus arrangement". EEG data showed SSVEP features through amplitude-frequency analysis. FBCCA and TRCA confirmed its suitability.
Collapse
Affiliation(s)
- Xi Zhao
- School of Microelectronics, Shanghai University, Shanghai 200444, China
| | - Shencheng Xu
- School of Microelectronics, Shanghai University, Shanghai 200444, China
| | - Kexing Geng
- School of Microelectronics, Shanghai University, Shanghai 200444, China
| | - Ting Zhou
- School of Microelectronics, Shanghai University, Shanghai 200444, China
| | - Tianheng Xu
- Shanghai Advanced Research Institute, Chinese Academy of Sciences, Shanghai 201210, China
| | - Zhenyu Wang
- Shanghai Advanced Research Institute, Chinese Academy of Sciences, Shanghai 201210, China
| | - Shilun Feng
- State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China
| | - Honglin Hu
- Shanghai Advanced Research Institute, Chinese Academy of Sciences, Shanghai 201210, China
- School of Information Science and Technology, Shanghai Tech University, Shanghai 201210, China
| |
Collapse
|
9
|
Hou Z, Li X, Yang J, Xu SY. Enhancing mathematical learning outcomes through a low-cost single-channel BCI system. NPJ SCIENCE OF LEARNING 2024; 9:65. [PMID: 39528522 PMCID: PMC11555232 DOI: 10.1038/s41539-024-00277-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/02/2024] [Accepted: 10/22/2024] [Indexed: 11/16/2024]
Abstract
This study investigates the effectiveness of a Low-Cost Single-Channel BCI system in improving mathematical learning outcomes, self-efficacy, and alpha power in university students. Eighty participants were randomly assigned to either a BCI group receiving real-time neurofeedback based on alpha rhythms or a sham feedback group. Results showed that the BCI group had significantly higher mathematical performance, self-efficacy, and alpha power compared to the sham feedback group. Mathematics performance, alpha wave intensity, and self-efficacy showed significant positive correlations after training, indicating that neurofeedback training may have promoted their interaction and integration. These findings demonstrate the potential of BCI technology in enhancing mathematical learning outcomes and highlight the importance of considering pre-test performance and self-efficacy in predicting learning outcomes, with implications for personalized learning interventions and the integration of BCI technology in educational settings.
Collapse
Affiliation(s)
- Zhe Hou
- Department of Psychology, Wuhan University, Wuhan, China
| | - Xiang Li
- Faculty of Education Science, Shanxi Normal University, Taiyuan, China
| | - Jiawen Yang
- Faculty of Education Science, Shanxi Normal University, Taiyuan, China
| | - Shi Yang Xu
- Faculty of Education Science, Shanxi Normal University, Taiyuan, China.
| |
Collapse
|
10
|
Jin W, Zhu X, Qian L, Wu C, Yang F, Zhan D, Kang Z, Luo K, Meng D, Xu G. Electroencephalogram-based adaptive closed-loop brain-computer interface in neurorehabilitation: a review. Front Comput Neurosci 2024; 18:1431815. [PMID: 39371523 PMCID: PMC11449715 DOI: 10.3389/fncom.2024.1431815] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2024] [Accepted: 09/10/2024] [Indexed: 10/08/2024] Open
Abstract
Brain-computer interfaces (BCIs) represent a groundbreaking approach to enabling direct communication for individuals with severe motor impairments, circumventing traditional neural and muscular pathways. Among the diverse array of BCI technologies, electroencephalogram (EEG)-based systems are particularly favored due to their non-invasive nature, user-friendly operation, and cost-effectiveness. Recent advancements have facilitated the development of adaptive bidirectional closed-loop BCIs, which dynamically adjust to users' brain activity, thereby enhancing responsiveness and efficacy in neurorehabilitation. These systems support real-time modulation and continuous feedback, fostering personalized therapeutic interventions that align with users' neural and behavioral responses. By incorporating machine learning algorithms, these BCIs optimize user interaction and promote recovery outcomes through mechanisms of activity-dependent neuroplasticity. This paper reviews the current landscape of EEG-based adaptive bidirectional closed-loop BCIs, examining their applications in the recovery of motor and sensory functions, as well as the challenges encountered in practical implementation. The findings underscore the potential of these technologies to significantly enhance patients' quality of life and social interaction, while also identifying critical areas for future research aimed at improving system adaptability and performance. As advancements in artificial intelligence continue, the evolution of sophisticated BCI systems holds promise for transforming neurorehabilitation and expanding applications across various domains.
Collapse
Affiliation(s)
- Wenjie Jin
- Department of Rehabilitation Medicine, Nanjing Medical University, Nanjing, China
- Rehabilitation Medicine Center, Zhejiang Chinese Medical University Affiliated Jiaxing TCM Hospital, Jiaxing, China
| | - XinXin Zhu
- Rehabilitation Medicine Center, Zhejiang Chinese Medical University Affiliated Jiaxing TCM Hospital, Jiaxing, China
| | - Lifeng Qian
- Rehabilitation Medicine Center, Zhejiang Chinese Medical University Affiliated Jiaxing TCM Hospital, Jiaxing, China
| | - Cunshu Wu
- Department of Rehabilitation Medicine, Nanjing Medical University, Nanjing, China
| | - Fan Yang
- Rehabilitation Medicine Center, Zhejiang Chinese Medical University Affiliated Jiaxing TCM Hospital, Jiaxing, China
| | - Daowei Zhan
- Rehabilitation Medicine Center, Zhejiang Chinese Medical University Affiliated Jiaxing TCM Hospital, Jiaxing, China
| | - Zhaoyin Kang
- Rehabilitation Medicine Center, Zhejiang Chinese Medical University Affiliated Jiaxing TCM Hospital, Jiaxing, China
| | - Kaitao Luo
- Rehabilitation Medicine Center, Zhejiang Chinese Medical University Affiliated Jiaxing TCM Hospital, Jiaxing, China
| | - Dianhuai Meng
- Department of Rehabilitation Medicine, Nanjing Medical University, Nanjing, China
- Rehabilitation Medicine Center, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - Guangxu Xu
- Department of Rehabilitation Medicine, Nanjing Medical University, Nanjing, China
- Rehabilitation Medicine Center, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| |
Collapse
|
11
|
Awuah WA, Ahluwalia A, Darko K, Sanker V, Tan JK, Tenkorang PO, Ben-Jaafar A, Ranganathan S, Aderinto N, Mehta A, Shah MH, Lee Boon Chun K, Abdul-Rahman T, Atallah O. Bridging Minds and Machines: The Recent Advances of Brain-Computer Interfaces in Neurological and Neurosurgical Applications. World Neurosurg 2024; 189:138-153. [PMID: 38789029 DOI: 10.1016/j.wneu.2024.05.104] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2024] [Revised: 05/16/2024] [Accepted: 05/17/2024] [Indexed: 05/26/2024]
Abstract
Brain-computer interfaces (BCIs), a remarkable technological advancement in neurology and neurosurgery, mark a significant leap since the inception of electroencephalography in 1924. These interfaces effectively convert central nervous system signals into commands for external devices, offering revolutionary benefits to patients with severe communication and motor impairments due to a myriad of neurological conditions like stroke, spinal cord injuries, and neurodegenerative disorders. BCIs enable these individuals to communicate and interact with their environment, using their brain signals to operate interfaces for communication and environmental control. This technology is especially crucial for those completely locked in, providing a communication lifeline where other methods fall short. The advantages of BCIs are profound, offering autonomy and an improved quality of life for patients with severe disabilities. They allow for direct interaction with various devices and prostheses, bypassing damaged or nonfunctional neural pathways. However, challenges persist, including the complexity of accurately interpreting brain signals, the need for individual calibration, and ensuring reliable, long-term use. Additionally, ethical considerations arise regarding autonomy, consent, and the potential for dependence on technology. Despite these challenges, BCIs represent a transformative development in neurotechnology, promising enhanced patient outcomes and a deeper understanding of brain-machine interfaces.
Collapse
Affiliation(s)
| | - Arjun Ahluwalia
- School of Medicine, Queen's University Belfast, Belfast, United Kingdom
| | - Kwadwo Darko
- Department of Neurosurgery, Korle Bu Teaching Hospital, Accra, Ghana
| | - Vivek Sanker
- Department of Neurosurgery, Trivandrum Medical College, India
| | - Joecelyn Kirani Tan
- Faculty of Medicine, University of St Andrews, St. Andrews, Scotland, United Kingdom.
| | | | - Adam Ben-Jaafar
- University College Dublin, School of Medicine, Belfield, Dublin, Ireland
| | - Sruthi Ranganathan
- Department of Medicine, University of Cambridge, Cambridge, United Kingdom
| | - Nicholas Aderinto
- Internal Medicine Department, LAUTECH Teaching Hospital, Ogbomoso, Nigeria
| | - Aashna Mehta
- University of Debrecen-Faculty of Medicine, Debrecen, Hungary
| | | | | | | | - Oday Atallah
- Department of Neurosurgery, Hannover Medical School, Hannover, Germany
| |
Collapse
|
12
|
M AL, R R. Rehabilitation Based on BCI: An Innovative Enhancement for Sensorimotor Cortex Rhythms Systemization. Adv Biol (Weinh) 2024; 8:e2400004. [PMID: 38977410 DOI: 10.1002/adbi.202400004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Revised: 06/06/2024] [Indexed: 07/10/2024]
Abstract
The research proposes a novel strategy for categorizing electroencephalograms (EEG) in real-time brain-computer interfaces that have rehabilitation applications. The methodology utilizes Five Cross-Common Spatial Patterns (FCCSP) to develop a motor movement/imagery systemization model that extracts multi-domain characteristics with excellent performance. The goal is to eliminate the impact caused by EEG's nonstationarity. The article highlights the findings of a real-time technique that is incorporated into a comprehensive prediction system, and it offers an innovative method to boost accuracy in real-time Sensory-Motor cortex Rhythms (SMR). The accuracy increased from 57.14% using raw EEG to 85.71% after preprocessing, and from 58.08% to 97.94% in public domain SMR. The proposed Butterworth bandpass filter is optimized using the FCCSP to determine the ideal bandwidth that incorporates the whole EEG features in beta waves. The Hybrid Systemization of the Correlated Feature Removal classifier is then integrated with the FCCSP method to create improved predictive models. As a consequence, while applied to real-time and PhysioNet datasets, the outcome system achieved outstanding accuracy values of 85.71% and 97.94%, respectively. This demonstrates the robustness of the strategy to increase SMR prediction efficiency.
Collapse
Affiliation(s)
- Anna Latha M
- Vellore Institute of Technology, Chennai, Tamil Nadu, 600127, India
| | - Ramesh R
- Vellore Institute of Technology, Chennai, Tamil Nadu, 600127, India
| |
Collapse
|
13
|
Bunterngchit C, Wang J, Hou ZG. Simultaneous EEG-fNIRS Data Classification Through Selective Channel Representation and Spectrogram Imaging. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2024; 12:600-612. [PMID: 39247844 PMCID: PMC11379445 DOI: 10.1109/jtehm.2024.3448457] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/17/2024] [Revised: 07/02/2024] [Accepted: 08/20/2024] [Indexed: 09/10/2024]
Abstract
The integration of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) can facilitate the advancement of brain-computer interfaces (BCIs). However, existing research in this domain has grappled with the challenge of the efficient selection of features, resulting in the underutilization of the temporal richness of EEG and the spatial specificity of fNIRS data.To effectively address this challenge, this study proposed a deep learning architecture called the multimodal DenseNet fusion (MDNF) model that was trained on two-dimensional (2D) EEG data images, leveraging advanced feature extraction techniques. The model transformed EEG data into 2D images using a short-time Fourier transform, applied transfer learning to extract discriminative features, and consequently integrated them with fNIRS-derived spectral entropy features. This approach aimed to bridge existing gaps in EEG-fNIRS-based BCI research by enhancing classification accuracy and versatility across various cognitive and motor imagery tasks.Experimental results on two public datasets demonstrated the superiority of our model over existing state-of-the-art methods.Thus, the high accuracy and precise feature utilization of the MDNF model demonstrates the potential in clinical applications for neurodiagnostics and rehabilitation, thereby paving the method for patient-specific therapeutic strategies.
Collapse
Affiliation(s)
- Chayut Bunterngchit
- State Key Laboratory of Multimodal Artificial Intelligence SystemsInstitute of Automation, Chinese Academy of SciencesBeijing100190China
- School of Artificial IntelligenceUniversity of Chinese Academy of SciencesBeijing100049China
| | - Jiaxing Wang
- State Key Laboratory of Multimodal Artificial Intelligence SystemsInstitute of Automation, Chinese Academy of SciencesBeijing100190China
| | - Zeng-Guang Hou
- State Key Laboratory of Multimodal Artificial Intelligence SystemsInstitute of Automation, Chinese Academy of SciencesBeijing100190China
| |
Collapse
|
14
|
Dillen A, Omidi M, Ghaffari F, Romain O, Vanderborght B, Roelands B, Nowé A, De Pauw K. User Evaluation of a Shared Robot Control System Combining BCI and Eye Tracking in a Portable Augmented Reality User Interface. SENSORS (BASEL, SWITZERLAND) 2024; 24:5253. [PMID: 39204948 PMCID: PMC11359122 DOI: 10.3390/s24165253] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/13/2024] [Revised: 08/02/2024] [Accepted: 08/09/2024] [Indexed: 09/04/2024]
Abstract
This study evaluates an innovative control approach to assistive robotics by integrating brain-computer interface (BCI) technology and eye tracking into a shared control system for a mobile augmented reality user interface. Aimed at enhancing the autonomy of individuals with physical disabilities, particularly those with impaired motor function due to conditions such as stroke, the system utilizes BCI to interpret user intentions from electroencephalography signals and eye tracking to identify the object of focus, thus refining control commands. This integration seeks to create a more intuitive and responsive assistive robot control strategy. The real-world usability was evaluated, demonstrating significant potential to improve autonomy for individuals with severe motor impairments. The control system was compared with an eye-tracking-based alternative to identify areas needing improvement. Although BCI achieved an acceptable success rate of 0.83 in the final phase, eye tracking was more effective with a perfect success rate and consistently lower completion times (p<0.001). The user experience responses favored eye tracking in 11 out of 26 questions, with no significant differences in the remaining questions, and subjective fatigue was higher with BCI use (p=0.04). While BCI performance lagged behind eye tracking, the user evaluation supports the validity of our control strategy, showing that it could be deployed in real-world conditions and suggesting a pathway for further advancements.
Collapse
Affiliation(s)
- Arnau Dillen
- Human Physiology and Sports Physiotherapy Research Group, Vrije Universiteit Brussel, 1050 Brussels, Belgium
- Equipes Traitement de l’Information et Systèmes, UMR 8051, CY Cergy Paris Université, École Nationale Supérieure de l’Electronique et de ses Applications (ENSEA), Centre National de la Recherche Scientifique (CNRS), 95000 Cergy, France; (F.G.); (O.R.)
- Brussels Human Robotics Research Center (BruBotics), Vrije Universiteit Brussel, 1050 Brussels, Belgium; (M.O.); (B.V.)
| | - Mohsen Omidi
- Brussels Human Robotics Research Center (BruBotics), Vrije Universiteit Brussel, 1050 Brussels, Belgium; (M.O.); (B.V.)
- IMEC, 1050 Brussels, Belgium
| | - Fakhreddine Ghaffari
- Equipes Traitement de l’Information et Systèmes, UMR 8051, CY Cergy Paris Université, École Nationale Supérieure de l’Electronique et de ses Applications (ENSEA), Centre National de la Recherche Scientifique (CNRS), 95000 Cergy, France; (F.G.); (O.R.)
| | - Olivier Romain
- Equipes Traitement de l’Information et Systèmes, UMR 8051, CY Cergy Paris Université, École Nationale Supérieure de l’Electronique et de ses Applications (ENSEA), Centre National de la Recherche Scientifique (CNRS), 95000 Cergy, France; (F.G.); (O.R.)
| | - Bram Vanderborght
- Brussels Human Robotics Research Center (BruBotics), Vrije Universiteit Brussel, 1050 Brussels, Belgium; (M.O.); (B.V.)
- IMEC, 1050 Brussels, Belgium
| | - Bart Roelands
- Human Physiology and Sports Physiotherapy Research Group, Vrije Universiteit Brussel, 1050 Brussels, Belgium
- Brussels Human Robotics Research Center (BruBotics), Vrije Universiteit Brussel, 1050 Brussels, Belgium; (M.O.); (B.V.)
| | - Ann Nowé
- Artificial Intelligence Lab, Vrije Universiteit Brussel, 1050 Brussels, Belgium
| | - Kevin De Pauw
- Human Physiology and Sports Physiotherapy Research Group, Vrije Universiteit Brussel, 1050 Brussels, Belgium
- Brussels Human Robotics Research Center (BruBotics), Vrije Universiteit Brussel, 1050 Brussels, Belgium; (M.O.); (B.V.)
| |
Collapse
|
15
|
Tang F, Yan F, Zhong Y, Li J, Gong H, Li X. Optogenetic Brain-Computer Interfaces. Bioengineering (Basel) 2024; 11:821. [PMID: 39199779 PMCID: PMC11351350 DOI: 10.3390/bioengineering11080821] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2024] [Revised: 07/23/2024] [Accepted: 07/24/2024] [Indexed: 09/01/2024] Open
Abstract
The brain-computer interface (BCI) is one of the most powerful tools in neuroscience and generally includes a recording system, a processor system, and a stimulation system. Optogenetics has the advantages of bidirectional regulation, high spatiotemporal resolution, and cell-specific regulation, which expands the application scenarios of BCIs. In recent years, optogenetic BCIs have become widely used in the lab with the development of materials and software. The systems were designed to be more integrated, lightweight, biocompatible, and power efficient, as were the wireless transmission and chip-level embedded BCIs. The software is also constantly improving, with better real-time performance and accuracy and lower power consumption. On the other hand, as a cutting-edge technology spanning multidisciplinary fields including molecular biology, neuroscience, material engineering, and information processing, optogenetic BCIs have great application potential in neural decoding, enhancing brain function, and treating neural diseases. Here, we review the development and application of optogenetic BCIs. In the future, combined with other functional imaging techniques such as near-infrared spectroscopy (fNIRS) and functional magnetic resonance imaging (fMRI), optogenetic BCIs can modulate the function of specific circuits, facilitate neurological rehabilitation, assist perception, establish a brain-to-brain interface, and be applied in wider application scenarios.
Collapse
Affiliation(s)
- Feifang Tang
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, MoE Key Laboratory for Biomedical Photonics, Huazhong University of Science and Technology, Wuhan 430074, China; (F.T.); (F.Y.); (Y.Z.); (J.L.); (H.G.)
| | - Feiyang Yan
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, MoE Key Laboratory for Biomedical Photonics, Huazhong University of Science and Technology, Wuhan 430074, China; (F.T.); (F.Y.); (Y.Z.); (J.L.); (H.G.)
| | - Yushan Zhong
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, MoE Key Laboratory for Biomedical Photonics, Huazhong University of Science and Technology, Wuhan 430074, China; (F.T.); (F.Y.); (Y.Z.); (J.L.); (H.G.)
| | - Jinqian Li
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, MoE Key Laboratory for Biomedical Photonics, Huazhong University of Science and Technology, Wuhan 430074, China; (F.T.); (F.Y.); (Y.Z.); (J.L.); (H.G.)
| | - Hui Gong
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, MoE Key Laboratory for Biomedical Photonics, Huazhong University of Science and Technology, Wuhan 430074, China; (F.T.); (F.Y.); (Y.Z.); (J.L.); (H.G.)
| | - Xiangning Li
- Key Laboratory of Biomedical Engineering of Hainan Province, School of Biomedical Engineering, Hainan University, Haikou 570228, China
| |
Collapse
|
16
|
Vakilipour P, Fekrvand S. Brain-to-brain interface technology: A brief history, current state, and future goals. Int J Dev Neurosci 2024; 84:351-367. [PMID: 38711277 DOI: 10.1002/jdn.10334] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Revised: 04/05/2024] [Accepted: 04/18/2024] [Indexed: 05/08/2024] Open
Abstract
A brain-to-brain interface (BBI), defined as a combination of neuroimaging and neurostimulation methods to extract and deliver information between brains directly without the need for the peripheral nervous system, is a budding communication technique. A BBI system is made up of two parts known as the brain-computer interface part, which reads a sender's brain activity and digitalizes it, and the computer-brain interface part, which writes the delivered brain activity to a receiving brain. As with other technologies, BBI systems have gone through an evolutionary process since they first appeared. The BBI systems have been employed for numerous purposes, including rehabilitation for post-stroke patients, communicating with patients suffering from amyotrophic lateral sclerosis, locked-in syndrome and speech problems following stroke. Also, it has been proposed that a BBI system could play an important role on future battlefields. This technology was not only employed for communicating between two human brains but also for making a direct communication path among different species through which motor or sensory commands could be sent and received. However, the application of BBI systems has provoked significant challenges to human rights principles due to their ability to access and manipulate human brain information. In this study, we aimed to review the brain-computer interface and computer-brain interface technologies as components of BBI systems, the development of BBI systems, applications of this technology, arising ethical issues and expectations for future use.
Collapse
Affiliation(s)
- Pouya Vakilipour
- Student Research Committee, Tabriz University of Medical Sciences, Tabriz, Iran
- Universal Scientific Education and Research Network (USERN), Tehran, Iran
| | - Saba Fekrvand
- Universal Scientific Education and Research Network (USERN), Tehran, Iran
- Brain and Spinal Cord Injury Research Center, Neuroscience Institute, Tehran University of Medical Sciences, Tehran, Iran
| |
Collapse
|
17
|
Schwartze KC, Lee WH, Rouse AG. Initial and corrective submovement encoding differences within primary motor cortex during precision reaching. J Neurophysiol 2024; 132:433-445. [PMID: 38985937 PMCID: PMC11427045 DOI: 10.1152/jn.00269.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Revised: 06/28/2024] [Accepted: 07/01/2024] [Indexed: 07/12/2024] Open
Abstract
Precision reaching often requires corrective submovements to obtain the desired goal. Most studies of reaching have focused on single initial movements, and implied the cortical encoding model was the same for all submovements. However, corrective submovements may show different encoding patterns from the initial submovement with distinct patterns of activation across the population. Two rhesus macaques performed a precision center-out-task with small targets. Neural activity from single units in the primary motor cortex and associated behavioral data were recorded to evaluate movement characteristics. Neural population data and individual neuronal firing rates identified with a peak finding algorithm to identify peaks in hand speed were examined for encoding differences between initial and corrective submovements. Individual neurons were fitted with a regression model that included the reach vector, position, and speed to predict firing rate. For both initial and corrective submovements, the largest effect remained movement direction. We observed a large subset changed their preferred direction greater than 45° between initial and corrective submovements. Neuronal depth of modulation also showed considerable variation when adjusted for movement speed. By using principal component analysis, neural trajectories of initial and corrective submovements progressed through different neural subspaces. These findings all suggest that different neural encoding patterns exist for initial and corrective submovements within the cortex. We hypothesize that this variation in how neurons change to encode small, corrective submovements might allow for a larger portion of the neural space being used to encode a greater range of movements with varying amplitudes and levels of precision.NEW & NOTEWORTHY Neuronal recordings matched with kinematic behavior were collected in a precision center-out task that often required corrective movements. We reveal large differences in preferred direction and depth of modulation between initial and corrective submovements across the neural population. We then present a model of the neural population describing how these shifts in tuning create different subspaces for signaling initial and corrective movements likely to improve motor precision.
Collapse
Affiliation(s)
- Kevin C Schwartze
- Department of Neurosurgery, University of Kansas Medical Center, Kansas City, Kansas, United States
- Department of Cell Biology and Physiology, University of Kansas Medical Center, Kansas City, Kansas, United States
| | - Wei-Hsien Lee
- Department of Neurosurgery, University of Kansas Medical Center, Kansas City, Kansas, United States
- Bioengineering Program, University of Kansas, Lawrence, Kansas, United States
| | - Adam G Rouse
- Department of Neurosurgery, University of Kansas Medical Center, Kansas City, Kansas, United States
- Department of Cell Biology and Physiology, University of Kansas Medical Center, Kansas City, Kansas, United States
- Bioengineering Program, University of Kansas, Lawrence, Kansas, United States
- Department of Electrical Engineering and Computer Science, University of Kansas, Lawrence, Kansas, United States
| |
Collapse
|
18
|
Kilani S, Aghili SN, Fathi Y, Sburlea AI. Optimization of transfer learning based on source sample selection in Euclidean space for P300-based brain-computer interfaces. Front Neurosci 2024; 18:1360709. [PMID: 39071181 PMCID: PMC11272559 DOI: 10.3389/fnins.2024.1360709] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2023] [Accepted: 06/25/2024] [Indexed: 07/30/2024] Open
Abstract
Introduction Event-related potentials (ERPs), such as P300, are widely utilized for non-invasive monitoring of brain activity in brain-computer interfaces (BCIs) via electroencephalogram (EEG). However, the non-stationary nature of EEG signals and different data distributions among subjects create significant challenges for implementing real-time P300-based BCIs. This requires time-consuming calibration and a large number of training samples. Methods To address these challenges, this study proposes a transfer learning-based approach that uses a convolutional neural network for high-level feature extraction, followed by Euclidean space data alignment to ensure similar distributions of extracted features. Furthermore, a source selection technique based on the Euclidean distance metric was applied to measure the distance between each source feature sample and a reference point from the target domain. The samples with the lowest distance were then chosen to increase the similarity between source and target datasets. Finally, the transferred features are applied to a discriminative restricted Boltzmann machine classifier for P300 detection. Results The proposed method was evaluated on the state-of-the-art BCI Competition III dataset II and rapid serial visual presentation dataset. The results demonstrate that the proposed technique achieves an average accuracy of 97% for both online and offline after 15 repetitions, which is comparable to the state-of-the-art methods. Notably, the proposed approach requires <½ of the training samples needed by previous studies. Discussion Therefore, this technique offers an efficient solution for developing ERP-based BCIs with robust performance against reduced a number of training data.
Collapse
Affiliation(s)
- Sepideh Kilani
- Department of Biomedical Engineering, School of Electrical Engineering, Iran University of Science and Technology (IUST), Tehran, Iran
| | - Seyedeh Nadia Aghili
- Department of Biomedical Engineering, School of Electrical Engineering, Iran University of Science and Technology (IUST), Tehran, Iran
| | - Yaser Fathi
- Institute of Neuroscience, Universite Catholique de Louvain, Brussels, Belgium
| | - Andreea Ioana Sburlea
- Bernoulli Institute of Mathematics, Computer Science and Artificial Intelligence, Faculty of Science and Engineering, University of Groningen, Groningen, Netherlands
| |
Collapse
|
19
|
Falcon-Caro A, Shirani S, Ferreira JF, Bird JJ, Sanei S. Formulation of Common Spatial Patterns for Multi-Task Hyperscanning BCI. IEEE Trans Biomed Eng 2024; 71:1950-1957. [PMID: 38252565 DOI: 10.1109/tbme.2024.3356665] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2024]
Abstract
This work proposes a new formulation for common spatial patterns (CSP), often used as a powerful feature extraction technique in brain-computer interfacing (BCI) and other neurological studies. In this approach, applied to multiple subjects' data and named as hyperCSP, the individual covariance and mutual correlation matrices between multiple simultaneously recorded subjects' electroencephalograms are exploited in the CSP formulation. This method aims at effectively isolating the common motor task between multiple heads and alleviate the effects of other spurious or undesired tasks inherently or intentionally performed by the subjects. This technique can provide a satisfactory classification performance while using small data size and low computational complexity. By using the proposed hyperCSP followed by support vector machines classifier, we obtained a classification accuracy of 81.82% over 8 trials in the presence of strong undesired tasks. We hope that this method could reduce the training error in multi-task BCI scenarios. The recorded valuable motor-related hyperscanning dataset is available for public use to promote the research in this area.
Collapse
|
20
|
Kantawala B, Emir Hamitoglu A, Nohra L, Abdullahi Yusuf H, Jonathan Isaac K, Shariff S, Nazir A, Soju K, Yenkoyan K, Wojtara M, Uwishema O. Microengineered neuronal networks: enhancing brain-machine interfaces. Ann Med Surg (Lond) 2024; 86:3535-3542. [PMID: 38846893 PMCID: PMC11152794 DOI: 10.1097/ms9.0000000000002130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2023] [Accepted: 04/05/2024] [Indexed: 06/09/2024] Open
Abstract
The brain-machine interface (BMI), a crucial conduit between the human brain and computers, holds transformative potential for various applications in neuroscience. This manuscript explores the role of micro-engineered neuronal networks (MNNs) in advancing BMI technologies and their therapeutic applications. As the interdisciplinary collaboration intensifies, the need for innovative and user-friendly BMI technologies becomes paramount. A comprehensive literature review sourced from reputable databases (PubMed Central, Medline, EBSCOhost, and Google Scholar) aided in the foundation of the manuscript, emphasizing the pivotal role of MNNs. This study aims to synthesize and analyze the diverse facets of MNNs in the context of BMI technologies, contributing insights into neural processes, technological advancements, therapeutic potentials, and ethical considerations surrounding BMIs. MNNs, exemplified by dual-mode neural microelectrodes, offer a controlled platform for understanding complex neural processes. Through case studies, we showcase the pivotal role of MNNs in BMI innovation, addressing challenges, and paving the way for therapeutic applications. The integration of MNNs with BMI technologies marks a revolutionary stride in neuroscience, refining brain-computer interactions and offering therapeutic avenues for neurological disorders. Challenges, ethical considerations, and future trends in BMI research necessitate a balanced approach, leveraging interdisciplinary collaboration to ensure responsible and ethical advancements. Embracing the potential of MNNs is paramount for the betterment of individuals with neurological conditions and the broader community.
Collapse
Affiliation(s)
- Burhan Kantawala
- Oli Health Magazine Organization, Research and Education, Kigali, Rwanda
- Neuroscience Laboratory, Cobrain Centre, Yerevan State Medical University named after Mkhitar Heratsi, Yerevan, Armenia
| | - Ali Emir Hamitoglu
- Oli Health Magazine Organization, Research and Education, Kigali, Rwanda
- Faculty of Medicine, Namik Kemal University, Tekirdag, Turkey
| | - Lea Nohra
- Oli Health Magazine Organization, Research and Education, Kigali, Rwanda
- Faculty of Medical Science, Lebanese University, Beirut, Lebanon
| | - Hassan Abdullahi Yusuf
- Oli Health Magazine Organization, Research and Education, Kigali, Rwanda
- College of Health science, Faculty of Clinical Sciences Bayero University Kano, Nigeria
| | - Kirumira Jonathan Isaac
- Oli Health Magazine Organization, Research and Education, Kigali, Rwanda
- Faculty of Clinical Medicine and Dentistry, Kampala International University, Uganda
| | - Sanobar Shariff
- Oli Health Magazine Organization, Research and Education, Kigali, Rwanda
- Neuroscience Laboratory, Cobrain Centre, Yerevan State Medical University named after Mkhitar Heratsi, Yerevan, Armenia
| | - Abubakar Nazir
- Oli Health Magazine Organization, Research and Education, Kigali, Rwanda
- Department of Medicine, King Edward Medical University, Pakistan
| | - Kevin Soju
- Oli Health Magazine Organization, Research and Education, Kigali, Rwanda
- Faculty of Medicine, Christian Medical College, Ludhiana, India
| | - Konstantin Yenkoyan
- Neuroscience Laboratory, Cobrain Centre, Yerevan State Medical University named after Mkhitar Heratsi, Yerevan, Armenia
- Department of Biochemistry, Yerevan State Medical University named after Mkhitar Heratsi, Yerevan, Armenia
| | - Magda Wojtara
- Oli Health Magazine Organization, Research and Education, Kigali, Rwanda
| | - Olivier Uwishema
- Oli Health Magazine Organization, Research and Education, Kigali, Rwanda
| |
Collapse
|
21
|
Porte L, Boucheix JM, Rapet L, Drai-Zerbib V, Martinez JL. Immersive virtual reality for learning about ecosystems: effect of two signaling levels and feedback on action decisions. Front Psychol 2024; 15:1359071. [PMID: 38725951 PMCID: PMC11079815 DOI: 10.3389/fpsyg.2024.1359071] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Accepted: 03/22/2024] [Indexed: 05/12/2024] Open
Abstract
Introduction The goal of the present study was to test the effect of signaling associated with feed-back in learning forest ecosystems in the context of realistic living forest simulator, in IVR conditions for students in agriculture. Two signaling modalities, corresponding to two signaling levels, were investigated: visual flashing of forest elements (tree species, plants, flowers, fungi, wet-areas etc.) and marker-stones, both with text in pop-up windows, in a 2x2 experimental plan. Methods Ninety-three pupils of an agricultural technological high school had to explore (including physically), interrogate (search for) and select (using the joysticks) relevant elements of the forest in three living forest areas (visually delimited inside of a broader forest area) in order to choose (and justify) the best area, among the three, in which an equipped public-tourist reception site (picnic, resting, reception site) could be built. The chosen site must have the least possible negative impact on the ecosystem of the forest and its development over time. After their decision (and justification) they were provided a feed-back with a series of VR desktop multimedia slides showing the effect of this choice on the ecosystem of the chosen area. After the feed-back they had to decide and justify again whether they would change or maintain their first decision. Finally, subjective scales were also used in order to investigate presence, cognitive complexity, sickness and overall enjoyment. Results and discussion Results showed significant positive effects of both signaling levels, and of the feed-back on the correct decision answers. Further, the combination, and interaction, between signaling and feedback seemed to enhance, the activation and retrieval from memory, of the task-relevant concepts. In addition, the results indicated a significant positive effect (medium size) of presence on decision performances, a finding which is consistent with the immersion principle.
Collapse
Affiliation(s)
- Laurie Porte
- LEAD-CNRS, University of Bourgogne, Dijon, France
| | | | - Louis Rapet
- Arts et Métiers, Institute of Technology, LISPEN, HESAM University, Chalon sur Saône, France
| | | | - Jean-Luc Martinez
- Arts et Métiers, Institute of Technology, LISPEN, HESAM University, Chalon sur Saône, France
| |
Collapse
|
22
|
Khan AYY, Anjum A. Ethical tightrope: Navigating neuro-ethics in brain computer interface (BCI) technology. BRAIN & SPINE 2024; 4:102800. [PMID: 38584867 PMCID: PMC10995966 DOI: 10.1016/j.bas.2024.102800] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/27/2024] [Accepted: 03/31/2024] [Indexed: 04/09/2024]
Affiliation(s)
| | - Ammar Anjum
- Akhtar Saeed Trust Hospital, Lahore, Pakistan
| |
Collapse
|
23
|
Chen Y, Wang F, Li T, Zhao L, Gong A, Nan W, Ding P, Fu Y. Several inaccurate or erroneous conceptions and misleading propaganda about brain-computer interfaces. Front Hum Neurosci 2024; 18:1391550. [PMID: 38601800 PMCID: PMC11004276 DOI: 10.3389/fnhum.2024.1391550] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2024] [Accepted: 03/18/2024] [Indexed: 04/12/2024] Open
Abstract
Brain-computer interface (BCI) is a revolutionizing human-computer interaction, which has potential applications for specific individuals or groups in specific scenarios. Extensive research has been conducted on the principles and implementation methods of BCI, and efforts are currently being made to bridge the gap from research to real-world applications. However, there are inaccurate or erroneous conceptions about BCI among some members of the public, and certain media outlets, as well as some BCI researchers, developers, manufacturers, and regulators, propagate misleading or overhyped claims about BCI technology. Therefore, this article summarizes the several misconceptions and misleading propaganda about BCI, including BCI being capable of "mind-controlled," "controlling brain," "mind reading," and the ability to "download" or "upload" information from or to the brain using BCI, among others. Finally, the limitations (shortcomings) and limits (boundaries) of BCI, as well as the necessity of conducting research aimed at countering BCI systems are discussed, and several suggestions are offered to reduce misconceptions and misleading claims about BCI.
Collapse
Affiliation(s)
- Yanxiao Chen
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Fan Wang
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Tianwen Li
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
- Faculty of Science, Kunming University of Science and Technology, Kunming, China
| | - Lei Zhao
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
- Faculty of Science, Kunming University of Science and Technology, Kunming, China
| | - Anmin Gong
- School of Information Engineering, Chinese People’s Armed Police Force Engineering University, Xi’an, China
| | - Wenya Nan
- Department of Psychology, School of Education, Shanghai Normal University, Shanghai, China
| | - Peng Ding
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Yunfa Fu
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| |
Collapse
|
24
|
Ma R, Chen YF, Jiang YC, Zhang M. A New Compound-Limbs Paradigm: Integrating Upper-Limb Swing Improves Lower-Limb Stepping Intention Decoding From EEG. IEEE Trans Neural Syst Rehabil Eng 2023; 31:3823-3834. [PMID: 37713229 DOI: 10.1109/tnsre.2023.3315717] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/16/2023]
Abstract
Brain-computer interface (BCI) systems based on spontaneous electroencephalography (EEG) hold the promise to implement human voluntary control of lower-extremity powered exoskeletons. However, current EEG-BCI paradigms do not consider the cooperation of upper and lower limbs during walking, which is inconsistent with natural human stepping patterns. To deal with this problem, this study proposed a stepping-matched human EEG-BCI paradigm that involved actions of both unilateral lower and contralateral upper limbs (also referred to as compound-limbs movement). Experiments were conducted in motor execution (ME) and motor imagery (MI) conditions to validate the feasibility. Common spatial pattern (CSP) proposed subject-specific CSP (SSCSP), and filter-bank CSP (FBCSP) methods were applied for feature extraction, respectively. The best average classification results based on SSCSP indicated that the accuracies of compound-limbs paradigms in ME and MI conditions achieved 89.02% ± 12.84% and 73.70% ± 12.47%, respectively. Although they were 2.03% and 5.68% lower than those of the single-upper-limb mode that does not match human stepping patterns, they were 24.30% and 11.02% higher than those of the single-lower-limb mode. These findings indicated that the proposed compound-limbs EEG-BCI paradigm is feasible for decoding human stepping intention and thus provides a potential way for natural human control of walking assistance devices.
Collapse
|
25
|
Karikari E, Koshechkin KA. Review on brain-computer interface technologies in healthcare. Biophys Rev 2023; 15:1351-1358. [PMID: 37974976 PMCID: PMC10643750 DOI: 10.1007/s12551-023-01138-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Accepted: 08/31/2023] [Indexed: 11/19/2023] Open
Abstract
Brain-computer interface (BCI) technologies have developed as a game changer, altering how humans interact with computers and opening up new avenues for understanding and utilizing the power of the human brain. The goal of this research study is to assess recent breakthroughs in BCI technologies and their future prospects. The paper starts with an outline of the fundamental concepts and principles that underpin BCI technologies. It examines the many forms of BCIs, including as invasive, partially invasive, and non-invasive interfaces, emphasizing their advantages and disadvantages. The progress of BCI hardware and signal processing techniques is investigated, with a focus on the shift from bulky and invasive systems to more portable and user-friendly options. Following that, the article delves into the important advances in BCI applications across several fields. It investigates the use of BCIs in healthcare, particularly in neurorehabilitation, assistive technology, and cognitive enhancement. BCIs' potential for boosting human capacities such as communication, motor control, and sensory perception is being thoroughly researched. Furthermore, the article investigates developing BCI applications in gaming, entertainment, and virtual reality, demonstrating how BCI technologies are growing outside medical and therapeutic settings. The study also gives light on the problems and limits that prevent BCIs from being widely adopted. Ethical concerns about privacy, data security, and informed permission are addressed, highlighting the importance of strong legislative frameworks to enable responsible and ethical usage of BCI technologies. Furthermore, the study delves into technological issues such as increasing signal resolution and precision, increasing system reliability, and enabling smooth connection with existing technology. Finally, this study paper gives an in-depth examination of the advances and future possibilities of BCI technologies. It emphasizes the transformative influence of BCIs on human-computer interaction and their potential to alter healthcare, gaming, and other industries. This research intends to stimulate further innovation and progress in the field of brain-computer interfaces by addressing problems and imagining future possibilities.
Collapse
Affiliation(s)
- Evelyn Karikari
- Department of Public Health and Healthcare, I.M. Sechenov First Moscow State Medical University, Moscow, Russia
| | - Konstantin A. Koshechkin
- The Digital Health Institute, I.M. Sechenov First Moscow State Medical University, Moscow, Russia
| |
Collapse
|
26
|
Lugo ZR, Cinel C, Jeunet C, Pichiorri F, Riccio A, Wriessnegger SC. Editorial: Women in brain-computer interfaces. Front Hum Neurosci 2023; 17:1260479. [PMID: 37674934 PMCID: PMC10478244 DOI: 10.3389/fnhum.2023.1260479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Accepted: 08/08/2023] [Indexed: 09/08/2023] Open
Affiliation(s)
- Zulay R. Lugo
- Department of Neurology, University Hospital of Caracas, Caracas, Venezuela
- Civil Association-Clinic Dispensary Padre Machado, Caracas, Venezuela
| | | | - Camille Jeunet
- UMR5287, Aquitaine Institute for Cognitive and Integrative Neuroscience (INCIA), Bordeaux, France
| | | | | | | |
Collapse
|
27
|
Peksa J, Mamchur D. State-of-the-Art on Brain-Computer Interface Technology. SENSORS (BASEL, SWITZERLAND) 2023; 23:6001. [PMID: 37447849 DOI: 10.3390/s23136001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Revised: 06/23/2023] [Accepted: 06/26/2023] [Indexed: 07/15/2023]
Abstract
This paper provides a comprehensive overview of the state-of-the-art in brain-computer interfaces (BCI). It begins by providing an introduction to BCIs, describing their main operation principles and most widely used platforms. The paper then examines the various components of a BCI system, such as hardware, software, and signal processing algorithms. Finally, it looks at current trends in research related to BCI use for medical, educational, and other purposes, as well as potential future applications of this technology. The paper concludes by highlighting some key challenges that still need to be addressed before widespread adoption can occur. By presenting an up-to-date assessment of the state-of-the-art in BCI technology, this paper will provide valuable insight into where this field is heading in terms of progress and innovation.
Collapse
Affiliation(s)
- Janis Peksa
- Department of Information Technologies, Turiba University, Graudu Street 68, LV-1058 Riga, Latvia
- Institute of Information Technology, Riga Technical University, Kalku Street 1, LV-1658 Riga, Latvia
| | - Dmytro Mamchur
- Department of Information Technologies, Turiba University, Graudu Street 68, LV-1058 Riga, Latvia
- Computer Engineering and Electronics Department, Kremenchuk Mykhailo Ostrohradskyi National University, Pershotravneva 20, 39600 Kremenchuk, Ukraine
| |
Collapse
|
28
|
Sen O, Sheehan AM, Raman PR, Khara KS, Khalifa A, Chatterjee B. Machine-Learning Methods for Speech and Handwriting Detection Using Neural Signals: A Review. SENSORS (BASEL, SWITZERLAND) 2023; 23:5575. [PMID: 37420741 DOI: 10.3390/s23125575] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Revised: 06/09/2023] [Accepted: 06/12/2023] [Indexed: 07/09/2023]
Abstract
Brain-Computer Interfaces (BCIs) have become increasingly popular in recent years due to their potential applications in diverse fields, ranging from the medical sector (people with motor and/or communication disabilities), cognitive training, gaming, and Augmented Reality/Virtual Reality (AR/VR), among other areas. BCI which can decode and recognize neural signals involved in speech and handwriting has the potential to greatly assist individuals with severe motor impairments in their communication and interaction needs. Innovative and cutting-edge advancements in this field have the potential to develop a highly accessible and interactive communication platform for these people. The purpose of this review paper is to analyze the existing research on handwriting and speech recognition from neural signals. So that the new researchers who are interested in this field can gain thorough knowledge in this research area. The current research on neural signal-based recognition of handwriting and speech has been categorized into two main types: invasive and non-invasive studies. We have examined the latest papers on converting speech-activity-based neural signals and handwriting-activity-based neural signals into text data. The methods of extracting data from the brain have also been discussed in this review. Additionally, this review includes a brief summary of the datasets, preprocessing techniques, and methods used in these studies, which were published between 2014 and 2022. This review aims to provide a comprehensive summary of the methodologies used in the current literature on neural signal-based recognition of handwriting and speech. In essence, this article is intended to serve as a valuable resource for future researchers who wish to investigate neural signal-based machine-learning methods in their work.
Collapse
Affiliation(s)
- Ovishake Sen
- Department of ECE, University of Florida, Gainesville, FL 32611, USA
| | - Anna M Sheehan
- Department of ECE, University of Florida, Gainesville, FL 32611, USA
| | - Pranay R Raman
- Department of ECE, University of Florida, Gainesville, FL 32611, USA
| | - Kabir S Khara
- Department of ECE, University of Florida, Gainesville, FL 32611, USA
| | - Adam Khalifa
- Department of ECE, University of Florida, Gainesville, FL 32611, USA
| | | |
Collapse
|
29
|
Tayebi H, Azadnajafabad S, Maroufi SF, Pour-Rashidi A, Khorasanizadeh M, Faramarzi S, Slavin KV. Applications of brain-computer interfaces in neurodegenerative diseases. Neurosurg Rev 2023; 46:131. [PMID: 37256332 DOI: 10.1007/s10143-023-02038-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2023] [Revised: 05/06/2023] [Accepted: 05/23/2023] [Indexed: 06/01/2023]
Abstract
Brain-computer interfaces (BCIs) provide the central nervous system with channels of direct communication to the outside world, without having to go through the peripheral nervous system. Neurodegenerative diseases (NDs) are notoriously incurable and burdensome medical conditions that will result in progressive deterioration of the nervous system. The applications of BCIs in NDs have been studied for decades now through different approaches, resulting in a considerable amount of literature in all related areas. In this study, we begin by introducing BCIs and proceed by explaining the principles of BCI-based neurorehabilitation. Then, we go through four specific types of NDs, including amyotrophic lateral sclerosis, Parkinson's disease, Alzheimer's disease, and spinal muscular atrophy, and review some of the applications of BCIs in the neural rehabilitation of these diseases. We conclude with a discussion of the characteristics, challenges, and future possibilities of research in the field. Going through the uses of BCIs in NDs, we can see that approaches and strategies employed to tackle the wide range of limitations caused by NDs are numerous and diverse. Furthermore, NDs can fall under different categories based on the target area of neurodegeneration and thus require different methods of BCI-based rehabilitation. In recent years, neurotechnology companies have substantially invested in research on BCIs, focusing on commercializing BCIs and bringing BCI-based technologies from bench to bedside. This can mean the beginning of a new era for BCI-based neurorehabilitation, with an anticipated spike in interest among researchers, practitioners, engineers, and entrepreneurs alike.
Collapse
Affiliation(s)
- Hossein Tayebi
- Neurosurgical Research Network (NRN), Universal Scientific Education and Research Network (USERN), Tehran, Iran
- School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Sina Azadnajafabad
- Neurosurgical Research Network (NRN), Universal Scientific Education and Research Network (USERN), Tehran, Iran
- Department of Surgery, Tehran University of Medical Sciences, Tehran, Iran
| | - Seyed Farzad Maroufi
- Neurosurgical Research Network (NRN), Universal Scientific Education and Research Network (USERN), Tehran, Iran
- School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Ahmad Pour-Rashidi
- Neurosurgical Research Network (NRN), Universal Scientific Education and Research Network (USERN), Tehran, Iran
- Department of Neurosurgery, Sina Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - MirHojjat Khorasanizadeh
- Department of Neurosurgery, Mount Sinai Hospital, Icahn School of Medicine, New York City, NY, USA
| | | | - Konstantin V Slavin
- Department of Neurosurgery, University of Illinois at Chicago, Chicago, IL, 60612, USA.
| |
Collapse
|
30
|
He Y, Tang Z, Sun G, Cai C, Wang Y, Yang G, Bao Z. Effectiveness of a Mindfulness Meditation App Based on an Electroencephalography-Based Brain-Computer Interface in Radiofrequency Catheter Ablation for Patients With Atrial Fibrillation: Pilot Randomized Controlled Trial. JMIR Mhealth Uhealth 2023; 11:e44855. [PMID: 37133926 DOI: 10.2196/44855] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Revised: 03/28/2023] [Accepted: 04/13/2023] [Indexed: 05/04/2023] Open
Abstract
BACKGROUND Radiofrequency catheter ablation (RFCA) for patients with atrial fibrillation (AF) can generate considerable physical and psychological discomfort under conscious sedation. App-based mindfulness meditation combined with an electroencephalography (EEG)-based brain-computer interface (BCI) shows promise as effective and accessible adjuncts in medical practice. OBJECTIVE This study aimed to investigate the effectiveness of a BCI-based mindfulness meditation app in improving the experience of patients with AF during RFCA. METHODS This single-center pilot randomized controlled trial involved 84 eligible patients with AF scheduled for RFCA, who were randomized 1:1 to the intervention and control groups. Both groups received a standardized RFCA procedure and a conscious sedative regimen. Patients in the control group were administered conventional care, while those in the intervention group received BCI-based app-delivered mindfulness meditation from a research nurse. The primary outcomes were the changes in the numeric rating scale, State Anxiety Inventory, and Brief Fatigue Inventory scores. Secondary outcomes were the differences in hemodynamic parameters (heart rate, blood pressure, and peripheral oxygen saturation), adverse events, patient-reported pain, and the doses of sedative drugs used in ablation. RESULTS BCI-based app-delivered mindfulness meditation, compared to conventional care, resulted in a significantly lower mean numeric rating scale (mean 4.6, SD 1.7 [app-based mindfulness meditation] vs mean 5.7, SD 2.1 [conventional care]; P=.008), State Anxiety Inventory (mean 36.7, SD 5.5 vs mean 42.3, SD 7.2; P<.001), and Brief Fatigue Inventory (mean 3.4, SD 2.3 vs mean 4.7, SD 2.2; P=.01) scores. No significant differences were observed in hemodynamic parameters or the amounts of parecoxib and dexmedetomidine used in RFCA between the 2 groups. The intervention group exhibited a significant decrease in fentanyl use compared to the control group, with a mean dose of 3.96 (SD 1.37) mcg/kg versus 4.85 (SD 1.25) mcg/kg in the control group (P=.003).The incidence of adverse events was lower in the intervention group (5/40) than in the control group (10/40), though this difference was not significant (P=.15). CONCLUSIONS BCI-based app-delivered mindfulness meditation effectively relieved physical and psychological discomfort and may reduce the doses of sedative medication used in RFCA for patients with AF. TRIAL REGISTRATION ClinicalTrials.gov NCT05306015; https://clinicaltrials.gov/ct2/show/NCT05306015.
Collapse
Affiliation(s)
- Ying He
- Department of Cardiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - Zhijie Tang
- School of Nursing, Nanjing Medical University, Nanjing, China
| | - Guozhen Sun
- Department of Cardiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - Cheng Cai
- Department of Cardiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - Yao Wang
- Department of Cardiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - Gang Yang
- Department of Cardiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - ZhiPeng Bao
- Department of Cardiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| |
Collapse
|
31
|
Macías-Macías JM, Ramírez-Quintana JA, Chacón-Murguía MI, Torres-García AA, Corral-Martínez LF. Interpretation of a deep analysis of speech imagery features extracted by a capsule neural network. Comput Biol Med 2023; 159:106909. [PMID: 37071937 DOI: 10.1016/j.compbiomed.2023.106909] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Revised: 03/28/2023] [Accepted: 04/10/2023] [Indexed: 04/20/2023]
Abstract
Speech imagery has been successfully employed in developing Brain-Computer Interfaces because it is a novel mental strategy that generates brain activity more intuitively than evoked potentials or motor imagery. There are many methods to analyze speech imagery signals, but those based on deep neural networks achieve the best results. However, more research is necessary to understand the properties and features that describe imagined phonemes and words. In this paper, we analyze the statistical properties of speech imagery EEG signals from the KaraOne dataset to design a method that classifies imagined phonemes and words. With this analysis, we propose a Capsule Neural Network that categorizes speech imagery patterns into bilabial, nasal, consonant-vocal, and vowels/iy/ and/uw/. The method is called Capsules for Speech Imagery Analysis (CapsK-SI). The input of CapsK-SI is a set of statistical features of EEG speech imagery signals. The architecture of the Capsule Neural Network is composed of a convolution layer, a primary capsule layer, and a class capsule layer. The average accuracy reached is 90.88%±7 for bilabial, 90.15%±8 for nasal, 94.02%±6 for consonant-vowel, 89.70%±8 for word-phoneme, 94.33%± for/iy/ vowel and, 94.21%±3 for/uw/ vowel detection. Finally, with the activity vectors of the CapsK-SI capsules, we generated brain maps to represent brain activity in the production of bilabial, nasal, and consonant-vocal signals.
Collapse
Affiliation(s)
- José M Macías-Macías
- Tecnológico Nacional de México/IT Chihuahua, Av. Tecnológico 2909, Chihuahua, 31310, Chihuahua, Mexico.
| | - Juan A Ramírez-Quintana
- Tecnológico Nacional de México/IT Chihuahua, Av. Tecnológico 2909, Chihuahua, 31310, Chihuahua, Mexico
| | - Mario I Chacón-Murguía
- Tecnológico Nacional de México/IT Chihuahua, Av. Tecnológico 2909, Chihuahua, 31310, Chihuahua, Mexico
| | - Alejandro A Torres-García
- Instituto Nacional de Astrofísica Óptica y Electrónica, Luis Enrique Erro No 1, Tonanzintla, 72840, Puebla, Mexico
| | - Luis F Corral-Martínez
- Tecnológico Nacional de México/IT Chihuahua, Av. Tecnológico 2909, Chihuahua, 31310, Chihuahua, Mexico
| |
Collapse
|
32
|
Zhang H, Yao J, Xu C, Wang C. Targeting electroencephalography for alcohol dependence: A narrative review. CNS Neurosci Ther 2023; 29:1205-1212. [PMID: 36890659 PMCID: PMC10068473 DOI: 10.1111/cns.14138] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2022] [Revised: 01/26/2023] [Accepted: 02/16/2023] [Indexed: 03/10/2023] Open
Abstract
BACKGROUND Electroencephalography (EEG)-based electrophysiological techniques have made progress in diagnosing and treating alcohol dependence in recent years. AIMS The article reviews the latest literature in this field. MATERIALS AND METHODS Alcohol dependence, which is common and prone to relapsing, poses a serious threat to individuals, families, and society. At present, the objective detection methods for alcohol dependence in clinic are not enough. As electrophysiological techniques developed in psychiatry, some researches on EEG-based monitoring methods are of great significance in the diagnosis and treatment of alcohol dependence. DISCUSSION As electrophysiological techniques developed in psychiatry, some researches on EEG-based monitoring methods such as resting electroencephalography (REEG), event-related potentials (ERP), event-related oscillations (ERO), and polysomnography (PSG), was reported. CONCLUSION In this paper, the status of electrophysiological researches on EEG in alcoholics are reviewed in detail.
Collapse
Affiliation(s)
- Huiwen Zhang
- Department of Anaesthesiology, General Hospital of Ningxia Medical University, Yinchuan, China.,Department of Anaesthesiology, Shanghai Jiaotong University Affiliated Sixth People's Hospital, Shanghai, China
| | - Jiahui Yao
- Department of Anaesthesiology, General Hospital of Ningxia Medical University, Yinchuan, China
| | - Cheng Xu
- Department of Anaesthesiology, Shanghai Jiaotong University Affiliated Sixth People's Hospital, Shanghai, China
| | - Chengyu Wang
- Department of Anaesthesiology, Shanghai Jiaotong University Affiliated Sixth People's Hospital, Shanghai, China
| |
Collapse
|
33
|
Siribunyaphat N, Punsawad Y. Brain-Computer Interface Based on Steady-State Visual Evoked Potential Using Quick-Response Code Pattern for Wheelchair Control. SENSORS (BASEL, SWITZERLAND) 2023; 23:2069. [PMID: 36850667 PMCID: PMC9964090 DOI: 10.3390/s23042069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Revised: 02/09/2023] [Accepted: 02/10/2023] [Indexed: 06/18/2023]
Abstract
Brain-computer interfaces (BCIs) are widely utilized in control applications for people with severe physical disabilities. Several researchers have aimed to develop practical brain-controlled wheelchairs. An existing electroencephalogram (EEG)-based BCI based on steady-state visually evoked potential (SSVEP) was developed for device control. This study utilized a quick-response (QR) code visual stimulus pattern for a robust existing system. Four commands were generated using the proposed visual stimulation pattern with four flickering frequencies. Moreover, we employed a relative power spectrum density (PSD) method for the SSVEP feature extraction and compared it with an absolute PSD method. We designed experiments to verify the efficiency of the proposed system. The results revealed that the proposed SSVEP method and algorithm yielded an average classification accuracy of approximately 92% in real-time processing. For the wheelchair simulated via independent-based control, the proposed BCI control required approximately five-fold more time than the keyboard control for real-time control. The proposed SSVEP method using a QR code pattern can be used for BCI-based wheelchair control. However, it suffers from visual fatigue owing to long-time continuous control. We will verify and enhance the proposed system for wheelchair control in people with severe physical disabilities.
Collapse
Affiliation(s)
| | - Yunyong Punsawad
- School of Informatics, Walailak University, Nakhon Si Thammarat 80160, Thailand
- Informatics Innovative Center of Excellence, Walailak University, Nakhon Si Thammarat 80160, Thailand
| |
Collapse
|
34
|
Schnetzer L, McCoy M, Bergmann J, Kunz A, Leis S, Trinka E. Locked-in syndrome revisited. Ther Adv Neurol Disord 2023; 16:17562864231160873. [PMID: 37006459 PMCID: PMC10064471 DOI: 10.1177/17562864231160873] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Accepted: 02/14/2023] [Indexed: 03/31/2023] Open
Abstract
The locked-in syndrome (LiS) is characterized by quadriplegia with preserved vertical eye and eyelid movements and retained cognitive abilities. Subcategorization, aetiologies and the anatomical foundation of LiS are discussed. The damage of different structures in the pons, mesencephalon and thalamus are attributed to symptoms of classical, complete and incomplete LiS and the locked-in plus syndrome, which is characterized by additional impairments of consciousness, making the clinical distinction to other chronic disorders of consciousness at times difficult. Other differential diagnoses are cognitive motor dissociation (CMD) and akinetic mutism. Treatment options are reviewed and an early, interdisciplinary and aggressive approach, including the provision of psychological support and coping strategies is favoured. The establishment of communication is a main goal of rehabilitation. Finally, the quality of life of LiS patients and ethical implications are considered. While patients with LiS report a high quality of life and well-being, medical professionals and caregivers have largely pessimistic perceptions. The negative view on life with LiS must be overthought and the autonomy and dignity of LiS patients prioritized. Knowledge has to be disseminated, diagnostics accelerated and technical support system development promoted. More well-designed research but also more awareness of the needs of LiS patients and their perception as individual persons is needed to enable a life with LiS that is worth living.
Collapse
Affiliation(s)
| | - Mark McCoy
- Department of Neurology, Neurological Intensive Care and Neurorehabilitation, Christian Doppler Medical Centre, Paracelsus Medical University, Salzburg, Austria
| | - Jürgen Bergmann
- Department of Neurology, Neurological Intensive Care and Neurorehabilitation, Christian Doppler Medical Centre, Paracelsus Medical University, Salzburg, Austria
| | - Alexander Kunz
- Department of Neurology, Neurological Intensive Care and Neurorehabilitation, Christian Doppler Medical Centre, Paracelsus Medical University, Salzburg, Austria
- Karl Landsteiner Institute of Neurorehabilitation and Space Neurology, Salzburg, Austria
| | - Stefan Leis
- Department of Neurology, Neurological Intensive Care and Neurorehabilitation, Christian Doppler Medical Centre, Paracelsus Medical University, Salzburg, Austria
| | - Eugen Trinka
- Department of Neurology, Neurological Intensive Care and Neurorehabilitation, Christian Doppler Medical Centre, Paracelsus Medical University, Salzburg, Austria
- MRI Research Unit, Neuroscience Institute, Christian Doppler Medical Centre, Paracelsus Medical University, Salzburg, Austria
- Karl Landsteiner Institute of Neurorehabilitation and Space Neurology, Salzburg, Austria
| |
Collapse
|
35
|
Penev YP, Beneke A, Root KT, Meisel E, Kwak S, Diaz MJ, Root JL, Hosseini MR, Lucke-Wold B. Therapeutic Effectiveness of Brain Computer Interfaces in Stroke Patients: A Systematic Review. JOURNAL OF EXPERIMENTAL NEUROLOGY 2023; 4:87-93. [PMID: 37799298 PMCID: PMC10552326 DOI: 10.33696/neurol.4.077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 10/07/2023]
Abstract
Background Brain-computer interfaces (BCIs) are a rapidly advancing field which utilizes brain activity to control external devices for a myriad of functions, including the restoration of motor function. Clinically, BCIs have been especially impactful in patients who suffer from stroke-mediated damage. However, due to the rapid advancement in the field, there is a lack of accepted standards of practice. Therefore, the aim of this systematic review is to summarize the current literature published regarding the efficacy of BCI-based rehabilitation of motor dysfunction in stroke patients. Methodology This systematic review was performed in accordance with the guidelines set forth by the Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) 2020 statement. PubMed, Embase, and Cochrane Library were queried for relevant articles and screened for inclusion criteria by two authors. All discrepancies were resolved by discussion among both reviewers and subsequent consensus. Results 11/12 (91.6%) of studies focused on upper extremity outcomes and reported larger initial improvements for participants in the treatment arm (using BCI) as compared to those in the control arm (no BCI). 2/2 studies focused on lower extremity outcomes reported improvements for the treatment arm compared to the control arm. Discussion/Conclusion This systematic review illustrates the utility BCI has for the restoration of upper extremity and lower extremity motor function in stroke patients and supports further investigation of BCI for other clinical indications.
Collapse
Affiliation(s)
- Yordan P. Penev
- ICollege of Medicine, University of Florida, Gainesville, Florida, USA
| | - Alice Beneke
- ICollege of Medicine, University of Florida, Gainesville, Florida, USA
| | - Kevin T. Root
- ICollege of Medicine, University of Florida, Gainesville, Florida, USA
| | - Emily Meisel
- ICollege of Medicine, University of Florida, Gainesville, Florida, USA
| | - Sean Kwak
- ICollege of Medicine, University of Florida, Gainesville, Florida, USA
| | - Michael J. Diaz
- ICollege of Medicine, University of Florida, Gainesville, Florida, USA
| | | | | | - Brandon Lucke-Wold
- Department of Neurosurgery, University of Florida, Gainesville, Florida, USA
| |
Collapse
|
36
|
Ferracuti F, Freddi A, Iarlori S, Monteriù A, Omer KIM, Porcaro C. A human-in-the-loop approach for enhancing mobile robot navigation in presence of obstacles not detected by the sensory set. Front Robot AI 2022; 9:909971. [PMID: 36523445 PMCID: PMC9744805 DOI: 10.3389/frobt.2022.909971] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Accepted: 11/07/2022] [Indexed: 04/20/2024] Open
Abstract
Human-in-the-loop approaches can greatly enhance the human-robot interaction by making the user an active part of the control loop, who can provide a feedback to the robot in order to augment its capabilities. Such feedback becomes even more important in all those situations where safety is of utmost concern, such as in assistive robotics. This study aims to realize a human-in-the-loop approach, where the human can provide a feedback to a specific robot, namely, a smart wheelchair, to augment its artificial sensory set, extending and improving its capabilities to detect and avoid obstacles. The feedback is provided by both a keyboard and a brain-computer interface: with this scope, the work has also included a protocol design phase to elicit and evoke human brain event-related potentials. The whole architecture has been validated within a simulated robotic environment, with electroencephalography signals acquired from different test subjects.
Collapse
Affiliation(s)
- Francesco Ferracuti
- Department of Information Engineering, Università Politecnica delle Marche, Ancona, Italy
| | - Alessandro Freddi
- Department of Information Engineering, Università Politecnica delle Marche, Ancona, Italy
| | - Sabrina Iarlori
- Department of Information Engineering, Università Politecnica delle Marche, Ancona, Italy
| | - Andrea Monteriù
- Department of Information Engineering, Università Politecnica delle Marche, Ancona, Italy
| | | | - Camillo Porcaro
- Department of Neuroscience and Padova Neuroscience Center (PNC), University of Padova, Padova, Italy
- Institute of Cognitive Sciences and Technologies (ISCT)-National Research Council (CNR), Rome, Italy
- Centre for Human Brain Health, School of Psychology, University of Birmingham, Birmingham, United Kingdom
| |
Collapse
|
37
|
Gao W, Cui Z, Yu Y, Mao J, Xu J, Ji L, Kan X, Shen X, Li X, Zhu S, Hong Y. Application of a Brain-Computer Interface System with Visual and Motor Feedback in Limb and Brain Functional Rehabilitation after Stroke: Case Report. Brain Sci 2022; 12:1083. [PMID: 36009146 PMCID: PMC9405856 DOI: 10.3390/brainsci12081083] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2022] [Revised: 08/05/2022] [Accepted: 08/10/2022] [Indexed: 11/25/2022] Open
Abstract
(1) Objective: To investigate the feasibility, safety, and effectiveness of a brain-computer interface (BCI) system with visual and motor feedback in limb and brain function rehabilitation after stroke. (2) Methods: First, we recruited three hemiplegic stroke patients to perform rehabilitation training using a BCI system with visual and motor feedback for two consecutive days (four sessions) to verify the feasibility and safety of the system. Then, we recruited five other hemiplegic stroke patients for rehabilitation training (6 days a week, lasting for 12-14 days) using the same BCI system to verify the effectiveness. The mean and Cohen's w were used to compare the changes in limb motor and brain functions before and after training. (3) Results: In the feasibility verification, the continuous motor state switching time (CMSST) of the three patients was 17.8 ± 21.0s, and the motor state percentages (MSPs) in the upper and lower limb training were 52.6 ± 25.7% and 72.4 ± 24.0%, respectively. The effective training revolutions (ETRs) per minute were 25.8 ± 13.0 for upper limb and 24.8 ± 6.4 for lower limb. There were no adverse events during the training process. Compared with the baseline, the motor function indices of the five patients were improved, including sitting balance ability, upper limb Fugel-Meyer assessment (FMA), lower limb FMA, 6 min walking distance, modified Barthel index, and root mean square (RMS) value of triceps surae, which increased by 0.4, 8.0, 5.4, 11.4, 7.0, and 0.9, respectively, and all had large effect sizes (Cohen's w ≥ 0.5). The brain function indices of the five patients, including the amplitudes of the motor evoked potentials (MEP) on the non-lesion side and lesion side, increased by 3.6 and 3.7, respectively; the latency of MEP on the non-lesion side was shortened by 2.6 ms, and all had large effect sizes (Cohen's w ≥ 0.5). (4) Conclusions: The BCI system with visual and motor feedback is applicable in active rehabilitation training of stroke patients with hemiplegia, and the pilot results show potential multidimensional benefits after a short course of treatment.
Collapse
Affiliation(s)
- Wen Gao
- Department of Rehabilitation Medicine, The Second Hospital of Anhui Medical University, No. 678 Furong Road, Economic and Technological Development Zone, Hefei 230601, China
| | - Zhengzhe Cui
- Zhejiang Laboratory, Department of Intelligent Robot, Keji Avenue, Yuhang Zone, Hangzhou 311100, China
| | - Yang Yu
- Department of Rehabilitation Medicine, The Second Hospital of Anhui Medical University, No. 678 Furong Road, Economic and Technological Development Zone, Hefei 230601, China
| | - Jing Mao
- Department of Rehabilitation Medicine, The Second Hospital of Anhui Medical University, No. 678 Furong Road, Economic and Technological Development Zone, Hefei 230601, China
| | - Jun Xu
- Department of Rehabilitation Medicine, The Second Hospital of Anhui Medical University, No. 678 Furong Road, Economic and Technological Development Zone, Hefei 230601, China
| | - Leilei Ji
- Department of Rehabilitation Medicine, The Second Hospital of Anhui Medical University, No. 678 Furong Road, Economic and Technological Development Zone, Hefei 230601, China
| | - Xiuli Kan
- Department of Rehabilitation Medicine, The Second Hospital of Anhui Medical University, No. 678 Furong Road, Economic and Technological Development Zone, Hefei 230601, China
| | - Xianshan Shen
- Department of Rehabilitation Medicine, The Second Hospital of Anhui Medical University, No. 678 Furong Road, Economic and Technological Development Zone, Hefei 230601, China
| | - Xueming Li
- Department of Rehabilitation Medicine, The Second Hospital of Anhui Medical University, No. 678 Furong Road, Economic and Technological Development Zone, Hefei 230601, China
| | - Shiqiang Zhu
- Zhejiang Laboratory, Department of Intelligent Robot, Keji Avenue, Yuhang Zone, Hangzhou 311100, China
- Ocean College, Zhejiang University, No. 866 Yuhangtang Road, Xihu Zone, Hangzhou 310030, China
| | - Yongfeng Hong
- Department of Rehabilitation Medicine, The Second Hospital of Anhui Medical University, No. 678 Furong Road, Economic and Technological Development Zone, Hefei 230601, China
| |
Collapse
|
38
|
Choi H, Park J, Yang YM. Whitening Technique Based on Gram-Schmidt Orthogonalization for Motor Imagery Classification of Brain-Computer Interface Applications. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22166042. [PMID: 36015803 PMCID: PMC9413233 DOI: 10.3390/s22166042] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/03/2022] [Revised: 07/28/2022] [Accepted: 08/11/2022] [Indexed: 05/28/2023]
Abstract
A novel whitening technique for motor imagery (MI) classification is proposed to reduce the accuracy variance of brain-computer interfaces (BCIs). This method is intended to improve the electroencephalogram eigenface analysis performance for the MI classification of BCIs. In BCI classification, the variance of the accuracy among subjects is sensitive to the accuracy itself for superior classification results. Hence, with the help of Gram-Schmidt orthogonalization, we propose a BCI channel whitening (BCICW) scheme to minimize the variance among subjects. The newly proposed BCICW method improved the variance of the MI classification in real data. To validate and verify the proposed scheme, we performed an experiment on the BCI competition 3 dataset IIIa (D3D3a) and the BCI competition 4 dataset IIa (D4D2a) using the MATLAB simulation tool. The variance data when using the proposed BCICW method based on Gram-Schmidt orthogonalization was much lower (11.21) than that when using the EFA method (58.33) for D3D3a and decreased from (17.48) to (9.38) for D4D2a. Therefore, the proposed method could be effective for MI classification of BCI applications.
Collapse
Affiliation(s)
- Hojong Choi
- Department of Electronic Engineering, Gachon University, Seongnam 13306, Korea
| | - Junghun Park
- School of Electronic Engineering, Kumoh National Institute of Technology, Gumi 39177, Korea
| | - Yeon-Mo Yang
- School of Electronic Engineering, Kumoh National Institute of Technology, Gumi 39177, Korea
| |
Collapse
|
39
|
Borirakarawin M, Punsawad Y. Event-Related Potential-Based Brain-Computer Interface Using the Thai Vowels' and Numerals' Auditory Stimulus Pattern. SENSORS (BASEL, SWITZERLAND) 2022; 22:5864. [PMID: 35957419 PMCID: PMC9371073 DOI: 10.3390/s22155864] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/18/2022] [Revised: 08/01/2022] [Accepted: 08/04/2022] [Indexed: 06/15/2023]
Abstract
Herein, we developed an auditory stimulus pattern for an event-related potential (ERP)-based brain-computer interface (BCI) system to improve control and communication in quadriplegia with visual impairment. Auditory stimulus paradigms for multicommand electroencephalogram (EEG)-based BCIs and audio stimulus patterns were examined. With the proposed auditory stimulation, using the selected Thai vowel, similar to the English vowel, and Thai numeral sounds, as simple target recognition, we explored the ERPs' response and classification efficiency from the suggested EEG channels. We also investigated the use of single and multi-loudspeakers for auditory stimuli. Four commands were created using the proposed paradigm. The experimental paradigm was designed to observe ERP responses and verify the proposed auditory stimulus pattern. The conventional classification method produced four commands using the proposed auditory stimulus pattern. The results established that the proposed auditory stimulation with 20 to 30 trials of stream stimuli could produce a prominent ERP response from Pz channels. The vowel stimuli could achieve higher accuracy than the proposed numeral stimuli for two auditory stimuli intervals (100 and 250 ms). Additionally, multi-loudspeaker patterns through vowel and numeral sound stimulation provided an accuracy greater than 85% of the average accuracy. Thus, the proposed auditory stimulation patterns can be implemented as a real-time BCI system to aid in the daily activities of quadratic patients with visual and tactile impairments. In future, practical use of the auditory ERP-based BCI system will be demonstrated and verified in an actual scenario.
Collapse
Affiliation(s)
| | - Yunyong Punsawad
- School of Informatics, Walailak University, Nakhon Si Thammarat 80160, Thailand
- Informatics Innovative Center of Excellence, Walailak University, Nakhon Si Thammarat 80160, Thailand
| |
Collapse
|
40
|
Subject-Dependent Artifact Removal for Enhancing Motor Imagery Classifier Performance under Poor Skills. SENSORS 2022; 22:s22155771. [PMID: 35957329 PMCID: PMC9371054 DOI: 10.3390/s22155771] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Revised: 07/26/2022] [Accepted: 07/29/2022] [Indexed: 11/28/2022]
Abstract
The Electroencephalography (EEG)-based motor imagery (MI) paradigm is one of the most studied technologies for Brain-Computer Interface (BCI) development. Still, the low Signal-to-Noise Ratio (SNR) poses a challenge when constructing EEG-based BCI systems. Moreover, the non-stationary and nonlinear signal issues, the low-spatial data resolution, and the inter- and intra-subject variability hamper the extraction of discriminant features. Indeed, subjects with poor motor skills have difficulties in practicing MI tasks against low SNR scenarios. Here, we propose a subject-dependent preprocessing approach that includes the well-known Surface Laplacian Filtering and Independent Component Analysis algorithms to remove signal artifacts based on the MI performance. In addition, power- and phase-based functional connectivity measures are studied to extract relevant and interpretable patterns and identify subjects of inefficency. As a result, our proposal, Subject-dependent Artifact Removal (SD-AR), improves the MI classification performance in subjects with poor motor skills. Consequently, electrooculography and volume-conduction EEG artifacts are mitigated within a functional connectivity feature-extraction strategy, which favors the classification performance of a straightforward linear classifier.
Collapse
|
41
|
Abstract
In brain–computer interfaces (BCIs), it is crucial to process brain signals to improve the accuracy of the classification of motor movements. Machine learning (ML) algorithms such as artificial neural networks (ANNs), linear discriminant analysis (LDA), decision tree (D.T.), K-nearest neighbor (KNN), naive Bayes (N.B.), and support vector machine (SVM) have made significant progress in classification issues. This paper aims to present a signal processing analysis of electroencephalographic (EEG) signals among different feature extraction techniques to train selected classification algorithms to classify signals related to motor movements. The motor movements considered are related to the left hand, right hand, both fists, feet, and relaxation, making this a multiclass problem. In this study, nine ML algorithms were trained with a dataset created by the feature extraction of EEG signals.The EEG signals of 30 Physionet subjects were used to create a dataset related to movement. We used electrodes C3, C1, CZ, C2, and C4 according to the standard 10-10 placement. Then, we extracted the epochs of the EEG signals and applied tone, amplitude levels, and statistical techniques to obtain the set of features. LabVIEW™2015 version custom applications were used for reading the EEG signals; for channel selection, noise filtering, band selection, and feature extraction operations; and for creating the dataset. MATLAB 2021a was used for training, testing, and evaluating the performance metrics of the ML algorithms. In this study, the model of Medium-ANN achieved the best performance, with an AUC average of 0.9998, Cohen’s Kappa coefficient of 0.9552, a Matthews correlation coefficient of 0.9819, and a loss of 0.0147. These findings suggest the applicability of our approach to different scenarios, such as implementing robotic prostheses, where the use of superficial features is an acceptable option when resources are limited, as in embedded systems or edge computing devices.
Collapse
|
42
|
Lima AA, Mridha MF, Das SC, Kabir MM, Islam MR, Watanobe Y. A Comprehensive Survey on the Detection, Classification, and Challenges of Neurological Disorders. BIOLOGY 2022; 11:469. [PMID: 35336842 PMCID: PMC8945195 DOI: 10.3390/biology11030469] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/13/2022] [Revised: 03/12/2022] [Accepted: 03/14/2022] [Indexed: 01/19/2023]
Abstract
Neurological disorders (NDs) are becoming more common, posing a concern to pregnant women, parents, healthy infants, and children. Neurological disorders arise in a wide variety of forms, each with its own set of origins, complications, and results. In recent years, the intricacy of brain functionalities has received a better understanding due to neuroimaging modalities, such as magnetic resonance imaging (MRI), magnetoencephalography (MEG), and positron emission tomography (PET), etc. With high-performance computational tools and various machine learning (ML) and deep learning (DL) methods, these modalities have discovered exciting possibilities for identifying and diagnosing neurological disorders. This study follows a computer-aided diagnosis methodology, leading to an overview of pre-processing and feature extraction techniques. The performance of existing ML and DL approaches for detecting NDs is critically reviewed and compared in this article. A comprehensive portion of this study also shows various modalities and disease-specified datasets that detect and records images, signals, and speeches, etc. Limited related works are also summarized on NDs, as this domain has significantly fewer works focused on disease and detection criteria. Some of the standard evaluation metrics are also presented in this study for better result analysis and comparison. This research has also been outlined in a consistent workflow. At the conclusion, a mandatory discussion section has been included to elaborate on open research challenges and directions for future work in this emerging field.
Collapse
Affiliation(s)
- Aklima Akter Lima
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh; (A.A.L.); (M.F.M.); (S.C.D.); (M.M.K.)
| | - M. Firoz Mridha
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh; (A.A.L.); (M.F.M.); (S.C.D.); (M.M.K.)
| | - Sujoy Chandra Das
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh; (A.A.L.); (M.F.M.); (S.C.D.); (M.M.K.)
| | - Muhammad Mohsin Kabir
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh; (A.A.L.); (M.F.M.); (S.C.D.); (M.M.K.)
| | - Md. Rashedul Islam
- Department of Computer Science and Engineering, University of Asia Pacific, Dhaka 1216, Bangladesh
| | - Yutaka Watanobe
- Department of Computer Science and Engineering, University of Aizu, Aizu-Wakamatsu 965-8580, Japan;
| |
Collapse
|
43
|
Siribunyaphat N, Punsawad Y. Steady-State Visual Evoked Potential-Based Brain–Computer Interface Using a Novel Visual Stimulus with Quick Response (QR) Code Pattern. SENSORS 2022; 22:s22041439. [PMID: 35214341 PMCID: PMC8877481 DOI: 10.3390/s22041439] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/23/2021] [Revised: 01/27/2022] [Accepted: 02/09/2022] [Indexed: 12/04/2022]
Abstract
Steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) systems suffer from low SSVEP response intensity and visual fatigue, resulting in lower accuracy when operating the system for continuous commands, such as an electric wheelchair control. This study proposes two SSVEP improvements to create a practical BCI for communication and control in disabled people. The first is flicker pattern modification for increasing SSVEP response through mixing (1) fundamental and first harmonic frequencies, and (2) two fundamental frequencies for an additional number of commands. The second method utilizes a quick response (QR) code for visual stimulus patterns to increase the SSVEP response and reduce visual fatigue. Eight different stimulus patterns from three flickering frequencies (7, 13, and 17 Hz) were presented to twelve participants for the test and score levels of visual fatigue. Two popular SSVEP methods, i.e., power spectral density (PSD) with Welch periodogram and canonical correlation analysis (CCA) with overlapping sliding window, are used to detect SSVEP intensity and response, compared to the checkerboard pattern. The results suggest that the QR code patterns can yield higher accuracy than checkerboard patterns for both PSD and CCA methods. Moreover, a QR code pattern with low frequency can reduce visual fatigue; however, visual fatigue can be easily affected by high flickering frequency. The findings can be used in the future to implement a real-time, SSVEP-based BCI for verifying user and system performance in actual environments.
Collapse
Affiliation(s)
| | - Yunyong Punsawad
- School of Informatics, Walailak University, Nakhon Si Thammarat 80160, Thailand;
- Informatics Innovative Center of Excellence, Walailak University, Nakhon Si Thammarat 80160, Thailand
- Correspondence: ; Tel.: +668-6909-1568
| |
Collapse
|
44
|
Xiong W, Wei Q. Reducing calibration time in motor imagery-based BCIs by data alignment and empirical mode decomposition. PLoS One 2022; 17:e0263641. [PMID: 35134085 PMCID: PMC8824327 DOI: 10.1371/journal.pone.0263641] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Accepted: 01/25/2022] [Indexed: 11/18/2022] Open
Abstract
One of the major reasons that limit the practical applications of a brain-computer interface (BCI) is its long calibration time. In this paper, we propose a novel approach to reducing the calibration time of motor imagery (MI)-based BCIs without sacrificing classification accuracy. The approach aims to augment the training set size of a new subject by generating artificial electroencephalogram (EEG) data from a few training trials initially available. The artificial EEG data are obtained by first performing empirical mode decomposition (EMD) and then mixing resulting intrinsic mode functions (IMFs). The original training trials are aligned to common reference point with Euclidean alignment (EA) method prior to EMD and pooled together with artificial trials as the expended training set, which is input into a linear discriminant analysis (LDA) classifier or a logistic regression (LR) classifier. The performance of the proposed algorithm is evaluated on two motor imagery (MI) data sets and compared with that of the algorithm trained with only real EEG data (Baseline) and the algorithm trained with expanded EEG data by EMD without data alignment. The experimental results showed that the proposed algorithm can significantly reduce the amount of training data needed to achieve a given performance level and thus is expected to facilitate the real-world applications of MI-based BCIs.
Collapse
Affiliation(s)
- Wei Xiong
- Dept. of Electronic Information Engineering, School of Information Engineering, Nanchang University, Nanchang, People’s Republic of China
| | - Qingguo Wei
- Dept. of Electronic Information Engineering, School of Information Engineering, Nanchang University, Nanchang, People’s Republic of China
- * E-mail:
| |
Collapse
|