1
|
Zhu F, Cai J, Zheng H, Liang Z, Zhang Y. Suppression of negative transfer in motor imagery brain-computer interface based on mutual information and Pearson correlation coefficient. THE REVIEW OF SCIENTIFIC INSTRUMENTS 2024; 95:075105. [PMID: 38984886 DOI: 10.1063/5.0208524] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Accepted: 06/19/2024] [Indexed: 07/11/2024]
Abstract
The focus of this paper is on the main challenges in brain-computer interface transfer learning: how to address data characteristic length and the source domain sample selection problems caused by individual differences. To overcome the negative migration that results from feature length, we propose a migration algorithm based on mutual information transfer (MIT), which selects effective features by calculating the entropy value of the probability distribution and conditional distribution, thereby reducing negative migration and improving learning efficiency. Source domain participants who differ too much from the target domain distribution can affect the overall classification performance. On the basis of MIT, we propose the Pearson correlation coefficient source domain automatic selection algorithm (PDAS algorithm). The PDAS algorithm can automatically select the appropriate source domain participants according to the target domain distribution, which reduces the negative migration of participant data among the source domain participants, improves experimental accuracy, and greatly reduces training time. The two proposed algorithms were tested offline and online on two public datasets, and the results were compared with those from existing advanced algorithms. The experimental results showed that the MIT algorithm and the MIT + PDAS algorithm had obvious advantages.
Collapse
Affiliation(s)
- Fenfang Zhu
- School of Life Sciences, Anhui University, Hefei 230000, China
| | - Jicheng Cai
- Center of Artificial Intelligence, Hangzhou Innovation Institute, Beihang University, Hangzhou, Zhejiang Province 310000, China
| | - Hao Zheng
- Center of Artificial Intelligence, Hangzhou Innovation Institute, Beihang University, Hangzhou, Zhejiang Province 310000, China
| | - Zilin Liang
- Center of Artificial Intelligence, Hangzhou Innovation Institute, Beihang University, Hangzhou, Zhejiang Province 310000, China
| | - Yue Zhang
- Center of Artificial Intelligence, Hangzhou Innovation Institute, Beihang University, Hangzhou, Zhejiang Province 310000, China
| |
Collapse
|
2
|
Padfield N, Agius Anastasi A, Camilleri T, Fabri S, Bugeja M, Camilleri K. BCI-controlled wheelchairs: end-users' perceptions, needs, and expectations, an interview-based study. Disabil Rehabil Assist Technol 2024; 19:1539-1551. [PMID: 37166297 DOI: 10.1080/17483107.2023.2211602] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Accepted: 05/03/2023] [Indexed: 05/12/2023]
Abstract
PURPOSE Brain-computer interface (BCI)-controlled wheelchairs have the potential to improve the independence of people with mobility impairments. The low uptake of BCI devices has been linked to a lack of knowledge among researchers of the needs of end-users that should influence BCI development. MATERIALS AND METHODS This study used semi-structured interviews to learn about the perceptions, needs, and expectations of spinal cord injury (SCI) patients with regards to a BCI-controlled wheelchair. Topics discussed in the interview include: paradigms, shared control, safety, robustness, channel selection, hardware, and experimental design. The interviews were recorded and then transcribed. Analysis was carried out using coding based on grounded theory principles. RESULTS The majority of participants had a positive view of BCI-controlled wheelchair technology and were willing to use the technology. Core issues were raised regarding safety, cost and aesthetics. Interview discussions were linked to state-of-the-art BCI technology. The results challenge the current reliance of researchers on the motor-imagery paradigm by suggesting end-users expect highly intuitive paradigms. There also needs to be a stronger focus on obstacle avoidance and safety features in BCI wheelchairs. Finally, the development of control approaches that can be personalized for individual users may be instrumental for widespread adoption of these devices. CONCLUSIONS This study, based on interviews with SCI patients, indicates that BCI-controlled wheelchairs are a promising assistive technology that would be well received by end-users. Recommendations for a more person-centered design of BCI controlled wheelchairs are made and clear avenues for future research are identified.
Collapse
Affiliation(s)
- Natasha Padfield
- Centre for Biomedical Cybernetics, University of Malta, Msida, Malta
| | | | - Tracey Camilleri
- Department of Systems and Control Engineering, University of Malta, Msida, Malta
| | - Simon Fabri
- Department of Systems and Control Engineering, University of Malta, Msida, Malta
| | - Marvin Bugeja
- Department of Systems and Control Engineering, University of Malta, Msida, Malta
| | - Kenneth Camilleri
- Centre for Biomedical Cybernetics, University of Malta, Msida, Malta
- Department of Systems and Control Engineering, University of Malta, Msida, Malta
| |
Collapse
|
3
|
Selvam A, Aggarwal T, Mukherjee M, Verma YK. Humans and robots: Friends of the future? A bird's eye view of biomanufacturing industry 5.0. Biotechnol Adv 2023; 68:108237. [PMID: 37604228 DOI: 10.1016/j.biotechadv.2023.108237] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2023] [Revised: 07/15/2023] [Accepted: 08/18/2023] [Indexed: 08/23/2023]
Abstract
The evolution of industries have introduced versatile technologies, motivating limitless possibilities of tackling pivotal global predicaments in the arenas of medicine, environment, defence, and national security. In this direction, ardently emerges the new era of Industry 5.0 through the eyes of biomanufacturing, which integrates the most advanced systems 21st century has to offer by means of integrating artificial systems to mimic and nativize the natural milieu to substitute the deficits of nature, thence leading to a new meta world. Albeit, it questions the natural order of the living world, which necessitates certain paramount stipulations to be addressed for a successful expansion of biomanufacturing Industry 5.0. Can humans live in synergism with artificial beings? How can humans establish dominance of hierarchy with artificial counterparts? This perspective provides a bird's eye view on the plausible direction of a new meta world inquisitively. For this purpose, we propose the influence of internet of things (IoT) via new generation interfacial systems, such as, human-machine interface (HMI) and brain-computer interface (BCI) in the domain of tissue engineering and regenerative medicine, which can be extended to target modern warfare and smart healthcare.
Collapse
Affiliation(s)
- Abhyavartin Selvam
- Amity Institute of Nanotechnology, Amity University Noida, Uttar Pradesh 201303, India
| | - Tanishka Aggarwal
- Department of Biotechnology, School of Chemical and Life Sciences (SCLS) Jamia Hamdard, New Delhi 110062, India
| | - Monalisa Mukherjee
- Amity Institute of Click Chemistry Research and Studies, Amity University Noida, Uttar Pradesh 201303, India
| | - Yogesh Kumar Verma
- Stem Cell & Tissue Engineering Research Group, Institute of Nuclear Medicine and Allied Sciences, Defence Research and Development Organisation, New Delhi 110054, India.
| |
Collapse
|
4
|
Ferrero L, Quiles V, Ortiz M, Iáñez E, Gil-Agudo Á, Azorín JM. Brain-computer interface enhanced by virtual reality training for controlling a lower limb exoskeleton. iScience 2023; 26:106675. [PMID: 37250318 PMCID: PMC10214472 DOI: 10.1016/j.isci.2023.106675] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2022] [Revised: 03/06/2023] [Accepted: 04/11/2023] [Indexed: 05/31/2023] Open
Abstract
This study explores the use of a brain-computer interface (BCI) based on motor imagery (MI) for the control of a lower limb exoskeleton to aid in motor recovery after a neural injury. The BCI was evaluated in ten able-bodied subjects and two patients with spinal cord injuries. Five able-bodied subjects underwent a virtual reality (VR) training session to accelerate training with the BCI. Results from this group were compared with a control group of five able-bodied subjects, and it was found that the employment of shorter training by VR did not reduce the effectiveness of the BCI and even improved it in some cases. Patients gave positive feedback about the system and were able to handle experimental sessions without reaching high levels of physical and mental exertion. These results are promising for the inclusion of BCI in rehabilitation programs, and future research should investigate the potential of the MI-based BCI system.
Collapse
Affiliation(s)
- Laura Ferrero
- Brain-Machine Interface System Lab, Miguel Hernández University of Elche, Elche, Spain
- Instituto de Investigación en Ingeniería de Elche-I3E, Miguel Hernández University of Elche, Elche, Spain
- The European University of Brain and Technology (NeurotechEU)
| | - Vicente Quiles
- Brain-Machine Interface System Lab, Miguel Hernández University of Elche, Elche, Spain
- Instituto de Investigación en Ingeniería de Elche-I3E, Miguel Hernández University of Elche, Elche, Spain
| | - Mario Ortiz
- Brain-Machine Interface System Lab, Miguel Hernández University of Elche, Elche, Spain
- Instituto de Investigación en Ingeniería de Elche-I3E, Miguel Hernández University of Elche, Elche, Spain
- The European University of Brain and Technology (NeurotechEU)
| | - Eduardo Iáñez
- Brain-Machine Interface System Lab, Miguel Hernández University of Elche, Elche, Spain
- Instituto de Investigación en Ingeniería de Elche-I3E, Miguel Hernández University of Elche, Elche, Spain
| | | | - José M. Azorín
- Brain-Machine Interface System Lab, Miguel Hernández University of Elche, Elche, Spain
- Instituto de Investigación en Ingeniería de Elche-I3E, Miguel Hernández University of Elche, Elche, Spain
- Valencian Graduate School and Research Network of Artificial Intelligence (valgrAI), Valencia, Spain
- The European University of Brain and Technology (NeurotechEU)
| |
Collapse
|
5
|
Masengo G, Zhang X, Dong R, Alhassan AB, Hamza K, Mudaheranwa E. Lower limb exoskeleton robot and its cooperative control: A review, trends, and challenges for future research. Front Neurorobot 2023; 16:913748. [PMID: 36714152 PMCID: PMC9875327 DOI: 10.3389/fnbot.2022.913748] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Accepted: 12/19/2022] [Indexed: 01/12/2023] Open
Abstract
Effective control of an exoskeleton robot (ER) using a human-robot interface is crucial for assessing the robot's movements and the force they produce to generate efficient control signals. Interestingly, certain surveys were done to show off cutting-edge exoskeleton robots. The review papers that were previously published have not thoroughly examined the control strategy, which is a crucial component of automating exoskeleton systems. As a result, this review focuses on examining the most recent developments and problems associated with exoskeleton control systems, particularly during the last few years (2017-2022). In addition, the trends and challenges of cooperative control, particularly multi-information fusion, are discussed.
Collapse
Affiliation(s)
- Gilbert Masengo
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China,Shaanxi Key Laboratory of Intelligent Robot, Xi'an Jiaotong University, Xi'an, China,Department of Mechanical Engineering, Rwanda Polytechnic/Integrated Polytechnic Regional College (IPRC) Karongi, Kigali, Rwanda,*Correspondence: Gilbert Masengo ✉
| | - Xiaodong Zhang
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China,Shaanxi Key Laboratory of Intelligent Robot, Xi'an Jiaotong University, Xi'an, China
| | - Runlin Dong
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China,Shaanxi Key Laboratory of Intelligent Robot, Xi'an Jiaotong University, Xi'an, China
| | - Ahmad B. Alhassan
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China,Shaanxi Key Laboratory of Intelligent Robot, Xi'an Jiaotong University, Xi'an, China
| | - Khaled Hamza
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China,Shaanxi Key Laboratory of Intelligent Robot, Xi'an Jiaotong University, Xi'an, China
| | - Emmanuel Mudaheranwa
- Department of Mechanical Engineering, Rwanda Polytechnic/Integrated Polytechnic Regional College (IPRC) Karongi, Kigali, Rwanda,Department of Engineering, Cardiff University, Cardiff, United Kingdom
| |
Collapse
|
6
|
Said RR, Heyat MBB, Song K, Tian C, Wu Z. A Systematic Review of Virtual Reality and Robot Therapy as Recent Rehabilitation Technologies Using EEG-Brain-Computer Interface Based on Movement-Related Cortical Potentials. BIOSENSORS 2022; 12:bios12121134. [PMID: 36551100 PMCID: PMC9776155 DOI: 10.3390/bios12121134] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/24/2022] [Revised: 11/24/2022] [Accepted: 12/02/2022] [Indexed: 06/01/2023]
Abstract
To enhance the treatment of motor function impairment, patients' brain signals for self-control as an external tool may be an extraordinarily hopeful option. For the past 10 years, researchers and clinicians in the brain-computer interface (BCI) field have been using movement-related cortical potential (MRCP) as a control signal in neurorehabilitation applications to induce plasticity by monitoring the intention of action and feedback. Here, we reviewed the research on robot therapy (RT) and virtual reality (VR)-MRCP-based BCI rehabilitation technologies as recent advancements in human healthcare. A list of 18 full-text studies suitable for qualitative review out of 322 articles published between 2000 and 2022 was identified based on inclusion and exclusion criteria. We used PRISMA guidelines for the systematic review, while the PEDro scale was used for quality evaluation. Bibliometric analysis was conducted using the VOSviewer software to identify the relationship and trends of key items. In this review, 4 studies used VR-MRCP, while 14 used RT-MRCP-based BCI neurorehabilitation approaches. The total number of subjects in all identified studies was 107, whereby 4.375 ± 6.3627 were patient subjects and 6.5455 ± 3.0855 were healthy subjects. The type of electrodes, the epoch, classifiers, and the performance information that are being used in the RT- and VR-MRCP-based BCI rehabilitation application are provided in this review. Furthermore, this review also describes the challenges facing this field, solutions, and future directions of these smart human health rehabilitation technologies. By key items relationship and trends analysis, we found that motor control, rehabilitation, and upper limb are important key items in the MRCP-based BCI field. Despite the potential of these rehabilitation technologies, there is a great scarcity of literature related to RT and VR-MRCP-based BCI. However, the information on these rehabilitation methods can be beneficial in developing RT and VR-MRCP-based BCI rehabilitation devices to induce brain plasticity and restore motor impairment. Therefore, this review will provide the basis and references of the MRCP-based BCI used in rehabilitation applications for further clinical and research development.
Collapse
Affiliation(s)
- Ramadhan Rashid Said
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Md Belal Bin Heyat
- IoT Research Center, College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China
| | - Keer Song
- Franklin College of Arts and Science, University of Georgia, Athens, GA 30602, USA
| | - Chao Tian
- Department of Women’s Health, Sichuan Cancer Hospital, Chengdu 610044, China
| | - Zhe Wu
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, China
| |
Collapse
|
7
|
A Review of Brain Activity and EEG-Based Brain-Computer Interfaces for Rehabilitation Application. BIOENGINEERING (BASEL, SWITZERLAND) 2022; 9:bioengineering9120768. [PMID: 36550974 PMCID: PMC9774292 DOI: 10.3390/bioengineering9120768] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Revised: 11/29/2022] [Accepted: 11/30/2022] [Indexed: 12/12/2022]
Abstract
Patients with severe CNS injuries struggle primarily with their sensorimotor function and communication with the outside world. There is an urgent need for advanced neural rehabilitation and intelligent interaction technology to provide help for patients with nerve injuries. Recent studies have established the brain-computer interface (BCI) in order to provide patients with appropriate interaction methods or more intelligent rehabilitation training. This paper reviews the most recent research on brain-computer-interface-based non-invasive rehabilitation systems. Various endogenous and exogenous methods, advantages, limitations, and challenges are discussed and proposed. In addition, the paper discusses the communication between the various brain-computer interface modes used between severely paralyzed and locked patients and the surrounding environment, particularly the brain-computer interaction system utilizing exogenous (induced) EEG signals (such as P300 and SSVEP). This discussion reveals with an examination of the interface for collecting EEG signals, EEG components, and signal postprocessing. Furthermore, the paper describes the development of natural interaction strategies, with a focus on signal acquisition, data processing, pattern recognition algorithms, and control techniques.
Collapse
|
8
|
A Comprehensive Review of Endogenous EEG-Based BCIs for Dynamic Device Control. SENSORS 2022; 22:s22155802. [PMID: 35957360 PMCID: PMC9370865 DOI: 10.3390/s22155802] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Revised: 07/23/2022] [Accepted: 07/30/2022] [Indexed: 11/28/2022]
Abstract
Electroencephalogram (EEG)-based brain–computer interfaces (BCIs) provide a novel approach for controlling external devices. BCI technologies can be important enabling technologies for people with severe mobility impairment. Endogenous paradigms, which depend on user-generated commands and do not need external stimuli, can provide intuitive control of external devices. This paper discusses BCIs to control various physical devices such as exoskeletons, wheelchairs, mobile robots, and robotic arms. These technologies must be able to navigate complex environments or execute fine motor movements. Brain control of these devices presents an intricate research problem that merges signal processing and classification techniques with control theory. In particular, obtaining strong classification performance for endogenous BCIs is challenging, and EEG decoder output signals can be unstable. These issues present myriad research questions that are discussed in this review paper. This review covers papers published until the end of 2021 that presented BCI-controlled dynamic devices. It discusses the devices controlled, EEG paradigms, shared control, stabilization of the EEG signal, traditional machine learning and deep learning techniques, and user experience. The paper concludes with a discussion of open questions and avenues for future work.
Collapse
|
9
|
Measurement, Evaluation, and Control of Active Intelligent Gait Training Systems—Analysis of the Current State of the Art. ELECTRONICS 2022. [DOI: 10.3390/electronics11101633] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Gait recognition and rehabilitation has been a research hotspot in recent years due to its importance to medical care and elderly care. Active intelligent rehabilitation and assistance systems for lower limbs integrates mechanical design, sensing technology, intelligent control, and robotics technology, and is one of the effective ways to resolve the above problems. In this review, crucial technologies and typical prototypes of active intelligent rehabilitation and assistance systems for gait training are introduced. The limitations, challenges, and future directions in terms of gait measurement and intention recognition, gait rehabilitation evaluation, and gait training control strategies are discussed. To address the core problems of the sensing, evaluation and control technology of the active intelligent gait training systems, the possible future research directions are proposed. Firstly, different sensing methods need to be proposed for the decoding of human movement intention. Secondly, the human walking ability evaluation models will be developed by integrating the clinical knowledge and lower limb movement data. Lastly, the personalized gait training strategy for collaborative control of human–machine systems needs to be implemented in the clinical applications.
Collapse
|
10
|
Kumar A, Gao L, Li J, Ma J, Fu J, Gu X, Mahmoud SS, Fang Q. Error-Related Negativity-Based Robot-Assisted Stroke Rehabilitation System: Design and Proof-of-Concept. Front Neurorobot 2022; 16:837119. [PMID: 35548781 PMCID: PMC9085417 DOI: 10.3389/fnbot.2022.837119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2021] [Accepted: 03/04/2022] [Indexed: 12/02/2022] Open
Abstract
Conventional rehabilitation systems typically execute a fixed set of programs that most motor-impaired stroke patients undergo. In these systems, the brain, which is embodied in the body, is often left out. Including the brains of stroke patients in the control loop of a rehabilitation system can be worthwhile as the system can be tailored to each participant and, thus, be more effective. Here, we propose a novel brain-computer interface (BCI)-based robot-assisted stroke rehabilitation system (RASRS), which takes inputs from the patient's intrinsic feedback mechanism to adapt the assistance level of the RASRS. The proposed system will utilize the patients' consciousness about their performance decoded through their error-related negativity signals. As a proof-of-concept, we experimented on 12 healthy people in which we recorded their electroencephalogram (EEG) signals while performing a standard rehabilitation exercise. We set the performance requirements beforehand and observed participants' neural responses when they failed/met the set requirements and found a statistically significant (p < 0.05) difference in their neural responses in the two conditions. The feasibility of the proposed BCI-based RASRS was demonstrated through a use-case description with a timing diagram and meeting the crucial requirements for developing the proposed rehabilitation system. The use of a patient's intrinsic feedback mechanism will have significant implications for the development of human-in-the-loop stroke rehabilitation systems.
Collapse
Affiliation(s)
- Akshay Kumar
- Department of Biomedical Engineering, College of Engineering, Shantou University, Shantou, China
| | - Lin Gao
- Department of Biomedical Engineering, College of Engineering, Shantou University, Shantou, China
| | - Jiaming Li
- Department of Biomedical Engineering, College of Engineering, Shantou University, Shantou, China
| | - Jiaxin Ma
- OMRON SINIC X Corporation, Tokyo, Japan
| | | | - Xudong Gu
- 2nd Hospital of Jiaxing, Jiaxing, China
| | - Seedahmed S. Mahmoud
- Department of Biomedical Engineering, College of Engineering, Shantou University, Shantou, China
| | - Qiang Fang
- Department of Biomedical Engineering, College of Engineering, Shantou University, Shantou, China
- *Correspondence: Qiang Fang
| |
Collapse
|
11
|
Asanza V, Peláez E, Loayza F, Lorente-Leyva LL, Peluffo-Ordóñez DH. Identification of Lower-Limb Motor Tasks via Brain-Computer Interfaces: A Topical Overview. SENSORS (BASEL, SWITZERLAND) 2022; 22:2028. [PMID: 35271175 PMCID: PMC8914806 DOI: 10.3390/s22052028] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Revised: 02/11/2022] [Accepted: 02/23/2022] [Indexed: 02/01/2023]
Abstract
Recent engineering and neuroscience applications have led to the development of brain-computer interface (BCI) systems that improve the quality of life of people with motor disabilities. In the same area, a significant number of studies have been conducted in identifying or classifying upper-limb movement intentions. On the contrary, few works have been concerned with movement intention identification for lower limbs. Notwithstanding, lower-limb neurorehabilitation is a major topic in medical settings, as some people suffer from mobility problems in their lower limbs, such as those diagnosed with neurodegenerative disorders, such as multiple sclerosis, and people with hemiplegia or quadriplegia. Particularly, the conventional pattern recognition (PR) systems are one of the most suitable computational tools for electroencephalography (EEG) signal analysis as the explicit knowledge of the features involved in the PR process itself is crucial for both improving signal classification performance and providing more interpretability. In this regard, there is a real need for outline and comparative studies gathering benchmark and state-of-art PR techniques that allow for a deeper understanding thereof and a proper selection of a specific technique. This study conducted a topical overview of specialized papers covering lower-limb motor task identification through PR-based BCI/EEG signal analysis systems. To do so, we first established search terms and inclusion and exclusion criteria to find the most relevant papers on the subject. As a result, we identified the 22 most relevant papers. Next, we reviewed their experimental methodologies for recording EEG signals during the execution of lower limb tasks. In addition, we review the algorithms used in the preprocessing, feature extraction, and classification stages. Finally, we compared all the algorithms and determined which of them are the most suitable in terms of accuracy.
Collapse
Affiliation(s)
- Víctor Asanza
- Facultad de Ingeniería en Electricidad y Computación, Escuela Superior Politécnica del Litoral (ESPOL), Campus Gustavo Galindo km 30.5 Vía Perimetral, Guayaquil P.O. Box 09-01-5863, Ecuador;
| | - Enrique Peláez
- Facultad de Ingeniería en Electricidad y Computación, Escuela Superior Politécnica del Litoral (ESPOL), Campus Gustavo Galindo km 30.5 Vía Perimetral, Guayaquil P.O. Box 09-01-5863, Ecuador;
| | - Francis Loayza
- Neuroimaging and Bioengineering Laboratory (LNB), Facultad de Ingeniería en Mecánica y Ciencias de la Producción, Escuela Superior Politécnica del Litoral (ESPOL), Campus Gustavo Galindo km 30.5 Vía Perimetral, Guayaquil P.O. Box 09-01-5863, Ecuador;
| | | | - Diego H. Peluffo-Ordóñez
- Faculty of Engineering, Corporación Universitaria Autónoma de Nariño, Pasto 520001, Colombia;
- Modeling, Simulation and Data Analysis (MSDA) Research Program, Mohammed VI Polytechnic University, Ben Guerir 43150, Morocco
| |
Collapse
|
12
|
Hamid H, Naseer N, Nazeer H, Khan MJ, Khan RA, Shahbaz Khan U. Analyzing Classification Performance of fNIRS-BCI for Gait Rehabilitation Using Deep Neural Networks. SENSORS (BASEL, SWITZERLAND) 2022; 22:1932. [PMID: 35271077 PMCID: PMC8914987 DOI: 10.3390/s22051932] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/28/2022] [Revised: 02/21/2022] [Accepted: 02/25/2022] [Indexed: 05/11/2023]
Abstract
This research presents a brain-computer interface (BCI) framework for brain signal classification using deep learning (DL) and machine learning (ML) approaches on functional near-infrared spectroscopy (fNIRS) signals. fNIRS signals of motor execution for walking and rest tasks are acquired from the primary motor cortex in the brain's left hemisphere for nine subjects. DL algorithms, including convolutional neural networks (CNNs), long short-term memory (LSTM), and bidirectional LSTM (Bi-LSTM) are used to achieve average classification accuracies of 88.50%, 84.24%, and 85.13%, respectively. For comparison purposes, three conventional ML algorithms, support vector machine (SVM), k-nearest neighbor (k-NN), and linear discriminant analysis (LDA) are also used for classification, resulting in average classification accuracies of 73.91%, 74.24%, and 65.85%, respectively. This study successfully demonstrates that the enhanced performance of fNIRS-BCI can be achieved in terms of classification accuracy using DL approaches compared to conventional ML approaches. Furthermore, the control commands generated by these classifiers can be used to initiate and stop the gait cycle of the lower limb exoskeleton for gait rehabilitation.
Collapse
Affiliation(s)
- Huma Hamid
- Department of Mechatronics and Biomedical Engineering, Air University, Islamabad 44000, Pakistan; (H.H.); (H.N.)
| | - Noman Naseer
- Department of Mechatronics and Biomedical Engineering, Air University, Islamabad 44000, Pakistan; (H.H.); (H.N.)
| | - Hammad Nazeer
- Department of Mechatronics and Biomedical Engineering, Air University, Islamabad 44000, Pakistan; (H.H.); (H.N.)
| | - Muhammad Jawad Khan
- School of Mechanical and Manufacturing Engineering, National University of Science and Technology, Islamabad 44000, Pakistan;
| | - Rayyan Azam Khan
- Department of Mechanical Engineering, University of Saskatchewan, Saskatoon, SK S7N 5A9, Canada;
| | - Umar Shahbaz Khan
- Department of Mechatronics Engineering, National University of Sciences and Technology, Islamabad 44000, Pakistan;
- National Centre of Robotics and Automation (NCRA), Rawalpindi 46000, Pakistan
| |
Collapse
|
13
|
Sanjeevi N, Singh Y, Vashista V. Recent advances in lower-extremity exoskeletons in promoting performance restoration. CURRENT OPINION IN BIOMEDICAL ENGINEERING 2021. [DOI: 10.1016/j.cobme.2021.100338] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
|
14
|
Brain Symmetry Analysis during the Use of a BCI Based on Motor Imagery for the Control of a Lower-Limb Exoskeleton. Symmetry (Basel) 2021. [DOI: 10.3390/sym13091746] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Brain–Computer Interfaces (BCI) are systems that allow external devices to be controlled by means of brain activity. There are different such technologies, and electroencephalography (EEG) is an example. One of the most common EEG control methods is based on detecting changes in sensorimotor rhythms (SMRs) during motor imagery (MI). The aim of this study was to assess the laterality of cortical function when performing MI of the lower limb. Brain signals from five subjects were analyzed in two conditions, during exoskeleton-assisted gait and while static. Three different EEG electrode configurations were evaluated: covering both hemispheres, covering the non-dominant hemisphere and covering the dominant hemisphere. In addition, the evolution of performance and laterality with practice was assessed. Although sightly superior results were achieved with information from all electrodes, differences between electrode configurations were not statistically significant. Regarding the evolution during the experimental sessions, the performance of the BCI generally evolved positively the higher the experience was.
Collapse
|
15
|
Kumar A, Pirogova E, Mahmoud SS, Fang Q. Classification of error-related potentials evoked during stroke rehabilitation training. J Neural Eng 2021; 18. [PMID: 34384052 DOI: 10.1088/1741-2552/ac1d32] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2020] [Accepted: 08/12/2021] [Indexed: 01/22/2023]
Abstract
Objective.Error-related potentials (ErrPs) are elicited in the human brain following an error's perception. Recently, ErrPs have been observed in a novel task situation, i.e. when stroke patients perform upper-limb rehabilitation exercises. These ErrPs can be used to developassist-as-needed(AAN) robotic stroke rehabilitation systems. However, to date, there is no reported research on assessing the feasibility of using the ErrPs to implement the AAN approach. Hence, in this study, we evaluated and compared the single-trial classification of novel ErrPs using various classical machine learning and deep learning approaches.Approach.Electroencephalogram data of 13 stroke patients recorded while performing an upper-limb physical rehabilitation exercise were used. Two classification approaches, one combining the xDAWN spatial filtering and support vector machines, and the other using a convolutional neural network-based double transfer learning, were utilized.Main results.Results showed that the ErrPs could be detected with a mean area under the receiver operating characteristics curve of 0.838, and a mean accuracy of 0.842, 0.257 above the chance level (p< 0.05), for a within-subject classification. The results indicated the feasibility of using ErrP signals in real-time AAN robot therapy with evidence from the conducted latency analysis, cross-subject classification, and three-class asynchronous classification.Significance.The findings presented support our proposed approach of using ErrPs as a measure to trigger and/or modulate as required the robotic assistance in a real-timehuman-in-the-looprobotic stroke rehabilitation system.
Collapse
Affiliation(s)
- Akshay Kumar
- Department of Biomedical Engineering, College of Engineering, Shantou University, Guangdong, People's Republic of China
| | - Elena Pirogova
- School of Engineering, Royal Melbourne Institute of Technology University, Melbourne, Australia
| | - Seedahmed S Mahmoud
- Department of Biomedical Engineering, College of Engineering, Shantou University, Guangdong, People's Republic of China
| | - Qiang Fang
- Department of Biomedical Engineering, College of Engineering, Shantou University, Guangdong, People's Republic of China
| |
Collapse
|
16
|
Assessment Methods of Usability and Cognitive Workload of Rehabilitative Exoskeletons: A Systematic Review. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11157146] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
Abstract
Robotic exoskeleton technologies are applied in the medical field to help patients with impaired mobility to recover their motor functions. Relevant literature shows that usability and cognitive workload may influence the patients’ likelihood to benefit from the use of rehabilitative exoskeletons. Following the PRISMA method, the present study aimed to systematically review the assessment methods of usability and cognitive workload in the use of exoskeletal devices for motor rehabilitation. The literature search was conducted in the Scopus and Web of Science bibliographical databases, using 16 keywords that were combined into one search query. A final sample of 23 articles was included in the review, from which 18 distinct assessment methods were identified. Of them, 15 aimed to assess usability, whereas 3 aimed to assess cognitive workload in the use of rehabilitative exoskeletons. Some of the identified methods (e.g., SUS, QUEST, SWAT, and NASA-TLX) showed good psychometric properties and were therefore proven to be appropriate to assess usability and cognitive workload while performing exoskeleton-based rehabilitation. The current study may contribute to the development of guidelines and analytical tools for exoskeletons’ usability and exoskeleton-related patients’ cognitive workload in the domain of medical rehabilitation.
Collapse
|
17
|
Jamil N, Belkacem AN, Ouhbi S, Lakas A. Noninvasive Electroencephalography Equipment for Assistive, Adaptive, and Rehabilitative Brain-Computer Interfaces: A Systematic Literature Review. SENSORS (BASEL, SWITZERLAND) 2021; 21:4754. [PMID: 34300492 PMCID: PMC8309653 DOI: 10.3390/s21144754] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/06/2021] [Revised: 06/28/2021] [Accepted: 07/09/2021] [Indexed: 11/30/2022]
Abstract
Humans interact with computers through various devices. Such interactions may not require any physical movement, thus aiding people with severe motor disabilities in communicating with external devices. The brain-computer interface (BCI) has turned into a field involving new elements for assistive and rehabilitative technologies. This systematic literature review (SLR) aims to help BCI investigator and investors to decide which devices to select or which studies to support based on the current market examination. This examination of noninvasive EEG devices is based on published BCI studies in different research areas. In this SLR, the research area of noninvasive BCIs using electroencephalography (EEG) was analyzed by examining the types of equipment used for assistive, adaptive, and rehabilitative BCIs. For this SLR, candidate studies were selected from the IEEE digital library, PubMed, Scopus, and ScienceDirect. The inclusion criteria (IC) were limited to studies focusing on applications and devices of the BCI technology. The data used herein were selected using IC and exclusion criteria to ensure quality assessment. The selected articles were divided into four main research areas: education, engineering, entertainment, and medicine. Overall, 238 papers were selected based on IC. Moreover, 28 companies were identified that developed wired and wireless equipment as means of BCI assistive technology. The findings of this review indicate that the implications of using BCIs for assistive, adaptive, and rehabilitative technologies are encouraging for people with severe motor disabilities and healthy people. With an increasing number of healthy people using BCIs, other research areas, such as the motivation of players when participating in games or the security of soldiers when observing certain areas, can be studied and collaborated using the BCI technology. However, such BCI systems must be simple (wearable), convenient (sensor fabrics and self-adjusting abilities), and inexpensive.
Collapse
Affiliation(s)
- Nuraini Jamil
- Department of Computer Science and Software Engineering, College of Information Technology, United Arab Emirates University, Al Ain P.O. Box 15551, United Arab Emirates; (N.J.); (S.O.)
| | - Abdelkader Nasreddine Belkacem
- Department of Computer and Network Engineering, College of Information Technology, United Arab Emirates University, Al Ain P.O. Box 15551, United Arab Emirates;
| | - Sofia Ouhbi
- Department of Computer Science and Software Engineering, College of Information Technology, United Arab Emirates University, Al Ain P.O. Box 15551, United Arab Emirates; (N.J.); (S.O.)
| | - Abderrahmane Lakas
- Department of Computer and Network Engineering, College of Information Technology, United Arab Emirates University, Al Ain P.O. Box 15551, United Arab Emirates;
| |
Collapse
|
18
|
A BMI Based on Motor Imagery and Attention for Commanding a Lower-Limb Robotic Exoskeleton: A Case Study. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11094106] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
Lower-limb robotic exoskeletons are wearable devices that can be beneficial for people with lower-extremity motor impairment because they can be valuable in rehabilitation or assistance. These devices can be controlled mentally by means of brain–machine interfaces (BMI). The aim of the present study was the design of a BMI based on motor imagery (MI) to control the gait of a lower-limb exoskeleton. The evaluation is carried out with able-bodied subjects as a preliminary study since potential users are people with motor limitations. The proposed control works as a state machine, i.e., the decoding algorithm is different to start (standing still) and to stop (walking). The BMI combines two different paradigms for reducing the false triggering rate (when the BMI identifies irrelevant brain tasks as MI), one based on motor imagery and another one based on the attention to the gait of the user. Research was divided into two parts. First, during the training phase, results showed an average accuracy of 68.44 ± 8.46% for the MI paradigm and 65.45 ± 5.53% for the attention paradigm. Then, during the test phase, the exoskeleton was controlled by the BMI and the average performance was 64.50 ± 10.66%, with very few false positives. Participants completed various sessions and there was a significant improvement over time. These results indicate that, after several sessions, the developed system may be employed for controlling a lower-limb exoskeleton, which could benefit people with motor impairment as an assistance device and/or as a therapeutic approach with very limited false activations.
Collapse
|
19
|
Zhang J, Wang M. A survey on robots controlled by motor imagery brain-computer interfaces. COGNITIVE ROBOTICS 2021. [DOI: 10.1016/j.cogr.2021.02.001] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
20
|
Tortora S, Tonin L, Chisari C, Micera S, Menegatti E, Artoni F. Hybrid Human-Machine Interface for Gait Decoding Through Bayesian Fusion of EEG and EMG Classifiers. Front Neurorobot 2020; 14:582728. [PMID: 33281593 PMCID: PMC7705173 DOI: 10.3389/fnbot.2020.582728] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2020] [Accepted: 09/30/2020] [Indexed: 01/25/2023] Open
Abstract
Despite the advances in the field of brain computer interfaces (BCI), the use of the sole electroencephalography (EEG) signal to control walking rehabilitation devices is currently not viable in clinical settings, due to its unreliability. Hybrid interfaces (hHMIs) represent a very recent solution to enhance the performance of single-signal approaches. These are classification approaches that combine multiple human-machine interfaces, normally including at least one BCI with other biosignals, such as the electromyography (EMG). However, their use for the decoding of gait activity is still limited. In this work, we propose and evaluate a hybrid human-machine interface (hHMI) to decode walking phases of both legs from the Bayesian fusion of EEG and EMG signals. The proposed hHMI significantly outperforms its single-signal counterparts, by providing high and stable performance even when the reliability of the muscular activity is compromised temporarily (e.g., fatigue) or permanently (e.g., weakness). Indeed, the hybrid approach shows a smooth degradation of classification performance after temporary EMG alteration, with more than 75% of accuracy at 30% of EMG amplitude, with respect to the EMG classifier whose performance decreases below 60% of accuracy. Moreover, the fusion of EEG and EMG information helps keeping a stable recognition rate of each gait phase of more than 80% independently on the permanent level of EMG degradation. From our study and findings from the literature, we suggest that the use of hybrid interfaces may be the key to enhance the usability of technologies restoring or assisting the locomotion on a wider population of patients in clinical applications and outside the laboratory environment.
Collapse
Affiliation(s)
- Stefano Tortora
- Department of Information Engineering, University of Padova, Padova, Italy
| | - Luca Tonin
- Department of Information Engineering, University of Padova, Padova, Italy
| | - Carmelo Chisari
- Unit of Neurorehabilitation, Department of Medical Specialties, University Hospital of Pisa, Pisa, Italy
| | - Silvestro Micera
- Department of Excellence in Robotics and AI Scuola Superiore Sant'Anna, The Biorobotics Institute, Pisa, Italy.,Bertarelli Foundation Chair in Translational Neuroengineering, Center for Neuroprosthetics and Institute of Bioengineering, Lausanne, Switzerland
| | - Emanuele Menegatti
- Department of Information Engineering, University of Padova, Padova, Italy
| | - Fiorenzo Artoni
- Bertarelli Foundation Chair in Translational Neuroengineering, Center for Neuroprosthetics and Institute of Bioengineering, Lausanne, Switzerland.,Functional Brain Mapping Laboratory, Department of Basic Neuroscience, Faculty of Medicine, University of Geneva, Geneva, Switzerland
| |
Collapse
|
21
|
Liang C, Hsiao T. Walking Strategies and Performance Evaluation for Human-Exoskeleton Systems under Admittance Control. SENSORS (BASEL, SWITZERLAND) 2020; 20:s20154346. [PMID: 32759803 PMCID: PMC7436263 DOI: 10.3390/s20154346] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/16/2020] [Revised: 07/28/2020] [Accepted: 07/30/2020] [Indexed: 06/11/2023]
Abstract
Lower-limb exoskeletons as walking assistive devices have been intensively investigated in recent decades. In these studies, intention detection and performance evaluation are important topics. In our previous studies, we proposed a disturbance observer (DOB)-based torque estimation algorithm and an admittance control law to shape the admittance of the human-exoskeleton system (HES) and comply with the user's walking intention. These algorithms have been experimentally verified under the condition of no ground reaction force (GRF) in our previous studies. In this paper, we devised and integrated with the exoskeleton control system a sensing and communication module on each foot to measure and compensate for GRF. Rigorous theoretical analysis was performed and the sufficient conditions for the robust stability of the closed-loop system were derived. Then, we conducted level ground assistive walking repeatedly with different test subjects and exhaustive combinations of admittance parameters. In addition, we proposed two tractable and physically insightful performance indices called normalized energy consumption index (NECI) and walking distance in a fixed period of time to quantitatively evaluate the performance for different admittance parameters. We also compared the energy consumption for users walking with and without the exoskeleton. The results show that the proposed admittance control law reduces the energy consumption of the user during level ground walking.
Collapse
|
22
|
Tortora S, Ghidoni S, Chisari C, Micera S, Artoni F. Deep learning-based BCI for gait decoding from EEG with LSTM recurrent neural network. J Neural Eng 2020; 17:046011. [DOI: 10.1088/1741-2552/ab9842] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
|
23
|
Lennon O, Tonellato M, Del Felice A, Di Marco R, Fingleton C, Korik A, Guanziroli E, Molteni F, Guger C, Otner R, Coyle D. A Systematic Review Establishing the Current State-of-the-Art, the Limitations, and the DESIRED Checklist in Studies of Direct Neural Interfacing With Robotic Gait Devices in Stroke Rehabilitation. Front Neurosci 2020; 14:578. [PMID: 32714127 PMCID: PMC7344195 DOI: 10.3389/fnins.2020.00578] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2019] [Accepted: 05/12/2020] [Indexed: 01/16/2023] Open
Abstract
Background: Stroke is a disease with a high associated disability burden. Robotic-assisted gait training offers an opportunity for the practice intensity levels associated with good functional walking outcomes in this population. Neural interfacing technology, electroencephalography (EEG), or electromyography (EMG) can offer new strategies for robotic gait re-education after a stroke by promoting more active engagement in movement intent and/or neurophysiological feedback. Objectives: This study identifies the current state-of-the-art and the limitations in direct neural interfacing with robotic gait devices in stroke rehabilitation. Methods: A pre-registered systematic review was conducted using standardized search operators that included the presence of stroke and robotic gait training and neural biosignals (EMG and/or EEG) and was not limited by study type. Results: From a total of 8,899 papers identified, 13 articles were considered for the final selection. Only five of the 13 studies received a strong or moderate quality rating as a clinical study. Three studies recorded EEG activity during robotic gait, two of which used EEG for BCI purposes. While demonstrating utility for decoding kinematic and EMG-related gait data, no EEG study has been identified to close the loop between robot and human. Twelve of the studies recorded EMG activity during or after robotic walking, primarily as an outcome measure. One study used multisource information fusion from EMG, joint angle, and force to modify robotic commands in real time, with higher error rates observed during active movement. A novel study identified used EMG data during robotic gait to derive the optimal, individualized robot-driven step trajectory. Conclusions: Wide heterogeneity in the reporting and the purpose of neurobiosignal use during robotic gait training after a stroke exists. Neural interfacing with robotic gait after a stroke demonstrates promise as a future field of study. However, as a nascent area, direct neural interfacing with robotic gait after a stroke would benefit from a more standardized protocol for biosignal collection and processing and for robotic deployment. Appropriate reporting for clinical studies of this nature is also required with respect to the study type and the participants' characteristics.
Collapse
Affiliation(s)
- Olive Lennon
- School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Michele Tonellato
- Department of Neuroscience, Rehabilitation Unit, University of Padova, Padova, Italy
| | - Alessandra Del Felice
- Department of Neuroscience, NEUROMOVE-Rehab Laboratory, University of Padova, Padova, Italy
- Padova Neuroscience Center, University of Padova, Padova, Italy
| | - Roberto Di Marco
- Department of Neuroscience, NEUROMOVE-Rehab Laboratory, University of Padova, Padova, Italy
| | - Caitriona Fingleton
- Department of Physiotherapy, Mater Misericordiae University Hospital, Dublin, Ireland
| | - Attila Korik
- Intelligent Systems Research Centre, School of Computing, Engineering and Intelligent Systems, Ulster University, Derry, United Kingdom
| | | | - Franco Molteni
- Villa Beretta Rehabilitation Center, Valduce Hospital, Costa Masnaga, Italy
| | | | - Rupert Otner
- g.tec Medical Engineering GmbH, Schiedlberg, Austria
| | - Damien Coyle
- Intelligent Systems Research Centre, School of Computing, Engineering and Intelligent Systems, Ulster University, Derry, United Kingdom
| |
Collapse
|
24
|
Kumar A, Fang Q, Fu J, Pirogova E, Gu X. Error-Related Neural Responses Recorded by Electroencephalography During Post-stroke Rehabilitation Movements. Front Neurorobot 2019; 13:107. [PMID: 31920616 PMCID: PMC6934053 DOI: 10.3389/fnbot.2019.00107] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2019] [Accepted: 12/06/2019] [Indexed: 01/07/2023] Open
Abstract
Error-related potential (ErrP) based assist-as-needed robot-therapy can be an effective rehabilitation method. To date, several studies have shown the presence of ErrP under various task situations. However, in the context of assist-as-needed methods, the existence of ErrP is unexplored. Therefore, the principal objective of this study is to determine if an ErrP can be evoked when a subject is unable to complete a physical exercise in a given time. Fifteen stroke patients participated in an experiment that involved performing a physical rehabilitation exercise. Results showed that the electroencephalographic (EEG) response of the trials, where patients failed to complete the exercise, against the trials, where patients successfully completed the exercise, significantly differ from each other, and the resulting difference of event-related potentials resembles the previously reported ErrP signals as well as has some unique features. Along with the highly statistically significant difference, the trials differ in time-frequency patterns and scalp distribution maps. In summary, the results of the study provide a novel basis for the detection of the failure against the success events while executing rehabilitation exercises that can be used to improve the state-of-the-art robot-assisted rehabilitation methods.
Collapse
Affiliation(s)
- Akshay Kumar
- School of Engineering, RMIT University, Melbourne, VIC, Australia
| | - Qiang Fang
- College of Engineering, Shantou University, Shantou, China
| | | | - Elena Pirogova
- School of Engineering, RMIT University, Melbourne, VIC, Australia
| | - Xudong Gu
- 2nd Hospital of Jiaxing, Jiaxing, China
| |
Collapse
|
25
|
Zhao X, Chen WH, Li B, Wu X, Wang J. An adaptive stair-ascending gait generation approach based on depth camera for lower limb exoskeleton. THE REVIEW OF SCIENTIFIC INSTRUMENTS 2019; 90:125112. [PMID: 31893777 DOI: 10.1063/1.5109741] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/11/2019] [Accepted: 11/16/2019] [Indexed: 06/10/2023]
Abstract
The mobility on stairways is a daily challenge for seniors and people with dyskinesia. Lower limb exoskeletons can be effective assistants to improve their life quality. In this paper, we present an adaptive stair-ascending gait generation algorithm based on a depth camera for lower limb exoskeletons. We first construct a linked-list-based stairway model with the point cloud captured from the depth camera. Then, an optimal foothold point is calculated based on the linked-list stair model for gait generation. Finally, the exoskeleton takes the stair-ascending gait of healthy people as a reference and generates appropriate gait for the stair. The proposed gait generation algorithm is initially validated through holistic simulation analyses. We tested the stairway modeling algorithm on varieties of indoor and outdoor stairways and evaluated the gait generation algorithm on stairs of different height. The subjects' stair walking tests with lower limb exoskeletons show the effectiveness of the proposed stairway modeling and gait generation approaches.
Collapse
Affiliation(s)
- Xiaoming Zhao
- School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China
| | - Wei-Hai Chen
- College of Electrical Engineering and Automation, Shandong University of Science and Technology, Qingdao 266590, China
| | - Bing Li
- Department of Automotive Engineering, Clemson University, Greenville, South Carolina 29607, USA
| | - Xingming Wu
- School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China
| | - Jianhua Wang
- School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China
| |
Collapse
|
26
|
Delgado MR. Disability in the Fourth Industrial Revolution. Dev Med Child Neurol 2019; 61:993. [PMID: 31373401 DOI: 10.1111/dmcn.14296] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
27
|
EEG-Based Control for Upper and Lower Limb Exoskeletons and Prostheses: A Systematic Review. SENSORS 2018; 18:s18103342. [PMID: 30301238 PMCID: PMC6211123 DOI: 10.3390/s18103342] [Citation(s) in RCA: 38] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/14/2018] [Revised: 09/12/2018] [Accepted: 09/28/2018] [Indexed: 12/13/2022]
Abstract
Electroencephalography (EEG) signals have great impact on the development of assistive rehabilitation devices. These signals are used as a popular tool to investigate the functions and the behavior of the human motion in recent research. The study of EEG-based control of assistive devices is still in early stages. Although the EEG-based control of assistive devices has attracted a considerable level of attention over the last few years, few studies have been carried out to systematically review these studies, as a means of offering researchers and experts a comprehensive summary of the present, state-of-the-art EEG-based control techniques used for assistive technology. Therefore, this research has three main goals. The first aim is to systematically gather, summarize, evaluate and synthesize information regarding the accuracy and the value of previous research published in the literature between 2011 and 2018. The second goal is to extensively report on the holistic, experimental outcomes of this domain in relation to current research. It is systematically performed to provide a wealthy image and grounded evidence of the current state of research covering EEG-based control for assistive rehabilitation devices to all the experts and scientists. The third goal is to recognize the gap of knowledge that demands further investigation and to recommend directions for future research in this area.
Collapse
|