1
|
Cervera-Negueruela M, Chee L, Cimolato A, Valle G, Tschopp M, Menke M, Papazoglou A, Raspopovic S. Bionic blink improves real-time eye closure in unilateral facial paralysis. J Neural Eng 2024; 21:026020. [PMID: 38507808 DOI: 10.1088/1741-2552/ad35e7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Accepted: 03/20/2024] [Indexed: 03/22/2024]
Abstract
Facial paralysis is the inability to move facial muscles thereby impairing the ability to blink and make facial expressions. Depending on the localization of the nerve malfunction it is subcategorised into central or peripheral and is usually unilateral. This leads to health deficits stemming from corneal dryness and social ostracization.Objective: Electrical stimulation shows promise as a method through which to restore the blink function and as a result improve eye health. However, it is unknown whether a real-time, myoelectrically controlled, neurostimulating device can be used as assistance to this pathological condition.Approach: We developed NEURO-BLINK, a wearable robotic system, that can detect the volitional healthy contralateral blink through electromyography and electrically stimulate the impaired subcutaneous facial nerve and orbicularis oculi muscle to compensate for lost blink function. Alongside the system, we developed a method to evaluate optimal electrode placement through the relationship between blink amplitude and injected charge.Main results: Ten patients with unilateral facial palsy were enrolled in the NEURO-BLINK study, with eight completing testing under two conditions. (1) where the stimulation was cued with an auditory signal (i.e. paced controlled) and (2) synchronized with the natural blink (i.e. myoelectrically controlled). In both scenarios, overall eye closure (distance between eyelids) and cornea coverage measured with high FPS video were found to significantly improve when measured in real-time, while no significant clinical changes were found immediately after use.Significance: This work takes steps towards the development of a portable medical device for blink restoration and facial stimulation which has the potential to improve long-term ocular health.
Collapse
Affiliation(s)
- Mar Cervera-Negueruela
- Department of Health Sciences and Technology, Neuroengineering Laboratory, ETH Zürich, Tannenstrasse 1, 8092 Zürich, Switzerland
| | - Lauren Chee
- Department of Health Sciences and Technology, Neuroengineering Laboratory, ETH Zürich, Tannenstrasse 1, 8092 Zürich, Switzerland
| | - Andrea Cimolato
- Department of Health Sciences and Technology, Neuroengineering Laboratory, ETH Zürich, Tannenstrasse 1, 8092 Zürich, Switzerland
| | - Giacomo Valle
- Department of Health Sciences and Technology, Neuroengineering Laboratory, ETH Zürich, Tannenstrasse 1, 8092 Zürich, Switzerland
| | - Markus Tschopp
- Department of Ophthalmology, Cantonal Hospital Aarau, Aarau, Switzerland
- Department of Ophthalmology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Marcel Menke
- Department of Ophthalmology, Cantonal Hospital Aarau, Aarau, Switzerland
- Department of Ophthalmology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Anthia Papazoglou
- Department of Ophthalmology, Cantonal Hospital Aarau, Aarau, Switzerland
- Medical Faculty, University of Zurich, Zurich, Switzerland
| | - Stanisa Raspopovic
- Department of Health Sciences and Technology, Neuroengineering Laboratory, ETH Zürich, Tannenstrasse 1, 8092 Zürich, Switzerland
| |
Collapse
|
2
|
Guo K, Orban M, Lu J, Al-Quraishi MS, Yang H, Elsamanty M. Empowering Hand Rehabilitation with AI-Powered Gesture Recognition: A Study of an sEMG-Based System. Bioengineering (Basel) 2023; 10:bioengineering10050557. [PMID: 37237627 DOI: 10.3390/bioengineering10050557] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2023] [Revised: 04/30/2023] [Accepted: 05/03/2023] [Indexed: 05/28/2023] Open
Abstract
Stroke is one of the most prevalent health issues that people face today, causing long-term complications such as paresis, hemiparesis, and aphasia. These conditions significantly impact a patient's physical abilities and cause financial and social hardships. In order to address these challenges, this paper presents a groundbreaking solution-a wearable rehabilitation glove. This motorized glove is designed to provide comfortable and effective rehabilitation for patients with paresis. Its unique soft materials and compact size make it easy to use in clinical settings and at home. The glove can train each finger individually and all fingers together, using assistive force generated by advanced linear integrated actuators controlled by sEMG signals. The glove is also durable and long-lasting, with 4-5 h of battery life. The wearable motorized glove is worn on the affected hand to provide assistive force during rehabilitation training. The key to this glove's effectiveness is its ability to perform the classified hand gestures acquired from the non-affected hand by integrating four sEMG sensors and a deep learning algorithm (the 1D-CNN algorithm and the InceptionTime algorithm). The InceptionTime algorithm classified ten hand gestures' sEMG signals with an accuracy of 91.60% and 90.09% in the training and verification sets, respectively. The overall accuracy was 90.89%. It showed potential as a tool for developing effective hand gesture recognition systems. The classified hand gestures can be used as a control command for the motorized wearable glove placed on the affected hand, allowing it to mimic the movements of the non-affected hand. This innovative technology performs rehabilitation exercises based on the theory of mirror therapy and task-oriented therapy. Overall, this wearable rehabilitation glove represents a significant step forward in stroke rehabilitation, offering a practical and effective solution to help patients recover from stroke's physical, financial, and social impact.
Collapse
Affiliation(s)
- Kai Guo
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230026, China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
| | - Mostafa Orban
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230026, China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
- Mechanical Department, Faculty of Engineering at Shoubra, Benha University, Cairo 11672, Egypt
| | - Jingxin Lu
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
- School of Mechanical and Electrical Engineering, Changchun University of Science and Technology, Changchun 130001, China
| | | | - Hongbo Yang
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230026, China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
- School of Mechanical and Electrical Engineering, Changchun University of Science and Technology, Changchun 130001, China
| | - Mahmoud Elsamanty
- Mechanical Department, Faculty of Engineering at Shoubra, Benha University, Cairo 11672, Egypt
- Mechatronics and Robotics Department, School of Innovative Design Engineering, Egypt-Japan University of Science and Technology, Alexandria 21934, Egypt
| |
Collapse
|
3
|
Liu C, Li J, Zhang S, Yang H, Guo K. Study on Flexible sEMG Acquisition System and Its Application in Muscle Strength Evaluation and Hand Rehabilitation. MICROMACHINES 2022; 13:mi13122047. [PMID: 36557346 PMCID: PMC9782516 DOI: 10.3390/mi13122047] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/09/2022] [Revised: 11/18/2022] [Accepted: 11/20/2022] [Indexed: 06/01/2023]
Abstract
Wearable devices based on surface electromyography (sEMG) to detect muscle activity can be used to assess muscle strength with the development of hand rehabilitation applications. However, conventional acquisition devices are usually complicated to operate and poorly comfortable for more medical and scientific application scenarios. Here, we report a flexible sEMG acquisition system that combines a graphene-based flexible electrode with a signal acquisition flexible printed circuit (FPC) board. Our system utilizes a polydimethylsiloxane (PDMS) substrate combined with graphene transfer technology to develop a flexible sEMG sensor. The single-lead sEMG acquisition system was designed and the FPC board was fabricated considering the requirements of flexible bending and twisting. We demonstrate the above design approach and extend this flexible sEMG acquisition system to applications for assessing muscle strength and hand rehabilitation training using a long- and short-term memory network training model trained to predict muscle strength, with 98.81% accuracy in the test set. The device exhibited good flexion and comfort characteristics. In general, the ability to accurately and imperceptibly monitor surface electromyography (EMG) signals is critical for medical professionals and patients.
Collapse
Affiliation(s)
- Chang Liu
- College of Mechanical and Electrical Engineering, Changchun University of Science and Technology, Changchun 130022, China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
| | - Jiuqiang Li
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230026, China
| | - Senhao Zhang
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230026, China
| | - Hongbo Yang
- College of Mechanical and Electrical Engineering, Changchun University of Science and Technology, Changchun 130022, China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230026, China
| | - Kai Guo
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230026, China
| |
Collapse
|
4
|
Xu B, Zhang K, Yang X, Liu D, Hu C, Li H, Song A. Natural grasping movement recognition and force estimation using electromyography. Front Neurosci 2022; 16:1020086. [DOI: 10.3389/fnins.2022.1020086] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Accepted: 10/06/2022] [Indexed: 11/13/2022] Open
Abstract
Electromyography (EMG) generated by human hand movements is usually used to decode different action types with high accuracy. However, the classifications of the gestures rarely consider the impact of force, and the estimation of the grasp force when performing natural grasping movements is so far overlooked. Decoding natural grasping movements and estimating the force generated by the associated movements can help patients to improve the accuracy of prosthesis control. This study mainly focused on two aspects: the classification of four natural grasping movements and the force estimation of these actions. For this purpose, we designed an experimental platform where subjects could perform four common natural grasping movements in daily life, including pinch, palmar, twist, and plug grasp, to complete target profiles. On the one hand, the results showed that, for natural grasping movements with different levels of force (three levels at 20, 50, and 80%), the average accuracy could reach from 91.43 to 97.33% under five classification schemes. On the other hand, the feasibility of force estimation for natural grasping movements was demonstrated. Furthermore, in the process of force estimation, we confirmed that the regression performance about plug grasp was the best, and the average R2 could reach 0.9082. Besides, we found that the regression results were affected by the speed of force application. These findings contribute to the natural control of myoelectric prosthesis and the EMG-based rehabilitation training system, improving the user’s experience and acceptance.
Collapse
|
5
|
Zhang X, Tricomi E, Missiroli F, Lotti N, Bokranz C, Nicklas D, Masia L. Enhancing Gait Assistance Control Robustness of a Hip Exosuit by Means of Machine Learning. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3183791] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Affiliation(s)
- Xiaohui Zhang
- Institut für Technische Informatik (ZITI), Heidelberg University, Heidelberg, Deutschland
| | - Enrica Tricomi
- Institut für Technische Informatik (ZITI), Heidelberg University, Heidelberg, Deutschland
| | - Francesco Missiroli
- Institut für Technische Informatik (ZITI), Heidelberg University, Heidelberg, Deutschland
| | - Nicola Lotti
- Institut für Technische Informatik (ZITI), Heidelberg University, Heidelberg, Deutschland
| | - Casimir Bokranz
- Institut für Technische Informatik (ZITI), Heidelberg University, Heidelberg, Deutschland
| | - Daniela Nicklas
- Institut für Technische Informatik (ZITI), Heidelberg University, Heidelberg, Deutschland
| | - Lorenzo Masia
- Institut für Technische Informatik (ZITI), Heidelberg University, Heidelberg, Deutschland
| |
Collapse
|
6
|
RBF Sliding Mode Control Method for an Upper Limb Rehabilitation Exoskeleton Based on Intent Recognition. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12104993] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Aiming at the lack of active willingness of patients to participate in the current upper limb exoskeleton rehabilitation training control methods, this study proposed a radial basis function (RBF) sliding mode impedance control method based on surface electromyography (sEMG) to identify the movement intention of upper limb rehabilitation. The proposed control method realizes the process of active and passive rehabilitation training according to the wearer’s movement intention. This study first established a joint angle prediction model based on sEMG for the problem of poor human–machine coupling and used the least-squares support vector machine method (LSSVM) to complete the upper limb joint angle prediction. In addition, in view of the problem of poor compliance in the rehabilitation training process, an adaptive sliding mode controller based on the RBF network approximation system model was proposed. In the process of active training, an impedance model was added based on the position loop control, which could dynamically adjust the motion trajectory according to the interaction force. The experiment results showed that the impedance control method based on the RBF could effectively reduce the interaction force between the human and machine to improve the compliance of the exoskeleton manipulator and achieve the purpose of stabilizing the impedance characteristics of the system.
Collapse
|
7
|
Current State of Robotics in Hand Rehabilitation after Stroke: A Systematic Review. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12094540] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
Among the methods of hand function rehabilitation after stroke, robot-assisted rehabilitation is widely used, and the use of hand rehabilitation robots can provide functional training of the hand or assist the paralyzed hand with activities of daily living. However, patients with hand disorders consistently report that the needs of some users are not being met. The purpose of this review is to understand the reasons why these user needs are not being adequately addressed, to explore research on hand rehabilitation robots, to review their current state of research in recent years, and to summarize future trends in the hope that it will be useful to researchers in this research area. This review summarizes the techniques in this paper in a systematic way. We first provide a comprehensive review of research institutions, commercial products, and literature. Thus, the state of the art and deficiencies of functional hand rehabilitation robots are sought and guide the development of subsequent hand rehabilitation robots. This review focuses specifically on the actuation and control of hand functional rehabilitation robots, as user needs are primarily focused on actuation and control strategies. We also review hand detection technologies and compare them with patient needs. The results show that the trends in recent years are more inclined to pursue new lightweight materials to improve hand adaptability, investigating intelligent control methods for human-robot interaction in hand functional rehabilitation robots to improve control robustness and accuracy, and VR virtual task positioning to improve the effectiveness of active rehabilitation training.
Collapse
|