1
|
Wu D, Tian P, Zhang S, Wang Q, Yu K, Wang Y, Gao Z, Huang L, Li X, Zhai X, Tian M, Huang C, Zhang H, Zhang J. A Surface Electromyography (sEMG) System Applied for Grip Force Monitoring. SENSORS (BASEL, SWITZERLAND) 2024; 24:3818. [PMID: 38931601 PMCID: PMC11207591 DOI: 10.3390/s24123818] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/11/2024] [Revised: 05/31/2024] [Accepted: 06/07/2024] [Indexed: 06/28/2024]
Abstract
Muscles play an indispensable role in human life. Surface electromyography (sEMG), as a non-invasive method, is crucial for monitoring muscle status. It is characterized by its real-time, portable nature and is extensively utilized in sports and rehabilitation sciences. This study proposed a wireless acquisition system based on multi-channel sEMG for objective monitoring of grip force. The system consists of an sEMG acquisition module containing four-channel discrete terminals and a host computer receiver module, using Bluetooth wireless transmission. The system is portable, wearable, low-cost, and easy to operate. Leveraging the system, an experiment for grip force prediction was designed, employing the bald eagle search (BES) algorithm to enhance the Random Forest (RF) algorithm. This approach established a grip force prediction model based on dual-channel sEMG signals. As tested, the performance of acquisition terminal proceeded as follows: the gain was up to 1125 times, and the common mode rejection ratio (CMRR) remained high in the sEMG signal band range (96.94 dB (100 Hz), 84.12 dB (500 Hz)), while the performance of the grip force prediction algorithm had an R2 of 0.9215, an MAE of 1.0637, and an MSE of 1.7479. The proposed system demonstrates excellent performance in real-time signal acquisition and grip force prediction, proving to be an effective muscle status monitoring tool for rehabilitation, training, disease condition surveillance and scientific fitness applications.
Collapse
Affiliation(s)
- Dantong Wu
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Peng Tian
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Shuai Zhang
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
| | - Qihang Wang
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
| | - Kang Yu
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
| | - Yunfeng Wang
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Zhixing Gao
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Lin Huang
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Xiangyu Li
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Xingchen Zhai
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Meng Tian
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Chengjun Huang
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Haiying Zhang
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Jun Zhang
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| |
Collapse
|
2
|
Moslhi AM, Aly HH, ElMessiery M. The Impact of Feature Extraction on Classification Accuracy Examined by Employing a Signal Transformer to Classify Hand Gestures Using Surface Electromyography Signals. SENSORS (BASEL, SWITZERLAND) 2024; 24:1259. [PMID: 38400416 PMCID: PMC10893156 DOI: 10.3390/s24041259] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Revised: 02/01/2024] [Accepted: 02/09/2024] [Indexed: 02/25/2024]
Abstract
Interest in developing techniques for acquiring and decoding biological signals is on the rise in the research community. This interest spans various applications, with a particular focus on prosthetic control and rehabilitation, where achieving precise hand gesture recognition using surface electromyography signals is crucial due to the complexity and variability of surface electromyography data. Advanced signal processing and data analysis techniques are required to effectively extract meaningful information from these signals. In our study, we utilized three datasets: NinaPro Database 1, CapgMyo Database A, and CapgMyo Database B. These datasets were chosen for their open-source availability and established role in evaluating surface electromyography classifiers. Hand gesture recognition using surface electromyography signals draws inspiration from image classification algorithms, leading to the introduction and development of the Novel Signal Transformer. We systematically investigated two feature extraction techniques for surface electromyography signals: the Fast Fourier Transform and wavelet-based feature extraction. Our study demonstrated significant advancements in surface electromyography signal classification, particularly in the Ninapro database 1 and CapgMyo dataset A, surpassing existing results in the literature. The newly introduced Signal Transformer outperformed traditional Convolutional Neural Networks by excelling in capturing structural details and incorporating global information from image-like signals through robust basis functions. Additionally, the inclusion of an attention mechanism within the Signal Transformer highlighted the significance of electrode readings, improving classification accuracy. These findings underscore the potential of the Signal Transformer as a powerful tool for precise and effective surface electromyography signal classification, promising applications in prosthetic control and rehabilitation.
Collapse
Affiliation(s)
- Aly Medhat Moslhi
- Faculty of Engineering, The Arab Academy for Science, Technology & Maritime Transport, Smart Village Campus, Giza P.O. Box 2033, Egypt;
| | - Hesham H. Aly
- Faculty of Engineering, The Arab Academy for Science, Technology & Maritime Transport, Smart Village Campus, Giza P.O. Box 2033, Egypt;
| | - Medhat ElMessiery
- Faculty of Engineering, Cairo University, Giza P.O. Box 2033, Egypt;
| |
Collapse
|
3
|
Yi KH, Kim DC, Lee S, Lee HJ, Lee JH. Intramuscular Neural Distribution of the Gluteus Maximus Muscle: Diagnostic Electromyography and Injective Treatments. Diagnostics (Basel) 2024; 14:140. [PMID: 38248017 PMCID: PMC10813873 DOI: 10.3390/diagnostics14020140] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Revised: 12/29/2023] [Accepted: 01/03/2024] [Indexed: 01/23/2024] Open
Abstract
INTRODUCTION The purpose of this study was to investigate neural patterns within the gluteus maximus (Gmax) muscle to identify optimal EMG placement and injection sites for botulinum toxin and other injectable agents. METHODS This study used 10 fixed and 1 non-fixed adult Korean cadavers. Intramuscular arborization patterns were confirmed in the cranial, middle, and caudal segments of 20 Gmax muscles using Sihler staining. Ultrasound images were obtained from one cadaver, and blue dye was injected using ultrasound guidance to confirm the results. RESULTS The intramuscular innervation pattern of the Gmax was mostly in the middle part of this muscle. The nerve endings of the Gmax are mainly located in the 40-70% range in the cranial segment, the 30-60% range in the middle segment, and the 40-70% range in the caudal segment. DISCUSSION Addressing the spasticity of the gluteus maximus requires precise, site-specific botulinum toxin injections. The use of EMG and other injection therapies should be guided by the findings of this study. We propose that these specific sites, which correspond to areas with the densest nerve branches, are the safest and most efficient locations for both botulinum toxin injections and EMG procedures.
Collapse
Affiliation(s)
- Kyu-Ho Yi
- Division in Anatomy and Developmental Biology, Department of Oral Biology, Human Identification Research Institute, BK21 PLUS Project, Yonsei University College of Dentistry, Seoul 03722, Republic of Korea;
- Maylin Clinic (Apgujeong), Seoul 06005, Republic of Korea
| | - Dong Chan Kim
- Department of Rehabilitation Medicine, Eunpyeong St. Mary’s Hospital, Seoul 03312, Republic of Korea;
| | - Siyun Lee
- Department of Cancer Biology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA 02215, USA;
| | - Hyung-Jin Lee
- Catholic Institute for Applied Anatomy, Department of Anatomy, College of Medicine, The Catholic University of Korea, Seoul 06591, Republic of Korea
| | - Ji-Hyun Lee
- Department of Anatomy and Acupoint, College of Korean Medicine, Gachon University, Seongnam 13120, Republic of Korea
| |
Collapse
|
4
|
Ramírez-Pérez V, Guerrero-Díaz-de-León JA, Macías-Díaz JE. On the detection of activity patterns in electromyographic signals via decision trees. EVOLUTIONARY INTELLIGENCE 2023. [DOI: 10.1007/s12065-023-00844-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/30/2023]
|
5
|
Al-Daraghmeh MY, Stone RT. A review of medical wearables: materials, power sources, sensors, and manufacturing aspects of human wearable technologies. J Med Eng Technol 2023; 47:67-81. [PMID: 35856912 DOI: 10.1080/03091902.2022.2097743] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2023]
Abstract
Wearable technology is a promising and revolutionary technology that is changing some aspects of our standard of living to a great extent, including health monitoring, sport and fitness, performance tracking, education, and entertainment. This article presents a comprehensive literature review of over 160 articles related to state-of-the-art human wearable technologies. We provide a thorough understanding of the materials, power sources, sensors, and manufacturing processes, and the relationships between these to capture opportunities for enhancement and challenges to overcome in wearables. As a result of our review, we have determined the need for the development of a comprehensive, robust manufacturing system alongside specific standards and regulations that take into account wearables' unique characteristics. Seeing the whole picture will provide a frame reference and road map for researchers and industries through the design, manufacturing, and commercialisation of effective, portable, self-powered, multi-sensing ultimate future wearable devices and create opportunities for new innovations and applications.
Collapse
Affiliation(s)
- Mohammad Y Al-Daraghmeh
- Department of Industrial and Manufacturing Systems Engineering, Iowa State University, Ames, IA, USA.,Department of Industrial Engineering, Yarmouk University, Irbid, Jordan
| | - Richard T Stone
- Department of Industrial and Manufacturing Systems Engineering, Iowa State University, Ames, IA, USA
| |
Collapse
|
6
|
Barfi M, Karami H, Faridi F, Sohrabi Z, Hosseini M. Improving robotic hand control via adaptive Fuzzy-PI controller using classification of EMG signals. Heliyon 2022; 8:e11931. [DOI: 10.1016/j.heliyon.2022.e11931] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Revised: 05/16/2022] [Accepted: 11/18/2022] [Indexed: 12/03/2022] Open
|
7
|
Wang H, Zuo S, Cerezo-Sánchez M, Arekhloo NG, Nazarpour K, Heidari H. Wearable super-resolution muscle-machine interfacing. Front Neurosci 2022; 16:1020546. [PMID: 36466163 PMCID: PMC9714306 DOI: 10.3389/fnins.2022.1020546] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2022] [Accepted: 10/21/2022] [Indexed: 09/19/2023] Open
Abstract
Muscles are the actuators of all human actions, from daily work and life to communication and expression of emotions. Myography records the signals from muscle activities as an interface between machine hardware and human wetware, granting direct and natural control of our electronic peripherals. Regardless of the significant progression as of late, the conventional myographic sensors are still incapable of achieving the desired high-resolution and non-invasive recording. This paper presents a critical review of state-of-the-art wearable sensing technologies that measure deeper muscle activity with high spatial resolution, so-called super-resolution. This paper classifies these myographic sensors according to the different signal types (i.e., biomechanical, biochemical, and bioelectrical) they record during measuring muscle activity. By describing the characteristics and current developments with advantages and limitations of each myographic sensor, their capabilities are investigated as a super-resolution myography technique, including: (i) non-invasive and high-density designs of the sensing units and their vulnerability to interferences, (ii) limit-of-detection to register the activity of deep muscles. Finally, this paper concludes with new opportunities in this fast-growing super-resolution myography field and proposes promising future research directions. These advances will enable next-generation muscle-machine interfaces to meet the practical design needs in real-life for healthcare technologies, assistive/rehabilitation robotics, and human augmentation with extended reality.
Collapse
Affiliation(s)
- Huxi Wang
- Microelectronics Lab, James Watt School of Engineering, The University of Glasgow, Glasgow, United Kingdom
- Neuranics Ltd., Glasgow, United Kingdom
| | - Siming Zuo
- Microelectronics Lab, James Watt School of Engineering, The University of Glasgow, Glasgow, United Kingdom
- Neuranics Ltd., Glasgow, United Kingdom
| | - María Cerezo-Sánchez
- Microelectronics Lab, James Watt School of Engineering, The University of Glasgow, Glasgow, United Kingdom
- Neuranics Ltd., Glasgow, United Kingdom
| | - Negin Ghahremani Arekhloo
- Microelectronics Lab, James Watt School of Engineering, The University of Glasgow, Glasgow, United Kingdom
- Neuranics Ltd., Glasgow, United Kingdom
| | - Kianoush Nazarpour
- Neuranics Ltd., Glasgow, United Kingdom
- School of Informatics, The University of Edinburgh, Edinburgh, United Kingdom
| | - Hadi Heidari
- Microelectronics Lab, James Watt School of Engineering, The University of Glasgow, Glasgow, United Kingdom
- Neuranics Ltd., Glasgow, United Kingdom
| |
Collapse
|
8
|
Chang Y, Wang L, Lin L, Liu M. Deep Neural Network for Electromyography Signal Classification via Wearable Sensors. INTERNATIONAL JOURNAL OF DISTRIBUTED SYSTEMS AND TECHNOLOGIES 2022. [DOI: 10.4018/ijdst.307988] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The human-computer interaction has been widely used in many fields, such intelligent prosthetic control, sports medicine, rehabilitation medicine, and clinical medicine. It has gradually become a research focus of social scientists. In the field of intelligent prosthesis, sEMG signal has become the most widely used control signal source because it is easy to obtain. The off-line sEMG control intelligent prosthesis needs to recognize the gestures to execute associated action. In order solve this issue, this paper adopts a CNN plus BiLSTM to automatically extract sEMG features and recognize the gestures. The CNN plus BiLSTM can overcome the drawbacks in the manual feature extraction methods. The experimental results show that the proposed gesture recognition framework can extract overall gesture features, which can improve the recognition rate.
Collapse
Affiliation(s)
- Ying Chang
- Harbin Engineering University, China & Jilin Agricultural Science and Technology University, China
| | - Lan Wang
- Harbin Engineering University, China
| | | | - Ming Liu
- Technology Department, Yamamoto Co., Ltd., Japan
| |
Collapse
|
9
|
Moznuzzaman M, Khan TI, Neher B, Teramoto K, Ide S. Ageing effect of lower limb muscle activity for correlating healthy and osteoarthritic knees by surface electromyogram analysis. SENSING AND BIO-SENSING RESEARCH 2022. [DOI: 10.1016/j.sbsr.2022.100488] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/18/2022] Open
|
10
|
"Listen to Your Immune System When It's Calling for You": Monitoring Autoimmune Diseases Using the iShU App. SENSORS 2022; 22:s22103834. [PMID: 35632243 PMCID: PMC9147288 DOI: 10.3390/s22103834] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/15/2022] [Revised: 05/10/2022] [Accepted: 05/16/2022] [Indexed: 12/02/2022]
Abstract
The immune system plays a key role in protecting living beings against bacteria, viruses, and fungi, among other pathogens, which may be harmful and represent a threat to our own health. However, for reasons that are not fully understood, in some people this protective mechanism accidentally attacks the organs and tissues, thus causing inflammation and leads to the development of autoimmune diseases. Remote monitoring of human health involves the use of sensor network technology as a means of capturing patient data, and wearable devices, such as smartwatches, have lately been considered good collectors of biofeedback data, owing to their easy connectivity with a mHealth system. Moreover, the use of gamification may encourage the frequent usage of such devices and behavior changes to improve self-care for autoimmune diseases. This study reports on the use of wearable sensors for inflammation surveillance and autoimmune disease management based on a literature search and evaluation of an app prototype with fifteen stakeholders, in which eight participants were diagnosed with autoimmune or inflammatory diseases and four were healthcare professionals. Of these, six were experts in human–computer interaction to assess critical aspects of user experience. The developed prototype allows the monitoring of autoimmune diseases in pre-, during-, and post-inflammatory crises, meeting the personal needs of people with this health condition. The findings suggest that the proposed prototype—iShU—achieves its purpose and the overall experience may serve as a foundation for designing inflammation surveillance and autoimmune disease management monitoring solutions.
Collapse
|
11
|
Bakiya A, Anitha A, Sridevi T, Kamalanand K. Classification of Myopathy and Amyotrophic Lateral Sclerosis Electromyograms Using Bat Algorithm and Deep Neural Networks. Behav Neurol 2022; 2022:3517872. [PMID: 35419115 PMCID: PMC9001138 DOI: 10.1155/2022/3517872] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Revised: 02/12/2022] [Accepted: 03/05/2022] [Indexed: 11/17/2022] Open
Abstract
Electromyograms (EMG) are a recorded galvanic action of nerves and muscles which assists in diagnosing the disorders associated with muscles and nerves. The efficient discrimination of abnormal EMG signals, myopathy and amyotrophic lateral sclerosis, engage crucial role in automatic diagnostic assistance tools, since EMG signals are nonstationary signals. Hence, for computer-aided identification of abnormalities, extraction of features, selection of superlative feature subset, and developing an efficient classifier are indispensable. Initially, time domain and Wigner-Ville transformed time-frequency features were extracted from abnormal EMG signals for experiments. The selection of substantial characteristics from time and time-frequency features was performed using bat algorithm. Extensively, deep neural network classifier is modelled for selected feature subset using bat algorithm from extracted time and time-frequency features. The performance of deep neural network exerting selected features from bat algorithm was compared with conventional artificial neural network. Results demonstrate that the deep neural network modelled with layers 2 and 3 (neurons = 2 and 4) using time domain features is efficient in classifying the abnormalities of EMG signals with an accuracy, sensitivity, and specificity of 100% and also exhibited finer performance. Correspondingly, the developed conventional single layer artificial neural network (neurons = 7) with time domain features has shown an accuracy of 83.3%, sensitivity of 100%, and specificity of 71.42%. The work materializes the significance of conventional and deep neural network using time and time-frequency features in diagnosing the abnormal signals exists in neuromuscular system using efficient classification.
Collapse
Affiliation(s)
- A. Bakiya
- Department of Electronics and Communication Engineering, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Chennai 600062, India
| | - A. Anitha
- PG Department of Computer Science, Dwaraka Doss Goverdhan Doss Vaishnav College, Chennai-600106, India
| | - T. Sridevi
- PG and Research Department of MCA, Dwaraka Doss Goverdhan Doss Vaishnav College, Chennai-600106, India
| | - K. Kamalanand
- Department of Instrumentation Engineering, MIT Campus, Anna University, Chennai-600044, India
| |
Collapse
|
12
|
Yang Z, Jiang D, Sun Y, Tao B, Tong X, Jiang G, Xu M, Yun J, Liu Y, Chen B, Kong J. Dynamic Gesture Recognition Using Surface EMG Signals Based on Multi-Stream Residual Network. Front Bioeng Biotechnol 2021; 9:779353. [PMID: 34746114 PMCID: PMC8569623 DOI: 10.3389/fbioe.2021.779353] [Citation(s) in RCA: 38] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2021] [Accepted: 10/04/2021] [Indexed: 11/13/2022] Open
Abstract
Gesture recognition technology is widely used in the flexible and precise control of manipulators in the assisted medical field. Our MResLSTM algorithm can effectively perform dynamic gesture recognition. The result of surface EMG signal decoding is applied to the controller, which can improve the fluency of artificial hand control. Much current gesture recognition research using sEMG has focused on static gestures. In addition, the accuracy of recognition depends on the extraction and selection of features. However, Static gesture research cannot meet the requirements of natural human-computer interaction and dexterous control of manipulators. Therefore, a multi-stream residual network (MResLSTM) is proposed for dynamic hand movement recognition. This study aims to improve the accuracy and stability of dynamic gesture recognition. Simultaneously, it can also advance the research on the smooth control of the Manipulator. We combine the residual model and the convolutional short-term memory model into a unified framework. The architecture extracts spatiotemporal features from two aspects: global and deep, and combines feature fusion to retain essential information. The strategy of pointwise group convolution and channel shuffle is used to reduce the number of network calculations. A dataset is constructed containing six dynamic gestures for model training. The experimental results show that on the same recognition model, the gesture recognition effect of fusion of sEMG signal and acceleration signal is better than that of only using sEMG signal. The proposed approach obtains competitive performance on our dataset with the recognition accuracies of 93.52%, achieving state-of-the-art performance with 89.65% precision on the Ninapro DB1 dataset. Our bionic calculation method is applied to the controller, which can realize the continuity of human-computer interaction and the flexibility of manipulator control.
Collapse
Affiliation(s)
- Zhiwen Yang
- Key Laboratory of Metallurgical Equipment and Control Technology of Ministry of Education, Wuhan University of Science and Technology, Wuhan, China.,Research Center for Biomimetic Robot and Intelligent Measurement and Control, Wuhan University of Science and Technology, Wuhan, China
| | - Du Jiang
- Key Laboratory of Metallurgical Equipment and Control Technology of Ministry of Education, Wuhan University of Science and Technology, Wuhan, China.,Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, Wuhan University of Science and Technology, Wuhan, China.,Institute of Precision Manufacturing, Wuhan University of Science and Technology, Wuhan, China
| | - Ying Sun
- Key Laboratory of Metallurgical Equipment and Control Technology of Ministry of Education, Wuhan University of Science and Technology, Wuhan, China.,Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, Wuhan University of Science and Technology, Wuhan, China.,Institute of Precision Manufacturing, Wuhan University of Science and Technology, Wuhan, China
| | - Bo Tao
- Key Laboratory of Metallurgical Equipment and Control Technology of Ministry of Education, Wuhan University of Science and Technology, Wuhan, China.,Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, Wuhan University of Science and Technology, Wuhan, China.,Institute of Precision Manufacturing, Wuhan University of Science and Technology, Wuhan, China
| | - Xiliang Tong
- Research Center for Biomimetic Robot and Intelligent Measurement and Control, Wuhan University of Science and Technology, Wuhan, China.,Institute of Precision Manufacturing, Wuhan University of Science and Technology, Wuhan, China
| | - Guozhang Jiang
- Research Center for Biomimetic Robot and Intelligent Measurement and Control, Wuhan University of Science and Technology, Wuhan, China.,Institute of Precision Manufacturing, Wuhan University of Science and Technology, Wuhan, China
| | - Manman Xu
- Key Laboratory of Metallurgical Equipment and Control Technology of Ministry of Education, Wuhan University of Science and Technology, Wuhan, China.,Research Center for Biomimetic Robot and Intelligent Measurement and Control, Wuhan University of Science and Technology, Wuhan, China.,Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, Wuhan University of Science and Technology, Wuhan, China
| | - Juntong Yun
- Research Center for Biomimetic Robot and Intelligent Measurement and Control, Wuhan University of Science and Technology, Wuhan, China.,Institute of Precision Manufacturing, Wuhan University of Science and Technology, Wuhan, China
| | - Ying Liu
- Research Center for Biomimetic Robot and Intelligent Measurement and Control, Wuhan University of Science and Technology, Wuhan, China.,Institute of Precision Manufacturing, Wuhan University of Science and Technology, Wuhan, China
| | - Baojia Chen
- Hubei Key Laboratory of Hydroelectric Machinery Design and Maintenance, Three Gorges University, Yichang, China
| | - Jianyi Kong
- Research Center for Biomimetic Robot and Intelligent Measurement and Control, Wuhan University of Science and Technology, Wuhan, China.,Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, Wuhan University of Science and Technology, Wuhan, China.,Institute of Precision Manufacturing, Wuhan University of Science and Technology, Wuhan, China
| |
Collapse
|
13
|
Bakiya A, Kamalanand K, Rajinikanth V. Automated diagnosis of amyotrophic lateral sclerosis using electromyograms and firefly algorithm based neural networks with fractional position update. Phys Eng Sci Med 2021; 44:1095-1105. [PMID: 34398392 DOI: 10.1007/s13246-021-01046-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2020] [Accepted: 08/08/2021] [Indexed: 11/26/2022]
Abstract
Amyotrophic Lateral Sclerosis (ALS) is a disorder of the neuromuscular system that causes the impairment of nerve cells from brain to spinal cord and to the voluntary muscles in every part of the human physiological system, which totally leads to paralysis. The examination of ALS using Electromyograms (EMG) is a challenging task which requires experts to investigate and diagnose. Hence, the development of an efficient and automated procedure is significant for the analysis of ALS signals. In this work, eighty time-frequency features were extricated from EMG signals transformed into time-frequency images. Further, fifteen highly substantial features were chosen using the firefly algorithm with fractional position update. Further, fractional firefly neural network is introduced and developed to examine the EMG signals. The performance metrics of the fractional firefly based neural network diagnostic system were analyzed with different fractional orders (α) and hidden neurons. Results demonstrated that the proposed technique is highly efficient and yields good statistical significance. Further, the accuracy of the fractional firefly neural network classifier with α = 0.5 and 15 hidden neurons is higher (93.3%) when compared to the accuracy of the classifier with different α values and hidden neurons. The proposed fractional order-based feature selection algorithm and classifier model are highly suitable for development of systems for evaluation of ALS and normal EMG signals, since the proficient discrimination of normal and ALS EMG signals is essential for the identification of neuromuscular disorders.
Collapse
Affiliation(s)
- A Bakiya
- Department of Instrumentation Engineering, MIT Campus, Anna University, Chennai, 600044, India
| | - K Kamalanand
- Department of Instrumentation Engineering, MIT Campus, Anna University, Chennai, 600044, India
| | - V Rajinikanth
- Department of Electronics and Instrumentation Engineering, St. Joseph's College of Engineering, Chennai, 600119, India.
| |
Collapse
|
14
|
Li X, Zhou Z, Wu J, Xiong Y. Human Posture Detection Method Based on Wearable Devices. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:8879061. [PMID: 33833862 PMCID: PMC8016574 DOI: 10.1155/2021/8879061] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/07/2020] [Revised: 11/20/2020] [Accepted: 03/14/2021] [Indexed: 12/04/2022]
Abstract
The dynamic detection of human motion is important, which is widely applied in the fields of motion state capture and rehabilitation engineering. In this study, based on multimodal information of surface electromyography (sEMG) signals of upper limb and triaxial acceleration and plantar pressure signals of lower limb, the effective virtual driving control and gait recognition methods were proposed. The effective way of wearable human posture detection was also constructed. Firstly, the moving average window and threshold comparison were used to segment the sEMG signals of the upper limb. The standard deviation and singular values of wavelet coefficients were extracted as the features. After the training and classification by optimized support vector machine (SVM) algorithm, the real-time detection and analysis of three virtual driving actions were performed. The average identification accuracy was 90.90%. Secondly, the mean, standard deviation, variance, and wavelet energy spectrum of triaxial acceleration were extracted, and these parameters were combined with plantar pressure as the gait features. The optimized SVM was selected for the gait identification, and the average accuracy was 90.48%. The experimental results showed that, through different combinations of wearable sensors on the upper and lower limbs, the motion posture information could be dynamically detected, which could be used in the design of virtual rehabilitation system and walking auxiliary system.
Collapse
Affiliation(s)
- Xiaoou Li
- College of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai 201318, China
| | - Zhiyong Zhou
- School of Design and Art, Shanghai Dianji University, Shanghai 200240, China
| | - Jiajia Wu
- College of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai 201318, China
| | - Yichao Xiong
- College of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai 201318, China
| |
Collapse
|
15
|
Kireev D, Okogbue E, Jayanth RT, Ko TJ, Jung Y, Akinwande D. Multipurpose and Reusable Ultrathin Electronic Tattoos Based on PtSe 2 and PtTe 2. ACS NANO 2021; 15:2800-2811. [PMID: 33470791 DOI: 10.1021/acsnano.0c08689] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/26/2023]
Abstract
Wearable bioelectronics with emphasis on the research and development of advanced person-oriented biomedical devices have attracted immense interest in the past decade. Scientists and clinicians find it essential to utilize skin-worn smart tattoos for on-demand and ambulatory monitoring of an individual's vital signs. Here, we report on the development of ultrathin platinum-based two-dimensional dichalcogenide (Pt-TMDs)-based electronic tattoos as advanced building blocks of future wearable bioelectronics. We made these ultrathin electronic tattoos out of large-scale synthesized platinum diselenide (PtSe2) and platinum ditelluride (PtTe2) layered materials and used them for monitoring human physiological vital signs, such as the electrical activity of the heart and the brain, muscle contractions, eye movements, and temperature. We show that both materials can be used for these applications; yet, PtTe2 was found to be the most suitable choice due to its metallic structure. In terms of sheet resistance, skin contact, and electrochemical impedance, PtTe2 outperforms state-of-the-art gold and graphene electronic tattoos and performs on par with medical-grade Ag/AgCl gel electrodes. The PtTe2 tattoos show 4 times lower impedance and almost 100 times lower sheet resistance compared to monolayer graphene tattoos. One of the possible prompt implications of this work is perhaps in the development of advanced human-machine interfaces. To display the application, we built a multi-tattoo system that can easily distinguish eye movement and identify the direction of an individual's sight.
Collapse
Affiliation(s)
- Dmitry Kireev
- Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, Texas 78758 United States
- Microelectronics Research Center, The University of Texas at Austin, Austin, Texas 78758 United States
| | - Emmanuel Okogbue
- NanoScience Technology Center, University of Central Florida, Orlando, Florida 32826, United States
- Department of Electrical and Computer Engineering, University of Central Florida, Orlando, Florida 32816, United States
| | - R T Jayanth
- Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, Texas 78758 United States
| | - Tae-Jun Ko
- NanoScience Technology Center, University of Central Florida, Orlando, Florida 32826, United States
| | - Yeonwoong Jung
- NanoScience Technology Center, University of Central Florida, Orlando, Florida 32826, United States
- Department of Electrical and Computer Engineering, University of Central Florida, Orlando, Florida 32816, United States
- Department of Materials Science and Engineering, University of Central Florida, Orlando, Florida 32816, United States
| | - Deji Akinwande
- Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, Texas 78758 United States
- Microelectronics Research Center, The University of Texas at Austin, Austin, Texas 78758 United States
- Texas Materials Institute, The University of Texas at Austin, Austin, Texas 78758 United States
| |
Collapse
|
16
|
A novel statistical decimal pattern-based surface electromyogram signal classification method using tunable q-factor wavelet transform. Soft comput 2021. [DOI: 10.1007/s00500-020-05205-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
17
|
Celik Y, Stuart S, Woo WL, Godfrey A. Gait analysis in neurological populations: Progression in the use of wearables. Med Eng Phys 2020; 87:9-29. [PMID: 33461679 DOI: 10.1016/j.medengphy.2020.11.005] [Citation(s) in RCA: 52] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2020] [Revised: 11/02/2020] [Accepted: 11/11/2020] [Indexed: 12/19/2022]
Abstract
Gait assessment is an essential tool for clinical applications not only to diagnose different neurological conditions but also to monitor disease progression as it contributes to the understanding of underlying deficits. There are established methods and models for data collection and interpretation of gait assessment within different pathologies. This narrative review aims to depict the evolution of gait assessment from observation and rating scales to wearable sensors and laboratory technologies and provide limitations and possible future directions in the field of gait assessment. In this context, we first present an extensive review of current clinical outcomes and gait models. Then, we demonstrate commercially available wearable technologies with their technical capabilities along with their use in gait assessment studies for various neurological conditions. In the next sections, a descriptive knowledge for existing inertial and EMG based algorithms and a sign based guide that shows the outcomes of previous neurological gait assessment studies are presented. Finally, we state a discussion for the use of wearables in gait assessment and speculate the possible research directions by revealing the limitations and knowledge gaps in the literature.
Collapse
Affiliation(s)
- Y Celik
- Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne NE1 8ST, UK
| | - S Stuart
- Department of Sport, Exercise and Rehabilitation, Northumbria University, Newcastle upon Tyne NE1 8ST, UK
| | - W L Woo
- Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne NE1 8ST, UK
| | - A Godfrey
- Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne NE1 8ST, UK.
| |
Collapse
|
18
|
Fang C, He B, Wang Y, Cao J, Gao S. EMG-Centered Multisensory Based Technologies for Pattern Recognition in Rehabilitation: State of the Art and Challenges. BIOSENSORS 2020; 10:E85. [PMID: 32722542 PMCID: PMC7460307 DOI: 10.3390/bios10080085] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/27/2020] [Revised: 07/20/2020] [Accepted: 07/22/2020] [Indexed: 01/18/2023]
Abstract
In the field of rehabilitation, the electromyography (EMG) signal plays an important role in interpreting patients' intentions and physical conditions. Nevertheless, utilizing merely the EMG signal suffers from difficulty in recognizing slight body movements, and the detection accuracy is strongly influenced by environmental factors. To address the above issues, multisensory integration-based EMG pattern recognition (PR) techniques have been developed in recent years, and fruitful results have been demonstrated in diverse rehabilitation scenarios, such as achieving high locomotion detection and prosthesis control accuracy. Owing to the importance and rapid development of the EMG centered multisensory fusion technologies in rehabilitation, this paper reviews both theories and applications in this emerging field. The principle of EMG signal generation and the current pattern recognition process are explained in detail, including signal preprocessing, feature extraction, classification algorithms, etc. Mechanisms of collaborations between two important multisensory fusion strategies (kinetic and kinematics) and EMG information are thoroughly explained; corresponding applications are studied, and the pros and cons are discussed. Finally, the main challenges in EMG centered multisensory pattern recognition are discussed, and a future research direction of this area is prospected.
Collapse
Affiliation(s)
- Chaoming Fang
- School of Instrumentation and Optoelectronic Engineering, Beihang University, Beijing 100083, China; (C.F.); (Y.W.)
| | - Bowei He
- School of Automation Science and Electrical Engineering, Beihang University, Beijing 100083, China;
| | - Yixuan Wang
- School of Instrumentation and Optoelectronic Engineering, Beihang University, Beijing 100083, China; (C.F.); (Y.W.)
| | - Jin Cao
- Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02138, USA;
| | - Shuo Gao
- School of Instrumentation and Optoelectronic Engineering, Beihang University, Beijing 100083, China; (C.F.); (Y.W.)
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, Beihang University, Beijing 100083, China
| |
Collapse
|
19
|
Implementation of a Cost-Effective Didactic Prototype for the Acquisition of Biomedical Signals. ELECTRONICS 2018. [DOI: 10.3390/electronics7050077] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|