1
|
Sherif O, Bassuoni MM, Mehrez O. A survey on the state of the art of force myography technique (FMG): analysis and assessment. Med Biol Eng Comput 2024; 62:1313-1332. [PMID: 38305814 PMCID: PMC11021344 DOI: 10.1007/s11517-024-03019-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2023] [Accepted: 01/09/2024] [Indexed: 02/03/2024]
Abstract
Precise feedback assures precise control commands especially for assistive or rehabilitation devices. Biofeedback systems integrated with assistive or rehabilitative robotic exoskeletons tend to increase its performance and effectiveness. Therefore, there has been plenty of research in the field of biofeedback covering different aspects such as signal acquisition, conditioning, feature extraction and integration with the control system. Among several types of biofeedback systems, Force myography (FMG) technique is a promising one in terms of affordability, high classification accuracies, ease to use, and low computational cost. Compared to traditional biofeedback systems such as electromyography (EMG) which offers some invasive techniques, FMG offers a completely non-invasive solution with much less effort for preprocessing with high accuracies. This work covers the whole aspects of FMG technique in terms of signal acquisition, feature extraction, signal processing, developing the machine learning model, evaluating tools for the performance of the model. Stating the difference between real-time and offline assessment, also highlighting the main uncovered points for further study, and thus enhancing the development of this technique.
Collapse
Affiliation(s)
- Omar Sherif
- Mechanical Power Engineering Department, Faculty of Engineering, Tanta University, Tanta, Egypt.
| | | | - Omar Mehrez
- Mechanical Power Engineering Department, Faculty of Engineering, Tanta University, Tanta, Egypt
| |
Collapse
|
2
|
Rehman MU, Shah K, Haq IU, Iqbal S, Ismail MA. A Wearable Force Myography-Based Armband for Recognition of Upper Limb Gestures. SENSORS (BASEL, SWITZERLAND) 2023; 23:9357. [PMID: 38067728 PMCID: PMC10708660 DOI: 10.3390/s23239357] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/24/2023] [Revised: 11/15/2023] [Accepted: 11/16/2023] [Indexed: 12/18/2023]
Abstract
Force myography (FMG) represents a promising alternative to surface electromyography (EMG) in the context of controlling bio-robotic hands. In this study, we built upon our prior research by introducing a novel wearable armband based on FMG technology, which integrates force-sensitive resistor (FSR) sensors housed in newly designed casings. We evaluated the sensors' characteristics, including their load-voltage relationship and signal stability during the execution of gestures over time. Two sensor arrangements were evaluated: arrangement A, featuring sensors spaced at 4.5 cm intervals, and arrangement B, with sensors distributed evenly along the forearm. The data collection involved six participants, including three individuals with trans-radial amputations, who performed nine upper limb gestures. The prediction performance was assessed using support vector machines (SVMs) and k-nearest neighbor (KNN) algorithms for both sensor arrangments. The results revealed that the developed sensor exhibited non-linear behavior, and its sensitivity varied with the applied force. Notably, arrangement B outperformed arrangement A in classifying the nine gestures, with an average accuracy of 95.4 ± 2.1% compared to arrangement A's 91.3 ± 2.3%. The utilization of the arrangement B armband led to a substantial increase in the average prediction accuracy, demonstrating an improvement of up to 4.5%.
Collapse
Affiliation(s)
- Mustafa Ur Rehman
- Department of Mechatronics Engineering, University of Engineering and Technology Peshawar, Peshawar 25000, Pakistan; (M.U.R.)
| | - Kamran Shah
- Department of Mechatronics Engineering, University of Engineering and Technology Peshawar, Peshawar 25000, Pakistan; (M.U.R.)
- Department of Mechanical Engineering, King Faisal University, Al-Ahsa 31982, Saudi Arabia;
| | - Izhar Ul Haq
- Department of Mechatronics Engineering, University of Engineering and Technology Peshawar, Peshawar 25000, Pakistan; (M.U.R.)
| | - Sajid Iqbal
- Department of Information Systems, King Faisal University, Al-Ahsa 31982, Saudi Arabia;
| | - Mohamed A. Ismail
- Department of Mechanical Engineering, King Faisal University, Al-Ahsa 31982, Saudi Arabia;
| |
Collapse
|
3
|
Rehman MU, Shah K, Haq IU, Iqbal S, Ismail MA, Selimefendigil F. Assessment of Low-Density Force Myography Armband for Classification of Upper Limb Gestures. SENSORS (BASEL, SWITZERLAND) 2023; 23:2716. [PMID: 36904919 PMCID: PMC10007530 DOI: 10.3390/s23052716] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 02/23/2023] [Accepted: 02/24/2023] [Indexed: 06/18/2023]
Abstract
Using force myography (FMG) to monitor volumetric changes in limb muscles is a promising and effective alternative for controlling bio-robotic prosthetic devices. In recent years, there has been a focus on developing new methods to improve the performance of FMG technology in the control of bio-robotic devices. This study aimed to design and evaluate a novel low-density FMG (LD-FMG) armband for controlling upper limb prostheses. The study investigated the number of sensors and sampling rate for the newly developed LD-FMG band. The performance of the band was evaluated by detecting nine gestures of the hand, wrist, and forearm at varying elbow and shoulder positions. Six subjects, including both fit and amputated individuals, participated in this study and completed two experimental protocols: static and dynamic. The static protocol measured volumetric changes in forearm muscles at the fixed elbow and shoulder positions. In contrast, the dynamic protocol included continuous motion of the elbow and shoulder joints. The results showed that the number of sensors significantly impacts gesture prediction accuracy, with the best accuracy achieved on the 7-sensor FMG band arrangement. Compared to the number of sensors, the sampling rate had a lower influence on prediction accuracy. Additionally, variations in limb position greatly affect the classification accuracy of gestures. The static protocol shows an accuracy above 90% when considering nine gestures. Among dynamic results, shoulder movement shows the least classification error compared to elbow and elbow-shoulder (ES) movements.
Collapse
Affiliation(s)
- Mustafa Ur Rehman
- Department of Mechatronics Engineering, University of Engineering and Technology, Peshawar 25000, Pakistan
| | - Kamran Shah
- Department of Mechatronics Engineering, University of Engineering and Technology, Peshawar 25000, Pakistan
- Department of Mechanical Engineering, King Faisal University, Al-Hofuf 31982, Saudi Arabia
| | - Izhar Ul Haq
- Department of Mechatronics Engineering, University of Engineering and Technology, Peshawar 25000, Pakistan
| | - Sajid Iqbal
- Department of Information Systems, King Faisal University, Al-Hofuf 31982, Saudi Arabia
| | - Mohamed A. Ismail
- Department of Mechanical Engineering, King Faisal University, Al-Hofuf 31982, Saudi Arabia
| | - Fatih Selimefendigil
- Department of Mechanical Engineering, King Faisal University, Al-Hofuf 31982, Saudi Arabia
| |
Collapse
|
4
|
Zheng Z, Wu Z, Zhao R, Ni Y, Jing X, Gao S. A Review of EMG-, FMG-, and EIT-Based Biosensors and Relevant Human–Machine Interactivities and Biomedical Applications. BIOSENSORS 2022; 12:bios12070516. [PMID: 35884319 PMCID: PMC9313012 DOI: 10.3390/bios12070516] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Revised: 07/06/2022] [Accepted: 07/09/2022] [Indexed: 11/23/2022]
Abstract
Wearables developed for human body signal detection receive increasing attention in the current decade. Compared to implantable sensors, wearables are more focused on body motion detection, which can support human–machine interaction (HMI) and biomedical applications. In wearables, electromyography (EMG)-, force myography (FMG)-, and electrical impedance tomography (EIT)-based body information monitoring technologies are broadly presented. In the literature, all of them have been adopted for many similar application scenarios, which easily confuses researchers when they start to explore the area. Hence, in this article, we review the three technologies in detail, from basics including working principles, device architectures, interpretation algorithms, application examples, merits and drawbacks, to state-of-the-art works, challenges remaining to be solved and the outlook of the field. We believe the content in this paper could help readers create a whole image of designing and applying the three technologies in relevant scenarios.
Collapse
Affiliation(s)
| | | | | | | | | | - Shuo Gao
- Correspondence: ; Tel.: +86-18600737330
| |
Collapse
|
5
|
Gharibo JS, Naish MD. Multi-modal Prosthesis Control using sEMG, FMG and IMU Sensors. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:2983-2987. [PMID: 36086300 DOI: 10.1109/embc48229.2022.9871586] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
In this work, a novel multi-modal device that allows data to simultaneously be collected from three noninva-sive sensor modalities was created. Force myography (FMG), surface electromyography (sEMG), and inertial measurement unit (IMU) sensors were integrated into a wearable armband and used to collect signal data while subjects performed gestures important for the activities of daily living (ADL). An established machine learning algorithm was used to decipher the signals to predict the user's intent/gesture being held, which could be used to control a prosthetic device. Using all three modalities provided statistically-significant improvements over most other modality combinations, as it provided the most accurate and consistent classification results. Clinical relevance-The use of three sensing modalities can improve gesture-based control of upper-limb prosthetics.
Collapse
|
6
|
Investigation on the Sampling Frequency and Channel Number for Force Myography Based Hand Gesture Recognition. SENSORS 2021; 21:s21113872. [PMID: 34205220 PMCID: PMC8200028 DOI: 10.3390/s21113872] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/07/2021] [Revised: 05/31/2021] [Accepted: 05/31/2021] [Indexed: 11/17/2022]
Abstract
Force myography (FMG) is a method that uses pressure sensors to measure muscle contraction indirectly. Compared with the conventional approach utilizing myoelectric signals in hand gesture recognition, it is a valuable substitute. To achieve the aim of gesture recognition at minimum cost, it is necessary to study the minimum sampling frequency and the minimal number of channels. For purpose of investigating the effect of sampling frequency and the number of channels on the accuracy of gesture recognition, a hardware system that has 16 channels has been designed for capturing forearm FMG signals with a maximum sampling frequency of 1 kHz. Using this acquisition equipment, a force myography database containing 10 subjects' data has been created. In this paper, gesture accuracies under different sampling frequencies and channel's number are obtained. Under 1 kHz sampling rate and 16 channels, four of five tested classifiers reach an accuracy up to about 99%. Other experimental results indicate that: (1) the sampling frequency of the FMG signal can be as low as 5 Hz for the recognition of static movements; (2) the reduction of channel number has a large impact on the accuracy, and the suggested channel number for gesture recognition is eight; and (3) the distribution of the sensors on the forearm would affect the recognition accuracy, and it is possible to improve the accuracy via optimizing the sensor position.
Collapse
|
7
|
Abstract
Exoskeleton robotics has ushered in a new era of modern neuromuscular rehabilitation engineering and assistive technology research. The technology promises to improve the upper-limb functionalities required for performing activities of daily living. The exoskeleton technology is evolving quickly but still needs interdisciplinary research to solve technical challenges, e.g., kinematic compatibility and development of effective human–robot interaction. In this paper, the recent development in upper-limb exoskeletons is reviewed. The key challenges involved in the development of assistive exoskeletons are highlighted by comparing available solutions. This paper provides a general classification, comparisons, and overview of the mechatronic designs of upper-limb exoskeletons. In addition, a brief overview of the control modalities for upper-limb exoskeletons is also presented in this paper. A discussion on the future directions of research is included.
Collapse
|
8
|
Xiao ZG, Menon C. A Review of Force Myography Research and Development. SENSORS (BASEL, SWITZERLAND) 2019; 19:E4557. [PMID: 31635167 PMCID: PMC6832981 DOI: 10.3390/s19204557] [Citation(s) in RCA: 44] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/29/2019] [Revised: 10/12/2019] [Accepted: 10/15/2019] [Indexed: 11/20/2022]
Abstract
Information about limb movements can be used for monitoring physical activities or for human-machine-interface applications. In recent years, a technique called Force Myography (FMG) has gained ever-increasing traction among researchers to extract such information. FMG uses force sensors to register the variation of muscle stiffness patterns around a limb during different movements. Using machine learning algorithms, researchers are able to predict many different limb activities. This review paper presents state-of-art research and development on FMG technology in the past 20 years. It summarizes the research progress in both the hardware design and the signal processing techniques. It also discusses the challenges that need to be solved before FMG can be used in an everyday scenario. This paper aims to provide new insight into FMG technology and contribute to its advancement.
Collapse
Affiliation(s)
- Zhen Gang Xiao
- Menrva Research Group, Schools of Mechatronic Systems Engineering and Engineering Science, Simon Fraser University, Metro Vancouver, BC V3T 0A3, Canada.
| | - Carlo Menon
- Menrva Research Group, Schools of Mechatronic Systems Engineering and Engineering Science, Simon Fraser University, Metro Vancouver, BC V3T 0A3, Canada.
| |
Collapse
|