1
|
Rolandino G, Gagliardi M, Martins T, Cerone GL, Andrews B, FitzGerald JJ. Developing RPC-Net: Leveraging High-Density Electromyography and Machine Learning for Improved Hand Position Estimation. IEEE Trans Biomed Eng 2024; 71:1617-1627. [PMID: 38133970 DOI: 10.1109/tbme.2023.3346192] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2023]
Abstract
OBJECTIVE The purpose of this study was to develop and evaluate the performance of RPC-Net (Recursive Prosthetic Control Network), a novel method using simple neural network architectures to translate electromyographic activity into hand position with high accuracy and computational efficiency. METHODS RPC-Net uses a regression-based approach to convert forearm electromyographic signals into hand kinematics. We tested the adaptability of the algorithm to different conditions and compared its performance with that of solutions from the academic literature. RESULTS RPC-Net demonstrated a high degree of accuracy in predicting hand position from electromyographic activity, outperforming other solutions with the same computational cost. Including previous position data consistently improved results across subjects and conditions. RPC-Net showed robustness against a reduction in the number of electromyography electrodes used and shorter input signals, indicating potential for further reduction in computational cost. CONCLUSION The results demonstrate that RPC-Net is capable of accurately translating forearm electromyographic activity into hand position, offering a practical and adaptable tool that may be accessible in clinical settings. SIGNIFICANCE The development of RPC-Net represents a significant advancement. In clinical settings, its application could enable prosthetic devices to be controlled in a way that feels more natural, improving the quality of life for individuals with limb loss.
Collapse
|
2
|
Quinn KN, Tian Y, Budde R, Irazoqui PP, Tuffaha S, Thakor NV. Neuromuscular implants: Interfacing with skeletal muscle for improved clinical translation of prosthetic limbs. Muscle Nerve 2024; 69:134-147. [PMID: 38126120 DOI: 10.1002/mus.28029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 11/27/2023] [Accepted: 12/10/2023] [Indexed: 12/23/2023]
Abstract
After an amputation, advanced prosthetic limbs can be used to interface with the nervous system and restore motor function. Despite numerous breakthroughs in the field, many of the recent research advancements have not been widely integrated into clinical practice. This review highlights recent innovations in neuromuscular implants-specifically those that interface with skeletal muscle-which could improve the clinical translation of prosthetic technologies. Skeletal muscle provides a physiologic gateway to harness and amplify signals from the nervous system. Recent surgical advancements in muscle reinnervation surgeries leverage the "bio-amplification" capabilities of muscle, enabling more intuitive control over a greater number of degrees of freedom in prosthetic limbs than previously achieved. We anticipate that state-of-the-art implantable neuromuscular interfaces that integrate well with skeletal muscle and novel surgical interventions will provide a long-term solution for controlling advanced prostheses. Flexible electrodes are expected to play a crucial role in reducing foreign body responses and improving the longevity of the interface. Additionally, innovations in device miniaturization and ongoing exploration of shape memory polymers could simplify surgical procedures for implanting such interfaces. Once implanted, wireless strategies for powering and transferring data from the interface can eliminate bulky external wires, reduce infection risk, and enhance day-to-day usability. By outlining the current limitations of neuromuscular interfaces along with potential future directions, this review aims to guide continued research efforts and future collaborations between engineers and specialists in the field of neuromuscular and musculoskeletal medicine.
Collapse
Affiliation(s)
- Kiara N Quinn
- Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
| | - Yucheng Tian
- Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
| | - Ryan Budde
- Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
| | - Pedro P Irazoqui
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, Maryland, USA
| | - Sami Tuffaha
- Department of Plastic and Reconstructive Surgery, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
| | - Nitish V Thakor
- Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, Maryland, USA
| |
Collapse
|
3
|
Vieira TM, Cerone GL, Botter A, Watanabe K, Vigotsky AD. The Sensitivity of Bipolar Electromyograms to Muscle Excitation Scales With the Inter-Electrode Distance. IEEE Trans Neural Syst Rehabil Eng 2023; 31:4245-4255. [PMID: 37844006 DOI: 10.1109/tnsre.2023.3325132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2023]
Abstract
The value of surface electromyograms (EMGs) lies in their potential to non-invasively probe the neuromuscular system. Whether muscle excitation may be accurately inferred from bipolar EMGs depends on how much the detected signal is both sensitive and specific to the excitation of the target muscle. While both are known to be a function of the inter-electrode distance (IED), specificity has been of long concern in the physiological literature. In contrast, sensitivity, at best, has been implicitly assumed. Here we provide evidence that the IED imposes a biophysical constraint on the sensitivity of surface EMG. From 20 healthy subjects, we tested the hypothesis that excessively reducing the IED limits EMGs' physiological content. We detected bipolar EMGs with IEDs varying from 5 mm to 50 mm from two skeletal muscles with distinct architectures, gastrocnemius and biceps brachii. Non-parametric statistics and Bayesian hierarchical modelling were used to evaluate the dependence of the onset of muscle excitation and signal-to-noise ratio (SNR) on the IED. Experimental results revealed that IED critically affects the sensitivity of bipolar EMGs for both muscles-indeliberately reducing the IED yields EMGs that are not representative of the whole muscle, hampering validity. Simulation results substantiate the generalization of experimental results to small and large electrodes. Based on current and previous findings, we discuss a potentially valid procedure for defining the most appropriate IED for a single bipolar, surface recording-i.e., the distance from the electrode to the target muscle boundary may heuristically serve as a lower bound when choosing an IED.
Collapse
|
4
|
Murciego LP, Komolafe A, Peřinka N, Nunes-Matos H, Junker K, Díez AG, Lanceros-Méndez S, Torah R, Spaich EG, Dosen S. A Novel Screen-Printed Textile Interface for High-Density Electromyography Recording. SENSORS (BASEL, SWITZERLAND) 2023; 23:1113. [PMID: 36772153 PMCID: PMC9919117 DOI: 10.3390/s23031113] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/26/2022] [Revised: 01/06/2023] [Accepted: 01/09/2023] [Indexed: 06/18/2023]
Abstract
Recording electrical muscle activity using a dense matrix of detection points (high-density electromyography, EMG) is of interest in a range of different applications, from human-machine interfacing to rehabilitation and clinical assessment. The wider application of high-density EMG is, however, limited as the clinical interfaces are not convenient for practical use (e.g., require conductive gel/cream). In the present study, we describe a novel dry electrode (TEX) in which the matrix of sensing pads is screen printed on textile and then coated with a soft polymer to ensure good skin-electrode contact. To benchmark the novel solution, an identical electrode was produced using state-of-the-art technology (polyethylene terephthalate with hydrogel, PET) and a process that ensured a high-quality sample. The two electrodes were then compared in terms of signal quality as well as functional application. The tests showed that the signals collected using PET and TEX were characterised by similar spectra, magnitude, spatial distribution and signal-to-noise ratio. The electrodes were used by seven healthy subjects and an amputee participant to recognise seven hand gestures, leading to similar performance during offline analysis and online control. The comprehensive assessment, therefore, demonstrated that the proposed textile interface is an attractive solution for practical applications.
Collapse
Affiliation(s)
- Luis Pelaez Murciego
- Neurorehabilitation Systems, Department of Health Science and Technology, Faculty of Medicine, Aalborg University, 9260 Aalborg, Denmark
| | - Abiodun Komolafe
- School of Electronics and Computer Science, University of Southampton, Southampton SO17 1BJ, UK
| | - Nikola Peřinka
- BCMaterials, Basque Centre for Materials, Applications and Nanostructures, UPV/EHU Science Park, 48940 Leioa, Spain
| | - Helga Nunes-Matos
- School of Electronics and Computer Science, University of Southampton, Southampton SO17 1BJ, UK
| | | | - Ander García Díez
- BCMaterials, Basque Centre for Materials, Applications and Nanostructures, UPV/EHU Science Park, 48940 Leioa, Spain
| | - Senentxu Lanceros-Méndez
- BCMaterials, Basque Centre for Materials, Applications and Nanostructures, UPV/EHU Science Park, 48940 Leioa, Spain
- Ikerbasque, Basque Foundation for Science, 48009 Bilbao, Spain
| | - Russel Torah
- School of Electronics and Computer Science, University of Southampton, Southampton SO17 1BJ, UK
| | - Erika G. Spaich
- Neurorehabilitation Systems, Department of Health Science and Technology, Faculty of Medicine, Aalborg University, 9260 Aalborg, Denmark
| | - Strahinja Dosen
- Neurorehabilitation Systems, Department of Health Science and Technology, Faculty of Medicine, Aalborg University, 9260 Aalborg, Denmark
| |
Collapse
|
5
|
Simonetti D, Koopman B, Sartori M. Automated estimation of ankle muscle EMG envelopes and resulting plantar-dorsi flexion torque from 64 garment-embedded electrodes uniformly distributed around the human leg. J Electromyogr Kinesiol 2022; 67:102701. [PMID: 36096035 DOI: 10.1016/j.jelekin.2022.102701] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2022] [Revised: 08/26/2022] [Accepted: 08/26/2022] [Indexed: 12/14/2022] Open
Abstract
The design of personalized movement training and rehabilitation pipelines relies on the ability of assessing the activation of individual muscles concurrently with the resulting joint torques exerted during functional movements. Despite advances in motion capturing, force sensing and bio-electrical recording technologies, the estimation of muscle activation and resulting force still relies on lengthy experimental and computational procedures that are not clinically viable. This work proposes a wearable technology for the rapid, yet quantitative, assessment of musculoskeletal function. It comprises of (1) a soft leg garment sensorized with 64 uniformly distributed electromyography (EMG) electrodes, (2) an algorithm that automatically groups electrodes into seven muscle-specific clusters, and (3) a EMG-driven musculoskeletal model that estimates the resulting force and torque produced about the ankle joint sagittal plane. Our results show the ability of the proposed technology to automatically select a sub-set of muscle-specific electrodes that enabled accurate estimation of muscle excitations and resulting joint torques across a large range of biomechanically diverse movements, underlying different excitation patterns, in a group of eight healthy individuals. This may substantially decrease time needed for localization of muscle sites and electrode placement procedures, thereby facilitating applicability of EMG-driven modelling pipelines in standard clinical protocols.
Collapse
Affiliation(s)
- Donatella Simonetti
- Department of Biomechanical Engineering, University of Twente, Enschede, the Netherlands.
| | - Bart Koopman
- Department of Biomechanical Engineering, University of Twente, Enschede, the Netherlands
| | - Massimo Sartori
- Department of Biomechanical Engineering, University of Twente, Enschede, the Netherlands
| |
Collapse
|
6
|
Bao T, Xie SQ, Yang P, Zhou P, Zhang ZQ. Towards Robust, Adaptive and Reliable Upper-limb Motion Estimation Using Machine Learning and Deep Learning--A Survey in Myoelectric Control. IEEE J Biomed Health Inform 2022; 26:3822-3835. [PMID: 35294368 DOI: 10.1109/jbhi.2022.3159792] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
To develop multi-functional human-machine interfaces that can help disabled people reconstruct lost functions of upper-limbs, machine learning (ML) and deep learning (DL) techniques have been widely implemented to decode human movement intentions from surface electromyography (sEMG) signals. However, due to the high complexity of upper-limb movements and the inherent non-stable characteristics of sEMG, the usability of ML/DL based control schemes is still greatly limited in practical scenarios. To this end, tremendous efforts have been made to improve model robustness, adaptation, and reliability. In this article, we provide a systematic review on recent achievements, mainly from three categories: multi-modal sensing fusion to gain additional information of the user, transfer learning (TL) methods to eliminate domain shift impacts on estimation models, and post-processing approaches to obtain more reliable outcomes. Special attention is given to fusion strategies, deep TL frameworks, and confidence estimation. \textcolor{red}{Research challenges and emerging opportunities, with respect to hardware development, public resources, and decoding strategies, are also analysed to provide perspectives for future developments.
Collapse
|
7
|
Batista E, Moncusi MA, López-Aguilar P, Martínez-Ballesté A, Solanas A. Sensors for Context-Aware Smart Healthcare: A Security Perspective. SENSORS (BASEL, SWITZERLAND) 2021; 21:6886. [PMID: 34696099 PMCID: PMC8537585 DOI: 10.3390/s21206886] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Revised: 10/12/2021] [Accepted: 10/14/2021] [Indexed: 12/24/2022]
Abstract
The advances in the miniaturisation of electronic devices and the deployment of cheaper and faster data networks have propelled environments augmented with contextual and real-time information, such as smart homes and smart cities. These context-aware environments have opened the door to numerous opportunities for providing added-value, accurate and personalised services to citizens. In particular, smart healthcare, regarded as the natural evolution of electronic health and mobile health, contributes to enhance medical services and people's welfare, while shortening waiting times and decreasing healthcare expenditure. However, the large number, variety and complexity of devices and systems involved in smart health systems involve a number of challenging considerations to be considered, particularly from security and privacy perspectives. To this aim, this article provides a thorough technical review on the deployment of secure smart health services, ranging from the very collection of sensors data (either related to the medical conditions of individuals or to their immediate context), the transmission of these data through wireless communication networks, to the final storage and analysis of such information in the appropriate health information systems. As a result, we provide practitioners with a comprehensive overview of the existing vulnerabilities and solutions in the technical side of smart healthcare.
Collapse
Affiliation(s)
- Edgar Batista
- Department of Computer Engineering and Mathematics, Universitat Rovira i Virgili, Av. Països Catalans 26, 43007 Tarragona, Spain; (E.B.); (M.A.M.); (A.M.-B.)
- SIMPPLE S.L., C. Joan Maragall 1A, 43003 Tarragona, Spain
| | - M. Angels Moncusi
- Department of Computer Engineering and Mathematics, Universitat Rovira i Virgili, Av. Països Catalans 26, 43007 Tarragona, Spain; (E.B.); (M.A.M.); (A.M.-B.)
| | - Pablo López-Aguilar
- Anti-Phishing Working Group EU, Av. Diagonal 621–629, 08028 Barcelona, Spain;
| | - Antoni Martínez-Ballesté
- Department of Computer Engineering and Mathematics, Universitat Rovira i Virgili, Av. Països Catalans 26, 43007 Tarragona, Spain; (E.B.); (M.A.M.); (A.M.-B.)
| | - Agusti Solanas
- Department of Computer Engineering and Mathematics, Universitat Rovira i Virgili, Av. Països Catalans 26, 43007 Tarragona, Spain; (E.B.); (M.A.M.); (A.M.-B.)
| |
Collapse
|