1
|
Tang J, Zhao L, Wu M, Jiang Z, Cao J, Bao X. A SE-DenseNet-LSTM model for locomotion mode recognition in lower limb exoskeleton. PeerJ Comput Sci 2024; 10:e1881. [PMID: 38435551 PMCID: PMC10909223 DOI: 10.7717/peerj-cs.1881] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Accepted: 01/26/2024] [Indexed: 03/05/2024]
Abstract
Locomotion mode recognition in humans is fundamental for flexible control in wearable-powered exoskeleton robots. This article proposes a hybrid model that combines a dense convolutional network (DenseNet) and long short-term memory (LSTM) with a channel attention mechanism (SENet) for locomotion mode recognition. DenseNet can automatically extract deep-level features from data, while LSTM effectively captures long-dependent information in time series. To evaluate the validity of the hybrid model, inertial measurement units (IMUs) and pressure sensors were used to obtain motion data from 15 subjects. Five locomotion modes were tested for the hybrid model, such as level ground walking, stair ascending, stair descending, ramp ascending, and ramp descending. Furthermore, the data features of the ramp were inconspicuous, leading to large recognition errors. To address this challenge, the SENet module was incorporated, which improved recognition rates to some extent. The proposed model automatically extracted the features and achieved an average recognition rate of 97.93%. Compared with known algorithms, the proposed model has substantial recognition results and robustness. This work holds promising potential for applications such as limb support and weight bearing.
Collapse
Affiliation(s)
- Jing Tang
- Hubei Key Laboratory for High-efficiency Utilization of Solar Energy and Operation Control of Energy Storage System, Hubei University of Technology, Wuhan, China
- Hubei Engineering Research Centre for Safety Monitoring of New Energy and Power Grid Equipment, Hubei University of Technology, Wuhan, China
| | - Lun Zhao
- Hubei Key Laboratory for High-efficiency Utilization of Solar Energy and Operation Control of Energy Storage System, Hubei University of Technology, Wuhan, China
| | - Minghu Wu
- Hubei Key Laboratory for High-efficiency Utilization of Solar Energy and Operation Control of Energy Storage System, Hubei University of Technology, Wuhan, China
- Hubei Engineering Research Centre for Safety Monitoring of New Energy and Power Grid Equipment, Hubei University of Technology, Wuhan, China
| | - Zequan Jiang
- Hubei Key Laboratory for High-efficiency Utilization of Solar Energy and Operation Control of Energy Storage System, Hubei University of Technology, Wuhan, China
| | - Jiaxun Cao
- Hubei Key Laboratory for High-efficiency Utilization of Solar Energy and Operation Control of Energy Storage System, Hubei University of Technology, Wuhan, China
| | - Xiang Bao
- Hubei Key Laboratory for High-efficiency Utilization of Solar Energy and Operation Control of Energy Storage System, Hubei University of Technology, Wuhan, China
| |
Collapse
|
2
|
Andrade RL, Figueiredo J, Fonseca P, Vilas-Boas JP, Silva MT, Santos CP. Human-Robot Joint Misalignment, Physical Interaction, and Gait Kinematic Assessment in Ankle-Foot Orthoses. SENSORS (BASEL, SWITZERLAND) 2023; 24:246. [PMID: 38203110 PMCID: PMC10781370 DOI: 10.3390/s24010246] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Revised: 12/24/2023] [Accepted: 12/26/2023] [Indexed: 01/12/2024]
Abstract
Lower limb exoskeletons and orthoses have been increasingly used to assist the user during gait rehabilitation through torque transmission and motor stability. However, the physical human-robot interface (HRi) has not been properly addressed. Current orthoses lead to spurious forces at the HRi that cause adverse effects and high abandonment rates. This study aims to assess and compare, in a holistic approach, human-robot joint misalignment and gait kinematics in three fixation designs of ankle-foot orthoses (AFOs). These are AFOs with a frontal shin guard (F-AFO), lateral shin guard (L-AFO), and the ankle modulus of the H2 exoskeleton (H2-AFO). An experimental protocol was implemented to assess misalignment, fixation displacement, pressure interactions, user-perceived comfort, and gait kinematics during walking with the three AFOs. The F-AFO showed reduced vertical misalignment (peak of 1.37 ± 0.90 cm, p-value < 0.05), interactions (median pressures of 0.39-3.12 kPa), and higher user-perceived comfort (p-value < 0.05) when compared to H2-AFO (peak misalignment of 2.95 ± 0.64 and pressures ranging from 3.19 to 19.78 kPa). F-AFO also improves the L-AFO in pressure (median pressures ranging from 8.64 to 10.83 kPa) and comfort (p-value < 0.05). All AFOs significantly modified hip joint angle regarding control gait (p-value < 0.01), while the H2-AFO also affected knee joint angle (p-value < 0.01) and gait spatiotemporal parameters (p-value < 0.05). Overall, findings indicate that an AFO with a frontal shin guard and a sports shoe is effective at reducing misalignment and pressure at the HRI, increasing comfort with slight changes in gait kinematics.
Collapse
Affiliation(s)
- Ricardo Luís Andrade
- Center for MicroElectroMechanical Systems (CMEMS), University of Minho, 4800-058 Guimarães, Portugal
| | - Joana Figueiredo
- Center for MicroElectroMechanical Systems (CMEMS), University of Minho, 4800-058 Guimarães, Portugal
- LABBELS—Associate Laboratory, 4710-057 Braga/4800-058 Guimarães, Portugal
| | - Pedro Fonseca
- Porto Biomechanics Laboratory (LABIOMEP), University of Porto, 4200-450 Porto, Portugal; (P.F.); (J.P.V.-B.)
| | - João P. Vilas-Boas
- Porto Biomechanics Laboratory (LABIOMEP), University of Porto, 4200-450 Porto, Portugal; (P.F.); (J.P.V.-B.)
- Centre of Research, Education, Innovation and Intervention in Sport (CIFI2D), Faculty of Sport, University of Porto, 4200-450 Porto, Portugal
| | - Miguel T. Silva
- IDMEC, Instituto Superior Técnico, Universidade de Lisboa, Av. Rovisco Pais 1, 1049-001 Lisbon, Portugal;
| | - Cristina P. Santos
- Center for MicroElectroMechanical Systems (CMEMS), University of Minho, 4800-058 Guimarães, Portugal
- LABBELS—Associate Laboratory, 4710-057 Braga/4800-058 Guimarães, Portugal
| |
Collapse
|
3
|
Massardi S, Pinto-Fernandez D, Babič J, Dežman M, Trošt A, Grosu V, Lefeber D, Rodriguez C, Bessler J, Schaake L, Prange-Lasonder G, Veneman JF, Torricelli D. Relevance of hazards in exoskeleton applications: a survey-based enquiry. J Neuroeng Rehabil 2023; 20:68. [PMID: 37259115 DOI: 10.1186/s12984-023-01191-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Accepted: 05/10/2023] [Indexed: 06/02/2023] Open
Abstract
Exoskeletons are becoming the reference technology for assistance and augmentation of human motor functions in a wide range of application domains. Unfortunately, the exponential growth of this sector has not been accompanied by a rigorous risk assessment (RA) process, which is necessary to identify the major aspects concerning the safety and impact of this new technology on humans. This situation may seriously hamper the market uptake of new products. This paper presents the results of a survey that was circulated to understand how hazards are considered by exoskeleton users, from research and industry perspectives. Our analysis aimed to identify the perceived occurrence and the impact of a sample of generic hazards, as well as to collect suggestions and general opinions from the respondents that can serve as a reference for more targeted RA. Our results identified a list of relevant hazards for exoskeletons. Among them, misalignments and unintended device motion were perceived as key aspects for exoskeletons' safety. This survey aims to represent a first attempt in recording overall feedback from the community and contribute to future RAs and the identification of better mitigation strategies in the field.
Collapse
Affiliation(s)
- Stefano Massardi
- Neural Rehabilitation Group of the Spanish National Research Council (CSIC), Madrid, Spain
- Department of Mechanical and Industrial Engineering, University of Brescia (DIMI), Brescia, Italy
| | - David Pinto-Fernandez
- Neural Rehabilitation Group of the Spanish National Research Council (CSIC), Madrid, Spain
- Universidad Politécnica de Madrid, Madrid, Spain
| | - Jan Babič
- Laboratory for Neuromechanics and Biorobotics, Department for Automation, Biocybernetics, and Robotics, Jožef Stefan Institute, Ljubljana, Slovenia
| | - Miha Dežman
- Laboratory for Neuromechanics and Biorobotics, Department for Automation, Biocybernetics, and Robotics, Jožef Stefan Institute, Ljubljana, Slovenia
| | - Andrej Trošt
- Laboratory for Neuromechanics and Biorobotics, Department for Automation, Biocybernetics, and Robotics, Jožef Stefan Institute, Ljubljana, Slovenia
| | - Victor Grosu
- Department of Mechanical Engineering, Robotics & Multibody Mechanics Research Group (R&MM), and Flanders Make, Vrije Universiteit Brussel, Pleinlaan 2, 1050, Brussels, Belgium
| | - Dirk Lefeber
- Department of Mechanical Engineering, Robotics & Multibody Mechanics Research Group (R&MM), and Flanders Make, Vrije Universiteit Brussel, Pleinlaan 2, 1050, Brussels, Belgium
| | - Carlos Rodriguez
- Department of Mechanical Engineering, Robotics & Multibody Mechanics Research Group (R&MM), and Flanders Make, Vrije Universiteit Brussel, Pleinlaan 2, 1050, Brussels, Belgium
| | - Jule Bessler
- Department of Biomedical Signals and Systems, University of Twente, Enschede, The Netherlands
- Roessingh Research and Development, Enschede, The Netherlands
| | | | - Gerdienke Prange-Lasonder
- Roessingh Research and Development, Enschede, The Netherlands
- Department of Biomechanical Engineering, University of Twente, Enschede, The Netherlands
| | | | - Diego Torricelli
- Neural Rehabilitation Group of the Spanish National Research Council (CSIC), Madrid, Spain.
| |
Collapse
|
4
|
ZHENG JIANBIN, PENG MINGPENG, HUANG LIPING, GAO YIFAN, LI ZEFANG, WANG BINFENG, WANG YU. A CNN–SVM MODEL USING IMU FOR LOCOMOTION MODE RECOGNITION IN LOWER EXTREMITY EXOSKELETON. J MECH MED BIOL 2022. [DOI: 10.1142/s0219519422500439] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Human activity intention is indispensable for wearable powered lower extremity exoskeleton such that ensuring the compliant control of the robot. Lots of researches have been done on gait phase detection, which served as a sub-module of locomotion mode recognition to support the follow-on task. Therefore, it is self-evident that locomotion mode recognition is of great importance. Many model-based recognition methods are usually applied in manual extraction of cumbersome features, such as the traditional neural network (NN), support vector machine (SVM), etc. In contrast, the feature mapping layer coming with the convolutional neural network (CNN) can effectively solve the above time-consuming problem. Given that the training of NN is prone to overfitting, SVM with optimal characteristics is considered. A hybrid CNN–SVM model is proposed to identify human locomotion modes by collecting multi-channel inertial measurement unit (IMU) signals and is integrated with the error correction function of the finite state machine (FSM). Therefore, the CNN–SVM model has great influence on the generalization performance and recognition accuracy. The recognition rates of five single locomotion modes and eight mixed locomotion modes reach 97.91% and 98.93%, respectively. The system meets the demand of real-time performance, and the recognition time exceeds 370[Formula: see text]ms on heel strike.
Collapse
Affiliation(s)
- JIANBIN ZHENG
- School of Information Engineering, Wuhan University of Technology, Wuhan, Hubei 430070, P. R. China
| | - MINGPENG PENG
- School of Information Engineering, Wuhan University of Technology, Wuhan, Hubei 430070, P. R. China
| | - LIPING HUANG
- School of Information Engineering, Wuhan University of Technology, Wuhan, Hubei 430070, P. R. China
| | - YIFAN GAO
- School of Information Engineering, Wuhan University of Technology, Wuhan, Hubei 430070, P. R. China
| | - ZEFANG LI
- School of Information Engineering, Wuhan University of Technology, Wuhan, Hubei 430070, P. R. China
| | - BINFENG WANG
- School of Information Engineering, Wuhan University of Technology, Wuhan, Hubei 430070, P. R. China
| | - YU WANG
- School of Information Engineering, Wuhan University of Technology, Wuhan, Hubei 430070, P. R. China
| |
Collapse
|
5
|
Massardi S, Rodriguez-Cianca D, Pinto-Fernandez D, Moreno JC, Lancini M, Torricelli D. Characterization and Evaluation of Human-Exoskeleton Interaction Dynamics: A Review. SENSORS (BASEL, SWITZERLAND) 2022; 22:3993. [PMID: 35684614 PMCID: PMC9183080 DOI: 10.3390/s22113993] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/29/2022] [Revised: 05/21/2022] [Accepted: 05/23/2022] [Indexed: 02/01/2023]
Abstract
Exoskeletons and exosuits have witnessed unprecedented growth in recent years, especially in the medical and industrial sectors. In order to be successfully integrated into the current society, these devices must comply with several commercialization rules and safety standards. Due to their intrinsic coupling with human limbs, one of the main challenges is to test and prove the quality of physical interaction with humans. However, the study of physical human-exoskeleton interactions (pHEI) has been poorly addressed in the literature. Understanding and identifying the technological ways to assess pHEI is necessary for the future acceptance and large-scale use of these devices. The harmonization of these evaluation processes represents a key factor in building a still missing accepted framework to inform human-device contact safety. In this review, we identify, analyze, and discuss the metrics, testing procedures, and measurement devices used to assess pHEI in the last ten years. Furthermore, we discuss the role of pHEI in safety contact evaluation. We found a very heterogeneous panorama in terms of sensors and testing methods, which are still far from considering realistic conditions and use-cases. We identified the main gaps and drawbacks of current approaches, pointing towards a number of promising research directions. This review aspires to help the wearable robotics community find agreements on interaction quality and safety assessment testing procedures.
Collapse
Affiliation(s)
- Stefano Massardi
- Neural Rehabilitation Group, Cajal Institute, Spanish National Research Council (CSIC), 28006 Madrid, Spain; (S.M.); (D.R.-C.); (D.P.-F.); (J.C.M.)
- Department of Mechanical and Industrial Engineering (DIMI), University of Brescia, 25100 Brescia, Italy
| | - David Rodriguez-Cianca
- Neural Rehabilitation Group, Cajal Institute, Spanish National Research Council (CSIC), 28006 Madrid, Spain; (S.M.); (D.R.-C.); (D.P.-F.); (J.C.M.)
| | - David Pinto-Fernandez
- Neural Rehabilitation Group, Cajal Institute, Spanish National Research Council (CSIC), 28006 Madrid, Spain; (S.M.); (D.R.-C.); (D.P.-F.); (J.C.M.)
- Universidad Politécnica de Madrid (UPM), 28040 Madrid, Spain
| | - Juan C. Moreno
- Neural Rehabilitation Group, Cajal Institute, Spanish National Research Council (CSIC), 28006 Madrid, Spain; (S.M.); (D.R.-C.); (D.P.-F.); (J.C.M.)
| | - Matteo Lancini
- Department of Medical and Surgical Specialties, Radiological Sciences and Public Health (DSMC), University of Brescia, 25100 Brescia, Italy;
| | - Diego Torricelli
- Neural Rehabilitation Group, Cajal Institute, Spanish National Research Council (CSIC), 28006 Madrid, Spain; (S.M.); (D.R.-C.); (D.P.-F.); (J.C.M.)
| |
Collapse
|
6
|
Langlois K, Geeroms J, Van De Velde G, Rodriguez-Guerrero C, Verstraten T, Vanderborght B, Lefeber D. Improved Motion Classification With an Integrated Multimodal Exoskeleton Interface. Front Neurorobot 2021; 15:693110. [PMID: 34759807 PMCID: PMC8572867 DOI: 10.3389/fnbot.2021.693110] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2021] [Accepted: 09/23/2021] [Indexed: 11/13/2022] Open
Abstract
Human motion intention detection is an essential part of the control of upper-body exoskeletons. While surface electromyography (sEMG)-based systems may be able to provide anticipatory control, they typically require exact placement of the electrodes on the muscle bodies which limits the practical use and donning of the technology. In this study, we propose a novel physical interface for exoskeletons with integrated sEMG- and pressure sensors. The sensors are 3D-printed with flexible, conductive materials and allow multi-modal information to be obtained during operation. A K-Nearest Neighbours classifier is implemented in an off-line manner to detect reaching movements and lifting tasks that represent daily activities of industrial workers. The performance of the classifier is validated through repeated experiments and compared to a unimodal EMG-based classifier. The results indicate that excellent prediction performance can be obtained, even with a minimal amount of sEMG electrodes and without specific placement of the electrode.
Collapse
Affiliation(s)
- Kevin Langlois
- Robotics & Multibody Mechanics Research Group, MECH Department, Vrije Universiteit Brussel, Brussel, Belgium.,IMEC, Leuven, Belgium
| | - Joost Geeroms
- Robotics & Multibody Mechanics Research Group, MECH Department, Vrije Universiteit Brussel, Brussel, Belgium.,Flanders Make, Lommel, Belgium
| | - Gabriel Van De Velde
- Robotics & Multibody Mechanics Research Group, MECH Department, Vrije Universiteit Brussel, Brussel, Belgium
| | - Carlos Rodriguez-Guerrero
- Robotics & Multibody Mechanics Research Group, MECH Department, Vrije Universiteit Brussel, Brussel, Belgium.,Flanders Make, Lommel, Belgium
| | - Tom Verstraten
- Robotics & Multibody Mechanics Research Group, MECH Department, Vrije Universiteit Brussel, Brussel, Belgium.,Flanders Make, Lommel, Belgium
| | - Bram Vanderborght
- Robotics & Multibody Mechanics Research Group, MECH Department, Vrije Universiteit Brussel, Brussel, Belgium.,IMEC, Leuven, Belgium
| | - Dirk Lefeber
- Robotics & Multibody Mechanics Research Group, MECH Department, Vrije Universiteit Brussel, Brussel, Belgium.,Flanders Make, Lommel, Belgium
| |
Collapse
|
7
|
Wang Y, Qiu J, Cheng H, Zheng X. Analysis of Human-Exoskeleton System Interaction for Ergonomic Design. HUMAN FACTORS 2020:18720820913789. [PMID: 32207992 DOI: 10.1177/0018720820913789] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
OBJECTIVE Lower-limb exoskeleton systems are defined as gait training or walking-assisting devices for spinal cord injury or hemiplegic patients. Crutches, straps, and baffles are designed to protect subjects from falling. However, skin abrasions occur when the interaction forces are too large. In this study, the interaction forces between the human body and an exoskeleton system named the AIDER were measured to confirm whether the design was ergonomic. BACKGROUND The AIDER system is a wearable lower-limb exoskeleton. It secures a subject by binding on the waist, thighs, shanks, and feet. METHOD Eight healthy subjects participated in the study. The interaction forces of the waist strap, thigh baffles, shank baffles, and crutch handles were measured by pressure sensors. Ten repetitions were completed in this study. After one repetition, custom comfort questionnaires were completed by the subjects. RESULTS Although a few of the peak values of the maximum intensities of pressure between the hands and crutch handles reached the minimum value of the pain-pressure threshold (PPT), the average pressure intensities were much smaller than the PPT value. CONCLUSIONS The results indicated that the mechanical structure and control strategy of the AIDER must be improved to be more ergonomic in the future.
Collapse
Affiliation(s)
- Yilin Wang
- 272021 12599 University of Electronic Science and Technology of China, Chengdu, China
| | - Jing Qiu
- 272021 12599 University of Electronic Science and Technology of China, Chengdu, China
| | - Hong Cheng
- 272021 12599 University of Electronic Science and Technology of China, Chengdu, China
| | - Xiaojuan Zheng
- 272021 12599 University of Electronic Science and Technology of China, Chengdu, China
| |
Collapse
|
8
|
Wan X, Liu Y, Akiyama Y, Yamada Y. Monitoring Contact Behavior During Assisted Walking With a Lower Limb Exoskeleton. IEEE Trans Neural Syst Rehabil Eng 2020; 28:869-877. [PMID: 32167901 DOI: 10.1109/tnsre.2020.2979986] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Interaction forces between a robotic cuff and the skin during assisted walking with a lower limb exoskeleton may cause skin injuries over time, such as blisters and ulcers. This study proposes a sensing cuff that can monitor the contact behavior between the exoskeleton and skin during assisted walking, and a functional test and assisted walking experiments were conducted to evaluate the performance of the proposed device. The functional test of the sensing cuff showed good performance of capturing the contact behavior for safety evaluation. The walking experiment involved subjects walking on a treadmill with a lower limb exoskeleton under different conditions (i.e., walking speed and clothing), and the sensing cuff attached to the exoskeleton measured the interaction forces and slip velocity. The magnitude of shear force in the movement direction peaked near the beginning and within 40 - 50% of the gait cycle. The contact safety of the lower limb exoskeleton during assisted walking was then evaluated based on the calculated shear stress. The designed sensing cuff could provide sufficient information regarding contact behavior and contact safety during assisted walking.
Collapse
|
9
|
Li Z, Yuan Y, Luo L, Su W, Zhao K, Xu C, Huang J, Pi M. Hybrid Brain/Muscle Signals Powered Wearable Walking Exoskeleton Enhancing Motor Ability in Climbing Stairs Activity. ACTA ACUST UNITED AC 2019. [DOI: 10.1109/tmrb.2019.2949865] [Citation(s) in RCA: 79] [Impact Index Per Article: 13.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|