Synergy-based knee angle estimation using kinematics of thigh

Compensation Method for Missing and Misidentified Skeletons in Nursing Care Action Assessment by Improving Spatial Temporal Graph Convolutional Networks

With the increasing aging population, nursing care providers have been facing a substantial risk of work-related musculoskeletal disorders (WMSDs). Visual-based pose estimation methods, like OpenPose, are commonly used for ergonomic posture risk assessment. However, these methods face difficulty when identifying overlapping and interactive nursing tasks, resulting in missing and misidentified skeletons. To address this, we propose a skeleton compensation method using improved spatial temporal graph convolutional networks (ST-GCN), which integrates kinematic chain and action features to assess skeleton integrity and compensate for it. The results verified the effectiveness of our approach in optimizing skeletal loss and misidentification in nursing care tasks, leading to improved accuracy in calculating both skeleton joint angles and REBA scores. Moreover, comparative analysis against other skeleton compensation methods demonstrated the superior performance of our approach, achieving an 87.34% REBA accuracy score. Collectively, our method might hold promising potential for optimizing the skeleton loss and misidentification in nursing care tasks.

Data-efficient human walking speed intent identification

The ability to accurately identify human gait intent is a challenge relevant to the success of many applications in robotics, including, but not limited to, assistive devices. Most existing intent identification approaches, however, are either sensor-specific or use a pattern-recognition approach that requires large amounts of training data. This paper introduces a real-time walking speed intent identification algorithm based on the Mahalanobis distance that requires minimal training data. This data efficiency is enabled by making the simplifying assumption that each time step of walking data is independent of all other time steps. The accuracy of the algorithm was analyzed through human-subject experiments that were conducted using controlled walking speed changes on a treadmill. Experimental results confirm that the model used for intent identification converges quickly (within 5 min of training data). On average, the algorithm successfully detected the change in desired walking speed within one gait cycle and had a maximum of 87% accuracy at responding with the correct intent category of speed up, slow down, or no change. The findings also show that the accuracy of the algorithm improves with the magnitude of the speed change, while speed increases were more easily detected than speed decreases.

Gait Synergy Analysis and Modeling on Amputees and Stroke Patients for Lower Limb Assistive Devices

The concept of synergy has drawn attention and been applied to lower limb assistive devices such as exoskeletons and prostheses for improving human–machine interaction. A better understanding of the influence of gait kinematics on synergies and a better synergy-modeling method are important for device design and improvement. To this end, gait data from healthy, amputee, and stroke subjects were collected. First, continuous relative phase (CRP) was used to quantify their synergies and explore the influence of kinematics. Second, long short-term memory (LSTM) and principal component analysis (PCA) were adopted to model interlimb synergy and intralimb synergy, respectively. The results indicate that the limited hip and knee range of motions (RoMs) in stroke patients and amputees significantly influence their synergies in different ways. In interlimb synergy modeling, LSTM (RMSE: 0.798° (hip) and 1.963° (knee)) has lower errors than PCA (RMSE: 5.050° (hip) and 10.353° (knee)), which is frequently used in the literature. Further, in intralimb synergy modeling, LSTM (RMSE: 3.894°) enables better synergy modeling than PCA (RMSE: 10.312°). In conclusion, stroke patients and amputees perform different compensatory mechanisms to adapt to new interlimb and intralimb synergies different from healthy people. LSTM has better synergy modeling and shows a promise for generating trajectories in line with the wearer’s motion for lower limb assistive devices.