Personalised pose estimation from single-plane moving fluoroscope images using deep convolutional neural networks

Multi-task artificial neural networks and their extrapolation capabilities to predict full-body 3D human posture during one- and two-handed load-handling activities

Machine-learning based human posture-prediction tools can potentially be robust alternatives to motion capture measurements. Existing posture-prediction approaches are confined to two-handed load-handling activities performed at heights below 120 cm from the floor and to predicting a limited number of body-joint coordinates/angles. Moreover, the extrapolating power of these tools beyond the range of the input dataset they were trained for (e.g., for underweight, overweight, or left-handed individuals) has not been investigated. In this study, we trained/validated/tested two posture-prediction (for full-body joint coordinates and angles) artificial neural networks (ANNs) using both 70%/15%/15% random-hold-out and leave-one-subject-out methods, based on a comprehensive kinematic dataset of forty-one full-body skin markers collected from twenty right-handed normal-weight (BMI = 18-26 kg/m2) subjects. Subjects performed 204 one- and two-handed unloaded activities at different vertical (0 to 180 cm from the floor) and horizontal (up to 60 cm lateral and/or anterior) destinations. Subsequently, the extrapolation capability of the trained/validated/tested ANNs was evaluated using data collected from fifteen additional subjects (unseen by the ANNs); three individuals in five groups: underweight, overweight, obese, left-handed individuals, and subjects with a hand-load. Results indicated that the ANNs predicted body joint coordinates and angles during various activities with errors of ∼ 25 mm and ∼ 10°, respectively; considerable improvements when compared to previous posture-prediction ANNs. Extrapolation errors of our ANNs generally remained within the error range of existing ANNs with obesity and being left-handed having, respectively, the most and least compromising effects on their accuracy. These easy-to-use ANNs appear, therefore, to be robust alternatives to common posture-measurement approaches.