Musculoskeletal model of osseointegrated transfemoral amputees in OpenSim

Learning to Walk With Deep Reinforcement Learning: Forward Dynamic Simulation of a Physics-Based Musculoskeletal Model of an Osseointegrated Transfemoral Amputee

This paper leverages the OpenSim physics-based simulation environment for the forward dynamic simulation of an osseointegrated transfemoral amputee musculoskeletal model, wearing a generic prosthesis. A deep reinforcement learning architecture, which combines the proximal policy optimization algorithm with imitation learning, is designed to enable the model to walk by using three different observation states. The first is a complete state that includes the agent's kinematics, ground reaction forces, and muscle data; the second is a reduced state that only includes the kinematics and ground reaction forces; the third is an augmented state that combines the kinematics and ground reaction forces with a prediction of the muscle data generated by a fully-connected feed-forward neural network. The empirical results demonstrate that the model trained with the augmented observation state can achieve walking patterns with rewards and gait symmetry ratings comparable to those of the model trained with the complete observation state, while there are no symmetric walking patterns when using the reduced observation state. This paper shows the importance of including muscle data in a deep reinforcement learning architecture for the forward dynamic simulation of musculoskeletal models of transfemoral amputees.

The gait1415+2 OpenSim musculoskeletal model of transfemoral amputees with a generic bone-anchored prosthesis

This short communication presents the gait1415+2 musculoskeletal model, that has been developed in OpenSim to describe the lower-extremity of a human subject with transfemoral amputation wearing a generic lower-limb bone-anchored prosthesis. The model has fourteen degrees of freedom, governed by fifteen musculotendon units (placed at the contralateral and residual limbs) and two generic actuators (one placed at the knee joint and one at the ankle joint of the prosthetic leg). Even though the model is a simplified abstraction, it is capable of generating a human-like walking gait and, specifically, it is capable of reproducing both the kinematics and the dynamics of a person with transfemoral amputation wearing a bone-anchored prosthesis during normal level-ground walking. The model is released as support material to this short communication with the final goal of providing the scientific community with a tool for performing forward and inverse dynamics simulations, and for developing computationally-demanding control schemes based on artificial intelligence methods for lower-limb prostheses.