Real-time conversion of inertial measurement unit data to ankle joint angles using deep neural networks

Real-Time Calibration-Free Musculotendon Kinematics for Neuromusculoskeletal Models

Neuromusculoskeletal (NMS) models enable non-invasive estimation of clinically important internal biomechanics. A critical part of NMS modelling is the estimation of musculotendon kinematics, which comprise musculotendon unit lengths, moment arms, and lines of action. Musculotendon kinematics, which are partially dependent on joint angles, define the non-linear mapping of muscle forces to joint moments and contact forces. Currently, real-time computation of musculotendon kinematics requires creation of a per-individual surrogate model. The computational speed and accuracy of these surrogates degrade with increasing number of coordinates. We developed a feed-forward neural network that completely encodes musculotendon kinematics of a target model across a wide anthropometric range, enabling accurate real-time estimates of musculotendon kinematics without need for a priori creation of a per-individual surrogate model. Compared to reference, the neural network had median normalized errors ~0.1% for musculotendon lengths, <0.4% for moment arms, and <0.10° for line of action orientations. The neural network was employed within an electromyogram-informed NMS model to calculate hip contact forces, demonstrating little difference (normalized root mean square error 1.23±0.15 %) compared to using reference musculotendon kinematics. Finally, execution time was <0.04 ms per frame and constant for increasing number of model coordinates. Our approach to musculoskeletal kinematics may facilitate deployment of complex real-time NMS modelling in computer vision or wearable sensors applications to realize biomechanics monitoring, rehabilitation, and disease management outside the research laboratory.

Predicting ankle and knee sagittal kinematics and kinetics using an ankle-mounted inertial sensor

The purpose of this study was to develop a machine learning model to reconstruct time series kinematic and kinetic profiles of the ankle and knee joint across six different tasks using an ankle-mounted IMU. Four male collegiate basketball players performed repeated tasks, including walking, jogging, running, sidestep cutting, max-height jumping, and stop-jumping, resulting in a total of 102 movements. Ankle and knee flexion-extension angles and moments were estimated using motion capture and inverse dynamics and considered 'actual data' for the purpose of model fitting. Synchronous acceleration and angular velocity data were collected from right ankle-mounted IMUs. A time-series feature extraction model was used to determine a set of features used as input to a random forest regression model to predict the ankle and knee kinematics and kinetics. Five-fold cross-validation was performed to verify the model accuracy, and statistical parametric mapping was used to determine the difference between the predicted and experimental time series. The random forest regression model predicted the time-series profiles of the ankle and knee flexion-extension angles and moments with high accuracy (Kinematics: R2 ranged from 0.782 to 0.962, RMSE ranged from 2.19° to 11.58°; Kinetics: R2 ranged from 0.711 to 0.966, RMSE ranged from 0.10 Nm/kg to 0.41 Nm/kg). There were differences between predicted and actual time series for the knee flexion-extension moment during stop-jumping and walking. An appropriately trained feature-based regression model can predict time series knee and ankle joint angles and moments across a wide range of tasks using a single ankle-mounted IMU.

A scoping review of applications of artificial intelligence in kinematics and kinetics of ankle sprains - current state-of-the-art and future prospects

BACKGROUND

Despite the existence of evidence-based rehabilitation strategies that address biomechanical deficits, the persistence of recurrent ankle problems in 70% of patients with acute ankle sprains highlights the unresolved nature of this issue. Artificial intelligence (AI) emerges as a promising tool to identify definitive predictors for ankle sprains. This paper aims to summarize the use of AI in investigating the ankle biomechanics of healthy and subjects with ankle sprains.

METHODS

Articles published between 2010 and 2023 were searched from five electronic databases. 59 papers were included for analysis with regards to: i). types of motion tested (functional vs. purposeful ankle movement); ii) types of biomechanical parameters measured (kinetic vs kinematic); iii) types of sensor systems used (lab-based vs field-based); and, iv) AI techniques used.

FINDINGS

Most studies (83.1%) examined biomechanics during functional motion. Single kinematic parameter, specifically ankle range of motion, could obtain accuracy up to 100% in identifying injury status. Wearable sensor exhibited high reliability for use in both laboratory and on-field/clinical settings. AI algorithms primarily utilized electromyography and joint angle information as input data. Support vector machine was the most used supervised learning algorithm (18.64%), while artificial neural network demonstrated the highest accuracy in eight studies.

INTERPRETATIONS

The potential for remote patient monitoring is evident with the adoption of field-based devices. Nevertheless, AI-based sensors are underutilized in detecting ankle motions at risk of sprain. We identify three key challenges: sensor designs, the controllability of AI models, and the integration of AI-sensor models, providing valuable insights for future research.

Integrating an LSTM framework for predicting ankle joint biomechanics during gait using inertial sensors

The ankle joint plays a crucial role in gait, facilitating the articulation of the lower limb, maintaining foot-ground contact, balancing the body, and transmitting the center of gravity. This study aimed to implement long short-term memory (LSTM) networks for predicting ankle joint angles, torques, and contact forces using inertial measurement unit (IMU) sensors. Twenty-five healthy participants were recruited. Two IMU sensors were attached to the foot dorsum and the vertical axis of the distal anteromedial tibia in the right lower limb to record acceleration and angular velocity during running. We proposed a LSTM-MLP (multilayer perceptron) model for training time-series data from IMU sensors and predicting ankle joint biomechanics. The model underwent validation and testing using a custom nested k-fold cross-validation process. The average values of the coefficient of determination (R2), mean absolute error (MAE), and mean squared error (MSE) for ankle dorsiflexion joint and moment, subtalar inversion joint and moment, and ankle joint contact forces were 0.89 ± 0.04, 0.75 ± 1.04, and 2.96 ± 4.96 for walking, and 0.87 ± 0.07, 0.88 ± 1.26, and 4.1 ± 7.17 for running, respectively. This study demonstrates that IMU sensors, combined with LSTM neural networks, are invaluable tools for evaluating ankle joint biomechanics in lower limb pathological diagnosis and rehabilitation, offering a cost-effective and versatile alternative to traditional experimental settings.

Estimation of Lower Limb Joint Angles and Joint Moments during Different Locomotive Activities Using the Inertial Measurement Units and a Hybrid Deep Learning Model

Using inertial measurement units (IMUs) to estimate lower limb joint kinematics and kinetics can provide valuable information for disease diagnosis and rehabilitation assessment. To estimate gait parameters using IMUs, model-based filtering approaches have been proposed, such as the Kalman filter and complementary filter. However, these methods require special calibration and alignment of IMUs. The development of deep learning algorithms has facilitated the application of IMUs in biomechanics as it does not require particular calibration and alignment procedures of IMUs in use. To estimate hip/knee/ankle joint angles and moments in the sagittal plane, a subject-independent temporal convolutional neural network-bidirectional long short-term memory network (TCN-BiLSTM) model was proposed using three IMUs. A public benchmark dataset containing the most representative locomotive activities in daily life was used to train and evaluate the TCN-BiLSTM model. The mean Pearson correlation coefficient of joint angles and moments estimated by the proposed model reached 0.92 and 0.87, respectively. This indicates that the TCN-BiLSTM model can effectively estimate joint angles and moments in multiple scenarios, demonstrating its potential for application in clinical and daily life scenarios.

Conversion of Upper-Limb Inertial Measurement Unit Data to Joint Angles: A Systematic Review

Inertial measurement units (IMUs) have become the mainstay in human motion evaluation outside of the laboratory; however, quantification of 3-dimensional upper limb motion using IMUs remains challenging. The objective of this systematic review is twofold. Firstly, to evaluate computational methods used to convert IMU data to joint angles in the upper limb, including for the scapulothoracic, humerothoracic, glenohumeral, and elbow joints; and secondly, to quantify the accuracy of these approaches when compared to optoelectronic motion analysis. Fifty-two studies were included. Maximum joint motion measurement accuracy from IMUs was achieved using Euler angle decomposition and Kalman-based filters. This resulted in differences between IMU and optoelectronic motion analysis of 4° across all degrees of freedom of humerothoracic movement. Higher accuracy has been achieved at the elbow joint with functional joint axis calibration tasks and the use of kinematic constraints on gyroscope data, resulting in RMS errors between IMU and optoelectronic motion for flexion-extension as low as 2°. For the glenohumeral joint, 3D joint motion has been described with RMS errors of 6° and higher. In contrast, scapulothoracic joint motion tracking yielded RMS errors in excess of 10° in the protraction-retraction and anterior-posterior tilt direction. The findings of this study demonstrate high-quality 3D humerothoracic and elbow joint motion measurement capability using IMUs and underscore the challenges of skin motion artifacts in scapulothoracic and glenohumeral joint motion analysis. Future studies ought to implement functional joint axis calibrations, and IMU-based scapula locators to address skin motion artifacts at the scapula, and explore the use of artificial neural networks and data-driven approaches to directly convert IMU data to joint angles.

Cross-Leg Prediction of Running Kinematics across Various Running Conditions and Drawing from a Minimal Data Set Using a Single Wearable Sensor

The feasibility of prediction of same-limb kinematics using a single inertial measurement unit attached to the same limb has been demonstrated using machine learning. This study was performed to see if a single inertial measurement unit attached to the tibia can predict the opposite leg’s kinematics (cross-leg prediction). It also investigated if there is a minimal or smaller data set in a convolutional neural network model to predict lower extremity running kinematics under other running conditions and with what accuracy for the intra- and inter-participant situations. Ten recreational runners completed running exercises under five conditions, including treadmill running at speeds of 2, 2.5, 3, and 3.5 m/s and level-ground running at their preferred speed. A one-predict-all scheme was adopted to determine which running condition could be used to best predict a participant’s overall running kinematics. Running kinematic predictions were performed for intra- and inter-participant scenarios. Among the tested running conditions, treadmill running at 3 m/s was found to be the optimal condition for accurately predicting running kinematics under other conditions, with R2 values ranging from 0.880 to 0.958 and 0.784 to 0.936 for intra- and inter-participant scenarios, respectively. The feasibility of cross-leg prediction was demonstrated but with significantly lower accuracy than the same leg. The treadmill running condition at 3 m/s showed the highest intra-participant cross-leg prediction accuracy. This study proposes a novel, deep-learning method for predicting running kinematics under different conditions on a small training data set.