Conclusion or Illusion: Quantifying Uncertainty in Inverse Analyses From Marker-Based Motion Capture due to Errors in Marker Registration and Model Scaling

Validation of Markerless Motion Capture for Soldier Movement Patterns Assessment Under Varying Body-Borne Loads

Field performance of modern soldiers is affected by an increase in body-borne load due to technological advancements related to their armour and equipment. In this project, the Theia3D markerless motion capture system was compared to the marker-based gold standard for capturing movement patterns of participants wearing various body-borne loads. The aim was to estimate lower body joint kinematics, gastrocnemius lateralis and medialis muscle activation patterns, and lower body joint reaction forces from the two motion capture systems. Data were collected on 16 participants performing three repetitions of walking and running under four body-borne load conditions by both motion capture systems simultaneously. A complete musculoskeletal analysis was completed in OpenSim. Strong correlations ( r > 0.8 ) and acceptable differences were observed between the kinematics of the marker-based and markerless systems. Timing of muscle activations of the gastrocnemius lateralis and medialis, as estimated through OpenSim from both systems, agreed with the ones measured using electromyography. Joint reaction force results showed a very strong correlation ( r > 0.9 ) between the systems; however, the markerless model estimated greater joint reaction forces when compared the marker-based model due to differences in muscle recruitment strategy. Overall, this research highlights the potential of markerless motion capture to track participants wearing body-borne loads.

LiDAR-based scaling of OpenSim musculoskeletal human models is a viable alternative to marker-based approaches - A preliminary study

Biomechanical analysis is increasingly being undertaken in field-based settings, often using inertial sensors or video-based pose estimation. These advancements necessitate more practical and accessible scaling methods as alternatives to traditional laboratory-based techniques like optical marker-based scaling. LiDAR scanning is a technique that could provide a reliable and efficient means of scaling biomechanical models. This study tested a scaling method for OpenSim models and comparing outcomes with those of traditional marker-based scaling in healthy adult participants. An anatomical skeleton was inferred from a LiDAR scan taken with an iPad. Key skeletal landmarks were then used to generate scaling factors using statistical shape models. The scaling factors of the pelvis, femur and tibia body segments derived from the LiDAR-based method demonstrated excellent reliability, with repeated scans of seven subjects producing an ICC value of 0.961. When comparing the scaling factors of eight additional subjects with the current gold standard technique of marker-based optical motion capture, a Bland-Altman analysis revealed differences of -0.5% ± 5.3 (95CI = [-10.8, 10]). Joint kinematics calculated using LiDAR scaled models had an average RMSD of 3.7° ± 0.1°when compared with those calculated with a marker-scaled model. These results indicate that a LiDAR-based scaling method can address the challenge of accurate and reliable scaling methods that are practical for use in the field. Future work with larger cohorts and diverse populations, and scaling of other body segments will provide further validation and enhance the generalizability and robustness of this approach.

Real-time, accurate, and open source upper-limb musculoskeletal analysis using a single RGBD camera - An exploratory hand-cycling study

Biomechanical biofeedback may enhance rehabilitation and provide clinicians with more objective task evaluation. These feedbacks often rely on expensive motion capture systems (∼$100000), which restricts their widespread use, leading to the development of computer vision-based methods. These methods are subject to large joint angle errors, considering the upper limb, and exclude the scapula and clavicle motion in the analysis. Our open-source approach offers a user-friendly solution for high-fidelity upper-limb kinematics using a single consumer-grade depth-sensing camera (∼$500) and includes semi-automatic skin marker labeling. Real-time biomechanical analysis, ranging from kinematics to muscle force estimation, was conducted on eight participants performing a hand-cycling motion to demonstrate the applicability of our approach on the upper limb. Markers were recorded by the depth-sensing camera and an optoelectronic camera system, considered as a reference. Muscle activity and external load were recorded using eight electromyography sensors and instrumented hand pedals, respectively. Bland-Altman analysis revealed significant agreements in the 3D markers' positions between the two motion capture methods, with errors averaging 3.3 ± 3.9 mm. The error propagation was low for the biomechanical analysis, with joint angle differences, for example, below 5° when comparing both systems. Biofeedback from the depth-sensing camera was provided at 68 Hz. Our study introduces a novel method for using a depth-sensing camera as a low-cost motion capture solution. Results from healthy participants suggest its potential for accurate kinematic reconstruction and comprehensive upper-limb biomechanical studies. Further investigation is needed to explore its clinical applications in pathological populations.

Influence of multibody kinematic optimisation pipeline on marker residual errors

Residual errors are used as a goodness-of-fit metric of the musculoskeletal model to the experimental data in multibody kinematic optimisation (MKO) analyses. Despite many studies reporting residual errors as a criterion for evaluating their proposed algorithm or model, the validity of residual errors as a performance metric has been questioned, with studies indicating a non-causal relationship between residual errors and computed joint angles. Additionally, the impact of different parameters of an MKO pipeline on residual errors has not been analysed. In our study, we have investigated the effect of each step of the MKO pipeline on residual errors, and the existence of a causal relationship between residual errors and joint angles. Increases in residual errors from the baseline model (13.84 [12.72, 15.15]mm) were obtained for: models with marker registration errors of 1.25 cm (16.36 [15.37, 17.57]mm); models with segment scaling errors of 1.25 cm (14.84 [13.77, 16.24]mm); variation in marker weighting scheme (15.28[14.00, 16.85]mm); and models with differing joint constraints (18.21[17.37, 19.11]mm). We also observed that significant variation in residual errors results in significant variation in computed joint angles, with increases in residual error positively correlated with increases in joint angle errors when the same MKO pipeline is employed. Our findings support the existence of a causal relationship and present the significant effect the MKO pipeline has on residual errors. We believe our results can further the discussion of residual errors as a goodness-of-fit metric, specifically in the absence of artefact-free bone movement.

Inverse kinematics in cervical spine models: Effects of scaling and model degrees of freedom for extension and flexion movements

Intervertebral kinematics can affect model-predicted loads and strains in the spine; therefore knowledge of expected vertebral kinematics error is important for understanding the limitations of model predictions. This study addressed how different kinematic models of the neck affect the prediction of intervertebral kinematics from markers on the head and trunk. Eight subjects executed head and neck extension-flexion motion with simultaneous motion capture and biplanar dynamic stereo-radiography (DSX) of vertebrae C1-C7. A generic head and neck model in OpenSim was scaled by marker data, and three versions of the model were used with an inverse kinematics solver. The models differed according to the number of independent degrees of freedom (DOF) between the head and trunk: 3 rotational DOF with constraints defining intervertebral kinematics as a function of overall head-trunk motion; 24DOF with 3 independent rotational DOF at each level, skull-T1; 48DOF with 3 rotational and 3 translational DOF at each level. Marker tracking error was lower for scaled models compared to generic models and decreased as model DOF increased. The largest mean absolute error (MAE) was found in extension-flexion angle and anterior-posterior translation at C1-C2, and superior-inferior translation at C2-C3. Model scaling and complexity did not have a statistically significant effect on most error metrics when corrected for multiple comparisons, but ranges of motion were significantly different from DSX in some cases. This study evaluated model kinematics in comparison to gold standard radiographic data and provides important information about intervertebral kinematics error that are foundational to model validity.

Hip contact forces can be predicted with a neural network using only synthesised key points and electromyography in people with hip osteoarthritis

OBJECTIVE

To develop and validate a neural network to estimate hip contact forces (HCF), and lower body kinematics and kinetics during walking in individuals with hip osteoarthritis (OA) using synthesised anatomical key points and electromyography. To assess the capability of the neural network to detect directional changes in HCF resulting from prescribed gait modifications.

DESIGN

A calibrated electromyography-informed neuromusculoskeletal model was used to compute lower body joint angles, moments, and HCF for 17 participants with mild-to-moderate hip OA. Anatomical key points (e.g., joint centres) were synthesised from marker trajectories and augmented with bias and noise expected from computer vision-based pose estimation systems. Temporal convolutional and long short-term memory neural networks (NN) were trained using leave-one-subject-out validation to predict neuromusculoskeletal modelling outputs from the synthesised key points and measured electromyography data from 5 hip-spanning muscles.

RESULTS

HCF was predicted with an average error of 13.4 ± 7.1% of peak force. Joint angles and moments were predicted with an average root-mean-square-error of 5.3 degrees and 0.10 Nm/kg, respectively. The NN could detect changes in peak HCF that occur due to gait modifications with good agreement with neuromusculoskeletal modelling (r2 = 0.72) and a minimum detectable change of 9.5%.

CONCLUSION

The developed neural network predicted HCF and lower body joint angles and moments in individuals with hip OA using noisy synthesised key point locations with acceptable errors. Changes in HCF magnitude due to gait modifications were predicted with high accuracy. These findings have important implications for implementation of load-modification based gait retraining interventions for people with hip OA in a natural environment (i.e., home, clinic).

AST: An OpenSim-based tool for the automatic scaling of generic musculoskeletal models

BACKGROUND AND OBJECTIVES

The paper introduces a tool called Automatic Scaling Tool (AST) designed for improving and expediting musculoskeletal (MSK) simulations based on generic models in OpenSim. Scaling is a crucial initial step in MSK analyses, involving the correction of virtual marker locations on a model to align with actual experimental markers.

METHODS

The AST automates this process by iteratively adjusting virtual markers using scaling and inverse kinematics on a static trial. It evaluates the root mean square error (RMSE) and maximum marker error, implementing corrective actions until achieving the desired accuracy level. The tool determines whether to scale a segment with a marker-based or constant scaling factor based on checks on RMSE and segment scaling factors.

RESULTS

Testing on three generic MSK models demonstrated that the AST significantly outperformed manual scaling by an expert operator. The RMSE for static trials was one order of magnitude lower, and for gait tasks, it was five times lower (8.5 ± 0.76 mm vs. 44.5 ± 7.5 mm). The AST consistently achieved the desired level of accuracy in less than 100 iterations, providing reliable scaled MSK models within a relatively brief timeframe, ranging from minutes to hours depending on model complexity.

CONCLUSIONS

The paper concludes that AST can greatly benefit the biomechanical community by quickly and accurately scaling generic models, a critical first step in MSK analyses. Further validation through additional experimental datasets and generic models is proposed for future tests.

A Method to Track 3D Knee Kinematics by Multi-Channel 3D-Tracked A-Mode Ultrasound

This paper introduces a method for measuring 3D tibiofemoral kinematics using a multi-channel A-mode ultrasound system under dynamic conditions. The proposed system consists of a multi-channel A-mode ultrasound system integrated with a conventional motion capture system (i.e., optical tracking system). This approach allows for the non-invasive and non-radiative quantification of the tibiofemoral joint's six degrees of freedom (DOF). We demonstrated the feasibility and accuracy of this method in the cadaveric experiment. The knee joint's motions were mimicked by manually manipulating the leg through multiple motion cycles from flexion to extension. To measure it, six custom ultrasound holders, equipped with a total of 30 A-mode ultrasound transducers and 18 optical markers, were mounted on various anatomical regions of the lower extremity of the specimen. During experiments, 3D-tracked intra-cortical bone pins were inserted into the femur and tibia to measure the ground truth of tibiofemoral kinematics. The results were compared with the tibiofemoral kinematics derived from the proposed ultrasound system. The results showed an average rotational error of 1.51 ± 1.13° and a translational error of 3.14 ± 1.72 mm for the ultrasound-derived kinematics, compared to the ground truth. In conclusion, this multi-channel A-mode ultrasound system demonstrated a great potential of effectively measuring tibiofemoral kinematics during dynamic motions. Its improved accuracy, nature of non-invasiveness, and lack of radiation exposure make this method a promising alternative to incorporate into gait analysis and prosthetic kinematic measurements later.

Muscle-Tendon Unit Length Measurement Using 3D Ultrasound in Passive Conditions: OpenSim Validation and Development of Personalized Models

This study investigated the validity of using OpenSim to measure muscle-tendon unit (MTU) length of the bi-articular lower limb muscles in several postures (shortened, lengthened, a combination of shortened and lengthened involving both joints, neutral and standing) using 3D freehand ultrasound (US), and to propose new personalized models. MTU length was measured on 14 participants and 6 bi-articular muscles (semimembranosus SM, semitendinosus ST, biceps femoris BF, rectus femoris RF, gastrocnemius medialis GM and gastrocnemius lateralis GL), considering 5 to 6 postures. MTU length was computed using OpenSim with three different models: OS (the generic OpenSim scaled model), OS + INSER (OS with personalized 3D US MTU insertions), OS + INSER + PATH (OS with personalized 3D US MTU insertions and path obtained from one posture). Significant differences in MTU length were found between OS and 3D US models for RF, GM and GL (from - 6.3 to 10.9%). Non-significant effects were reported for the hamstrings, notably for the ST (- 1.5%) and BF (- 1.9%), while the SM just crossed the alpha level (- 3.4%, p = 0.049). The OS + INSER model reduced the magnitude of bias by an average of 4% for RF, GM and GL. The OS + INSER + PATH model showed the smallest biases in length estimates, which made them negligible and non-significant for all the MTU (i.e. ≤ 2.2%). A 3D US pipeline was developed and validated to estimate the MTU length from a limited number of measurements. This opens up new perspectives for personalizing musculoskeletal models using low-cost user-friendly devices.

A marker-less human motion analysis system for motion-based biomarker identification and quantification in knee disorders

In recent years the healthcare industry has had increased difficulty seeing all low-risk patients, including but not limited to suspected osteoarthritis (OA) patients. To help address the increased waiting lists and shortages of staff, we propose a novel method of automated biomarker identification and quantification for the monitoring of treatment or disease progression through the analysis of clinical motion data captured from a standard RGB video camera. The proposed method allows for the measurement of biomechanics information and analysis of their clinical significance, in both a cheap and sensitive alternative to the traditional motion capture techniques. These methods and results validate the capabilities of standard RGB cameras in clinical environments to capture clinically relevant motion data. Our method focuses on generating 3D human shape and pose from 2D video data via adversarial training in a deep neural network with a self-attention mechanism to encode both spatial and temporal information. Biomarker identification using Principal Component Analysis (PCA) allows the production of representative features from motion data and uses these to generate a clinical report automatically. These new biomarkers can then be used to assess the success of treatment and track the progress of rehabilitation or to monitor the progression of the disease. These methods have been validated with a small clinical study, by administering a local anaesthetic to a small population with knee pain, this allows these new representative biomarkers to be validated as statistically significant (p -value < 0.05 ). These significant biomarkers include the cumulative acceleration of elbow flexion/extension in a sit-to-stand, as well as the smoothness of the knee and elbow flexion/extension in both a squat and sit-to-stand.

Does enforcing glenohumeral joint stability matter? A new rapid muscle redundancy solver highlights the importance of non-superficial shoulder muscles

The complexity of the human shoulder girdle enables the large mobility of the upper extremity, but also introduces instability of the glenohumeral (GH) joint. Shoulder movements are generated by coordinating large superficial and deeper stabilizing muscles spanning numerous degrees-of-freedom. How shoulder muscles are coordinated to stabilize the movement of the GH joint remains widely unknown. Musculoskeletal simulations are powerful tools to gain insights into the actions of individual muscles and particularly of those that are difficult to measure. In this study, we analyze how enforcement of GH joint stability in a musculoskeletal model affects the estimates of individual muscle activity during shoulder movements. To estimate both muscle activity and GH stability from recorded shoulder movements, we developed a Rapid Muscle Redundancy (RMR) solver to include constraints on joint reaction forces (JRFs) from a musculoskeletal model. The RMR solver yields muscle activations and joint forces by minimizing the weighted sum of squared-activations, while matching experimental motion. We implemented three new features: first, computed muscle forces include active and passive fiber contributions; second, muscle activation rates are enforced to be physiological, and third, JRFs are efficiently formulated as linear functions of activations. Muscle activity from the RMR solver without GH stability was not different from the computed muscle control (CMC) algorithm and electromyography of superficial muscles. The efficiency of the solver enabled us to test over 3600 trials sampled within the uncertainty of the experimental movements to test the differences in muscle activity with and without GH joint stability enforced. We found that enforcing GH stability significantly increases the estimated activity of the rotator cuff muscles but not of most superficial muscles. Therefore, a comparison of shoulder model muscle activity to EMG measurements of superficial muscles alone is insufficient to validate the activity of rotator cuff muscles estimated from musculoskeletal models.

Towards Single Camera Human 3D-Kinematics

Markerless estimation of 3D Kinematics has the great potential to clinically diagnose and monitor movement disorders without referrals to expensive motion capture labs; however, current approaches are limited by performing multiple de-coupled steps to estimate the kinematics of a person from videos. Most current techniques work in a multi-step approach by first detecting the pose of the body and then fitting a musculoskeletal model to the data for accurate kinematic estimation. Errors in training data of the pose detection algorithms, model scaling, as well the requirement of multiple cameras limit the use of these techniques in a clinical setting. Our goal is to pave the way toward fast, easily applicable and accurate 3D kinematic estimation. To this end, we propose a novel approach for direct 3D human kinematic estimation D3KE from videos using deep neural networks. Our experiments demonstrate that the proposed end-to-end training is robust and outperforms 2D and 3D markerless motion capture based kinematic estimation pipelines in terms of joint angles error by a large margin (35% from 5.44 to 3.54 degrees). We show that D3KE is superior to the multi-step approach and can run at video framerate speeds. This technology shows the potential for clinical analysis from mobile devices in the future.