1
|
Cornish BM, Pizzolato C, Saxby DJ, Xia Z, Devaprakash D, Diamond LE. Hip contact forces can be predicted with a neural network using only synthesised key points and electromyography in people with hip osteoarthritis. Osteoarthritis Cartilage 2024; 32:730-739. [PMID: 38442767 DOI: 10.1016/j.joca.2024.02.891] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Revised: 01/23/2024] [Accepted: 02/13/2024] [Indexed: 03/07/2024]
Abstract
OBJECTIVE To develop and validate a neural network to estimate hip contact forces (HCF), and lower body kinematics and kinetics during walking in individuals with hip osteoarthritis (OA) using synthesised anatomical key points and electromyography. To assess the capability of the neural network to detect directional changes in HCF resulting from prescribed gait modifications. DESIGN A calibrated electromyography-informed neuromusculoskeletal model was used to compute lower body joint angles, moments, and HCF for 17 participants with mild-to-moderate hip OA. Anatomical key points (e.g., joint centres) were synthesised from marker trajectories and augmented with bias and noise expected from computer vision-based pose estimation systems. Temporal convolutional and long short-term memory neural networks (NN) were trained using leave-one-subject-out validation to predict neuromusculoskeletal modelling outputs from the synthesised key points and measured electromyography data from 5 hip-spanning muscles. RESULTS HCF was predicted with an average error of 13.4 ± 7.1% of peak force. Joint angles and moments were predicted with an average root-mean-square-error of 5.3 degrees and 0.10 Nm/kg, respectively. The NN could detect changes in peak HCF that occur due to gait modifications with good agreement with neuromusculoskeletal modelling (r2 = 0.72) and a minimum detectable change of 9.5%. CONCLUSION The developed neural network predicted HCF and lower body joint angles and moments in individuals with hip OA using noisy synthesised key point locations with acceptable errors. Changes in HCF magnitude due to gait modifications were predicted with high accuracy. These findings have important implications for implementation of load-modification based gait retraining interventions for people with hip OA in a natural environment (i.e., home, clinic).
Collapse
Affiliation(s)
- Bradley M Cornish
- Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, Australia; School of Health Sciences and Social Work, Griffith University, Gold Coast, Australia.
| | - Claudio Pizzolato
- Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, Australia; School of Health Sciences and Social Work, Griffith University, Gold Coast, Australia.
| | - David J Saxby
- Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, Australia; School of Health Sciences and Social Work, Griffith University, Gold Coast, Australia.
| | - Zhengliang Xia
- Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, Australia; School of Health Sciences and Social Work, Griffith University, Gold Coast, Australia.
| | - Daniel Devaprakash
- Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, Australia; School of Health Sciences and Social Work, Griffith University, Gold Coast, Australia; Vald Performance, Brisbane, Australia.
| | - Laura E Diamond
- Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, Australia; School of Health Sciences and Social Work, Griffith University, Gold Coast, Australia.
| |
Collapse
|
2
|
Di Pietro A, Bersani A, Curreli C, Di Puccio F. AST: An OpenSim-based tool for the automatic scaling of generic musculoskeletal models. Comput Biol Med 2024; 175:108524. [PMID: 38688126 DOI: 10.1016/j.compbiomed.2024.108524] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2024] [Revised: 04/22/2024] [Accepted: 04/24/2024] [Indexed: 05/02/2024]
Abstract
BACKGROUND AND OBJECTIVES The paper introduces a tool called Automatic Scaling Tool (AST) designed for improving and expediting musculoskeletal (MSK) simulations based on generic models in OpenSim. Scaling is a crucial initial step in MSK analyses, involving the correction of virtual marker locations on a model to align with actual experimental markers. METHODS The AST automates this process by iteratively adjusting virtual markers using scaling and inverse kinematics on a static trial. It evaluates the root mean square error (RMSE) and maximum marker error, implementing corrective actions until achieving the desired accuracy level. The tool determines whether to scale a segment with a marker-based or constant scaling factor based on checks on RMSE and segment scaling factors. RESULTS Testing on three generic MSK models demonstrated that the AST significantly outperformed manual scaling by an expert operator. The RMSE for static trials was one order of magnitude lower, and for gait tasks, it was five times lower (8.5 ± 0.76 mm vs. 44.5 ± 7.5 mm). The AST consistently achieved the desired level of accuracy in less than 100 iterations, providing reliable scaled MSK models within a relatively brief timeframe, ranging from minutes to hours depending on model complexity. CONCLUSIONS The paper concludes that AST can greatly benefit the biomechanical community by quickly and accurately scaling generic models, a critical first step in MSK analyses. Further validation through additional experimental datasets and generic models is proposed for future tests.
Collapse
Affiliation(s)
- Andrea Di Pietro
- Department of Civil and Industrial Engineering, University of Pisa, Italy.
| | - Alex Bersani
- Department of Industrial Engineering, Alma Mater Studiorum - University of Bologna, Italy; Medical Technology Lab, IRCCS Istituto Ortopedico Rizzoli, Bologna, Italy
| | - Cristina Curreli
- Medical Technology Lab, IRCCS Istituto Ortopedico Rizzoli, Bologna, Italy
| | - Francesca Di Puccio
- Department of Civil and Industrial Engineering, University of Pisa, Italy; Center for Rehabilitative Medicine "Sport and Anatomy", University of Pisa, Italy
| |
Collapse
|
3
|
Niu K, Sluiter V, Lan B, Homminga J, Sprengers A, Verdonschot N. A Method to Track 3D Knee Kinematics by Multi-Channel 3D-Tracked A-Mode Ultrasound. SENSORS (BASEL, SWITZERLAND) 2024; 24:2439. [PMID: 38676056 PMCID: PMC11053743 DOI: 10.3390/s24082439] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Revised: 04/05/2024] [Accepted: 04/10/2024] [Indexed: 04/28/2024]
Abstract
This paper introduces a method for measuring 3D tibiofemoral kinematics using a multi-channel A-mode ultrasound system under dynamic conditions. The proposed system consists of a multi-channel A-mode ultrasound system integrated with a conventional motion capture system (i.e., optical tracking system). This approach allows for the non-invasive and non-radiative quantification of the tibiofemoral joint's six degrees of freedom (DOF). We demonstrated the feasibility and accuracy of this method in the cadaveric experiment. The knee joint's motions were mimicked by manually manipulating the leg through multiple motion cycles from flexion to extension. To measure it, six custom ultrasound holders, equipped with a total of 30 A-mode ultrasound transducers and 18 optical markers, were mounted on various anatomical regions of the lower extremity of the specimen. During experiments, 3D-tracked intra-cortical bone pins were inserted into the femur and tibia to measure the ground truth of tibiofemoral kinematics. The results were compared with the tibiofemoral kinematics derived from the proposed ultrasound system. The results showed an average rotational error of 1.51 ± 1.13° and a translational error of 3.14 ± 1.72 mm for the ultrasound-derived kinematics, compared to the ground truth. In conclusion, this multi-channel A-mode ultrasound system demonstrated a great potential of effectively measuring tibiofemoral kinematics during dynamic motions. Its improved accuracy, nature of non-invasiveness, and lack of radiation exposure make this method a promising alternative to incorporate into gait analysis and prosthetic kinematic measurements later.
Collapse
Affiliation(s)
- Kenan Niu
- Robotics and Mechatronics Group, Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS), University of Twente, P.O. Box 217, 7500 AE Enschede, The Netherlands;
| | - Victor Sluiter
- Department of Biomechanical Engineering, University of Twente, 7521 HK Enschede, The Netherlands (J.H.)
| | - Bangyu Lan
- Robotics and Mechatronics Group, Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS), University of Twente, P.O. Box 217, 7500 AE Enschede, The Netherlands;
| | - Jasper Homminga
- Department of Biomechanical Engineering, University of Twente, 7521 HK Enschede, The Netherlands (J.H.)
| | - André Sprengers
- Orthopaedic Research Lab, Radboud University Medical Center, P.O. Box 9101, 6500 HB Nijmegen, The Netherlands
| | - Nico Verdonschot
- Department of Biomechanical Engineering, University of Twente, 7521 HK Enschede, The Netherlands (J.H.)
- Orthopaedic Research Lab, Radboud University Medical Center, P.O. Box 9101, 6500 HB Nijmegen, The Netherlands
| |
Collapse
|
4
|
Guenanten H, Retailleau M, Dorel S, Sarcher A, Colloud F, Nordez A. Muscle-Tendon Unit Length Measurement Using 3D Ultrasound in Passive Conditions: OpenSim Validation and Development of Personalized Models. Ann Biomed Eng 2024; 52:997-1008. [PMID: 38286938 DOI: 10.1007/s10439-023-03436-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2023] [Accepted: 12/26/2023] [Indexed: 01/31/2024]
Abstract
This study investigated the validity of using OpenSim to measure muscle-tendon unit (MTU) length of the bi-articular lower limb muscles in several postures (shortened, lengthened, a combination of shortened and lengthened involving both joints, neutral and standing) using 3D freehand ultrasound (US), and to propose new personalized models. MTU length was measured on 14 participants and 6 bi-articular muscles (semimembranosus SM, semitendinosus ST, biceps femoris BF, rectus femoris RF, gastrocnemius medialis GM and gastrocnemius lateralis GL), considering 5 to 6 postures. MTU length was computed using OpenSim with three different models: OS (the generic OpenSim scaled model), OS + INSER (OS with personalized 3D US MTU insertions), OS + INSER + PATH (OS with personalized 3D US MTU insertions and path obtained from one posture). Significant differences in MTU length were found between OS and 3D US models for RF, GM and GL (from - 6.3 to 10.9%). Non-significant effects were reported for the hamstrings, notably for the ST (- 1.5%) and BF (- 1.9%), while the SM just crossed the alpha level (- 3.4%, p = 0.049). The OS + INSER model reduced the magnitude of bias by an average of 4% for RF, GM and GL. The OS + INSER + PATH model showed the smallest biases in length estimates, which made them negligible and non-significant for all the MTU (i.e. ≤ 2.2%). A 3D US pipeline was developed and validated to estimate the MTU length from a limited number of measurements. This opens up new perspectives for personalizing musculoskeletal models using low-cost user-friendly devices.
Collapse
Affiliation(s)
- Hugo Guenanten
- Nantes Université, Movement - Interactions - Performance, MIP, UR 4334, 44000, Nantes, France
- Institut Pprime, CNRS, Université de Poitiers, ISAE-ENSMA, UPR 3346, 86360, Chasseneuil-du-Poitou, France
| | - Maëva Retailleau
- Nantes Université, Movement - Interactions - Performance, MIP, UR 4334, 44000, Nantes, France
- Arts et Métiers Institute of Technology, Institut de Biomécanique Humaine Georges Charpak, 75013, Paris, France
| | - Sylvain Dorel
- Nantes Université, Movement - Interactions - Performance, MIP, UR 4334, 44000, Nantes, France
| | - Aurélie Sarcher
- Nantes Université, Movement - Interactions - Performance, MIP, UR 4334, 44000, Nantes, France
| | - Floren Colloud
- Arts et Métiers Institute of Technology, Institut de Biomécanique Humaine Georges Charpak, 75013, Paris, France
| | - Antoine Nordez
- Nantes Université, Movement - Interactions - Performance, MIP, UR 4334, 44000, Nantes, France.
- Institut Universitaire de France (IUF), Paris, France.
- , 23, rue du Recteur Schmitt Bât F0 - BP 92235, 44322, Nantes Cedex 3, France.
| |
Collapse
|
5
|
Armstrong K, Zhang L, Wen Y, Willmott AP, Lee P, Ye X. A marker-less human motion analysis system for motion-based biomarker identification and quantification in knee disorders. Front Digit Health 2024; 6:1324511. [PMID: 38384738 PMCID: PMC10880093 DOI: 10.3389/fdgth.2024.1324511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Accepted: 01/09/2024] [Indexed: 02/23/2024] Open
Abstract
In recent years the healthcare industry has had increased difficulty seeing all low-risk patients, including but not limited to suspected osteoarthritis (OA) patients. To help address the increased waiting lists and shortages of staff, we propose a novel method of automated biomarker identification and quantification for the monitoring of treatment or disease progression through the analysis of clinical motion data captured from a standard RGB video camera. The proposed method allows for the measurement of biomechanics information and analysis of their clinical significance, in both a cheap and sensitive alternative to the traditional motion capture techniques. These methods and results validate the capabilities of standard RGB cameras in clinical environments to capture clinically relevant motion data. Our method focuses on generating 3D human shape and pose from 2D video data via adversarial training in a deep neural network with a self-attention mechanism to encode both spatial and temporal information. Biomarker identification using Principal Component Analysis (PCA) allows the production of representative features from motion data and uses these to generate a clinical report automatically. These new biomarkers can then be used to assess the success of treatment and track the progress of rehabilitation or to monitor the progression of the disease. These methods have been validated with a small clinical study, by administering a local anaesthetic to a small population with knee pain, this allows these new representative biomarkers to be validated as statistically significant (p -value < 0.05 ). These significant biomarkers include the cumulative acceleration of elbow flexion/extension in a sit-to-stand, as well as the smoothness of the knee and elbow flexion/extension in both a squat and sit-to-stand.
Collapse
Affiliation(s)
- Kai Armstrong
- Laboratory of Vision Engineering, School of Computer Science, University of Lincoln, Lincoln, United Kingdom
| | - Lei Zhang
- Laboratory of Vision Engineering, School of Computer Science, University of Lincoln, Lincoln, United Kingdom
| | - Yan Wen
- Laboratory of Vision Engineering, School of Computer Science, University of Lincoln, Lincoln, United Kingdom
| | - Alexander P. Willmott
- School of Sport and Exercise Science, University of Lincoln, Lincoln, United Kingdom
| | - Paul Lee
- School of Sport and Exercise Science, University of Lincoln, Lincoln, United Kingdom
- MSK Doctors, Sleaford, United Kingdom
| | - Xujiong Ye
- Laboratory of Vision Engineering, School of Computer Science, University of Lincoln, Lincoln, United Kingdom
| |
Collapse
|
6
|
Belli I, Joshi S, Prendergast JM, Beck I, Della Santina C, Peternel L, Seth A. Does enforcing glenohumeral joint stability matter? A new rapid muscle redundancy solver highlights the importance of non-superficial shoulder muscles. PLoS One 2023; 18:e0295003. [PMID: 38033021 PMCID: PMC10688910 DOI: 10.1371/journal.pone.0295003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2023] [Accepted: 11/14/2023] [Indexed: 12/02/2023] Open
Abstract
The complexity of the human shoulder girdle enables the large mobility of the upper extremity, but also introduces instability of the glenohumeral (GH) joint. Shoulder movements are generated by coordinating large superficial and deeper stabilizing muscles spanning numerous degrees-of-freedom. How shoulder muscles are coordinated to stabilize the movement of the GH joint remains widely unknown. Musculoskeletal simulations are powerful tools to gain insights into the actions of individual muscles and particularly of those that are difficult to measure. In this study, we analyze how enforcement of GH joint stability in a musculoskeletal model affects the estimates of individual muscle activity during shoulder movements. To estimate both muscle activity and GH stability from recorded shoulder movements, we developed a Rapid Muscle Redundancy (RMR) solver to include constraints on joint reaction forces (JRFs) from a musculoskeletal model. The RMR solver yields muscle activations and joint forces by minimizing the weighted sum of squared-activations, while matching experimental motion. We implemented three new features: first, computed muscle forces include active and passive fiber contributions; second, muscle activation rates are enforced to be physiological, and third, JRFs are efficiently formulated as linear functions of activations. Muscle activity from the RMR solver without GH stability was not different from the computed muscle control (CMC) algorithm and electromyography of superficial muscles. The efficiency of the solver enabled us to test over 3600 trials sampled within the uncertainty of the experimental movements to test the differences in muscle activity with and without GH joint stability enforced. We found that enforcing GH stability significantly increases the estimated activity of the rotator cuff muscles but not of most superficial muscles. Therefore, a comparison of shoulder model muscle activity to EMG measurements of superficial muscles alone is insufficient to validate the activity of rotator cuff muscles estimated from musculoskeletal models.
Collapse
Affiliation(s)
- Italo Belli
- Cognitive Robotics Department, Technische Universiteit Delft, Delft, Zuid Holland, The Netherlands
- Biomechanical Engineering Department, Technische Universiteit Delft, Delft, Zuid Holland, The Netherlands
| | - Sagar Joshi
- Cognitive Robotics Department, Technische Universiteit Delft, Delft, Zuid Holland, The Netherlands
- Biomechanical Engineering Department, Technische Universiteit Delft, Delft, Zuid Holland, The Netherlands
| | - J. Micah Prendergast
- Cognitive Robotics Department, Technische Universiteit Delft, Delft, Zuid Holland, The Netherlands
| | - Irene Beck
- Biomechanical Engineering Department, Technische Universiteit Delft, Delft, Zuid Holland, The Netherlands
| | - Cosimo Della Santina
- Cognitive Robotics Department, Technische Universiteit Delft, Delft, Zuid Holland, The Netherlands
- Robotics and Mechatronics Department, German Aerospace Center (DLR), Munich, Germany
| | - Luka Peternel
- Cognitive Robotics Department, Technische Universiteit Delft, Delft, Zuid Holland, The Netherlands
| | - Ajay Seth
- Biomechanical Engineering Department, Technische Universiteit Delft, Delft, Zuid Holland, The Netherlands
| |
Collapse
|
7
|
Bittner M, Yang WT, Zhang X, Seth A, van Gemert J, van der Helm FCT. Towards Single Camera Human 3D-Kinematics. SENSORS (BASEL, SWITZERLAND) 2022; 23:341. [PMID: 36616937 PMCID: PMC9823525 DOI: 10.3390/s23010341] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/01/2022] [Revised: 12/17/2022] [Accepted: 12/21/2022] [Indexed: 06/17/2023]
Abstract
Markerless estimation of 3D Kinematics has the great potential to clinically diagnose and monitor movement disorders without referrals to expensive motion capture labs; however, current approaches are limited by performing multiple de-coupled steps to estimate the kinematics of a person from videos. Most current techniques work in a multi-step approach by first detecting the pose of the body and then fitting a musculoskeletal model to the data for accurate kinematic estimation. Errors in training data of the pose detection algorithms, model scaling, as well the requirement of multiple cameras limit the use of these techniques in a clinical setting. Our goal is to pave the way toward fast, easily applicable and accurate 3D kinematic estimation. To this end, we propose a novel approach for direct 3D human kinematic estimation D3KE from videos using deep neural networks. Our experiments demonstrate that the proposed end-to-end training is robust and outperforms 2D and 3D markerless motion capture based kinematic estimation pipelines in terms of joint angles error by a large margin (35% from 5.44 to 3.54 degrees). We show that D3KE is superior to the multi-step approach and can run at video framerate speeds. This technology shows the potential for clinical analysis from mobile devices in the future.
Collapse
Affiliation(s)
- Marian Bittner
- Vicarious Perception Technologies (VicarVision), 1015 AH Amsterdam, The Netherlands
- Computer Vision Lab, Delft University of Technology, 2628 XE Delft, The Netherlands
- Biomechanical Engineering, Delft University of Technology, 2628 CN Delft, The Netherlands
| | - Wei-Tse Yang
- Computer Vision Lab, Delft University of Technology, 2628 XE Delft, The Netherlands
| | - Xucong Zhang
- Computer Vision Lab, Delft University of Technology, 2628 XE Delft, The Netherlands
| | - Ajay Seth
- Biomechanical Engineering, Delft University of Technology, 2628 CN Delft, The Netherlands
| | - Jan van Gemert
- Computer Vision Lab, Delft University of Technology, 2628 XE Delft, The Netherlands
| | | |
Collapse
|