1
|
Coll I, Mavor MP, Karakolis T, Graham RB, Clouthier AL. Validation of Markerless Motion Capture for Soldier Movement Patterns Assessment Under Varying Body-Borne Loads. Ann Biomed Eng 2024:10.1007/s10439-024-03622-w. [PMID: 39375307 DOI: 10.1007/s10439-024-03622-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Accepted: 09/13/2024] [Indexed: 10/09/2024]
Abstract
Field performance of modern soldiers is affected by an increase in body-borne load due to technological advancements related to their armour and equipment. In this project, the Theia3D markerless motion capture system was compared to the marker-based gold standard for capturing movement patterns of participants wearing various body-borne loads. The aim was to estimate lower body joint kinematics, gastrocnemius lateralis and medialis muscle activation patterns, and lower body joint reaction forces from the two motion capture systems. Data were collected on 16 participants performing three repetitions of walking and running under four body-borne load conditions by both motion capture systems simultaneously. A complete musculoskeletal analysis was completed in OpenSim. Strong correlations ( r > 0.8 ) and acceptable differences were observed between the kinematics of the marker-based and markerless systems. Timing of muscle activations of the gastrocnemius lateralis and medialis, as estimated through OpenSim from both systems, agreed with the ones measured using electromyography. Joint reaction force results showed a very strong correlation ( r > 0.9 ) between the systems; however, the markerless model estimated greater joint reaction forces when compared the marker-based model due to differences in muscle recruitment strategy. Overall, this research highlights the potential of markerless motion capture to track participants wearing body-borne loads.
Collapse
Affiliation(s)
- Isabel Coll
- Ottawa-Carleton Institute of Biomedical Engineering (OCIBME), Faculty of Engineering, University of Ottawa, 75 Laurier Ave. E, Ottawa, ON, K1N 6N5, Canada.
| | - Matthew P Mavor
- School of Human Kinetics, University of Ottawa, 75 Laurier Ave. E, Ottawa, ON, K1N 6N5, Canada
| | - Thomas Karakolis
- Defence Research and Development Canada - Toronto Research Centre, 1133 Sheppard Ave. W, Toronto, ON, M3K 2C9, Canada
| | - Ryan B Graham
- Ottawa-Carleton Institute of Biomedical Engineering (OCIBME), Faculty of Engineering, University of Ottawa, 75 Laurier Ave. E, Ottawa, ON, K1N 6N5, Canada
- School of Human Kinetics, University of Ottawa, 75 Laurier Ave. E, Ottawa, ON, K1N 6N5, Canada
| | - Allison L Clouthier
- Ottawa-Carleton Institute of Biomedical Engineering (OCIBME), Faculty of Engineering, University of Ottawa, 75 Laurier Ave. E, Ottawa, ON, K1N 6N5, Canada
- School of Human Kinetics, University of Ottawa, 75 Laurier Ave. E, Ottawa, ON, K1N 6N5, Canada
| |
Collapse
|
2
|
Min YS, Jung TD, Lee YS, Kwon Y, Kim HJ, Kim HC, Lee JC, Park E. Biomechanical Gait Analysis Using a Smartphone-Based Motion Capture System (OpenCap) in Patients with Neurological Disorders. Bioengineering (Basel) 2024; 11:911. [PMID: 39329653 PMCID: PMC11429388 DOI: 10.3390/bioengineering11090911] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2024] [Revised: 09/09/2024] [Accepted: 09/09/2024] [Indexed: 09/28/2024] Open
Abstract
This study evaluates the utility of OpenCap (v0.3), a smartphone-based motion capture system, for performing gait analysis in patients with neurological disorders. We compared kinematic and kinetic gait parameters between 10 healthy controls and 10 patients with neurological conditions, including stroke, Parkinson's disease, and cerebral palsy. OpenCap captured 3D movement dynamics using two smartphones, with data processed through musculoskeletal modeling. The key findings indicate that the patient group exhibited significantly slower gait speeds (0.67 m/s vs. 1.10 m/s, p = 0.002), shorter stride lengths (0.81 m vs. 1.29 m, p = 0.001), and greater step length asymmetry (107.43% vs. 91.23%, p = 0.023) compared to the controls. Joint kinematic analysis revealed increased variability in pelvic tilt, hip flexion, knee extension, and ankle dorsiflexion throughout the gait cycle in patients, indicating impaired motor control and compensatory strategies. These results indicate that OpenCap can effectively identify significant gait differences, which may serve as valuable biomarkers for neurological disorders, thereby enhancing its utility in clinical settings where traditional motion capture systems are impractical. OpenCap has the potential to improve access to biomechanical assessments, thereby enabling better monitoring of gait abnormalities and informing therapeutic interventions for individuals with neurological disorders.
Collapse
Affiliation(s)
- Yu-Sun Min
- Department of Rehabilitation Medicine, School of Medicine, Kyungpook National University, Daegu 41944, Republic of Korea; (Y.-S.M.); (T.-D.J.); (Y.-S.L.)
- Department of Rehabilitation Medicine, Kyungpook National University Chilgok Hospital, Daegu 41404, Republic of Korea;
- AI-Driven Convergence Software Education Research Program, Graduate School of Computer Science and Engineering, Kyungpook National University, Daegu 41566, Republic of Korea
- Department of Biomedical Engineering, College of Medicine, Seoul National University, Seoul 03080, Republic of Korea; (H.C.K.); (J.C.L.)
| | - Tae-Du Jung
- Department of Rehabilitation Medicine, School of Medicine, Kyungpook National University, Daegu 41944, Republic of Korea; (Y.-S.M.); (T.-D.J.); (Y.-S.L.)
- Department of Rehabilitation Medicine, Kyungpook National University Chilgok Hospital, Daegu 41404, Republic of Korea;
| | - Yang-Soo Lee
- Department of Rehabilitation Medicine, School of Medicine, Kyungpook National University, Daegu 41944, Republic of Korea; (Y.-S.M.); (T.-D.J.); (Y.-S.L.)
- Department of Rehabilitation Medicine, Kyungpook National University Hospital, Daegu 41944, Republic of Korea;
| | - Yonghan Kwon
- Department of Rehabilitation Medicine, Kyungpook National University Hospital, Daegu 41944, Republic of Korea;
| | - Hyung Joon Kim
- Department of Rehabilitation Medicine, Kyungpook National University Chilgok Hospital, Daegu 41404, Republic of Korea;
| | - Hee Chan Kim
- Department of Biomedical Engineering, College of Medicine, Seoul National University, Seoul 03080, Republic of Korea; (H.C.K.); (J.C.L.)
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul 08826, Republic of Korea
| | - Jung Chan Lee
- Department of Biomedical Engineering, College of Medicine, Seoul National University, Seoul 03080, Republic of Korea; (H.C.K.); (J.C.L.)
- Institute of Bioengineering, Seoul National University, Seoul 03080, Republic of Korea
- Institute of Medical and Biological Engineering, Medical Research Center, Seoul National University, Seoul 03080, Republic of Korea
| | - Eunhee Park
- Department of Rehabilitation Medicine, School of Medicine, Kyungpook National University, Daegu 41944, Republic of Korea; (Y.-S.M.); (T.-D.J.); (Y.-S.L.)
- Department of Rehabilitation Medicine, Kyungpook National University Chilgok Hospital, Daegu 41404, Republic of Korea;
- AI-Driven Convergence Software Education Research Program, Graduate School of Computer Science and Engineering, Kyungpook National University, Daegu 41566, Republic of Korea
| |
Collapse
|
3
|
Huber J, Slone S, Bae J. Computer vision for kinematic metrics of the drinking task in a pilot study of neurotypical participants. Sci Rep 2024; 14:20668. [PMID: 39237646 PMCID: PMC11377576 DOI: 10.1038/s41598-024-71470-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2024] [Accepted: 08/28/2024] [Indexed: 09/07/2024] Open
Abstract
Assessment of the upper limb is critical to guiding the rehabilitation cycle. Drawbacks of observation-based assessment include subjectivity and coarse resolution of ordinal scales. Kinematic assessment gives rise to objective quantitative metrics, but uptake is encumbered by costly and impractical setups. Our objective was to investigate feasibility and accuracy of computer vision (CV) for acquiring kinematic metrics of the drinking task, which are recommended in stroke rehabilitation research. We implemented CV for upper limb kinematic assessment using modest cameras and an open-source machine learning solution. To explore feasibility, 10 neurotypical participants were recruited for repeated kinematic measures during the drinking task. To investigate accuracy, a simultaneous marker-based motion capture system was used, and error was quantified for the following kinematic metrics: Number of Movement Units (NMU), Trunk Displacement (TD), and Movement Time (MT). Across all participant trials, kinematic metrics of the drinking task were successfully acquired using CV. Compared to marker-based motion capture, no significant difference was observed for group mean values of kinematic metrics. Mean error for NMU, TD, and MT were - 0.12 units, 3.4 mm, and 0.15 s, respectively. Bland-Altman analysis revealed no bias. Kinematic metrics of the drinking task can be measured using CV, and preliminary findings support accuracy. Further study in neurodivergent populations is needed to determine validity of CV for kinematic assessment of the post-stroke upper limb.
Collapse
Affiliation(s)
- Justin Huber
- Department of Physical Medicine and Rehabilitation, University of Kentucky, Lexington, KY, 40506, USA.
| | - Stacey Slone
- Dr. Bing Zhang Department of Statistics, University of Kentucky, Lexington, KY, 40506, USA
| | - Jihye Bae
- Department of Electrical and Computer Engineering, University of Kentucky, Lexington, KY, 40506, USA
| |
Collapse
|
4
|
Carvalho A, Vanrenterghem J, Cabral S, Assunção A, Fernandes R, Veloso AP, Moniz-Pereira V. Markerless three-dimensional gait analysis in healthy older adults: test-retest reliability and measurement error. J Biomech 2024; 174:112280. [PMID: 39153296 DOI: 10.1016/j.jbiomech.2024.112280] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2023] [Revised: 08/02/2024] [Accepted: 08/12/2024] [Indexed: 08/19/2024]
Abstract
In older adults, gait analysis may detect changes that signal early disease states, yet challenges in biomechanical screening limit widespread use in clinical or community settings. Recently, a markerless method from multi-camera video data has become accessible, making screenings less challenging. This study evaluated the test-retest reliability and measurement error of markerless gait kinematics and kinetics in healthy older adults. Twenty-nine healthy older adults performed gait analysis on two occasions, at preferred walking speed, using their everyday clothes. Lower limb angles and moments were averaged from 8 gait cycles. Integrated pointwise indices [Intraclass Correlation Coefficient (ICCA,K) and Standard Error of Measurement (SEM)] were calculated for curve data, as well as ICCA,K, and SEM [95 % confidence intervals] for selected peaks. Generally, kinematic ICCs were good (>0.75) and reasonably stable throughout the gait cycle, except for the hip kinematics during the swing phase in the sagittal plane and pelvis tilt and rotation. The integrated and peaks SEM were <2.4°. The reliability of kinetics was similar (ICC>0.75), except for the transverse hip moment and abduction peak, fluctuating more during the swing than through the stance phase. SEM were < 0.07Nm/Kg. In conclusion, these results showed good overall test-retest reliability for markerless gait kinematics and kinetics for the hip, knee, and ankle joints, moderate for the pelvis angles, and error levels of ≤5°, and SEM%≤5% for the sagittal plane. This supports this method's use in assessing gait in healthy older adults, including kinetics, for which reliability data from markerless systems is difficult to find reported.
Collapse
Affiliation(s)
- Andreia Carvalho
- Universidade Lisboa, Faculdade de Motricidade Humana, CIPER, LBMF, P-1499-002 Lisboa, Portugal; Musculoskeletal Rehabilitation Research Group, Faculty of Movement and Rehabilitation Sciences, Leuven KU, Belgium; Escola Superior de Tecnologia da Saúde de Lisboa, Instituto Politécnico de Lisboa, 1990-096 Lisboa, Portugal.
| | - Jos Vanrenterghem
- Musculoskeletal Rehabilitation Research Group, Faculty of Movement and Rehabilitation Sciences, Leuven KU, Belgium.
| | - Sílvia Cabral
- Universidade Lisboa, Faculdade de Motricidade Humana, CIPER, LBMF, P-1499-002 Lisboa, Portugal.
| | - Ana Assunção
- Universidade Lisboa, Faculdade de Motricidade Humana, CIPER, LBMF, P-1499-002 Lisboa, Portugal.
| | - Rita Fernandes
- Universidade Lisboa, Faculdade de Motricidade Humana, CIPER, LBMF, P-1499-002 Lisboa, Portugal; Instituto Politécnico de Setúbal, Escola Superior de Saúde, Campus do Instituto Politécnico de Setúbal, ESCE, Estefanilha, Edifício 2914-503 Setúbal, Portugal; Comprehensive Health Research Centre, Nova Medical School, 1150-190 Lisboa, Portugal.
| | - António P Veloso
- Universidade Lisboa, Faculdade de Motricidade Humana, CIPER, LBMF, P-1499-002 Lisboa, Portugal.
| | - Vera Moniz-Pereira
- Universidade Lisboa, Faculdade de Motricidade Humana, CIPER, LBMF, P-1499-002 Lisboa, Portugal.
| |
Collapse
|
5
|
Harrington MS, Di Leo SD, Hlady CA, Burkhart TA. Musculoskeletal modeling and movement simulation for structural hip disorder research: A scoping review of methods, validation, and applications. Heliyon 2024; 10:e35007. [PMID: 39157349 PMCID: PMC11328100 DOI: 10.1016/j.heliyon.2024.e35007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2024] [Accepted: 07/22/2024] [Indexed: 08/20/2024] Open
Abstract
Musculoskeletal modeling is a powerful tool to quantify biomechanical factors typically not feasible to measure in vivo, such as hip contact forces and deep muscle activations. While technological advancements in musculoskeletal modeling have increased accessibility, selecting the appropriate modeling approach for a specific research question, particularly when investigating pathological populations, has become more challenging. The purposes of this review were to summarize current modeling and simulation methods in structural hip disorder research, as well as evaluate model validation and study reproducibility. MEDLINE and Web of Science were searched to identify literature relating to the use of musculoskeletal models to investigate structural hip disorders (i.e., involving a bony abnormality of the pelvis, femur, or both). Forty-seven articles were included for analysis, which either compared multiple modeling methods or applied a single modeling workflow to answer a research question. Findings from studies comparing methods were summarized, such as the effect of generic versus patient-specific modeling techniques on model-estimated hip contact forces or muscle forces. The review also discussed limitations in validation practices, as only 11 of the included studies conducted a validation and used qualitative approaches only. Given the lack of information related to model validation, additional details regarding the development and validation of generic models were retrieved from references and modeling software documentation. To address the wide variability and under-reporting of data collection, data processing, and modeling methods highlighted in this review, we developed a template that researchers can complete and include as a table within the methodology section of their manuscripts. The use of this table will help increase transparency and reporting of essential details related to reproducibility and methods without being limited by word count restrictions. Overall, this review provides a comprehensive synthesis of modeling approaches that can help researchers make modeling decisions and evaluate existing literature.
Collapse
Affiliation(s)
- Margaret S. Harrington
- Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, ON, Canada
| | - Stefania D.F. Di Leo
- Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, ON, Canada
| | - Courtney A. Hlady
- Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, ON, Canada
- Department of Physical Therapy, University of Toronto, Toronto, ON, Canada
| | - Timothy A. Burkhart
- Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
6
|
Di Paolo S, Ito N, Seymore KD, Sigurðsson HB, Bragonzoni L, Zaffagnini S, Snyder-Mackler L, Gravare Silbernagel K. Hop Distance Symmetry Moderately Reflects Knee Biomechanics Symmetry During Landing But Not For Controlled Propulsions. Int J Sports Phys Ther 2024; 19:956-964. [PMID: 39268226 PMCID: PMC11392465 DOI: 10.26603/001c.121599] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Accepted: 06/21/2024] [Indexed: 09/15/2024] Open
Abstract
Background Landing with poor knee sagittal plane biomechanics has been identified as a risk factor for Anterior Cruciate Ligament (ACL) injury. However, it is unclear if the horizontal hop test battery reflects knee function and biomechanics. Hypothesis/Purpose To investigate the correlation between clinical limb symmetry index (LSI) and landing and propulsion knee biomechanics during the hop test battery using markerless motion capture. Study Design Cross-sectional biomechanics laboratory study. Methods Forty-two participants with and without knee surgery (age 28.0 ± 8.0 years) performed the hop test battery which consisted of a single hop for distance, crossover hop, triple hop, and 6-m timed hop in the order listed. Eight high speed cameras were used to collect simultaneous 3D motion data and Theia 3D (Theia Markerless Inc.) was used to generate 3D body model files. Lower limb joint kinematics were calculated in Visual3D. Correlation (Spearman's ρ) was computed between clinical LSI and symmetry in peak and initial contact (IC) knee flexion angle during propulsion and landing phases of each movement. Results In the single hop, clinical LSI showed positive correlation with kinematic LSI at peak landing (ρ= 0.39, p=0.011), but no correlation at peak propulsion (ρ= -0.03, p=0.851). In the crossover hop, non-significant correlations were found in both propulsion and landing. In the triple hop, positive correlation was found at peak propulsion (ρ= 0.38, p=0.027), peak landing (ρ= 0.48 - 0.66, p<0.001), and last landing IC (ρ= 0.45, p=0.009). In the timed hop, peak propulsion showed positive correlation (ρ= 0.51, p=0.003). Conclusions Single hop and triple hop distance symmetry reflected landing biomechanical symmetry better than propulsion symmetry. Poor scores on the hop test battery reflect asymmetrical knee landing biomechanics, emphasizing the importance of continuing to use the hop test battery as part of clinical decision making. Level of Evidence 3b.
Collapse
Affiliation(s)
- Stefano Di Paolo
- Clinica Ortopedica e Traumatologica II IRCCS Istituto Ortopedico Rizzoli
| | - Naoaki Ito
- Department of Physical Therapy University of Delaware
| | | | | | | | - Stefano Zaffagnini
- Clinica Ortopedica e Traumatologica II IRCCS Istituto Ortopedico Rizzoli
| | | | | |
Collapse
|
7
|
Peng Y, Wang W, Wang L, Zhou H, Chen Z, Zhang Q, Li G. Smartphone videos-driven musculoskeletal multibody dynamics modelling workflow to estimate the lower limb joint contact forces and ground reaction forces. Med Biol Eng Comput 2024:10.1007/s11517-024-03171-3. [PMID: 39046692 DOI: 10.1007/s11517-024-03171-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Accepted: 07/07/2024] [Indexed: 07/25/2024]
Abstract
The estimation of joint contact forces in musculoskeletal multibody dynamics models typically requires the use of expensive and time-consuming technologies, such as reflective marker-based motion capture (Mocap) system. In this study, we aim to propose a more accessible and cost-effective solution that utilizes the dual smartphone videos (SPV)-driven musculoskeletal multibody dynamics modeling workflow to estimate the lower limb mechanics. Twelve participants were recruited to collect marker trajectory data, force plate data, and motion videos during walking and running. The smartphone videos were initially analyzed using the OpenCap platform to identify key joint points and anatomical markers. The markers were used as inputs for the musculoskeletal multibody dynamics model to calculate the lower limb joint kinematics, joint contact forces, and ground reaction forces, which were then evaluated by the Mocap-based workflow. The root mean square error (RMSE), mean absolute deviation (MAD), and Pearson correlation coefficient (ρ) were adopted to evaluate the results. Excellent or strong Pearson correlations were observed in most lower limb joint angles (ρ = 0.74 ~ 0.94). The averaged MADs and RMSEs for the joint angles were 1.93 ~ 6.56° and 2.14 ~ 7.08°, respectively. Excellent or strong Pearson correlations were observed in most lower limb joint contact forces and ground reaction forces (ρ = 0.78 ~ 0.92). The averaged MADs and RMSEs for the joint lower limb joint contact forces were 0.18 ~ 1.07 bodyweight (BW) and 0.28 ~ 1.32 BW, respectively. Overall, the proposed smartphone video-driven musculoskeletal multibody dynamics simulation workflow demonstrated reliable accuracy in predicting lower limb mechanics and ground reaction forces, which has the potential to expedite gait dynamics analysis in a clinical setting.
Collapse
Affiliation(s)
- Yinghu Peng
- CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Wei Wang
- CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Lin Wang
- CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Hao Zhou
- CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Zhenxian Chen
- Key Laboratory of Road Construction Technology and Equipment (Ministry of Education), School of Mechanical Engineering, Chang'an University, Xi'an, 710064, China
| | - Qida Zhang
- Musculoskeletal Research Laboratory, Department of Orthopaedics & Traumatology, The Chinese University of Hong Kong, Hong Kong SAR, 000000, China
| | - Guanglin Li
- CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China.
- Research Center for Neural Engineering, Shenzhen Institutes of Advanced Technology, Shandong Zhongke Advanced Technology CO., LTD., Jinan, 250000, China.
| |
Collapse
|
8
|
Falisse A, Uhlrich SD, Chaudhari AS, Hicks JL, Delp SL. Marker Data Enhancement For Markerless Motion Capture. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.07.13.603382. [PMID: 39071421 PMCID: PMC11275905 DOI: 10.1101/2024.07.13.603382] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/30/2024]
Abstract
Objective Human pose estimation models can measure movement from videos at a large scale and low cost; however, open-source pose estimation models typically detect only sparse keypoints, which leads to inaccurate joint kinematics. OpenCap, a freely available service for researchers to measure movement from videos, addresses this issue using a deep learning model- the marker enhancer-that transforms sparse keypoints into dense anatomical markers. However, OpenCap performs poorly on movements not included in the training data. Here, we create a much larger and more diverse training dataset and develop a more accurate and generalizable marker enhancer. Methods We compiled marker-based motion capture data from 1176 subjects and synthesized 1433 hours of keypoints and anatomical markers to train the marker enhancer. We evaluated its accuracy in computing kinematics using both benchmark movement videos and synthetic data representing unseen, diverse movements. Results The marker enhancer improved kinematic accuracy on benchmark movements (mean error: 4.1°, max: 8.7°) compared to using video keypoints (mean: 9.6°, max: 43.1°) and OpenCap's original enhancer (mean: 5.3°, max: 11.5°). It also better generalized to unseen, diverse movements (mean: 4.1°, max: 6.7°) than OpenCap's original enhancer (mean: 40.4°, max: 252.0°). Conclusion Our marker enhancer demonstrates both accuracy and generalizability across diverse movements. Significance We integrated the marker enhancer into OpenCap, thereby offering its thousands of users more accurate measurements across a broader range of movements.
Collapse
|
9
|
Mundt M, Colyer S, Wade L, Needham L, Evans M, Millett E, Alderson J. Automating Video-Based Two-Dimensional Motion Analysis in Sport? Implications for Gait Event Detection, Pose Estimation, and Performance Parameter Analysis. Scand J Med Sci Sports 2024; 34:e14693. [PMID: 38984681 DOI: 10.1111/sms.14693] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2024] [Revised: 06/12/2024] [Accepted: 06/25/2024] [Indexed: 07/11/2024]
Abstract
BACKGROUND Two-dimensional (2D) video is a common tool used during sports training and competition to analyze movement. In these videos, biomechanists determine key events, annotate joint centers, and calculate spatial, temporal, and kinematic parameters to provide performance reports to coaches and athletes. Automatic tools relying on computer vision and artificial intelligence methods hold promise to reduce the need for time-consuming manual methods. OBJECTIVE This study systematically analyzed the steps required to automate the video analysis workflow by investigating the applicability of a threshold-based event detection algorithm developed for 3D marker trajectories to 2D video data at four sampling rates; the agreement of 2D keypoints estimated by an off-the-shelf pose estimation model compared with gold-standard 3D marker trajectories projected to camera's field of view; and the influence of an offset in event detection on contact time and the sagittal knee joint angle at the key critical events of touch down and foot flat. METHODS Repeated measures limits of agreement were used to compare parameters determined by markerless and marker-based motion capture. RESULTS Results highlighted that a minimum video sampling rate of 100 Hz is required to detect key events, and the limited applicability of 3D marker trajectory-based event detection algorithms when using 2D video. Although detected keypoints showed good agreement with the gold-standard, misidentification of key events-such as touch down by 20 ms resulted in knee compression angle differences of up to 20°. CONCLUSION These findings emphasize the need for de novo accurate key event detection algorithms to automate 2D video analysis pipelines.
Collapse
Affiliation(s)
- Marion Mundt
- UWA Tech & Policy Lab, The University of Western Australia, Crawley, Western Australia, Australia
| | - Steffi Colyer
- The Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, UK
| | - Logan Wade
- The Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, UK
| | - Laurie Needham
- The Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, UK
| | - Murray Evans
- The Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, UK
| | - Emma Millett
- New South Wales Institute of Sport, Sydney, New South Wales, Australia
- Athletics Australia, Albert Park, Victoria, Australia
| | - Jacqueline Alderson
- UWA Tech & Policy Lab, The University of Western Australia, Crawley, Western Australia, Australia
| |
Collapse
|
10
|
Tang H, Munkasy B, Li L. Differences between lower extremity joint running kinetics captured by marker-based and markerless systems were speed dependent. JOURNAL OF SPORT AND HEALTH SCIENCE 2024; 13:569-578. [PMID: 38218372 PMCID: PMC11184322 DOI: 10.1016/j.jshs.2024.01.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Revised: 12/07/2023] [Accepted: 01/04/2024] [Indexed: 01/15/2024]
Abstract
BACKGROUND The development of computer vision technology has enabled the use of markerless movement tracking for biomechanical analysis. Recent research has reported the feasibility of markerless systems in motion analysis but has yet to fully explore their utility for capturing faster movements, such as running. Applied studies using markerless systems in clinical and sports settings are still lacking. Thus, the present study compared running biomechanics estimated by marker-based and markerless systems. Given running speed not only affects sports performance but is also associated with clinical injury prevention, diagnosis, and rehabilitation, we aimed to investigate the effects of speed on the comparison of estimated lower extremity joint moments and powers between markerless and marker-based technologies during treadmill running as a concurrent validating study. METHODS Kinematic data from marker-based/markerless technologies were collected, along with ground reaction force data, from 16 young adults running on an instrumented treadmill at 3 speeds: 2.24 m/s, 2.91 m/s, and 3.58 m/s (5.0 miles/h, 6.5 miles/h, and 8.0 miles/h). Sagittal plane moments and powers of the hip, knee, and ankle were calculated by inverse dynamic methods. Time series analysis and statistical parametric mapping were used to determine system differences. RESULTS Compared to the marker-based system, the markerless system estimated increased lower extremity joint kinetics with faster speed during the swing phase in most cases. CONCLUSION Despite the promising application of markerless technology in clinical settings, systematic markerless overestimation requires focused attention. Based on segment pose estimations, the centers of mass estimated by markerless technologies were farther away from the relevant distal joint centers, which led to greater joint moments and powers estimates by markerless vs. marker-based systems. The differences were amplified by running speed.
Collapse
Affiliation(s)
- Hui Tang
- Department of Health Sciences and Kinesiology, Georgia Southern University, Statesboro, GA 30458, USA; Department of Kinesiology and Health Education, University of Texas at Austin, Austin, TX 78712, USA
| | - Barry Munkasy
- Department of Health Sciences and Kinesiology, Georgia Southern University, Statesboro, GA 30458, USA
| | - Li Li
- Department of Health Sciences and Kinesiology, Georgia Southern University, Statesboro, GA 30458, USA.
| |
Collapse
|
11
|
Brambilla C, Scano A. Kinematic synergies show good consistency when extracted with a low-cost markerless device and a marker-based motion tracking system. Heliyon 2024; 10:e32042. [PMID: 38882310 PMCID: PMC11176860 DOI: 10.1016/j.heliyon.2024.e32042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2024] [Revised: 05/23/2024] [Accepted: 05/27/2024] [Indexed: 06/18/2024] Open
Abstract
Recently, markerless tracking systems, such as RGB-Depth cameras, have spread to overcome some of the limitations of the gold standard marker-based tracking systems. Although these systems are valuable substitutes for human motion analysis, as they guarantee higher flexibility, faster setup time and lower costs, their tracking accuracy is lower with respect to marker-based systems. Many studies quantified the error made by markerless systems in terms of body segment length estimation, articular angles, and biomechanics, concluding that they are appropriate for many clinical applications related to motion analysis. We propose an innovative approach to compare a markerless tracking system (Kinect V2) with a gold standard marker-based system (Vicon), based on motor control assessment. We quantified kinematic synergies from the tracking data of fifteen participants performing multi-directional upper limb movements. Kinematic synergy analysis decomposes the kinematic data into a reduced set of motor primitives that describe how the central nervous system coordinates motion at spatial and temporal level. Synergies were extracted with the recently released mixed-matrix factorization algorithm. Four synergies were extracted from both marker-based and markerless datasets and synergies were grouped in 6 clusters for each dataset. Cosine similarity in each cluster was ⩾0.60 in both systems, showing good consistency of synergies. Good matching was found between synergies extracted from markerless and from marker-based data, with a cosine similarity between matched synergies ⩾0.60 in 5 out 6 synergies. These results showed that the markerless sensor can be feasible for kinematic synergy analysis for gross movements, as it correctly estimates the number of synergies and in most cases also their spatial and temporal organization.
Collapse
Affiliation(s)
- Cristina Brambilla
- Institute of Intelligent Industrial Systems and Technologies for Advanced Manufacturing (STIIMA), Italian Council of National Research (CNR), Milano, Italy
| | - Alessandro Scano
- Institute of Intelligent Industrial Systems and Technologies for Advanced Manufacturing (STIIMA), Italian Council of National Research (CNR), Milano, Italy
| |
Collapse
|
12
|
Scataglini S, Abts E, Van Bocxlaer C, Van den Bussche M, Meletani S, Truijen S. Accuracy, Validity, and Reliability of Markerless Camera-Based 3D Motion Capture Systems versus Marker-Based 3D Motion Capture Systems in Gait Analysis: A Systematic Review and Meta-Analysis. SENSORS (BASEL, SWITZERLAND) 2024; 24:3686. [PMID: 38894476 PMCID: PMC11175331 DOI: 10.3390/s24113686] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/21/2024] [Revised: 05/22/2024] [Accepted: 05/30/2024] [Indexed: 06/21/2024]
Abstract
(1) Background: Marker-based 3D motion capture systems (MBS) are considered the gold standard in gait analysis. However, they have limitations for which markerless camera-based 3D motion capture systems (MCBS) could provide a solution. The aim of this systematic review and meta-analysis is to compare the accuracy, validity, and reliability of MCBS and MBS. (2) Methods: A total of 2047 papers were systematically searched according to PRISMA guidelines on 7 February 2024, in two different databases: Pubmed (1339) and WoS (708). The COSMIN-tool and EBRO guidelines were used to assess risk of bias and level of evidence. (3) Results: After full text screening, 22 papers were included. Spatiotemporal parameters showed overall good to excellent accuracy, validity, and reliability. For kinematic variables, hip and knee showed moderate to excellent agreement between the systems, while for the ankle joint, poor concurrent validity and reliability were measured. The accuracy and concurrent validity of walking speed were considered excellent in all cases, with only a small bias. The meta-analysis of the inter-rater reliability and concurrent validity of walking speed, step time, and step length resulted in a good-to-excellent intraclass correlation coefficient (ICC) (0.81; 0.98). (4) Discussion and conclusions: MCBS are comparable in terms of accuracy, concurrent validity, and reliability to MBS in spatiotemporal parameters. Additionally, kinematic parameters for hip and knee in the sagittal plane are considered most valid and reliable but lack valid and accurate measurement outcomes in transverse and frontal planes. Customization and standardization of methodological procedures are necessary for future research to adequately compare protocols in clinical settings, with more attention to patient populations.
Collapse
Affiliation(s)
- Sofia Scataglini
- 4D4ALL Laboratory, Department of Rehabilitation Sciences and Physiotherapy, Center for Health and Technology (CHaT), Faculty of Medicine and Health Sciences, University of Antwerp, 2000 Antwerpen, Belgium; (E.A.); (C.V.B.); (M.V.d.B.); (S.M.); (S.T.)
| | | | | | | | | | | |
Collapse
|
13
|
Turner JA, Chaaban CR, Padua DA. Validation of OpenCap: A low-cost markerless motion capture system for lower-extremity kinematics during return-to-sport tasks. J Biomech 2024; 171:112200. [PMID: 38905926 DOI: 10.1016/j.jbiomech.2024.112200] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2024] [Revised: 06/08/2024] [Accepted: 06/14/2024] [Indexed: 06/23/2024]
Abstract
Low-cost markerless motion capture systems offer the potential for 3D measurement of joint angles during human movement. This study aimed to validate a smartphone-based markerless motion capture system's (OpenCap) derived lower extremity kinematics during common return-to-sport tasks, comparing it to an established optoelectronic motion capture system. Athletes with prior anterior cruciate ligament reconstruction (12-18 months post-surgery) performed three movements: a jump-landing-rebound, single-leg hop, and lateral-vertical hop. Kinematics were recorded concurrently with two smartphones running OpenCap's software and with a 10-camera, marker-based motion capture system. Validity of lower extremity joint kinematics was assessed across 437 recorded trials using measures of agreement (coefficient of multiple correlation: CMC) and error (mean absolute error: MAE, root mean squared error: RMSE) across the time series of movement. Agreement was best in the sagittal plane for the knee and hip in all movements (CMC > 0.94), followed by the ankle (CMC = 0.84-0.93). Lower agreement was observed for frontal (CMC = 0.47-0.78) and transverse (CMC = 0.51-0.6) plane motion. OpenCap presented a grand mean error of 3.85° (MAE) and 4.34° (RMSE) across all joint angles and movements. These results were comparable to other available markerless systems. Most notably, OpenCap's user-friendly interface, free software, and small physical footprint have the potential to extend motion analysis applications beyond conventional biomechanics labs, thus enhancing the accessibility for a diverse range of users.
Collapse
Affiliation(s)
- Jeffrey A Turner
- Department of Exercise and Sport Science, University of North Carolina at Chapel Hill, NC, USA; Human Movement Science Curriculum, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
| | - Courtney R Chaaban
- Department of Exercise and Sport Science, University of North Carolina at Chapel Hill, NC, USA; Human Movement Science Curriculum, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
| | - Darin A Padua
- Department of Exercise and Sport Science, University of North Carolina at Chapel Hill, NC, USA; Human Movement Science Curriculum, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
| |
Collapse
|
14
|
Wishaupt K, Schallig W, van Dorst MH, Buizer AI, van der Krogt MM. The applicability of markerless motion capture for clinical gait analysis in children with cerebral palsy. Sci Rep 2024; 14:11910. [PMID: 38789587 PMCID: PMC11126730 DOI: 10.1038/s41598-024-62119-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Accepted: 05/14/2024] [Indexed: 05/26/2024] Open
Abstract
The aim of this comparative, cross-sectional study was to determine whether markerless motion capture can track deviating gait patterns in children with cerebral palsy (CP) to a similar extent as marker-based motion capturing. Clinical gait analysis (CGA) was performed for 30 children with spastic CP and 15 typically developing (TD) children. Marker data were processed with the Human Body Model and video files with Theia3D markerless software, to calculate joint angles for both systems. Statistical parametric mapping paired t-tests were used to compare the trunk, pelvis, hip, knee and ankle joint angles, for both TD and CP, as well as for the deviation from the norm in the CP group. Individual differences were quantified using mean absolute differences. Markerless motion capture was able to track frontal plane angles and sagittal plane knee and ankle angles well, but individual deviations in pelvic tilt and transverse hip rotation as present in CP were not captured by the system. Markerless motion capture is a promising new method for CGA in children with CP, but requires improvement to better capture several clinically relevant deviations especially in pelvic tilt and transverse hip rotation.
Collapse
Affiliation(s)
- Koen Wishaupt
- Department of Rehabilitation Medicine, Amsterdam UMC location Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.
| | - Wouter Schallig
- Department of Rehabilitation Medicine, Amsterdam UMC location Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
- Amsterdam Movement Sciences, Rehabilitation & Development, Amsterdam, The Netherlands
| | - Marleen H van Dorst
- Department of Rehabilitation Medicine, Amsterdam UMC location Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
- Amsterdam Movement Sciences, Rehabilitation & Development, Amsterdam, The Netherlands
| | - Annemieke I Buizer
- Department of Rehabilitation Medicine, Amsterdam UMC location Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
- Amsterdam Movement Sciences, Rehabilitation & Development, Amsterdam, The Netherlands
- Emma Children's Hospital, Amsterdam UMC, Amsterdam, The Netherlands
| | - Marjolein M van der Krogt
- Department of Rehabilitation Medicine, Amsterdam UMC location Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
- Amsterdam Movement Sciences, Rehabilitation & Development, Amsterdam, The Netherlands
| |
Collapse
|
15
|
Simonet A, Fourcade P, Loete F, Delafontaine A, Yiou E. Evaluation of the Margin of Stability during Gait Initiation in Young Healthy Adults, Elderly Healthy Adults and Patients with Parkinson's Disease: A Comparison of Force Plate and Markerless Motion Capture Systems. SENSORS (BASEL, SWITZERLAND) 2024; 24:3322. [PMID: 38894112 PMCID: PMC11174352 DOI: 10.3390/s24113322] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/07/2024] [Revised: 05/17/2024] [Accepted: 05/20/2024] [Indexed: 06/21/2024]
Abstract
Gait initiation (GI) is a functional task classically used in the literature to evaluate the capacity of individuals to maintain postural stability. Postural stability during GI can be evaluated through the "margin of stability" (MoS), a variable that is often computed from force plate recordings. The markerless motion capture system (MLS) is a recent innovative technology based on deep learning that has the potential to compute the MoS. This study tested the agreement between a force plate measurement system (FPS, gold standard) and an MLS to compute the MoS during GI. Healthy adults (young [YH] and elderly [EH]) and Parkinson's disease patients (PD) performed GI series at spontaneous (SVC) and maximum velocity (MVC) on an FPS while being filmed by a MLS. Descriptive statistics revealed a significant effect of the group (YH vs. EH vs. PD) and velocity condition (SVC vs. MVC) on the MoS but failed to reveal any significant effect of the system (MLS vs. PFS) or interaction between factors. Bland-Altman plot analysis further showed that mean MoS biases were zero in all groups and velocity conditions, while the Bayes factor 01 indicated "moderate evidence" that both systems provided equivalent MoS. Trial-by-trial analysis of Bland-Altman plots, however, revealed that differences of >20% between the two systems did occur. Globally taken, these findings suggest that the two systems are similarly effective in detecting an effect of the group and velocity on the MoS. These findings may have important implications in both clinical and laboratory settings due to the ease of use of the MLS compared to the FPS.
Collapse
Affiliation(s)
- Arnaud Simonet
- LADAPT Loiret, Centre de Soins de Suite et de Réadaptation, 45200 Amilly, France;
- CIAMS, Université Paris-Saclay, 91405 Orsay, France; (P.F.); (A.D.)
- CIAMS, Université d’Orléans, 45067 Orléans, France
| | - Paul Fourcade
- CIAMS, Université Paris-Saclay, 91405 Orsay, France; (P.F.); (A.D.)
- CIAMS, Université d’Orléans, 45067 Orléans, France
| | - Florent Loete
- Laboratoire GeePs—CENTRALESUPELEC, 91190 Gif-sur-Yvette, France;
| | - Arnaud Delafontaine
- CIAMS, Université Paris-Saclay, 91405 Orsay, France; (P.F.); (A.D.)
- CIAMS, Université d’Orléans, 45067 Orléans, France
- Laboratoire d’Anatomie Fonctionnelle, Faculté des Sciences de la Motricité, Université Libre de Bruxelles, CP 619-1070 Brussels, Belgium
- Laboratoire d’Anatomie, de Biomécanique et d’Organogenèse, Faculté de Médecine, Université Libre de Bruxelles, CP 619-1070 Brussels, Belgium
| | - Eric Yiou
- CIAMS, Université Paris-Saclay, 91405 Orsay, France; (P.F.); (A.D.)
- CIAMS, Université d’Orléans, 45067 Orléans, France
| |
Collapse
|
16
|
Kanko RM, Outerleys JB, Laende EK, Selbie WS, Deluzio KJ. Comparison of Concurrent and Asynchronous Running Kinematics and Kinetics From Marker-Based and Markerless Motion Capture Under Varying Clothing Conditions. J Appl Biomech 2024; 40:129-137. [PMID: 38237574 DOI: 10.1123/jab.2023-0069] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Revised: 09/05/2023] [Accepted: 10/20/2023] [Indexed: 03/27/2024]
Abstract
As markerless motion capture is increasingly used to measure 3-dimensional human pose, it is important to understand how markerless results can be interpreted alongside historical marker-based data and how they are impacted by clothing. We compared concurrent running kinematics and kinetics between marker-based and markerless motion capture, and between 2 markerless clothing conditions. Thirty adults ran on an instrumented treadmill wearing motion capture clothing while concurrent marker-based and markerless data were recorded, and ran a second time wearing athletic clothing (shorts and t-shirt) while markerless data were recorded. Differences calculated between the concurrent signals from both systems, and also between each participant's mean signals from both asynchronous clothing conditions were summarized across all participants using root mean square differences. Most kinematic and kinetic signals were visually consistent between systems and markerless clothing conditions. Between systems, joint center positions differed by 3 cm or less, sagittal plane joint angles differed by 5° or less, and frontal and transverse plane angles differed by 5° to 10°. Joint moments differed by 0.3 N·m/kg or less between systems. Differences were sensitive to segment coordinate system definitions, highlighting the effects of these definitions when comparing against historical data or other motion capture modalities.
Collapse
Affiliation(s)
| | - Jereme B Outerleys
- Theia Markerless Inc., Kingston, ON, Canada
- Mechanical and Materials Engineering, Queen's University, Kingston, ON, Canada
| | - Elise K Laende
- Mechanical and Materials Engineering, Queen's University, Kingston, ON, Canada
| | | | - Kevin J Deluzio
- Mechanical and Materials Engineering, Queen's University, Kingston, ON, Canada
| |
Collapse
|
17
|
Huang T, Ruan M, Huang S, Fan L, Wu X. Comparison of kinematics and joint moments calculations for lower limbs during gait using markerless and marker-based motion capture. Front Bioeng Biotechnol 2024; 12:1280363. [PMID: 38532880 PMCID: PMC10963629 DOI: 10.3389/fbioe.2024.1280363] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2023] [Accepted: 02/26/2024] [Indexed: 03/28/2024] Open
Abstract
Objective: This study aimed at quantifying the difference in kinematic and joint moments calculation for lower limbs during gait utilizing a markerless motion system (TsingVA Technology, Beijing, China) in comparison to values estimated using a marker-based motion capture system (Nokov Motion Capture System, Beijing, China). Methods: Sixteen healthy participants were recruited for the study. The kinematic data of the lower limb during walking were acquired simultaneously based on the markerless motion capture system (120 Hz) and the marker-based motion capture system (120 Hz). The ground reaction force was recorded synchronously using a force platform (1,200 Hz). The kinematic and force data were input into Visual3D for inverse dynamics calculations. Results: The difference in the lower limb joint center position between the two systems was the least at the ankle joint in the posterior/anterior direction, with the mean absolute deviation (MAD) of 0.74 cm. The least difference in measuring lower limb angles between the two systems was found in flexion/extension movement, and the greatest difference was found in internal/external rotation movement. The coefficient of multiple correlations (CMC) of the lower limb three joint moments for both systems exceeded or equaled 0.75, except for the ad/abduction of the knee and ankle. All the Root Mean Squared Deviation (RMSD) of the lower limb joint moment are below 18 N·m. Conclusion: The markerless motion capture system and marker-based motion capture system showed a high similarity in kinematics and inverse dynamic calculation for lower limbs during gait in the sagittal plane. However, it should be noted that there is a notable deviation in ad/abduction moments at the knee and ankle.
Collapse
Affiliation(s)
- Tianchen Huang
- Sports Biomechanics Laboratory, College of Physical Education and Health, Wenzhou University, Wenzhou, China
| | - Mianfang Ruan
- Sports Biomechanics Laboratory, College of Physical Education and Health, Wenzhou University, Wenzhou, China
| | - Shangjun Huang
- Laboratory of Biomechanics and Rehabilitation Engineering, School of Medicine, Tongji University, Shanghai, China
| | - Linlin Fan
- TsingVA (Beijing) Technology Co., Ltd., Beijing, China
| | - Xie Wu
- Key Laboratory of Exercise and Health Sciences, Ministry of Education, Shanghai University of Sport, Shanghai, China
| |
Collapse
|
18
|
Stenum J, Hsu MM, Pantelyat AY, Roemmich RT. Clinical gait analysis using video-based pose estimation: Multiple perspectives, clinical populations, and measuring change. PLOS DIGITAL HEALTH 2024; 3:e0000467. [PMID: 38530801 DOI: 10.1371/journal.pdig.0000467] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Accepted: 02/12/2024] [Indexed: 03/28/2024]
Abstract
Gait dysfunction is common in many clinical populations and often has a profound and deleterious impact on independence and quality of life. Gait analysis is a foundational component of rehabilitation because it is critical to identify and understand the specific deficits that should be targeted prior to the initiation of treatment. Unfortunately, current state-of-the-art approaches to gait analysis (e.g., marker-based motion capture systems, instrumented gait mats) are largely inaccessible due to prohibitive costs of time, money, and effort required to perform the assessments. Here, we demonstrate the ability to perform quantitative gait analyses in multiple clinical populations using only simple videos recorded using low-cost devices (tablets). We report four primary advances: 1) a novel, versatile workflow that leverages an open-source human pose estimation algorithm (OpenPose) to perform gait analyses using videos recorded from multiple different perspectives (e.g., frontal, sagittal), 2) validation of this workflow in three different populations of participants (adults without gait impairment, persons post-stroke, and persons with Parkinson's disease) via comparison to ground-truth three-dimensional motion capture, 3) demonstration of the ability to capture clinically relevant, condition-specific gait parameters, and 4) tracking of within-participant changes in gait, as is required to measure progress in rehabilitation and recovery. Importantly, our workflow has been made freely available and does not require prior gait analysis expertise. The ability to perform quantitative gait analyses in nearly any setting using only low-cost devices and computer vision offers significant potential for dramatic improvement in the accessibility of clinical gait analysis across different patient populations.
Collapse
Affiliation(s)
- Jan Stenum
- Center for Movement Studies, Kennedy Krieger Institute, Baltimore, Maryland, United States of America
- Department of Physical Medicine and Rehabilitation, The Johns Hopkins University School of Medicine, Baltimore, Maryland, United States of America
| | - Melody M Hsu
- Center for Movement Studies, Kennedy Krieger Institute, Baltimore, Maryland, United States of America
- Department of Neuroscience, The Johns Hopkins University School of Medicine, Baltimore, Maryland, United States of America
| | - Alexander Y Pantelyat
- Department of Neurology, The Johns Hopkins University School of Medicine, Baltimore, Maryland, United States of America
| | - Ryan T Roemmich
- Center for Movement Studies, Kennedy Krieger Institute, Baltimore, Maryland, United States of America
- Department of Physical Medicine and Rehabilitation, The Johns Hopkins University School of Medicine, Baltimore, Maryland, United States of America
| |
Collapse
|
19
|
Horsak B, Prock K, Krondorfer P, Siragy T, Simonlehner M, Dumphart B. Inter-trial variability is higher in 3D markerless compared to marker-based motion capture: Implications for data post-processing and analysis. J Biomech 2024; 166:112049. [PMID: 38493576 DOI: 10.1016/j.jbiomech.2024.112049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2023] [Revised: 01/22/2024] [Accepted: 03/11/2024] [Indexed: 03/19/2024]
Abstract
Markerless motion capture has recently attracted significant interest in clinical gait analysis and human movement science. Its ease of use and potential to streamline motion capture recordings bear great potential for out-of-the-laboratory measurements in large cohorts. While previous studies have shown that markerless systems can achieve acceptable accuracy and reliability for kinematic parameters of gait, they also noted higher inter-trial variability of markerless data. Since increased inter-trial variability can have important implications for data post-processing and analysis, this study compared the inter-trial variability of simultaneously recorded markerless and marker-based data. For this purpose, the data of 18 healthy volunteers were used who were instructed to simulate four different gait patterns: physiological, crouch, circumduction, and equinus gait. Gait analysis was performed using the smartphone-based markerless system OpenCap and a marker-based motion capture system. We compared the inter-trial variability of both systems and also evaluated if changes in inter-trial variability may depend on the analyzed gait pattern. Compared to the marker-based data, we observed an increase of inter-trial variability for the markerless system ranging from 6.6% to 22.0% for the different gait patterns. Our findings demonstrate that the markerless pose estimation pipelines can introduce additionally variability in the kinematic data across different gait patterns and levels of natural variability. We recommend using averaged waveforms rather than single ones to mitigate this problem. Further, caution is advised when using variability-based metrics in gait and human movement analysis based on markerless data as increased inter-trial variability can lead to misleading results.
Collapse
Affiliation(s)
- Brian Horsak
- Center for Digital Health and Social Innovation, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria; Institute of Health Sciences, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria.
| | - Kerstin Prock
- Center for Digital Health and Social Innovation, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria
| | - Philipp Krondorfer
- Center for Digital Health and Social Innovation, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria
| | - Tarique Siragy
- Center for Digital Health and Social Innovation, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria
| | - Mark Simonlehner
- Center for Digital Health and Social Innovation, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria; Institute of Health Sciences, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria
| | - Bernhard Dumphart
- Center for Digital Health and Social Innovation, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria; Institute of Health Sciences, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria
| |
Collapse
|
20
|
Hauenstein JD, Huebner A, Wagle JP, Cobian ER, Cummings J, Hills C, McGinty M, Merritt M, Rosengarten S, Skinner K, Szemborski M, Wojtkiewicz L. Reliability of Markerless Motion Capture Systems for Assessing Movement Screenings. Orthop J Sports Med 2024; 12:23259671241234339. [PMID: 38476162 PMCID: PMC10929051 DOI: 10.1177/23259671241234339] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Accepted: 09/06/2023] [Indexed: 03/14/2024] Open
Abstract
Background Movement screenings are commonly used to detect unfavorable movement patterns. Markerless motion capture systems have been developed to track 3-dimensional motion. Purpose To determine the reliability of movement screenings assessed using a markerless motion capture system when comparing the results of multiple systems and multiple collection periods. Study Design Descriptive laboratory study. Methods The inter- and intrarater reliability of a commercially available markerless motion capture system were investigated in 21 recreationally active participants aged between 18 and 22 years. A total of 39 kinematic variables arising from 10 fundamental upper and lower body movements typical of a screening procedure in sports performance were considered. The data were statistically analyzed in terms of relative error via the intraclass correlation coefficient (ICC) and absolute error via the residual standard error (RSE). Results Both inter- and intrarater reliability ICCs were at least moderate across all variables (ICC, >0.50), with most movements and corresponding variables having excellent reliability (ICC, >0.90). Although maximum knee valgus angles were the kinematic variables with the lowest interrater reliability (ICCs, 0.59-0.82) and moderate relative agreement, there was agreement in absolute terms with an RSE of <1.3°. Conclusion Findings indicated that markerless motion capture provides reliable measurements of joint position during a movement screen, which allows for a more objective evaluation of the direction and subsequent success of interventions. However, practitioners should consider relative and absolute agreements when applying information provided by these systems. Clinical Relevance Markerless motion capture systems may assist clinicians by reliably assessing movement screenings using different systems over different collection periods.
Collapse
Affiliation(s)
- Jonathan D. Hauenstein
- Department of Applied and Computational Mathematics and Statistics, University of Notre Dame, Notre Dame, Indiana, USA
| | - Alan Huebner
- Department of Applied and Computational Mathematics and Statistics, University of Notre Dame, Notre Dame, Indiana, USA
| | - John P. Wagle
- University of Notre Dame, Sports Performance, Notre Dame, Indiana, USA
| | - Emma R. Cobian
- Department of Applied and Computational Mathematics and Statistics, University of Notre Dame, Notre Dame, Indiana, USA
| | - Joseph Cummings
- Department of Applied and Computational Mathematics and Statistics, University of Notre Dame, Notre Dame, Indiana, USA
| | - Caroline Hills
- Department of Applied and Computational Mathematics and Statistics, University of Notre Dame, Notre Dame, Indiana, USA
| | - Megan McGinty
- Department of Applied and Computational Mathematics and Statistics, University of Notre Dame, Notre Dame, Indiana, USA
| | - Mandy Merritt
- University of Notre Dame, Sports Performance, Notre Dame, Indiana, USA
| | - Sam Rosengarten
- Department of Applied and Computational Mathematics and Statistics, University of Notre Dame, Notre Dame, Indiana, USA
- Baltimore Ravens, Under Armour Performance Center, Owings Mills, Maryland, USA
| | - Kyle Skinner
- University of Notre Dame, Sports Performance, Notre Dame, Indiana, USA
| | | | - Leigh Wojtkiewicz
- University of Notre Dame, Data & Analytics, Notre Dame, Indiana, USA
| |
Collapse
|
21
|
Lichtwark GA, Schuster RW, Kelly LA, Trost SG, Bialkowski A. Markerless motion capture provides accurate predictions of ground reaction forces across a range of movement tasks. J Biomech 2024; 166:112051. [PMID: 38503062 DOI: 10.1016/j.jbiomech.2024.112051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Revised: 02/28/2024] [Accepted: 03/13/2024] [Indexed: 03/21/2024]
Abstract
Measuring or estimating the forces acting on the human body during movement is critical for determining the biomechanical aspects relating to injury, disease and healthy ageing. In this study we examined whether quantifying whole-body motion (segmental accelerations) using a commercial markerless motion capture system could accurately predict three-dimensional ground reaction force during a diverse range of human movements: walking, running, jumping and cutting. We synchronously recorded 3D ground reaction forces (force instrumented treadmill or in-ground plates) with high-resolution video from eight cameras that were spatially calibrated relative to a common coordinate system. We used a commercially available software to reconstruct whole body motion, along with a geometric skeletal model to calculate the acceleration of each segment and hence the whole-body centre of mass and ground reaction force across each movement task. The average root mean square difference (RMSD) across all three dimensions and all tasks was 0.75 N/kg, with the maximum average RMSD being 1.85 N/kg for running vertical force (7.89 % of maximum). There was very strong agreement between peak forces across tasks, with R2 values indicating that the markerless prediction algorithm was able to predict approximately 95-99 % of the variance in peak force across all axes and movements. The results were comparable to previous reports using whole-body marker-based approaches and hence this provides strong proof-of-principle evidence that markerless motion capture can be used to predict ground reaction forces and therefore potentially assess movement kinetics with limited requirements for participant preparation.
Collapse
Affiliation(s)
- Glen A Lichtwark
- School of Exercise and Nutrition Sciences, Queensland University of Technology, Kelvin Grove, QLD 4059, Australia; School of Human Movement and Nutrition Sciences, The University of Queensland, St. Lucia, QLD 4072, Australia.
| | - Robert W Schuster
- School of Human Movement and Nutrition Sciences, The University of Queensland, St. Lucia, QLD 4072, Australia
| | - Luke A Kelly
- School of Human Movement and Nutrition Sciences, The University of Queensland, St. Lucia, QLD 4072, Australia; School of Health Sciences and Social Work, Griffith University, Gold Coast 4111, Australia; Griffith Centre of Biomedical and Rehabilitation Engineering, Griffith University, Gold Coast 4111, Australia
| | - Stewart G Trost
- School of Human Movement and Nutrition Sciences, The University of Queensland, St. Lucia, QLD 4072, Australia; Children's Health Queensland Health and Hospital Service, South Brisbane, QLD 4101, Australia
| | - Alina Bialkowski
- School of Electrical Engineering and Computer Science, The University of Queensland, St Lucia, QLD 4072, Australia
| |
Collapse
|
22
|
Wang H, Su B, Lu L, Jung S, Qing L, Xie Z, Xu X. Markerless gait analysis through a single camera and computer vision. J Biomech 2024; 165:112027. [PMID: 38430608 DOI: 10.1016/j.jbiomech.2024.112027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Revised: 02/23/2024] [Accepted: 02/26/2024] [Indexed: 03/05/2024]
Abstract
The assessment of gait performance using quantitative measures can yield crucial insights into an individual's health status. Recently, computer vision-based human pose estimation has emerged as a promising solution for markerless gait analysis, as it allows for the direct extraction of gait parameters from videos. This study aimed to compare the lower extremity kinematics and spatiotemporal gait parameters obtained from a single-camera-based markerless method with those acquired from a marker-based motion tracking system across a healthy population. Additionally, we investigated the impact of camera viewing angles and distances on the accuracy of the markerless method. Our findings demonstrated a robust correlation and agreement (Rxy > 0.75, Rc > 0.7) between the markerless and marker-based methods for most spatiotemporal gait parameters. We also observed strong correlations (Rxy > 0.8) between the two methods for hip flexion/extension, knee flexion/extension, hip abduction/adduction, and hip internal/external rotation. Statistical tests revealed significant effects of viewing angles and distances on the accuracy of the identified gait parameters. While the markerless method offers an alternative for general gait analysis, particularly when marker use is impractical, its accuracy for clinical applications remains insufficient and requires substantial improvement. Future investigations should explore the potential of the markerless system to measure gait parameters in pathological gaits.
Collapse
Affiliation(s)
- Hanwen Wang
- Edward P. Fitts Department of Industrial and Systems Engineering North, Carolina State University, Raleigh NC, 27695, USA
| | - Bingyi Su
- Edward P. Fitts Department of Industrial and Systems Engineering North, Carolina State University, Raleigh NC, 27695, USA
| | - Lu Lu
- Edward P. Fitts Department of Industrial and Systems Engineering North, Carolina State University, Raleigh NC, 27695, USA
| | - Sehee Jung
- Edward P. Fitts Department of Industrial and Systems Engineering North, Carolina State University, Raleigh NC, 27695, USA
| | - Liwei Qing
- Edward P. Fitts Department of Industrial and Systems Engineering North, Carolina State University, Raleigh NC, 27695, USA
| | - Ziyang Xie
- Edward P. Fitts Department of Industrial and Systems Engineering North, Carolina State University, Raleigh NC, 27695, USA
| | - Xu Xu
- Edward P. Fitts Department of Industrial and Systems Engineering North, Carolina State University, Raleigh NC, 27695, USA.
| |
Collapse
|
23
|
Chaumeil A, Lahkar BK, Dumas R, Muller A, Robert T. Agreement between a markerless and a marker-based motion capture systems for balance related quantities. J Biomech 2024; 165:112018. [PMID: 38412623 DOI: 10.1016/j.jbiomech.2024.112018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2023] [Revised: 02/07/2024] [Accepted: 02/19/2024] [Indexed: 02/29/2024]
Abstract
Balance studies usually focus on quantities describing the global body motion. Assessing such quantities using classical marker-based approach can be tedious and modify the participant's behaviour. The recent development of markerless motion capture methods could bypass the issues related to the use of markers. This work compared dynamic balance related quantities obtained with markers and videos. Sixteen young healthy participants performed four different motor tasks: walking at self-selected speed, balance loss, walking on a narrow beam and countermovement jumps. Their movements were recorded simultaneously by marker-based and markerless motion capture systems. Videos were processed using a commercial markerless pose estimation software, Theia3D. The centre of mass position (CoM) was computed, and the associated extrapolated centre of mass position (XCoM) and whole-body angular momentum (WBAM) were derived. Bland-Altman analysis was performed and root mean square difference (RMSD) and coefficient of correlation were computed to compare the results obtained with marker-based and markerless methods. Bias remained of the magnitude of a few mm for CoM and XCoM positions, and RMSD of CoM and XCoM was around 1 cm. RMSD of the WBAM was less than 10 % of the total amplitude in any direction, and bias was less than 1 %. Results suggest that outcomes of balance studies will be similar whether marker-based or markerless motion capture system are used. Nevertheless, one should be careful when assessing dynamic movements such as jumping, as they displayed the biggest differences (both bias and RMSD), although it is unclear whether these differences are due to errors in markerless or marker-based motion capture system.
Collapse
Affiliation(s)
- Anaïs Chaumeil
- Univ Lyon, Univ Gustave Eiffel, Univ Claude Bernard Lyon 1, LBMC UMR_T 9406, F-69622 Lyon, France
| | - Bhrigu Kumar Lahkar
- Univ Lyon, Univ Gustave Eiffel, Univ Claude Bernard Lyon 1, LBMC UMR_T 9406, F-69622 Lyon, France
| | - Raphaël Dumas
- Univ Lyon, Univ Gustave Eiffel, Univ Claude Bernard Lyon 1, LBMC UMR_T 9406, F-69622 Lyon, France.
| | - Antoine Muller
- Univ Lyon, Univ Gustave Eiffel, Univ Claude Bernard Lyon 1, LBMC UMR_T 9406, F-69622 Lyon, France
| | - Thomas Robert
- Univ Lyon, Univ Gustave Eiffel, Univ Claude Bernard Lyon 1, LBMC UMR_T 9406, F-69622 Lyon, France
| |
Collapse
|
24
|
Simonet A, Delafontaine A, Fourcade P, Yiou E. Vertical Center-of-Mass Braking and Motor Performance during Gait Initiation in Young Healthy Adults, Elderly Healthy Adults, and Patients with Parkinson's Disease: A Comparison of Force-Plate and Markerless Motion Capture Systems. SENSORS (BASEL, SWITZERLAND) 2024; 24:1302. [PMID: 38400460 PMCID: PMC10891667 DOI: 10.3390/s24041302] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Revised: 02/12/2024] [Accepted: 02/15/2024] [Indexed: 02/25/2024]
Abstract
BACKGROUND This study tested the agreement between a markerless motion capture system and force-plate system ("gold standard") to quantify stability control and motor performance during gait initiation. METHODS Healthy adults (young and elderly) and patients with Parkinson's disease performed gait initiation series at spontaneous and maximal velocity on a system of two force-plates placed in series while being filmed by a markerless motion capture system. Signals from both systems were used to compute the peak of forward center-of-mass velocity (indicator of motor performance) and the braking index (indicator of stability control). RESULTS Descriptive statistics indicated that both systems detected between-group differences and velocity effects similarly, while a Bland-Altman plot analysis showed that mean biases of both biomechanical indicators were virtually zero in all groups and conditions. Bayes factor 01 indicated strong (braking index) and moderate (motor performance) evidence that both systems provided equivalent values. However, a trial-by-trial analysis of Bland-Altman plots revealed the possibility of differences >10% between the two systems. CONCLUSION Although non-negligible differences do occur, a markerless motion capture system appears to be as efficient as a force-plate system in detecting Parkinson's disease and velocity condition effects on the braking index and motor performance.
Collapse
Affiliation(s)
- Arnaud Simonet
- LADAPT Loiret, Centre de Soins de Suite et de Réadaptation, 45200 Amilly, France;
- CIAMS, Université Paris-Saclay, 91190 Paris, France; (A.D.); (P.F.)
- CIAMS, Université d’Orléans, 45067 Orléans, France
| | - Arnaud Delafontaine
- CIAMS, Université Paris-Saclay, 91190 Paris, France; (A.D.); (P.F.)
- CIAMS, Université d’Orléans, 45067 Orléans, France
- Département de Chirurgie Orthopédique, Université Libre de Bruxelles, 1050 Bruxelles, Belgium
| | - Paul Fourcade
- CIAMS, Université Paris-Saclay, 91190 Paris, France; (A.D.); (P.F.)
- CIAMS, Université d’Orléans, 45067 Orléans, France
| | - Eric Yiou
- CIAMS, Université Paris-Saclay, 91190 Paris, France; (A.D.); (P.F.)
- CIAMS, Université d’Orléans, 45067 Orléans, France
| |
Collapse
|
25
|
Cashaback JGA, Allen JL, Chou AHY, Lin DJ, Price MA, Secerovic NK, Song S, Zhang H, Miller HL. NSF DARE-transforming modeling in neurorehabilitation: a patient-in-the-loop framework. J Neuroeng Rehabil 2024; 21:23. [PMID: 38347597 PMCID: PMC10863253 DOI: 10.1186/s12984-024-01318-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Accepted: 01/25/2024] [Indexed: 02/15/2024] Open
Abstract
In 2023, the National Science Foundation (NSF) and the National Institute of Health (NIH) brought together engineers, scientists, and clinicians by sponsoring a conference on computational modelling in neurorehabiilitation. To facilitate multidisciplinary collaborations and improve patient care, in this perspective piece we identify where and how computational modelling can support neurorehabilitation. To address the where, we developed a patient-in-the-loop framework that uses multiple and/or continual measurements to update diagnostic and treatment model parameters, treatment type, and treatment prescription, with the goal of maximizing clinically-relevant functional outcomes. This patient-in-the-loop framework has several key features: (i) it includes diagnostic and treatment models, (ii) it is clinically-grounded with the International Classification of Functioning, Disability and Health (ICF) and patient involvement, (iii) it uses multiple or continual data measurements over time, and (iv) it is applicable to a range of neurological and neurodevelopmental conditions. To address the how, we identify state-of-the-art and highlight promising avenues of future research across the realms of sensorimotor adaptation, neuroplasticity, musculoskeletal, and sensory & pain computational modelling. We also discuss both the importance of and how to perform model validation, as well as challenges to overcome when implementing computational models within a clinical setting. The patient-in-the-loop approach offers a unifying framework to guide multidisciplinary collaboration between computational and clinical stakeholders in the field of neurorehabilitation.
Collapse
Affiliation(s)
- Joshua G A Cashaback
- Biomedical Engineering, Mechanical Engineering, Kinesiology and Applied Physiology, Biome chanics and Movement Science Program, Interdisciplinary Neuroscience Graduate Program, University of Delaware, 540 S College Ave, Newark, DE, 19711, USA.
| | - Jessica L Allen
- Department of Mechanical Engineering, University of Florida, Gainesville, USA
| | | | - David J Lin
- Division of Neurocritical Care and Stroke Service, Department of Neurology, Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital, Harvard Medical School, Boston, USA
- Department of Veterans Affairs, Center for Neurorestoration and Neurotechnology, Rehabilitation Research and Development Service, Providence, USA
| | - Mark A Price
- Department of Mechanical and Industrial Engineering, Department of Kinesiology, University of Massachusetts Amherst, Amherst, USA
| | - Natalija K Secerovic
- School of Electrical Engineering, The Mihajlo Pupin Institute, University of Belgrade, Belgrade, Serbia
- Laboratory for Neuroengineering, Institute for Robotics and Intelligent Systems ETH Zürich, Zurich, Switzerland
| | - Seungmoon Song
- Mechanical and Industrial Engineering, Northeastern University, Boston, USA
| | - Haohan Zhang
- Department of Mechanical Engineering, University of Utah, Salt Lake City, USA
| | - Haylie L Miller
- School of Kinesiology, University of Michigan, 830 N University Ave, Ann Arbor, MI, 48109, USA.
| |
Collapse
|
26
|
Ruescas-Nicolau AV, De Rosario H, Bernabé EP, Juan MC. Positioning errors of anatomical landmarks identified by fixed vertices in homologous meshes. Gait Posture 2024; 108:215-221. [PMID: 38118225 DOI: 10.1016/j.gaitpost.2023.11.024] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 06/21/2023] [Accepted: 11/29/2023] [Indexed: 12/22/2023]
Abstract
BACKGROUND Human movement analysis is usually achieved by tracking markers attached to anatomical landmarks with photogrammetry. Such marker-based systems have disadvantages that have led to the development of markerless procedures, although their accuracy is not usually comparable to that of manual palpation procedures. New motion acquisition systems, such as 3D temporal scanners, provide homologous meshes that can be exploited for this purpose. RESEARCH QUESTION Can fixed vertices of a homologous mesh be used to identify anatomical landmarks with an accuracy equivalent to that of manual palpation? METHODS We used 3165 human shape scans from the CAESAR dataset, with labelled locations of anatomical landmarks. First, we fitted a template mesh to the scans, and assigned a vertex of that mesh to 53 anatomical landmarks in all subjects. Then we defined a nominal vertex for each landmark, as the more centred vertex out of the set assigned for that landmark. We calculated the errors of the template-fitting and the nominal vertex determination procedures, and analysed their relationship to subject's sex, height and body mass index, as well as their size compared to manual palpation errors. RESULTS The template-fitting errors were below 5 mm, and the nominal vertex determination errors reached maximum values of 24 mm. Except for the trochanter, those errors were the same order of magnitude or smaller than inter-examiner errors of lower limb landmarks. Errors increased with height and body mass index, and were smaller for men than for women of the same height and body mass index. SIGNIFICANCE We defined a set of vertices for 53 anatomical landmarks in a homologous mesh, which yields location errors comparable to those obtained by manual palpation for the majority of landmarks. We also quantified how the subject's sex and anthropometric features can affect the size of those errors.
Collapse
Affiliation(s)
- Ana V Ruescas-Nicolau
- Instituto de Biomecánica - IBV. Universitat Politècnica de València, edifici 9C. Camí de Vera, s/n 46022 València, Spain.
| | - Helios De Rosario
- Instituto de Biomecánica - IBV. Universitat Politècnica de València, edifici 9C. Camí de Vera, s/n 46022 València, Spain
| | - Eduardo Parrilla Bernabé
- Instituto de Biomecánica - IBV. Universitat Politècnica de València, edifici 9C. Camí de Vera, s/n 46022 València, Spain
| | - M-Carmen Juan
- Instituto Universitario de Automática e Informática Industrial. Universitat Politècnica de València, edifici 1F. Camí de Vera, s/n 46022 València, Spain
| |
Collapse
|
27
|
Yang J, Park K. Improving Gait Analysis Techniques with Markerless Pose Estimation Based on Smartphone Location. Bioengineering (Basel) 2024; 11:141. [PMID: 38391625 PMCID: PMC10886083 DOI: 10.3390/bioengineering11020141] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Revised: 01/25/2024] [Accepted: 01/29/2024] [Indexed: 02/24/2024] Open
Abstract
Marker-based 3D motion capture systems, widely used for gait analysis, are accurate but have disadvantages such as cost and accessibility. Whereas markerless pose estimation has emerged as a convenient and cost-effective alternative for gait analysis, challenges remain in achieving optimal accuracy. Given the limited research on the effects of camera location and orientation on data collection accuracy, this study investigates how camera placement affects gait assessment accuracy utilizing five smartphones. This study aimed to explore the differences in data collection accuracy between marker-based systems and pose estimation, as well as to assess the impact of camera location and orientation on accuracy in pose estimation. The results showed that the differences in joint angles between pose estimation and marker-based systems are below 5°, an acceptable level for gait analysis, with a strong correlation between the two datasets supporting the effectiveness of pose estimation in gait analysis. In addition, hip and knee angles were accurately measured at the front diagonal of the subject and ankle angle at the lateral side. This research highlights the significance of careful camera placement for reliable gait analysis using pose estimation, serving as a concise reference to guide future efforts in enhancing the quantitative accuracy of gait analysis.
Collapse
Affiliation(s)
- Junhyuk Yang
- Department of Mechatronics Engineering, Incheon National University, Incheon 22012, Republic of Korea
| | - Kiwon Park
- Department of Mechatronics Engineering, Incheon National University, Incheon 22012, Republic of Korea
| |
Collapse
|
28
|
Torvinen P, Ruotsalainen KS, Zhao S, Cronin N, Ohtonen O, Linnamo V. Evaluation of 3D Markerless Motion Capture System Accuracy during Skate Skiing on a Treadmill. Bioengineering (Basel) 2024; 11:136. [PMID: 38391622 PMCID: PMC10886413 DOI: 10.3390/bioengineering11020136] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Revised: 01/23/2024] [Accepted: 01/26/2024] [Indexed: 02/24/2024] Open
Abstract
In this study, we developed a deep learning-based 3D markerless motion capture system for skate skiing on a treadmill and evaluated its accuracy against marker-based motion capture during G1 and G3 skating techniques. Participants performed roller skiing trials on a skiing treadmill. Trials were recorded with two synchronized video cameras (100 Hz). We then trained a custom model using DeepLabCut, and the skiing movements were analyzed using both DeepLabCut-based markerless motion capture and marker-based motion capture systems. We statistically compared joint centers and joint vector angles between the methods. The results demonstrated a high level of agreement for joint vector angles, with mean differences ranging from -2.47° to 3.69°. For joint center positions and toe placements, mean differences ranged from 24.0 to 40.8 mm. This level of accuracy suggests that our markerless approach could be useful as a skiing coaching tool. The method presents interesting opportunities for capturing and extracting value from large amounts of data without the need for markers attached to the skier and expensive cameras.
Collapse
Affiliation(s)
- Petra Torvinen
- Faculty of Sport and Health Sciences, University of Jyväskylä, 88610 Jyväskylä, Finland
| | - Keijo S Ruotsalainen
- Faculty of Sport and Health Sciences, University of Jyväskylä, 88610 Jyväskylä, Finland
| | - Shuang Zhao
- Faculty of Sport and Health Sciences, University of Jyväskylä, 88610 Jyväskylä, Finland
| | - Neil Cronin
- Faculty of Sport and Health Sciences, University of Jyväskylä, 88610 Jyväskylä, Finland
| | - Olli Ohtonen
- Faculty of Sport and Health Sciences, University of Jyväskylä, 88610 Jyväskylä, Finland
| | - Vesa Linnamo
- Faculty of Sport and Health Sciences, University of Jyväskylä, 88610 Jyväskylä, Finland
| |
Collapse
|
29
|
Rhudy MB, Mahoney JM, Altman-Singles AR. Knee Angle Estimation with Dynamic Calibration Using Inertial Measurement Units for Running. SENSORS (BASEL, SWITZERLAND) 2024; 24:695. [PMID: 38276387 PMCID: PMC10819858 DOI: 10.3390/s24020695] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/20/2023] [Revised: 01/17/2024] [Accepted: 01/19/2024] [Indexed: 01/27/2024]
Abstract
The knee flexion angle is an important measurement for studies of the human gait. Running is a common activity with a high risk of knee injury. Studying the running gait in realistic situations is challenging because accurate joint angle measurements typically come from optical motion-capture systems constrained to laboratory settings. This study considers the use of shank and thigh inertial sensors within three different filtering algorithms to estimate the knee flexion angle for running without requiring sensor-to-segment mounting assumptions, body measurements, specific calibration poses, or magnetometers. The objective of this study is to determine the knee flexion angle within running applications using accelerometer and gyroscope information only. Data were collected for a single test participant (21-year-old female) at four different treadmill speeds and used to validate the estimation results for three filter variations with respect to a Vicon optical motion-capture system. The knee flexion angle filtering algorithms resulted in root-mean-square errors of approximately three degrees. The results of this study indicate estimation results that are within acceptable limits of five degrees for clinical gait analysis. Specifically, a complementary filter approach is effective for knee flexion angle estimation in running applications.
Collapse
Affiliation(s)
- Matthew B. Rhudy
- Mechanical Engineering, The Pennsylvania State University, Berks College, Reading, PA 19610, USA
| | - Joseph M. Mahoney
- Mechanical Engineering, Alvernia University, Reading, PA 19607, USA;
| | - Allison R. Altman-Singles
- Mechanical Engineering, The Pennsylvania State University, Berks College, Reading, PA 19610, USA
- Kinesiology, The Pennsylvania State University, Berks College, Reading, PA 19610, USA;
| |
Collapse
|
30
|
Cronin NJ, Walker J, Tucker CB, Nicholson G, Cooke M, Merlino S, Bissas A. Feasibility of OpenPose markerless motion analysis in a real athletics competition. Front Sports Act Living 2024; 5:1298003. [PMID: 38250008 PMCID: PMC10796501 DOI: 10.3389/fspor.2023.1298003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Accepted: 12/14/2023] [Indexed: 01/23/2024] Open
Abstract
This study tested the performance of OpenPose on footage collected by two cameras at 200 Hz from a real-life competitive setting by comparing it with manually analyzed data in SIMI motion. The same take-off recording from the men's Long Jump finals at the 2017 World Athletics Championships was used for both approaches (markerless and manual) to reconstruct the 3D coordinates from each of the camera's 2D coordinates. Joint angle and Centre of Mass (COM) variables during the final step and take-off phase of the jump were determined. Coefficients of Multiple Determinations (CMD) for joint angle waveforms showed large variation between athletes with the knee angle values typically being higher (take-off leg: 0.727 ± 0.242; swing leg: 0.729 ± 0.190) than those for hip (take-off leg: 0.388 ± 0.193; swing leg: 0.370 ± 0.227) and ankle angle (take-off leg: 0.247 ± 0.172; swing leg: 0.155 ± 0.228). COM data also showed considerable variation between athletes and parameters, with position (0.600 ± 0.322) and projection angle (0.658 ± 0.273) waveforms generally showing better agreement than COM velocity (0.217 ± 0.241). Agreement for discrete data was generally poor with high random error for joint kinematics and COM parameters at take-off and an average ICC across variables of 0.17. The poor agreement statistics and a range of unrealistic values returned by the pose estimation underline that OpenPose is not suitable for in-competition performance analysis in events such as the long jump, something that manual analysis still achieves with high levels of accuracy and reliability.
Collapse
Affiliation(s)
- Neil J. Cronin
- Neuromuscular Research Centre, Faculty of Sport and Health Sciences, University of Jyväskylä, Jyväskylä, Finland
- School of Education and Sciences, University of Gloucestershire, Gloucester, United Kingdom
| | - Josh Walker
- Carnegie School of Sport, Leeds Beckett University, Leeds, United Kingdom
| | | | - Gareth Nicholson
- Carnegie School of Sport, Leeds Beckett University, Leeds, United Kingdom
| | - Mark Cooke
- Carnegie School of Sport, Leeds Beckett University, Leeds, United Kingdom
| | - Stéphane Merlino
- International Relations and Development Department, World Athletics, Monaco, Monaco
| | - Athanassios Bissas
- School of Education and Sciences, University of Gloucestershire, Gloucester, United Kingdom
- Carnegie School of Sport, Leeds Beckett University, Leeds, United Kingdom
| |
Collapse
|
31
|
Auer S, Süß F, Dendorfer S. Using markerless motion capture and musculoskeletal models: An evaluation of joint kinematics. Technol Health Care 2024; 32:3433-3442. [PMID: 38905067 DOI: 10.3233/thc-240202] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/23/2024]
Abstract
BACKGROUND This study presents a comprehensive comparison between a marker-based motion capture system (MMC) and a video-based motion capture system (VMC) in the context of kinematic analysis using musculoskeletal models. OBJECTIVE Focusing on joint angles, the study aimed to evaluate the accuracy of VMC as a viable alternative for biomechanical research. METHODS Eighteen healthy subjects performed isolated movements with 17 joint degrees of freedom, and their kinematic data were collected using both an MMC and a VMC setup. The kinematic data were entered into the AnyBody Modelling System, which enables the calculation of joint angles. The mean absolute error (MAE) was calculated to quantify the deviations between the two systems. RESULTS The results showed good agreement between VMC and MMC at several joint angles. In particular, the shoulder, hip and knee joints showed small deviations in kinematics with MAE values of 4.8∘, 6.8∘ and 3.5∘, respectively. However, the study revealed problems in tracking hand and elbow movements, resulting in higher MAE values of 13.7∘ and 27.7∘. Deviations were also higher for head and thoracic movements. CONCLUSION Overall, VMC showed promising results for lower body and shoulder kinematics. However, the tracking of the wrist and pelvis still needs to be refined. The research results provide a basis for further investigations that promote the fusion of VMC and musculoskeletal models.
Collapse
Affiliation(s)
- Simon Auer
- Laboratory for Biomechanics, Ostbayerische Technische Hochschule Regensburg, Regensburg, Germany
| | - Franz Süß
- Laboratory for Biomechanics, Ostbayerische Technische Hochschule Regensburg, Regensburg, Germany
- Regensburg Center of Biomedical Engineering, Ostbayerische Technische Hochschule and University Regensburg, Germany
| | - Sebastian Dendorfer
- Laboratory for Biomechanics, Ostbayerische Technische Hochschule Regensburg, Regensburg, Germany
- Regensburg Center of Biomedical Engineering, Ostbayerische Technische Hochschule and University Regensburg, Germany
| |
Collapse
|
32
|
Trovato B, Roggio F, Sortino M, Rapisarda L, Petrigna L, Musumeci G. Thermal profile classification of the back of sportive and sedentary healthy individuals. J Therm Biol 2023; 118:103751. [PMID: 38000144 DOI: 10.1016/j.jtherbio.2023.103751] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2023] [Revised: 10/30/2023] [Accepted: 11/01/2023] [Indexed: 11/26/2023]
Abstract
BACKGROUND Infrared thermography (IRT) is a non-harmful, risk-free imaging technique and it has application for healthy and pathological population. OBJECTIVE The aim of this study is to evaluate the thermographic profiles of the back of sport practitioners from different disciplines and compare it with those of sedentary healthy individuals. METHOD The back of 160 healthy subjects were evaluated, and participants were grouped considering their sport practice: team sport (TS), individual sport (IS), weight training (WT), inactive (I). Three regions of interest were identified to analyze the cervical, thoracic and lumbar temperatures of the back. RESULTS The Multivariate analysis of variance (MANOVA) resulted significant showing statistical differences for the cervical (p < 0.001), dorsal (p = 0.0011), and lumbar areas (p = 0.0366). The Tukey post-hoc test for pairwise comparison showed statistically significant differences between groups. For the cervical area significance was found between the IN and WT group (p = 0.002), the IN and IS group (p < 0.001), IN and TS group (p = 0.020). The dorsal area resulted significant between the IN and WT group (p = 0.007), the IN and IS group (p < 0.001), IN and TS group. The lumbar area showed significant differences only between the IN and WT group and the IN and IS group (p = 0.043). CONCLUSION This study demonstrated that inactive individuals manifest a statistically significant higher temperature in the cervical, dorsal and lumbar area of the back compared to sportive individuals.
Collapse
Affiliation(s)
- Bruno Trovato
- Department of Biomedical and Biotechnological Sciences, Section of Anatomy, Histology and Movement Science, School of Medicine, University of Catania, Via S. Sofia n°97, 95123, Catania, Italy
| | - Federico Roggio
- Department of Biomedical and Biotechnological Sciences, Section of Anatomy, Histology and Movement Science, School of Medicine, University of Catania, Via S. Sofia n°97, 95123, Catania, Italy; Sport and Exercise Sciences Research Unit, Department of Psychology, Educational Science and Human Movement, University of Palermo, Via Giovanni Pascoli 6, Palermo, 90144, Italy
| | - Martina Sortino
- Department of Biomedical and Biotechnological Sciences, Section of Anatomy, Histology and Movement Science, School of Medicine, University of Catania, Via S. Sofia n°97, 95123, Catania, Italy
| | | | - Luca Petrigna
- Department of Biomedical and Biotechnological Sciences, Section of Anatomy, Histology and Movement Science, School of Medicine, University of Catania, Via S. Sofia n°97, 95123, Catania, Italy.
| | - Giuseppe Musumeci
- Department of Biomedical and Biotechnological Sciences, Section of Anatomy, Histology and Movement Science, School of Medicine, University of Catania, Via S. Sofia n°97, 95123, Catania, Italy; Research Center on Motor Activities (CRAM), University of Catania, Via S. Sofia n°97, 95123, Catania, Italy; Department of Biology, Sbarro Institute for Cancer Research and Molecular Medicine, College of Science and Technology, Temple University, Philadelphia, 19122, PA, United States
| |
Collapse
|
33
|
Angelini L, Terranova R, Lazzeri G, van den Berg KRE, Dirkx MF, Paparella G. The role of laboratory investigations in the classification of tremors. Neurol Sci 2023; 44:4183-4192. [PMID: 37814130 PMCID: PMC10641063 DOI: 10.1007/s10072-023-07108-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2023] [Accepted: 09/28/2023] [Indexed: 10/11/2023]
Abstract
INTRODUCTION Tremor is the most common movement disorder. Although clinical examination plays a significant role in evaluating patients with tremor, laboratory tests are useful to classify tremors according to the recent two-axis approach proposed by the International Parkinson and Movement Disorders Society. METHODS In the present review, we will discuss the usefulness and applicability of the various diagnostic methods in classifying and diagnosing tremors. We will evaluate a number of techniques, including laboratory and genetic tests, neurophysiology, and neuroimaging. The role of newly introduced innovative tremor assessment methods will also be discussed. RESULTS Neurophysiology plays a crucial role in tremor definition and classification, and it can be useful for the identification of specific tremor syndromes. Laboratory and genetic tests and neuroimaging may be of paramount importance in identifying specific etiologies. Highly promising innovative technologies are being developed for both clinical and research purposes. CONCLUSIONS Overall, laboratory investigations may support clinicians in the diagnostic process of tremor. Also, combining data from different techniques can help improve understanding of the pathophysiological bases underlying tremors and guide therapeutic management.
Collapse
Affiliation(s)
- Luca Angelini
- Department of Human Neurosciences, Sapienza University of Rome, Viale Dell'Università 30, 00185, Rome, Italy.
| | - Roberta Terranova
- Department of Medical, Surgical Sciences and Advanced Technologies "GF Ingrassia," University of Catania, Catania, Italy
| | - Giulia Lazzeri
- IRCCS Ca' Granda Ospedale Maggiore Policlinico, Neurology Unit, Milan, Italy
| | - Kevin R E van den Berg
- Centre for Cognitive Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
- Department of Neurology, Center of Expertise for Parkinson and Movement Disorders, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Centre, Nijmegen, The Netherlands
| | - Michiel F Dirkx
- Centre for Cognitive Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
- Department of Neurology, Center of Expertise for Parkinson and Movement Disorders, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Centre, Nijmegen, The Netherlands
| | - Giulia Paparella
- Department of Human Neurosciences, Sapienza University of Rome, Viale Dell'Università 30, 00185, Rome, Italy
- IRCCS Neuromed, Pozzilli (IS), Italy
| |
Collapse
|
34
|
Werling K, Bianco NA, Raitor M, Stingel J, Hicks JL, Collins SH, Delp SL, Liu CK. AddBiomechanics: Automating model scaling, inverse kinematics, and inverse dynamics from human motion data through sequential optimization. PLoS One 2023; 18:e0295152. [PMID: 38033114 PMCID: PMC10688959 DOI: 10.1371/journal.pone.0295152] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Accepted: 11/14/2023] [Indexed: 12/02/2023] Open
Abstract
Creating large-scale public datasets of human motion biomechanics could unlock data-driven breakthroughs in our understanding of human motion, neuromuscular diseases, and assistive devices. However, the manual effort currently required to process motion capture data and quantify the kinematics and dynamics of movement is costly and limits the collection and sharing of large-scale biomechanical datasets. We present a method, called AddBiomechanics, to automate and standardize the quantification of human movement dynamics from motion capture data. We use linear methods followed by a non-convex bilevel optimization to scale the body segments of a musculoskeletal model, register the locations of optical markers placed on an experimental subject to the markers on a musculoskeletal model, and compute body segment kinematics given trajectories of experimental markers during a motion. We then apply a linear method followed by another non-convex optimization to find body segment masses and fine tune kinematics to minimize residual forces given corresponding trajectories of ground reaction forces. The optimization approach requires approximately 3-5 minutes to determine a subject's skeleton dimensions and motion kinematics, and less than 30 minutes of computation to also determine dynamically consistent skeleton inertia properties and fine-tuned kinematics and kinetics, compared with about one day of manual work for a human expert. We used AddBiomechanics to automatically reconstruct joint angle and torque trajectories from previously published multi-activity datasets, achieving close correspondence to expert-calculated values, marker root-mean-square errors less than 2 cm, and residual force magnitudes smaller than 2% of peak external force. Finally, we confirmed that AddBiomechanics accurately reproduced joint kinematics and kinetics from synthetic walking data with low marker error and residual loads. We have published the algorithm as an open source cloud service at AddBiomechanics.org, which is available at no cost and asks that users agree to share processed and de-identified data with the community. As of this writing, hundreds of researchers have used the prototype tool to process and share about ten thousand motion files from about one thousand experimental subjects. Reducing the barriers to processing and sharing high-quality human motion biomechanics data will enable more people to use state-of-the-art biomechanical analysis, do so at lower cost, and share larger and more accurate datasets.
Collapse
Affiliation(s)
- Keenon Werling
- Department of Computer Science, Stanford University, Stanford, California, United States of America
| | - Nicholas A. Bianco
- Department of Mechanical Engineering, Stanford University, Stanford, California, United States of America
| | - Michael Raitor
- Department of Mechanical Engineering, Stanford University, Stanford, California, United States of America
| | - Jon Stingel
- Department of Mechanical Engineering, Stanford University, Stanford, California, United States of America
| | - Jennifer L. Hicks
- Department of Bioengineering, Stanford University, Stanford, California, United States of America
| | - Steven H. Collins
- Department of Mechanical Engineering, Stanford University, Stanford, California, United States of America
| | - Scott L. Delp
- Department of Mechanical Engineering, Stanford University, Stanford, California, United States of America
- Department of Bioengineering, Stanford University, Stanford, California, United States of America
| | - C. Karen Liu
- Department of Computer Science, Stanford University, Stanford, California, United States of America
| |
Collapse
|
35
|
Wade L, Needham L, Evans M, McGuigan P, Colyer S, Cosker D, Bilzon J. Examination of 2D frontal and sagittal markerless motion capture: Implications for markerless applications. PLoS One 2023; 18:e0293917. [PMID: 37943887 PMCID: PMC10635560 DOI: 10.1371/journal.pone.0293917] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Accepted: 10/21/2023] [Indexed: 11/12/2023] Open
Abstract
This study examined if occluded joint locations, obtained from 2D markerless motion capture (single camera view), produced 2D joint angles with reduced agreement compared to visible joints, and if 2D frontal plane joint angles were usable for practical applications. Fifteen healthy participants performed over-ground walking whilst recorded by fifteen marker-based cameras and two machine vision cameras (frontal and sagittal plane). Repeated measures Bland-Altman analysis illustrated that markerless standard deviation of bias and limits of agreement for the occluded-side hip and knee joint angles in the sagittal plane were double that of the camera-side (visible) hip and knee. Camera-side sagittal plane knee and hip angles were near or within marker-based error values previously observed. While frontal plane limits of agreement accounted for 35-46% of total range of motion at the hip and knee, Bland-Altman bias and limits of agreement (-4.6-1.6 ± 3.7-4.2˚) were actually similar to previously reported marker-based error values. This was not true for the ankle, where the limits of agreement (± 12˚) were still too high for practical applications. Our results add to previous literature, highlighting shortcomings of current pose estimation algorithms and labelled datasets. As such, this paper finishes by reviewing methods for creating anatomically accurate markerless training data using marker-based motion capture data.
Collapse
Affiliation(s)
- Logan Wade
- Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, United Kingdom
| | - Laurie Needham
- Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, United Kingdom
| | - Murray Evans
- Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, United Kingdom
| | - Polly McGuigan
- Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, United Kingdom
| | - Steffi Colyer
- Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, United Kingdom
| | - Darren Cosker
- Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, United Kingdom
| | - James Bilzon
- Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, United Kingdom
| |
Collapse
|
36
|
Shin S, Li Z, Halilaj E. Markerless Motion Tracking With Noisy Video and IMU Data. IEEE Trans Biomed Eng 2023; 70:3082-3092. [PMID: 37171931 DOI: 10.1109/tbme.2023.3275775] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
OBJECTIVE Marker-based motion capture, considered the gold standard in human motion analysis, is expensive and requires trained personnel. Advances in inertial sensing and computer vision offer new opportunities to obtain research-grade assessments in clinics and natural environments. A challenge that discourages clinical adoption, however, is the need for careful sensor-to-body alignment, which slows the data collection process in clinics and is prone to errors when patients take the sensors home. METHODS We propose deep learning models to estimate human movement with noisy data from videos (VideoNet), inertial sensors (IMUNet), and a combination of the two (FusionNet), obviating the need for careful calibration. The video and inertial sensing data used to train the models were generated synthetically from a marker-based motion capture dataset of a broad range of activities and augmented to account for sensor-misplacement and camera-occlusion errors. The models were tested using real data that included walking, jogging, squatting, sit-to-stand, and other activities. RESULTS On calibrated data, IMUNet was as accurate as state-of-the-art models, while VideoNet and FusionNet reduced mean ± std root-mean-squared errors by 7.6 ± 5.4 ° and 5.9 ± 3.3 °, respectively. Importantly, all the newly proposed models were less sensitive to noise than existing approaches, reducing errors by up to 14.0 ± 5.3 ° for sensor-misplacement errors of up to 30.0 ± 13.7 ° and by up to 7.4 ± 5.5 ° for joint-center-estimation errors of up to 101.1 ± 11.2 mm, across joints. CONCLUSION These tools offer clinicians and patients the opportunity to estimate movement with research-grade accuracy, without the need for time-consuming calibration steps or the high costs associated with commercial products such as Theia3D or Xsens, helping democratize the diagnosis, prognosis, and treatment of neuromusculoskeletal conditions.
Collapse
|
37
|
Harrington MS, Adeyinka IC, Burkhart TA. Intrarater and Interrater Reliability and Agreement of a Method to Quantify Lower-Extremity Kinematics Using Remote Data Collection. J Sport Rehabil 2023; 32:894-902. [PMID: 37643758 DOI: 10.1123/jsr.2022-0453] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Revised: 06/02/2023] [Accepted: 07/10/2023] [Indexed: 08/31/2023]
Abstract
CONTEXT To assess the reliability of a remote 2D markerless motion tracking method (Kinovea) to quantify knee and hip angles during dynamic tasks. METHODS Fourteen healthy adults performed body weight squats and lateral lunges while video recording themselves at home. Knee and hip angles were quantified in the sagittal plane for the squats and in the frontal plane for the lateral lunges. Two students each performed the video analysis procedure twice, 2 weeks apart. Intraclass correlation coefficients were used to calculate the intrarater and interrater reliability for angles at maximum depth. The intrarater and interrater agreement over the joint angle-time signals were quantified using a validation metric; an acceptable agreement threshold was set at a validation metric of 0.803 or higher. Standard error of measurement (SEM) was also calculated. RESULTS Reliability was good to excellent (intraclass correlation coefficients = .80-.98) for all angle comparisons at maximum depth. The agreement over the entire joint angle-time signal was acceptable for all squat variables except for the interrater hip angle comparison (validation metric = 0.797). None of the lateral lunge variables met the threshold of acceptable agreement. The mean SEM across participants for all joint angle-time signal and for maximum depth was acceptable (<5°) for all measurements (SEM = 1.2°-4.9°). CONCLUSIONS Overall, the reliability, agreement, and SEM quantified in this study support the integration of remote methods to quantify lower-extremity kinematics into research and clinical practice.
Collapse
Affiliation(s)
- Margaret S Harrington
- Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, ON, Canada
| | - Ikeade C Adeyinka
- Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, ON, Canada
| | - Timothy A Burkhart
- Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
38
|
Maillard T. The Three-Dimensional Body Center of Mass at the Workplace under Hypogravity. Bioengineering (Basel) 2023; 10:1221. [PMID: 37892951 PMCID: PMC10604834 DOI: 10.3390/bioengineering10101221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Revised: 10/12/2023] [Accepted: 10/17/2023] [Indexed: 10/29/2023] Open
Abstract
The center of mass dynamics of the seated posture of humans in a work environment under hypogravity (0 < g < 1) have rarely been investigated, and such research is yet to be carried out. The present study determined the difference in the body system of 32 participants working under simulated 1/6 g (Moon) and 1 g (Earth) for comparison using static and dynamic task measurements. This was based on a markerless motion capture method that analyzed participants' center of mass at the start, middle and end of the task when they began to get fatigued. According to this analysis, there is a positive relationship (p < 0.01) with a positive coefficient of correlation between the downward center of mass body shift along the proximodistal axis and gravity level for males and females. At the same time, the same positive relationship (p < 0.01) between the tilt of the body backward along the anterior-posterior axis and the level of gravity was found only in females. This offers fresh perspectives for comprehending hypogravity in a broader framework regarding its impact on musculoskeletal disorders. It can also improve workplace ergonomics, body stability, equipment design, and biomechanics.
Collapse
Affiliation(s)
- Tatiana Maillard
- Space Innovation, Swiss Federal Institute of Technology in Lausanne, 1015 Lausanne, Switzerland
| |
Collapse
|
39
|
Chellapurath M, Khandelwal PC, Schulz AK. Bioinspired robots can foster nature conservation. Front Robot AI 2023; 10:1145798. [PMID: 37920863 PMCID: PMC10619165 DOI: 10.3389/frobt.2023.1145798] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2023] [Accepted: 09/25/2023] [Indexed: 11/04/2023] Open
Abstract
We live in a time of unprecedented scientific and human progress while being increasingly aware of its negative impacts on our planet's health. Aerial, terrestrial, and aquatic ecosystems have significantly declined putting us on course to a sixth mass extinction event. Nonetheless, the advances made in science, engineering, and technology have given us the opportunity to reverse some of our ecosystem damage and preserve them through conservation efforts around the world. However, current conservation efforts are primarily human led with assistance from conventional robotic systems which limit their scope and effectiveness, along with negatively impacting the surroundings. In this perspective, we present the field of bioinspired robotics to develop versatile agents for future conservation efforts that can operate in the natural environment while minimizing the disturbance/impact to its inhabitants and the environment's natural state. We provide an operational and environmental framework that should be considered while developing bioinspired robots for conservation. These considerations go beyond addressing the challenges of human-led conservation efforts and leverage the advancements in the field of materials, intelligence, and energy harvesting, to make bioinspired robots move and sense like animals. In doing so, it makes bioinspired robots an attractive, non-invasive, sustainable, and effective conservation tool for exploration, data collection, intervention, and maintenance tasks. Finally, we discuss the development of bioinspired robots in the context of collaboration, practicality, and applicability that would ensure their further development and widespread use to protect and preserve our natural world.
Collapse
Affiliation(s)
- Mrudul Chellapurath
- Max Planck Institute for Intelligent Systems, Stuttgart, Germany
- KTH Royal Institute of Technology, Stockholm, Sweden
| | - Pranav C. Khandelwal
- Max Planck Institute for Intelligent Systems, Stuttgart, Germany
- Institute of Flight Mechanics and Controls, University of Stuttgart, Stuttgart, Germany
| | - Andrew K. Schulz
- Max Planck Institute for Intelligent Systems, Stuttgart, Germany
| |
Collapse
|
40
|
Maillard T. Hypogravity modeling of upper extremities: an investigation of manual handling in the workplace. Front Physiol 2023; 14:1198162. [PMID: 37854467 PMCID: PMC10580979 DOI: 10.3389/fphys.2023.1198162] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Accepted: 08/29/2023] [Indexed: 10/20/2023] Open
Abstract
Experiments on the lower limbs are the only approaches being used to study how hypogravity (HG) (0 < g < 1, e.g., Moon: 1/6 g, Mars: 3/8 g) affects human movement. The goal of this study was to expand this field experimentally by investigating the effect of HG on the upper extremities during one-handed manual handling tasks in a sitting posture: static weight holding with an outstretched arm, and slow repetitive weight lifting and lowering motions. The hypothesis was that while completing static and dynamic tasks with elements of repetition in HG, the upper body's tilt (angle regarding the vertical axis) would change differently from Earth's gravity. Specifically, upper arm and spine angles, joint torques, and forces were investigated. Twenty-four healthy participants aged 33.6 ± 8.2 years were involved in the trial. Joint angles were examined using vision-based 3D motion analysis. According to this investigation, there is a correlation between a body tilting backward and a gravity level reduction (p < 0.01). Thus, HG causes postural deviation, and this shows that workplace design must be adapted according to the level of gravity to promote comfortable and balanced body alignment, minimizing stress on muscles and joints. To lower the risk of musculoskeletal disorders (MSDs), enhance overall performance, and increase job satisfaction, proper support systems and restrictions for sitting positions should be taken into account, concerning different levels of gravity.
Collapse
Affiliation(s)
- Tatiana Maillard
- Space Innovation, Doctoral Program in Civil and Environmental Engineering, Swiss Federal Institute of Technology in Lausanne, Lausanne, Switzerland
| |
Collapse
|
41
|
Zarro M, Dickman M, Hulett T, Rowland R, Larkins D, Taylor J, Nelson C. Hop to It! The Relationship Between Hop Tests and The Anterior Cruciate Ligament - Return to Sport Index After Anterior Cruciate Ligament Reconstruction in NCAA Division 1 Collegiate Athletes. Int J Sports Phys Ther 2023; 18:1076-1084. [PMID: 37795334 PMCID: PMC10547069 DOI: 10.26603/001c.86130] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Accepted: 08/05/2023] [Indexed: 10/06/2023] Open
Abstract
Background Outcomes after anterior cruciate ligament reconstruction (ACLR) may not be optimal, with poor physical and psychological function potentially affecting return to sport (RTS) ability. Understanding the relationship between commonly used hop tests and the Anterior Cruciate Ligament - Return to Sport Index (ACL-RSI) may improve rehabilitation strategies and optimize patient outcomes. Hypothesis/Purpose The purpose of this study was to examine the relationship between ACL-RSI scores and limb symmetry index (LSI) for the single hop for distance (SHD), triple hop for distance (THD), crossover hop for distance (CHD), timed 6-meter hop (T6H), and single leg vertical hop (SLVH) in a cohort of National Collegiate Athletic Association (NCAA) Division 1 collegiate athletes after ACLR. The hypothesis was that SLVH LSI would be more highly correlated with ACL-RSI score than all horizontal hop tests. Study design Cross-Sectional Study. Methods Twenty-one National Collegiate Athletic Association (NCAA) Division 1 collegiate athletes (7 males, 14 females) at 6.62 ± 1.69 months after ACLR were included in this retrospective study. Primary outcomes were ACL-RSI score and LSI for SHD, THD, CHD, T6H, and SLVH. The relationship between ACL-RSI scores and performance on hop tests (LSIs) was evaluated using correlation analysis and step-wise linear regression (p ≤ 0.05). Results There were significant correlations found when comparing ACL-RSI and the LSI for SHD (rs = 0.704, p < 0.001), THD (rs = 0.617, p = 0.003), CHD (rs = 0.580, p = 0.006), and SLVH (rs = 0.582, p = 0.006). The CHD explained 66% (R2 value of 0.660) of the variance in the ACL-RSI, while the other hop tests did not add to the predictive model. Conclusions Physical function has the capacity to influence psychological status after ACLR. Clinicians should recognize that SLVH, SHD, THD, and CHD are correlated with ACL-RSI and improvements in physical function during rehabilitation may improve psychological status and optimize RTS after ACLR. Level of evidence Level 3.
Collapse
Affiliation(s)
- Michael Zarro
- Physical Therapy and Rehabilitation Science University of Maryland, Baltimore
- Orthopaedics University of Maryland, Baltimore
| | - Madelyn Dickman
- Physical Therapy and Rehabilitation Science University of Maryland, Baltimore
| | - Timothy Hulett
- Physical Therapy and Rehabilitation Science University of Maryland, Baltimore
| | - Robert Rowland
- Physical Therapy and Rehabilitation Science University of Maryland, Baltimore
- Orthopaedics University of Maryland, Baltimore
| | - Derrick Larkins
- Physical Therapy and Rehabilitation Science University of Maryland, Baltimore
| | | | | |
Collapse
|
42
|
Uhlrich SD, Falisse A, Kidziński Ł, Muccini J, Ko M, Chaudhari AS, Hicks JL, Delp SL. OpenCap: Human movement dynamics from smartphone videos. PLoS Comput Biol 2023; 19:e1011462. [PMID: 37856442 PMCID: PMC10586693 DOI: 10.1371/journal.pcbi.1011462] [Citation(s) in RCA: 27] [Impact Index Per Article: 27.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Accepted: 08/24/2023] [Indexed: 10/21/2023] Open
Abstract
Measures of human movement dynamics can predict outcomes like injury risk or musculoskeletal disease progression. However, these measures are rarely quantified in large-scale research studies or clinical practice due to the prohibitive cost, time, and expertise required. Here we present and validate OpenCap, an open-source platform for computing both the kinematics (i.e., motion) and dynamics (i.e., forces) of human movement using videos captured from two or more smartphones. OpenCap leverages pose estimation algorithms to identify body landmarks from videos; deep learning and biomechanical models to estimate three-dimensional kinematics; and physics-based simulations to estimate muscle activations and musculoskeletal dynamics. OpenCap's web application enables users to collect synchronous videos and visualize movement data that is automatically processed in the cloud, thereby eliminating the need for specialized hardware, software, and expertise. We show that OpenCap accurately predicts dynamic measures, like muscle activations, joint loads, and joint moments, which can be used to screen for disease risk, evaluate intervention efficacy, assess between-group movement differences, and inform rehabilitation decisions. Additionally, we demonstrate OpenCap's practical utility through a 100-subject field study, where a clinician using OpenCap estimated musculoskeletal dynamics 25 times faster than a laboratory-based approach at less than 1% of the cost. By democratizing access to human movement analysis, OpenCap can accelerate the incorporation of biomechanical metrics into large-scale research studies, clinical trials, and clinical practice.
Collapse
Affiliation(s)
- Scott D. Uhlrich
- Departments of Bioengineering, Stanford University, Stanford, California, United States of America
| | - Antoine Falisse
- Departments of Bioengineering, Stanford University, Stanford, California, United States of America
| | - Łukasz Kidziński
- Departments of Bioengineering, Stanford University, Stanford, California, United States of America
| | - Julie Muccini
- Radiology, Stanford University, Stanford, California, United States of America
| | - Michael Ko
- Radiology, Stanford University, Stanford, California, United States of America
| | - Akshay S. Chaudhari
- Radiology, Stanford University, Stanford, California, United States of America
- Biomedical Data Science, Stanford University, Stanford, California, United States of America
| | - Jennifer L. Hicks
- Departments of Bioengineering, Stanford University, Stanford, California, United States of America
| | - Scott L. Delp
- Departments of Bioengineering, Stanford University, Stanford, California, United States of America
- Mechanical Engineering, Stanford University, Stanford, California, United States of America
- Orthopaedic Surgery, Stanford University, Stanford, California, United States of America
| |
Collapse
|
43
|
Ripic Z, Nienhuis M, Signorile JF, Best TM, Jacobs KA, Eltoukhy M. A comparison of three-dimensional kinematics between markerless and marker-based motion capture in overground gait. J Biomech 2023; 159:111793. [PMID: 37725886 DOI: 10.1016/j.jbiomech.2023.111793] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2023] [Revised: 07/20/2023] [Accepted: 09/04/2023] [Indexed: 09/21/2023]
Abstract
Vision-based methods using RGB inputs for human pose estimation have grown in recent years but have undergone limited testing in clinical and biomechanics research areas like gait analysis. The purpose of the present study was to compare lower extremity kinematics during overground gait between a traditional marker-based approach and a commercial multi-view markerless system in a sample of subjects including young adults, older adults, and adults diagnosed with Parkinson's disease. A convenience sample of 35 adults between the age of 18-85 years were included in this study, yielding a total of 114 trials and 228 gait cycles that were compared between systems. A total of 30 time normalized waveforms, including three-dimensional joint centers, segment angles, and joint angles were compared between systems using root mean-squared error (RMSE), range of motion difference (ΔROM), Pearson correlation coefficients (r), and interclass correlation coefficients (ICC). RMSEs for joint center positions were less than 28 mm in all joints with correlations indicating good to excellent agreement. RMSEs for segment and joint angles were in range of previous results, with highest agreement between systems in the sagittal plane. ΔROM differences were within reference values that characterize clinical groups like Parkinson's disease, stroke, or knee osteoarthritis. Further improvements in pelvis tracking, markerless keypoint model definitions, and standardization of comparison study protocols are needed. Nevertheless, markerless solutions seem promising toward unrestricted motion analysis in biomechanics research and clinical settings.
Collapse
Affiliation(s)
- Zachary Ripic
- Department of Kinesiology and Sport Sciences, University of Miami, Miami, FL, United States; Sports Medicine Institute, University of Miami Miller School of Medicine, Miami, FL, United States
| | - Mitch Nienhuis
- Department of Kinesiology and Sport Sciences, University of Miami, Miami, FL, United States
| | - Joseph F Signorile
- Department of Kinesiology and Sport Sciences, University of Miami, Miami, FL, United States; Center on Aging, University of Miami Miller School of Medicine, Miami, FL, United States
| | - Thomas M Best
- Sports Medicine Institute, University of Miami Miller School of Medicine, Miami, FL, United States; Department of Orthopaedics, University of Miami Miller School of Medicine, Miami, FL, United States
| | - Kevin A Jacobs
- Department of Kinesiology and Sport Sciences, University of Miami, Miami, FL, United States
| | - Moataz Eltoukhy
- Department of Kinesiology and Sport Sciences, University of Miami, Miami, FL, United States; Department of Physical Therapy, University of Miami Miller School of Medicine, Miami, FL, United States; Department of Industrial and Systems Engineering, University of Miami, Miami, FL, United States.
| |
Collapse
|
44
|
Horsak B, Eichmann A, Lauer K, Prock K, Krondorfer P, Siragy T, Dumphart B. Concurrent validity of smartphone-based markerless motion capturing to quantify lower-limb joint kinematics in healthy and pathological gait. J Biomech 2023; 159:111801. [PMID: 37738945 DOI: 10.1016/j.jbiomech.2023.111801] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Revised: 08/24/2023] [Accepted: 09/12/2023] [Indexed: 09/24/2023]
Abstract
Markerless motion capturing has the potential to provide a low-cost and accessible alternative to traditional marker-based systems for real-world biomechanical assessment. However, before these systems can be put into practice, we need to rigorously evaluate their accuracy in estimating joint kinematics for various gait patterns. This study evaluated the accuracy of a low-cost, open-source, and smartphone-based markerless motion capture system, namely OpenCap, for measuring 3D joint kinematics in healthy and pathological gait compared to a marker-based system. 21 healthy volunteers were instructed to walk with four different gait patterns: physiological, crouch, circumduction, and equinus gait. Three-dimensional kinematic data were simultaneously recorded using the markerless and a marker-based motion capture system. The root mean square error (RMSE) and the peak error were calculated between every joint kinematic variable obtained by both systems. We found an overall RMSE of 5.8 (SD: 1.8 degrees) and a peak error of 11.3 degrees (SD: 3.9). A repeated measures ANOVA with post hoc tests indicated significant differences in RMSE and peak errors between the four gait patterns (p ¡ 0.05). Physiological gait presented the lowest, crouch and circumduction gait the highest errors. Our findings indicate a roughly comparable accuracy to IMU-based approaches and commercial markerless multi-camera solutions. However, errors are still above clinically desirable thresholds of two to five degrees. While our findings highlight the potential of markerless systems for assessing gait kinematics, they also underpin the need to further improve the underlying deep learning algorithms to make markerless pose estimation a valuable tool in clinical settings.
Collapse
Affiliation(s)
- Brian Horsak
- Center for Digital Health and Social Innovation, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria; Institute of Health Sciences, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria.
| | - Anna Eichmann
- Study Program Gait Analysis and Rehabilitation, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria
| | - Kerstin Lauer
- Study Program Gait Analysis and Rehabilitation, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria
| | - Kerstin Prock
- Center for Digital Health and Social Innovation, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria
| | - Philipp Krondorfer
- Center for Digital Health and Social Innovation, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria
| | - Tarique Siragy
- Center for Digital Health and Social Innovation, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria
| | - Bernhard Dumphart
- Center for Digital Health and Social Innovation, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria; Institute of Health Sciences, St. Pölten University of Applied Sciences, Campus-Platz 1, St. Pölten, 3100, Austria
| |
Collapse
|
45
|
Inai T, Takabayashi T. Lower-limb sagittal joint angles during gait can be predicted based on foot acceleration and angular velocity. PeerJ 2023; 11:e16131. [PMID: 37744216 PMCID: PMC10512936 DOI: 10.7717/peerj.16131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Accepted: 08/28/2023] [Indexed: 09/26/2023] Open
Abstract
Background and purpose Continuous monitoring of lower-limb movement may help in the early detection and control/reduction of diseases (such as the progression of orthopedic diseases) by applying suitable interventions. Therefore, it is invaluable to calculate the lower-limb movement (sagittal joint angles) while walking daily for continuous evaluation of such risks. Although cameras in a motion capture system are necessary for calculating lower-limb sagittal joint angles during gait, the method is unrealistic considering the setting is difficult to achieve in daily life. Therefore, the estimation of lower-limb sagittal joint angles during walking based on variables, which can be measured using wearable sensors (e.g., foot acceleration and angular velocity), is important. This study estimates the lower-limb sagittal joint angles during gait from the norms of foot acceleration and angular velocity using machine learning and validates the accuracy of the estimated joint angles with those obtained using a motion capture system. Methods Healthy adults (n = 200) were asked to walk at a comfortable speed (10 trials), and their lower-limb sagittal joint angles, foot accelerations, and angular velocities were obtained. Using these variables, we established a feedforward neural network and estimated the lower-limb sagittal joint angles. Results The average root mean squared errors of the lower-limb sagittal joint angles during gait ranged between 2.5°-7.0° (hip: 7.0°; knee: 4.0°; and ankle: 2.5°). Conclusion These results show that we can estimate the lower-limb sagittal joint angles during gait using only the norms of foot acceleration and angular velocity, which can help calculate the lower-limb sagittal joint angles during daily walking.
Collapse
Affiliation(s)
- Takuma Inai
- National Institute of Advanced Industrial Science and Technology, Takamatsu City, Japan
| | | |
Collapse
|
46
|
Werling K, Bianco NA, Raitor M, Stingel J, Hicks JL, Collins SH, Delp SL, Liu CK. AddBiomechanics: Automating model scaling, inverse kinematics, and inverse dynamics from human motion data through sequential optimization. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.06.15.545116. [PMID: 37398034 PMCID: PMC10312696 DOI: 10.1101/2023.06.15.545116] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/04/2023]
Abstract
Creating large-scale public datasets of human motion biomechanics could unlock data-driven breakthroughs in our understanding of human motion, neuromuscular diseases, and assistive devices. However, the manual effort currently required to process motion capture data and quantify the kinematics and dynamics of movement is costly and limits the collection and sharing of large-scale biomechanical datasets. We present a method, called AddBiomechanics, to automate and standardize the quantification of human movement dynamics from motion capture data. We use linear methods followed by a non-convex bilevel optimization to scale the body segments of a musculoskeletal model, register the locations of optical markers placed on an experimental subject to the markers on a musculoskeletal model, and compute body segment kinematics given trajectories of experimental markers during a motion. We then apply a linear method followed by another non-convex optimization to find body segment masses and fine tune kinematics to minimize residual forces given corresponding trajectories of ground reaction forces. The optimization approach requires approximately 3-5 minutes to determine a subjecťs skeleton dimensions and motion kinematics, and less than 30 minutes of computation to also determine dynamically consistent skeleton inertia properties and fine-tuned kinematics and kinetics, compared with about one day of manual work for a human expert. We used AddBiomechanics to automatically reconstruct joint angle and torque trajectories from previously published multi-activity datasets, achieving close correspondence to expert-calculated values, marker root-mean-square errors less than 2 c m , and residual force magnitudes smaller than 2 % of peak external force. Finally, we confirmed that AddBiomechanics accurately reproduced joint kinematics and kinetics from synthetic walking data with low marker error and residual loads. We have published the algorithm as an open source cloud service at AddBiomechanics.org, which is available at no cost and asks that users agree to share processed and de-identified data with the community. As of this writing, hundreds of researchers have used the prototype tool to process and share about ten thousand motion files from about one thousand experimental subjects. Reducing the barriers to processing and sharing high-quality human motion biomechanics data will enable more people to use state-of-the-art biomechanical analysis, do so at lower cost, and share larger and more accurate datasets.
Collapse
Affiliation(s)
- Keenon Werling
- Department of Computer Science, Stanford University, Stanford, California
| | - Nicholas A. Bianco
- Department of Mechanical Engineering, Stanford University, Stanford, California
| | - Michael Raitor
- Department of Mechanical Engineering, Stanford University, Stanford, California
| | - Jon Stingel
- Department of Mechanical Engineering, Stanford University, Stanford, California
| | - Jennifer L. Hicks
- Department of Bioengineering, Stanford University, Stanford, California
| | - Steven H. Collins
- Department of Mechanical Engineering, Stanford University, Stanford, California
| | - Scott L. Delp
- Department of Mechanical Engineering, Stanford University, Stanford, California
- Department of Bioengineering, Stanford University, Stanford, California
| | - C. Karen Liu
- Department of Computer Science, Stanford University, Stanford, California
| |
Collapse
|
47
|
Song K, Hullfish TJ, Scattone Silva R, Silbernagel KG, Baxter JR. Markerless motion capture estimates of lower extremity kinematics and kinetics are comparable to marker-based across 8 movements. J Biomech 2023; 157:111751. [PMID: 37552921 PMCID: PMC10494994 DOI: 10.1016/j.jbiomech.2023.111751] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2023] [Revised: 06/23/2023] [Accepted: 08/03/2023] [Indexed: 08/10/2023]
Abstract
Motion analysis is essential for assessing in-vivo human biomechanics. Marker-based motion capture is the standard to analyze human motion, but the inherent inaccuracy and practical challenges limit its utility in large-scale and real-world applications. Markerless motion capture has shown promise to overcome these practical barriers. However, its fidelity in quantifying joint kinematics and kinetics has not been verified across multiple common human movements. In this study, we concurrently captured marker-based and markerless motion data on 10 healthy study participants performing 8 daily living and exercise movements. We calculated the correlation (Rxy) and root-mean-square difference (RMSD) between markerless and marker-based estimates of ankle dorsi-plantarflexion, knee flexion, and three-dimensional hip kinematics (angles) and kinetics (moments) during each movement. Estimates from markerless motion capture matched closely with marker-based in ankle and knee joint angles (Rxy ≥ 0.877, RMSD ≤ 5.9°) and moments (Rxy ≥ 0.934, RMSD ≤ 2.66 % height × weight). High outcome comparability means the practical benefits of markerless motion capture can simplify experiments and facilitate large-scale analyses. Hip angles and moments demonstrated more differences between the two systems (RMSD: 6.7-15.9° and up to 7.15 % height × weight), especially during rapid movements such as running. Markerless motion capture appears to improve the accuracy of hip-related measures, yet more research is needed for validation. We encourage the biomechanics community to continue verifying, validating, and establishing best practices for markerless motion capture, which holds exciting potential to advance collaborative biomechanical research and expand real-world assessments needed for clinical translation.
Collapse
Affiliation(s)
- Ke Song
- Department of Orthopaedic Surgery, University of Pennsylvania, Philadelphia, PA, USA.
| | - Todd J Hullfish
- Department of Orthopaedic Surgery, University of Pennsylvania, Philadelphia, PA, USA
| | - Rodrigo Scattone Silva
- Department of Physical Therapy, University of Delaware, Newark, DE, USA; Postgraduate Program in Rehabilitation Sciences, Postgraduate Program in Physical Therapy, Federal University of Rio Grande do Norte, Santa Cruz, Brazil
| | | | - Josh R Baxter
- Department of Orthopaedic Surgery, University of Pennsylvania, Philadelphia, PA, USA
| |
Collapse
|
48
|
Ripic Z, Theodorakos I, Andersen MS, Signorile JF, Best TM, Jacobs KA, Eltoukhy M. Prediction of gait kinetics using Markerless-driven musculoskeletal modeling. J Biomech 2023; 157:111712. [PMID: 37421911 DOI: 10.1016/j.jbiomech.2023.111712] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Revised: 05/28/2023] [Accepted: 06/30/2023] [Indexed: 07/10/2023]
Abstract
Video-based motion analysis systems are emerging in the biomechanics research community, yet there is limited exploration of kinetics prediction using RGB-markerless kinematics and musculoskeletal modeling. This project aimed to provide ground reaction force (GRF) and ground reaction moment (GRM) predictions during over-ground gait by introducing RGB-markerless kinematics into a musculoskeletal modeling framework. Full-body markerless kinematic inputs and musculoskeletal modeling were used to obtain GRF and GRM predictions which were compared to measured force plate values. The markerless-driven predictions yielded average root mean-squared error (RMSE) in the stance phase of 0.035 ± 0.009 N∙BW-1, 0.070 ± 0.014 N∙BW-1, and 0.155 ± 0.041 N∙BW-1 in the mediolateral (ML), anteroposterior (AP), and vertical (V) GRFs. This was accompanied by moderate to high correlations and interclass correlation coefficients (ICC) indicating moderate to good agreement between measured and predicted values (95% Confidence Inervals: ML = [0.479, 0.717], AP = [0.714, 0.856], V = [0.803, 0.905]). For ground reaction moments (GRM), average RMSE was 0.029 ± 0.013 Nm∙BWH-1, 0.014 ± 0.005 Nm∙BWH-1, and 0.005 ± 0.002 Nm∙BWH-1 in the sagittal, frontal, and transverse planes. Pearson correlations and ICCs indicated poor agreement between systems for GRMs (95% Confidence Intervals: Sagittal = [0.314, 0.608], Frontal = [0.006, 0.373], Transverse = [0.269, 0.570]). Currently, RMSE is larger than target thresholds set from studies using Kinect, inertial, or marker-based kinematic drivers; but methodological considerations highlighted in this work may help guide follow-up iterations. At this point, further use in research or clinical practice is cautioned until methodological considerations are addressed, although results are promising at this point.
Collapse
Affiliation(s)
- Zachary Ripic
- Department of Kinesiology and Sport Sciences, University of Miami, Miami, FL, United States; Sports Medicine Institute, University of Miami Miller School of Medicine, Miami, FL, United States
| | - Ilias Theodorakos
- Department of Materials and Production, Aalborg University, Aalborg, Denmark
| | - Michael S Andersen
- Department of Materials and Production, Aalborg University, Aalborg, Denmark
| | - Joseph F Signorile
- Department of Kinesiology and Sport Sciences, University of Miami, Miami, FL, United States; Center on Aging, University of Miami Miller School of Medicine, Miami, FL, United States
| | - Thomas M Best
- Sports Medicine Institute, University of Miami Miller School of Medicine, Miami, FL, United States; Department of Orthopaedics, University of Miami Miller School of Medicine, Miami, FL, United States
| | - Kevin A Jacobs
- Department of Kinesiology and Sport Sciences, University of Miami, Miami, FL, United States
| | - Moataz Eltoukhy
- Department of Kinesiology and Sport Sciences, University of Miami, Miami, FL, United States; Department of Industrial & Systems Engineering, University of Miami, Miami, FL, United States; Department of Physical Therapy, University of Miami, Miami, FL, United States.
| |
Collapse
|
49
|
Song K, Scattone Silva R, Hullfish TJ, Silbernagel KG, Baxter JR. Patellofemoral Joint Loading Progression Across 35 Weightbearing Rehabilitation Exercises and Activities of Daily Living. Am J Sports Med 2023; 51:2110-2119. [PMID: 37272685 PMCID: PMC10315869 DOI: 10.1177/03635465231175160] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/10/2022] [Accepted: 03/28/2023] [Indexed: 06/06/2023]
Abstract
BACKGROUND Exercises that provide progressive therapeutic loading are a central component of patellofemoral pain rehabilitation, but quantitative evidence on patellofemoral joint loading is scarce for a majority of common weightbearing rehabilitation exercises. PURPOSE To define a loading index to quantify, compare, rank, and categorize overall loading levels in the patellofemoral joint across 35 types of weightbearing rehabilitation exercises and activities of daily living. STUDY DESIGN Descriptive laboratory study. METHODS Model-estimated knee flexion angles and extension moments based on motion capture and ground-reaction force data were used to quantify patellofemoral joint loading in 20 healthy participants who performed each exercise. A loading index was computed via a weighted sum of loading peak and cumulative loading impulse for each exercise. The 35 rehabilitation exercises and daily living activities were then ranked and categorized into low, moderate, and high "loading tiers" according to the loading index. RESULTS Overall patellofemoral loading levels varied substantially across the exercises and activities, with loading peak ranging from 0.6 times body weight during walking to 8.2 times body weight during single-leg decline squat. Most rehabilitation exercises generated a moderate level of patellofemoral joint loading. Few weightbearing exercises provided low-level loading that resembled walking or high-level loading with both high magnitude and duration. Exercises with high knee flexion tended to generate higher patellofemoral joint loading compared with high-intensity exercises. CONCLUSION This study quantified patellofemoral joint loading across a large collection of weightbearing exercises in the same cohort. CLINICAL RELEVANCE The visualized loading index ranks and modifiable worksheet may assist clinicians in planning patient-specific exercise programs for patellofemoral pain rehabilitation.
Collapse
Affiliation(s)
- Ke Song
- Department of Orthopaedic Surgery, University of Pennsylvania School of Medicine, Philadelphia, Pennsylvania, USA
| | - Rodrigo Scattone Silva
- Department of Physical Therapy, University of Delaware, Newark, Delaware, USA
- Postgraduate Program in Rehabilitation Sciences, Postgraduate Program in Physical Therapy, Federal University of Rio Grande do Norte, Santa Cruz, Brazil
| | - Todd J. Hullfish
- Department of Orthopaedic Surgery, University of Pennsylvania School of Medicine, Philadelphia, Pennsylvania, USA
| | | | - Josh R. Baxter
- Department of Orthopaedic Surgery, University of Pennsylvania School of Medicine, Philadelphia, Pennsylvania, USA
| |
Collapse
|
50
|
Wren TAL, Isakov P, Rethlefsen SA. Comparison of kinematics between Theia markerless and conventional marker-based gait analysis in clinical patients. Gait Posture 2023; 104:9-14. [PMID: 37285635 DOI: 10.1016/j.gaitpost.2023.05.029] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/02/2023] [Revised: 05/09/2023] [Accepted: 05/30/2023] [Indexed: 06/09/2023]
Abstract
BACKGROUND Markerless motion capture systems have the potential to make clinical gait analysis more efficient and convenient. Theia3D is a commercially available markerless system that may serve as an alternative to traditional gait analysis for clinical gait laboratories. RESEARCH QUESTION What is the concurrent validity of markerless gait analysis using Theia3D compared to traditional marker-based gait analysis in pediatric clinical gait patients? METHODS Thirty-six patients (20 male, age 2-25 years) with a range of diagnoses underwent clinical gait analysis with data being captured concurrently by a traditional marker-based motion capture system (Vicon Nexus) and a commercial markerless system (Theia3D). Multiple left strides were averaged for each subject, and the difference in kinematics (Theia - Vicon) was calculated over the gait cycle and evaluated using root mean square difference (RMSD), mean difference, and RMSD after subtracting the mean value across the gait cycle (RMSDoffset). Sub-analysis was performed for 25 patients with foot deformities, 9 wearing ankle-foot orthoses, and 6 walking with assistance (cane, crutches, walker, or handheld). RESULTS Kinematics showed similar patterns between the marker-based and markerless systems. RMSD was < 6° except for pelvic tilt, hip flexion, ankle inversion, foot progression, and transverse plane rotation of the hip, knee, and ankle. These measures mainly differed due to an offset between the curves. After adjusting for offsets, all RMSDoffset were < 6°. RMSD was larger for patients with foot deformities, wearing orthoses, or using assistive devices, but all RMSDoffset were still < 8°. In some cases, however, the markerless system had greater trial-to-trial variability, showed a larger knee varus "bump" in swing, or failed to track the subject. SIGNIFICANCE This study provides preliminary evidence of concurrent validity of Theia3D for pediatric patients with abnormal gait. However, some questions remain regarding identification of the knee axis and for patients with foot deformity or assistive devices.
Collapse
Affiliation(s)
- Tishya A L Wren
- Jackie and Gene Autry Orthopaedic Center, Children's Hospital Los Angeles, Los Angeles, USA; Departments of Orthopaedic Surgery, Radiology, and Biomedical Engineering, University of Southern California, Los Angeles, USA.
| | - Pavel Isakov
- Jackie and Gene Autry Orthopaedic Center, Children's Hospital Los Angeles, Los Angeles, USA
| | - Susan A Rethlefsen
- Jackie and Gene Autry Orthopaedic Center, Children's Hospital Los Angeles, Los Angeles, USA
| |
Collapse
|