1
|
Lloyd D. The future of in-field sports biomechanics: wearables plus modelling compute real-time in vivo tissue loading to prevent and repair musculoskeletal injuries. Sports Biomech 2024; 23:1284-1312. [PMID: 34496728 DOI: 10.1080/14763141.2021.1959947] [Citation(s) in RCA: 15] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/28/2021] [Accepted: 07/20/2021] [Indexed: 01/13/2023]
Abstract
This paper explores the use of biomechanics in identifying the mechanistic causes of musculoskeletal tissue injury and degeneration. It appraises how biomechanics has been used to develop training programmes aiming to maintain or recover tissue health. Tissue health depends on the functional mechanical environment experienced by tissues during daily and rehabilitation activities. These environments are the result of the interactions between tissue motion, loading, biology, and morphology. Maintaining health of and/or repairing musculoskeletal tissues requires targeting the "ideal" in vivo tissue mechanics (i.e., loading and deformation), which may be enabled by appropriate real-time biofeedback. Recent research shows that biofeedback technologies may increase their quality and effectiveness by integrating a personalised neuromusculoskeletal modelling driven by real-time motion capture and medical imaging. Model personalisation is crucial in obtaining physically and physiologically valid predictions of tissue biomechanics. Model real-time execution is crucial and achieved by code optimisation and artificial intelligence methods. Furthermore, recent work has also shown that laboratory-based motion capture biomechanical measurements and modelling can be performed outside the laboratory with wearable sensors and artificial intelligence. The next stage is to combine these technologies into well-designed easy to use products to guide training to maintain or recover tissue health in the real-world.
Collapse
Affiliation(s)
- David Lloyd
- School of Health Sciences and Social Work, Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), in the Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Griffith University, Australia
| |
Collapse
|
2
|
Carter J, Chen X, Cazzola D, Trewartha G, Preatoni E. Consumer-priced wearable sensors combined with deep learning can be used to accurately predict ground reaction forces during various treadmill running conditions. PeerJ 2024; 12:e17896. [PMID: 39221284 PMCID: PMC11366233 DOI: 10.7717/peerj.17896] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2024] [Accepted: 07/19/2024] [Indexed: 09/04/2024] Open
Abstract
Ground reaction force (GRF) data is often collected for the biomechanical analysis of running, due to the performance and injury risk insights that GRF analysis can provide. Traditional methods typically limit GRF collection to controlled lab environments, recent studies have looked to combine the ease of use of wearable sensors with the statistical power of machine learning to estimate continuous GRF data outside of these restrictions. Before such systems can be deployed with confidence outside of the lab they must be shown to be a valid and accurate tool for a wide range of users. The aim of this study was to evaluate how accurately a consumer-priced sensor system could estimate GRFs whilst a heterogeneous group of runners completed a treadmill protocol with three different personalised running speeds and three gradients. Fifty runners (25 female, 25 male) wearing pressure insoles made up of 16 resistive sensors and an inertial measurement unit ran at various speeds and gradients on an instrumented treadmill. A long short term memory (LSTM) neural network was trained to estimate both vertical ( G R F v ) and anteroposterior ( G R F a p ) force traces using leave one subject out validation. The average relative root mean squared error (rRMSE) was 3.2% and 3.1%, respectively. The mean ( G R F v ) rRMSE across the evaluated participants ranged from 0.8% to 8.8% and from 1.3% to 17.3% in the ( G R F a p ) estimation. The findings from this study suggest that current consumer-priced sensors could be used to accurately estimate two-dimensional GRFs for a wide range of runners at a variety of running intensities. The estimated kinetics could be used to provide runners with individualised feedback as well as form the basis of data collection for running injury risk factor studies on a much larger scale than is currently possible with lab based methods.
Collapse
Affiliation(s)
- Josh Carter
- Department of Health, University of Bath, Bath, Somerset, United Kingdom
| | - Xi Chen
- Department of Computer Science, University of Bath, Bath, Somerset, United Kingdom
| | - Dario Cazzola
- Department of Health, University of Bath, Bath, Somerset, United Kingdom
| | - Grant Trewartha
- School of Health and Life Sciences, University of Teesside, Middlesbrough, North Yorkshire, United Kingdom
| | - Ezio Preatoni
- Department of Health, University of Bath, Bath, Somerset, United Kingdom
| |
Collapse
|
3
|
Sipes GC, Lee M, Halloran KM, Rice I, Kersh ME. Kinematics-Based Predictions of External Loads during Handcycling. SENSORS (BASEL, SWITZERLAND) 2024; 24:5297. [PMID: 39204990 PMCID: PMC11359576 DOI: 10.3390/s24165297] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/03/2024] [Revised: 08/07/2024] [Accepted: 08/11/2024] [Indexed: 09/04/2024]
Abstract
The increased risk of cardiovascular disease in people with spinal cord injuries motivates work to identify exercise options that improve health outcomes without causing risk of musculoskeletal injury. Handcycling is an exercise mode that may be beneficial for wheelchair users, but further work is needed to establish appropriate guidelines and requires assessment of the external loads. The goal of this research was to predict the six-degree-of-freedom external loads during handcycling from data similar to those which can be measured from inertial measurement units (segment accelerations and velocities) using machine learning. Five neural network models and two ensemble models were compared against a statistical model. A temporal convolutional network (TCN) yielded the best predictions. Predictions of forces and moments in-plane with the crank were the most accurate (r = 0.95-0.97). The TCN model could predict external loads during activities of different intensities, making it viable for different exercise protocols. The ability to predict the loads associated with forward propulsion using wearable-type data enables the development of informed exercise guidelines.
Collapse
Affiliation(s)
- Griffin C. Sipes
- Department of Mechanical Science and Engineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA; (G.C.S.); (M.L.); (K.M.H.)
| | - Matthew Lee
- Department of Mechanical Science and Engineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA; (G.C.S.); (M.L.); (K.M.H.)
| | - Kellie M. Halloran
- Department of Mechanical Science and Engineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA; (G.C.S.); (M.L.); (K.M.H.)
| | - Ian Rice
- Department of Health and Kinesiology, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA;
| | - Mariana E. Kersh
- Department of Mechanical Science and Engineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA; (G.C.S.); (M.L.); (K.M.H.)
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
- Carle Illinois College of Medicine, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
| |
Collapse
|
4
|
Xia Z, Cornish BM, Devaprakash D, Barrett RS, Lloyd DG, Hams AH, Pizzolato C. Prediction of Achilles Tendon Force During Common Motor Tasks From Markerless Video. IEEE Trans Neural Syst Rehabil Eng 2024; 32:2070-2077. [PMID: 38787676 DOI: 10.1109/tnsre.2024.3403092] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/26/2024]
Abstract
Remodeling of the Achilles tendon (AT) is partly driven by its mechanical environment. AT force can be estimated with neuromusculoskeletal (NMSK) modeling; however, the complex experimental setup required to perform the analyses confines use to the laboratory. We developed task-specific long short-term memory (LSTM) neural networks that employ markerless video data to predict the AT force during walking, running, countermovement jump, single-leg landing, and single-leg heel rise. The task-specific LSTM models were trained on pose estimation keypoints and corresponding AT force data from 16 subjects, calculated via an established NMSK modeling pipeline, and cross-validated using a leave-one-subject-out approach. As proof-of-concept, new motion data of one participant was collected with two smartphones and used to predict AT forces. The task-specific LSTM models predicted the time-series AT force using synthesized pose estimation data with root mean square error (RMSE) ≤ 526 N, normalized RMSE (nRMSE) ≤ 0.21 , R 2 ≥ 0.81 . Walking task resulted the most accurate with RMSE = 189±62 N; nRMSE = 0.11±0.03 , R 2 = 0.92±0.04 . AT force predicted with smartphones video data was physiologically plausible, agreeing in timing and magnitude with established force profiles. This study demonstrated the feasibility of using low-cost solutions to deploy complex biomechanical analyses outside the laboratory.
Collapse
|
5
|
Xiang L, Gao Z, Wang A, Shim V, Fekete G, Gu Y, Fernandez J. Rethinking running biomechanics: a critical review of ground reaction forces, tibial bone loading, and the role of wearable sensors. Front Bioeng Biotechnol 2024; 12:1377383. [PMID: 38650752 PMCID: PMC11033368 DOI: 10.3389/fbioe.2024.1377383] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2024] [Accepted: 03/22/2024] [Indexed: 04/25/2024] Open
Abstract
This study presents a comprehensive review of the correlation between tibial acceleration (TA), ground reaction forces (GRF), and tibial bone loading, emphasizing the critical role of wearable sensor technology in accurately measuring these biomechanical forces in the context of running. This systematic review and meta-analysis searched various electronic databases (PubMed, SPORTDiscus, Scopus, IEEE Xplore, and ScienceDirect) to identify relevant studies. It critically evaluates existing research on GRF and tibial acceleration (TA) as indicators of running-related injuries, revealing mixed findings. Intriguingly, recent empirical data indicate only a marginal link between GRF, TA, and tibial bone stress, thus challenging the conventional understanding in this field. The study also highlights the limitations of current biomechanical models and methodologies, proposing a paradigm shift towards more holistic and integrated approaches. The study underscores wearable sensors' potential, enhanced by machine learning, in transforming the monitoring, prevention, and rehabilitation of running-related injuries.
Collapse
Affiliation(s)
- Liangliang Xiang
- Department of Radiology, Ningbo No. 2 Hospital, Ningbo, China
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand
| | - Zixiang Gao
- Department of Radiology, Ningbo No. 2 Hospital, Ningbo, China
- Faculty of Engineering, University of Pannonia, Veszprém, Hungary
| | - Alan Wang
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand
- Center for Medical Imaging, Faculty of Medical and Health Sciences, The University of Auckland, Auckland, New Zealand
| | - Vickie Shim
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand
| | - Gusztáv Fekete
- Vehicle Industry Research Center, Széchenyi István University, Győr, Hungary
| | - Yaodong Gu
- Department of Radiology, Ningbo No. 2 Hospital, Ningbo, China
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand
- Faculty of Sports Science, Ningbo University, Ningbo, China
| | - Justin Fernandez
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand
- Department of Engineering Science, The University of Auckland, Auckland, New Zealand
| |
Collapse
|
6
|
Liang W, Muhammad Rehan Afzal H, Qiao Y, Fan A, Wang F, Hu Y, Yang P. Estimation of electrical muscle activity during gait using inertial measurement units with convolution attention neural network and small-scale dataset. J Biomech 2024; 167:112093. [PMID: 38615480 DOI: 10.1016/j.jbiomech.2024.112093] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 04/07/2024] [Accepted: 04/09/2024] [Indexed: 04/16/2024]
Abstract
In general, muscle activity can be directly measured using Electromyography (EMG) or calculated with musculoskeletal models. However, both methods are not suitable for non-technical users and unstructured environments. It is desired to establish more portable and easy-to-use muscle activity estimation methods. Deep learning (DL) models combined with inertial measurement units (IMUs) have shown great potential to estimate muscle activity. However, it frequently occurs in clinical scenarios that a very small amount of data is available and leads to limited performance of the DL models, while the augmentation techniques to efficiently expand a small sample size for DL model training are rarely used. The primary aim of the present study was to develop a novel DL model to estimate the EMG envelope during gait using IMUs with high accuracy. A secondary aim was to develop a novel model-based data augmentation method to improve the performance of the estimation model with small-scale dataset. Therefore, in the present study, a time convolutional network-based generative adversarial network, namely MuscleGAN, was proposed for data augmentation. Moreover, a subject-independent regression DL model was developed to estimate EMG envelope. Results suggested that the proposed two-stage method has better generalization and estimation performance than the commonly used existing methods. Pearson correlation coefficient and normalized root-mean-square errors derived from the proposed method reached up to 0.72 and 0.13, respectively. It was indicated that the MuscleGAN indeed improved the estimation accuracy of lower limb EMG envelope from 70% to 72%. Thus, even using only two IMUs and a very small-scale dataset, the proposed model is still capable of accurately estimating lower limb EMG envelope, demonstrating considerable potential for its application in clinical and daily life scenarios.
Collapse
Affiliation(s)
- Wenqi Liang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an, China
| | - Hafiz Muhammad Rehan Afzal
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an, China
| | - Yongyu Qiao
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an, China
| | - Ao Fan
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an, China
| | - Fanjie Wang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an, China
| | - Yiwei Hu
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an, China
| | - Pengfei Yang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an, China.
| |
Collapse
|
7
|
Krishnakumar S, van Beijnum BJF, Baten CTM, Veltink PH, Buurke JH. Estimation of Kinetics Using IMUs to Monitor and Aid in Clinical Decision-Making during ACL Rehabilitation: A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2024; 24:2163. [PMID: 38610374 PMCID: PMC11014074 DOI: 10.3390/s24072163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Revised: 03/18/2024] [Accepted: 03/23/2024] [Indexed: 04/14/2024]
Abstract
After an ACL injury, rehabilitation consists of multiple phases, and progress between these phases is guided by subjective visual assessments of activities such as running, hopping, jump landing, etc. Estimation of objective kinetic measures like knee joint moments and GRF during assessment can help physiotherapists gain insights on knee loading and tailor rehabilitation protocols. Conventional methods deployed to estimate kinetics require complex, expensive systems and are limited to laboratory settings. Alternatively, multiple algorithms have been proposed in the literature to estimate kinetics from kinematics measured using only IMUs. However, the knowledge about their accuracy and generalizability for patient populations is still limited. Therefore, this article aims to identify the available algorithms for the estimation of kinetic parameters using kinematics measured only from IMUs and to evaluate their applicability in ACL rehabilitation through a comprehensive systematic review. The papers identified through the search were categorized based on the modelling techniques and kinetic parameters of interest, and subsequently compared based on the accuracies achieved and applicability for ACL patients during rehabilitation. IMUs have exhibited potential in estimating kinetic parameters with good accuracy, particularly for sagittal movements in healthy cohorts. However, several shortcomings were identified and future directions for improvement have been proposed, including extension of proposed algorithms to accommodate multiplanar movements and validation of the proposed techniques in diverse patient populations and in particular the ACL population.
Collapse
Affiliation(s)
- Sanchana Krishnakumar
- Department of Biomedical Signals and System, University of Twente, Drienerlolaan 5, 7522 NB Enschede, The Netherlands; (B.-J.F.v.B.); (P.H.V.); (J.H.B.)
| | - Bert-Jan F. van Beijnum
- Department of Biomedical Signals and System, University of Twente, Drienerlolaan 5, 7522 NB Enschede, The Netherlands; (B.-J.F.v.B.); (P.H.V.); (J.H.B.)
| | - Chris T. M. Baten
- Roessingh Research and Development, Roessinghsbleekweg 33B, 7522 AH Enschede, The Netherlands;
| | - Peter H. Veltink
- Department of Biomedical Signals and System, University of Twente, Drienerlolaan 5, 7522 NB Enschede, The Netherlands; (B.-J.F.v.B.); (P.H.V.); (J.H.B.)
| | - Jaap H. Buurke
- Department of Biomedical Signals and System, University of Twente, Drienerlolaan 5, 7522 NB Enschede, The Netherlands; (B.-J.F.v.B.); (P.H.V.); (J.H.B.)
- Roessingh Research and Development, Roessinghsbleekweg 33B, 7522 AH Enschede, The Netherlands;
| |
Collapse
|
8
|
Lichtwark GA, Schuster RW, Kelly LA, Trost SG, Bialkowski A. Markerless motion capture provides accurate predictions of ground reaction forces across a range of movement tasks. J Biomech 2024; 166:112051. [PMID: 38503062 DOI: 10.1016/j.jbiomech.2024.112051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Revised: 02/28/2024] [Accepted: 03/13/2024] [Indexed: 03/21/2024]
Abstract
Measuring or estimating the forces acting on the human body during movement is critical for determining the biomechanical aspects relating to injury, disease and healthy ageing. In this study we examined whether quantifying whole-body motion (segmental accelerations) using a commercial markerless motion capture system could accurately predict three-dimensional ground reaction force during a diverse range of human movements: walking, running, jumping and cutting. We synchronously recorded 3D ground reaction forces (force instrumented treadmill or in-ground plates) with high-resolution video from eight cameras that were spatially calibrated relative to a common coordinate system. We used a commercially available software to reconstruct whole body motion, along with a geometric skeletal model to calculate the acceleration of each segment and hence the whole-body centre of mass and ground reaction force across each movement task. The average root mean square difference (RMSD) across all three dimensions and all tasks was 0.75 N/kg, with the maximum average RMSD being 1.85 N/kg for running vertical force (7.89 % of maximum). There was very strong agreement between peak forces across tasks, with R2 values indicating that the markerless prediction algorithm was able to predict approximately 95-99 % of the variance in peak force across all axes and movements. The results were comparable to previous reports using whole-body marker-based approaches and hence this provides strong proof-of-principle evidence that markerless motion capture can be used to predict ground reaction forces and therefore potentially assess movement kinetics with limited requirements for participant preparation.
Collapse
Affiliation(s)
- Glen A Lichtwark
- School of Exercise and Nutrition Sciences, Queensland University of Technology, Kelvin Grove, QLD 4059, Australia; School of Human Movement and Nutrition Sciences, The University of Queensland, St. Lucia, QLD 4072, Australia.
| | - Robert W Schuster
- School of Human Movement and Nutrition Sciences, The University of Queensland, St. Lucia, QLD 4072, Australia
| | - Luke A Kelly
- School of Human Movement and Nutrition Sciences, The University of Queensland, St. Lucia, QLD 4072, Australia; School of Health Sciences and Social Work, Griffith University, Gold Coast 4111, Australia; Griffith Centre of Biomedical and Rehabilitation Engineering, Griffith University, Gold Coast 4111, Australia
| | - Stewart G Trost
- School of Human Movement and Nutrition Sciences, The University of Queensland, St. Lucia, QLD 4072, Australia; Children's Health Queensland Health and Hospital Service, South Brisbane, QLD 4101, Australia
| | - Alina Bialkowski
- School of Electrical Engineering and Computer Science, The University of Queensland, St Lucia, QLD 4072, Australia
| |
Collapse
|
9
|
Wilmes E, de Ruiter CJ, Beers LGM, de Koning L, Brink MS, Savelsbergh GJP. New training load metrics in field hockey using inertial measurement units. Eur J Sport Sci 2023; 23:2191-2199. [PMID: 37245222 DOI: 10.1080/17461391.2023.2214786] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
Field hockey players are exposed to high biomechanical loads. These loads often cannot be adequately estimated with global navigational satellite systems (GNSS) since on-field displacements during these movements are often small. Therefore, this study aims to explore the potential of different proxies of biomechanical load in field hockey with use of a simple inertial measurement unit (IMU) system. Sixteen field hockey players performed a range of field hockey specific exercises, including running with stick on the ground, running upright, and different types of shots and passes. All exercises were performed at two different frequencies (i.e. number of actions per minute). A variety of proxies of biomechanical load (time spent with forward tilted pelvis, time spent in lunge position, time spent with flexed thighs, and Hip Load) were obtained using wearable IMUs. In addition, total distance was quantified using a GNSS system. Linear mixed models were constructed to determine the effects of the different exercises and action frequency on all quantified metrics. All metrics increased approximately proportional to the increase in action frequency. Total distance and Hip Load were greatest for the running exercises, but the different types of shots and passes had greater effects on specific on the times spent in the demanding body postures. This shows that these proxies of biomechanical load can be used to estimate field hockey-specific biomechanical loads. The use of these metrics may provide coaches and medical staff with a more complete view of the training load that field hockey players experience.Highlights New proxies of biomechanical load derived with inertial measurement units were used to quantify field hockey specific biomechanical loads.These new biomechanical metrics are complementary to metrics obtained with global navigation satellite systems and increased proportionally to a doubling of the exercise intensity.The presented biomechanical load metrics can help field hockey coaches to achieve a better balance between load and recovery for their players.
Collapse
Affiliation(s)
- Erik Wilmes
- Amsterdam Movement Sciences, Department of Human Movement Sciences, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Cornelis J de Ruiter
- Amsterdam Movement Sciences, Department of Human Movement Sciences, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Leonarda G M Beers
- Amsterdam Movement Sciences, Department of Human Movement Sciences, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Lisa de Koning
- Amsterdam Movement Sciences, Department of Human Movement Sciences, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Michel S Brink
- Center for Human Movement Sciences, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Geert J P Savelsbergh
- Amsterdam Movement Sciences, Department of Human Movement Sciences, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
10
|
Xu D, Zhou H, Quan W, Gusztav F, Wang M, Baker JS, Gu Y. Accurately and effectively predict the ACL force: Utilizing biomechanical landing pattern before and after-fatigue. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 241:107761. [PMID: 37579552 DOI: 10.1016/j.cmpb.2023.107761] [Citation(s) in RCA: 28] [Impact Index Per Article: 28.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Revised: 08/08/2023] [Accepted: 08/09/2023] [Indexed: 08/16/2023]
Abstract
BACKGROUND AND OBJECTIVE As a fundamental exercise technique, landing can commonly be associated with anterior cruciate ligament (ACL) injury, especially during after-fatigue single-leg landing (SL). Presently, the inability to accurately detect ACL loading makes it difficult to recognize the risk degree of ACL injury, which reduces the effectiveness of injury prevention and sports monitoring. Increased risk of ACL injury during after-fatigue SL may be related to changes in ankle motion patterns. Therefore, this study aims to develop a highly accurate and easily implemented ACL force prediction model by combining deep learning and the explored relationship between ACL force and ankle motion pattern. METHODS First, 56 subjects' during before and after-fatigue SL data were collected to explore the relationship between the ankle initial contact angle (AIC), ankle range of motion (AROM) and peak ACL force (PAF). Then, the musculoskeletal model was developed to simulate and calculate the ACL force. Finally, the ACL force prediction model was constructed by combining the explored relationship and sparrow search algorithm (SSA) to optimize the extreme learning machine (ELM) and long short-term memory (LSTM). RESULTS There was almost a stronger linear relationship between the PAF and AIC (R = -0.70), AROM (R2 = -0.61). By substituting AIC and AROM as independent variables in the SSA-ELM prediction model, the model shows excellent prediction performance because of very strong correlation (R2 = 0.9992, MSE = 0.0023, RMSE = 0.0474). Based on the equal scaling by combining results of SSA-ELM and SSA-LSTM, the prediction model achieves excellent performance in ACL force prediction of the overall waveform (R2 = 0.9947, MSE = 0.0076, RMSE = 0.0873). CONCLUSION By increasing the AIC and AROM during SL, the lower limb joint energy dissipation can be increased and the PAF reduced, thus reducing the impact loads on the lower limb joints and reducing ACL injuries. The proposed ACL dynamic load force prediction model has low input variable demands (sagittal joint angles), excellent generalization capabilities and superior performance in terms of high accuracy. In the future, we plan to use it as an accurate ACL injury risk assessment tool to promote and apply it to a wider range of sports training and injury monitoring.
Collapse
Affiliation(s)
- Datao Xu
- Faculty of Sports Science, Ningbo University, Ningbo, 315211, China; Faculty of Engineering, University of Pannonia, Veszprém, 8201, Hungary; Savaria Institute of Technology, Eötvös Loránd University, Szombathely, 9700, Hungary
| | - Huiyu Zhou
- Faculty of Sports Science, Ningbo University, Ningbo, 315211, China; School of Health and Life Sciences, University of the West of Scotland, Scotland, G72 0LH, United Kingdom
| | - Wenjing Quan
- Faculty of Sports Science, Ningbo University, Ningbo, 315211, China; Faculty of Engineering, University of Pannonia, Veszprém, 8201, Hungary; Savaria Institute of Technology, Eötvös Loránd University, Szombathely, 9700, Hungary
| | - Fekete Gusztav
- Faculty of Engineering, University of Pannonia, Veszprém, 8201, Hungary; Savaria Institute of Technology, Eötvös Loránd University, Szombathely, 9700, Hungary
| | - Meizi Wang
- Faculty of Sports Science, Ningbo University, Ningbo, 315211, China; Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, 999077, Hong Kong, China
| | - Julien S Baker
- Department of Sport and Physical Education, Hong Kong Baptist University, Hong Kong, 999077, China
| | - Yaodong Gu
- Faculty of Sports Science, Ningbo University, Ningbo, 315211, China.
| |
Collapse
|
11
|
Kiernan D, Ng B, Hawkins DA. Acceleration-Based Estimation of Vertical Ground Reaction Forces during Running: A Comparison of Methods across Running Speeds, Surfaces, and Foot Strike Patterns. SENSORS (BASEL, SWITZERLAND) 2023; 23:8719. [PMID: 37960420 PMCID: PMC10648662 DOI: 10.3390/s23218719] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Revised: 10/18/2023] [Accepted: 10/23/2023] [Indexed: 11/15/2023]
Abstract
Twenty-seven methods of estimating vertical ground reaction force first peak, loading rate, second peak, average, and/or time series from a single wearable accelerometer worn on the shank or approximate center of mass during running were compared. Force estimation errors were quantified for 74 participants across different running surfaces, speeds, and foot strike angles and biases, repeatability coefficients, and limits of agreement were modeled with linear mixed effects to quantify the accuracy, reliability, and precision. Several methods accurately and reliably estimated the first peak and loading rate, however, none could do so precisely (the limits of agreement exceeded ±65% of target values). Thus, we do not recommend first peak or loading rate estimation from accelerometers with the methods currently available. In contrast, the second peak, average, and time series could all be estimated accurately, reliably, and precisely with several different methods. Of these, we recommend the 'Pogson' methods due to their accuracy, reliability, and precision as well as their stability across surfaces, speeds, and foot strike angles.
Collapse
Affiliation(s)
- Dovin Kiernan
- Biomedical Engineering Graduate Group, University of California, Davis, Davis, CA 95616, USA
| | - Brandon Ng
- Department of Biomedical Engineering, University of California, Davis, Davis, CA 95616, USA
| | - David A. Hawkins
- Biomedical Engineering Graduate Group, University of California, Davis, Davis, CA 95616, USA
- Department of Neurobiology, Physiology, & Behavior, University of California, Davis, Davis, CA 95616, USA
| |
Collapse
|
12
|
Xiao D, Zhu F, Jiang J, Niu X. Leveraging natural cognitive systems in conjunction with ResNet50-BiGRU model and attention mechanism for enhanced medical image analysis and sports injury prediction. Front Neurosci 2023; 17:1273931. [PMID: 37795185 PMCID: PMC10546033 DOI: 10.3389/fnins.2023.1273931] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Accepted: 08/28/2023] [Indexed: 10/06/2023] Open
Abstract
Introduction In this study, we explore the potential benefits of integrating natural cognitive systems (medical professionals' expertise) and artificial cognitive systems (deep learning models) in the realms of medical image analysis and sports injury prediction. We focus on analyzing medical images of athletes to gain valuable insights into their health status. Methods To synergize the strengths of both natural and artificial cognitive systems, we employ the ResNet50-BiGRU model and introduce an attention mechanism. Our goal is to enhance the performance of medical image feature extraction and motion injury prediction. This integrated approach aims to achieve precise identification of anomalies in medical images, particularly related to muscle or bone damage. Results We evaluate the effectiveness of our method on four medical image datasets, specifically pertaining to skeletal and muscle injuries. We use performance indicators such as Peak Signal-to-Noise Ratio and Structural Similarity Index, confirming the robustness of our approach in sports injury analysis. Discussion Our research contributes significantly by providing an effective deep learning-driven method that harnesses both natural and artificial cognitive systems. By combining human expertise with advanced machine learning techniques, we offer a comprehensive understanding of athletes' health status. This approach holds potential implications for enhancing sports injury prevention, improving diagnostic accuracy, and tailoring personalized treatment plans for athletes, ultimately promoting better overall health and performance outcomes. Despite advancements in medical image analysis and sports injury prediction, existing systems often struggle to identify subtle anomalies and provide precise injury risk assessments, underscoring the necessity of a more integrated and comprehensive approach.
Collapse
Affiliation(s)
- Duo Xiao
- Ministry of Culture, Sports and Labor, Jiangxi Gannan Health Vocational College, Ganzhou, Jiangxi, China
| | - Fei Zhu
- Ministry of Culture, Sports and Labor, Jiangxi Gannan Health Vocational College, Ganzhou, Jiangxi, China
| | - Jian Jiang
- Gannan University of Science and Technology, Ganzhou, Jiangxi, China
| | - Xiaoqiang Niu
- Ministry of Culture, Sports and Labor, Jiangxi Gannan Health Vocational College, Ganzhou, Jiangxi, China
| |
Collapse
|
13
|
Liang W, Wang F, Fan A, Zhao W, Yao W, Yang P. Extended Application of Inertial Measurement Units in Biomechanics: From Activity Recognition to Force Estimation. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23094229. [PMID: 37177436 PMCID: PMC10180901 DOI: 10.3390/s23094229] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Revised: 04/20/2023] [Accepted: 04/22/2023] [Indexed: 05/15/2023]
Abstract
Abnormal posture or movement is generally the indicator of musculoskeletal injuries or diseases. Mechanical forces dominate the injury and recovery processes of musculoskeletal tissue. Using kinematic data collected from wearable sensors (notably IMUs) as input, activity recognition and musculoskeletal force (typically represented by ground reaction force, joint force/torque, and muscle activity/force) estimation approaches based on machine learning models have demonstrated their superior accuracy. The purpose of the present study is to summarize recent achievements in the application of IMUs in biomechanics, with an emphasis on activity recognition and mechanical force estimation. The methodology adopted in such applications, including data pre-processing, noise suppression, classification models, force/torque estimation models, and the corresponding application effects, are reviewed. The extent of the applications of IMUs in daily activity assessment, posture assessment, disease diagnosis, rehabilitation, and exoskeleton control strategy development are illustrated and discussed. More importantly, the technical feasibility and application opportunities of musculoskeletal force prediction using IMU-based wearable devices are indicated and highlighted. With the development and application of novel adaptive networks and deep learning models, the accurate estimation of musculoskeletal forces can become a research field worthy of further attention.
Collapse
Affiliation(s)
- Wenqi Liang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| | - Fanjie Wang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| | - Ao Fan
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| | - Wenrui Zhao
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| | - Wei Yao
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| | - Pengfei Yang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| |
Collapse
|
14
|
Lloyd DG, Saxby DJ, Pizzolato C, Worsey M, Diamond LE, Palipana D, Bourne M, de Sousa AC, Mannan MMN, Nasseri A, Perevoshchikova N, Maharaj J, Crossley C, Quinn A, Mulholland K, Collings T, Xia Z, Cornish B, Devaprakash D, Lenton G, Barrett RS. Maintaining soldier musculoskeletal health using personalised digital humans, wearables and/or computer vision. J Sci Med Sport 2023:S1440-2440(23)00070-1. [PMID: 37149408 DOI: 10.1016/j.jsams.2023.04.001] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 03/27/2023] [Accepted: 04/05/2023] [Indexed: 05/08/2023]
Abstract
OBJECTIVES The physical demands of military service place soldiers at risk of musculoskeletal injuries and are major concerns for military capability. This paper outlines the development new training technologies to prevent and manage these injuries. DESIGN Narrative review. METHODS Technologies suitable for integration into next-generation training devices were examined. We considered the capability of technologies to target tissue level mechanics, provide appropriate real-time feedback, and their useability in-the-field. RESULTS Musculoskeletal tissues' health depends on their functional mechanical environment experienced in military activities, training and rehabilitation. These environments result from the interactions between tissue motion, loading, biology, and morphology. Maintaining health of and/or repairing joint tissues requires targeting the "ideal" in vivo tissue mechanics (i.e., loading and strain), which may be enabled by real-time biofeedback. Recent research has shown that these biofeedback technologies are possible by integrating a patient's personalised digital twin and wireless wearable devices. Personalised digital twins are personalised neuromusculoskeletal rigid body and finite element models that work in real-time by code optimisation and artificial intelligence. Model personalisation is crucial in obtaining physically and physiologically valid predictions. CONCLUSIONS Recent work has shown that laboratory-quality biomechanical measurements and modelling can be performed outside the laboratory with a small number of wearable sensors or computer vision methods. The next stage is to combine these technologies into well-designed easy to use products.
Collapse
Affiliation(s)
- David G Lloyd
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia; School of Health Sciences and Social Work, Griffith University, Australia.
| | - David J Saxby
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia; School of Health Sciences and Social Work, Griffith University, Australia
| | - Claudio Pizzolato
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia; School of Health Sciences and Social Work, Griffith University, Australia
| | - Matthew Worsey
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia
| | - Laura E Diamond
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia; School of Health Sciences and Social Work, Griffith University, Australia
| | - Dinesh Palipana
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia; School of Medicine, Dentistry and Health, Griffith University, Australia
| | - Matthew Bourne
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia; School of Health Sciences and Social Work, Griffith University, Australia
| | - Ana Cardoso de Sousa
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia
| | - Malik Muhammad Naeem Mannan
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia
| | - Azadeh Nasseri
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia
| | - Nataliya Perevoshchikova
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia
| | - Jayishni Maharaj
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia; School of Health Sciences and Social Work, Griffith University, Australia
| | - Claire Crossley
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia; School of Health Sciences and Social Work, Griffith University, Australia
| | - Alastair Quinn
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia; School of Health Sciences and Social Work, Griffith University, Australia
| | - Kyle Mulholland
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia
| | - Tyler Collings
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia; School of Health Sciences and Social Work, Griffith University, Australia
| | - Zhengliang Xia
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia
| | - Bradley Cornish
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia; School of Health Sciences and Social Work, Griffith University, Australia
| | - Daniel Devaprakash
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia; VALD Performance, Australia
| | | | - Rodney S Barrett
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, Australia; School of Health Sciences and Social Work, Griffith University, Australia
| |
Collapse
|
15
|
Kim J, Kang H, Lee S, Choi J, Tack G. A Deep Learning Model for 3D Ground Reaction Force Estimation Using Shoes with Three Uniaxial Load Cells. SENSORS (BASEL, SWITZERLAND) 2023; 23:3428. [PMID: 37050487 PMCID: PMC10099259 DOI: 10.3390/s23073428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Revised: 03/20/2023] [Accepted: 03/23/2023] [Indexed: 06/19/2023]
Abstract
Ground reaction force (GRF) is essential for estimating muscle strength and joint torque in inverse dynamic analysis. Typically, it is measured using a force plate. However, force plates have spatial limitations, and studies of gaits involve numerous steps and thus require a large number of force plates, which is disadvantageous. To overcome these challenges, we developed a deep learning model for estimating three-axis GRF utilizing shoes with three uniaxial load cells. GRF data were collected from 81 people as they walked on two force plates while wearing shoes with three load cells. The three-axis GRF was calculated using a seq2seq approach based on long short-term memory (LSTM). To conduct the learning, validation, and testing, random selection was performed based on the subjects. The 60 selected participants were divided as follows: 37 were in the training set, 12 were in the validation set, and 11 were in the test set. The estimated GRF matched the force plate-measured GRF with correlation coefficients of 0.97, 0.96, and 0.90 and root mean square errors of 65.12 N, 15.50 N, and 9.83 N for the vertical, anterior-posterior, and medial-lateral directions, respectively, and there was a mid-stance timing error of 5.61% in the test dataset. A Bland-Altman analysis showed good agreement for the maximum vertical GRF. The proposed shoe with three uniaxial load cells and seq2seq LSTM can be utilized for estimating the 3D GRF in an outdoor environment with level ground and/or for gait research in which the subject takes several steps at their preferred walking speed, and hence can supply crucial data for a basic inverse dynamic analysis.
Collapse
Affiliation(s)
- Junggil Kim
- Department of Biomedical Engineering, Konkuk University, Chungju 27478, Republic of Korea
| | - Hyeon Kang
- Department of Biomedical Engineering, Konkuk University, Chungju 27478, Republic of Korea
| | - Seulgi Lee
- Department of Biomedical Engineering, Konkuk University, Chungju 27478, Republic of Korea
| | - Jinseung Choi
- Department of Biomedical Engineering, Konkuk University, Chungju 27478, Republic of Korea
- BK21 Plus Research Institute of Biomedical Engineering, Konkuk University, Chungju 27478, Republic of Korea
| | - Gyerae Tack
- Department of Biomedical Engineering, Konkuk University, Chungju 27478, Republic of Korea
- BK21 Plus Research Institute of Biomedical Engineering, Konkuk University, Chungju 27478, Republic of Korea
| |
Collapse
|
16
|
Tan T, Gatti AA, Fan B, Shea KG, Sherman SL, Uhlrich SD, Hicks JL, Delp SL, Shull PB, Chaudhari AS. A scoping review of portable sensing for out-of-lab anterior cruciate ligament injury prevention and rehabilitation. NPJ Digit Med 2023; 6:46. [PMID: 36934194 PMCID: PMC10024704 DOI: 10.1038/s41746-023-00782-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Accepted: 02/17/2023] [Indexed: 03/20/2023] Open
Abstract
Anterior cruciate ligament (ACL) injury and ACL reconstruction (ACLR) surgery are common. Laboratory-based biomechanical assessment can evaluate ACL injury risk and rehabilitation progress after ACLR; however, lab-based measurements are expensive and inaccessible to most people. Portable sensors such as wearables and cameras can be deployed during sporting activities, in clinics, and in patient homes. Although many portable sensing approaches have demonstrated promising results during various assessments related to ACL injury, they have not yet been widely adopted as tools for out-of-lab assessment. The purpose of this review is to summarize research on out-of-lab portable sensing applied to ACL and ACLR and offer our perspectives on new opportunities for future research and development. We identified 49 original research articles on out-of-lab ACL-related assessment; the most common sensing modalities were inertial measurement units, depth cameras, and RGB cameras. The studies combined portable sensors with direct feature extraction, physics-based modeling, or machine learning to estimate a range of biomechanical parameters (e.g., knee kinematics and kinetics) during jump-landing tasks, cutting, squats, and gait. Many of the reviewed studies depict proof-of-concept methods for potential future clinical applications including ACL injury risk screening, injury prevention training, and rehabilitation assessment. By synthesizing these results, we describe important opportunities that exist for clinical validation of existing approaches, using sophisticated modeling techniques, standardization of data collection, and creation of large benchmark datasets. If successful, these advances will enable widespread use of portable-sensing approaches to identify ACL injury risk factors, mitigate high-risk movements prior to injury, and optimize rehabilitation paradigms.
Collapse
Affiliation(s)
- Tian Tan
- Department of Radiology, Stanford University, Stanford, CA, USA
| | - Anthony A Gatti
- Department of Radiology, Stanford University, Stanford, CA, USA
| | - Bingfei Fan
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou, Zhejiang, China
| | - Kevin G Shea
- Department of Orthopaedic Surgery, Stanford University, Stanford, CA, USA
| | - Seth L Sherman
- Department of Orthopaedic Surgery, Stanford University, Stanford, CA, USA
| | - Scott D Uhlrich
- Department of Bioengineering, Stanford University, Stanford, CA, USA
| | - Jennifer L Hicks
- Department of Bioengineering, Stanford University, Stanford, CA, USA
| | - Scott L Delp
- Department of Orthopaedic Surgery, Stanford University, Stanford, CA, USA
- Department of Bioengineering, Stanford University, Stanford, CA, USA
- Department of Mechanical Engineering, Stanford University, Stanford, CA, USA
| | - Peter B Shull
- School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, Shanghai, China.
| | - Akshay S Chaudhari
- Department of Radiology, Stanford University, Stanford, CA, USA
- Department of Biomedical Data Science, Stanford University, Stanford, CA, USA
| |
Collapse
|
17
|
Nasseri A, Akhundov R, Bryant AL, Lloyd DG, Saxby DJ. Limiting the Use of Electromyography and Ground Reaction Force Data Changes the Magnitude and Ranking of Modelled Anterior Cruciate Ligament Forces. Bioengineering (Basel) 2023; 10:bioengineering10030369. [PMID: 36978760 PMCID: PMC10045248 DOI: 10.3390/bioengineering10030369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Revised: 03/09/2023] [Accepted: 03/14/2023] [Indexed: 03/19/2023] Open
Abstract
Neuromusculoskeletal models often require three-dimensional (3D) body motions, ground reaction forces (GRF), and electromyography (EMG) as input data. Acquiring these data in real-world settings is challenging, with barriers such as the cost of instruments, setup time, and operator skills to correctly acquire and interpret data. This study investigated the consequences of limiting EMG and GRF data on modelled anterior cruciate ligament (ACL) forces during a drop–land–jump task in late-/post-pubertal females. We compared ACL forces generated by a reference model (i.e., EMG-informed neural mode combined with 3D GRF) to those generated by an EMG-informed with only vertical GRF, static optimisation with 3D GRF, and static optimisation with only vertical GRF. Results indicated ACL force magnitude during landing (when ACL injury typically occurs) was significantly overestimated if only vertical GRF were used for either EMG-informed or static optimisation neural modes. If 3D GRF were used in combination with static optimisation, ACL force was marginally overestimated compared to the reference model. None of the alternative models maintained rank order of ACL loading magnitudes generated by the reference model. Finally, we observed substantial variability across the study sample in response to limiting EMG and GRF data, indicating need for methods incorporating subject-specific measures of muscle activation patterns and external loading when modelling ACL loading during dynamic motor tasks.
Collapse
Affiliation(s)
- Azadeh Nasseri
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland, Griffith University, Southport, QLD 4222, Australia
- Correspondence:
| | - Riad Akhundov
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland, Griffith University, Southport, QLD 4222, Australia
| | - Adam L. Bryant
- Centre for Health, Exercise & Sports Medicine, University of Melbourne, Melbourne, VIC 3010, Australia
| | - David G. Lloyd
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland, Griffith University, Southport, QLD 4222, Australia
| | - David J. Saxby
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland, Griffith University, Southport, QLD 4222, Australia
| |
Collapse
|
18
|
Donahue SR, Hahn ME. Estimation of ground reaction force waveforms during fixed pace running outside the laboratory. Front Sports Act Living 2023; 5:974186. [PMID: 36860734 PMCID: PMC9968876 DOI: 10.3389/fspor.2023.974186] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 01/16/2023] [Indexed: 02/15/2023] Open
Abstract
In laboratory experiments, biomechanical data collections with wearable technologies and machine learning have been promising. Despite the development of lightweight portable sensors and algorithms for the identification of gait events and estimation of kinetic waveforms, machine learning models have yet to be used to full potential. We propose the use of a Long Short Term Memory network to map inertial data to ground reaction force data gathered in a semi-uncontrolled environment. Fifteen healthy runners were recruited for this study, with varied running experience: novice to highly trained runners (<15 min 5 km race), and ages ranging from 18 to 64 years old. Force sensing insoles were used to measure normal foot-shoe forces, providing the standard for identification of gait events and measurement of kinetic waveforms. Three inertial measurement units (IMUs) were mounted to each participant, two bilaterally on the dorsal aspect of the foot and one clipped to the back of each participant's waistband, approximating their sacrum. Data input into the Long Short Term Memory network were from the three IMUs and output were estimated kinetic waveforms, compared against the standard of the force sensing insoles. The range of RMSE for each stance phase was from 0.189-0.288 BW, which is similar to multiple previous studies. Estimation of foot contact had an r 2 = 0.795. Estimation of kinetic variables varied, with peak force presenting the best output with an r 2 = 0.614. In conclusion, we have shown that at controlled paces over level ground a Long Short Term Memory network can estimate 4 s temporal windows of ground reaction force data across a range of running speeds.
Collapse
Affiliation(s)
- Seth R. Donahue
- Bowerman Sports Science Center, Department of Human Physiology, University of Oregon, Eugene, OR, United States
| | | |
Collapse
|
19
|
Estimation of gait events and kinetic waveforms with wearable sensors and machine learning when running in an unconstrained environment. Sci Rep 2023; 13:2339. [PMID: 36759681 PMCID: PMC9911774 DOI: 10.1038/s41598-023-29314-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2022] [Accepted: 02/02/2023] [Indexed: 02/11/2023] Open
Abstract
Wearable sensors and machine learning algorithms are becoming a viable alternative for biomechanical analysis outside of the laboratory. The purpose of this work was to estimate gait events from inertial measurement units (IMUs) and utilize machine learning for the estimation of ground reaction force (GRF) waveforms. Sixteen healthy runners were recruited for this study, with varied running experience. Force sensing insoles were used to measure normal foot-shoe forces, providing a proxy for vertical GRF and a standard for the identification of gait events. Three IMUs were mounted on each participant, two bilaterally on the dorsal aspect of each foot and one clipped to the back of each participant's waistband, approximating their sacrum. Participants also wore a GPS watch to record elevation and velocity. A Bidirectional Long Short Term Memory Network (BD-LSTM) was used to estimate GRF waveforms from inertial waveforms. Gait event estimation from both IMU data and machine learning algorithms led to accurate estimations of contact time. The GRF magnitudes were generally underestimated by the machine learning algorithm when presented with data from a novel participant, especially at faster running speeds. This work demonstrated that estimation of GRF waveforms is feasible across a range of running velocities and at different grades in an uncontrolled environment.
Collapse
|
20
|
Dorschky E, Camomilla V, Davis J, Federolf P, Reenalda J, Koelewijn AD. Perspective on "in the wild" movement analysis using machine learning. Hum Mov Sci 2023; 87:103042. [PMID: 36493569 DOI: 10.1016/j.humov.2022.103042] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2022] [Revised: 09/01/2022] [Accepted: 11/19/2022] [Indexed: 12/12/2022]
Abstract
Recent advances in wearable sensing and machine learning have created ample opportunities for "in the wild" movement analysis in sports, since the combination of both enables real-time feedback to be provided to athletes and coaches, as well as long-term monitoring of movements. The potential for real-time feedback is useful for performance enhancement or technique analysis, and can be achieved by training efficient models and implementing them on dedicated hardware. Long-term monitoring of movement can be used for injury prevention, among others. Such applications are often enabled by training a machine learned model from large datasets that have been collected using wearable sensors. Therefore, in this perspective paper, we provide an overview of approaches for studies that aim to analyze sports movement "in the wild" using wearable sensors and machine learning. First, we discuss how a measurement protocol can be set up by answering six questions. Then, we discuss the benefits and pitfalls and provide recommendations for effective training of machine learning models from movement data, focusing on data pre-processing, feature calculation, and model selection and tuning. Finally, we highlight two application domains where "in the wild" data recording was combined with machine learning for injury prevention and technique analysis, respectively.
Collapse
Affiliation(s)
- Eva Dorschky
- Machine Learning and Data Analytics (MaD) Lab, Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Valentina Camomilla
- Department of Movement, Human and Health Sciences, University of Rome "Foro Italico", Rome, Italy
| | - Jesse Davis
- Department of Computer Science and Leuven.AI, KU Leuven, Leuven, Belgium
| | - Peter Federolf
- Department of Sport Science, University of Innsbruck, Innsbruck, Austria
| | - Jasper Reenalda
- Biomedical Signal and Systems group, University of Twente, Enschede, The Netherlands; Roessingh Research and Development, Enschede, The Netherlands
| | - Anne D Koelewijn
- Machine Learning and Data Analytics (MaD) Lab, Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany.
| |
Collapse
|
21
|
Mason R, Pearson LT, Barry G, Young F, Lennon O, Godfrey A, Stuart S. Wearables for Running Gait Analysis: A Systematic Review. Sports Med 2023; 53:241-268. [PMID: 36242762 PMCID: PMC9807497 DOI: 10.1007/s40279-022-01760-6] [Citation(s) in RCA: 27] [Impact Index Per Article: 27.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/21/2022] [Indexed: 01/12/2023]
Abstract
BACKGROUND Running gait assessment has traditionally been performed using subjective observation or expensive laboratory-based objective technologies, such as three-dimensional motion capture or force plates. However, recent developments in wearable devices allow for continuous monitoring and analysis of running mechanics in any environment. Objective measurement of running gait is an important (clinical) tool for injury assessment and provides measures that can be used to enhance performance. OBJECTIVES We aimed to systematically review the available literature investigating how wearable technology is being used for running gait analysis in adults. METHODS A systematic search of the literature was conducted in the following scientific databases: PubMed, Scopus, Web of Science and SPORTDiscus. Information was extracted from each included article regarding the type of study, participants, protocol, wearable device(s), main outcomes/measures, analysis and key findings. RESULTS A total of 131 articles were reviewed: 56 investigated the validity of wearable technology, 22 examined the reliability and 77 focused on applied use. Most studies used inertial measurement units (n = 62) [i.e. a combination of accelerometers, gyroscopes and magnetometers in a single unit] or solely accelerometers (n = 40), with one using gyroscopes alone and 31 using pressure sensors. On average, studies used one wearable device to examine running gait. Wearable locations were distributed among the shank, shoe and waist. The mean number of participants was 26 (± 27), with an average age of 28.3 (± 7.0) years. Most studies took place indoors (n = 93), using a treadmill (n = 62), with the main aims seeking to identify running gait outcomes or investigate the effects of injury, fatigue, intrinsic factors (e.g. age, sex, morphology) or footwear on running gait outcomes. Generally, wearables were found to be valid and reliable tools for assessing running gait compared to reference standards. CONCLUSIONS This comprehensive review highlighted that most studies that have examined running gait using wearable sensors have done so with young adult recreational runners, using one inertial measurement unit sensor, with participants running on a treadmill and reporting outcomes of ground contact time, stride length, stride frequency and tibial acceleration. Future studies are required to obtain consensus regarding terminology, protocols for testing validity and the reliability of devices and suitability of gait outcomes. CLINICAL TRIAL REGISTRATION CRD42021235527.
Collapse
Affiliation(s)
- Rachel Mason
- Department of Sport, Exercise and Rehabilitation, Faculty of Health and Life Sciences, Northumbria University, Newcastle upon Tyne, UK
| | - Liam T Pearson
- Department of Sport, Exercise and Rehabilitation, Faculty of Health and Life Sciences, Northumbria University, Newcastle upon Tyne, UK
| | - Gillian Barry
- Department of Sport, Exercise and Rehabilitation, Faculty of Health and Life Sciences, Northumbria University, Newcastle upon Tyne, UK
| | - Fraser Young
- Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne, UK
| | | | - Alan Godfrey
- Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne, UK
| | - Samuel Stuart
- Department of Sport, Exercise and Rehabilitation, Faculty of Health and Life Sciences, Northumbria University, Newcastle upon Tyne, UK.
- Northumbria Healthcare NHS Foundation Trust, Newcastle upon Tyne, UK.
| |
Collapse
|
22
|
Mundt M, Born Z, Goldacre M, Alderson J. Estimating Ground Reaction Forces from Two-Dimensional Pose Data: A Biomechanics-Based Comparison of AlphaPose, BlazePose, and OpenPose. SENSORS (BASEL, SWITZERLAND) 2022; 23:s23010078. [PMID: 36616676 PMCID: PMC9823796 DOI: 10.3390/s23010078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/11/2022] [Revised: 12/12/2022] [Accepted: 12/16/2022] [Indexed: 05/14/2023]
Abstract
The adoption of computer vision pose estimation approaches, used to identify keypoint locations which are intended to reflect the necessary anatomical landmarks relied upon by biomechanists for musculoskeletal modelling, has gained increasing traction in recent years. This uptake has been further accelerated by keypoint use as inputs into machine learning models used to estimate biomechanical parameters such as ground reaction forces (GRFs) in the absence of instrumentation required for direct measurement. This study first aimed to investigate the keypoint detection rate of three open-source pose estimation models (AlphaPose, BlazePose, and OpenPose) across varying movements, camera views, and trial lengths. Second, this study aimed to assess the suitability and interchangeability of keypoints detected by each pose estimation model when used as inputs into machine learning models for the estimation of GRFs. The keypoint detection rate of BlazePose was distinctly lower than that of AlphaPose and OpenPose. All pose estimation models achieved a high keypoint detection rate at the centre of an image frame and a lower detection rate in the true sagittal plane camera field of view, compared with slightly anteriorly or posteriorly located quasi-sagittal plane camera views. The three-dimensional ground reaction force, instantaneous loading rate, and peak force for running could be estimated using the keypoints of all three pose estimation models. However, only AlphaPose and OpenPose keypoints could be used interchangeably with a machine learning model trained to estimate GRFs based on AlphaPose keypoints resulting in a high estimation accuracy when OpenPose keypoints were used as inputs and vice versa. The findings of this study highlight the need for further evaluation of computer vision-based pose estimation models for application in biomechanical human modelling, and the limitations of machine learning-based GRF estimation models that rely on 2D keypoints. This is of particular relevance given that machine learning models informing athlete monitoring guidelines are being developed for application related to athlete well-being.
Collapse
Affiliation(s)
- Marion Mundt
- UWA Minderoo Tech & Policy Lab, Law School, The University of Western Australia, Crawley, WA 6009, Australia
- Correspondence:
| | - Zachery Born
- UWA Minderoo Tech & Policy Lab, Law School, The University of Western Australia, Crawley, WA 6009, Australia
| | - Molly Goldacre
- UWA Minderoo Tech & Policy Lab, Law School, The University of Western Australia, Crawley, WA 6009, Australia
| | - Jacqueline Alderson
- UWA Minderoo Tech & Policy Lab, Law School, The University of Western Australia, Crawley, WA 6009, Australia
- Sports Performance Research Institute New Zealand (SPRINZ), Auckland University of Technology, Auckland 1010, New Zealand
| |
Collapse
|
23
|
Bach MM, Dominici N, Daffertshofer A. Predicting vertical ground reaction forces from 3D accelerometry using reservoir computers leads to accurate gait event detection. Front Sports Act Living 2022; 4:1037438. [PMID: 36385782 PMCID: PMC9644164 DOI: 10.3389/fspor.2022.1037438] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Accepted: 10/04/2022] [Indexed: 11/06/2022] Open
Abstract
Accelerometers are low-cost measurement devices that can readily be used outside the lab. However, determining isolated gait events from accelerometer signals, especially foot-off events during running, is an open problem. We outline a two-step approach where machine learning serves to predict vertical ground reaction forces from accelerometer signals, followed by force-based event detection. We collected shank accelerometer signals and ground reaction forces from 21 adults during comfortable walking and running on an instrumented treadmill. We trained one common reservoir computer using segmented data using both walking and running data. Despite being trained on just a small number of strides, this reservoir computer predicted vertical ground reaction forces in continuous gait with high quality. The subsequent foot contact and foot off event detection proved highly accurate when compared to the gold standard based on co-registered ground reaction forces. Our proof-of-concept illustrates the capacity of combining accelerometry with machine learning for detecting isolated gait events irrespective of mode of locomotion.
Collapse
|
24
|
Young F, Mason R, Wall C, Morris R, Stuart S, Godfrey A. Examination of a foot mounted IMU-based methodology for a running gait assessment. Front Sports Act Living 2022; 4:956889. [PMID: 36147582 PMCID: PMC9485551 DOI: 10.3389/fspor.2022.956889] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2022] [Accepted: 08/10/2022] [Indexed: 11/13/2022] Open
Abstract
Gait assessment is essential to understand injury prevention mechanisms during running, where high-impact forces can lead to a range of injuries in the lower extremities. Information regarding the running style to increase efficiency and/or selection of the correct running equipment, such as shoe type, can minimize the risk of injury, e.g., matching a runner's gait to a particular set of cushioning technologies found in modern shoes (neutral/support cushioning). Awareness of training or selection of the correct equipment requires an understanding of a runner's biomechanics, such as determining foot orientation when it strikes the ground. Previous work involved a low-cost approach with a foot-mounted inertial measurement unit (IMU) and an associated zero-crossing-based methodology to objectively understand a runner's biomechanics (in any setting) to learn about shoe selection. Here, an investigation of the previously presented ZC-based methodology is presented only to determine general validity for running gait assessment in a range of running abilities from novice (8 km/h) to experienced (16 km/h+). In comparison to Vicon 3D motion tracking data, the presented approach can extract pronation, foot strike location, and ground contact time with good [ICC(2,1) > 0.750] to excellent [ICC(2,1) > 0.900] agreement between 8-12 km/h runs. However, at higher speeds (14 km/h+), the ZC-based approach begins to deteriorate in performance, suggesting that other features and approaches may be more suitable for faster running and sprinting tasks.
Collapse
Affiliation(s)
- Fraser Young
- Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne, United Kingdom
| | - Rachel Mason
- Department of Sport, Exercise and Rehabilitation, Northumbria University, Newcastle upon Tyne, United Kingdom
| | - Conor Wall
- Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne, United Kingdom
| | - Rosie Morris
- Department of Sport, Exercise and Rehabilitation, Northumbria University, Newcastle upon Tyne, United Kingdom
| | - Samuel Stuart
- Department of Sport, Exercise and Rehabilitation, Northumbria University, Newcastle upon Tyne, United Kingdom
| | - Alan Godfrey
- Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne, United Kingdom
| |
Collapse
|
25
|
Generative Deep Learning Applied to Biomechanics: A New Augmentation Technique for Motion Capture Datasets. J Biomech 2022; 144:111301. [DOI: 10.1016/j.jbiomech.2022.111301] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2021] [Revised: 07/28/2022] [Accepted: 09/06/2022] [Indexed: 11/22/2022]
|
26
|
Mundt M, Oberlack H, Goldacre M, Powles J, Funken J, Morris C, Potthast W, Alderson J. Synthesising 2D Video from 3D Motion Data for Machine Learning Applications. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22176522. [PMID: 36080981 PMCID: PMC9459679 DOI: 10.3390/s22176522] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/17/2022] [Revised: 08/17/2022] [Accepted: 08/25/2022] [Indexed: 05/27/2023]
Abstract
To increase the utility of legacy, gold-standard, three-dimensional (3D) motion capture datasets for computer vision-based machine learning applications, this study proposed and validated a method to synthesise two-dimensional (2D) video image frames from historic 3D motion data. We applied the video-based human pose estimation model OpenPose to real (in situ) and synthesised 2D videos and compared anatomical landmark keypoint outputs, with trivial observed differences (2.11−3.49 mm). We further demonstrated the utility of the method in a downstream machine learning use-case in which we trained and then tested the validity of an artificial neural network (ANN) to estimate ground reaction forces (GRFs) using synthesised and real 2D videos. Training an ANN to estimate GRFs using eight OpenPose keypoints derived from synthesised 2D videos resulted in accurate waveform GRF estimations (r > 0.9; nRMSE < 14%). When compared with using the smaller number of real videos only, accuracy was improved by adding the synthetic views and enlarging the dataset. The results highlight the utility of the developed approach to enlarge small 2D video datasets, or to create 2D video images to accompany 3D motion capture datasets to make them accessible for machine learning applications.
Collapse
Affiliation(s)
- Marion Mundt
- UWA Minderoo Tech & Policy Lab, Law School, The University of Western Australia, Crawley, WA 6009, Australia
| | - Henrike Oberlack
- Institute of General Mechanics, RWTH Aachen University, 52062 Aachen, Germany
| | - Molly Goldacre
- UWA Minderoo Tech & Policy Lab, Law School, The University of Western Australia, Crawley, WA 6009, Australia
| | - Julia Powles
- UWA Minderoo Tech & Policy Lab, Law School, The University of Western Australia, Crawley, WA 6009, Australia
| | - Johannes Funken
- Institute of Biomechanics and Orthopaedics, German Sport University Cologne, 50933 Cologne, Germany
| | - Corey Morris
- UWA Minderoo Tech & Policy Lab, Law School, The University of Western Australia, Crawley, WA 6009, Australia
- School of Human Sciences, The University of Western Australia, Crawley, WA 6009, Australia
| | - Wolfgang Potthast
- Institute of Biomechanics and Orthopaedics, German Sport University Cologne, 50933 Cologne, Germany
| | - Jacqueline Alderson
- UWA Minderoo Tech & Policy Lab, Law School, The University of Western Australia, Crawley, WA 6009, Australia
- Sports Performance Research Institute New Zealand (SPRINZ), Auckland University of Technology, Auckland 1010, New Zealand
| |
Collapse
|
27
|
Xiang L, Wang A, Gu Y, Zhao L, Shim V, Fernandez J. Recent Machine Learning Progress in Lower Limb Running Biomechanics With Wearable Technology: A Systematic Review. Front Neurorobot 2022; 16:913052. [PMID: 35721274 PMCID: PMC9201717 DOI: 10.3389/fnbot.2022.913052] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2022] [Accepted: 05/04/2022] [Indexed: 01/17/2023] Open
Abstract
With the emergence of wearable technology and machine learning approaches, gait monitoring in real-time is attracting interest from the sports biomechanics community. This study presents a systematic review of machine learning approaches in running biomechanics using wearable sensors. Electronic databases were retrieved in PubMed, Web of Science, SPORTDiscus, Scopus, IEEE Xplore, and ScienceDirect. A total of 4,068 articles were identified via electronic databases. Twenty-four articles that met the eligibility criteria after article screening were included in this systematic review. The range of quality scores of the included studies is from 0.78 to 1.00, with 40% of articles recruiting participant numbers between 20 and 50. The number of inertial measurement unit (IMU) placed on the lower limbs varied from 1 to 5, mainly in the pelvis, thigh, distal tibia, and foot. Deep learning algorithms occupied 57% of total machine learning approaches. Convolutional neural networks (CNN) were the most frequently used deep learning algorithm. However, the validation process for machine learning models was lacking in some studies and should be given more attention in future research. The deep learning model combining multiple CNN and recurrent neural networks (RNN) was observed to extract different running features from the wearable sensors and presents a growing trend in running biomechanics.
Collapse
Affiliation(s)
- Liangliang Xiang
- Faculty of Sports Science, Ningbo University, Ningbo, China
- Research Academy of Grand Health, Ningbo University, Ningbo, China
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand
| | - Alan Wang
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand
- Faculty of Medical and Health Sciences, The University of Auckland, Auckland, New Zealand
| | - Yaodong Gu
- Faculty of Sports Science, Ningbo University, Ningbo, China
- Research Academy of Grand Health, Ningbo University, Ningbo, China
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand
| | - Liang Zhao
- Faculty of Sports Science, Ningbo University, Ningbo, China
| | - Vickie Shim
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand
| | - Justin Fernandez
- Research Academy of Grand Health, Ningbo University, Ningbo, China
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand
- Department of Engineering Science, Faculty of Engineering, The University of Auckland, Auckland, New Zealand
| |
Collapse
|
28
|
Tan T, Strout ZA, Cheung RT, Shull PB. Strike index estimation using a convolutional neural network with a single, shoe-mounted inertial sensor. J Biomech 2022; 139:111145. [DOI: 10.1016/j.jbiomech.2022.111145] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Revised: 05/06/2022] [Accepted: 05/06/2022] [Indexed: 10/18/2022]
|
29
|
Estimating Running Ground Reaction Forces from Plantar Pressure during Graded Running. SENSORS 2022; 22:s22093338. [PMID: 35591027 PMCID: PMC9105722 DOI: 10.3390/s22093338] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Revised: 04/18/2022] [Accepted: 04/23/2022] [Indexed: 12/10/2022]
Abstract
Ground reaction forces (GRFs) describe how runners interact with their surroundings and provide the basis for computing inverse dynamics. Wearable technology can predict time−continuous GRFs during walking and running; however, the majority of GRF predictions examine level ground locomotion. The purpose of this manuscript was to predict vertical and anterior–posterior GRFs across different speeds and slopes. Eighteen recreationally active subjects ran on an instrumented treadmill while we collected GRFs and plantar pressure. Subjects ran on level ground at 2.6, 3.0, 3.4, and 3.8 m/s, six degrees inclined at 2.6, 2.8, and 3.0 m/s, and six degrees declined at 2.6, 2.8, 3.0, and 3.4 m/s. We estimated GRFs using a set of linear models and a recurrent neural network, which used speed, slope, and plantar pressure as inputs. We also tested eliminating speed and slope as inputs. The recurrent neural network outperformed the linear model across all conditions, especially with the prediction of anterior–posterior GRFs. Eliminating speed and slope as model inputs had little effect on performance. We also demonstrate that subject−specific model training can reduce errors from 8% to 3%. With such low errors, researchers can use these wearable−based GRFs to understand running performance or injuries in real−world settings.
Collapse
|
30
|
Screening Tests for Assessing Athletes at Risk of ACL Injury or Reinjury-A Scoping Review. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19052864. [PMID: 35270563 PMCID: PMC8910677 DOI: 10.3390/ijerph19052864] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/29/2022] [Revised: 02/25/2022] [Accepted: 02/26/2022] [Indexed: 12/23/2022]
Abstract
Various tests are available to assess athletes for factors associated with their susceptibility and risk of anterior cruciate ligament (ACL) injury or reinjury; however, it is unclear which tests are clinically meaningful and what should be considered when using them. Therefore, the aim of this scoping review was to screen and summarize testing and to derive evidence-based recommendations for clinicians, practitioners and future research. Five databases were searched to identify studies addressing musculoskeletal morphology or functional-performance-related screening tests with a clear conceptual link or an evidence-based relationship to ACL (re)injury. A quality rating was carried out using the National Institutes of Health (NIH) Study-Quality Assessment Tool. Six different categories of common screening tests were identified: balance and postural control, gait- and running-related tests, joint laxity, joint morphology and anthropometrics, jump tests and strength tests. Predicting future injury in a complex, dynamic system based on a single screening test is methodologically challenging, which is also reflected in the highly controversial findings in the literature regarding potential associations between specific screening tests and the occurrence of ACL injuries and reinjuries. Nonetheless, various screening tests can provide clinically relevant information on ACL-(re)injury-related factors and help to provide tailored preventive measures. A selection of corresponding evidence-based recommendations is derived and presented in this scoping review.
Collapse
|
31
|
Low WS, Chan CK, Chuah JH, Tee YK, Hum YC, Salim MIM, Lai KW. A Review of Machine Learning Network in Human Motion Biomechanics. JOURNAL OF GRID COMPUTING 2022; 20:4. [DOI: 10.1007/s10723-021-09595-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/05/2021] [Accepted: 11/28/2021] [Indexed: 07/26/2024]
|
32
|
Harris EJ, Khoo IH, Demircan E. A Survey of Human Gait-Based Artificial Intelligence Applications. Front Robot AI 2022; 8:749274. [PMID: 35047564 PMCID: PMC8762057 DOI: 10.3389/frobt.2021.749274] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2021] [Accepted: 11/01/2021] [Indexed: 12/17/2022] Open
Abstract
We performed an electronic database search of published works from 2012 to mid-2021 that focus on human gait studies and apply machine learning techniques. We identified six key applications of machine learning using gait data: 1) Gait analysis where analyzing techniques and certain biomechanical analysis factors are improved by utilizing artificial intelligence algorithms, 2) Health and Wellness, with applications in gait monitoring for abnormal gait detection, recognition of human activities, fall detection and sports performance, 3) Human Pose Tracking using one-person or multi-person tracking and localization systems such as OpenPose, Simultaneous Localization and Mapping (SLAM), etc., 4) Gait-based biometrics with applications in person identification, authentication, and re-identification as well as gender and age recognition 5) “Smart gait” applications ranging from smart socks, shoes, and other wearables to smart homes and smart retail stores that incorporate continuous monitoring and control systems and 6) Animation that reconstructs human motion utilizing gait data, simulation and machine learning techniques. Our goal is to provide a single broad-based survey of the applications of machine learning technology in gait analysis and identify future areas of potential study and growth. We discuss the machine learning techniques that have been used with a focus on the tasks they perform, the problems they attempt to solve, and the trade-offs they navigate.
Collapse
Affiliation(s)
- Elsa J Harris
- Human Performance and Robotics Laboratory, Department of Mechanical and Aerospace Engineering, California State University Long Beach, Long Beach, CA, United States
| | - I-Hung Khoo
- Department of Electrical Engineering, California State University Long Beach, Long Beach, CA, United States.,Department of Biomedical Engineering, California State University Long Beach, Long Beach, CA, United States
| | - Emel Demircan
- Human Performance and Robotics Laboratory, Department of Mechanical and Aerospace Engineering, California State University Long Beach, Long Beach, CA, United States.,Department of Biomedical Engineering, California State University Long Beach, Long Beach, CA, United States
| |
Collapse
|
33
|
A Study of Athlete Pose Estimation Techniques in Sports Game Videos Combining Multiresidual Module Convolutional Neural Networks. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2021:4367875. [PMID: 34992645 PMCID: PMC8727100 DOI: 10.1155/2021/4367875] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Revised: 11/15/2021] [Accepted: 12/16/2021] [Indexed: 11/29/2022]
Abstract
In this paper, we propose a multiresidual module convolutional neural network-based method for athlete pose estimation in sports game videos. The network firstly designs an improved residual module based on the traditional residual module. Firstly, a large perceptual field residual module is designed to learn the correlation between the athlete components in the sports game video within a large perceptual field. A multiscale residual module is designed in the paper to better solve the inaccuracy of the pose estimation due to the problem of scale change of the athlete components in the sports game video. Secondly, these three residual modules are used as the building blocks of the convolutional neural network. When the resolution is high, the large perceptual field residual module and the multiscale residual module are used to capture information in a larger range as well as at each scale, and when the resolution is low, only the improved residual module is used. Finally, four multiresidual module convolutional neural networks are used to form the final multiresidual module stacked convolutional neural network. The neural network model proposed in this paper achieves high accuracy of 89.5% and 88.2% on the upper arm and lower arm, respectively, so the method in this paper reduces the influence of occlusion on the athlete's posture estimation to a certain extent. Through the experiments, it can be seen that the proposed multiresidual module stacked convolutional neural network-based method for athlete pose estimation in sports game videos further improves the accuracy of athlete pose estimation in sports game videos.
Collapse
|
34
|
Alcantara RS, Edwards WB, Millet GY, Grabowski AM. Predicting continuous ground reaction forces from accelerometers during uphill and downhill running: a recurrent neural network solution. PeerJ 2022; 10:e12752. [PMID: 35036107 PMCID: PMC8740512 DOI: 10.7717/peerj.12752] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2021] [Accepted: 12/15/2021] [Indexed: 01/07/2023] Open
Abstract
BACKGROUND Ground reaction forces (GRFs) are important for understanding human movement, but their measurement is generally limited to a laboratory environment. Previous studies have used neural networks to predict GRF waveforms during running from wearable device data, but these predictions are limited to the stance phase of level-ground running. A method of predicting the normal (perpendicular to running surface) GRF waveform using wearable devices across a range of running speeds and slopes could allow researchers and clinicians to predict kinetic and kinematic variables outside the laboratory environment. PURPOSE We sought to develop a recurrent neural network capable of predicting continuous normal (perpendicular to surface) GRFs across a range of running speeds and slopes from accelerometer data. METHODS Nineteen subjects ran on a force-measuring treadmill at five slopes (0°, ±5°, ±10°) and three speeds (2.5, 3.33, 4.17 m/s) per slope with sacral- and shoe-mounted accelerometers. We then trained a recurrent neural network to predict normal GRF waveforms frame-by-frame. The predicted versus measured GRF waveforms had an average ± SD RMSE of 0.16 ± 0.04 BW and relative RMSE of 6.4 ± 1.5% across all conditions and subjects. RESULTS The recurrent neural network predicted continuous normal GRF waveforms across a range of running speeds and slopes with greater accuracy than neural networks implemented in previous studies. This approach may facilitate predictions of biomechanical variables outside the laboratory in near real-time and improves the accuracy of quantifying and monitoring external forces experienced by the body when running.
Collapse
Affiliation(s)
- Ryan S. Alcantara
- Department of Integrative Physiology, University of Colorado Boulder, Boulder, CO, United States of America, Current affiliation: Department of Bioengineering, Stanford University, Stanford, CA, United States of America
| | - W. Brent Edwards
- Human Performance Laboratory, Faculty of Kinesiology, University of Calgary, Calgary, Alberta, Canada
| | - Guillaume Y. Millet
- Laboratoire Interuniversitaire de Biologie de la Motricité, Université Lyon, UJM-Saint-Etienne, Saint-Etienne, France
| | - Alena M. Grabowski
- Department of Integrative Physiology, University of Colorado Boulder, Boulder, CO, United States of America
| |
Collapse
|
35
|
Weir G. Anterior cruciate ligament injury prevention in sport: biomechanically informed approaches. Sports Biomech 2021:1-21. [PMID: 34965847 DOI: 10.1080/14763141.2021.2016925] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/27/2021] [Accepted: 12/06/2021] [Indexed: 01/14/2023]
Abstract
This paper reviews a series of studies contributing to a framework for preventing anterior cruciate ligament (ACL) injuries in sport. As the majority of these injuries are non-contact in nature, theoretically, these injuries are preventable. The studies presented in this paper focus on understanding biomechanical countermeasures of ACL injury and how this knowledge can inform both screening and training intervention research and practice in sport. These countermeasures include: 1) modifying an athlete's technique to reduce externally applied loads to the knee; 2) increasing the muscle support around the knee and hip to counter elevated loads applied to the knee and; 3) improving an athlete's perception during dynamic sports tasks to increase planning time to coordinate desirable movement patterns. By furthering the empirical evidence of modifiable biomechanical countermeasures of ACL injury risk, we can better understand best practices for developing interventions on a mass scale to prevent ACL injuries in the sporting community.
Collapse
Affiliation(s)
- Gillian Weir
- Biomechanics Laboratory, University of Massachusetts, Amherst, MA, USA
- School of Human Sciences, University of Western Australia, Perth, Australia
| |
Collapse
|
36
|
Diamond LE, Barrett RS, Modenese L, Anderson AE, Hall M. Editorial: Neuromechanics of Hip Osteoarthritis. Front Sports Act Living 2021; 3:788263. [PMID: 34859205 PMCID: PMC8631320 DOI: 10.3389/fspor.2021.788263] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Accepted: 10/20/2021] [Indexed: 11/17/2022] Open
Affiliation(s)
- Laura E Diamond
- Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, QLD, Australia.,School of Health Sciences and Social Work, Griffith University, Gold Coast, QLD, Australia
| | - Rod S Barrett
- Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, QLD, Australia.,School of Health Sciences and Social Work, Griffith University, Gold Coast, QLD, Australia
| | - Luca Modenese
- Department of Civil and Environmental Engineering, Imperial College London, London, United Kingdom
| | - Andrew E Anderson
- University of Utah Motion Capture Core Facility, University of Utah, Salt Lake City, UT, United States
| | - Michelle Hall
- Centre for Health, Exercise and Sports Medicine, The University of Melbourne, Melbourne, VIC, Australia
| |
Collapse
|
37
|
Lam SK, Vujaklija I. Joint Torque Prediction via Hybrid Neuromusculoskeletal Modelling during Gait Using Statistical Ground Reaction Estimates: An Exploratory Study. SENSORS 2021; 21:s21196597. [PMID: 34640917 PMCID: PMC8512679 DOI: 10.3390/s21196597] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Revised: 09/27/2021] [Accepted: 09/28/2021] [Indexed: 01/03/2023]
Abstract
Joint torques of lower extremity are important clinical indicators of gait capability. This parameter can be quantified via hybrid neuromusculoskeletal modelling that combines electromyography-driven modelling and static optimisation. The simulations rely on kinematics and external force measurements, for example, ground reaction forces (GRF) and the corresponding centres of pressure (COP), which are conventionally acquired using force plates. This bulky equipment, however, hinders gait analysis in real-world environments. While this portability issue could potentially be solved by estimating the parameters through machine learning, the effect of the estimation errors on joint torque prediction with biomechanical models remains to be investigated. This study first estimated GRF and COP through feedforward artificial neural networks, and then leveraged them to predict lower-limb sagittal joint torques via (i) inverse dynamics and (ii) hybrid modelling. The approach was evaluated on five healthy subjects, individually. The predicted torques were validated with the measured torques, showing that hip was the most sensitive whereas ankle was the most resistive to the GRF/COP estimates for both models, with average metrics values being 0.70 < R2 < 0.97 and 0.069 < RMSE < 0.15 (Nm/kg). This study demonstrated the feasibility of torque prediction based on personalised (neuro)musculoskeletal modelling using statistical ground reaction estimates, thus providing insights into potential real-world mobile joint torque quantification.
Collapse
|
38
|
Both a single sacral marker and the whole-body center of mass accurately estimate peak vertical ground reaction force in running. Gait Posture 2021; 89:186-192. [PMID: 34325223 DOI: 10.1016/j.gaitpost.2021.07.013] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/17/2021] [Revised: 07/20/2021] [Accepted: 07/22/2021] [Indexed: 02/02/2023]
Abstract
BACKGROUND While running, the human body absorbs repetitive shocks with every step. These shocks can be quantified by the peak vertical ground reaction force (Fv,max). To measure so, using a force plate is the gold standard method (GSM), but not always at hand. In this case, a motion capture system might be an alternative if it accurately estimates Fv,max. RESEARCH QUESTION The purpose of this study was to estimate Fv,max based on motion capture data and validate the obtained estimates with force plate-based measures. METHODS One hundred and fifteen runners participated at this study and ran at 9, 11, and 13 km/h. Force data (1000 Hz) and whole-body kinematics (200 Hz) were acquired with an instrumented treadmill and an optoelectronic system, respectively. The vertical ground reaction force was reconstructed from either the whole-body center of mass (COM-M) or sacral marker (SACR-M) accelerations, calculated as the second derivative of their respective positions, and further low-pass filtered using several cutoff frequencies (2-20 Hz) and a fourth-order Butterworth filter. RESULTS The most accurate estimations of Fv,max were obtained using 5 and 4 Hz cutoff frequencies for the filtering of COM and sacral marker accelerations, respectively. GSM, COM-M, and SACR-M were not significantly different at 11 km/h but were at 9 and 13 km/h. The comparison between GSM and COM-M or SACR-M for each speed depicted root mean square error (RMSE) smaller or equal to 0.17BW (≤6.5 %) and no systematic bias at 11 km/h but small systematic biases at 9 and 13 km/h (≤0.09 BW). COM-M gave systematic biases three times smaller than SACR-M and two times smaller RMSE. SIGNIFICANCE The findings of this study support the use of either COM-M or SACR-M using data filtered at 5 and 4 Hz, respectively, to estimate Fv,max during level treadmill runs at endurance speeds.
Collapse
|
39
|
Sharifi Renani M, Eustace AM, Myers CA, Clary CW. The Use of Synthetic IMU Signals in the Training of Deep Learning Models Significantly Improves the Accuracy of Joint Kinematic Predictions. SENSORS 2021; 21:s21175876. [PMID: 34502766 PMCID: PMC8434290 DOI: 10.3390/s21175876] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/10/2021] [Revised: 08/17/2021] [Accepted: 08/27/2021] [Indexed: 11/24/2022]
Abstract
Gait analysis based on inertial sensors has become an effective method of quantifying movement mechanics, such as joint kinematics and kinetics. Machine learning techniques are used to reliably predict joint mechanics directly from streams of IMU signals for various activities. These data-driven models require comprehensive and representative training datasets to be generalizable across the movement variability seen in the population at large. Bottlenecks in model development frequently occur due to the lack of sufficient training data and the significant time and resources necessary to acquire these datasets. Reliable methods to generate synthetic biomechanical training data could streamline model development and potentially improve model performance. In this study, we developed a methodology to generate synthetic kinematics and the associated predicted IMU signals using open source musculoskeletal modeling software. These synthetic data were used to train neural networks to predict three degree-of-freedom joint rotations at the hip and knee during gait either in lieu of or along with previously measured experimental gait data. The accuracy of the models’ kinematic predictions was assessed using experimentally measured IMU signals and gait kinematics. Models trained using the synthetic data out-performed models using only the experimental data in five of the six rotational degrees of freedom at the hip and knee. On average, root mean square errors in joint angle predictions were improved by 38% at the hip (synthetic data RMSE: 2.3°, measured data RMSE: 4.5°) and 11% at the knee (synthetic data RMSE: 2.9°, measured data RMSE: 3.3°), when models trained solely on synthetic data were compared to measured data. When models were trained on both measured and synthetic data, root mean square errors were reduced by 54% at the hip (measured + synthetic data RMSE: 1.9°) and 45% at the knee (measured + synthetic data RMSE: 1.7°), compared to measured data alone. These findings enable future model development for different activities of clinical significance without the burden of generating large quantities of gait lab data for model training, streamlining model development, and ultimately improving model performance.
Collapse
|
40
|
Mundt M, Johnson WR, Potthast W, Markert B, Mian A, Alderson J. A Comparison of Three Neural Network Approaches for Estimating Joint Angles and Moments from Inertial Measurement Units. SENSORS 2021; 21:s21134535. [PMID: 34283080 PMCID: PMC8271391 DOI: 10.3390/s21134535] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Revised: 06/24/2021] [Accepted: 06/28/2021] [Indexed: 11/23/2022]
Abstract
The application of artificial intelligence techniques to wearable sensor data may facilitate accurate analysis outside of controlled laboratory settings—the holy grail for gait clinicians and sports scientists looking to bridge the lab to field divide. Using these techniques, parameters that are difficult to directly measure in-the-wild, may be predicted using surrogate lower resolution inputs. One example is the prediction of joint kinematics and kinetics based on inputs from inertial measurement unit (IMU) sensors. Despite increased research, there is a paucity of information examining the most suitable artificial neural network (ANN) for predicting gait kinematics and kinetics from IMUs. This paper compares the performance of three commonly employed ANNs used to predict gait kinematics and kinetics: multilayer perceptron (MLP); long short-term memory (LSTM); and convolutional neural networks (CNN). Overall high correlations between ground truth and predicted kinematic and kinetic data were found across all investigated ANNs. However, the optimal ANN should be based on the prediction task and the intended use-case application. For the prediction of joint angles, CNNs appear favourable, however these ANNs do not show an advantage over an MLP network for the prediction of joint moments. If real-time joint angle and joint moment prediction is desirable an LSTM network should be utilised.
Collapse
Affiliation(s)
- Marion Mundt
- Minderoo Tech and Policy Lab, UWA Law School, The University of Western Australia, Crawley 6009, Australia;
- Correspondence:
| | | | - Wolfgang Potthast
- Institute of Biomechanics and Orthopeadics, German Sport University Cologne, 50933 Cologne, Germany;
| | - Bernd Markert
- Institute of General Mechanics, RWTH Aachen University, 52062 Aachen, Germany;
| | - Ajmal Mian
- School of Computer Science and Software Engineering, The University of Western Australia, Crawley 6009, Australia;
| | - Jacqueline Alderson
- Minderoo Tech and Policy Lab, UWA Law School, The University of Western Australia, Crawley 6009, Australia;
- Sports Performance Research Institute New Zealand (SPRINZ), Auckland University of Technology, Auckland 1010, New Zealand
| |
Collapse
|
41
|
A Wearable System for the Estimation of Performance-Related Metrics during Running and Jumping Tasks. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11115258] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Abstract
Athletic performance, technique assessment, and injury prevention are all important aspects in sports for both professional and amateur athletes. Wearable technology is attracting the research community’s interest because of its capability to provide real-time biofeedback to coaches and athletes when on the field and outside of more restrictive laboratory conditions. In this paper, a novel wearable motion sensor-based system has been designed and developed for athletic performance assessment during running and jumping tasks. The system consists of a number of components involving embedded systems (hardware and software), back-end analytics, information and communications technology (ICT) platforms, and a graphical user interface for data visualization by the coach. The system is able to provide automatic activity recognition, estimation of running and jumping metrics, as well as vertical ground reaction force (GRF) predictions, with sufficient accuracy to provide valuable information as regards training outcomes. The developed system is low-power, sufficiently small for real-world scenarios, easy to use, and achieves the specified communication range. The system’s high sampling rate, levels of accuracy and performance enables it as a performance evaluation tool able to support coaches and athletes in their real-world practice.
Collapse
|
42
|
Li F, Martínez OS, Aiswarya RS. Internet of things-based smart wearable system to monitor sports person health. Technol Health Care 2021; 29:1249-1262. [PMID: 34092674 DOI: 10.3233/thc-213004] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023]
Abstract
BACKGROUND The modern Internet of Things (IoT) makes small devices that can sense, process, interact, connect devices, and other sensors ready to understand the environment. IoT technologies and intelligent health apps have multiplied. The main challenges in the sports environment are playing without injuries and healthily. OBJECTIVE In this paper the Internet of Things-based Smart Wearable System (IoT-SWS) is introduced for monitoring sports person activity to improve sports person health and performance in a healthy way. METHOD Wearable systems are commonly used to capture individual sports details on a real-time basis. Collecting data from wearable devices and IoT technologies can help organizations learn how to optimize in-game strategies, identify opponents' vulnerabilities, and make smarter draft choices and trading decisions for a sportsperson. RESULTS The experimental result shows that IoT-SWS achieve the highest accuracy of 98.22% and efficient in predicting the sports person's health to improve sports person performance reliably.
Collapse
Affiliation(s)
- Fen Li
- Sports Department, Chongqing Jiaotong University, Chongqing, China
| | | | - R S Aiswarya
- Department of VLSI, KPR Institute of Engineering and Technology, India
| |
Collapse
|
43
|
Alcantara RS, Day EM, Hahn ME, Grabowski AM. Sacral acceleration can predict whole-body kinetics and stride kinematics across running speeds. PeerJ 2021; 9:e11199. [PMID: 33954039 PMCID: PMC8048400 DOI: 10.7717/peerj.11199] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2020] [Accepted: 03/10/2021] [Indexed: 12/31/2022] Open
Abstract
Background Stress fractures are injuries caused by repetitive loading during activities such as running. The application of advanced analytical methods such as machine learning to data from multiple wearable sensors has allowed for predictions of biomechanical variables associated with running-related injuries like stress fractures. However, it is unclear if data from a single wearable sensor can accurately estimate variables that characterize external loading during running such as peak vertical ground reaction force (vGRF), vertical impulse, and ground contact time. Predicting these biomechanical variables with a single wearable sensor could allow researchers, clinicians, and coaches to longitudinally monitor biomechanical running-related injury risk factors without expensive force-measuring equipment. Purpose We quantified the accuracy of applying quantile regression forest (QRF) and linear regression (LR) models to sacral-mounted accelerometer data to predict peak vGRF, vertical impulse, and ground contact time across a range of running speeds. Methods Thirty-seven collegiate cross country runners (24 females, 13 males) ran on a force-measuring treadmill at 3.8-5.4 m/s while wearing an accelerometer clipped posteriorly to the waistband of their running shorts. We cross-validated QRF and LR models by training them on acceleration data, running speed, step frequency, and body mass as predictor variables. Trained models were then used to predict peak vGRF, vertical impulse, and contact time. We compared predicted values to those calculated from a force-measuring treadmill on a subset of data (n = 9) withheld during model training. We quantified prediction accuracy by calculating the root mean square error (RMSE) and mean absolute percentage error (MAPE). Results The QRF model predicted peak vGRF with a RMSE of 0.150 body weights (BW) and MAPE of 4.27 ± 2.85%, predicted vertical impulse with a RMSE of 0.004 BW*s and MAPE of 0.80 ± 0.91%, and predicted contact time with a RMSE of 0.011 s and MAPE of 4.68 ± 3.00%. The LR model predicted peak vGRF with a RMSE of 0.139 BW and MAPE of 4.04 ± 2.57%, predicted vertical impulse with a RMSE of 0.002 BW*s and MAPE of 0.50 ± 0.42%, and predicted contact time with a RMSE of 0.008 s and MAPE of 3.50 ± 2.27%. There were no statistically significant differences between QRF and LR model prediction MAPE for peak vGRF (p = 0.549) or vertical impulse (p = 0.073), but the LR model's MAPE for contact time was significantly lower than the QRF model's MAPE (p = 0.0497). Conclusions Our findings indicate that the QRF and LR models can accurately predict peak vGRF, vertical impulse, and contact time (MAPE < 5%) from a single sacral-mounted accelerometer across a range of running speeds. These findings may be beneficial for researchers, clinicians, or coaches seeking to monitor running-related injury risk factors without force-measuring equipment.
Collapse
Affiliation(s)
- Ryan S Alcantara
- Department of Integrative Physiology, University of Colorado Boulder, Boulder, CO, United States of America
| | - Evan M Day
- Department of Human Physiology, University of Oregon, Eugene, OR, United States of America
| | - Michael E Hahn
- Department of Human Physiology, University of Oregon, Eugene, OR, United States of America
| | - Alena M Grabowski
- Department of Integrative Physiology, University of Colorado Boulder, Boulder, CO, United States of America
| |
Collapse
|
44
|
Sharma D, Davidson P, Müller P, Piché R. Indirect Estimation of Vertical Ground Reaction Force from a Body-Mounted INS/GPS Using Machine Learning. SENSORS 2021; 21:s21041553. [PMID: 33672353 PMCID: PMC7926815 DOI: 10.3390/s21041553] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/18/2020] [Revised: 02/05/2021] [Accepted: 02/17/2021] [Indexed: 11/16/2022]
Abstract
Vertical ground reaction force (vGRF) can be measured by force plates or instrumented treadmills, but their application is limited to indoor environments. Insoles remove this restriction but suffer from low durability (several hundred hours). Therefore, interest in the indirect estimation of vGRF using inertial measurement units and machine learning techniques has increased. This paper presents a methodology for indirectly estimating vGRF and other features used in gait analysis from measurements of a wearable GPS-aided inertial navigation system (INS/GPS) device. A set of 27 features was extracted from the INS/GPS data. Feature analysis showed that six of these features suffice to provide precise estimates of 11 different gait parameters. Bagged ensembles of regression trees were then trained and used for predicting gait parameters for a dataset from the test subject from whom the training data were collected and for a dataset from a subject for whom no training data were available. The prediction accuracies for the latter were significantly worse than for the first subject but still sufficiently good. K-nearest neighbor (KNN) and long short-term memory (LSTM) neural networks were then used for predicting vGRF and ground contact times. The KNN yielded a lower normalized root mean square error than the neural network for vGRF predictions but cannot detect new patterns in force curves.
Collapse
Affiliation(s)
- Dharmendra Sharma
- VTT Technical Research Centre of Finland, Kaitoväylä 1, 90570 Oulu, Finland;
| | - Pavel Davidson
- Faculty of Information Technology and Communication Sciences, Tampere University, 33720 Tampere, Finland; (P.D.); (R.P.)
| | - Philipp Müller
- Faculty of Information Technology and Communication Sciences, Tampere University, 33720 Tampere, Finland; (P.D.); (R.P.)
- Correspondence: ; Tel.: +358-50-343-3369
| | - Robert Piché
- Faculty of Information Technology and Communication Sciences, Tampere University, 33720 Tampere, Finland; (P.D.); (R.P.)
| |
Collapse
|
45
|
Liu Q, Mo S, Cheung VCK, Cheung BMF, Wang S, Chan PPK, Malhotra A, Cheung RTH, Chan RHM. Classification of runners' performance levels with concurrent prediction of biomechanical parameters using data from inertial measurement units. J Biomech 2020; 112:110072. [PMID: 33075666 DOI: 10.1016/j.jbiomech.2020.110072] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2020] [Revised: 09/14/2020] [Accepted: 09/23/2020] [Indexed: 11/16/2022]
Abstract
Identification of runner's performance level is critical to coaching, performance enhancement and injury prevention. Machine learning techniques have been developed to measure biomechanical parameters with body-worn inertial measurement unit (IMU) sensors. However, a robust method to classify runners is still unavailable. In this paper, we developed two models to classify running performance and predict biomechanical parameters of 30 subjects. We named the models RunNet-CNN and RunNet-MLP based on their architectures: convolutional neural network (CNN) and multilayer perceptron (MLP), respectively. In addition, we examined two validation approaches, subject-wise (leave-one-subject-out) and record-wise. RunNet-MLP classified runner's performance levels with an overall accuracy of 97.1%. Our results also showed that RunNet-CNN outperformed RunNet-MLP and gradient boosting decision tree in predicting biomechanical parameters. RunNet-CNN showed good agreement (R2 > 0.9) with the ground-truth reference on biomechanical parameters. The prediction accuracy for the record-wise method was better than the subject-wise method regardless of biomechanical parameters or models. Our findings showed the viability of using IMUs to produce reliable prediction of runners' performance levels and biomechanical parameters.
Collapse
Affiliation(s)
- Qi Liu
- Department of Electrical Engineering, City University of Hong Kong, Hong Kong SAR
| | - Shiwei Mo
- Division of Sports Science and Physical Education, Shenzhen University, China; Gait & Motion Analysis Laboratory, Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong SAR
| | - Vincent C K Cheung
- School of Biomedical Sciences, and The Gerald Choa Neuroscience Centre, The Chinese University of Hong Kong, Hong Kong SAR
| | | | - Shuotong Wang
- Gait & Motion Analysis Laboratory, Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong SAR
| | - Peter P K Chan
- Gait & Motion Analysis Laboratory, Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong SAR; School of Biomedical Sciences, and The Gerald Choa Neuroscience Centre, The Chinese University of Hong Kong, Hong Kong SAR
| | - Akash Malhotra
- Gait & Motion Analysis Laboratory, Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong SAR
| | - Roy T H Cheung
- Gait & Motion Analysis Laboratory, Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong SAR; School of Health Sciences, Western Sydney University, Australia.
| | - Rosa H M Chan
- Department of Electrical Engineering, City University of Hong Kong, Hong Kong SAR.
| |
Collapse
|
46
|
Pizzolato C, Shim VB, Lloyd DG, Devaprakash D, Obst SJ, Newsham-West R, Graham DF, Besier TF, Zheng MH, Barrett RS. Targeted Achilles Tendon Training and Rehabilitation Using Personalized and Real-Time Multiscale Models of the Neuromusculoskeletal System. Front Bioeng Biotechnol 2020; 8:878. [PMID: 32903393 PMCID: PMC7434842 DOI: 10.3389/fbioe.2020.00878] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2020] [Accepted: 07/09/2020] [Indexed: 12/16/2022] Open
Abstract
Musculoskeletal tissues, including tendons, are sensitive to their mechanical environment, with both excessive and insufficient loading resulting in reduced tissue strength. Tendons appear to be particularly sensitive to mechanical strain magnitude, and there appears to be an optimal range of tendon strain that results in the greatest positive tendon adaptation. At present, there are no tools that allow localized tendon strain to be measured or estimated in training or a clinical environment. In this paper, we first review the current literature regarding Achilles tendon adaptation, providing an overview of the individual technologies that so far have been used in isolation to understand in vivo Achilles tendon mechanics, including 3D tendon imaging, motion capture, personalized neuromusculoskeletal rigid body models, and finite element models. We then describe how these technologies can be integrated in a novel framework to provide real-time feedback of localized Achilles tendon strain during dynamic motor tasks. In a proof of concept application, Achilles tendon localized strains were calculated in real-time for a single subject during walking, single leg hopping, and eccentric heel drop. Data was processed at 250 Hz and streamed on a smartphone for visualization. Achilles tendon peak localized strains ranged from ∼3 to ∼11% for walking, ∼5 to ∼15% during single leg hop, and ∼2 to ∼9% during single eccentric leg heel drop, overall showing large strain variation within the tendon. Our integrated framework connects, across size scales, knowledge from isolated tendons and whole-body biomechanics, and offers a new approach to Achilles tendon rehabilitation and training. A key feature is personalization of model components, such as tendon geometry, material properties, muscle geometry, muscle-tendon paths, moment arms, muscle activation, and movement patterns, all of which have the potential to affect tendon strain estimates. Model personalization is important because tendon strain can differ substantially between individuals performing the same exercise due to inter-individual differences in these model components.
Collapse
Affiliation(s)
- Claudio Pizzolato
- School of Allied Health Sciences, Griffith University, Gold Coast, QLD, Australia.,Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, QLD, Australia
| | - Vickie B Shim
- School of Allied Health Sciences, Griffith University, Gold Coast, QLD, Australia.,Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand
| | - David G Lloyd
- School of Allied Health Sciences, Griffith University, Gold Coast, QLD, Australia.,Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, QLD, Australia
| | - Daniel Devaprakash
- School of Allied Health Sciences, Griffith University, Gold Coast, QLD, Australia.,Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, QLD, Australia
| | - Steven J Obst
- School of Allied Health Sciences, Griffith University, Gold Coast, QLD, Australia.,School of Health, Medical and Applied Sciences, Central Queensland University, Bundaberg, QLD, Australia
| | - Richard Newsham-West
- School of Allied Health Sciences, Griffith University, Gold Coast, QLD, Australia
| | - David F Graham
- School of Allied Health Sciences, Griffith University, Gold Coast, QLD, Australia.,Department of Health and Human Development, Montana State University, Bozeman, MT, United States
| | - Thor F Besier
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand
| | - Ming Hao Zheng
- Centre for Orthopaedic Translational Research, School of Surgery, The University of Western Australia, Nedlands, WA, Australia
| | - Rod S Barrett
- School of Allied Health Sciences, Griffith University, Gold Coast, QLD, Australia.,Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, QLD, Australia
| |
Collapse
|