1
|
Coll I, Mavor MP, Karakolis T, Graham RB, Clouthier AL. Validation of Markerless Motion Capture for Soldier Movement Patterns Assessment Under Varying Body-Borne Loads. Ann Biomed Eng 2024:10.1007/s10439-024-03622-w. [PMID: 39375307 DOI: 10.1007/s10439-024-03622-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Accepted: 09/13/2024] [Indexed: 10/09/2024]
Abstract
Field performance of modern soldiers is affected by an increase in body-borne load due to technological advancements related to their armour and equipment. In this project, the Theia3D markerless motion capture system was compared to the marker-based gold standard for capturing movement patterns of participants wearing various body-borne loads. The aim was to estimate lower body joint kinematics, gastrocnemius lateralis and medialis muscle activation patterns, and lower body joint reaction forces from the two motion capture systems. Data were collected on 16 participants performing three repetitions of walking and running under four body-borne load conditions by both motion capture systems simultaneously. A complete musculoskeletal analysis was completed in OpenSim. Strong correlations ( r > 0.8 ) and acceptable differences were observed between the kinematics of the marker-based and markerless systems. Timing of muscle activations of the gastrocnemius lateralis and medialis, as estimated through OpenSim from both systems, agreed with the ones measured using electromyography. Joint reaction force results showed a very strong correlation ( r > 0.9 ) between the systems; however, the markerless model estimated greater joint reaction forces when compared the marker-based model due to differences in muscle recruitment strategy. Overall, this research highlights the potential of markerless motion capture to track participants wearing body-borne loads.
Collapse
Affiliation(s)
- Isabel Coll
- Ottawa-Carleton Institute of Biomedical Engineering (OCIBME), Faculty of Engineering, University of Ottawa, 75 Laurier Ave. E, Ottawa, ON, K1N 6N5, Canada.
| | - Matthew P Mavor
- School of Human Kinetics, University of Ottawa, 75 Laurier Ave. E, Ottawa, ON, K1N 6N5, Canada
| | - Thomas Karakolis
- Defence Research and Development Canada - Toronto Research Centre, 1133 Sheppard Ave. W, Toronto, ON, M3K 2C9, Canada
| | - Ryan B Graham
- Ottawa-Carleton Institute of Biomedical Engineering (OCIBME), Faculty of Engineering, University of Ottawa, 75 Laurier Ave. E, Ottawa, ON, K1N 6N5, Canada
- School of Human Kinetics, University of Ottawa, 75 Laurier Ave. E, Ottawa, ON, K1N 6N5, Canada
| | - Allison L Clouthier
- Ottawa-Carleton Institute of Biomedical Engineering (OCIBME), Faculty of Engineering, University of Ottawa, 75 Laurier Ave. E, Ottawa, ON, K1N 6N5, Canada
- School of Human Kinetics, University of Ottawa, 75 Laurier Ave. E, Ottawa, ON, K1N 6N5, Canada
| |
Collapse
|
2
|
Sagasser S, Sauer A, Thorwächter C, Weber JG, Maas A, Woiczinski M, Grupp TM, Ortigas-Vásquez A. Validation of Inertial-Measurement-Unit-Based Ex Vivo Knee Kinematics during a Loaded Squat before and after Reference-Frame-Orientation Optimisation. SENSORS (BASEL, SWITZERLAND) 2024; 24:3324. [PMID: 38894115 PMCID: PMC11174694 DOI: 10.3390/s24113324] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/30/2024] [Revised: 05/14/2024] [Accepted: 05/21/2024] [Indexed: 06/21/2024]
Abstract
Recently, inertial measurement units have been gaining popularity as a potential alternative to optical motion capture systems in the analysis of joint kinematics. In a previous study, the accuracy of knee joint angles calculated from inertial data and an extended Kalman filter and smoother algorithm was tested using ground truth data originating from a joint simulator guided by fluoroscopy-based signals. Although high levels of accuracy were achieved, the experimental setup leveraged multiple iterations of the same movement pattern and an absence of soft tissue artefacts. Here, the algorithm is tested against an optical marker-based system in a more challenging setting, with single iterations of a loaded squat cycle simulated on seven cadaveric specimens on a force-controlled knee rig. Prior to the optimisation of local coordinate systems using the REference FRame Alignment MEthod (REFRAME) to account for the effect of differences in local reference frame orientation, root-mean-square errors between the kinematic signals of the inertial and optical systems were as high as 3.8° ± 3.5° for flexion/extension, 20.4° ± 10.0° for abduction/adduction and 8.6° ± 5.7° for external/internal rotation. After REFRAME implementation, however, average root-mean-square errors decreased to 0.9° ± 0.4° and to 1.5° ± 0.7° for abduction/adduction and for external/internal rotation, respectively, with a slight increase to 4.2° ± 3.6° for flexion/extension. While these results demonstrate promising potential in the approach's ability to estimate knee joint angles during a single loaded squat cycle, they highlight the limiting effects that a reduced number of iterations and the lack of a reliable consistent reference pose inflicts on the sensor fusion algorithm's performance. They similarly stress the importance of adapting underlying assumptions and correctly tuning filter parameters to ensure satisfactory performance. More importantly, our findings emphasise the notable impact that properly aligning reference-frame orientations before comparing joint kinematics can have on results and the conclusions derived from them.
Collapse
Affiliation(s)
- Svenja Sagasser
- Research and Development, Aesculap AG, 78532 Tuttlingen, Germany (A.M.); (T.M.G.); (A.O.-V.)
| | - Adrian Sauer
- Research and Development, Aesculap AG, 78532 Tuttlingen, Germany (A.M.); (T.M.G.); (A.O.-V.)
- Department of Orthopaedic and Trauma Surgery, Musculoskeletal University Center Munich (MUM), Campus Grosshadern, Ludwig Maximilians University Munich, 81377 Munich, Germany; (C.T.); (M.W.)
| | - Christoph Thorwächter
- Department of Orthopaedic and Trauma Surgery, Musculoskeletal University Center Munich (MUM), Campus Grosshadern, Ludwig Maximilians University Munich, 81377 Munich, Germany; (C.T.); (M.W.)
| | - Jana G. Weber
- Research and Development, Aesculap AG, 78532 Tuttlingen, Germany (A.M.); (T.M.G.); (A.O.-V.)
| | - Allan Maas
- Research and Development, Aesculap AG, 78532 Tuttlingen, Germany (A.M.); (T.M.G.); (A.O.-V.)
- Department of Orthopaedic and Trauma Surgery, Musculoskeletal University Center Munich (MUM), Campus Grosshadern, Ludwig Maximilians University Munich, 81377 Munich, Germany; (C.T.); (M.W.)
| | - Matthias Woiczinski
- Department of Orthopaedic and Trauma Surgery, Musculoskeletal University Center Munich (MUM), Campus Grosshadern, Ludwig Maximilians University Munich, 81377 Munich, Germany; (C.T.); (M.W.)
- Experimental Orthopaedics University Hospital Jena, Campus Eisenberg, Waldkliniken Eisenberg, 07607 Eisenberg, Germany
| | - Thomas M. Grupp
- Research and Development, Aesculap AG, 78532 Tuttlingen, Germany (A.M.); (T.M.G.); (A.O.-V.)
- Department of Orthopaedic and Trauma Surgery, Musculoskeletal University Center Munich (MUM), Campus Grosshadern, Ludwig Maximilians University Munich, 81377 Munich, Germany; (C.T.); (M.W.)
| | - Ariana Ortigas-Vásquez
- Research and Development, Aesculap AG, 78532 Tuttlingen, Germany (A.M.); (T.M.G.); (A.O.-V.)
- Department of Orthopaedic and Trauma Surgery, Musculoskeletal University Center Munich (MUM), Campus Grosshadern, Ludwig Maximilians University Munich, 81377 Munich, Germany; (C.T.); (M.W.)
| |
Collapse
|
3
|
Couvertier M, Pacher L, Fradet L. Does IMU redundancy improve multi-body optimization results to obtain lower-body kinematics? A preliminary study says no. J Biomech 2024; 168:112091. [PMID: 38640829 DOI: 10.1016/j.jbiomech.2024.112091] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Revised: 03/14/2024] [Accepted: 04/09/2024] [Indexed: 04/21/2024]
Abstract
Inertial Measurement Units (IMUs) have been proposed as an ecological alternative to optoelectronic systems for obtaining human body joint kinematics. Tremendous work has been done to reduce differences between kinematics obtained with IMUs and optoelectronic systems, by improving sensor-to-segment calibration, fusion algorithms, and by using Multibody Kinematics Optimization (MKO). However, these improvements seem to reach a barrier, particularly on transverse and frontal planes. Inspired by marker-based MKO approach performed via OpenSim, this study proposes to test whether IMU redundancy with MKO could improve lower-limb kinematics obtained from IMUs. For this study, five subjects were equipped with 11 IMUs and 30 reflective markers tracked by 18 optoelectronic cameras. They then performed gait, cycling, and running actions. Four different lower-limb kinematics were computed: one kinematics based on markers after MKO, one kinematics based on IMUs without MKO, and two based on IMUs after MKO performed with OpenSense (one with, and one without, sensor redundancy). Kinematics were compared via Root Mean Square Difference and correlation coefficients to kinematics based on markers after MKO. Results showed that redundancy does not reduce differences with the kinematics based on markers after MKO on frontal and transverse planes comparatively to classic IMU MKO. Sensor redundancy does not seem to impact lower-limb kinematics on frontal and transverse planes, due to the likelihood of the "rigid component" of soft-tissue artefact impacting all sensors located on one segment.
Collapse
Affiliation(s)
- Marien Couvertier
- Equipe RoBioSS, Institut PPRIME, UPR3346 CNRS Université de Poitiers ISAE ENSMA, 11 boulevard Marie et Pierre Curie, Site du Futuroscope TSA 41123, 86073 Poitiers Cedex 9, France.
| | - Léonie Pacher
- Equipe RoBioSS, Institut PPRIME, UPR3346 CNRS Université de Poitiers ISAE ENSMA, 11 boulevard Marie et Pierre Curie, Site du Futuroscope TSA 41123, 86073 Poitiers Cedex 9, France
| | - Laetitia Fradet
- Equipe RoBioSS, Institut PPRIME, UPR3346 CNRS Université de Poitiers ISAE ENSMA, 11 boulevard Marie et Pierre Curie, Site du Futuroscope TSA 41123, 86073 Poitiers Cedex 9, France
| |
Collapse
|
4
|
David JP, Schick D, Rapp L, Schick J, Glaser M. SensAA-Design and Verification of a Cloud-Based Wearable Biomechanical Data Acquisition System. SENSORS (BASEL, SWITZERLAND) 2024; 24:2405. [PMID: 38676022 PMCID: PMC11053589 DOI: 10.3390/s24082405] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/30/2023] [Revised: 03/29/2024] [Accepted: 04/04/2024] [Indexed: 04/28/2024]
Abstract
Exoskeletons designed to assist patients with activities of daily living are becoming increasingly popular, but still are subject to research. In order to gather requirements for the design of such systems, long-term gait observation of the patients over the course of multiple days in an environment of daily living are required. In this paper a wearable all-in-one data acquisition system for collecting and storing biomechanical data in everyday life is proposed. The system is designed to be cost efficient and easy to use, using off-the-shelf components and a cloud server system for centralized data storage. The measurement accuracy of the system was verified, by measuring the angle of the human knee joint at walking speeds between 3 and 12 km/h in reference to an optical motion analysis system. The acquired data were uploaded to a cloud database via a smartphone application. Verification results showed that the proposed toolchain works as desired. The system reached an RMSE from 2.9° to 8°, which is below that of most comparable systems. The system provides a powerful, scalable platform for collecting and processing biomechanical data, which can help to automize the generation of an extensive database for human kinematics.
Collapse
Affiliation(s)
| | | | | | | | - Markus Glaser
- Zentrum für Zuverlässige Mechatronische Systeme (ZMS), Aalen University, 73430 Aalen, Germany
| |
Collapse
|
5
|
McClintock FA, Callaway AJ, Clark CJ, Williams JM. Validity and reliability of inertial measurement units used to measure motion of the lumbar spine: A systematic review of individuals with and without low back pain. Med Eng Phys 2024; 126:104146. [PMID: 38621847 DOI: 10.1016/j.medengphy.2024.104146] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Revised: 12/22/2023] [Accepted: 03/09/2024] [Indexed: 04/17/2024]
Abstract
Low back pain (LBP) is a leading cause of disability, resulting in aberrant movement. This movement is difficult to measure accurately in clinical practice and gold standard methods, such as optoelectronic systems involve the use of expensive laboratory equipment. Inertial measurement units (IMU) offer an alternative method of quantifying movement that is accessible in most environments. However, there is no consensus around the validity and reliability of IMUs for quantifying lumbar spine movements compared with gold standard measures. The aim of this systematic review was to establish concurrent validity and repeated measures reliability of using IMUs for the measurement of lumbar spine movements in individuals with and without LBP. A systematic search of electronic databases, incorporating PRISMA guidelines was completed, limited to the English language. 503 studies were identified where 15 studies met the inclusion criteria. Overall, 305 individuals were included, and 109 of these individuals had LBP. Weighted synthesis of the results demonstrated root mean squared differences of <2.4° compared to the gold standard and intraclass correlations >0.84 for lumbar spine movements. IMUs offer clinicians and researchers valid and reliable measurement of motion in the lumbar spine, comparable to laboratory methods, such as optoelectronic motion capture for individuals with and without LBP.
Collapse
Affiliation(s)
- Frederick A McClintock
- Faculty of Health and Social Sciences, Bournemouth University, Fern Barrow, Poole BH12 5BB, United Kingdom.
| | - Andrew J Callaway
- Faculty of Health and Social Sciences, Bournemouth University, Fern Barrow, Poole BH12 5BB, United Kingdom
| | - Carol J Clark
- Faculty of Health and Social Sciences, Bournemouth University, Fern Barrow, Poole BH12 5BB, United Kingdom
| | - Jonathan M Williams
- Faculty of Health and Social Sciences, Bournemouth University, Fern Barrow, Poole BH12 5BB, United Kingdom
| |
Collapse
|
6
|
Ekdahl M, Ulman S, Butler L. Relationship of Knee Abduction Moment to Trunk and Lower Extremity Segment Acceleration during Sport-Specific Movements. SENSORS (BASEL, SWITZERLAND) 2024; 24:1454. [PMID: 38474989 DOI: 10.3390/s24051454] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/10/2023] [Revised: 02/10/2024] [Accepted: 02/19/2024] [Indexed: 03/14/2024]
Abstract
The knee abduction moment (KAM) has been identified as a significant predictor of anterior cruciate ligament (ACL) injury risk; however, the cost and time demands associated with collecting three-dimensional (3D) kinetic data have prompted the need for alternative solutions. Wearable inertial measurement units (IMUs) have been explored as a potential solution for quantitative on-field assessment of injury risk. Most previous work has focused on angular velocity data, which are highly susceptible to bias and noise relative to acceleration data. The purpose of this pilot study was to assess the relationship between KAM and body segment acceleration during sport-specific movements. Three functional tasks were selected to analyze peak KAM using optical motion capture and force plates as well as peak triaxial segment accelerations using IMUs. Moderate correlations with peak KAM were observed for peak shank acceleration during single-leg hop; peak trunk, thigh, and shank accelerations during a deceleration task; and peak trunk, pelvis, and shank accelerations during a 45° cut. These findings provide preliminary support for the use of wearable IMUs to identify peak KAM during athletic tasks.
Collapse
Affiliation(s)
| | - Sophia Ulman
- Scottish Rite for Children, Frisco, TX 75034, USA
- Department of Orthopaed Surgery, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA
| | - Lauren Butler
- Nicole Wertheim College of Nursing and Health Sciences, Florida International University, Miami, FL 33199, USA
- Nicklaus Children's Hospital, Miami, FL 33155, USA
| |
Collapse
|
7
|
Cornish BM, Diamond LE, Saxby DJ, Lloyd DG, Shi B, Lyon J, Abbruzzese K, Gallie P, Maharaj J. Sagittal plane knee kinematics can be measured during activities of daily living following total knee arthroplasty with two IMU. PLoS One 2024; 19:e0297899. [PMID: 38359050 PMCID: PMC10868843 DOI: 10.1371/journal.pone.0297899] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2023] [Accepted: 01/16/2024] [Indexed: 02/17/2024] Open
Abstract
Knee function is rarely measured objectively during functional tasks following total knee arthroplasty. Inertial measurement units (IMU) can measure knee kinematics and range of motion (ROM) during dynamic activities and offer an easy-to-use system for knee function assessment post total knee arthroplasty. However, IMU must be validated against gold standard three-dimensional optical motion capture systems (OMC) across a range of tasks if they are to see widespread uptake. We computed knee rotations and ROM from commercial IMU sensor measurements during walking, squatting, sit-to-stand, stair ascent, and stair descent in 21 patients one-year post total knee arthroplasty using two methods: direct computation using segment orientations (r_IMU), and an IMU-driven iCloud-based interactive lower limb model (m_IMU). This cross-sectional study compared computed knee angles and ROM to a gold-standard OMC and inverse kinematics method using Pearson's correlation coefficient (R) and root-mean-square-differences (RMSD). The r_IMU and m_IMU methods estimated sagittal plane knee angles with excellent correlation (>0.95) compared to OMC for walking, squatting, sit-to-stand, and stair-ascent, and very good correlation (>0.90) for stair descent. For squatting, sit-to-stand, and walking, the mean RMSD for r_IMU and m_IMU compared to OMC were <4 degrees, < 5 degrees, and <6 degrees, respectively but higher for stair ascent and descent (~12 degrees). Frontal and transverse plane knee kinematics estimated using r_IMU and m_IMU showed poor to moderate correlation compared to OMC. There were no differences in ROM measurements during squatting, sit-to-stand, and walking across the two methods. Thus, IMUs can measure sagittal plane knee angles and ROM with high accuracy for a variety of tasks and may be a useful in-clinic tool for objective assessment of knee function following total knee arthroplasty.
Collapse
Affiliation(s)
- Bradley M. Cornish
- Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, Queensland, Australia
- School of Health Sciences and Social Work, Griffith University, Gold Coast, Queensland, Australia
| | - Laura E. Diamond
- Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, Queensland, Australia
- School of Health Sciences and Social Work, Griffith University, Gold Coast, Queensland, Australia
| | - David John Saxby
- Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, Queensland, Australia
- School of Health Sciences and Social Work, Griffith University, Gold Coast, Queensland, Australia
| | - David G. Lloyd
- Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, Queensland, Australia
- School of Health Sciences and Social Work, Griffith University, Gold Coast, Queensland, Australia
| | - Beichen Shi
- Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, Queensland, Australia
- School of Health Sciences and Social Work, Griffith University, Gold Coast, Queensland, Australia
| | - Jenna Lyon
- Stryker Corporation, Kalamazoo, Michigan, Unites States of America
| | - Kevin Abbruzzese
- Stryker Corporation, Kalamazoo, Michigan, Unites States of America
| | - Price Gallie
- Coast Orthopaedics and Sports Medicine, Gold Coast, Queensland, Australia
| | - Jayishni Maharaj
- Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, Queensland, Australia
- School of Health Sciences and Social Work, Griffith University, Gold Coast, Queensland, Australia
| |
Collapse
|
8
|
Cimorelli A, Patel A, Karakostas T, Cotton RJ. Validation of portable in-clinic video-based gait analysis for prosthesis users. Sci Rep 2024; 14:3840. [PMID: 38360820 PMCID: PMC10869722 DOI: 10.1038/s41598-024-53217-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Accepted: 01/30/2024] [Indexed: 02/17/2024] Open
Abstract
Despite the common focus of gait in rehabilitation, there are few tools that allow quantitatively characterizing gait in the clinic. We recently described an algorithm, trained on a large dataset from our clinical gait analysis laboratory, which produces accurate cycle-by-cycle estimates of spatiotemporal gait parameters including step timing and walking velocity. Here, we demonstrate this system generalizes well to clinical care with a validation study on prosthetic users seen in therapy and outpatient clinics. Specifically, estimated walking velocity was similar to annotated 10-m walking velocities, and cadence and foot contact times closely mirrored our wearable sensor measurements. Additionally, we found that a 2D keypoint detector pretrained on largely able-bodied individuals struggles to localize prosthetic joints, particularly for those individuals with more proximal or bilateral amputations, but after training a prosthetic-specific joint detector video-based gait analysis also works on these individuals. Further work is required to validate the other outputs from our algorithm including sagittal plane joint angles and step length. Code for the gait transformer and the trained weights are available at https://github.com/peabody124/GaitTransformer .
Collapse
Affiliation(s)
| | - Ankit Patel
- Department of Neuroscience, Baylor College of Medicine, Houston, USA
- Department of Electrical & Computer Engineering, Rice University, Houston, USA
| | - Tasos Karakostas
- Shirley Ryan AbilityLab, Chicago, USA
- Department of Physical Medicine and Rehabilitation, Northwestern University, Evanston, USA
| | - R James Cotton
- Shirley Ryan AbilityLab, Chicago, USA.
- Department of Physical Medicine and Rehabilitation, Northwestern University, Evanston, USA.
| |
Collapse
|
9
|
Sibson BE, Banks JJ, Yawar A, Yegian AK, Anderson DE, Lieberman DE. Using inertial measurement units to estimate spine joint kinematics and kinetics during walking and running. Sci Rep 2024; 14:234. [PMID: 38168540 PMCID: PMC10762015 DOI: 10.1038/s41598-023-50652-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Accepted: 12/22/2023] [Indexed: 01/05/2024] Open
Abstract
Optical motion capture (OMC) is considered the best available method for measuring spine kinematics, yet inertial measurement units (IMU) have the potential to collect data outside the laboratory. When combined with musculoskeletal modeling, IMU technology may be used to estimate spinal loads in real-world settings. To date, IMUs have not been validated for estimates of spinal movement and loading during both walking and running. Using OpenSim Thoracolumbar Spine and Ribcage models, we compare IMU and OMC estimates of lumbosacral (L5/S1) and thoracolumbar (T12/L1) joint angles, moments, and reaction forces during gait across six speeds for five participants. For comparisons, time series are ensemble averaged over strides. Comparisons between IMU and OMC ensemble averages have low normalized root mean squared errors (< 0.3 for 81% of comparisons) and high, positive cross-correlations (> 0.5 for 91% of comparisons), suggesting signals are similar in magnitude and trend. As expected, joint moments and reaction forces are higher during running than walking for IMU and OMC. Relative to OMC, IMU overestimates joint moments and underestimates joint reaction forces by 20.9% and 15.7%, respectively. The results suggest using a combination of IMU technology and musculoskeletal modeling is a valid means for estimating spinal movement and loading.
Collapse
Affiliation(s)
- Benjamin E Sibson
- Department of Human Evolutionary Biology, Harvard University, Cambridge, MA, USA.
| | - Jacob J Banks
- Center for Advanced Orthopedic Studies, Beth Israel Deaconess Medical Center, Boston, MA, USA
- Department of Orthopedic Surgery, Harvard Medical School, Boston, MA, USA
| | - Ali Yawar
- Department of Human Evolutionary Biology, Harvard University, Cambridge, MA, USA
| | - Andrew K Yegian
- Department of Human Evolutionary Biology, Harvard University, Cambridge, MA, USA
| | - Dennis E Anderson
- Center for Advanced Orthopedic Studies, Beth Israel Deaconess Medical Center, Boston, MA, USA
- Department of Orthopedic Surgery, Harvard Medical School, Boston, MA, USA
| | - Daniel E Lieberman
- Department of Human Evolutionary Biology, Harvard University, Cambridge, MA, USA
| |
Collapse
|
10
|
Adamczyk PG, Harper SE, Reiter AJ, Roembke RA, Wang Y, Nichols KM, Thelen DG. Wearable sensing for understanding and influencing human movement in ecological contexts. CURRENT OPINION IN BIOMEDICAL ENGINEERING 2023; 28:100492. [PMID: 37663049 PMCID: PMC10469849 DOI: 10.1016/j.cobme.2023.100492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/05/2023]
Abstract
Wearable sensors offer a unique opportunity to study movement in ecological contexts - that is, outside the laboratory where movement happens in ordinary life. This article discusses the purpose, means, and impact of using wearable sensors to assess movement context, kinematics, and kinetics during locomotion, and how this information can be used to better understand and influence movement. We outline the types of information wearable sensors can gather and highlight recent developments in sensor technology, data analysis, and applications. We close with a vision for important future research and key questions the field will need to address to bring the potential benefits of wearable sensing to fruition.
Collapse
Affiliation(s)
- Peter Gabriel Adamczyk
- University of Wisconsin – Madison, Department of Mechanical Engineering, 1513 University Ave., Madison, Wisconsin, USA
| | - Sara E Harper
- University of Wisconsin – Madison, Department of Biomedical Engineering, 1550 Engineering Dr., Madison, Wisconsin, USA
| | - Alex J Reiter
- University of Wisconsin – Madison, Department of Mechanical Engineering, 1513 University Ave., Madison, Wisconsin, USA
| | - Rebecca A Roembke
- University of Wisconsin – Madison, Department of Mechanical Engineering, 1513 University Ave., Madison, Wisconsin, USA
| | - Yisen Wang
- University of Wisconsin – Madison, Department of Mechanical Engineering, 1513 University Ave., Madison, Wisconsin, USA
| | - Kieran M Nichols
- University of Wisconsin – Madison, Department of Mechanical Engineering, 1513 University Ave., Madison, Wisconsin, USA
| | - Darryl G. Thelen
- University of Wisconsin – Madison, Department of Mechanical Engineering, 1513 University Ave., Madison, Wisconsin, USA
- University of Wisconsin – Madison, Department of Biomedical Engineering, 1550 Engineering Dr., Madison, Wisconsin, USA
| |
Collapse
|
11
|
Wang F, Liang W, Afzal HMR, Fan A, Li W, Dai X, Liu S, Hu Y, Li Z, Yang P. Estimation of Lower Limb Joint Angles and Joint Moments during Different Locomotive Activities Using the Inertial Measurement Units and a Hybrid Deep Learning Model. SENSORS (BASEL, SWITZERLAND) 2023; 23:9039. [PMID: 38005427 PMCID: PMC10674933 DOI: 10.3390/s23229039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Revised: 11/02/2023] [Accepted: 11/06/2023] [Indexed: 11/26/2023]
Abstract
Using inertial measurement units (IMUs) to estimate lower limb joint kinematics and kinetics can provide valuable information for disease diagnosis and rehabilitation assessment. To estimate gait parameters using IMUs, model-based filtering approaches have been proposed, such as the Kalman filter and complementary filter. However, these methods require special calibration and alignment of IMUs. The development of deep learning algorithms has facilitated the application of IMUs in biomechanics as it does not require particular calibration and alignment procedures of IMUs in use. To estimate hip/knee/ankle joint angles and moments in the sagittal plane, a subject-independent temporal convolutional neural network-bidirectional long short-term memory network (TCN-BiLSTM) model was proposed using three IMUs. A public benchmark dataset containing the most representative locomotive activities in daily life was used to train and evaluate the TCN-BiLSTM model. The mean Pearson correlation coefficient of joint angles and moments estimated by the proposed model reached 0.92 and 0.87, respectively. This indicates that the TCN-BiLSTM model can effectively estimate joint angles and moments in multiple scenarios, demonstrating its potential for application in clinical and daily life scenarios.
Collapse
Affiliation(s)
- Fanjie Wang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi’an 710072, China; (F.W.); (W.L.); (H.M.R.A.); (A.F.); (Y.H.)
| | - Wenqi Liang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi’an 710072, China; (F.W.); (W.L.); (H.M.R.A.); (A.F.); (Y.H.)
| | - Hafiz Muhammad Rehan Afzal
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi’an 710072, China; (F.W.); (W.L.); (H.M.R.A.); (A.F.); (Y.H.)
| | - Ao Fan
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi’an 710072, China; (F.W.); (W.L.); (H.M.R.A.); (A.F.); (Y.H.)
| | - Wenjiong Li
- National Key Laboratory of Space Medicine, China Astronaut Research and Training Center, Beijing 100094, China; (W.L.); (X.D.); (S.L.)
| | - Xiaoqian Dai
- National Key Laboratory of Space Medicine, China Astronaut Research and Training Center, Beijing 100094, China; (W.L.); (X.D.); (S.L.)
| | - Shujuan Liu
- National Key Laboratory of Space Medicine, China Astronaut Research and Training Center, Beijing 100094, China; (W.L.); (X.D.); (S.L.)
| | - Yiwei Hu
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi’an 710072, China; (F.W.); (W.L.); (H.M.R.A.); (A.F.); (Y.H.)
| | - Zhili Li
- National Key Laboratory of Space Medicine, China Astronaut Research and Training Center, Beijing 100094, China; (W.L.); (X.D.); (S.L.)
| | - Pengfei Yang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi’an 710072, China; (F.W.); (W.L.); (H.M.R.A.); (A.F.); (Y.H.)
| |
Collapse
|
12
|
Florenciano Restoy JL, Solé-Casals J, Borràs-Boix X. Effect of Foot Orthoses on Angular Velocity of Feet. SENSORS (BASEL, SWITZERLAND) 2023; 23:8917. [PMID: 37960617 PMCID: PMC10650853 DOI: 10.3390/s23218917] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/21/2023] [Revised: 10/24/2023] [Accepted: 10/31/2023] [Indexed: 11/15/2023]
Abstract
There is some uncertainty regarding how foot orthoses (FO) affect the biomechanics of the lower extremities during running in non-injured individuals. This study aims to describe the behavior of the angular velocity of the foot in the stride cycle measured with a low-sampling-rate IMU device commonly used by podiatrists. Specific objectives were to determine if there are differences in angular velocity between the right and left foot and to determine the effect of foot orthoses (FO) on the 3D angular velocity of the foot during running. The sample was composed of 40 male adults (age: 43.0 ± 13.8 years, weight: 72.0 ± 5.5 kg, and height: 175.5 ± 7.0 cm), who were healthy and without any locomotor system alterations at the time of the test. All subjects use FO on a regular basis. The results show that there are significant differences in the transverse plane between feet, with greater differences in the right foot. Significant differences between FO and non-FO conditions were observed in the frontal and transverse planes on the left foot and in the sagittal and transverse planes on the right foot. FO decreases the velocity of the foot in dorsi-plantar flexion and abduction and increases the velocity in inversion. The kinematic changes in foot velocity occur between 30% and 60% of the complete cycle, and the FO reduces the velocity in abduction and dorsi-plantar flexion and increases the velocity in inversion-eversion, which facilitates the transition to the oscillating leg and with it the displacement of the center of mass. Quantifying possible asymmetries and assessing the effect of foot orthoses may aid in improving running mechanics and preventing injuries in individuals.
Collapse
Affiliation(s)
| | - Jordi Solé-Casals
- Data and Signal Processing Research Group, University of Vic—Central University of Catalonia, 08500 Vic, Spain
| | - Xantal Borràs-Boix
- Sport Exercise and Human Movement, University of Vic—Central University of Catalonia, 08500 Vic, Spain
| |
Collapse
|
13
|
Strongman C, Cavallerio F, Timmis MA, Morrison A. A Scoping Review of the Validity and Reliability of Smartphone Accelerometers When Collecting Kinematic Gait Data. SENSORS (BASEL, SWITZERLAND) 2023; 23:8615. [PMID: 37896708 PMCID: PMC10611257 DOI: 10.3390/s23208615] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Revised: 10/18/2023] [Accepted: 10/19/2023] [Indexed: 10/29/2023]
Abstract
The aim of this scoping review is to evaluate and summarize the existing literature that considers the validity and/or reliability of smartphone accelerometer applications when compared to 'gold standard' kinematic data collection (for example, motion capture). An electronic keyword search was performed on three databases to identify appropriate research. This research was then examined for details of measures and methodology and general study characteristics to identify related themes. No restrictions were placed on the date of publication, type of smartphone, or participant demographics. In total, 21 papers were reviewed to synthesize themes and approaches used and to identify future research priorities. The validity and reliability of smartphone-based accelerometry data have been assessed against motion capture, pressure walkways, and IMUs as 'gold standard' technology and they have been found to be accurate and reliable. This suggests that smartphone accelerometers can provide a cheap and accurate alternative to gather kinematic data, which can be used in ecologically valid environments to potentially increase diversity in research participation. However, some studies suggest that body placement may affect the accuracy of the result, and that position data correlate better than actual acceleration values, which should be considered in any future implementation of smartphone technology. Future research comparing different capture frequencies and resulting noise, and different walking surfaces, would be useful.
Collapse
Affiliation(s)
- Clare Strongman
- Cambridge Centre for Sport and Exercise Sciences, Anglia Ruskin University, East Road, Cambridge CB1 1PT, UK; (F.C.); (M.A.T.); (A.M.)
| | | | | | | |
Collapse
|
14
|
Uhlrich SD, Falisse A, Kidziński Ł, Muccini J, Ko M, Chaudhari AS, Hicks JL, Delp SL. OpenCap: Human movement dynamics from smartphone videos. PLoS Comput Biol 2023; 19:e1011462. [PMID: 37856442 PMCID: PMC10586693 DOI: 10.1371/journal.pcbi.1011462] [Citation(s) in RCA: 27] [Impact Index Per Article: 27.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Accepted: 08/24/2023] [Indexed: 10/21/2023] Open
Abstract
Measures of human movement dynamics can predict outcomes like injury risk or musculoskeletal disease progression. However, these measures are rarely quantified in large-scale research studies or clinical practice due to the prohibitive cost, time, and expertise required. Here we present and validate OpenCap, an open-source platform for computing both the kinematics (i.e., motion) and dynamics (i.e., forces) of human movement using videos captured from two or more smartphones. OpenCap leverages pose estimation algorithms to identify body landmarks from videos; deep learning and biomechanical models to estimate three-dimensional kinematics; and physics-based simulations to estimate muscle activations and musculoskeletal dynamics. OpenCap's web application enables users to collect synchronous videos and visualize movement data that is automatically processed in the cloud, thereby eliminating the need for specialized hardware, software, and expertise. We show that OpenCap accurately predicts dynamic measures, like muscle activations, joint loads, and joint moments, which can be used to screen for disease risk, evaluate intervention efficacy, assess between-group movement differences, and inform rehabilitation decisions. Additionally, we demonstrate OpenCap's practical utility through a 100-subject field study, where a clinician using OpenCap estimated musculoskeletal dynamics 25 times faster than a laboratory-based approach at less than 1% of the cost. By democratizing access to human movement analysis, OpenCap can accelerate the incorporation of biomechanical metrics into large-scale research studies, clinical trials, and clinical practice.
Collapse
Affiliation(s)
- Scott D. Uhlrich
- Departments of Bioengineering, Stanford University, Stanford, California, United States of America
| | - Antoine Falisse
- Departments of Bioengineering, Stanford University, Stanford, California, United States of America
| | - Łukasz Kidziński
- Departments of Bioengineering, Stanford University, Stanford, California, United States of America
| | - Julie Muccini
- Radiology, Stanford University, Stanford, California, United States of America
| | - Michael Ko
- Radiology, Stanford University, Stanford, California, United States of America
| | - Akshay S. Chaudhari
- Radiology, Stanford University, Stanford, California, United States of America
- Biomedical Data Science, Stanford University, Stanford, California, United States of America
| | - Jennifer L. Hicks
- Departments of Bioengineering, Stanford University, Stanford, California, United States of America
| | - Scott L. Delp
- Departments of Bioengineering, Stanford University, Stanford, California, United States of America
- Mechanical Engineering, Stanford University, Stanford, California, United States of America
- Orthopaedic Surgery, Stanford University, Stanford, California, United States of America
| |
Collapse
|
15
|
Ekdahl M, Loewen A, Erdman A, Sahin S, Ulman S. Inertial Measurement Unit Sensor-to-Segment Calibration Comparison for Sport-Specific Motion Analysis. SENSORS (BASEL, SWITZERLAND) 2023; 23:7987. [PMID: 37766040 PMCID: PMC10534374 DOI: 10.3390/s23187987] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 09/13/2023] [Accepted: 09/18/2023] [Indexed: 09/29/2023]
Abstract
Wearable inertial measurement units (IMUs) can be utilized as an alternative to optical motion capture as a method of measuring joint angles. These sensors require functional calibration prior to data collection, known as sensor-to-segment calibration. This study aims to evaluate previously described sensor-to-segment calibration methods to measure joint angle range of motion (ROM) during highly dynamic sports-related movements. Seven calibration methods were selected to compare lower extremity ROM measured using IMUs to an optical motion capture system. The accuracy of ROM measurements for each calibration method varied across joints and sport-specific tasks, with absolute mean differences between IMU measurement and motion capture measurement ranging from <0.1° to 24.1°. Fewer significant differences were observed at the pelvis than at the hip, knee, or ankle across all tasks. For each task, one or more calibration movements demonstrated non-significant differences in ROM for at least nine out of the twelve ROM variables. These results suggest that IMUs may be a viable alternative to optical motion capture for sport-specific lower-extremity ROM measurement, although the sensor-to-segment calibration methods used should be selected based on the specific tasks and variables of interest for a given application.
Collapse
Affiliation(s)
- Mitchell Ekdahl
- Scottish Rite for Children, Frisco, TX 75034, USA; (A.L.); (A.E.); (S.S.); (S.U.)
| | - Alex Loewen
- Scottish Rite for Children, Frisco, TX 75034, USA; (A.L.); (A.E.); (S.S.); (S.U.)
| | - Ashley Erdman
- Scottish Rite for Children, Frisco, TX 75034, USA; (A.L.); (A.E.); (S.S.); (S.U.)
| | - Sarp Sahin
- Scottish Rite for Children, Frisco, TX 75034, USA; (A.L.); (A.E.); (S.S.); (S.U.)
| | - Sophia Ulman
- Scottish Rite for Children, Frisco, TX 75034, USA; (A.L.); (A.E.); (S.S.); (S.U.)
- Department of Orthopaedic Surgery, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA
| |
Collapse
|
16
|
Inai T, Takabayashi T. Lower-limb sagittal joint angles during gait can be predicted based on foot acceleration and angular velocity. PeerJ 2023; 11:e16131. [PMID: 37744216 PMCID: PMC10512936 DOI: 10.7717/peerj.16131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Accepted: 08/28/2023] [Indexed: 09/26/2023] Open
Abstract
Background and purpose Continuous monitoring of lower-limb movement may help in the early detection and control/reduction of diseases (such as the progression of orthopedic diseases) by applying suitable interventions. Therefore, it is invaluable to calculate the lower-limb movement (sagittal joint angles) while walking daily for continuous evaluation of such risks. Although cameras in a motion capture system are necessary for calculating lower-limb sagittal joint angles during gait, the method is unrealistic considering the setting is difficult to achieve in daily life. Therefore, the estimation of lower-limb sagittal joint angles during walking based on variables, which can be measured using wearable sensors (e.g., foot acceleration and angular velocity), is important. This study estimates the lower-limb sagittal joint angles during gait from the norms of foot acceleration and angular velocity using machine learning and validates the accuracy of the estimated joint angles with those obtained using a motion capture system. Methods Healthy adults (n = 200) were asked to walk at a comfortable speed (10 trials), and their lower-limb sagittal joint angles, foot accelerations, and angular velocities were obtained. Using these variables, we established a feedforward neural network and estimated the lower-limb sagittal joint angles. Results The average root mean squared errors of the lower-limb sagittal joint angles during gait ranged between 2.5°-7.0° (hip: 7.0°; knee: 4.0°; and ankle: 2.5°). Conclusion These results show that we can estimate the lower-limb sagittal joint angles during gait using only the norms of foot acceleration and angular velocity, which can help calculate the lower-limb sagittal joint angles during daily walking.
Collapse
Affiliation(s)
- Takuma Inai
- National Institute of Advanced Industrial Science and Technology, Takamatsu City, Japan
| | | |
Collapse
|
17
|
Zha Q, Xu Z, Cai X, Zhang G, Shen X. Wearable rehabilitation wristband for distal radius fractures. Front Neurosci 2023; 17:1238176. [PMID: 37781255 PMCID: PMC10536142 DOI: 10.3389/fnins.2023.1238176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2023] [Accepted: 08/07/2023] [Indexed: 10/03/2023] Open
Abstract
Background Distal radius fractures are a common type of fracture. For patients treated with closed reduction with splinting, a period of rehabilitation is still required after the removal of the splint. However, there is a general lack of attention and low compliance to rehabilitation training during this period, so it is necessary to build a rehabilitation training monitoring system to improve the efficiency of patients' rehabilitation. Methods A wearable rehabilitation training wristband was proposed, which could be used in the patient's daily rehabilitation training scenario and could recognize four common wrist rehabilitation actions in real-time by using three thin film pressure sensors to detect the pressure change curve at three points on the wrist. An algorithmic framework for classifying rehabilitation training actions was proposed. In our framework, an action pre-detection strategy was designed to exclude false detections caused by switching initial gestures during rehabilitation training and wait for the arrival of the complete signal. To classify the action signals into four categories, firstly an autoencoder was used to downscale the original signal. Six SVMs were then used for evaluation and voting, and the final action with the highest number of votes would be used as the prediction result. Results Experimental results showed that the proposed algorithmic framework achieved an average recognition accuracy of 89.62%, an average recognition recall of 88.93%, and an f1 score of 89.27% on the four rehabilitation training actions. Conclusion The developed device has the advantages of being small size and easy to wear, which can quickly and accurately identify and classify four common rehabilitation training actions. It can easily be combined with peripheral devices and technologies (e.g., cell phones, computers, Internet) to build different rehabilitation training scenarios, making it worthwhile to use and promote in clinical settings.
Collapse
Affiliation(s)
- Qing Zha
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Science, Suzhou, China
| | - Zeou Xu
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Science, Suzhou, China
| | - Xuefeng Cai
- Suzhou TCM Hospital Affiliated to Nanjing University of Chinese Medicine, Suzhou, China
| | - Guodong Zhang
- Suzhou TCM Hospital Affiliated to Nanjing University of Chinese Medicine, Suzhou, China
| | - Xiaofeng Shen
- Suzhou TCM Hospital Affiliated to Nanjing University of Chinese Medicine, Suzhou, China
| |
Collapse
|
18
|
Siddiqui HUR, Saleem AA, Raza MA, Villar SG, Lopez LAD, Diez IDLT, Rustam F, Dudley S. Empowering Lower Limb Disorder Identification through PoseNet and Artificial Intelligence. Diagnostics (Basel) 2023; 13:2881. [PMID: 37761248 PMCID: PMC10530167 DOI: 10.3390/diagnostics13182881] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2023] [Revised: 08/25/2023] [Accepted: 09/04/2023] [Indexed: 09/29/2023] Open
Abstract
A novel approach is presented in this study for the classification of lower limb disorders, with a specific emphasis on the knee, hip, and ankle. The research employs gait analysis and the extraction of PoseNet features from video data in order to effectively identify and categorize these disorders. The PoseNet algorithm facilitates the extraction of key body joint movements and positions from videos in a non-invasive and user-friendly manner, thereby offering a comprehensive representation of lower limb movements. The features that are extracted are subsequently standardized and employed as inputs for a range of machine learning algorithms, such as Random Forest, Extra Tree Classifier, Multilayer Perceptron, Artificial Neural Networks, and Convolutional Neural Networks. The models undergo training and testing processes using a dataset consisting of 174 real patients and normal individuals collected at the Tehsil Headquarter Hospital Sadiq Abad. The evaluation of their performance is conducted through the utilization of K-fold cross-validation. The findings exhibit a notable level of accuracy and precision in the classification of various lower limb disorders. Notably, the Artificial Neural Networks model achieves the highest accuracy rate of 98.84%. The proposed methodology exhibits potential in enhancing the diagnosis and treatment planning of lower limb disorders. It presents a non-invasive and efficient method of analyzing gait patterns and identifying particular conditions.
Collapse
Affiliation(s)
- Hafeez Ur Rehman Siddiqui
- Institute of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Abu Dhabi Road, Rahim Yar Khan 64200, Punjab, Pakistan; (H.U.R.S.); (A.A.S.); (M.A.R.)
| | - Adil Ali Saleem
- Institute of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Abu Dhabi Road, Rahim Yar Khan 64200, Punjab, Pakistan; (H.U.R.S.); (A.A.S.); (M.A.R.)
| | - Muhammad Amjad Raza
- Institute of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Abu Dhabi Road, Rahim Yar Khan 64200, Punjab, Pakistan; (H.U.R.S.); (A.A.S.); (M.A.R.)
| | - Santos Gracia Villar
- Universidad Europea del Atlántico, Isabel Torres 21, 39011 Santander, Spain; (S.G.V.); (L.A.D.L.)
- Universidad Internacional Iberoamericana, Campeche 24560, Mexico
- Department of Extension, Universidade Internacional do Cuanza, Cuito EN250, Bié, Angola
| | - Luis Alonso Dzul Lopez
- Universidad Europea del Atlántico, Isabel Torres 21, 39011 Santander, Spain; (S.G.V.); (L.A.D.L.)
- Universidad Internacional Iberoamericana, Campeche 24560, Mexico
- Department of Project Management, Universidad Internacional Iberoamericana, Arecibo, PR 00613, USA
| | - Isabel de la Torre Diez
- Department of Signal Theory and Communications and Telematic Engineering, University of Valladolid, Paseo de Belén, 15, 47011 Valladolid, Spain
| | - Furqan Rustam
- School of Computer Science, University College Dublin, D04 V1W8 Dublin, Ireland
| | - Sandra Dudley
- Bioengineering Research Centre, School of Engineering, London South Bank University, 103 Borough Road, London SE1 0AA, UK;
| |
Collapse
|
19
|
Nouriani A, Jonason A, Jean J, McGovern R, Rajamani R. System-Identification-Based Activity Recognition Algorithms With Inertial Sensors. IEEE J Biomed Health Inform 2023; 27:3119-3128. [PMID: 37389995 DOI: 10.1109/jbhi.2023.3265856] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/02/2023]
Abstract
This paper focuses on activity recognition using a single wearable inertial measurement sensor placed on the subject's chest. The ten activities that need to be identified include lying down, standing, sitting, bending and walking, among others. The activity recognition approach is based on using and identifying a transfer function associated with each activity. The appropriate input and output signals for each transfer function are first determined based on the norms of the sensor signals excited by that specific activity. Then the transfer function is identified using training data and a Wiener filter based on the auto-correlation and cross-correlation of the output and input signals. The activity occurring in real-time is recognized by computing and comparing the input-output errors associated with all the transfer functions. The performance of the developed system is evaluated using data from a group of Parkinson's disease subjects, including data obtained in a clinical setting and data obtained through remote home monitoring. On average, the developed system provides better than 90% accuracy in identifying each activity as it occurs. Activity recognition is particularly useful for PD patients in order to monitor their level of activity, characterize their postural instability and recognize high risk-activities in real-time that could lead to falls.
Collapse
|
20
|
Ng G, Gouda A, Andrysek J. Convolutional Neural Network for Estimating Spatiotemporal and Kinematic Gait Parameters using a Single Inertial Sensor . ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38083203 DOI: 10.1109/embc40787.2023.10340904] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Lower limb disability severely impacts gait, thus requiring clinical interventions. Inertial sensor systems offer the potential for objective monitoring and assessment of gait in and out of the clinic. However, it is imperative such systems are capable of measuring important gait parameters while being minimally obtrusive (requiring few sensors). This work used convolutional neural networks to estimate a set of six spatiotemporal and kinematic gait parameters based on raw inertial sensor data. This differs from previous work which either was limited to spatiotemporal parameters or required conventional strap-down integration techniques to estimate kinematic parameters. Additionally, we investigated a data segmentation method which does not rely on gait event detection, further supporting its applicability in real-world settings.Preliminary results demonstrate our model achieved high accuracy on a mix of spatiotemporal and kinematic gait parameters, either meeting or exceeding benchmarks based on literature. We achieved 0.04 ± 0.03 mean absolute error for stance-time symmetry ratio and an absolute error of 4.78 ± 4.78, 4.50 ± 4.33, and 6.47 ± 7.37cm for right and left step length and stride length, respectively. Lastly, errors for knee and hip ranges of motion were 2.31 ± 4.20 and 1.73 ± 1.93°, respectively. The results suggest that machine learning can be a useful tool for long-term monitoring of gait using a single inertial sensor to estimate measures of gait quality.
Collapse
|
21
|
Ortigas Vásquez A, Taylor WR, Maas A, Woiczinski M, Grupp TM, Sauer A. A frame orientation optimisation method for consistent interpretation of kinematic signals. Sci Rep 2023; 13:9632. [PMID: 37316703 DOI: 10.1038/s41598-023-36625-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Accepted: 06/07/2023] [Indexed: 06/16/2023] Open
Abstract
In clinical movement biomechanics, kinematic data are often depicted as waveforms (i.e. signals), characterising the motion of articulating joints. Clinically meaningful interpretations of the underlying joint kinematics, however, require an objective understanding of whether two different kinematic signals actually represent two different underlying physical movement patterns of the joint or not. Previously, the accuracy of IMU-based knee joint angles was assessed using a six-degrees-of-freedom joint simulator guided by fluoroscopy-based signals. Despite implementation of sensor-to-segment corrections, observed errors were clearly indicative of cross-talk, and thus inconsistent reference frame orientations. Here, we address these limitations by exploring how minimisation of dedicated cost functions can harmonise differences in frame orientations, ultimately facilitating consistent interpretation of articulating joint kinematic signals. In this study, we present and investigate a frame orientation optimisation method (FOOM) that aligns reference frames and corrects for cross-talk errors, hence yielding a consistent interpretation of the underlying movement patterns. By executing optimised rotational sequences, thus producing angular corrections around each axis, we enable a reproducible frame definition and hence an approach for reliable comparison of kinematic data. Using this approach, root-mean-square errors between the previously collected (1) IMU-based data using functional joint axes, and (2) simulated fluoroscopy-based data relying on geometrical axes were almost entirely eliminated from an initial range of 0.7°-5.1° to a mere 0.1°-0.8°. Our results confirm that different local segment frames can yield different kinematic patterns, despite following the same rotation convention, and that appropriate alignment of reference frame orientation can successfully enable consistent kinematic interpretation.
Collapse
Affiliation(s)
- Ariana Ortigas Vásquez
- Research and Development, Aesculap AG, Tuttlingen, Germany.
- Department of Orthopaedic and Trauma Surgery, Musculoskeletal University Center Munich (MUM), Campus Grosshadern, Ludwig Maximilians University Munich, Munich, Germany.
| | - William R Taylor
- Laboratory for Movement Biomechanics, ETH Zurich, Zurich, Switzerland
| | - Allan Maas
- Research and Development, Aesculap AG, Tuttlingen, Germany
- Department of Orthopaedic and Trauma Surgery, Musculoskeletal University Center Munich (MUM), Campus Grosshadern, Ludwig Maximilians University Munich, Munich, Germany
| | - Matthias Woiczinski
- Department of Orthopaedic and Trauma Surgery, Musculoskeletal University Center Munich (MUM), Campus Grosshadern, Ludwig Maximilians University Munich, Munich, Germany
| | - Thomas M Grupp
- Research and Development, Aesculap AG, Tuttlingen, Germany
- Department of Orthopaedic and Trauma Surgery, Musculoskeletal University Center Munich (MUM), Campus Grosshadern, Ludwig Maximilians University Munich, Munich, Germany
| | - Adrian Sauer
- Research and Development, Aesculap AG, Tuttlingen, Germany
- Department of Orthopaedic and Trauma Surgery, Musculoskeletal University Center Munich (MUM), Campus Grosshadern, Ludwig Maximilians University Munich, Munich, Germany
| |
Collapse
|
22
|
Edwards NA, Talarico MK, Chaudhari A, Mansfield CJ, Oñate J. Use of accelerometers and inertial measurement units to quantify movement of tactical athletes: A systematic review. APPLIED ERGONOMICS 2023; 109:103991. [PMID: 36841096 DOI: 10.1016/j.apergo.2023.103991] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/25/2022] [Revised: 01/25/2023] [Accepted: 02/02/2023] [Indexed: 06/18/2023]
Abstract
The dynamic work environments of tactical athletes are difficult to replicate in a laboratory. Accelerometers and inertial measurement units provide a way to characterize movement in the field. This systematic review identified how accelerometers and inertial measurement units are currently being used to quantify movement patterns of tactical athletes. Seven research and military databases were searched, producing 26,228 potential articles with 78 articles included in this review. The articles studied military personnel (73.1%), firefighters (19.2%), paramedics (3.8%), and law enforcement officers (3.8%). Accelerometers were the most used type of sensor, and physical activity was the primarily reported outcome variable. Seventy of the studies had fair or poor quality. Research on firefighters, emergency medical services, and law enforcement officers was limited. Future research should strive to make quantified movement data more accessible and user-friendly for non-research personnel, thereby prompting increased use in tactical athlete groups, especially first responder agencies.
Collapse
Affiliation(s)
- Nathan A Edwards
- School of Health and Rehabilitation Sciences, The Ohio State University, 453 W 10th Ave, Columbus, OH, 43210, USA; Human Performance Collaborative, The Ohio State University, 1961 Tuttle Park Place, Columbus, OH, 43210, USA; Sports Medicine Research Institute, The Ohio State University, 4835 Fred Taylor Drive, Columbus, OH, 43210, USA.
| | - Maria K Talarico
- Human Systems Integration Division, DEVCOM Analysis Center, U.S. Army Futures Command, 7188 Sustainment Rd, Aberdeen Proving Ground, MD, 21005, USA.
| | - Ajit Chaudhari
- School of Health and Rehabilitation Sciences, The Ohio State University, 453 W 10th Ave, Columbus, OH, 43210, USA; Sports Medicine Research Institute, The Ohio State University, 4835 Fred Taylor Drive, Columbus, OH, 43210, USA; Department of Mechanical and Aerospace Engineering, The Ohio State University, 201 W. 19th Avenue, Columbus, OH, 43210, USA; Department of Biomedical Engineering, The Ohio State University, 140 W. 19th Avenue, Columbus, OH, 43210, USA.
| | - Cody J Mansfield
- School of Health and Rehabilitation Sciences, The Ohio State University, 453 W 10th Ave, Columbus, OH, 43210, USA; Sports Medicine Research Institute, The Ohio State University, 4835 Fred Taylor Drive, Columbus, OH, 43210, USA.
| | - James Oñate
- School of Health and Rehabilitation Sciences, The Ohio State University, 453 W 10th Ave, Columbus, OH, 43210, USA; Human Performance Collaborative, The Ohio State University, 1961 Tuttle Park Place, Columbus, OH, 43210, USA; Division of Athletic Training, School of Health and Rehabilitation Sciences, The Ohio State University, 453 W 10th Ave, Columbus, OH, 43210, USA; Sports Medicine Research Institute, The Ohio State University, 4835 Fred Taylor Drive, Columbus, OH, 43210, USA.
| |
Collapse
|
23
|
Kirking B. Angle measurement stability and cycle counting accuracy of hours-long duration IMU based arm motion tracking with application to normal shoulder ADLs. Gait Posture 2023; 100:27-32. [PMID: 36469964 DOI: 10.1016/j.gaitpost.2022.11.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/08/2022] [Revised: 10/26/2022] [Accepted: 11/29/2022] [Indexed: 12/03/2022]
Abstract
BACKGROUND Inertial measurement units are increasing used for monitoring joint motion, but there is a need to demonstrate their suitability during hours-long continuous use, as well as a need for validated methods to count arm cycles and provide descriptions of typical cycles. RESEARCH QUESTION Do IMU sensors and rainflow counting have sufficient accuracy for tracking and cycle counting of hours-long continuous arm motion? If so, what are the cycle rates of normal arm ADL and is there a representative cycle that can serve as a 'gait cycle' for the arm? METHODS IMU sensors continuously tracked a robot performing 8 h of simulated cyclic arm motion. Error in the angle measurements was regressed against time to determine the rate of error and the total accumulated error. Additionally, the cycle count accuracy of rainflow, peak/valley, and Fourier transform counting methods was evaluated. RESULTS Over 8 h the IMU measurements accumulated a maximum 0.473° of error and the rainflow method counted cycles with less than 1% error. Applying rainflow counting to normal shoulder ADL resulted in an average rate of 533 elevation cycles per day.Tabulating the ADL cycles by mean and range values into a matrix and calculating the centroid, the single best values representing arm elevation cycles were a mean of 22.4° and a range of 21.6°. SIGNIFICANCE IMU sensors can track arm motion for 8 h with little increase in error, though during longer durations error may reach unacceptable levels. For normal arm ADL, the rainflow determined count of arm elevation full-cycles differed from previous estimates based on peak/valley counting. From the rainflow counting, a single cycle representation of cycle mean and range was determined that can be used as a 'gait cycle' for the shoulder.
Collapse
Affiliation(s)
- Bryan Kirking
- Enovis, 9801 Metric Blvd, Austin, TX 78758, United States.
| |
Collapse
|
24
|
Ng G, Andrysek J. Classifying Changes in Amputee Gait following Physiotherapy Using Machine Learning and Continuous Inertial Sensor Signals. SENSORS (BASEL, SWITZERLAND) 2023; 23:1412. [PMID: 36772451 PMCID: PMC9921298 DOI: 10.3390/s23031412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 01/13/2023] [Accepted: 01/24/2023] [Indexed: 06/18/2023]
Abstract
Wearable sensors allow for the objective analysis of gait and motion both in and outside the clinical setting. However, it remains a challenge to apply such systems to highly diverse patient populations, including individuals with lower-limb amputations (LLA) that present with unique gait deviations and rehabilitation goals. This paper presents the development of a novel method using continuous gyroscope data from a single inertial sensor for person-specific classification of gait changes from a physiotherapist-led gait training session. Gyroscope data at the thigh were collected using a wearable gait analysis system for five LLA before, during, and after completing a gait training session. Data from able-bodied participants receiving no intervention were also collected. Models using dynamic time warping (DTW) and Euclidean distance in combination with the nearest neighbor classifier were applied to the gyroscope data to classify the pre- and post-training gait. The model achieved an accuracy of 98.65% ± 0.69 (Euclidean) and 98.98% ± 0.83 (DTW) on pre-training and 95.45% ± 6.20 (Euclidean) and 94.18% ± 5.77 (DTW) on post-training data across the participants whose gait changed significantly during their session. This study provides preliminary evidence that continuous angular velocity data from a single gyroscope could be used to assess changes in amputee gait. This supports future research and the development of wearable gait analysis and feedback systems that are adaptable to a broad range of mobility impairments.
Collapse
Affiliation(s)
- Gabriel Ng
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON M5S 1A1, Canada
- Bloorview Research Institute (BRI), Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON M4G 1R8, Canada
| | - Jan Andrysek
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON M5S 1A1, Canada
- Bloorview Research Institute (BRI), Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON M4G 1R8, Canada
| |
Collapse
|
25
|
Spilz A, Munz M. Synchronisation of wearable inertial measurement units based on magnetometer data. BIOMED ENG-BIOMED TE 2023:bmt-2021-0329. [PMID: 36668676 DOI: 10.1515/bmt-2021-0329] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2021] [Accepted: 12/27/2022] [Indexed: 01/22/2023]
Abstract
OBJECTIVES Synchronisation of wireless inertial measurement units in human movement analysis is often achieved using event-based synchronisation techniques. However, these techniques lack precise event generation and accuracy. An inaccurate synchronisation could lead to large errors in motion estimation and reconstruction and therefore wrong analysis outputs. METHODS We propose a novel event-based synchronisation technique based on a magnetic field, which allows sub-sample accuracy. A setup featuring Shimmer3 inertial measurement units is designed to test the approach. RESULTS The proposed technique shows to be able to synchronise with a maximum offset of below 2.6 ms with sensors measuring at 100 Hz. The investigated parameters suggest a required synchronisation time of 8 s. CONCLUSIONS The results indicate a reliable event generation and detection for synchronisation of wireless inertial measurement units. Further research should investigate the temperature changes that the sensors are exposed to during human motion analysis and their influence on the internal time measurement of the sensors. In addition, the approach should be tested using inertial measurement units from different manufacturers to investigate an identified constant offset in the accuracy measurements.
Collapse
Affiliation(s)
- Andreas Spilz
- Department of Mechatronics and Medical Engineering, Biomechatronics Research Group, University of Applied Sciences, Ulm, Germany
| | - Michael Munz
- Department of Mechatronics and Medical Engineering, Biomechatronics Research Group, University of Applied Sciences, Ulm, Germany
| |
Collapse
|
26
|
Brasiliano P, Mascia G, Di Feo P, Di Stanislao E, Alvini M, Vannozzi G, Camomilla V. Impact of Gait Events Identification through Wearable Inertial Sensors on Clinical Gait Analysis of Children with Idiopathic Toe Walking. MICROMACHINES 2023; 14:277. [PMID: 36837977 PMCID: PMC9962364 DOI: 10.3390/mi14020277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Revised: 01/13/2023] [Accepted: 01/19/2023] [Indexed: 06/18/2023]
Abstract
Idiopathic toe walking (ITW) is a gait deviation characterized by forefoot contact with the ground and excessive ankle plantarflexion over the entire gait cycle observed in otherwise-typical developing children. The clinical evaluation of ITW is usually performed using optoelectronic systems analyzing the sagittal component of ankle kinematics and kinetics. However, in standardized laboratory contexts, these children can adopt a typical walking pattern instead of a toe walk, thus hindering the laboratory-based clinical evaluation. With these premises, measuring gait in a more ecological environment may be crucial in this population. As a first step towards adopting wearable clinical protocols embedding magneto-inertial sensors and pressure insoles, this study analyzed the performance of three algorithms for gait events identification based on shank and/or foot sensors. Foot strike and foot off were estimated from gait measurements taken from children with ITW walking barefoot and while wearing a foot orthosis. Although no single algorithm stands out as best from all perspectives, preferable algorithms were devised for event identification, temporal parameters estimate and heel and forefoot rocker identification, depending on the barefoot/shoed condition. Errors more often led to an erroneous characterization of the heel rocker, especially in shoed condition. The ITW gait specificity may cause errors in the identification of the foot strike which, in turn, influences the characterization of the heel rocker and, therefore, of the pathologic ITW behavior.
Collapse
Affiliation(s)
- Paolo Brasiliano
- Department of Movement, Human and Health Sciences, University of Rome “Foro Italico”, Piazza Lauro De Bosis 6, 00135 Rome, Italy
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome “Foro Italico”, 00135 Rome, Italy
| | - Guido Mascia
- Department of Movement, Human and Health Sciences, University of Rome “Foro Italico”, Piazza Lauro De Bosis 6, 00135 Rome, Italy
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome “Foro Italico”, 00135 Rome, Italy
| | - Paolo Di Feo
- Department of Movement, Human and Health Sciences, University of Rome “Foro Italico”, Piazza Lauro De Bosis 6, 00135 Rome, Italy
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome “Foro Italico”, 00135 Rome, Italy
| | - Eugenio Di Stanislao
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome “Foro Italico”, 00135 Rome, Italy
- “ITOP SpA Officine Ortopediche”, Via Prenestina Nuova 307/A, 00036 Palestrina, Italy
| | - Martina Alvini
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome “Foro Italico”, 00135 Rome, Italy
- “ITOP SpA Officine Ortopediche”, Via Prenestina Nuova 307/A, 00036 Palestrina, Italy
| | - Giuseppe Vannozzi
- Department of Movement, Human and Health Sciences, University of Rome “Foro Italico”, Piazza Lauro De Bosis 6, 00135 Rome, Italy
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome “Foro Italico”, 00135 Rome, Italy
| | - Valentina Camomilla
- Department of Movement, Human and Health Sciences, University of Rome “Foro Italico”, Piazza Lauro De Bosis 6, 00135 Rome, Italy
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome “Foro Italico”, 00135 Rome, Italy
| |
Collapse
|
27
|
Ortigas Vásquez A, Maas A, List R, Schütz P, Taylor WR, Grupp TM. A Framework for Analytical Validation of Inertial-Sensor-Based Knee Kinematics Using a Six-Degrees-of-Freedom Joint Simulator. SENSORS (BASEL, SWITZERLAND) 2022; 23:348. [PMID: 36616945 PMCID: PMC9824828 DOI: 10.3390/s23010348] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/24/2022] [Revised: 12/23/2022] [Accepted: 12/24/2022] [Indexed: 06/16/2023]
Abstract
The success of kinematic analysis that relies on inertial measurement units (IMUs) heavily depends on the performance of the underlying algorithms. Quantifying the level of uncertainty associated with the models and approximations implemented within these algorithms, without the complication of soft-tissue artefact, is therefore critical. To this end, this study aimed to assess the rotational errors associated with controlled movements. Here, data of six total knee arthroplasty patients from a previously published fluoroscopy study were used to simulate realistic kinematics of daily activities using IMUs mounted to a six-degrees-of-freedom joint simulator. A model-based method involving extended Kalman filtering to derive rotational kinematics from inertial measurements was tested and compared against the ground truth simulator values. The algorithm demonstrated excellent accuracy (root-mean-square error ≤0.9°, maximum absolute error ≤3.2°) in estimating three-dimensional rotational knee kinematics during level walking. Although maximum absolute errors linked to stair descent and sit-to-stand-to-sit rose to 5.2° and 10.8°, respectively, root-mean-square errors peaked at 1.9° and 7.5°. This study hereby describes an accurate framework for evaluating the suitability of the underlying kinematic models and assumptions of an IMU-based motion analysis system, facilitating the future validation of analogous tools.
Collapse
Affiliation(s)
- Ariana Ortigas Vásquez
- Research and Development, Aesculap AG, 78532 Tuttlingen, Germany
- Department of Orthopaedic and Trauma Surgery, Musculoskeletal University Center Munich (MUM), Campus Grosshadern, Ludwig Maximilians University Munich, 81377 Munich, Germany
| | - Allan Maas
- Research and Development, Aesculap AG, 78532 Tuttlingen, Germany
- Department of Orthopaedic and Trauma Surgery, Musculoskeletal University Center Munich (MUM), Campus Grosshadern, Ludwig Maximilians University Munich, 81377 Munich, Germany
| | - Renate List
- Human Performance Lab., Schulthess Clinic, 8008 Zurich, Switzerland
| | - Pascal Schütz
- Institute for Biomechanics, ETH Zurich, Leopold-Ruzicka-Weg 4, 8093 Zurich, Switzerland
| | - William R. Taylor
- Institute for Biomechanics, ETH Zurich, Leopold-Ruzicka-Weg 4, 8093 Zurich, Switzerland
| | - Thomas M. Grupp
- Research and Development, Aesculap AG, 78532 Tuttlingen, Germany
- Department of Orthopaedic and Trauma Surgery, Musculoskeletal University Center Munich (MUM), Campus Grosshadern, Ludwig Maximilians University Munich, 81377 Munich, Germany
| |
Collapse
|
28
|
Potter MV, Cain SM, Ojeda LV, Gurchiek RD, McGinnis RS, Perkins NC. Evaluation of Error-State Kalman Filter Method for Estimating Human Lower-Limb Kinematics during Various Walking Gaits. SENSORS (BASEL, SWITZERLAND) 2022; 22:8398. [PMID: 36366096 PMCID: PMC9654083 DOI: 10.3390/s22218398] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Revised: 10/26/2022] [Accepted: 10/28/2022] [Indexed: 06/16/2023]
Abstract
Inertial measurement units (IMUs) offer an attractive way to study human lower-limb kinematics without traditional laboratory constraints. We present an error-state Kalman filter method to estimate 3D joint angles, joint angle ranges of motion, stride length, and step width using data from an array of seven body-worn IMUs. Importantly, this paper contributes a novel joint axis measurement correction that reduces joint angle drift errors without assumptions of strict hinge-like joint behaviors of the hip and knee. We evaluate the method compared to two optical motion capture methods on twenty human subjects performing six different types of walking gait consisting of forward walking (at three speeds), backward walking, and lateral walking (left and right). For all gaits, RMS differences in joint angle estimates generally remain below 5 degrees for all three ankle joint angles and for flexion/extension and abduction/adduction of the hips and knees when compared to estimates from reflective markers on the IMUs. Additionally, mean RMS differences in estimated stride length and step width remain below 0.13 m for all gait types, except stride length during slow walking. This study confirms the method's potential for non-laboratory based gait analysis, motivating further evaluation with IMU-only measurements and pathological gaits.
Collapse
Affiliation(s)
- Michael V. Potter
- Department of Physics and Engineering, Francis Marion University, Florence, SC 29506, USA
| | - Stephen M. Cain
- Department of Chemical and Biomedical Engineering, West Virginia University, Morgantown, WV 26506, USA
| | - Lauro V. Ojeda
- Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI 48109, USA
| | - Reed D. Gurchiek
- Department of Bioengineering, Stanford University, Stanford, CA 94305, USA
| | - Ryan S. McGinnis
- Department of Electrical and Biomedical Engineering, University of Vermont, Burlington, VT 05405, USA
| | - Noel C. Perkins
- Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI 48109, USA
| |
Collapse
|
29
|
Validity and Reliability of the Leomo Motion-Tracking Device Based on Inertial Measurement Unit with an Optoelectronic Camera System for Cycling Pedaling Evaluation. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19148375. [PMID: 35886226 PMCID: PMC9322640 DOI: 10.3390/ijerph19148375] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Revised: 07/06/2022] [Accepted: 07/07/2022] [Indexed: 11/17/2022]
Abstract
Background: The use of inertial measurement sensors (IMUs), in the search for a more ecological measure, is spreading among sports professionals with the aim of improving the sports performance of cyclists. The kinematic evaluation using the Leomo system (TYPE-R, Leomo, Boulder, CO, USA) has become popular. Purpose: The present study aimed to evaluate the reliability and validity of the Leomo system by measuring the angular kinematics of the lower extremities in the sagittal plane during pedaling at different intensities compared to a gold-standard motion capture camera system (OptiTrack, Natural Point, Inc., Corvallis, OR, USA). Methods: Twenty-four elite cyclists recruited from national and international cycling teams performed two 6-min cycles of cycling on a cycle ergometer at two different intensities (first ventilatory threshold (VT1) and second ventilatory threshold (VT2)) in random order, with a 5 min rest between intensity conditions. The reliability and validity of the Leomo system versus the motion capture system were evaluated. Results: Both systems showed high validity and were consistently excellent in foot angular range Q1 (FAR (Q1)) and foot angular range (FAR) (ICC-VT1 between 0.91 and 0.95 and ICC-VT2 between 0.88 and 0.97), while the variables leg angular range (LAR) and pelvic angle showed a modest validity (ICC-VT1 from 0.52 to 0.71 and ICC-VT2 between 0.61 and 0.67). Compared with Optitrack, Leomo overestimated all the variables, especially the LAR and pelvic angle values, in a range between 12 and 15°. Conclusions: Leomo is a reliable and valid tool for analyzing the ranges of motion of the cyclist’s lower limbs in the sagittal plane, especially for the variables FAR (Q1) and FAR. However, its systematic error for FAR and Pelvic Angle values must be considered in sports performance analysis.
Collapse
|
30
|
Mitternacht J, Hermann A, Carqueville P. Acquisition of Lower-Limb Motion Characteristics with a Single Inertial Measurement Unit—Validation for Use in Physiotherapy. Diagnostics (Basel) 2022; 12:diagnostics12071640. [PMID: 35885542 PMCID: PMC9317307 DOI: 10.3390/diagnostics12071640] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2022] [Revised: 06/21/2022] [Accepted: 07/02/2022] [Indexed: 11/16/2022] Open
Abstract
In physiotherapy, there is still a lack of practical measurement options to track the progress of therapy or rehabilitation following injuries to the lower limbs objectively and reproducibly yet simply and with minimal effort and time. We aim at filling this gap with the design of an IMU (inertial measurement unit) system with only one sensor placed on the tibia edge. In our study, the IMU system evaluated a set of 10 motion tests by a score value for each test and stored them in a database for a more reliable longitudinal assessment of the progress. The sensor analyzed the different motion patterns and obtained characteristic physiological parameters, such as angle ranges, and spatial and angular displacements, such as knee valgus under load. The scores represent the patient’s coordination, stability, strength and speed. To validate the IMU system, these scores were compared to corresponding values from a simultaneously recorded marker-based 3D video motion analysis of the measurements from five healthy volunteers. Score differences between the two systems were almost always within 1–3 degrees for angle measurements. Timing-related measurements were nearly completely identical. The tests on the valgus stability of the knee showed equally small deviations but should nevertheless be repeated with patients, because the healthy subjects showed no signs of instability.
Collapse
|
31
|
Shabani S, Bourke AK, Muaremi A, Praestgaard J, O'Keeffe K, Argent R, Brom M, Scotti C, Caulfield B, Walsh LC. An Automatic Foot and Shank IMU Synchronization Algorithm: Proof-of-concept. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:4210-4213. [PMID: 36083916 DOI: 10.1109/embc48229.2022.9871162] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
When using wearable sensors for measurement and analysis of human performance, it is often necessary to integrate and synchronise data from separate sensor systems. This paper describes a synchronization technique between IMUs attached to the shanks and insoles attached at the feet and aims to solve the need to compute the ankle joint angle, which relies on synchronized sensor data. This will additionally enable concurrent analysis using gait kinematic and kinetic features. A proof-of-concept of the algorithm, which relies on cross-correlation of gyroscope sensor data from the shank and foot, to align the sensor systems is demonstrated. The algorithm output is validated against those signals synchronized using manually annotated heel-strike and toe-off ground-truth signal landmarks, identified in both the shank and feet signals using previously published definitions. Results demonstrate that the developed algorithm is capable of synchronizing both sensor systems, based on IMU data from both healthy participants and participants suffering from knee osteoarthritis, with a mean lag time bias of 25.56ms when compared to the ground truth. A proof-of-concept of technique to synchronise IMUs attached to the shanks and insoles attached at the feet is demonstrated and offers an alternative approach to sensor system synchronisation.
Collapse
|
32
|
Dury J, Ravier G, Michel F. Hip Abductor Muscle Fatigue Induces Different Strategies During Disrupted Postural Control. Front Sports Act Living 2022; 4:918402. [PMID: 35847456 PMCID: PMC9277083 DOI: 10.3389/fspor.2022.918402] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2022] [Accepted: 06/07/2022] [Indexed: 11/15/2022] Open
Abstract
Background Ankle sprain is one of the most common injuries in sport, and hip abductor muscle weakness has recently been reported as a predisposing factor. Currently, the influence of hip abductor muscle fatigue on ankle joint control has not been elucidated during an ankle disturbed balance exercise. This study aimed to determine the influence of hip abductor muscle fatigue on ankle joint control during a disturbed balance task, and to consider inter-individual variability in the kinematic and neuromuscular reorganizations implemented. Methods Twenty-six healthy subjects (13 males; 13 females) performed a unipedal postural balance task with eyes closed before and after a fatiguing exercise (up to a 50% decrease in strength) of the hip abductor muscles. Subjects completed balance task while equipped with an ankle destabilization device that allows inversion/eversion movements. Electromyographic (EMG) activity of the gastrocnemius lateralis (GastL), peroneus longus (PL) and brevis, tibialis anterior, and gluteus medius were recorded during task. Kinematics (e.g., frontal foot angulation) of the ankle complex were determined using inertial measurement units. Results In the overall group, no significant time, sex or interaction effect was observed for kinematic and EMG variables. However, when considering individual responses to hip fatigue, 14 subjects decreased the standard deviation of frontal angulation (−30%) suggesting enhancement of ankle joint control, while 12 subjects increased it (+46%). Normalized EMG for PL and GastL muscles changed with fatigue for both these groups. However, variations were significantly different between groups (p = 0.027 for PL and p = 0.006 for GastL). Indeed, the contribution of ankle muscles increased for the enhanced-stability group while no change for the impaired-stability group. Conclusion These results highlight that subject adopt different neuromuscular and kinematic ankle strategies to control ankle destabilization in response to hip abductor muscle fatigue. Frontal foot angulation variability seemed to be a valuable marker to detect the type of strategy employed. The strategy adopted by the impaired-stability group might have important implications when analyzing risk factors for ankle sprains. Further studies should consider individual responses to fatigue, to understand which factor could predispose athletes to use of one or other strategy.
Collapse
Affiliation(s)
- Jeanne Dury
- Université de Franche Comté, Laboratoire C3S (EA 4660), UFR STAPS, Besançon, France
- Laboratoire Athlète Matériel Environnement, Besançon, France
- *Correspondence: Jeanne Dury
| | - Gilles Ravier
- Université de Franche Comté, Laboratoire C3S (EA 4660), UFR STAPS, Besançon, France
- Laboratoire Athlète Matériel Environnement, Besançon, France
| | - Fabrice Michel
- Université de Franche Comté, Laboratoire Nanomédecine (EA 4662), Besançon, France
- Service de Médecine Physique et de Réadaptation, CHRU Hôpital Jean Minjoz, Besançon, France
| |
Collapse
|
33
|
Mascia G, Brasiliano P, Di Feo P, Cereatti A, Camomilla V. A functional calibration protocol for ankle plantar-dorsiflexion estimate using magnetic and inertial measurement units: Repeatability and reliability assessment. J Biomech 2022; 141:111202. [PMID: 35751925 DOI: 10.1016/j.jbiomech.2022.111202] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Revised: 06/13/2022] [Accepted: 06/14/2022] [Indexed: 11/30/2022]
Abstract
The ankle joint complex presents a tangled functional anatomy, which understanding is fundamental to effectively estimate its kinematics on the sagittal plane. Protocols based on the use of magnetic and inertial measurement units (MIMUs) currently do not take in due account this factor. To this aim, a joint coordinate system for the ankle joint complex is proposed, along with a protocol to perform its anatomical calibration using MIMUs, consisting in a combination of anatomical functional calibrations of the tibiotalar axis and static acquisitions. Protocol repeatability and reliability were tested according to the metrics proposed in Schwartz et al. (2004) involving three different operators performing the protocol three times on ten participants, undergoing instrumented gait analysis through both stereophotogrammetry and MIMUs. Instrumental reliability was evaluated comparing the MIMU-derived kinematic traces with the stereophotogrammetric ones, obtained with the same protocol, through the linear fit method. A total of 270 gait cycles were considered. Results showed that the protocol was repeatable and reliable for what concerned the operators (0.4 ± 0.4 deg and 0.8 ± 0.5 deg, respectively). Instrumental reliability analysis showed a mean RMSD of 3.0 ± 1.3 deg, a mean offset of 9.4 ± 8.4 deg and a mean linear relationship strength of R2 = 0.88 ± 0.08. With due caution, the protocol can be considered both repeatable and reliable. Further studies should pay attention to the other ankle degrees of freedom as well as on the angular convention to compute them.
Collapse
Affiliation(s)
- Guido Mascia
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome "Foro Italico", Roma, Italy; Department of Human, Sports, and Health Science, University of Rome "Foro Italico", Roma, Italy
| | - Paolo Brasiliano
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome "Foro Italico", Roma, Italy; Department of Human, Sports, and Health Science, University of Rome "Foro Italico", Roma, Italy
| | - Paolo Di Feo
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome "Foro Italico", Roma, Italy; Department of Human, Sports, and Health Science, University of Rome "Foro Italico", Roma, Italy
| | - Andrea Cereatti
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome "Foro Italico", Roma, Italy; Department of Electronics and Telecommunications, Polytechnic of Turin, Torino, Italy
| | - Valentina Camomilla
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome "Foro Italico", Roma, Italy; Department of Human, Sports, and Health Science, University of Rome "Foro Italico", Roma, Italy.
| |
Collapse
|
34
|
Application of Fuzzy Clustering Model in the Classification of Sports Training Movements. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:4308283. [PMID: 35685169 PMCID: PMC9173957 DOI: 10.1155/2022/4308283] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/16/2022] [Revised: 04/15/2022] [Accepted: 04/30/2022] [Indexed: 12/02/2022]
Abstract
In order to accurately analyze the movements of sports training using artificial intelligence techniques, an improved fuzzy clustering model is proposed in this study. The fuzzy C-means is used to granulate the multilabel space, and the correlation degree between different variable labels is obtained through information gain. Aiming at the problem of multilabel information classification, an appropriate membership function is selected, which is used to map all information samples and obtain the membership degree of its category. Considering the slow training efficiency of fuzzy support vector machine, the clustering method is used to optimize the fuzzy support vector machine, establish the optimal hyperplane, and complete the classification according to their respective attributes in high-dimensional space. Finally, the proposed algorithm and other algorithms are experimentally compared on the published KTH and Weizmann human behavior data sets. Experimental results show that the proposed method is effective and robust.
Collapse
|
35
|
Patel G, Mullerpatan R, Agarwal B, Shetty T, Ojha R, Shaikh-Mohammed J, Sujatha S. Validation of wearable inertial sensor-based gait analysis system for measurement of spatiotemporal parameters and lower extremity joint kinematics in sagittal plane. Proc Inst Mech Eng H 2022; 236:686-696. [DOI: 10.1177/09544119211072971] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Wearable inertial sensor-based motion analysis systems are promising alternatives to standard camera-based motion capture systems for the measurement of gait parameters and joint kinematics. These wearable sensors, unlike camera-based gold standard systems, find usefulness in outdoor natural environment along with confined indoor laboratory-based environment due to miniature size and wireless data transmission. This study reports validation of our developed (i-Sens) wearable motion analysis system against standard motion capture system. Gait analysis was performed at self-selected speed on non-disabled volunteers in indoor ( n = 15) and outdoor ( n = 8) environments. Two i-Sens units were placed at the level of knee and hip along with passive markers (for indoor study only) for simultaneous 3D motion capture using a motion capture system. Mean absolute percentage error (MAPE) was computed for spatiotemporal parameters from the i-Sens system versus the motion capture system as a true reference. Mean and standard deviation of kinematic data for a gait cycle were plotted for both systems against normative data. Joint kinematics data were analyzed to compute the root mean squared error (RMSE) and Pearson’s correlation coefficient. Kinematic plots indicate a high degree of accuracy of the i-Sens system with the reference system. Excellent positive correlation was observed between the two systems in terms of hip and knee joint angles (Indoor: hip 3.98° ± 1.03°, knee 6.48° ± 1.91°, Outdoor: hip 3.94° ± 0.78°, knee 5.82° ± 0.99°) with low RMSE. Reliability characteristics (defined using standard statistical thresholds of MAPE) of stride length, cadence, walking speed in both outdoor and indoor environment were well within the “Good” category. The i-Sens system has emerged as a potentially cost-effective, valid, accurate, and reliable alternative to expensive, standard motion capture systems for gait analysis. Further clinical trials using the i-Sens system are warranted on participants across different age groups.
Collapse
Affiliation(s)
- Gunjan Patel
- Department of Mechanical Engineering, TTK Center for Rehabilitation Research and Device Development (R2D2), IIT Madras, Chennai, India
- Biodesign Medical Technology, Synersense Private Limited, Ahmedabad, India
| | - Rajani Mullerpatan
- MGM School of Physiotherapy, MGM Institute of Health Sciences, Navi Mumbai, India
| | - Bela Agarwal
- MGM School of Physiotherapy, MGM Institute of Health Sciences, Navi Mumbai, India
| | - Triveni Shetty
- MGM School of Physiotherapy, MGM Institute of Health Sciences, Navi Mumbai, India
| | - Rajdeep Ojha
- Movement Analysis and Rehab Research Laboratories, Department of Physical Medicine and Rehabilitation, Christian Medical College, Vellore, India
| | - Javeed Shaikh-Mohammed
- Department of Mechanical Engineering, TTK Center for Rehabilitation Research and Device Development (R2D2), IIT Madras, Chennai, India
| | - S Sujatha
- Department of Mechanical Engineering, TTK Center for Rehabilitation Research and Device Development (R2D2), IIT Madras, Chennai, India
| |
Collapse
|
36
|
Di Raimondo G, Vanwanseele B, van der Have A, Emmerzaal J, Willems M, Killen BA, Jonkers I. Inertial Sensor-to-Segment Calibration for Accurate 3D Joint Angle Calculation for Use in OpenSim. SENSORS 2022; 22:s22093259. [PMID: 35590949 PMCID: PMC9104520 DOI: 10.3390/s22093259] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Revised: 04/19/2022] [Accepted: 04/21/2022] [Indexed: 01/08/2023]
Abstract
Inertial capture (InCap) systems combined with musculoskeletal (MSK) models are an attractive option for monitoring 3D joint kinematics in an ecological context. However, the primary limiting factor is the sensor-to-segment calibration, which is crucial to estimate the body segment orientations. Walking, running, and stair ascent and descent trials were measured in eleven healthy subjects with the Xsens InCap system and the Vicon 3D motion capture (MoCap) system at a self-selected speed. A novel integrated method that combines previous sensor-to-segment calibration approaches was developed for use in a MSK model with three degree of freedom (DOF) hip and knee joints. The following were compared: RMSE, range of motion (ROM), peaks, and R2 between InCap kinematics estimated with different calibration methods and gold standard MoCap kinematics. The integrated method reduced the RSME for both the hip and the knee joints below 5°, and no statistically significant differences were found between MoCap and InCap kinematics. This was consistent across all the different analyzed movements. The developed method was integrated on an MSK model workflow, and it increased the sensor-to-segment calibration accuracy for an accurate estimate of 3D joint kinematics compared to MoCap, guaranteeing a clinical easy-to-use approach.
Collapse
|
37
|
Hossain MSB, Dranetz J, Choi H, Guo Z. DeepBBWAE-Net: A CNN-RNN Based Deep SuperLearner For Estimating Lower Extremity Sagittal Plane Joint Kinematics Using Shoe-Mounted IMU Sensors In Daily Living. IEEE J Biomed Health Inform 2022; 26:3906-3917. [PMID: 35385394 DOI: 10.1109/jbhi.2022.3165383] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Measurement of human body movement is an essential step in biomechanical analysis. The current standard for human motion capture systems uses infrared cameras to track reflective markers placed on the subject. While these systems can accurately track joint kinematics, the analyses are spatially limited to the lab environment. Though Inertial Measurement Unit (IMU) can eliminate the spatial limitations of the motion capture system, those systems are impractical for use in daily living due to the need for many sensors, typically one per body segment. Due to the need for practical and accurate estimation of joint kinematics, this study implements a reduced number of IMU sensors and employs machine learning algorithm to map sensor data to joint angles. Our developed algorithm estimates hip, knee, and ankle angles in the sagittal plane using two shoe-mounted IMU sensors in different practical walking conditions: treadmill, level overground, stair, and slope conditions. Specifically, we proposed five deep learning networks that use combinations of Convolutional Neural Networks (CNN) and Gated Recurrent Unit (GRU) based Recurrent Neural Networks (RNN) as base learners for our framework. Using those five baseline models, we proposed a novel framework, DeepBBWAE-Net, that implements ensemble techniques such as bagging, boosting, and weighted averaging to improve kinematic predictions. DeepBBWAE-Net predicts joint kinematics for the three joint angles under all the walking conditions with a Root Mean Square Error (RMSE) 6.93-29.0% lower than base models individually. This is the first study that uses a reduced number of IMU sensors to estimate kinematics in multiple walking environments.
Collapse
|
38
|
Wang F, Lu J, Fan Z, Ren C, Geng X. Continuous motion estimation of lower limbs based on deep belief networks and random forest. THE REVIEW OF SCIENTIFIC INSTRUMENTS 2022; 93:044106. [PMID: 35489877 DOI: 10.1063/5.0057478] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/21/2021] [Accepted: 03/18/2022] [Indexed: 06/14/2023]
Abstract
Due to the lag problem of traditional sensor acquisition data, the following movement of exoskeleton robots can affect the comfort of the wearer and even the normal movement pattern of the wearer. In order to solve the problem of lag in exoskeleton motion control, this paper designs a continuous motion estimation method for lower limbs based on the human surface electromyographic (sEMG) signal and achieves the recognition of the motion intention of the wearer through a combination of the deep belief network (DBN) and random forest (RF) algorithm. First, the motion characteristics of human lower limbs are analyzed, and the hip-knee angle and sEMG signal related to lower limb motion are collected and extracted; then, the DBN is used in the dimensionality reduction of the sEMG signal feature values; finally, the motion intention of the wearer is predicted using the RF model optimized by the genetic algorithm. The experimental results show that the root mean square error of knee and hip prediction results of the combined algorithm proposed in this article improved by 0.2573° and 0.3375°, respectively, compared to the algorithm with dimensionality reduction by principal component analysis, and the single prediction time is 0.28 ms less than that before dimensionality reduction, provided that other conditions are exactly the same.
Collapse
Affiliation(s)
- Fei Wang
- Faculty of Robot Science and Engineering, Northeastern University, No. 195, Innovation Road, Hunnan District, Shenyang 110819, China
| | - Jian Lu
- Faculty of Robot Science and Engineering, Northeastern University, No. 195, Innovation Road, Hunnan District, Shenyang 110819, China
| | - Zhibo Fan
- College of Information Science and Engineering, Northeastern University, No. 3-11, Wenhua Road, Heping District, Shenyang 110169, China
| | - Chuanjian Ren
- College of Information Science and Engineering, Northeastern University, No. 3-11, Wenhua Road, Heping District, Shenyang 110169, China
| | - Xin Geng
- College of Information Science and Engineering, Northeastern University, No. 3-11, Wenhua Road, Heping District, Shenyang 110169, China
| |
Collapse
|
39
|
Lee CJ, Lee JK. Inertial Motion Capture-Based Wearable Systems for Estimation of Joint Kinetics: A Systematic Review. SENSORS 2022; 22:s22072507. [PMID: 35408121 PMCID: PMC9002742 DOI: 10.3390/s22072507] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/13/2022] [Revised: 03/22/2022] [Accepted: 03/23/2022] [Indexed: 11/16/2022]
Abstract
In biomechanics, joint kinetics has an important role in evaluating the mechanical load of the joint and understanding its motor function. Although an optical motion capture (OMC) system has mainly been used to evaluate joint kinetics in combination with force plates, inertial motion capture (IMC) systems have recently been emerging in joint kinetic analysis due to their wearability and ubiquitous measurement capability. In this regard, numerous studies have been conducted to estimate joint kinetics using IMC-based wearable systems. However, these have not been comprehensively addressed yet. Thus, the aim of this review is to explore the methodology of the current studies on estimating joint kinetic variables by means of an IMC system. From a systematic search of the literature, 48 studies were selected. This paper summarizes the content of the selected literature in terms of the (i) study characteristics, (ii) methodologies, and (iii) study results. The estimation methods of the selected studies are categorized into two types: the inverse dynamics-based method and the machine learning-based method. While these two methods presented different characteristics in estimating the kinetic variables, it was demonstrated in the literature that both methods could be applied with good performance for the kinetic analysis of joints in different daily activities.
Collapse
Affiliation(s)
- Chang June Lee
- Department of Mechanical Engineering, Hankyong National University, Anseong 17579, Korea;
| | - Jung Keun Lee
- School of ICT, Robotics & Mechanical Engineering, Hankyong National University, Anseong 17579, Korea
- Correspondence: ; Tel.: +82-31-670-5112
| |
Collapse
|
40
|
Al Borno M, O’Day J, Ibarra V, Dunne J, Seth A, Habib A, Ong C, Hicks J, Uhlrich S, Delp S. OpenSense: An open-source toolbox for inertial-measurement-unit-based measurement of lower extremity kinematics over long durations. J Neuroeng Rehabil 2022; 19:22. [PMID: 35184727 PMCID: PMC8859896 DOI: 10.1186/s12984-022-01001-x] [Citation(s) in RCA: 45] [Impact Index Per Article: 22.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2021] [Accepted: 02/02/2022] [Indexed: 11/29/2022] Open
Abstract
Background The ability to measure joint kinematics in natural environments over long durations using inertial measurement units (IMUs) could enable at-home monitoring and personalized treatment of neurological and musculoskeletal disorders. However, drift, or the accumulation of error over time, inhibits the accurate measurement of movement over long durations. We sought to develop an open-source workflow to estimate lower extremity joint kinematics from IMU data that was accurate and capable of assessing and mitigating drift. Methods We computed IMU-based estimates of kinematics using sensor fusion and an inverse kinematics approach with a constrained biomechanical model. We measured kinematics for 11 subjects as they performed two 10-min trials: walking and a repeated sequence of varied lower-extremity movements. To validate the approach, we compared the joint angles computed with IMU orientations to the joint angles computed from optical motion capture using root mean square (RMS) difference and Pearson correlations, and estimated drift using a linear regression on each subject’s RMS differences over time. Results IMU-based kinematic estimates agreed with optical motion capture; median RMS differences over all subjects and all minutes were between 3 and 6 degrees for all joint angles except hip rotation and correlation coefficients were moderate to strong (r = 0.60–0.87). We observed minimal drift in the RMS differences over 10 min; the average slopes of the linear fits to these data were near zero (− 0.14–0.17 deg/min). Conclusions Our workflow produced joint kinematics consistent with those estimated by optical motion capture, and could mitigate kinematic drift even in the trials of continuous walking without rest, which may obviate the need for explicit sensor recalibration (e.g. sitting or standing still for a few seconds or zero-velocity updates) used in current drift-mitigation approaches when studying similar activities. This could enable long-duration measurements, bringing the field one step closer to estimating kinematics in natural environments. Supplementary Information The online version contains supplementary material available at 10.1186/s12984-022-01001-x.
Collapse
|
41
|
Scalera GM, Ferrarin M, Marzegan A, Rabuffetti M. Assessment of Stability of MIMU Probes to Skin-Marker-Based Anatomical Reference Frames During Locomotion Tasks: Effect of Different Locations on the Lower Limb. Front Bioeng Biotechnol 2022; 9:721900. [PMID: 35004633 PMCID: PMC8727529 DOI: 10.3389/fbioe.2021.721900] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2021] [Accepted: 07/09/2021] [Indexed: 12/01/2022] Open
Abstract
Soft tissue artefacts (STAs) undermine the validity of skin-mounted approaches to measure skeletal kinematics. Magneto-inertial measurement units (MIMU) gained popularity due to their low cost and ease of use. Although the reliability of different protocols for marker-based joint kinematics estimation has been widely reported, there are still no indications on where to place MIMU to minimize STA. This study aims to find the most stable positions for MIMU placement, among four positions on the thigh, four on the shank, and three on the foot. Stability was investigated by measuring MIMU movements against an anatomical reference frame, defined according to a standard marker-based approach. To this aim, markers were attached both on the case of each MIMU (technical frame) and on bony landmarks (anatomical frame). For each MIMU, the nine angles between each versor of the technical frame with each versor of the corresponding anatomical frame were computed. The maximum standard deviation of these angles was assumed as the instability index of MIMU-body coupling. Six healthy subjects were asked to perform barefoot gait, step negotiation, and sit-to-stand. Results showed that (1) in the thigh, the frontal position was the most stable in all tasks, especially in gait; (2) in the shank, the proximal position is the least stable, (3) lateral or medial calcaneus and foot dorsum positions showed equivalent stability performances. Further studies should be done before generalizing these conclusions to different motor tasks and MIMU-body fixation methods. The above results are of interest for both MIMU-based gait analysis and rehabilitation approaches using wearable sensors-based biofeedback.
Collapse
|
42
|
Tan JS, Tippaya S, Binnie T, Davey P, Napier K, Caneiro JP, Kent P, Smith A, O’Sullivan P, Campbell A. Predicting Knee Joint Kinematics from Wearable Sensor Data in People with Knee Osteoarthritis and Clinical Considerations for Future Machine Learning Models. SENSORS 2022; 22:s22020446. [PMID: 35062408 PMCID: PMC8781640 DOI: 10.3390/s22020446] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Revised: 12/18/2021] [Accepted: 01/04/2022] [Indexed: 12/16/2022]
Abstract
Deep learning models developed to predict knee joint kinematics are usually trained on inertial measurement unit (IMU) data from healthy people and only for the activity of walking. Yet, people with knee osteoarthritis have difficulties with other activities and there are a lack of studies using IMU training data from this population. Our objective was to conduct a proof-of-concept study to determine the feasibility of using IMU training data from people with knee osteoarthritis performing multiple clinically important activities to predict knee joint sagittal plane kinematics using a deep learning approach. We trained a bidirectional long short-term memory model on IMU data from 17 participants with knee osteoarthritis to estimate knee joint flexion kinematics for phases of walking, transitioning to and from a chair, and negotiating stairs. We tested two models, a double-leg model (four IMUs) and a single-leg model (two IMUs). The single-leg model demonstrated less prediction error compared to the double-leg model. Across the different activity phases, RMSE (SD) ranged from 7.04° (2.6) to 11.78° (6.04), MAE (SD) from 5.99° (2.34) to 10.37° (5.44), and Pearson’s R from 0.85 to 0.99 using leave-one-subject-out cross-validation. This study demonstrates the feasibility of using IMU training data from people who have knee osteoarthritis for the prediction of kinematics for multiple clinically relevant activities.
Collapse
Affiliation(s)
- Jay-Shian Tan
- School of Allied Health, Faculty of Health Sciences, Curtin University, Perth, WA 6845, Australia; (J.-S.T.); (T.B.); (P.D.); (J.P.C.); (P.K.); (A.S.); (P.O.)
| | - Sawitchaya Tippaya
- Curtin Institute for Computation, Curtin University, Perth, WA 6845, Australia; (S.T.); (K.N.)
| | - Tara Binnie
- School of Allied Health, Faculty of Health Sciences, Curtin University, Perth, WA 6845, Australia; (J.-S.T.); (T.B.); (P.D.); (J.P.C.); (P.K.); (A.S.); (P.O.)
| | - Paul Davey
- School of Allied Health, Faculty of Health Sciences, Curtin University, Perth, WA 6845, Australia; (J.-S.T.); (T.B.); (P.D.); (J.P.C.); (P.K.); (A.S.); (P.O.)
| | - Kathryn Napier
- Curtin Institute for Computation, Curtin University, Perth, WA 6845, Australia; (S.T.); (K.N.)
| | - J. P. Caneiro
- School of Allied Health, Faculty of Health Sciences, Curtin University, Perth, WA 6845, Australia; (J.-S.T.); (T.B.); (P.D.); (J.P.C.); (P.K.); (A.S.); (P.O.)
| | - Peter Kent
- School of Allied Health, Faculty of Health Sciences, Curtin University, Perth, WA 6845, Australia; (J.-S.T.); (T.B.); (P.D.); (J.P.C.); (P.K.); (A.S.); (P.O.)
| | - Anne Smith
- School of Allied Health, Faculty of Health Sciences, Curtin University, Perth, WA 6845, Australia; (J.-S.T.); (T.B.); (P.D.); (J.P.C.); (P.K.); (A.S.); (P.O.)
| | - Peter O’Sullivan
- School of Allied Health, Faculty of Health Sciences, Curtin University, Perth, WA 6845, Australia; (J.-S.T.); (T.B.); (P.D.); (J.P.C.); (P.K.); (A.S.); (P.O.)
| | - Amity Campbell
- School of Allied Health, Faculty of Health Sciences, Curtin University, Perth, WA 6845, Australia; (J.-S.T.); (T.B.); (P.D.); (J.P.C.); (P.K.); (A.S.); (P.O.)
- Correspondence:
| |
Collapse
|
43
|
Baronetto A, Amft O. AIM in Wearable and Implantable Computing. Artif Intell Med 2022. [DOI: 10.1007/978-3-030-64573-1_299] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
|
44
|
Bailey CA, Uchida TK, Nantel J, Graham RB. Validity and Sensitivity of an Inertial Measurement Unit-Driven Biomechanical Model of Motor Variability for Gait. SENSORS (BASEL, SWITZERLAND) 2021; 21:7690. [PMID: 34833766 PMCID: PMC8626040 DOI: 10.3390/s21227690] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Revised: 11/02/2021] [Accepted: 11/16/2021] [Indexed: 02/01/2023]
Abstract
Motor variability in gait is frequently linked to fall risk, yet field-based biomechanical joint evaluations are scarce. We evaluated the validity and sensitivity of an inertial measurement unit (IMU)-driven biomechanical model of joint angle variability for gait. Fourteen healthy young adults completed seven-minute trials of treadmill gait at several speeds and arm swing amplitudes. Trunk, pelvis, and lower-limb joint kinematics were estimated by IMU- and optoelectronic-based models using OpenSim. We calculated range of motion (ROM), magnitude of variability (meanSD), local dynamic stability (λmax), persistence of ROM fluctuations (DFAα), and regularity (SaEn) of each angle over 200 continuous strides, and evaluated model accuracy (RMSD: root mean square difference), consistency (ICC2,1: intraclass correlation), biases, limits of agreement, and sensitivity to within-participant gait responses (effects of speed and swing). RMSDs of joint angles were 1.7-9.2° (pooled mean of 4.8°), excluding ankle inversion. ICCs were mostly good to excellent in the primary plane of motion for ROM and in all planes for meanSD and λmax, but were poor to moderate for DFAα and SaEn. Modelled speed and swing responses for ROM, meanSD, and λmax were similar. Results suggest that the IMU-driven model is valid and sensitive for field-based assessments of joint angle time series, ROM in the primary plane of motion, magnitude of variability, and local dynamic stability.
Collapse
Affiliation(s)
- Christopher A. Bailey
- School of Human Kinetics, University of Ottawa, Ottawa, ON K1N 6N5, Canada; (C.A.B.); (J.N.)
| | - Thomas K. Uchida
- Department of Mechanical Engineering, University of Ottawa, Ottawa, ON K1N 6N5, Canada;
| | - Julie Nantel
- School of Human Kinetics, University of Ottawa, Ottawa, ON K1N 6N5, Canada; (C.A.B.); (J.N.)
| | - Ryan B. Graham
- School of Human Kinetics, University of Ottawa, Ottawa, ON K1N 6N5, Canada; (C.A.B.); (J.N.)
| |
Collapse
|
45
|
In-vitro validation of inertial-sensor-to-bone alignment. J Biomech 2021; 128:110781. [PMID: 34628197 DOI: 10.1016/j.jbiomech.2021.110781] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2021] [Revised: 09/24/2021] [Accepted: 09/27/2021] [Indexed: 11/24/2022]
Abstract
A major shortcoming in kinematic estimation using skin-attached inertial sensors is the alignment of sensor-embedded and segment-embedded coordinate systems. Only a correct alignment results in clinically relevant kinematics. Model-based inertial-sensor-to-bone alignment methods relate inertial sensor measurements with a model of the joint. Therefore, they do not rely on properly executed calibration movements or a correct sensor placement. However, it is unknown how accurate such model-based methods align the sensor axes and the underlying segment-embedded axes, as defined by clinical definitions. Also, validation of the alignment models is challenging, since an optical motion capture ground truth can be prone to disturbances from soft tissue movement, orientation estimation and manual palpation errors. We present an anatomical tibiofemoral ground truth on an unloaded cadaveric measurement set-up that intrinsically overcomes these disturbances. Additionally, we validate existing model-based alignment strategies. Modeling the degrees of freedom leads to the identification of rotation axes. However, there is no reason why these axes would align with the segment-embedded axes. Relative inertial-sensor orientation information and rich arbitrary movements showed to aid in identifying the underlying joint axes. The first dominant sagittal rotation axis aligned sufficiently well with the underlying segment-embedded reference. The estimated axes that relate to secondary kinematics tend to deviate from the underlying segment-embedded axes as much as their expected range of motion around the axes. In order to interpret the secondary kinematics, the alignment model should more closely match the biomechanics of the joint.
Collapse
|
46
|
González-Alonso J, Oviedo-Pastor D, Aguado HJ, Díaz-Pernas FJ, González-Ortega D, Martínez-Zarzuela M. Custom IMU-Based Wearable System for Robust 2.4 GHz Wireless Human Body Parts Orientation Tracking and 3D Movement Visualization on an Avatar. SENSORS 2021; 21:s21196642. [PMID: 34640961 PMCID: PMC8512038 DOI: 10.3390/s21196642] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Revised: 09/30/2021] [Accepted: 09/30/2021] [Indexed: 02/06/2023]
Abstract
Recent studies confirm the applicability of Inertial Measurement Unit (IMU)-based systems for human motion analysis. Notwithstanding, high-end IMU-based commercial solutions are yet too expensive and complex to democratize their use among a wide range of potential users. Less featured entry-level commercial solutions are being introduced in the market, trying to fill this gap, but still present some limitations that need to be overcome. At the same time, there is a growing number of scientific papers using not commercial, but custom do-it-yourself IMU-based systems in medical and sports applications. Even though these solutions can help to popularize the use of this technology, they have more limited features and the description on how to design and build them from scratch is yet too scarce in the literature. The aim of this work is two-fold: (1) Proving the feasibility of building an affordable custom solution aimed at simultaneous multiple body parts orientation tracking; while providing a detailed bottom-up description of the required hardware, tools, and mathematical operations to estimate and represent 3D movement in real-time. (2) Showing how the introduction of a custom 2.4 GHz communication protocol including a channel hopping strategy can address some of the current communication limitations of entry-level commercial solutions. The proposed system can be used for wireless real-time human body parts orientation tracking with up to 10 custom sensors, at least at 50 Hz. In addition, it provides a more reliable motion data acquisition in Bluetooth and Wi-Fi crowded environments, where the use of entry-level commercial solutions might be unfeasible. This system can be used as a groundwork for developing affordable human motion analysis solutions that do not require an accurate kinematic analysis.
Collapse
Affiliation(s)
- Javier González-Alonso
- Grupo de Telemática e Imagen, Universidad de Valladolid, 47011 Valladolid, Spain; (D.O.-P.); (F.J.D.-P.); (D.G.-O.)
- Correspondence: (J.G.-A.); (M.M.-Z.)
| | - David Oviedo-Pastor
- Grupo de Telemática e Imagen, Universidad de Valladolid, 47011 Valladolid, Spain; (D.O.-P.); (F.J.D.-P.); (D.G.-O.)
| | - Héctor J. Aguado
- Unidad de Traumatología, Hospital Clínico Universitario de Valladolid, 47003 Valladolid, Spain;
| | - Francisco J. Díaz-Pernas
- Grupo de Telemática e Imagen, Universidad de Valladolid, 47011 Valladolid, Spain; (D.O.-P.); (F.J.D.-P.); (D.G.-O.)
| | - David González-Ortega
- Grupo de Telemática e Imagen, Universidad de Valladolid, 47011 Valladolid, Spain; (D.O.-P.); (F.J.D.-P.); (D.G.-O.)
| | - Mario Martínez-Zarzuela
- Grupo de Telemática e Imagen, Universidad de Valladolid, 47011 Valladolid, Spain; (D.O.-P.); (F.J.D.-P.); (D.G.-O.)
- Correspondence: (J.G.-A.); (M.M.-Z.)
| |
Collapse
|
47
|
Teufl W, Taetz B, Miezal M, Dindorf C, Fröhlich M, Trinler U, Hogan A, Bleser G. Automated detection and explainability of pathological gait patterns using a one-class support vector machine trained on inertial measurement unit based gait data. Clin Biomech (Bristol, Avon) 2021; 89:105452. [PMID: 34481198 DOI: 10.1016/j.clinbiomech.2021.105452] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/10/2020] [Revised: 08/12/2021] [Accepted: 08/13/2021] [Indexed: 02/07/2023]
Abstract
BACKGROUND Machine learning approaches for the classification of pathological gait based on kinematic data, e.g. derived from inertial sensors, are commonly used in terms of a multi-class classification problem. However, there is a lack of research regarding one-class classifiers that are independent of certain pathologies. Therefore, it was the aim of this work to design a one-class classifier based on healthy norm-data that provides not only a prediction probability but rather an explanation of the classification decision, increasing the acceptance of this machine learning approach. METHODS The inertial sensor based gait kinematics of 25 healthy subjects was employed to train a one-class support vector machine. 25 healthy subjects, 20 patients after total hip arthroplasty and one transfemoral amputee served to validate the classifier. Prediction probabilities and feature importance scores were estimated for each subject. FINDINGS The support vector machine predicted 100% of the patients as outliers from the healthy group. Three healthy subjects were predicted as outliers. The feature importance calculation revealed the hip in the sagittal plane as most relevant feature concerning the group after total hip arthroplasty. For the misclassified healthy subject with the lowest probability score the knee flexion and the pelvis obliquity were identified. INTERPRETATION The support vector machine seems a useful tool to identify outliers from a healthy norm-group. The feature importance examination proved to provide valuable information on the musculoskeletal status of the subjects. In this combination, the present approach could be employed in various disciplines to identify abnormal gait and suggest subsequent training.
Collapse
Affiliation(s)
- Wolfgang Teufl
- University of Salzburg, Department of Sport Science, Schlossallee 49, 5400 Hallein, Austria.
| | - Bertram Taetz
- Technische Universität Kaiserslautern, Department of Computer Science, Gottlieb-Daimler-Straße 48, 67663 Kaiserslautern, Germany.
| | - Markus Miezal
- Technische Universität Kaiserslautern, Department of Computer Science, Gottlieb-Daimler-Straße 48, 67663 Kaiserslautern, Germany.
| | - Carlo Dindorf
- Technische Universität Kaiserslautern, Department of Sport Science, Erwin-Schrödinger-Straße 57, 67663 Kaiserslautern, Germany.
| | - Michael Fröhlich
- Technische Universität Kaiserslautern, Department of Sport Science, Erwin-Schrödinger-Straße 57, 67663 Kaiserslautern, Germany.
| | - Ursula Trinler
- BG Klinik Ludwigshafen, Ludwig-Guttmann-Straße 13, 67071 Ludwigshafen, Germany.
| | - Aidan Hogan
- BG Klinik Ludwigshafen, Ludwig-Guttmann-Straße 13, 67071 Ludwigshafen, Germany.
| | - Gabriele Bleser
- Technische Universität Kaiserslautern, Department of Computer Science, Gottlieb-Daimler-Straße 48, 67663 Kaiserslautern, Germany.
| |
Collapse
|
48
|
de Almeida TF, Morya E, Rodrigues AC, de Azevedo Dantas AFO. Development of a Low-Cost Open-Source Measurement System for Joint Angle Estimation. SENSORS 2021; 21:s21196477. [PMID: 34640796 PMCID: PMC8513086 DOI: 10.3390/s21196477] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/15/2021] [Revised: 09/11/2021] [Accepted: 09/22/2021] [Indexed: 12/26/2022]
Abstract
The use of inertial measurement units (IMUs) is a low-cost alternative for measuring joint angles. This study aims to present a low-cost open-source measurement system for joint angle estimation. The system is modular and has hardware and software. The hardware was developed using a low-cost IMU and microcontroller. The IMU data analysis software was developed in Python and has three fusion filters: Complementary Filter, Kalman Filter, and Madgwick Filter. Three experiments were performed for the proof of concept of the system. First, we evaluated the knee joint of Lokomat, with a predefined average range of motion (ROM) of 60∘. In the second, we evaluated our system in a real scenario, evaluating the knee of a healthy adult individual during gait. In the third experiment, we evaluated the software using data from gold standard devices, comparing the results of our software with Ground Truth. In the evaluation of the Lokomat, our system achieved an average ROM of 58.28∘, and during evaluation in a real scenario it achieved an average ROM of 44.62∘. In comparing our software with Ground Truth, we achieved a root-mean-square error of 0.04 and a mean average percentage error of 2.95%. These results encourage the use of this system in other scenarios.
Collapse
|
49
|
Golestani N, Moghaddam M. Wearable magnetic induction-based approach toward 3D motion tracking. Sci Rep 2021; 11:18905. [PMID: 34556725 PMCID: PMC8460632 DOI: 10.1038/s41598-021-98346-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Accepted: 09/02/2021] [Indexed: 11/09/2022] Open
Abstract
Activity recognition using wearable sensors has gained popularity due to its wide range of applications, including healthcare, rehabilitation, sports, and senior monitoring. Tracking the body movement in 3D space facilitates behavior recognition in different scenarios. Wearable systems have limited battery capacity, and many critical challenges have to be addressed to gain a trade-off among power consumption, computational complexity, minimizing the effects of environmental interference, and achieving higher tracking accuracy. This work presents a motion tracking system based on magnetic induction (MI) to tackle the challenges and limitations inherent in designing a wireless monitoring system. We integrated a realistic prototype of an MI sensor with machine learning techniques and investigated one-sensor and two-sensor configuration setups for motion reconstruction. This approach is successfully evaluated using measured and synthesized datasets generated by the analytical model of the MI system. The system has an average distance root-mean-squared error (RMSE) error of 3 cm compared to the ground-truth real-world measured data with Kinect.
Collapse
Affiliation(s)
- Negar Golestani
- Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, 90089, USA.
| | - Mahta Moghaddam
- Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, 90089, USA
| |
Collapse
|
50
|
Sharifi Renani M, Eustace AM, Myers CA, Clary CW. The Use of Synthetic IMU Signals in the Training of Deep Learning Models Significantly Improves the Accuracy of Joint Kinematic Predictions. SENSORS 2021; 21:s21175876. [PMID: 34502766 PMCID: PMC8434290 DOI: 10.3390/s21175876] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/10/2021] [Revised: 08/17/2021] [Accepted: 08/27/2021] [Indexed: 11/24/2022]
Abstract
Gait analysis based on inertial sensors has become an effective method of quantifying movement mechanics, such as joint kinematics and kinetics. Machine learning techniques are used to reliably predict joint mechanics directly from streams of IMU signals for various activities. These data-driven models require comprehensive and representative training datasets to be generalizable across the movement variability seen in the population at large. Bottlenecks in model development frequently occur due to the lack of sufficient training data and the significant time and resources necessary to acquire these datasets. Reliable methods to generate synthetic biomechanical training data could streamline model development and potentially improve model performance. In this study, we developed a methodology to generate synthetic kinematics and the associated predicted IMU signals using open source musculoskeletal modeling software. These synthetic data were used to train neural networks to predict three degree-of-freedom joint rotations at the hip and knee during gait either in lieu of or along with previously measured experimental gait data. The accuracy of the models’ kinematic predictions was assessed using experimentally measured IMU signals and gait kinematics. Models trained using the synthetic data out-performed models using only the experimental data in five of the six rotational degrees of freedom at the hip and knee. On average, root mean square errors in joint angle predictions were improved by 38% at the hip (synthetic data RMSE: 2.3°, measured data RMSE: 4.5°) and 11% at the knee (synthetic data RMSE: 2.9°, measured data RMSE: 3.3°), when models trained solely on synthetic data were compared to measured data. When models were trained on both measured and synthetic data, root mean square errors were reduced by 54% at the hip (measured + synthetic data RMSE: 1.9°) and 45% at the knee (measured + synthetic data RMSE: 1.7°), compared to measured data alone. These findings enable future model development for different activities of clinical significance without the burden of generating large quantities of gait lab data for model training, streamlining model development, and ultimately improving model performance.
Collapse
|