1
|
Raza A, Sekiguchi Y, Yaguchi H, Honda K, Fukushi K, Huang C, Ihara K, Nozaki Y, Nakahara K, Izumi SI, Ebihara S. Gait classification of knee osteoarthritis patients using shoe-embedded internal measurement units sensor. Clin Biomech (Bristol, Avon) 2024; 117:106285. [PMID: 38901396 DOI: 10.1016/j.clinbiomech.2024.106285] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Revised: 05/14/2024] [Accepted: 06/03/2024] [Indexed: 06/22/2024]
Abstract
BACKGROUND Knee osteoarthritis negatively affects the gait of patients, especially that of elderly people. However, the assessment of wearable sensors in knee osteoarthritis patients has been under-researched. During clinical assessments, patients may change their gait patterns under the placebo effect, whereas wearable sensors can be used in any environment. METHODS Sixty patients with knee osteoarthritis and 20 control subjects were included in the study. Wearing shoes with an IMU sensor embedded in the insoles, the participants were required to walk along a walkway. The sensor data were collected during the gait. To discriminate between healthy and knee osteoarthritis patients and to classify different subgroups of knee osteoarthritis patients (patients scheduled for surgery vs. patients not scheduled for surgery; bilateral knee osteoarthritis diagnosis vs. unilateral knee osteoarthritis diagnosis), we used a machine learning approach called the support vector machine. A total of 88 features were extracted and used for classification. FINDINGS The patients vs. healthy participants were classified with 71% accuracy, 85% sensitivity, and 56% specificity. The "patients scheduled for surgery" vs. "patients not scheduled for surgery" were classified with 83% accuracy, 83% sensitivity, and 81% specificity. The bilateral knee osteoarthritis diagnosis vs. unilateral knee osteoarthritis diagnosis was classified with 81% accuracy, 75% sensitivity, and 79% specificity. INTERPRETATION Gait analysis using wearable sensors and machine learning can discriminate between healthy and knee osteoarthritis patients and classify different subgroups with reasonable accuracy, sensitivity, and specificity. The proposed approach requires no complex gait factors and is not limited to controlled laboratory settings.
Collapse
Affiliation(s)
- Ahmed Raza
- Department of Physical Medicine and Rehabilitation, Tohoku University Graduate School of Medicine, 2-1 Seiryo-machi, Aoba-ku, Sendai 980-8575, Japan.
| | - Yusuke Sekiguchi
- Department of Physical Medicine and Rehabilitation, Tohoku University Graduate School of Medicine, 2-1 Seiryo-machi, Aoba-ku, Sendai 980-8575, Japan.
| | - Haruki Yaguchi
- Department of Physical Medicine and Rehabilitation, Tohoku University Graduate School of Medicine, 2-1 Seiryo-machi, Aoba-ku, Sendai 980-8575, Japan
| | - Keita Honda
- Department of Physical Medicine and Rehabilitation, Tohoku University Graduate School of Medicine, 2-1 Seiryo-machi, Aoba-ku, Sendai 980-8575, Japan
| | - Kenichiro Fukushi
- Biometrics Research Labs, NEC Corporation, Hinode 1131, Abiko, Chiba 270-1174, Japan
| | - Chenhui Huang
- Biometrics Research Labs, NEC Corporation, Hinode 1131, Abiko, Chiba 270-1174, Japan
| | - Kazuki Ihara
- Biometrics Research Labs, NEC Corporation, Hinode 1131, Abiko, Chiba 270-1174, Japan
| | - Yoshitaka Nozaki
- Biometrics Research Labs, NEC Corporation, Hinode 1131, Abiko, Chiba 270-1174, Japan
| | - Kentaro Nakahara
- Biometrics Research Labs, NEC Corporation, Hinode 1131, Abiko, Chiba 270-1174, Japan
| | - Shin-Ichi Izumi
- Department of Physical Medicine and Rehabilitation, Tohoku University Graduate School of Medicine, 2-1 Seiryo-machi, Aoba-ku, Sendai 980-8575, Japan; Graduate School of Biomedical Engineering, Tohoku University, 2-1, Seiryo-machi, Aoba-ku, Sendai 980-8575, Japan
| | - Satoru Ebihara
- Department of Internal Medicine & Rehabilitation Science, Disability Sciences, Tohoku University Graduate School of Medicine,1-1 Seiryo-machi, Aoba-ku, Sendai 980-8574, Japan
| |
Collapse
|
2
|
Perrone M, Mell SP, Martin J, Nho SJ, Malloy P. Machine learning-based prediction of hip joint moment in healthy subjects, patients and post-operative subjects. Comput Methods Biomech Biomed Engin 2024:1-5. [PMID: 38328932 DOI: 10.1080/10255842.2024.2310732] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2023] [Accepted: 01/19/2024] [Indexed: 02/09/2024]
Abstract
The application of machine learning in the field of motion capture research is growing rapidly. The purpose of the study is to implement a long-short term memory (LSTM) model able to predict sagittal plane hip joint moment (HJM) across three distinct cohorts (healthy controls, patients and post-operative patients) starting from 3D motion capture and force data. Statistical parametric mapping with paired samples t-test was performed to compare machine learning and inverse dynamics HJM predicted values, with the latter used as gold standard. The results demonstrated favorable model performance on each of the three cohorts, showcasing its ability to successfully generalize predictions across diverse cohorts.
Collapse
Affiliation(s)
- Mattia Perrone
- Department of Orthopedic Surgery, Rush Medical College of Rush University, Rush University Medical Center, Chicago, Illinois, USA
- Department of Physical Therapy, Arcadia University, Glenside, Pennsylvania, USA
| | - Steven P Mell
- Department of Orthopedic Surgery, Rush Medical College of Rush University, Rush University Medical Center, Chicago, Illinois, USA
| | - John Martin
- Department of Orthopedic Surgery, Rush Medical College of Rush University, Rush University Medical Center, Chicago, Illinois, USA
| | - Shane J Nho
- Department of Orthopedic Surgery, Rush Medical College of Rush University, Rush University Medical Center, Chicago, Illinois, USA
| | - Philip Malloy
- Department of Orthopedic Surgery, Rush Medical College of Rush University, Rush University Medical Center, Chicago, Illinois, USA
- Department of Physical Therapy, Arcadia University, Glenside, Pennsylvania, USA
| |
Collapse
|
3
|
Huang X, Xue Y, Ren S, Wang F. Sensor-Based Wearable Systems for Monitoring Human Motion and Posture: A Review. SENSORS (BASEL, SWITZERLAND) 2023; 23:9047. [PMID: 38005436 PMCID: PMC10675437 DOI: 10.3390/s23229047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/29/2023] [Revised: 11/06/2023] [Accepted: 11/06/2023] [Indexed: 11/26/2023]
Abstract
In recent years, marked progress has been made in wearable technology for human motion and posture recognition in the areas of assisted training, medical health, VR/AR, etc. This paper systematically reviews the status quo of wearable sensing systems for human motion capture and posture recognition from three aspects, which are monitoring indicators, sensors, and system design. In particular, it summarizes the monitoring indicators closely related to human posture changes, such as trunk, joints, and limbs, and analyzes in detail the types, numbers, locations, installation methods, and advantages and disadvantages of sensors in different monitoring systems. Finally, it is concluded that future research in this area will emphasize monitoring accuracy, data security, wearing comfort, and durability. This review provides a reference for the future development of wearable sensing systems for human motion capture.
Collapse
Affiliation(s)
- Xinxin Huang
- Guangdong Modern Apparel Technology & Engineering Center, Guangdong University of Technology, Guangzhou 510075, China or (X.H.); (Y.X.); (S.R.)
- Xiayi Lixing Research Institute of Textiles and Apparel, Shangqiu 476499, China
| | - Yunan Xue
- Guangdong Modern Apparel Technology & Engineering Center, Guangdong University of Technology, Guangzhou 510075, China or (X.H.); (Y.X.); (S.R.)
| | - Shuyun Ren
- Guangdong Modern Apparel Technology & Engineering Center, Guangdong University of Technology, Guangzhou 510075, China or (X.H.); (Y.X.); (S.R.)
| | - Fei Wang
- School of Textile Materials and Engineering, Wuyi University, Jiangmen 529020, China
| |
Collapse
|
4
|
Wang F, Liang W, Afzal HMR, Fan A, Li W, Dai X, Liu S, Hu Y, Li Z, Yang P. Estimation of Lower Limb Joint Angles and Joint Moments during Different Locomotive Activities Using the Inertial Measurement Units and a Hybrid Deep Learning Model. SENSORS (BASEL, SWITZERLAND) 2023; 23:9039. [PMID: 38005427 PMCID: PMC10674933 DOI: 10.3390/s23229039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Revised: 11/02/2023] [Accepted: 11/06/2023] [Indexed: 11/26/2023]
Abstract
Using inertial measurement units (IMUs) to estimate lower limb joint kinematics and kinetics can provide valuable information for disease diagnosis and rehabilitation assessment. To estimate gait parameters using IMUs, model-based filtering approaches have been proposed, such as the Kalman filter and complementary filter. However, these methods require special calibration and alignment of IMUs. The development of deep learning algorithms has facilitated the application of IMUs in biomechanics as it does not require particular calibration and alignment procedures of IMUs in use. To estimate hip/knee/ankle joint angles and moments in the sagittal plane, a subject-independent temporal convolutional neural network-bidirectional long short-term memory network (TCN-BiLSTM) model was proposed using three IMUs. A public benchmark dataset containing the most representative locomotive activities in daily life was used to train and evaluate the TCN-BiLSTM model. The mean Pearson correlation coefficient of joint angles and moments estimated by the proposed model reached 0.92 and 0.87, respectively. This indicates that the TCN-BiLSTM model can effectively estimate joint angles and moments in multiple scenarios, demonstrating its potential for application in clinical and daily life scenarios.
Collapse
Affiliation(s)
- Fanjie Wang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi’an 710072, China; (F.W.); (W.L.); (H.M.R.A.); (A.F.); (Y.H.)
| | - Wenqi Liang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi’an 710072, China; (F.W.); (W.L.); (H.M.R.A.); (A.F.); (Y.H.)
| | - Hafiz Muhammad Rehan Afzal
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi’an 710072, China; (F.W.); (W.L.); (H.M.R.A.); (A.F.); (Y.H.)
| | - Ao Fan
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi’an 710072, China; (F.W.); (W.L.); (H.M.R.A.); (A.F.); (Y.H.)
| | - Wenjiong Li
- National Key Laboratory of Space Medicine, China Astronaut Research and Training Center, Beijing 100094, China; (W.L.); (X.D.); (S.L.)
| | - Xiaoqian Dai
- National Key Laboratory of Space Medicine, China Astronaut Research and Training Center, Beijing 100094, China; (W.L.); (X.D.); (S.L.)
| | - Shujuan Liu
- National Key Laboratory of Space Medicine, China Astronaut Research and Training Center, Beijing 100094, China; (W.L.); (X.D.); (S.L.)
| | - Yiwei Hu
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi’an 710072, China; (F.W.); (W.L.); (H.M.R.A.); (A.F.); (Y.H.)
| | - Zhili Li
- National Key Laboratory of Space Medicine, China Astronaut Research and Training Center, Beijing 100094, China; (W.L.); (X.D.); (S.L.)
| | - Pengfei Yang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi’an 710072, China; (F.W.); (W.L.); (H.M.R.A.); (A.F.); (Y.H.)
| |
Collapse
|
5
|
Kwon MP, Hullfish TJ, Humbyrd CJ, Boakye LAT, Baxter JR. Wearable sensor and machine learning estimate tendon load and walking speed during immobilizing boot ambulation. Sci Rep 2023; 13:18086. [PMID: 37872320 PMCID: PMC10593749 DOI: 10.1038/s41598-023-45375-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Accepted: 10/18/2023] [Indexed: 10/25/2023] Open
Abstract
The purpose of this study is to develop a wearable paradigm to accurately monitor Achilles tendon loading and walking speed using wearable sensors that reduce subject burden. Ten healthy adults walked in an immobilizing boot under various heel wedge conditions (30°, 5°, 0°) and walking speeds. Three-dimensional motion capture, ground reaction force, and 6-axis inertial measurement unit (IMU) signals were collected. We used a Least Absolute Shrinkage and Selection Operator (LASSO) regression to predict peak Achilles tendon load and walking speed. The effects of altering sensor parameters were also explored. Walking speed models (mean absolute percentage error (MAPE): 8.81 ± 4.29%) outperformed tendon load models (MAPE: 34.93 ± 26.3%). Models trained with subject-specific data performed better than models trained without subject-specific data. Removing the gyroscope, decreasing the sampling frequency, and using combinations of sensors did not change the usability of the models, having inconsequential effects on model performance. We developed a simple monitoring paradigm that uses LASSO regression and wearable sensors to accurately predict (MAPE ≤ 12.6%) Achilles tendon loading and walking speed while ambulating in an immobilizing boot. This paradigm provides a clinically implementable strategy to longitudinally monitor patient loading and activity while recovering from Achilles tendon injuries.
Collapse
Affiliation(s)
- Michelle P Kwon
- Department of Orthopaedic Surgery, University of Pennsylvania, Philadelphia, PA, USA
| | - Todd J Hullfish
- Department of Orthopaedic Surgery, University of Pennsylvania, Philadelphia, PA, USA
| | - Casey Jo Humbyrd
- Department of Orthopaedic Surgery, University of Pennsylvania, Philadelphia, PA, USA
| | - Lorraine A T Boakye
- Department of Orthopaedic Surgery, University of Pennsylvania, Philadelphia, PA, USA
| | - Josh R Baxter
- Department of Orthopaedic Surgery, University of Pennsylvania, Philadelphia, PA, USA.
| |
Collapse
|
6
|
Mak THA, Liang R, Chim TW, Yip J. A Neural Network Approach for Inertial Measurement Unit-Based Estimation of Three-Dimensional Spinal Curvature. SENSORS (BASEL, SWITZERLAND) 2023; 23:6122. [PMID: 37447971 DOI: 10.3390/s23136122] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Revised: 06/27/2023] [Accepted: 06/30/2023] [Indexed: 07/15/2023]
Abstract
The spine is an important part of the human body. Thus, its curvature and shape are closely monitored, and treatment is required if abnormalities are detected. However, the current method of spinal examination mostly relies on two-dimensional static imaging, which does not provide real-time information on dynamic spinal behaviour. Therefore, this study explored an easier and more efficient method based on machine learning and sensors to determine the curvature of the spine. Fifteen participants were recruited and performed tests to generate data for training a neural network. This estimated the spinal curvature from the readings of three inertial measurement units and had an average absolute error of 0.261161 cm.
Collapse
Affiliation(s)
- T H Alex Mak
- Department of Computer Science, The University of Hong Kong, Pokfulam, Hong Kong, China
| | - Ruixin Liang
- Laboratory for Artificial Intelligence in Design, Hong Kong Science Park, New Territories, Hong Kong, China
| | - T W Chim
- Department of Computer Science, The University of Hong Kong, Pokfulam, Hong Kong, China
| | - Joanne Yip
- School of Fashion and Textiles, The Hong Kong Polytechnic University, Hung Hom, Hong Kong, China
| |
Collapse
|
7
|
Kwon MP, Hullfish TJ, Humbyrd CJ, Boakye LA, Baxter JR. Wearable sensor and machine learning accurately estimate tendon load and walking speed during immobilizing boot ambulation. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2023:2023.06.03.23290612. [PMID: 37333069 PMCID: PMC10274996 DOI: 10.1101/2023.06.03.23290612] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/20/2023]
Abstract
Achilles tendon injuries are treated with progressive weight bearing to promote tendon healing and restore function. Patient rehabilitation progression are typically studied in controlled, lab settings and do not represent the long-term loading experienced during daily living. The purpose of this study is to develop a wearable paradigm to accurately monitor Achilles tendon loading and walking speed using low-cost sensors that reduce subject burden. Ten healthy adults walked in an immobilizing boot under various heel wedge conditions (30°, 5°, 0°) and walking speeds. Three-dimensional motion capture, ground reaction force, and 6-axis inertial measurement unit (IMU) signals were collected per trial. We used Least Absolute Shrinkage and Selection Operator (LASSO) regression to predict peak Achilles tendon load and walking speed. The effects of using only accelerometer data, different sampling frequency, and multiple sensors to train the model were also explored. Walking speed models outperformed (mean absolute percentage error (MAPE): 8.41 ± 4.08%) tendon load models (MAPE: 33.93 ± 23.9%). Models trained with subject-specific data performed significantly better than generalized models. For example, our personalized model that was trained with only subject-specific data predicted tendon load with a 11.5 ± 4.41% MAPE and walking speed with a 4.50 ± 0.91% MAPE. Removing gyroscope channels, decreasing sampling frequency, and using combinations of sensors had inconsequential effects on models performance (changes in MAPE < 6.09%). We developed a simple monitoring paradigm that uses LASSO regression and wearable sensors to accurately predict Achilles tendon loading and walking speed while ambulating in an immobilizing boot. This paradigm provides a clinically implementable strategy to longitudinally monitor patient loading and activity while recovering from Achilles tendon injuries.
Collapse
|
8
|
Ozates ME, Karabulut D, Salami F, Wolf SI, Arslan YZ. Machine learning-based prediction of joint moments based on kinematics in patients with cerebral palsy. J Biomech 2023; 155:111668. [PMID: 37276682 DOI: 10.1016/j.jbiomech.2023.111668] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 04/28/2023] [Accepted: 05/26/2023] [Indexed: 06/07/2023]
Abstract
Joint moments during gait provide valuable information for clinical decision-making in patients with cerebral palsy (CP). Joint moments are calculated based on ground reaction forces (GRF) using inverse dynamics models. Obtaining GRF from patients with CP is challenging. Typically developed (TD) individuals' joint moments were predicted from joint angles using machine learning, but no such study has been conducted on patients with CP. Accordingly, we aimed to predict the dorsi-plantar flexion, knee flexion-extension, hip flexion-extension, and hip adduction-abduction moments based on the trunk, pelvis, hip, knee, and ankle kinematics during gait in patients with CP and TD individuals using one-dimensional convolutional neural networks (CNN). The anonymized retrospective gait data of 329 TD (26 years ± 14, mass: 70 kg ± 15, height: 167 cm ± 89) and 917 CP (17 years ± 9, mass:47 kg ± 19, height:153 cm ± 36) individuals were evaluated and after applying inclusion-exclusion criteria, 132 TD and 622 CP patients with spastic diplegia were selected. We trained specific CNN models and evaluated their performance using isolated test subject groups based on normalized root mean square error (nRMSE) and Pearson correlation coefficient (PCC). Joint moments were predicted with nRMSE between 18.02% and 13.58% for the CP and between 12.55% and 8.58% for the TD groups, whereas with PCC between 0.85 and 0.93 for the CP and between 0.94 and 0.98 for the TD groups. Machine learning-based joint moment prediction from kinematics could replace conventional moment calculation in CP patients in the future, but the current level of prediction errors restricts its use for clinical decision-making today.
Collapse
Affiliation(s)
- Mustafa Erkam Ozates
- Department of Robotics and Intelligent Systems, Institute of Graduate Studies in Science and Engineering, Turkish-German University, Istanbul, Turkey
| | - Derya Karabulut
- Department of Mechanical Engineering, Faculty of Engineering, Istanbul University-Cerrahpaşa, Istanbul, Turkey
| | - Firooz Salami
- Clinic for Orthopaedics and Trauma Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - Sebastian Immanuel Wolf
- Clinic for Orthopaedics and Trauma Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - Yunus Ziya Arslan
- Department of Robotics and Intelligent Systems, Institute of Graduate Studies in Science and Engineering, Turkish-German University, Istanbul, Turkey.
| |
Collapse
|
9
|
Di Raimondo G, Willems M, Killen BA, Havashinezhadian S, Turcot K, Vanwanseele B, Jonkers I. Peak Tibiofemoral Contact Forces Estimated Using IMU-Based Approaches Are Not Significantly Different from Motion Capture-Based Estimations in Patients with Knee Osteoarthritis. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23094484. [PMID: 37177688 PMCID: PMC10181595 DOI: 10.3390/s23094484] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Revised: 05/01/2023] [Accepted: 05/03/2023] [Indexed: 05/15/2023]
Abstract
Altered tibiofemoral contact forces represent a risk factor for osteoarthritis onset and progression, making optimization of the knee force distribution a target of treatment strategies. Musculoskeletal model-based simulations are a state-of-the-art method to estimate joint contact forces, but they typically require laboratory-based input and skilled operators. To overcome these limitations, ambulatory methods, relying on inertial measurement units, have been proposed to estimated ground reaction forces and, consequently, knee contact forces out-of-the-lab. This study proposes the use of a full inertial-capture-based musculoskeletal modelling workflow with an underlying probabilistic principal component analysis model trained on 1787 gait cycles in patients with knee osteoarthritis. As validation, five patients with knee osteoarthritis were instrumented with 17 inertial measurement units and 76 opto-reflective markers. Participants performed multiple overground walking trials while motion and inertial capture methods were synchronously recorded. Moderate to strong correlations were found for the inertial capture-based knee contact forces compared to motion capture with root mean square error between 0.15 and 0.40 of body weight. The results show that our workflow can inform and potentially assist clinical practitioners to monitor knee joint loading in physical therapy sessions and eventually assess long-term therapeutic effects in a clinical context.
Collapse
Affiliation(s)
- Giacomo Di Raimondo
- Department of Movement Sciences, Katholieke Universiteit Leuven, 3001 Heverlee, Belgium
| | - Miel Willems
- Department of Movement Sciences, Katholieke Universiteit Leuven, 3001 Heverlee, Belgium
| | - Bryce Adrian Killen
- Department of Movement Sciences, Katholieke Universiteit Leuven, 3001 Heverlee, Belgium
| | | | - Katia Turcot
- Department of Kinesiology, Université Laval, Québec, QC G1V 0A6, Canada
| | - Benedicte Vanwanseele
- Department of Movement Sciences, Katholieke Universiteit Leuven, 3001 Heverlee, Belgium
| | - Ilse Jonkers
- Department of Movement Sciences, Katholieke Universiteit Leuven, 3001 Heverlee, Belgium
| |
Collapse
|
10
|
Liang W, Wang F, Fan A, Zhao W, Yao W, Yang P. Extended Application of Inertial Measurement Units in Biomechanics: From Activity Recognition to Force Estimation. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23094229. [PMID: 37177436 PMCID: PMC10180901 DOI: 10.3390/s23094229] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Revised: 04/20/2023] [Accepted: 04/22/2023] [Indexed: 05/15/2023]
Abstract
Abnormal posture or movement is generally the indicator of musculoskeletal injuries or diseases. Mechanical forces dominate the injury and recovery processes of musculoskeletal tissue. Using kinematic data collected from wearable sensors (notably IMUs) as input, activity recognition and musculoskeletal force (typically represented by ground reaction force, joint force/torque, and muscle activity/force) estimation approaches based on machine learning models have demonstrated their superior accuracy. The purpose of the present study is to summarize recent achievements in the application of IMUs in biomechanics, with an emphasis on activity recognition and mechanical force estimation. The methodology adopted in such applications, including data pre-processing, noise suppression, classification models, force/torque estimation models, and the corresponding application effects, are reviewed. The extent of the applications of IMUs in daily activity assessment, posture assessment, disease diagnosis, rehabilitation, and exoskeleton control strategy development are illustrated and discussed. More importantly, the technical feasibility and application opportunities of musculoskeletal force prediction using IMU-based wearable devices are indicated and highlighted. With the development and application of novel adaptive networks and deep learning models, the accurate estimation of musculoskeletal forces can become a research field worthy of further attention.
Collapse
Affiliation(s)
- Wenqi Liang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| | - Fanjie Wang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| | - Ao Fan
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| | - Wenrui Zhao
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| | - Wei Yao
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| | - Pengfei Yang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| |
Collapse
|
11
|
Dorschky E, Camomilla V, Davis J, Federolf P, Reenalda J, Koelewijn AD. Perspective on "in the wild" movement analysis using machine learning. Hum Mov Sci 2023; 87:103042. [PMID: 36493569 DOI: 10.1016/j.humov.2022.103042] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2022] [Revised: 09/01/2022] [Accepted: 11/19/2022] [Indexed: 12/12/2022]
Abstract
Recent advances in wearable sensing and machine learning have created ample opportunities for "in the wild" movement analysis in sports, since the combination of both enables real-time feedback to be provided to athletes and coaches, as well as long-term monitoring of movements. The potential for real-time feedback is useful for performance enhancement or technique analysis, and can be achieved by training efficient models and implementing them on dedicated hardware. Long-term monitoring of movement can be used for injury prevention, among others. Such applications are often enabled by training a machine learned model from large datasets that have been collected using wearable sensors. Therefore, in this perspective paper, we provide an overview of approaches for studies that aim to analyze sports movement "in the wild" using wearable sensors and machine learning. First, we discuss how a measurement protocol can be set up by answering six questions. Then, we discuss the benefits and pitfalls and provide recommendations for effective training of machine learning models from movement data, focusing on data pre-processing, feature calculation, and model selection and tuning. Finally, we highlight two application domains where "in the wild" data recording was combined with machine learning for injury prevention and technique analysis, respectively.
Collapse
Affiliation(s)
- Eva Dorschky
- Machine Learning and Data Analytics (MaD) Lab, Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Valentina Camomilla
- Department of Movement, Human and Health Sciences, University of Rome "Foro Italico", Rome, Italy
| | - Jesse Davis
- Department of Computer Science and Leuven.AI, KU Leuven, Leuven, Belgium
| | - Peter Federolf
- Department of Sport Science, University of Innsbruck, Innsbruck, Austria
| | - Jasper Reenalda
- Biomedical Signal and Systems group, University of Twente, Enschede, The Netherlands; Roessingh Research and Development, Enschede, The Netherlands
| | - Anne D Koelewijn
- Machine Learning and Data Analytics (MaD) Lab, Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany.
| |
Collapse
|
12
|
Hamilton RI, Williams J, Holt C. Biomechanics beyond the lab: Remote technology for osteoarthritis patient data-A scoping review. FRONTIERS IN REHABILITATION SCIENCES 2022; 3:1005000. [PMID: 36451804 PMCID: PMC9701737 DOI: 10.3389/fresc.2022.1005000] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2022] [Accepted: 10/05/2022] [Indexed: 01/14/2024]
Abstract
The objective of this project is to produce a review of available and validated technologies suitable for gathering biomechanical and functional research data in patients with osteoarthritis (OA), outside of a traditionally fixed laboratory setting. A scoping review was conducted using defined search terms across three databases (Scopus, Ovid MEDLINE, and PEDro), and additional sources of information from grey literature were added. One author carried out an initial title and abstract review, and two authors independently completed full-text screenings. Out of the total 5,164 articles screened, 75 were included based on inclusion criteria covering a range of technologies in articles published from 2015. These were subsequently categorised by technology type, parameters measured, level of remoteness, and a separate table of commercially available systems. The results concluded that from the growing number of available and emerging technologies, there is a well-established range in use and further in development. Of particular note are the wide-ranging available inertial measurement unit systems and the breadth of technology available to record basic gait spatiotemporal measures with highly beneficial and informative functional outputs. With the majority of technologies categorised as suitable for part-remote use, the number of technologies that are usable and fully remote is rare and they usually employ smartphone software to enable this. With many systems being developed for camera-based technology, such technology is likely to increase in usability and availability as computational models are being developed with increased sensitivities to recognise patterns of movement, enabling data collection in the wider environment and reducing costs and creating a better understanding of OA patient biomechanical and functional movement data.
Collapse
Affiliation(s)
- Rebecca I. Hamilton
- Musculoskeletal Biomechanics Research Facility, School of Engineering, Cardiff University, Cardiff, United Kingdom
| | - Jenny Williams
- Musculoskeletal Biomechanics Research Facility, School of Engineering, Cardiff University, Cardiff, United Kingdom
| | | | - Cathy Holt
- Musculoskeletal Biomechanics Research Facility, School of Engineering, Cardiff University, Cardiff, United Kingdom
- Osteoarthritis Technology NetworkPlus (OATech+), EPSRC UK-Wide Research Network+, United Kingdom
| |
Collapse
|
13
|
Bo F, Yerebakan M, Dai Y, Wang W, Li J, Hu B, Gao S. IMU-Based Monitoring for Assistive Diagnosis and Management of IoHT: A Review. Healthcare (Basel) 2022; 10:healthcare10071210. [PMID: 35885736 PMCID: PMC9318359 DOI: 10.3390/healthcare10071210] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 06/20/2022] [Accepted: 06/23/2022] [Indexed: 01/22/2023] Open
Abstract
With the rapid development of Internet of Things (IoT) technologies, traditional disease diagnoses carried out in medical institutions can now be performed remotely at home or even ambient environments, yielding the concept of the Internet of Health Things (IoHT). Among the diverse IoHT applications, inertial measurement unit (IMU)-based systems play a significant role in the detection of diseases in many fields, such as neurological, musculoskeletal, and mental. However, traditional numerical interpretation methods have proven to be challenging to provide satisfying detection accuracies owing to the low quality of raw data, especially under strong electromagnetic interference (EMI). To address this issue, in recent years, machine learning (ML)-based techniques have been proposed to smartly map IMU-captured data on disease detection and progress. After a decade of development, the combination of IMUs and ML algorithms for assistive disease diagnosis has become a hot topic, with an increasing number of studies reported yearly. A systematic search was conducted in four databases covering the aforementioned topic for articles published in the past six years. Eighty-one articles were included and discussed concerning two aspects: different ML techniques and application scenarios. This review yielded the conclusion that, with the help of ML technology, IMUs can serve as a crucial element in disease diagnosis, severity assessment, characteristic estimation, and monitoring during the rehabilitation process. Furthermore, it summarizes the state-of-the-art, analyzes challenges, and provides foreseeable future trends for developing IMU-ML systems for IoHT.
Collapse
Affiliation(s)
- Fan Bo
- Smart Sensing Research and Development Center, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, China; (F.B.); (W.W.)
- School of Microelectronics, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Mustafa Yerebakan
- Department of Industrial and Systems Engineering, University of Florida, Gainesville, FL 32611, USA;
| | - Yanning Dai
- School of Instrumentation and Optoelectronic Engineering, Beihang University, Beijing 100191, China;
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, Beihang University, Beijing 100191, China
| | - Weibing Wang
- Smart Sensing Research and Development Center, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, China; (F.B.); (W.W.)
- School of Microelectronics, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Jia Li
- Smart Sensing Research and Development Center, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, China; (F.B.); (W.W.)
- School of Microelectronics, University of Chinese Academy of Sciences, Beijing 100049, China
- Correspondence: (J.L.); (B.H.); (S.G.)
| | - Boyi Hu
- Department of Industrial and Systems Engineering, University of Florida, Gainesville, FL 32611, USA;
- Correspondence: (J.L.); (B.H.); (S.G.)
| | - Shuo Gao
- School of Instrumentation and Optoelectronic Engineering, Beihang University, Beijing 100191, China;
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, Beihang University, Beijing 100191, China
- Correspondence: (J.L.); (B.H.); (S.G.)
| |
Collapse
|
14
|
Di Raimondo G, Vanwanseele B, van der Have A, Emmerzaal J, Willems M, Killen BA, Jonkers I. Inertial Sensor-to-Segment Calibration for Accurate 3D Joint Angle Calculation for Use in OpenSim. SENSORS 2022; 22:s22093259. [PMID: 35590949 PMCID: PMC9104520 DOI: 10.3390/s22093259] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Revised: 04/19/2022] [Accepted: 04/21/2022] [Indexed: 01/08/2023]
Abstract
Inertial capture (InCap) systems combined with musculoskeletal (MSK) models are an attractive option for monitoring 3D joint kinematics in an ecological context. However, the primary limiting factor is the sensor-to-segment calibration, which is crucial to estimate the body segment orientations. Walking, running, and stair ascent and descent trials were measured in eleven healthy subjects with the Xsens InCap system and the Vicon 3D motion capture (MoCap) system at a self-selected speed. A novel integrated method that combines previous sensor-to-segment calibration approaches was developed for use in a MSK model with three degree of freedom (DOF) hip and knee joints. The following were compared: RMSE, range of motion (ROM), peaks, and R2 between InCap kinematics estimated with different calibration methods and gold standard MoCap kinematics. The integrated method reduced the RSME for both the hip and the knee joints below 5°, and no statistically significant differences were found between MoCap and InCap kinematics. This was consistent across all the different analyzed movements. The developed method was integrated on an MSK model workflow, and it increased the sensor-to-segment calibration accuracy for an accurate estimate of 3D joint kinematics compared to MoCap, guaranteeing a clinical easy-to-use approach.
Collapse
|
15
|
Lee CJ, Lee JK. Inertial Motion Capture-Based Wearable Systems for Estimation of Joint Kinetics: A Systematic Review. SENSORS 2022; 22:s22072507. [PMID: 35408121 PMCID: PMC9002742 DOI: 10.3390/s22072507] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/13/2022] [Revised: 03/22/2022] [Accepted: 03/23/2022] [Indexed: 11/16/2022]
Abstract
In biomechanics, joint kinetics has an important role in evaluating the mechanical load of the joint and understanding its motor function. Although an optical motion capture (OMC) system has mainly been used to evaluate joint kinetics in combination with force plates, inertial motion capture (IMC) systems have recently been emerging in joint kinetic analysis due to their wearability and ubiquitous measurement capability. In this regard, numerous studies have been conducted to estimate joint kinetics using IMC-based wearable systems. However, these have not been comprehensively addressed yet. Thus, the aim of this review is to explore the methodology of the current studies on estimating joint kinetic variables by means of an IMC system. From a systematic search of the literature, 48 studies were selected. This paper summarizes the content of the selected literature in terms of the (i) study characteristics, (ii) methodologies, and (iii) study results. The estimation methods of the selected studies are categorized into two types: the inverse dynamics-based method and the machine learning-based method. While these two methods presented different characteristics in estimating the kinetic variables, it was demonstrated in the literature that both methods could be applied with good performance for the kinetic analysis of joints in different daily activities.
Collapse
Affiliation(s)
- Chang June Lee
- Department of Mechanical Engineering, Hankyong National University, Anseong 17579, Korea;
| | - Jung Keun Lee
- School of ICT, Robotics & Mechanical Engineering, Hankyong National University, Anseong 17579, Korea
- Correspondence: ; Tel.: +82-31-670-5112
| |
Collapse
|
16
|
Rose MJ, Costello KE, Eigenbrot S, Torabian K, Kumar D. Inertial measurement units and application for remote healthcare in hip and knee osteoarthritis: a narrative review (Preprint). JMIR Rehabil Assist Technol 2021; 9:e33521. [PMID: 35653180 PMCID: PMC9204569 DOI: 10.2196/33521] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2021] [Revised: 02/18/2022] [Accepted: 05/06/2022] [Indexed: 11/16/2022] Open
Abstract
Background Measuring and modifying movement-related joint loading is integral to the management of lower extremity osteoarthritis (OA). Although traditional approaches rely on measurements made within the laboratory or clinical environments, inertial sensors provide an opportunity to quantify these outcomes in patients’ natural environments, providing greater ecological validity and opportunities to develop large data sets of movement data for the development of OA interventions. Objective This narrative review aimed to discuss and summarize recent developments in the use of inertial sensors for assessing movement during daily activities in individuals with hip and knee OA and to identify how this may translate to improved remote health care for this population. Methods A literature search was performed in November 2018 and repeated in July 2019 and March 2021 using the PubMed and Embase databases for publications on inertial sensors in hip and knee OA published in English within the previous 5 years. The search terms encompassed both OA and wearable sensors. Duplicate studies, systematic reviews, conference abstracts, and study protocols were also excluded. One reviewer screened the search result titles by removing irrelevant studies, and 2 reviewers screened study abstracts to identify studies using inertial sensors as the main sensing technology and a primary outcome related to movement quality. In addition, after the March 2021 search, 2 reviewers rescreened all previously included studies to confirm their relevance to this review. Results From the search process, 43 studies were determined to be relevant and subsequently included in this review. Inertial sensors have been successfully implemented for assessing the presence and severity of OA (n=11), assessing disease progression risk and providing feedback for gait retraining (n=7), and remotely monitoring intervention outcomes and identifying potential responders and nonresponders to interventions (n=14). In addition, studies have validated the use of inertial sensors for these applications (n=8) and analyzed the optimal sensor placement combinations and data input analysis for measuring different metrics of interest (n=3). These studies show promise for remote health care monitoring and intervention delivery in hip and knee OA, but many studies have focused on walking rather than a range of activities of daily living and have been performed in small samples (<100 participants) and in a laboratory rather than in a real-world environment. Conclusions Inertial sensors show promise for remote monitoring, risk assessment, and intervention delivery in individuals with hip and knee OA. Future opportunities remain to validate these sensors in real-world settings across a range of activities of daily living and to optimize sensor placement and data analysis approaches.
Collapse
Affiliation(s)
- Michael J Rose
- Department of Physical Therapy & Athletic Training, Boston University College of Health & Rehabilitation Sciences: Sargent College, Boston, MA, United States
| | - Kerry E Costello
- Department of Physical Therapy & Athletic Training, Boston University College of Health & Rehabilitation Sciences: Sargent College, Boston, MA, United States
- Division of Rheumatology, Department of Medicine, Boston University School of Medicine, Boston, MA, United States
| | - Samantha Eigenbrot
- Department of Physical Therapy & Athletic Training, Boston University College of Health & Rehabilitation Sciences: Sargent College, Boston, MA, United States
| | - Kaveh Torabian
- Department of Physical Therapy & Athletic Training, Boston University College of Health & Rehabilitation Sciences: Sargent College, Boston, MA, United States
| | - Deepak Kumar
- Department of Physical Therapy & Athletic Training, Boston University College of Health & Rehabilitation Sciences: Sargent College, Boston, MA, United States
- Division of Rheumatology, Department of Medicine, Boston University School of Medicine, Boston, MA, United States
| |
Collapse
|
17
|
Dynamic Joint Motions in Occupational Environments as Indicators of Potential Musculoskeletal Injury Risk. J Appl Biomech 2021; 37:196-203. [PMID: 33690164 DOI: 10.1123/jab.2020-0213] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2020] [Revised: 10/29/2020] [Accepted: 11/25/2020] [Indexed: 11/18/2022]
Abstract
The objective of this study was to test the feasibility of using a pair of wearable inertial measurement unit (IMU) sensors to accurately capture dynamic joint motion data during simulated occupational conditions. Eleven subjects (5 males and 6 females) performed repetitive neck, low-back, and shoulder motions simulating low- and high-difficulty occupational tasks in a laboratory setting. Kinematics for each of the 3 joints were measured via IMU sensors in addition to a "gold standard" passive marker optical motion capture system. The IMU accuracy was benchmarked relative to the optical motion capture system, and IMU sensitivity to low- and high-difficulty tasks was evaluated. The accuracy of the IMU sensors was found to be very good on average, but significant positional drift was observed in some trials. In addition, IMU measurements were shown to be sensitive to differences in task difficulty in all 3 joints (P < .05). These results demonstrate the feasibility for using wearable IMU sensors to capture kinematic exposures as potential indicators of occupational injury risk. Velocities and accelerations demonstrate the most potential for developing risk metrics since they are sensitive to task difficulty and less sensitive to drift than rotational position measurements.
Collapse
|
18
|
Kobsar D, Masood Z, Khan H, Khalil N, Kiwan MY, Ridd S, Tobis M. Wearable Inertial Sensors for Gait Analysis in Adults with Osteoarthritis-A Scoping Review. SENSORS 2020; 20:s20247143. [PMID: 33322187 PMCID: PMC7763184 DOI: 10.3390/s20247143] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/05/2020] [Revised: 12/01/2020] [Accepted: 12/09/2020] [Indexed: 12/13/2022]
Abstract
Our objective was to conduct a scoping review which summarizes the growing body of literature using wearable inertial sensors for gait analysis in lower limb osteoarthritis. We searched six databases using predetermined search terms which highlighted the broad areas of inertial sensors, gait, and osteoarthritis. Two authors independently conducted title and abstract reviews, followed by two authors independently completing full-text screenings. Study quality was also assessed by two independent raters and data were extracted by one reviewer in areas such as study design, osteoarthritis sample, protocols, and inertial sensor outcomes. A total of 72 articles were included, which studied the gait of 2159 adults with osteoarthritis (OA) using inertial sensors. The most common location of OA studied was the knee (n = 46), followed by the hip (n = 22), and the ankle (n = 7). The back (n = 41) and the shank (n = 40) were the most common placements for inertial sensors. The three most prevalent biomechanical outcomes studied were: mean spatiotemporal parameters (n = 45), segment or joint angles (n = 33), and linear acceleration magnitudes (n = 22). Our findings demonstrate exceptional growth in this field in the last 5 years. Nevertheless, there remains a need for more longitudinal study designs, patient-specific models, free-living assessments, and a push for "Code Reuse" to maximize the unique capabilities of these devices and ultimately improve how we diagnose and treat this debilitating disease.
Collapse
Affiliation(s)
- Dylan Kobsar
- Department of Kinesiology, Faculty of Science, McMaster University, Hamilton, ON L8S 4L8, Canada; (Z.M.); (H.K.); (N.K.); (M.Y.K.); (M.T.)
- Correspondence:
| | - Zaryan Masood
- Department of Kinesiology, Faculty of Science, McMaster University, Hamilton, ON L8S 4L8, Canada; (Z.M.); (H.K.); (N.K.); (M.Y.K.); (M.T.)
| | - Heba Khan
- Department of Kinesiology, Faculty of Science, McMaster University, Hamilton, ON L8S 4L8, Canada; (Z.M.); (H.K.); (N.K.); (M.Y.K.); (M.T.)
| | - Noha Khalil
- Department of Kinesiology, Faculty of Science, McMaster University, Hamilton, ON L8S 4L8, Canada; (Z.M.); (H.K.); (N.K.); (M.Y.K.); (M.T.)
| | - Marium Yossri Kiwan
- Department of Kinesiology, Faculty of Science, McMaster University, Hamilton, ON L8S 4L8, Canada; (Z.M.); (H.K.); (N.K.); (M.Y.K.); (M.T.)
| | - Sarah Ridd
- Department of Psychology, Neuroscience, and Behaviour, Faculty of Science, McMaster University, Hamilton, ON L8S 4L8, Canada;
| | - Matthew Tobis
- Department of Kinesiology, Faculty of Science, McMaster University, Hamilton, ON L8S 4L8, Canada; (Z.M.); (H.K.); (N.K.); (M.Y.K.); (M.T.)
| |
Collapse
|
19
|
Towards the Monitoring of Functional Status in a Free-Living Environment for People with Hip or Knee Osteoarthritis: Design and Evaluation of the JOLO Blended Care App. SENSORS 2020; 20:s20236967. [PMID: 33291517 PMCID: PMC7730884 DOI: 10.3390/s20236967] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/20/2020] [Revised: 11/20/2020] [Accepted: 12/02/2020] [Indexed: 12/12/2022]
Abstract
(1) Background: Joint loading is an important parameter in patients with osteoarthritis (OA). However, calculating joint loading relies on the performance of an extensive biomechanical analysis, which is not possible to do in a free-living situation. We propose the concept and design of a novel blended-care app called JOLO (Joint Load) that combines free-living information on activity with lab-based measures of joint loading in order to estimate a subject’s functional status. (2) Method: We used an iterative design process to evaluate the usability of the JOLO app through questionnaires. The user interfaces that resulted from the iterations are described and provide a concept for feedback on functional status. (3) Results: In total, 44 people (20 people with OA and 24 health-care providers) participated in the testing of the JOLO app. OA patients rated the latest version of the JOLO app as moderately useful. Therapists were predominantly positive; however, their intention to use JOLO was low due to technological issues. (4) Conclusion: We can conclude that JOLO is promising, but further technological improvements concerning activity recognition, the development of personalized joint loading predictions and a more comfortable means to carry the device are needed to facilitate its integration as a blended-care program.
Collapse
|
20
|
Giarmatzis G, Zacharaki EI, Moustakas K. Real-Time Prediction of Joint Forces by Motion Capture and Machine Learning. SENSORS (BASEL, SWITZERLAND) 2020; 20:E6933. [PMID: 33291594 PMCID: PMC7730598 DOI: 10.3390/s20236933] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/21/2020] [Revised: 11/27/2020] [Accepted: 12/02/2020] [Indexed: 02/06/2023]
Abstract
Conventional biomechanical modelling approaches involve the solution of large systems of equations that encode the complex mathematical representation of human motion and skeletal structure. To improve stability and computational speed, being a common bottleneck in current approaches, we apply machine learning to train surrogate models and to predict in near real-time, previously calculated medial and lateral knee contact forces (KCFs) of 54 young and elderly participants during treadmill walking in a speed range of 3 to 7 km/h. Predictions are obtained by fusing optical motion capture and musculoskeletal modeling-derived kinematic and force variables, into regression models using artificial neural networks (ANNs) and support vector regression (SVR). Training schemes included either data from all subjects (LeaveTrialsOut) or only from a portion of them (LeaveSubjectsOut), in combination with inclusion of ground reaction forces (GRFs) in the dataset or not. Results identify ANNs as the best-performing predictor of KCFs, both in terms of Pearson R (0.89-0.98 for LeaveTrialsOut and 0.45-0.85 for LeaveSubjectsOut) and percentage normalized root mean square error (0.67-2.35 for LeaveTrialsOut and 1.6-5.39 for LeaveSubjectsOut). When GRFs were omitted from the dataset, no substantial decrease in prediction power of both models was observed. Our findings showcase the strength of ANNs to predict simultaneously multi-component KCF during walking at different speeds-even in the absence of GRFs-particularly applicable in real-time applications that make use of knee loading conditions to guide and treat patients.
Collapse
Affiliation(s)
- Georgios Giarmatzis
- VVR Group, Department of Electrical and Computer Engineering, University of Patras, 26504 Patras, Greece; (E.I.Z.); (K.M.)
| | | | | |
Collapse
|
21
|
In Silico-Enhanced Treatment and Rehabilitation Planning for Patients with Musculoskeletal Disorders: Can Musculoskeletal Modelling and Dynamic Simulations Really Impact Current Clinical Practice? APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10207255] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Over the past decades, the use of computational physics-based models representative of the musculoskeletal (MSK) system has become increasingly popular in many fields of clinically driven research, locomotor rehabilitation in particular. These models have been applied to various functional impairments given their ability to estimate parameters which cannot be readily measured in vivo but are of interest to clinicians. The use of MSK modelling and simulations allows analysis of relevant MSK biomarkers such as muscle and joint contact loading at a number of different stages in the clinical treatment pathway in order to benefit patient functional outcome. Applications of these methods include optimisation of rehabilitation programs, patient stratification, disease characterisation, surgical pre-planning, and assistive device and exoskeleton design and optimisation. This review provides an overview of current approaches, the components of standard MSK models, applications, limitations, and assumptions of these modelling and simulation methods, and finally proposes a future direction.
Collapse
|
22
|
Validity of a New 3-D Motion Analysis Tool for the Assessment of Knee, Hip and Spine Joint Angles during the Single Leg Squat. SENSORS 2020; 20:s20164539. [PMID: 32823657 PMCID: PMC7472619 DOI: 10.3390/s20164539] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/08/2020] [Revised: 08/07/2020] [Accepted: 08/08/2020] [Indexed: 01/10/2023]
Abstract
Aim: Study concurrent validity of a new sensor-based 3D motion capture (MoCap) tool to register knee, hip and spine joint angles during the single leg squat. Design: Cross-sectional. Setting: University laboratory. Participants: Forty-four physically active (Tegner ≥ 5) subjects (age 22.8 (±3.3)) Main outcome measures: Sagittal and frontal plane trunk, hip and knee angles at peak knee flexion. The sensor-based system consisted of 4 active (triaxial accelerometric, gyroscopic and geomagnetic) sensors wirelessly connected with an iPad. A conventional passive tracking 3D MoCap (OptiTrack) system served as gold standard. Results: All sagittal plane measurement correlations observed were very strong for the knee and hip (r = 0.929–0.988, p < 0.001). For sagittal plane spine assessment, the correlations were moderate (r = 0.708–0.728, p < 0.001). Frontal plane measurement correlations were moderate in size for the hip (ρ = 0.646–0.818, p < 0.001) and spine (ρ = 0.613–0.827, p < 0.001). Conclusions: The 3-D MoCap tool has good to excellent criterion validity for sagittal and frontal plane angles occurring in the knee, hip and spine during the single leg squat. This allows bringing this type of easily accessible MoCap technology outside laboratory settings.
Collapse
|