1
|
Liu CP, Lu TY, Wang HC, Chang CY, Hsieh CY, Chan CT. Inertial Measurement Unit-Based Frozen Shoulder Identification from Daily Shoulder Tasks Using Machine Learning Approaches. SENSORS (BASEL, SWITZERLAND) 2024; 24:6656. [PMID: 39460136 PMCID: PMC11511118 DOI: 10.3390/s24206656] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/29/2024] [Revised: 09/23/2024] [Accepted: 10/01/2024] [Indexed: 10/28/2024]
Abstract
Frozen shoulder (FS) is a common shoulder condition accompanied by shoulder pain and a loss of shoulder range of motion (ROM). The typical clinical assessment tools such as questionnaires and ROM measurement are susceptible to subjectivity and individual bias. To provide an objective evaluation for clinical assessment, this study proposes an inertial measurement unit (IMU)-based identification system to automatically identify shoulder tasks whether performed by healthy subjects or FS patients. Two groups of features (time-domain statistical features and kinematic features), seven machine learning (ML) techniques, and two deep learning (DL) models are applied in the proposed identification system. For the experiments, 24 FS patients and 20 healthy subjects were recruited to perform five daily shoulder tasks with two IMUs attached to the arm and the wrist. The results demonstrate that the proposed system using deep learning presented the best identification performance using all features. The convolutional neural network achieved the best identification accuracy of 88.26%, and the multilayer perceptron obtained the best F1 score of 89.23%. Further analysis revealed that the identification performance based on wrist features had a higher accuracy compared to that based on arm features. The system's performance using time-domain statistical features has better discriminability in terms of identifying FS compared to using kinematic features. We demonstrate that the implementation of the IMU-based identification system using ML is feasible for FS assessment in clinical practice.
Collapse
Affiliation(s)
- Chien-Pin Liu
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei City 112, Taiwan; (C.-P.L.); (H.-C.W.)
| | - Ting-Yang Lu
- Research Center for Information Technology Innovation, Academia Sinica, Taipei City 114, Taiwan;
| | - Hsuan-Chih Wang
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei City 112, Taiwan; (C.-P.L.); (H.-C.W.)
| | - Chih-Ya Chang
- Department of Physical Medicine and Rehabilitation, Tri-Service General Hospital, Taipei City 114, Taiwan;
| | - Chia-Yeh Hsieh
- Bachelor’s Program in Medical Informatics and Innovative Applications, Fu Jen Catholic University, New Taipei City 242, Taiwan
| | - Chia-Tai Chan
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei City 112, Taiwan; (C.-P.L.); (H.-C.W.)
| |
Collapse
|
2
|
Darevsky DM, Hu DA, Gomez FA, Davies MR, Liu X, Feeley BT. Algorithmic assessment of shoulder function using smartphone video capture and machine learning. Sci Rep 2023; 13:19986. [PMID: 37968288 PMCID: PMC10652003 DOI: 10.1038/s41598-023-46966-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 11/07/2023] [Indexed: 11/17/2023] Open
Abstract
Tears within the stabilizing muscles of the shoulder, known as the rotator cuff (RC), are the most common cause of shoulder pain-often presenting in older patients and requiring expensive advanced imaging for diagnosis. Despite the high prevalence of RC tears within the elderly population, there is no previously published work examining shoulder kinematics using markerless motion capture in the context of shoulder injury. Here we show that a simple string pulling behavior task, where subjects pull a string using hand-over-hand motions, provides a reliable readout of shoulder mobility across animals and humans. We find that both mice and humans with RC tears exhibit decreased movement amplitude, prolonged movement time, and quantitative changes in waveform shape during string pulling task performance. In rodents, we further note the degradation of low dimensional, temporally coordinated movements after injury. Furthermore, a logistic regression model built on our biomarker ensemble succeeds in classifying human patients as having a RC tear with > 90% accuracy. Our results demonstrate how a combined framework bridging animal models, motion capture, convolutional neural networks, and algorithmic assessment of movement quality enables future research into the development of smartphone-based, at-home diagnostic tests for shoulder injury.
Collapse
Affiliation(s)
- David M Darevsky
- Bioengineering Graduate Program, University of California San Francisco, San Francisco, CA, USA
- Bioengineering Graduate Program, University of California Berkeley, Berkeley, CA, USA
- Medical Scientist Training Program, University of California San Francisco, San Francisco, CA, USA
- Department of Orthopaedic Surgery, University of California San Francisco, San Francisco, USA
- Department of Neurology, University of California San Francisco, San Francisco, CA, USA
- San Francisco Veterans Affairs Health Care System, San Francisco, USA
- Neurology and Rehabilitation Service, San Francisco Veterans Affairs Medical Center, San Francisco, CA, USA
| | - Daniel A Hu
- Department of Orthopaedic Surgery, University of California San Francisco, San Francisco, USA
- San Francisco Veterans Affairs Health Care System, San Francisco, USA
| | - Francisco A Gomez
- Department of Orthopaedic Surgery, University of California San Francisco, San Francisco, USA
- San Francisco Veterans Affairs Health Care System, San Francisco, USA
| | - Michael R Davies
- Department of Orthopaedic Surgery, University of California San Francisco, San Francisco, USA
- San Francisco Veterans Affairs Health Care System, San Francisco, USA
| | - Xuhui Liu
- Department of Orthopaedic Surgery, University of California San Francisco, San Francisco, USA
- San Francisco Veterans Affairs Health Care System, San Francisco, USA
| | - Brian T Feeley
- Department of Orthopaedic Surgery, University of California San Francisco, San Francisco, USA.
- San Francisco Veterans Affairs Health Care System, San Francisco, USA.
| |
Collapse
|
3
|
Chou LW, Chang CY, Wu YT, Lin CY, Liu TJ, Ho TY, Shen YP, Liu KC, Lu TY. Inertial measurement unit-based functional evaluation for adhesive capsulitis assessment. JOURNAL OF MEDICAL SCIENCES 2022. [DOI: 10.4103/jmedsci.jmedsci_89_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
|
4
|
Beshara P, Anderson DB, Pelletier M, Walsh WR. The Reliability of the Microsoft Kinect and Ambulatory Sensor-Based Motion Tracking Devices to Measure Shoulder Range-of-Motion: A Systematic Review and Meta-Analysis. SENSORS (BASEL, SWITZERLAND) 2021; 21:8186. [PMID: 34960280 PMCID: PMC8705315 DOI: 10.3390/s21248186] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/07/2021] [Revised: 11/26/2021] [Accepted: 11/30/2021] [Indexed: 01/23/2023]
Abstract
Advancements in motion sensing technology can potentially allow clinicians to make more accurate range-of-motion (ROM) measurements and informed decisions regarding patient management. The aim of this study was to systematically review and appraise the literature on the reliability of the Kinect, inertial sensors, smartphone applications and digital inclinometers/goniometers to measure shoulder ROM. Eleven databases were screened (MEDLINE, EMBASE, EMCARE, CINAHL, SPORTSDiscus, Compendex, IEEE Xplore, Web of Science, Proquest Science and Technology, Scopus, and PubMed). The methodological quality of the studies was assessed using the consensus-based standards for the selection of health Measurement Instruments (COSMIN) checklist. Reliability assessment used intra-class correlation coefficients (ICCs) and the criteria from Swinkels et al. (2005). Thirty-two studies were included. A total of 24 studies scored "adequate" and 2 scored "very good" for the reliability standards. Only one study scored "very good" and just over half of the studies (18/32) scored "adequate" for the measurement error standards. Good intra-rater reliability (ICC > 0.85) and inter-rater reliability (ICC > 0.80) was demonstrated with the Kinect, smartphone applications and digital inclinometers. Overall, the Kinect and ambulatory sensor-based human motion tracking devices demonstrate moderate-good levels of intra- and inter-rater reliability to measure shoulder ROM. Future reliability studies should focus on improving study design with larger sample sizes and recommended time intervals between repeated measurements.
Collapse
Affiliation(s)
- Peter Beshara
- Department of Physiotherapy, Prince of Wales Hospital, Sydney, NSW 2031, Australia
- Prince of Wales Clinical School, Faculty of Medicine, University of New South Wales, Sydney, NSW 2031, Australia; (M.P.); (W.R.W.)
- Surgical & Orthopaedic Research Laboratories, Prince of Wales Hospital, Sydney, NSW 2031, Australia
| | - David B. Anderson
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW 2006, Australia;
| | - Matthew Pelletier
- Prince of Wales Clinical School, Faculty of Medicine, University of New South Wales, Sydney, NSW 2031, Australia; (M.P.); (W.R.W.)
- Surgical & Orthopaedic Research Laboratories, Prince of Wales Hospital, Sydney, NSW 2031, Australia
| | - William R. Walsh
- Prince of Wales Clinical School, Faculty of Medicine, University of New South Wales, Sydney, NSW 2031, Australia; (M.P.); (W.R.W.)
- Surgical & Orthopaedic Research Laboratories, Prince of Wales Hospital, Sydney, NSW 2031, Australia
| |
Collapse
|
5
|
Automatic Functional Shoulder Task Identification and Sub-task Segmentation Using Wearable Inertial Measurement Units for Frozen Shoulder Assessment. SENSORS 2020; 21:s21010106. [PMID: 33375341 PMCID: PMC7795360 DOI: 10.3390/s21010106] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/03/2020] [Revised: 12/22/2020] [Accepted: 12/22/2020] [Indexed: 11/26/2022]
Abstract
Advanced sensor technologies have been applied to support frozen shoulder assessment. Sensor-based assessment tools provide objective, continuous and quantitative information for evaluation and diagnosis. However, the current tools for assessment of functional shoulder tasks mainly rely on manual operation. It may cause several technical issues to the reliability and usability of the assessment tool, including manual bias during the recording and additional efforts for data labeling. To tackle these issues, this pilot study aims to propose an automatic functional shoulder task identification and sub-task segmentation system using inertial measurement units to provide reliable shoulder task labeling and sub-task information for clinical professionals. The proposed method combines machine learning models and rule-based modification to identify shoulder tasks and segment sub-tasks accurately. A hierarchical design is applied to enhance the efficiency and performance of the proposed approach. Nine healthy subjects and nine frozen shoulder patients are invited to perform five common shoulder tasks in the lab-based and clinical environments, respectively. The experimental results show that the proposed method can achieve 87.11% F-score for shoulder task identification, and 83.23% F-score and 427 mean absolute time errors (milliseconds) for sub-task segmentation. The proposed approach demonstrates the feasibility of the proposed method to support reliable evaluation for clinical assessment.
Collapse
|
6
|
Roldán-Jiménez C, Martin-Martin J, Cuesta-Vargas AI. Reliability of a Smartphone Compared With an Inertial Sensor to Measure Shoulder Mobility: Cross-Sectional Study. JMIR Mhealth Uhealth 2019; 7:e13640. [PMID: 31493320 PMCID: PMC6754695 DOI: 10.2196/13640] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2019] [Revised: 05/09/2019] [Accepted: 06/29/2019] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND The shoulder is one of the joints with the greatest mobility within the human body and its evaluation is complex. An assessment can be conducted using questionnaires or functional tests, and goniometry can complement the information obtained in this assessment. However, there are now validated devices that can provide more information on the realization of movement, such as inertial sensors. The cost of these devices is usually high and they are not available to all clinicians, but there are also inertial sensors that are implemented in mobile phones which are cheaper and widely available. Results from the inertial sensors integrated into mobile devices can have the same reliability as those from dedicated sensors. OBJECTIVE This study aimed to validate the use of the Nexus 4 smartphone as a measuring tool for the mobility of the humerus during shoulder movement compared with a dedicated InertiaCube3 (Intersense) sensor. METHODS A total of 43 subjects, 27 affected by shoulder pathologies and 16 asymptomatic, participated in the study. Shoulder flexion, abduction, and scaption were measured using an InertiaCube3 and a Nexus 4 smartphone, which were attached to the participants to record the results simultaneously. The interclass correlation coefficient (ICC) was calculated based on the 3 movements performed. RESULTS The smartphone reliably recorded the velocity values and simultaneously recorded them alongside the inertial sensor. The ICCs of the 3 gestures and for each of the axes of movement were analyzed with a 95% CI. In the abduction movement, the devices demonstrated excellent interclass reliability for the abduction humeral movement axis (Cronbach alpha=.98). The axis of abduction of the humeral showed excellent reliability for the movements of flexion (Cronbach alpha=.93) and scaption (Cronbach alpha=.98). CONCLUSIONS Compared with the InertiaCube3, the Nexus 4 smartphone is a reliable and valid tool for recording the velocity produced in the shoulder.
Collapse
Affiliation(s)
- Cristina Roldán-Jiménez
- Clinimetric Group F-14 Biomedical Research Institute of Malaga, Malaga, Spain.,Department of Physiotherapy, Faculty of Health Sciences, University of Malaga, Malaga, Spain
| | - Jaime Martin-Martin
- Clinimetric Group F-14 Biomedical Research Institute of Malaga, Malaga, Spain.,Legal Medicine Area, Department of Human Anatomy, Legal Medicine and History of Science, Faculty of Medicine, University of Malaga, Malaga, Spain
| | - Antonio I Cuesta-Vargas
- Clinimetric Group F-14 Biomedical Research Institute of Malaga, Malaga, Spain.,Department of Physiotherapy, Faculty of Health Sciences, University of Malaga, Malaga, Spain.,Institute of Health & Biomedical Innovation, Faculty of Health, Queensland University Technology, Queensland, Australia
| |
Collapse
|
7
|
Effect of smartphone application-supported self-rehabilitation for frozen shoulder: a prospective randomized control study. Clin Rehabil 2018; 33:653-660. [DOI: 10.1177/0269215518818866] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Objectives: To evaluate the clinical efficacy of smartphone-assisted self-rehabilitation in patients with frozen shoulder. Design: A single-center, randomized controlled trial. Setting: Orthopedic department of a university hospital. Subjects: A total of 84 patients with frozen shoulder were recruited. Intervention: Patients were randomly divided into two groups: a smartphone-assisted exercise group ( n = 42) and a conventional self-exercise group ( n = 42). The study was performed over three months, during which each group performed home-based rehabilitation. Main measures: Visual analogue scale for pain and passive shoulder range of motion were assessed at baseline and after 4, 8, and 12 weeks of treatment. Technology Acceptance Model–2 and Usefulness, Satisfaction, and Ease of Use scores were evaluated in the smartphone group. Results: Initial visual analogue scale for pain of the smartphone group was 6.0 ± 2.2 and ended up with 1.8 ± 2.5 after 12 weeks, whereas the self-exercise group showed 5.8 ± 2.3 for the baseline visual analogue scale for pain and 2.2 ± 1.7 at the end. Significant time-dependent improvements in all measured values were observed in both groups (all Ps < 0.001), but no significant intergroup difference was observed after 4, 8, or 12 weeks of treatment. In the smartphone group, Technology Acceptance Model–2 and Usefulness, Satisfaction, and Ease of Use scores showed high patient satisfaction with smartphone-assisted exercise. Conclusion: There was no difference between home-based exercise using a smartphone application and a conventional self-exercise program for the treatment of frozen shoulder in terms of visual analogue scale for pain and range of motions.
Collapse
|