1
|
Dotti G, Caruso M, Fortunato D, Knaflitz M, Cereatti A, Ghislieri M. A Statistical Approach for Functional Reach-to-Grasp Segmentation Using a Single Inertial Measurement Unit. SENSORS (BASEL, SWITZERLAND) 2024; 24:6119. [PMID: 39338864 PMCID: PMC11435557 DOI: 10.3390/s24186119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/10/2024] [Revised: 09/12/2024] [Accepted: 09/20/2024] [Indexed: 09/30/2024]
Abstract
The aim of this contribution is to present a segmentation method for the identification of voluntary movements from inertial data acquired through a single inertial measurement unit placed on the subject's wrist. Inertial data were recorded from 25 healthy subjects while performing 75 consecutive reach-to-grasp movements. The approach herein presented, called DynAMoS, is based on an adaptive thresholding step on the angular velocity norm, followed by a statistics-based post-processing on the movement duration distribution. Post-processing aims at reducing the number of erroneous transitions in the movement segmentation. We assessed the segmentation quality of this method using a stereophotogrammetric system as the gold standard. Two popular methods already presented in the literature were compared to DynAMoS in terms of the number of movements identified, onset and offset mean absolute errors, and movement duration. Moreover, we analyzed the sub-phase durations of the drinking movement to further characterize the task. The results show that the proposed method performs significantly better than the two state-of-the-art approaches (i.e., percentage of erroneous movements = 3%; onset and offset mean absolute error < 0.08 s), suggesting that DynAMoS could make more effective home monitoring applications for assessing the motion improvements of patients following domicile rehabilitation protocols.
Collapse
Affiliation(s)
- Gregorio Dotti
- PolitoBIOMed Lab, Department of Electronics and Telecommunications, Politecnico di Torino, 10129 Turin, Italy
| | - Marco Caruso
- PolitoBIOMed Lab, Department of Electronics and Telecommunications, Politecnico di Torino, 10129 Turin, Italy
| | - Daniele Fortunato
- PolitoBIOMed Lab, Department of Electronics and Telecommunications, Politecnico di Torino, 10129 Turin, Italy
| | - Marco Knaflitz
- PolitoBIOMed Lab, Department of Electronics and Telecommunications, Politecnico di Torino, 10129 Turin, Italy
| | - Andrea Cereatti
- PolitoBIOMed Lab, Department of Electronics and Telecommunications, Politecnico di Torino, 10129 Turin, Italy
| | - Marco Ghislieri
- PolitoBIOMed Lab, Department of Electronics and Telecommunications, Politecnico di Torino, 10129 Turin, Italy
| |
Collapse
|
2
|
Provenzale C, Di Tommaso F, Di Stefano N, Formica D, Taffoni F. Real-Time Visual Feedback Based on MIMUs Technology Reduces Bowing Errors in Beginner Violin Students. SENSORS (BASEL, SWITZERLAND) 2024; 24:3961. [PMID: 38931745 PMCID: PMC11207394 DOI: 10.3390/s24123961] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/18/2024] [Revised: 06/15/2024] [Accepted: 06/17/2024] [Indexed: 06/28/2024]
Abstract
Violin is one of the most complex musical instruments to learn. The learning process requires constant training and many hours of exercise and is primarily based on a student-teacher interaction where the latter guides the beginner through verbal instructions, visual demonstrations, and physical guidance. The teacher's instruction and practice allow the student to learn gradually how to perform the correct gesture autonomously. Unfortunately, these traditional teaching methods require the constant supervision of a teacher and the interpretation of non-real-time feedback provided after the performance. To address these limitations, this work presents a novel interface (Visual Interface for Bowing Evaluation-VIBE) to facilitate student's progression throughout the learning process, even in the absence of direct teacher intervention. The proposed interface allows two key parameters of bowing movements to be monitored, namely, the angle between the bow and the string (i.e., α angle) and the bow tilt (i.e., β angle), providing real-time visual feedback on how to correctly move the bow. Results collected on 24 beginners (12 exposed to visual feedback, 12 in a control group) showed a positive effect of the real-time visual feedback on the improvement of bow control. Moreover, the subjects exposed to visual feedback judged the latter as useful to correct their movement and clear in terms of the presentation of data. Although the task was rated as harder when performed with the additional feedback, the subjects did not perceive the presence of a violin teacher as essential to interpret the feedback.
Collapse
Affiliation(s)
- Cecilia Provenzale
- Advanced Robotics and Human-Centred Technologies–CREO Lab, Università Campus Bio-Medico di Roma, 00128 Rome, Italy; (C.P.); (F.D.T.); (F.T.)
- Department of Electrical and Information Engineering, University of Cassino and Southern Lazio, 03043 Cassino, Italy
| | - Francesco Di Tommaso
- Advanced Robotics and Human-Centred Technologies–CREO Lab, Università Campus Bio-Medico di Roma, 00128 Rome, Italy; (C.P.); (F.D.T.); (F.T.)
| | - Nicola Di Stefano
- Institute of Cognitive Sciences and Technologies (ISTC), National Research Council of Italy (CNR), 00196 Rome, Italy;
| | - Domenico Formica
- Neurorobotics Lab, School of Engineering, Newcastle University, Newcastle Upon Tyne NE1 7RU, UK
| | - Fabrizio Taffoni
- Advanced Robotics and Human-Centred Technologies–CREO Lab, Università Campus Bio-Medico di Roma, 00128 Rome, Italy; (C.P.); (F.D.T.); (F.T.)
| |
Collapse
|
3
|
Dellai J, Gilles MA, Remy O, Claudon L, Dietrich G. Development and Evaluation of a Hybrid Measurement System to Determine the Kinematics of the Wrist. SENSORS (BASEL, SWITZERLAND) 2024; 24:2543. [PMID: 38676160 PMCID: PMC11053611 DOI: 10.3390/s24082543] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/27/2024] [Revised: 04/13/2024] [Accepted: 04/14/2024] [Indexed: 04/28/2024]
Abstract
Optical Motion Capture Systems (OMCSs) are considered the gold standard for kinematic measurement of human movements. However, in situations such as measuring wrist kinematics during a hairdressing activity, markers can be obscured, resulting in a loss of data. Other measurement methods based on non-optical data can be considered, such as magneto-inertial measurement units (MIMUs). Their accuracy is generally lower than that of an OMCS. In this context, it may be worth considering a hybrid system [MIMU + OMCS] to take advantage of OMCS accuracy while limiting occultation problems. The aim of this work was (1) to propose a methodology for coupling a low-cost MIMU (BNO055) to an OMCS in order to evaluate wrist kinematics, and then (2) to evaluate the accuracy of this hybrid system [MIMU + OMCS] during a simple hairdressing gesture. During hair cutting gestures, the root mean square error compared with the OMCS was 4.53° (1.45°) for flexion/extension, 5.07° (1.30°) for adduction/abduction, and 3.65° (1.19°) for pronation/supination. During combing gestures, they were significantly higher, but remained below 10°. In conclusion, this system allows for maintaining wrist kinematics in case of the loss of hand markers while preserving an acceptable level of precision (<10°) for ergonomic measurement or entertainment purposes.
Collapse
Affiliation(s)
- Jason Dellai
- Institut National de Recherche et de Sécurité (INRS), 54519 Vandoeuvre-lès-Nancy, France; (M.A.G.); (O.R.); (L.C.)
- Institut des Sciences du Sport Santé de Paris (URP 3625), Université Paris Cité, 75015 Paris, France;
| | - Martine A. Gilles
- Institut National de Recherche et de Sécurité (INRS), 54519 Vandoeuvre-lès-Nancy, France; (M.A.G.); (O.R.); (L.C.)
| | - Olivier Remy
- Institut National de Recherche et de Sécurité (INRS), 54519 Vandoeuvre-lès-Nancy, France; (M.A.G.); (O.R.); (L.C.)
| | - Laurent Claudon
- Institut National de Recherche et de Sécurité (INRS), 54519 Vandoeuvre-lès-Nancy, France; (M.A.G.); (O.R.); (L.C.)
| | - Gilles Dietrich
- Institut des Sciences du Sport Santé de Paris (URP 3625), Université Paris Cité, 75015 Paris, France;
| |
Collapse
|
4
|
Beange KHE, Chan ADC, Graham RB. Investigating concurrent validity of inertial sensors to evaluate multiplanar spine movement. J Biomech 2024; 164:111939. [PMID: 38310004 DOI: 10.1016/j.jbiomech.2024.111939] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Revised: 12/13/2023] [Accepted: 01/04/2024] [Indexed: 02/05/2024]
Abstract
Inertial measurement units (IMUs) offer a portable and inexpensive alternative to traditional optical motion capture systems, and have potential to support clinical diagnosis and treatment of low back pain; however, due to a lack of confidence regarding the validity of IMU-derived metrics, their uptake and acceptance remain a challenge. The objective of this work was to assess the concurrent validity of the Xsens DOT IMUs for tracking multiplanar spine movement, and to evaluate concurrent validity and reliability for estimating clinically relevant metrics relative to gold-standard optical motion capture equipment. Ten healthy controls performed spine range of motion (ROM) tasks, while data were simultaneously tracked from IMUs and optical marker clusters placed over the C7, T12, and S1 vertebrae. Root mean square error (RMSE), mean absolute error (MAE), and intraclass correlation coefficients (ICC2,1) were calculated to assess validity and reliability of absolute (abs; C7, T12, and S1 sensors) and relative joint (rel; intersegmental thoracic, lumbar, and total) motion. Overall RMSEabs = 1.33°, MAEabs = 0.74° ± 0.69, and ICC2,1,abs = 0.953 across all movements, sensors, and planes. Results were slightly better for uniplanar movements when evaluating the primary rotation axis (prim) absolute ROM (MAEabs,prim = 0.56° ± 0.49; ICC2,1,abs,prim = 0.999). Similarly, when evaluating relative intersegmental motion, overall RMSErel = 2.39°, MAErel = 1.10° ± 0.96, and ICC2,1,rel = 0.950, and relative primary rotation axis achieved MAErel,prim = 0.87° ± 0.77, and ICC2,1,rel,prim = 0.994. Findings from this study suggest that these IMUs can be considered valid for tracking multiplanar spine movement, and may be used to objectively assess spine movement and neuromuscular control in clinics.
Collapse
Affiliation(s)
- Kristen H E Beange
- Department of Systems and Computer Engineering, Faculty of Engineering and Design, Carleton University, 1125 Colonel By Drive, Ottawa, Ontario K1S 5B6, Canada; Ottawa-Carleton Institute for Biomedical Engineering, Ottawa, Ontario, Canada
| | - Adrian D C Chan
- Department of Systems and Computer Engineering, Faculty of Engineering and Design, Carleton University, 1125 Colonel By Drive, Ottawa, Ontario K1S 5B6, Canada; School of Human Kinetics, Faculty of Health Sciences, University of Ottawa, 200 Lees Avenue, Ottawa, Ontario K1N 6N5, Canada; Ottawa-Carleton Institute for Biomedical Engineering, Ottawa, Ontario, Canada
| | - Ryan B Graham
- School of Human Kinetics, Faculty of Health Sciences, University of Ottawa, 200 Lees Avenue, Ottawa, Ontario K1N 6N5, Canada; Ottawa-Carleton Institute for Biomedical Engineering, Ottawa, Ontario, Canada.
| |
Collapse
|
5
|
Küderle A, Ullrich M, Roth N, Ollenschläger M, Ibrahim AA, Moradi H, Richer R, Seifer AK, Zürl M, Sîmpetru RC, Herzer L, Prossel D, Kluge F, Eskofier BM. Gaitmap-An Open Ecosystem for IMU-Based Human Gait Analysis and Algorithm Benchmarking. IEEE OPEN JOURNAL OF ENGINEERING IN MEDICINE AND BIOLOGY 2024; 5:163-172. [PMID: 38487091 PMCID: PMC10939318 DOI: 10.1109/ojemb.2024.3356791] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2023] [Revised: 11/15/2023] [Accepted: 01/17/2024] [Indexed: 03/17/2024] Open
Abstract
Goal: Gait analysis using inertial measurement units (IMUs) has emerged as a promising method for monitoring movement disorders. However, the lack of public data and easy-to-use open-source algorithms hinders method comparison and clinical application development. To address these challenges, this publication introduces the gaitmap ecosystem, a comprehensive set of open source Python packages for gait analysis using foot-worn IMUs. Methods: This initial release includes over 20 state-of-the-art algorithms, enables easy access to seven datasets, and provides eight benchmark challenges with reference implementations. Together with its extensive documentation and tooling, it enables rapid development and validation of new algorithm and provides a foundation for novel clinical applications. Conclusion: The published software projects represent a pioneering effort to establish an open-source ecosystem for IMU-based gait analysis. We believe that this work can democratize the access to high-quality algorithm and serve as a driver for open and reproducible research in the field of human gait analysis and beyond.
Collapse
Affiliation(s)
- Arne Küderle
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Martin Ullrich
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Nils Roth
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Malte Ollenschläger
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Alzhraa A. Ibrahim
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
- Department of Molecular NeurologyFAU Erlangen91054ErlangenGermany
- Computer Science Department, Faculty of Computers and InformationAssiut UniversityAssiut Governorate71515Egypt
| | - Hamid Moradi
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Robert Richer
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Ann-Kristin Seifer
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Matthias Zürl
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Raul C. Sîmpetru
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Liv Herzer
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Dominik Prossel
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Felix Kluge
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Bjoern M. Eskofier
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| |
Collapse
|
6
|
Chebel E, Tunc B. The effect of model complexity on the human center of mass estimation using the statically equivalent serial chain technique. Sci Rep 2023; 13:20308. [PMID: 37985690 PMCID: PMC10662471 DOI: 10.1038/s41598-023-47337-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2023] [Accepted: 11/12/2023] [Indexed: 11/22/2023] Open
Abstract
Estimating the human center of mass (CoM) has long been recognized as a highly complex process. A relatively recent and noteworthy technique for CoM estimation that has gained popularity is the statically equivalent serial chain (SESC). This technique employs a remodeling of the human skeleton as a serial chain where the end effector represents the CoM location. In this study, we aimed to evaluate the impact of model complexity on the estimation capability of the SESC technique. To achieve this, we designed and rigorously assessed four distinct models with varying complexities against the static center of pressure (CoP) as reference, by quantifying both the root-mean-square (RMS) and correlation metrics. In addition, the Bland-Altman analysis was utilized to quantify the agreement between the estimations and reference values. The findings revealed that increasing the model complexity significantly improved CoM estimation quality up to a specific threshold. The maximum observed RMS difference among the models reached 9.85 mm. However, the application and task context should be considered, as less complex models still provided satisfactory estimation performance. In conclusion, the evaluation of model complexity demonstrated its impact on CoM estimation using the SESC technique, providing insights into the trade-off between accuracy and complexity in practical applications.
Collapse
Affiliation(s)
- Elie Chebel
- Department of Computer Engineering, Bahcesehir University, Istanbul, 34353, Turkey.
| | - Burcu Tunc
- Department of Biomedical Engineering, Bahcesehir University, Istanbul, 34353, Turkey
| |
Collapse
|
7
|
Mouras H, Vonesch A, Lebel K, Léonard G, Lelard T. Posturography Approaches: An Insightful Window to Explore the Role of the Brain in Socio-Affective Processes. Brain Sci 2023; 13:1585. [PMID: 38002545 PMCID: PMC10669518 DOI: 10.3390/brainsci13111585] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2023] [Revised: 11/06/2023] [Accepted: 11/09/2023] [Indexed: 11/26/2023] Open
Abstract
A significant amount of research has highlighted the importance of a motor component in the brain's processing of emotional, motivational and social information. Posturography has emerged as an interesting way to assess motor correlates associated with this process. In this review, we highlight recent results within the functional context of painful stimulus perception and discuss the interest in broadening the use of posturography to other motivational and societal functional contexts. Although characterized by significant feasibility, the single measurement of the COP's anteroposterior displacement presents limitations for attesting approach-avoidance behavior towards a visual target. Here, we discuss a number of methodological avenues that could go some way towards overcoming these limitations.
Collapse
Affiliation(s)
- Harold Mouras
- UR-UPJV 4559 LNFP Functional and Pathological Neurosciences Laboratory, Picardy Jules Verne University, 80054 Amiens, France;
| | - Alexandre Vonesch
- UR-UPJV 4559 LNFP Functional and Pathological Neurosciences Laboratory, Picardy Jules Verne University, 80054 Amiens, France;
| | - Karina Lebel
- Research Centre on Aging, CIUSSS de l’Estrie—CHUS, Sherbrooke, QC J1H 4C4, Canada; (K.L.); (G.L.)
| | - Guillaume Léonard
- Research Centre on Aging, CIUSSS de l’Estrie—CHUS, Sherbrooke, QC J1H 4C4, Canada; (K.L.); (G.L.)
- School of Rehabilitation, Faculty of Medicine and Health Sciences, Sherbrooke University, Sherbrooke, QC J1H 5N4, Canada
| | - Thierry Lelard
- UR-UPJV 3300 APERE Physiological Adaptation to Exercise and Exercise Rehabilitation, Picardy Jules Verne University, 80054 Amiens, France;
| |
Collapse
|
8
|
El Fezazi M, Achmamad A, Jbari A, Jilbab A. A convenient approach for knee kinematics assessment using wearable inertial sensors during home-based rehabilitation: Validation with an optoelectronic system. SCIENTIFIC AFRICAN 2023; 20:e01676. [PMID: 37122479 PMCID: PMC10122771 DOI: 10.1016/j.sciaf.2023.e01676] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2022] [Revised: 02/23/2023] [Accepted: 04/22/2023] [Indexed: 05/02/2023] Open
Abstract
Rehabilitation services are among the most severely impacted by the COVID-19 pandemic. This has increased the number of people not receiving the needed rehabilitation care. Home-based rehabilitation becomes alternative support to face this greater need. However, monitoring kinematics parameters during rehabilitation exercises is critical for an effective recovery. This work proposes a detailed framework to estimate knee kinematics using a wearable Magnetic and Inertial Measurement Unit (MIMU). That allows at-home monitoring for knee rehabilitation progress. Two MIMU sensors were attached to the shank and thigh segments respectively. First, the absolute orientation of each sensor was estimated using a sensor fusion algorithm. Second, these sensor orientations were transformed to segments orientations using a functional sensor-to-segment (STS) alignment. Third, the relative orientation between segments, i.e., knee joint angle, was computed and the relevant kinematics parameters were extracted. Then, the validity of our approach was evaluated with a gold-standard optoelectronic system. Seven participants completed three to five Timed-Up-and-Go (TUG) tests. The estimated knee angle was compared to the reference angle. Root-mean-square error (RMSE), correlation coefficient, and Bland-Altman analysis were considered as evaluation metrics. Our results showed reasonable accuracy (RMSE < 8°), strong to very-strong correlation (correlation coefficient > 0.86), a mean difference within 1.1°, and agreement limits from -16° to 14°. In addition, no significant difference was found (p-value > 0.05) in extracted kinematics parameters between both systems. The proposed approach might represent a suitable alternative for the assessment of knee rehabilitation progress in a home context.
Collapse
Affiliation(s)
- Mohamed El Fezazi
- Electronic Systems Sensors and Nano-Biotechnologies, National Graduate School of Arts and Crafts (ENSAM), Mohammed V University in Rabat, Morocco
| | - Abdelouahad Achmamad
- Electronic Systems Sensors and Nano-Biotechnologies, National Graduate School of Arts and Crafts (ENSAM), Mohammed V University in Rabat, Morocco
| | - Atman Jbari
- Electronic Systems Sensors and Nano-Biotechnologies, National Graduate School of Arts and Crafts (ENSAM), Mohammed V University in Rabat, Morocco
| | - Abdelilah Jilbab
- Electronic Systems Sensors and Nano-Biotechnologies, National Graduate School of Arts and Crafts (ENSAM), Mohammed V University in Rabat, Morocco
| |
Collapse
|
9
|
Mohamed SA, Martinez-Hernandez U. A Light-Weight Artificial Neural Network for Recognition of Activities of Daily Living. SENSORS (BASEL, SWITZERLAND) 2023; 23:5854. [PMID: 37447703 DOI: 10.3390/s23135854] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Revised: 06/20/2023] [Accepted: 06/21/2023] [Indexed: 07/15/2023]
Abstract
Human activity recognition (HAR) is essential for the development of robots to assist humans in daily activities. HAR is required to be accurate, fast and suitable for low-cost wearable devices to ensure portable and safe assistance. Current computational methods can achieve accurate recognition results but tend to be computationally expensive, making them unsuitable for the development of wearable robots in terms of speed and processing power. This paper proposes a light-weight architecture for recognition of activities using five inertial measurement units and four goniometers attached to the lower limb. First, a systematic extraction of time-domain features from wearable sensor data is performed. Second, a small high-speed artificial neural network and line search method for cost function optimization are used for activity recognition. The proposed method is systematically validated using a large dataset composed of wearable sensor data from seven activities (sitting, standing, walking, stair ascent/descent, ramp ascent/descent) associated with eight healthy subjects. The accuracy and speed results are compared against methods commonly used for activity recognition including deep neural networks, convolutional neural networks, long short-term memory and convolutional-long short-term memory hybrid networks. The experiments demonstrate that the light-weight architecture can achieve a high recognition accuracy of 98.60%, 93.10% and 84.77% for seen data from seen subjects, unseen data from seen subjects and unseen data from unseen subjects, respectively, and an inference time of 85 μs. The results show that the proposed approach can perform accurate and fast activity recognition with a reduced computational complexity suitable for the development of portable assistive devices.
Collapse
Affiliation(s)
- Samer A Mohamed
- Department of Electronic and Electrical Engineering, Faculty of Engineering and Design, University of Bath, Bath BA2 7AY, UK
- Mechatronics Engineering Department, Faculty of Engineering, Ain Shams University, Cairo 11566, Egypt
- Multimodal Inte-R-Action Lab, University of Bath, Bath BA2 7AY, UK
| | - Uriel Martinez-Hernandez
- Department of Electronic and Electrical Engineering, Faculty of Engineering and Design, University of Bath, Bath BA2 7AY, UK
- Multimodal Inte-R-Action Lab, University of Bath, Bath BA2 7AY, UK
| |
Collapse
|
10
|
Salis F, Bertuletti S, Bonci T, Caruso M, Scott K, Alcock L, Buckley E, Gazit E, Hansen C, Schwickert L, Aminian K, Becker C, Brown P, Carsin AE, Caulfield B, Chiari L, D’Ascanio I, Del Din S, Eskofier BM, Garcia-Aymerich J, Hausdorff JM, Hume EC, Kirk C, Kluge F, Koch S, Kuederle A, Maetzler W, Micó-Amigo EM, Mueller A, Neatrour I, Paraschiv-Ionescu A, Palmerini L, Yarnall AJ, Rochester L, Sharrack B, Singleton D, Vereijken B, Vogiatzis I, Della Croce U, Mazzà C, Cereatti A, for the Mobilise-D consortium. A multi-sensor wearable system for the assessment of diseased gait in real-world conditions. Front Bioeng Biotechnol 2023; 11:1143248. [PMID: 37214281 PMCID: PMC10194657 DOI: 10.3389/fbioe.2023.1143248] [Citation(s) in RCA: 13] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Accepted: 03/30/2023] [Indexed: 05/24/2023] Open
Abstract
Introduction: Accurately assessing people's gait, especially in real-world conditions and in case of impaired mobility, is still a challenge due to intrinsic and extrinsic factors resulting in gait complexity. To improve the estimation of gait-related digital mobility outcomes (DMOs) in real-world scenarios, this study presents a wearable multi-sensor system (INDIP), integrating complementary sensing approaches (two plantar pressure insoles, three inertial units and two distance sensors). Methods: The INDIP technical validity was assessed against stereophotogrammetry during a laboratory experimental protocol comprising structured tests (including continuous curvilinear and rectilinear walking and steps) and a simulation of daily-life activities (including intermittent gait and short walking bouts). To evaluate its performance on various gait patterns, data were collected on 128 participants from seven cohorts: healthy young and older adults, patients with Parkinson's disease, multiple sclerosis, chronic obstructive pulmonary disease, congestive heart failure, and proximal femur fracture. Moreover, INDIP usability was evaluated by recording 2.5-h of real-world unsupervised activity. Results and discussion: Excellent absolute agreement (ICC >0.95) and very limited mean absolute errors were observed for all cohorts and digital mobility outcomes (cadence ≤0.61 steps/min, stride length ≤0.02 m, walking speed ≤0.02 m/s) in the structured tests. Larger, but limited, errors were observed during the daily-life simulation (cadence 2.72-4.87 steps/min, stride length 0.04-0.06 m, walking speed 0.03-0.05 m/s). Neither major technical nor usability issues were declared during the 2.5-h acquisitions. Therefore, the INDIP system can be considered a valid and feasible solution to collect reference data for analyzing gait in real-world conditions.
Collapse
Affiliation(s)
- Francesca Salis
- Department of Biomedical Sciences, University of Sassari, Sassari, Italy
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System (IuC BoHNes), Sassari, Italy
| | - Stefano Bertuletti
- Department of Biomedical Sciences, University of Sassari, Sassari, Italy
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System (IuC BoHNes), Sassari, Italy
| | - Tecla Bonci
- Department of Mechanical Engineering, Insigneo Institute for In Silico Medicine, The University of Sheffield, Sheffield, United Kingdom
| | - Marco Caruso
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System (IuC BoHNes), Sassari, Italy
- Department of Electronics and Telecommunications, Politecnico Di Torino, Torino, Italy
| | - Kirsty Scott
- Department of Mechanical Engineering, Insigneo Institute for In Silico Medicine, The University of Sheffield, Sheffield, United Kingdom
| | - Lisa Alcock
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle Upon Tyne, United Kingdom
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University, Newcastle Upon Tyne, United Kingdom
| | - Ellen Buckley
- Department of Mechanical Engineering, Insigneo Institute for In Silico Medicine, The University of Sheffield, Sheffield, United Kingdom
| | - Eran Gazit
- Centre for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Sourasky Medical Centre, Tel Aviv, Israel
| | - Clint Hansen
- Department of Neurology, University Medical Centre Schleswig-Holstein Campus Kiel and Kiel University, Kiel, Germany
| | - Lars Schwickert
- Department for Geriatric Rehabilitation, Robert-Bosch-Hospital, Stuttgart, Germany
| | - Kamiar Aminian
- Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Clemens Becker
- Department for Geriatric Rehabilitation, Robert-Bosch-Hospital, Stuttgart, Germany
| | - Philip Brown
- Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, United Kingdom
| | - Anne-Elie Carsin
- Instituto de Salud Global Barcelona, Barcelona Institute for Global Health (ISGlobal), Barcelona, Spain
- Faculty of Health and Life Sciences, Universitat Pompeu Fabra, Barcelona, Spain
- CIBER Epidemiología y Salud Pública, Madrid, Spain
| | - Brian Caulfield
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland
| | - Lorenzo Chiari
- Department of Electrical, Electronic and Information Engineering “Guglielmo Marconi”, University of Bologna, Bologna, Italy
- Health Sciences and Technologies-Interdepartmental Centre for Industrial Research (CIRI-SDV), University of Bologna, Bologna, Italy
| | - Ilaria D’Ascanio
- Department of Electrical, Electronic and Information Engineering “Guglielmo Marconi”, University of Bologna, Bologna, Italy
| | - Silvia Del Din
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle Upon Tyne, United Kingdom
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University, Newcastle Upon Tyne, United Kingdom
| | - Bjoern M. Eskofier
- Machine Learning and Data Analytics Lab, Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Judith Garcia-Aymerich
- Instituto de Salud Global Barcelona, Barcelona Institute for Global Health (ISGlobal), Barcelona, Spain
- Faculty of Health and Life Sciences, Universitat Pompeu Fabra, Barcelona, Spain
- CIBER Epidemiología y Salud Pública, Madrid, Spain
| | - Jeffrey M. Hausdorff
- Centre for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Sourasky Medical Centre, Tel Aviv, Israel
| | - Emily C. Hume
- Department of Sport, Exercise and Rehabilitation, Faculty of Health and Life Sciences, Northumbria University, Northumbia, United Kingdom
| | - Cameron Kirk
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle Upon Tyne, United Kingdom
| | - Felix Kluge
- Machine Learning and Data Analytics Lab, Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
- Novartis Institutes of Biomedical Research, Novartis Pharma AG, Basel, Switzerland
| | - Sarah Koch
- Instituto de Salud Global Barcelona, Barcelona Institute for Global Health (ISGlobal), Barcelona, Spain
- Faculty of Health and Life Sciences, Universitat Pompeu Fabra, Barcelona, Spain
- CIBER Epidemiología y Salud Pública, Madrid, Spain
| | - Arne Kuederle
- Machine Learning and Data Analytics Lab, Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Walter Maetzler
- Department of Neurology, University Medical Centre Schleswig-Holstein Campus Kiel and Kiel University, Kiel, Germany
| | - Encarna M. Micó-Amigo
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle Upon Tyne, United Kingdom
| | - Arne Mueller
- Novartis Institutes of Biomedical Research, Novartis Pharma AG, Basel, Switzerland
| | - Isabel Neatrour
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle Upon Tyne, United Kingdom
| | - Anisoara Paraschiv-Ionescu
- Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Luca Palmerini
- Department of Electrical, Electronic and Information Engineering “Guglielmo Marconi”, University of Bologna, Bologna, Italy
- Health Sciences and Technologies-Interdepartmental Centre for Industrial Research (CIRI-SDV), University of Bologna, Bologna, Italy
| | - Alison J. Yarnall
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle Upon Tyne, United Kingdom
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University, Newcastle Upon Tyne, United Kingdom
- Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, United Kingdom
| | - Lynn Rochester
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle Upon Tyne, United Kingdom
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University, Newcastle Upon Tyne, United Kingdom
- Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, United Kingdom
| | - Basil Sharrack
- Department of Neuroscience and Sheffield NIHR Translational Neuroscience BRC, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
| | - David Singleton
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland
| | - Beatrix Vereijken
- Department of Neuromedicine and Movement Science, Norwegian University of Science and Technology, Trondheim, Norway
| | - Ioannis Vogiatzis
- Department of Sport, Exercise and Rehabilitation, Faculty of Health and Life Sciences, Northumbria University, Northumbia, United Kingdom
| | - Ugo Della Croce
- Department of Biomedical Sciences, University of Sassari, Sassari, Italy
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System (IuC BoHNes), Sassari, Italy
| | - Claudia Mazzà
- Department of Mechanical Engineering, Insigneo Institute for In Silico Medicine, The University of Sheffield, Sheffield, United Kingdom
| | - Andrea Cereatti
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System (IuC BoHNes), Sassari, Italy
- Department of Electronics and Telecommunications, Politecnico Di Torino, Torino, Italy
| | | |
Collapse
|
11
|
Rossanigo R, Caruso M, Bertuletti S, Deriu F, Knaflitz M, Della Croce U, Cereatti A. Base of Support, Step Length and Stride Width Estimation during Walking Using an Inertial and Infrared Wearable System. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23083921. [PMID: 37112261 PMCID: PMC10144762 DOI: 10.3390/s23083921] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/13/2023] [Revised: 04/03/2023] [Accepted: 04/11/2023] [Indexed: 05/30/2023]
Abstract
The analysis of the stability of human gait may be effectively performed when estimates of the base of support are available. The base of support area is defined by the relative position of the feet when they are in contact with the ground and it is closely related to additional parameters such as step length and stride width. These parameters may be determined in the laboratory using either a stereophotogrammetric system or an instrumented mat. Unfortunately, their estimation in the real world is still an unaccomplished goal. This study aims at proposing a novel, compact wearable system, including a magneto-inertial measurement unit and two time-of-flight proximity sensors, suitable for the estimation of the base of support parameters. The wearable system was tested and validated on thirteen healthy adults walking at three self-selected speeds (slow, comfortable, and fast). Results were compared with the concurrent stereophotogrammetric data, used as the gold standard. The root mean square errors for the step length, stride width and base of support area varied from slow to high speed between 10-46 mm, 14-18 mm, and 39-52 cm2, respectively. The mean overlap of the base of support area as obtained with the wearable system and with the stereophotogrammetric system ranged between 70% and 89%. Thus, this study suggested that the proposed wearable solution is a valid tool for the estimation of the base of support parameters out of the laboratory.
Collapse
Affiliation(s)
- Rachele Rossanigo
- Department of Biomedical Sciences, University of Sassari, 07100 Sassari, Italy; (S.B.); (F.D.); (U.D.C.)
| | - Marco Caruso
- PolitoBIOMed Lab—Biomedical Engineering Lab, Politecnico di Torino, 10129 Torino, Italy; (M.C.); (M.K.)
- Department of Electronics and Telecommunications, Politecnico di Torino, 10129 Torino, Italy
| | - Stefano Bertuletti
- Department of Biomedical Sciences, University of Sassari, 07100 Sassari, Italy; (S.B.); (F.D.); (U.D.C.)
| | - Franca Deriu
- Department of Biomedical Sciences, University of Sassari, 07100 Sassari, Italy; (S.B.); (F.D.); (U.D.C.)
- Unit of Endocrinology, Nutritional and Metabolic Disorders, AOU Sassari, 07100 Sassari, Italy
| | - Marco Knaflitz
- PolitoBIOMed Lab—Biomedical Engineering Lab, Politecnico di Torino, 10129 Torino, Italy; (M.C.); (M.K.)
- Department of Electronics and Telecommunications, Politecnico di Torino, 10129 Torino, Italy
| | - Ugo Della Croce
- Department of Biomedical Sciences, University of Sassari, 07100 Sassari, Italy; (S.B.); (F.D.); (U.D.C.)
| | - Andrea Cereatti
- Department of Electronics and Telecommunications, Politecnico di Torino, 10129 Torino, Italy
| |
Collapse
|
12
|
Brasiliano P, Mascia G, Di Feo P, Di Stanislao E, Alvini M, Vannozzi G, Camomilla V. Impact of Gait Events Identification through Wearable Inertial Sensors on Clinical Gait Analysis of Children with Idiopathic Toe Walking. MICROMACHINES 2023; 14:277. [PMID: 36837977 PMCID: PMC9962364 DOI: 10.3390/mi14020277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Revised: 01/13/2023] [Accepted: 01/19/2023] [Indexed: 06/18/2023]
Abstract
Idiopathic toe walking (ITW) is a gait deviation characterized by forefoot contact with the ground and excessive ankle plantarflexion over the entire gait cycle observed in otherwise-typical developing children. The clinical evaluation of ITW is usually performed using optoelectronic systems analyzing the sagittal component of ankle kinematics and kinetics. However, in standardized laboratory contexts, these children can adopt a typical walking pattern instead of a toe walk, thus hindering the laboratory-based clinical evaluation. With these premises, measuring gait in a more ecological environment may be crucial in this population. As a first step towards adopting wearable clinical protocols embedding magneto-inertial sensors and pressure insoles, this study analyzed the performance of three algorithms for gait events identification based on shank and/or foot sensors. Foot strike and foot off were estimated from gait measurements taken from children with ITW walking barefoot and while wearing a foot orthosis. Although no single algorithm stands out as best from all perspectives, preferable algorithms were devised for event identification, temporal parameters estimate and heel and forefoot rocker identification, depending on the barefoot/shoed condition. Errors more often led to an erroneous characterization of the heel rocker, especially in shoed condition. The ITW gait specificity may cause errors in the identification of the foot strike which, in turn, influences the characterization of the heel rocker and, therefore, of the pathologic ITW behavior.
Collapse
Affiliation(s)
- Paolo Brasiliano
- Department of Movement, Human and Health Sciences, University of Rome “Foro Italico”, Piazza Lauro De Bosis 6, 00135 Rome, Italy
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome “Foro Italico”, 00135 Rome, Italy
| | - Guido Mascia
- Department of Movement, Human and Health Sciences, University of Rome “Foro Italico”, Piazza Lauro De Bosis 6, 00135 Rome, Italy
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome “Foro Italico”, 00135 Rome, Italy
| | - Paolo Di Feo
- Department of Movement, Human and Health Sciences, University of Rome “Foro Italico”, Piazza Lauro De Bosis 6, 00135 Rome, Italy
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome “Foro Italico”, 00135 Rome, Italy
| | - Eugenio Di Stanislao
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome “Foro Italico”, 00135 Rome, Italy
- “ITOP SpA Officine Ortopediche”, Via Prenestina Nuova 307/A, 00036 Palestrina, Italy
| | - Martina Alvini
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome “Foro Italico”, 00135 Rome, Italy
- “ITOP SpA Officine Ortopediche”, Via Prenestina Nuova 307/A, 00036 Palestrina, Italy
| | - Giuseppe Vannozzi
- Department of Movement, Human and Health Sciences, University of Rome “Foro Italico”, Piazza Lauro De Bosis 6, 00135 Rome, Italy
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome “Foro Italico”, 00135 Rome, Italy
| | - Valentina Camomilla
- Department of Movement, Human and Health Sciences, University of Rome “Foro Italico”, Piazza Lauro De Bosis 6, 00135 Rome, Italy
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome “Foro Italico”, 00135 Rome, Italy
| |
Collapse
|
13
|
A Narrative Review on Wearable Inertial Sensors for Human Motion Tracking in Industrial Scenarios. ROBOTICS 2022. [DOI: 10.3390/robotics11060138] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/05/2022] Open
Abstract
Industry 4.0 has promoted the concept of automation, supporting workers with robots while maintaining their central role in the factory. To guarantee the safety of operators and improve the effectiveness of the human-robot interaction, it is important to detect the movements of the workers. Wearable inertial sensors represent a suitable technology to pursue this goal because of their portability, low cost, and minimal invasiveness. The aim of this narrative review was to analyze the state-of-the-art literature exploiting inertial sensors to track the human motion in different industrial scenarios. The Scopus database was queried, and 54 articles were selected. Some important aspects were identified: (i) number of publications per year; (ii) aim of the studies; (iii) body district involved in the motion tracking; (iv) number of adopted inertial sensors; (v) presence/absence of a technology combined to the inertial sensors; (vi) a real-time analysis; (vii) the inclusion/exclusion of the magnetometer in the sensor fusion process. Moreover, an analysis and a discussion of these aspects was also developed.
Collapse
|
14
|
Mundt M, Oberlack H, Goldacre M, Powles J, Funken J, Morris C, Potthast W, Alderson J. Synthesising 2D Video from 3D Motion Data for Machine Learning Applications. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22176522. [PMID: 36080981 PMCID: PMC9459679 DOI: 10.3390/s22176522] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/17/2022] [Revised: 08/17/2022] [Accepted: 08/25/2022] [Indexed: 05/27/2023]
Abstract
To increase the utility of legacy, gold-standard, three-dimensional (3D) motion capture datasets for computer vision-based machine learning applications, this study proposed and validated a method to synthesise two-dimensional (2D) video image frames from historic 3D motion data. We applied the video-based human pose estimation model OpenPose to real (in situ) and synthesised 2D videos and compared anatomical landmark keypoint outputs, with trivial observed differences (2.11−3.49 mm). We further demonstrated the utility of the method in a downstream machine learning use-case in which we trained and then tested the validity of an artificial neural network (ANN) to estimate ground reaction forces (GRFs) using synthesised and real 2D videos. Training an ANN to estimate GRFs using eight OpenPose keypoints derived from synthesised 2D videos resulted in accurate waveform GRF estimations (r > 0.9; nRMSE < 14%). When compared with using the smaller number of real videos only, accuracy was improved by adding the synthetic views and enlarging the dataset. The results highlight the utility of the developed approach to enlarge small 2D video datasets, or to create 2D video images to accompany 3D motion capture datasets to make them accessible for machine learning applications.
Collapse
Affiliation(s)
- Marion Mundt
- UWA Minderoo Tech & Policy Lab, Law School, The University of Western Australia, Crawley, WA 6009, Australia
| | - Henrike Oberlack
- Institute of General Mechanics, RWTH Aachen University, 52062 Aachen, Germany
| | - Molly Goldacre
- UWA Minderoo Tech & Policy Lab, Law School, The University of Western Australia, Crawley, WA 6009, Australia
| | - Julia Powles
- UWA Minderoo Tech & Policy Lab, Law School, The University of Western Australia, Crawley, WA 6009, Australia
| | - Johannes Funken
- Institute of Biomechanics and Orthopaedics, German Sport University Cologne, 50933 Cologne, Germany
| | - Corey Morris
- UWA Minderoo Tech & Policy Lab, Law School, The University of Western Australia, Crawley, WA 6009, Australia
- School of Human Sciences, The University of Western Australia, Crawley, WA 6009, Australia
| | - Wolfgang Potthast
- Institute of Biomechanics and Orthopaedics, German Sport University Cologne, 50933 Cologne, Germany
| | - Jacqueline Alderson
- UWA Minderoo Tech & Policy Lab, Law School, The University of Western Australia, Crawley, WA 6009, Australia
- Sports Performance Research Institute New Zealand (SPRINZ), Auckland University of Technology, Auckland 1010, New Zealand
| |
Collapse
|
15
|
Komarizadehasl S, Komary M, Alahmad A, Lozano-Galant JA, Ramos G, Turmo J. A Novel Wireless Low-Cost Inclinometer Made from Combining the Measurements of Multiple MEMS Gyroscopes and Accelerometers. SENSORS (BASEL, SWITZERLAND) 2022; 22:5605. [PMID: 35957164 PMCID: PMC9371140 DOI: 10.3390/s22155605] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Revised: 07/20/2022] [Accepted: 07/23/2022] [Indexed: 06/15/2023]
Abstract
Structural damage detection using inclinometers is getting wide attention from researchers. However, the high price of inclinometers limits this system to unique structures with a relatively high structural health monitoring (SHM) budget. This paper presents a novel low-cost inclinometer, the low-cost adaptable reliable angle-meter (LARA), which combines five gyroscopes and five accelerometers to measure inclination. LARA incorporates Internet of Things (IoT)-based microcontroller technology enabling wireless data streaming and free commercial software for data acquisition. This paper investigates the accuracy, resolution, Allan variance and standard deviation of LARA produced with a different number of combined circuits, including an accelerometer and a gyroscope. To validate the accuracy and resolution of the developed device, its results are compared with those obtained by numerical slope calculations and a commercial inclinometer (HI-INC) in laboratory conditions. The results of a load test experiment on a simple beam model show the high accuracy of LARA (0.003 degrees). The affordability and high accuracy of LARA make it applicable for structural damage detection on bridges using inclinometers.
Collapse
Affiliation(s)
- Seyedmilad Komarizadehasl
- Department of Civil and Environment Engineering, Universitat Politècnica de Catalunya, BarcelonaTech. C/Jordi Girona 1-3, 08034 Barcelona, Spain; (S.K.); (M.K.); (A.A.); (G.R.)
| | - Mahyad Komary
- Department of Civil and Environment Engineering, Universitat Politècnica de Catalunya, BarcelonaTech. C/Jordi Girona 1-3, 08034 Barcelona, Spain; (S.K.); (M.K.); (A.A.); (G.R.)
| | - Ahmad Alahmad
- Department of Civil and Environment Engineering, Universitat Politècnica de Catalunya, BarcelonaTech. C/Jordi Girona 1-3, 08034 Barcelona, Spain; (S.K.); (M.K.); (A.A.); (G.R.)
| | - José Antonio Lozano-Galant
- Department of Civil Engineering, Universidad de Castilla-La Mancha, Av. Camilo Jose Cela s/n, 13071 Ciudad Real, Spain;
| | - Gonzalo Ramos
- Department of Civil and Environment Engineering, Universitat Politècnica de Catalunya, BarcelonaTech. C/Jordi Girona 1-3, 08034 Barcelona, Spain; (S.K.); (M.K.); (A.A.); (G.R.)
| | - Jose Turmo
- Department of Civil and Environment Engineering, Universitat Politècnica de Catalunya, BarcelonaTech. C/Jordi Girona 1-3, 08034 Barcelona, Spain; (S.K.); (M.K.); (A.A.); (G.R.)
| |
Collapse
|
16
|
Caruso M, Gastaldi L, Pastorelli S, Cereatti A, Digo E. An ISB-consistent Denavit-Hartenberg model of the human upper limb for joint kinematics optimization: validation on synthetic and robot data during a typical rehabilitation gesture. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:1805-1808. [PMID: 36085675 DOI: 10.1109/embc48229.2022.9871201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Several biomedical contexts such as diagnosis, rehabilitation, and ergonomics require an accurate estimate of human upper limbs kinematics. Wearable inertial measurement units (IMU s) represent a suitable solution because of their unobtrusiveness, portability, and low-cost. However, the time-integration of the gyroscope angular velocity leads to an unbounded orientation drift affecting both angular and linear displacements over long observation interval. In this work, a Denavit-Hartenberg model of the upper limb was defined in accordance with the guidelines of the International Society of Biomechanics and exploited to design an optimization kinematics process. This procedure estimated the joint angles by minimizing the difference between the modelled and IMU-driven orientation of upper arm and forearm. In addition, reasonable constraints were added to limit the drift influence on the final joint kinematics accuracy. The validity of the procedure was tested on synthetic and experimental data acquired with a robotic arm over 20 minutes. Average rms errors amounted to 2.8 deg and 1.1 for synthetic and robot data, respectively. Clinical Relevance - The proposed method has the potential to improve robustness and accuracy of multi-joint kinematics estimation in the general contexts of home-based tele-rehabilitation interventions. In this respect adoption of multi-segmental kinematic model along with physiological joint constraints could contribute to address current limitations associated to unsupervised analysis in terms of monitoring and outcome assessment.
Collapse
|
17
|
Mascia G, Brasiliano P, Di Feo P, Cereatti A, Camomilla V. A functional calibration protocol for ankle plantar-dorsiflexion estimate using magnetic and inertial measurement units: Repeatability and reliability assessment. J Biomech 2022; 141:111202. [PMID: 35751925 DOI: 10.1016/j.jbiomech.2022.111202] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Revised: 06/13/2022] [Accepted: 06/14/2022] [Indexed: 11/30/2022]
Abstract
The ankle joint complex presents a tangled functional anatomy, which understanding is fundamental to effectively estimate its kinematics on the sagittal plane. Protocols based on the use of magnetic and inertial measurement units (MIMUs) currently do not take in due account this factor. To this aim, a joint coordinate system for the ankle joint complex is proposed, along with a protocol to perform its anatomical calibration using MIMUs, consisting in a combination of anatomical functional calibrations of the tibiotalar axis and static acquisitions. Protocol repeatability and reliability were tested according to the metrics proposed in Schwartz et al. (2004) involving three different operators performing the protocol three times on ten participants, undergoing instrumented gait analysis through both stereophotogrammetry and MIMUs. Instrumental reliability was evaluated comparing the MIMU-derived kinematic traces with the stereophotogrammetric ones, obtained with the same protocol, through the linear fit method. A total of 270 gait cycles were considered. Results showed that the protocol was repeatable and reliable for what concerned the operators (0.4 ± 0.4 deg and 0.8 ± 0.5 deg, respectively). Instrumental reliability analysis showed a mean RMSD of 3.0 ± 1.3 deg, a mean offset of 9.4 ± 8.4 deg and a mean linear relationship strength of R2 = 0.88 ± 0.08. With due caution, the protocol can be considered both repeatable and reliable. Further studies should pay attention to the other ankle degrees of freedom as well as on the angular convention to compute them.
Collapse
Affiliation(s)
- Guido Mascia
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome "Foro Italico", Roma, Italy; Department of Human, Sports, and Health Science, University of Rome "Foro Italico", Roma, Italy
| | - Paolo Brasiliano
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome "Foro Italico", Roma, Italy; Department of Human, Sports, and Health Science, University of Rome "Foro Italico", Roma, Italy
| | - Paolo Di Feo
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome "Foro Italico", Roma, Italy; Department of Human, Sports, and Health Science, University of Rome "Foro Italico", Roma, Italy
| | - Andrea Cereatti
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome "Foro Italico", Roma, Italy; Department of Electronics and Telecommunications, Polytechnic of Turin, Torino, Italy
| | - Valentina Camomilla
- Interuniversity Centre of Bioengineering of the Human Neuromusculoskeletal System, University of Rome "Foro Italico", Roma, Italy; Department of Human, Sports, and Health Science, University of Rome "Foro Italico", Roma, Italy.
| |
Collapse
|
18
|
Detection of balance disorders using rotations around vertical axis and an artificial neural network. Sci Rep 2022; 12:7472. [PMID: 35523836 PMCID: PMC9076858 DOI: 10.1038/s41598-022-11425-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Accepted: 04/20/2022] [Indexed: 11/12/2022] Open
Abstract
Vestibular impairments affect patients' movements and can result in difficulties with daily life activities. The main aim of this study is to answer the question whether a simple and short test such as rotation about a vertical axis can be an objective method of assessing balance dysfunction in patients with unilateral vestibular impairments. A 360˚ rotation test was performed using six MediPost devices. The analysis was performed in three ways: (1) the analytical approach based only on data from one sensor; (2) the analytical approach based on data from six sensors; (3) the artificial neural network (ANN) approach based on data from six sensors. For approaches 1 and 2 best results were obtained using maximum angular velocities (MAV) of rotation and rotation duration (RD), while approach 3 used 11 different features. The following sensitivities and specificities were achieved: for approach 1: MAV—80% and 60%, RD—69% and 74%; for approach 2: 61% and 85% and RD—74% and 56%; for approach 3: 88% and 84%. The ANN-based six-sensor approach revealed the best sensitivity and specificity among parameters studied, however one-sensor approach might be a simple screening test used e.g. for rehabilitation purposes.
Collapse
|
19
|
Nilsson S, Ertzgaard P, Lundgren M, Grip H. Test-Retest Reliability of Kinematic and Temporal Outcome Measures for Clinical Gait and Stair Walking Tests, Based on Wearable Inertial Sensors. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22031171. [PMID: 35161916 PMCID: PMC8838027 DOI: 10.3390/s22031171] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Revised: 01/17/2022] [Accepted: 01/30/2022] [Indexed: 05/16/2023]
Abstract
It is important to assess gait function in neurological disorders. A common outcome measure from clinical walking tests is average speed, which is reliable but does not capture important kinematical and temporal aspects of gait function. An extended gait analysis must be time efficient and reliable to be included in the clinical routine. The aim of this study was to add an inertial sensor system to a gait test battery and analyze the test-retest reliability of kinematic and temporal outcome measures. Measurements and analyses were performed in the hospital environment by physiotherapists using customized software. In total, 22 healthy persons performed comfortable gait, fast gait, and stair walking, with 12 inertial sensors attached to the feet, shank, thigh, pelvis, thorax, and arms. Each person participated in 2 test sessions, with about 3-6 days between the sessions. Kinematics were calculated based on a sensor fusion algorithm. Sagittal peak angles, sagittal range of motion, and stride frequency were derived. Intraclass-correlation coefficients were determined to analyze the test-retest reliability, which was good to excellent for comfortable and fast gait, with exceptions for hip, knee, and ankle peak angles during fast gait, which showed moderate reliability, and fast gait stride frequency, which showed poor reliability. In stair walking, all outcome measures except shoulder extension showed good to excellent reliability. Inertial sensors have the potential to improve the clinical evaluation of gait function in neurological patients, but this must be verified in patient groups.
Collapse
Affiliation(s)
- Sofie Nilsson
- Department of Rehabilitation Medicine and Department of Health, Medicine and Caring Sciences, Linkoping University, 581 83 Linköping, Sweden; (S.N.); (P.E.)
| | - Per Ertzgaard
- Department of Rehabilitation Medicine and Department of Health, Medicine and Caring Sciences, Linkoping University, 581 83 Linköping, Sweden; (S.N.); (P.E.)
| | - Mikael Lundgren
- Department of Rehabilitation, Västervik Hospital, 593 33 Västervik, Sweden;
| | - Helena Grip
- Department of Radiation Sciences, Biomedical Engineering, Umeå University, 901 87 Umeå, Sweden
- Correspondence: ; Tel.: +46-907854029
| |
Collapse
|
20
|
Abstract
OBJECTIVE Analyzing human motion is essential for diagnosing movement disorders and guiding rehabilitation for conditions like osteoarthritis, stroke, and Parkinson's disease. Optical motion capture systems are the standard for estimating kinematics, but the equipment is expensive and requires a predefined space. While wearable sensor systems can estimate kinematics in any environment, existing systems are generally less accurate than optical motion capture. Many wearable sensor systems require a computer in close proximity and use proprietary software, limiting experimental reproducibility. METHODS Here, we present OpenSenseRT, an open-source and wearable system that estimates upper and lower extremity kinematics in real time by using inertial measurement units and a portable microcontroller. RESULTS We compared the OpenSenseRT system to optical motion capture and found an average RMSE of 4.4 degrees across 5 lower-limb joint angles during three minutes of walking and an average RMSE of 5.6 degrees across 8 upper extremity joint angles during a Fugl-Meyer task. The open-source software and hardware are scalable, tracking 1 to 14 body segments, with one sensor per segment. A musculoskeletal model and inverse kinematics solver estimate Kinematics in real-time. The computation frequency depends on the number of tracked segments, but is sufficient for real-time measurement for many tasks of interest; for example, the system can track 7 segments at 30 Hz in real-time. The system uses off-the-shelf parts costing approximately $100 USD plus $20 for each tracked segment. SIGNIFICANCE The OpenSenseRT system is validated against optical motion capture, low-cost, and simple to replicate, enabling movement analysis in clinics, homes, and free-living settings.
Collapse
Affiliation(s)
- Patrick Slade
- Department of Mechanical Engineering, Stanford University, Stanford, CA 94305, USA
| |
Collapse
|
21
|
Predicting Axial Impairment in Parkinson's Disease through a Single Inertial Sensor. SENSORS 2022; 22:s22020412. [PMID: 35062375 PMCID: PMC8778464 DOI: 10.3390/s22020412] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Revised: 12/23/2021] [Accepted: 01/05/2022] [Indexed: 02/06/2023]
Abstract
Background: Current telemedicine approaches lack standardised procedures for the remote assessment of axial impairment in Parkinson’s disease (PD). Unobtrusive wearable sensors may be a feasible tool to provide clinicians with practical medical indices reflecting axial dysfunction in PD. This study aims to predict the postural instability/gait difficulty (PIGD) score in PD patients by monitoring gait through a single inertial measurement unit (IMU) and machine-learning algorithms. Methods: Thirty-one PD patients underwent a 7-m timed-up-and-go test while monitored through an IMU placed on the thigh, both under (ON) and not under (OFF) dopaminergic therapy. After pre-processing procedures and feature selection, a support vector regression model was implemented to predict PIGD scores and to investigate the impact of L-Dopa and freezing of gait (FOG) on regression models. Results: Specific time- and frequency-domain features correlated with PIGD scores. After optimizing the dimensionality reduction methods and the model parameters, regression algorithms demonstrated different performance in the PIGD prediction in patients OFF and ON therapy (r = 0.79 and 0.75 and RMSE = 0.19 and 0.20, respectively). Similarly, regression models showed different performances in the PIGD prediction, in patients with FOG, ON and OFF therapy (r = 0.71 and RMSE = 0.27; r = 0.83 and RMSE = 0.22, respectively) and in those without FOG, ON and OFF therapy (r = 0.85 and RMSE = 0.19; r = 0.79 and RMSE = 0.21, respectively). Conclusions: Optimized support vector regression models have high feasibility in predicting PIGD scores in PD. L-Dopa and FOG affect regression model performances. Overall, a single inertial sensor may help to remotely assess axial motor impairment in PD patients.
Collapse
|
22
|
Mazzà C, Alcock L, Aminian K, Becker C, Bertuletti S, Bonci T, Brown P, Brozgol M, Buckley E, Carsin AE, Caruso M, Caulfield B, Cereatti A, Chiari L, Chynkiamis N, Ciravegna F, Del Din S, Eskofier B, Evers J, Garcia Aymerich J, Gazit E, Hansen C, Hausdorff JM, Helbostad JL, Hiden H, Hume E, Paraschiv-Ionescu A, Ireson N, Keogh A, Kirk C, Kluge F, Koch S, Küderle A, Lanfranchi V, Maetzler W, Micó-Amigo ME, Mueller A, Neatrour I, Niessen M, Palmerini L, Pluimgraaff L, Reggi L, Salis F, Schwickert L, Scott K, Sharrack B, Sillen H, Singleton D, Soltani A, Taraldsen K, Ullrich M, Van Gelder L, Vereijken B, Vogiatzis I, Warmerdam E, Yarnall A, Rochester L. Technical validation of real-world monitoring of gait: a multicentric observational study. BMJ Open 2021; 11:e050785. [PMID: 34857567 PMCID: PMC8640671 DOI: 10.1136/bmjopen-2021-050785] [Citation(s) in RCA: 42] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Abstract
INTRODUCTION Existing mobility endpoints based on functional performance, physical assessments and patient self-reporting are often affected by lack of sensitivity, limiting their utility in clinical practice. Wearable devices including inertial measurement units (IMUs) can overcome these limitations by quantifying digital mobility outcomes (DMOs) both during supervised structured assessments and in real-world conditions. The validity of IMU-based methods in the real-world, however, is still limited in patient populations. Rigorous validation procedures should cover the device metrological verification, the validation of the algorithms for the DMOs computation specifically for the population of interest and in daily life situations, and the users' perspective on the device. METHODS AND ANALYSIS This protocol was designed to establish the technical validity and patient acceptability of the approach used to quantify digital mobility in the real world by Mobilise-D, a consortium funded by the European Union (EU) as part of the Innovative Medicine Initiative, aiming at fostering regulatory approval and clinical adoption of DMOs.After defining the procedures for the metrological verification of an IMU-based device, the experimental procedures for the validation of algorithms used to calculate the DMOs are presented. These include laboratory and real-world assessment in 120 participants from five groups: healthy older adults; chronic obstructive pulmonary disease, Parkinson's disease, multiple sclerosis, proximal femoral fracture and congestive heart failure. DMOs extracted from the monitoring device will be compared with those from different reference systems, chosen according to the contexts of observation. Questionnaires and interviews will evaluate the users' perspective on the deployed technology and relevance of the mobility assessment. ETHICS AND DISSEMINATION The study has been granted ethics approval by the centre's committees (London-Bloomsbury Research Ethics committee; Helsinki Committee, Tel Aviv Sourasky Medical Centre; Medical Faculties of The University of Tübingen and of the University of Kiel). Data and algorithms will be made publicly available. TRIAL REGISTRATION NUMBER ISRCTN (12246987).
Collapse
Affiliation(s)
- Claudia Mazzà
- INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, UK
- Department of Mechanical Engineering, The University of Sheffield, Sheffield, UK
| | - Lisa Alcock
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - Kamiar Aminian
- Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Clemens Becker
- Robert Bosch Gesellschaft für Medizinische Forschung, Stuttgart, Germany
| | - Stefano Bertuletti
- Department of Biomedical Sciences, University of Sassari, Sassari, Sardegna, Italy
| | - Tecla Bonci
- INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, UK
- Department of Mechanical Engineering, The University of Sheffield, Sheffield, UK
| | - Philip Brown
- The Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, UK
| | - Marina Brozgol
- Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - Ellen Buckley
- INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, UK
- Department of Mechanical Engineering, The University of Sheffield, Sheffield, UK
| | - Anne-Elie Carsin
- ISGlobal, Barcelona, Spain
- Universitat Pompeu Fabra (UPF), Barcelona, Spain
- CIBER Epidemiología y Salud Pública (CIBERESP), Madrid, Spain
- IMIM (Hospital del Mar Medical Research Institute), Barcelona, Spain
| | - Marco Caruso
- Dipartimento di Elettronica e Telecomunicazioni, Politecnico di Torino, Torino, Italy
- PolitoBIOMed Lab - Biomedical Engineering Lab, Politecnico di Torino, Torino, Italy
| | - Brian Caulfield
- Insight Centre for Data Analytics, O'Brien Science Centre, University College Dublin, Dublin, Ireland
- UCD School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Andrea Cereatti
- Dipartimento di Elettronica e Telecomunicazioni, Politecnico di Torino, Torino, Italy
| | - Lorenzo Chiari
- Department of Electrical, Electronic and Information Engineering «Guglielmo Marconi», University of Bologna, Bologna, Italy
- Health Sciences and Technologies-Interdepartmental Center for Industrial Research (CIRI-SDV), University of Bologna, Bologna, Italy
| | - Nikolaos Chynkiamis
- Department of Sport, Exercise and Rehabilitation, Northumbria University Newcastle, Newcastle upon Tyne, UK
| | - Fabio Ciravegna
- INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, UK
- Department of Computer Science, The University of Sheffield, Sheffield, UK
| | - Silvia Del Din
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - Björn Eskofier
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Jordi Evers
- McRoberts BV, Den Haag, Zuid-Holland, Netherlands
| | - Judith Garcia Aymerich
- ISGlobal, Barcelona, Spain
- Universitat Pompeu Fabra (UPF), Barcelona, Spain
- CIBER Epidemiología y Salud Pública (CIBERESP), Madrid, Spain
| | - Eran Gazit
- Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - Clint Hansen
- Department of Neurology, University Medical Center Schleswig-Holstein Campus Kiel, Kiel, Germany
| | - Jeffrey M Hausdorff
- Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
- Department of Physical Therapy, Sackler Faculty of Medicine & Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| | - Jorunn L Helbostad
- Department of Neuromedicine and Movement Science, Norwegian University of Science and Technology, Trondheim, Norway
| | - Hugo Hiden
- School of Computing, Newcastle University, Newcastle upon Tyne, UK
| | - Emily Hume
- Department of Sport, Exercise and Rehabilitation, Northumbria University Newcastle, Newcastle upon Tyne, UK
| | - Anisoara Paraschiv-Ionescu
- Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Neil Ireson
- INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, UK
- Department of Computer Science, The University of Sheffield, Sheffield, UK
| | - Alison Keogh
- Insight Centre for Data Analytics, O'Brien Science Centre, University College Dublin, Dublin, Ireland
- UCD School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Cameron Kirk
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - Felix Kluge
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Sarah Koch
- ISGlobal, Barcelona, Spain
- Universitat Pompeu Fabra (UPF), Barcelona, Spain
- CIBER Epidemiología y Salud Pública (CIBERESP), Madrid, Spain
| | - Arne Küderle
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Vitaveska Lanfranchi
- INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, UK
- Department of Computer Science, The University of Sheffield, Sheffield, UK
| | - Walter Maetzler
- Department of Neurology, University Medical Center Schleswig-Holstein Campus Kiel, Kiel, Germany
| | - M Encarna Micó-Amigo
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - Arne Mueller
- Novartis Institutes of Biomedical Research, Novartis Pharma AG, Basel, Switzerland
| | - Isabel Neatrour
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | | | - Luca Palmerini
- Department of Electrical, Electronic and Information Engineering «Guglielmo Marconi», University of Bologna, Bologna, Italy
- Health Sciences and Technologies-Interdepartmental Center for Industrial Research (CIRI-SDV), University of Bologna, Bologna, Italy
| | | | - Luca Reggi
- Health Sciences and Technologies-Interdepartmental Center for Industrial Research (CIRI-SDV), University of Bologna, Bologna, Italy
| | - Francesca Salis
- Department of Biomedical Sciences, University of Sassari, Sassari, Sardegna, Italy
| | - Lars Schwickert
- Robert Bosch Gesellschaft für Medizinische Forschung, Stuttgart, Germany
| | - Kirsty Scott
- INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, UK
- Department of Mechanical Engineering, The University of Sheffield, Sheffield, UK
| | - Basil Sharrack
- Department of Neuroscience and Sheffield NIHR Translational Neuroscience BRC, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, UK
| | - Henrik Sillen
- Digital Health R&D, AstraZeneca Sweden, Sodertalje, Sweden
| | - David Singleton
- Insight Centre for Data Analytics, O'Brien Science Centre, University College Dublin, Dublin, Ireland
- UCD School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Abolfazi Soltani
- Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Kristin Taraldsen
- Department of Neuromedicine and Movement Science, Norwegian University of Science and Technology, Trondheim, Norway
| | - Martin Ullrich
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Linda Van Gelder
- INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, UK
- Department of Mechanical Engineering, The University of Sheffield, Sheffield, UK
| | - Beatrix Vereijken
- Department of Neuromedicine and Movement Science, Norwegian University of Science and Technology, Trondheim, Norway
| | - Ioannis Vogiatzis
- Department of Sport, Exercise and Rehabilitation, Northumbria University Newcastle, Newcastle upon Tyne, UK
| | - Elke Warmerdam
- Department of Neurology, University Medical Center Schleswig-Holstein Campus Kiel, Kiel, Germany
| | - Alison Yarnall
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
- The Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, UK
| | - Lynn Rochester
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
- The Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, UK
| |
Collapse
|
23
|
Caruso M, Sabatini AM, Knaflitz M, Della Croce U, Cereatti A. Extension of the Rigid-Constraint Method for the Heuristic Suboptimal Parameter Tuning to Ten Sensor Fusion Algorithms Using Inertial and Magnetic Sensing. SENSORS 2021; 21:s21186307. [PMID: 34577514 PMCID: PMC8473403 DOI: 10.3390/s21186307] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/29/2021] [Revised: 09/10/2021] [Accepted: 09/17/2021] [Indexed: 11/23/2022]
Abstract
The orientation of a magneto-inertial measurement unit can be estimated using a sensor fusion algorithm (SFA). However, orientation accuracy is greatly affected by the choice of the SFA parameter values which represents one of the most critical steps. A commonly adopted approach is to fine-tune parameter values to minimize the difference between estimated and true orientation. However, this can only be implemented within the laboratory setting by requiring the use of a concurrent gold-standard technology. To overcome this limitation, a Rigid-Constraint Method (RCM) was proposed to estimate suboptimal parameter values without relying on any orientation reference. The RCM method effectiveness was successfully tested on a single-parameter SFA, with an average error increase with respect to the optimal of 1.5 deg. In this work, the applicability of the RCM was evaluated on 10 popular SFAs with multiple parameters under different experimental scenarios. The average residual between the optimal and suboptimal errors amounted to 0.6 deg with a maximum of 3.7 deg. These encouraging results suggest the possibility to properly tune a generic SFA on different scenarios without using any reference. The synchronized dataset also including the optical data and the SFA codes are available online.
Collapse
Affiliation(s)
- Marco Caruso
- PolitoBIOMed Lab—Biomedical Engineering Lab, Politecnico di Torino, 10129 Torino, Italy;
- Department of Electronics and Telecommunications, Politecnico di Torino, 10129 Torino, Italy;
- Correspondence:
| | - Angelo Maria Sabatini
- Department of Excellence in Robotics & AI, The BioRobotics Institute, Scuola Superiore Sant’Anna, 56127 Pisa, Italy;
| | - Marco Knaflitz
- PolitoBIOMed Lab—Biomedical Engineering Lab, Politecnico di Torino, 10129 Torino, Italy;
- Department of Electronics and Telecommunications, Politecnico di Torino, 10129 Torino, Italy;
| | - Ugo Della Croce
- Department of Biomedical Sciences, University of Sassari, 07100 Sassari, Italy;
| | - Andrea Cereatti
- Department of Electronics and Telecommunications, Politecnico di Torino, 10129 Torino, Italy;
| |
Collapse
|
24
|
Abstract
Inertial-sensor-based attitude estimation is a crucial technology in various applications, from human motion tracking to autonomous aerial and ground vehicles. Application scenarios differ in characteristics of the performed motion, presence of disturbances, and environmental conditions. Since state-of-the-art attitude estimators do not generalize well over these characteristics, their parameters must be tuned for the individual motion characteristics and circumstances. We propose RIANN, a ready-to-use, neural network-based, parameter-free, real-time-capable inertial attitude estimator, which generalizes well across different motion dynamics, environments, and sampling rates, without the need for application-specific adaptations. We gather six publicly available datasets of which we exploit two datasets for the method development and the training, and we use four datasets for evaluation of the trained estimator in three different test scenarios with varying practical relevance. Results show that RIANN outperforms state-of-the-art attitude estimation filters in the sense that it generalizes much better across a variety of motions and conditions in different applications, with different sensor hardware and different sampling frequencies. This is true even if the filters are tuned on each individual test dataset, whereas RIANN was trained on completely separate data and has never seen any of these test datasets. RIANN can be applied directly without adaptations or training and is therefore expected to enable plug-and-play solutions in numerous applications, especially when accuracy is crucial but no ground-truth data is available for tuning or when motion and disturbance characteristics are uncertain. We made RIANN publicly available.
Collapse
|
25
|
Mundt M, Johnson WR, Potthast W, Markert B, Mian A, Alderson J. A Comparison of Three Neural Network Approaches for Estimating Joint Angles and Moments from Inertial Measurement Units. SENSORS 2021; 21:s21134535. [PMID: 34283080 PMCID: PMC8271391 DOI: 10.3390/s21134535] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Revised: 06/24/2021] [Accepted: 06/28/2021] [Indexed: 11/23/2022]
Abstract
The application of artificial intelligence techniques to wearable sensor data may facilitate accurate analysis outside of controlled laboratory settings—the holy grail for gait clinicians and sports scientists looking to bridge the lab to field divide. Using these techniques, parameters that are difficult to directly measure in-the-wild, may be predicted using surrogate lower resolution inputs. One example is the prediction of joint kinematics and kinetics based on inputs from inertial measurement unit (IMU) sensors. Despite increased research, there is a paucity of information examining the most suitable artificial neural network (ANN) for predicting gait kinematics and kinetics from IMUs. This paper compares the performance of three commonly employed ANNs used to predict gait kinematics and kinetics: multilayer perceptron (MLP); long short-term memory (LSTM); and convolutional neural networks (CNN). Overall high correlations between ground truth and predicted kinematic and kinetic data were found across all investigated ANNs. However, the optimal ANN should be based on the prediction task and the intended use-case application. For the prediction of joint angles, CNNs appear favourable, however these ANNs do not show an advantage over an MLP network for the prediction of joint moments. If real-time joint angle and joint moment prediction is desirable an LSTM network should be utilised.
Collapse
Affiliation(s)
- Marion Mundt
- Minderoo Tech and Policy Lab, UWA Law School, The University of Western Australia, Crawley 6009, Australia;
- Correspondence:
| | | | - Wolfgang Potthast
- Institute of Biomechanics and Orthopeadics, German Sport University Cologne, 50933 Cologne, Germany;
| | - Bernd Markert
- Institute of General Mechanics, RWTH Aachen University, 52062 Aachen, Germany;
| | - Ajmal Mian
- School of Computer Science and Software Engineering, The University of Western Australia, Crawley 6009, Australia;
| | - Jacqueline Alderson
- Minderoo Tech and Policy Lab, UWA Law School, The University of Western Australia, Crawley 6009, Australia;
- Sports Performance Research Institute New Zealand (SPRINZ), Auckland University of Technology, Auckland 1010, New Zealand
| |
Collapse
|
26
|
Abstract
Inertial measurement units (IMUs) enable orientation, velocity, and position estimation in several application domains ranging from robotics and autonomous vehicles to human motion capture and rehabilitation engineering. Errors in orientation estimation greatly affect any of those motion parameters. The present work explains the main challenges in inertial orientation estimation (IOE) and presents an extensive benchmark dataset that includes 3D inertial and magnetic data with synchronized optical marker-based ground truth measurements, the Berlin Robust Orientation Estimation Assessment Dataset (BROAD). The BROAD dataset consists of 39 trials that are conducted at different speeds and include various types of movement. Thereof, 23 trials are performed in an undisturbed indoor environment, and 16 trials are recorded with deliberate magnetometer and accelerometer disturbances. We furthermore propose error metrics that allow for IOE accuracy evaluation while separating the heading and inclination portions of the error and introduce well-defined benchmark metrics. Based on the proposed benchmark, we perform an exemplary case study on two widely used openly available IOE algorithms. Due to the broad range of motion and disturbance scenarios, the proposed benchmark is expected to provide valuable insight and useful tools for the assessment, selection, and further development of inertial sensor fusion methods and IMU-based application systems.
Collapse
|