1
|
Anderson W, Choffin Z, Jeong N, Callihan M, Jeong S, Sazonov E. Empirical Study on Human Movement Classification Using Insole Footwear Sensor System and Machine Learning. SENSORS 2022; 22:s22072743. [PMID: 35408358 PMCID: PMC9003281 DOI: 10.3390/s22072743] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/23/2022] [Revised: 03/25/2022] [Accepted: 03/29/2022] [Indexed: 02/04/2023]
Abstract
This paper presents a plantar pressure sensor system (P2S2) integrated in the insoles of shoes to detect thirteen commonly used human movements including walking, stooping left and right, pulling a cart backward, squatting, descending, ascending stairs, running, and falling (front, back, right, left). Six force sensitive resistors (FSR) sensors were positioned on critical pressure points on the insoles to capture the electrical signature of pressure change in the various movements. A total of 34 adult participants were tested with the P2S2. The pressure data were collected and processed using a Principal Component Analysis (PCA) for input to the multiple machine learning (ML) algorithms, including k-NN, neural network and Support-Vector Machine (SVM) algorithms. The ML models were trained using four-fold cross-validation. Each fold kept subject data independent from other folds. The model proved effective with an accuracy of 86%, showing a promising result in predicting human movements using the P2S2 integrated in shoes.
Collapse
Affiliation(s)
- Wolfe Anderson
- Department of Electrical and Computer Engineering, The University of Alabama, Tuscaloosa, AL 35487, USA; (W.A.); (Z.C.); (E.S.)
| | - Zachary Choffin
- Department of Electrical and Computer Engineering, The University of Alabama, Tuscaloosa, AL 35487, USA; (W.A.); (Z.C.); (E.S.)
| | - Nathan Jeong
- Department of Electrical and Computer Engineering, The University of Alabama, Tuscaloosa, AL 35487, USA; (W.A.); (Z.C.); (E.S.)
- Correspondence: ; Tel.: +1-(205)-348-4820
| | - Michael Callihan
- College of Nursing, The University of Alabama, Tuscaloosa, AL 35487, USA;
| | - Seongcheol Jeong
- Department of Electrical Engineering, Pohang University of Science and Technology, Pohang 37673, Korea;
| | - Edward Sazonov
- Department of Electrical and Computer Engineering, The University of Alabama, Tuscaloosa, AL 35487, USA; (W.A.); (Z.C.); (E.S.)
| |
Collapse
|
2
|
Kim DY, Lee SH, Jeong GM. Stack LSTM-Based User Identification Using Smart Shoes with Accelerometer Data. SENSORS 2021; 21:s21238129. [PMID: 34884133 PMCID: PMC8662428 DOI: 10.3390/s21238129] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/03/2021] [Revised: 11/10/2021] [Accepted: 11/22/2021] [Indexed: 11/16/2022]
Abstract
In this study, we propose a long short-term memory (LSTM)-based user identification method using accelerometer data from smart shoes. In general, for the user identification with human walking data, we require a pre-processing stage in order to divide human walking data into individual steps. Next, user identification can be made with divided step data. In these approaches, when there exist partial data that cannot complete a single step, it is difficult to apply those data to the classification. Considering these facts, in this study, we present a stack LSTM-based user identification method for smart-shoes data. Rather than using a complicated analysis method, we designed an LSTM network for user identification with accelerometer data of smart shoes. In order to learn partial data, the LSTM network was trained using walking data with random sizes and random locations. Then, the identification can be made without any additional analysis such as step division. In the experiments, user walking data with 10 m were used. The experimental results show that the average recognition rate was about 93.41%, 97.19%, and 98.26% by using walking data of 2.6, 3.9, and 5.2 s, respectively. With the experimental results, we show that the proposed method can classify users effectively.
Collapse
|
3
|
Automated Analysis of the Two-Minute Walk Test in Clinical Practice Using Accelerometer Data. Brain Sci 2021; 11:brainsci11111507. [PMID: 34827506 PMCID: PMC8615930 DOI: 10.3390/brainsci11111507] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2021] [Revised: 11/08/2021] [Accepted: 11/11/2021] [Indexed: 11/22/2022] Open
Abstract
One of the core problems for people with multiple sclerosis (pwMS) is the impairment of their ability to walk, which can be severely restrictive in everyday life. Therefore, monitoring of ambulatory function is of great importance to be able to effectively counteract disease progression. An extensive gait analysis, such as the Dresden protocol for multidimensional walking assessment, covers several facets of walking impairment including a 2-min walk test, in which the distance taken by the patient in two minutes is measured by an odometer. Using this approach, it is questionable how precise the measuring methods are at recording the distance traveled. In this project, we investigate whether the current measurement can be replaced by a digital measurement method based on accelerometers (six Opal sensors from the Mobility Lab system) that are attached to the patient’s body. We developed two algorithms using these data and compared the validity of these approaches using the results from 2-min walk tests from 562 pwMS that were collected with a gold-standard odometer. In 48.4% of pwMS, we detected an average relative measurement error of less than 5%, while results from 25.8% of the pwMS showed a relative measurement error of up to 10%. The algorithm had difficulties correctly calculating the walking distances in another 25.8% of pwMS; these results showed a measurement error of more than 20%. A main reason for this moderate performance was the variety of pathologically altered gait patterns in pwMS that may complicate the step detection. Overall, both algorithms achieved favorable levels of agreement (r = 0.884 and r = 0.980) with the odometer. Finally, we present suggestions for improvement of the measurement system to be implemented in the future.
Collapse
|
4
|
Soulard J, Vaillant J, Baillet A, Gaudin P, Vuillerme N. Gait and Axial Spondyloarthritis: Comparative Gait Analysis Study Using Foot-Worn Inertial Sensors. JMIR Mhealth Uhealth 2021; 9:e27087. [PMID: 34751663 PMCID: PMC8663701 DOI: 10.2196/27087] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2021] [Revised: 05/18/2021] [Accepted: 07/23/2021] [Indexed: 12/15/2022] Open
Abstract
Background Axial spondyloarthritis (axSpA) can lead to spinal mobility restrictions associated with restricted lower limb ranges of motion, thoracic kyphosis, spinopelvic ankylosis, or decrease in muscle strength. It is well known that these factors can have consequences on spatiotemporal gait parameters during walking. However, no study has assessed spatiotemporal gait parameters in patients with axSpA. Divergent results have been obtained in the studies assessing spatiotemporal gait parameters in ankylosing spondylitis, a subgroup of axSpA, which could be partly explained by self-reported pain intensity scores at time of assessment. Inertial measurement units (IMUs) are increasingly popular and may facilitate gait assessment in clinical practice. Objective This study compared spatiotemporal gait parameters assessed with foot-worn IMUs in patients with axSpA and matched healthy individuals without and with pain intensity score as a covariate. Methods A total of 30 patients with axSpA and 30 age- and sex-matched healthy controls performed a 10-m walk test at comfortable speed. Various spatiotemporal gait parameters were computed from foot-worn inertial sensors including gait speed in ms–1 (mean walking velocity), cadence in steps/minute (number of steps in a minute), stride length in m (distance between 2 consecutive footprints of the same foot on the ground), swing time in percentage (portion of the cycle during which the foot is in the air), stance time in percentage (portion of the cycle during which part of the foot touches the ground), and double support time in percentage (portion of the cycle where both feet touch the ground). Results Age, height, and weight were not significantly different between groups. Self-reported pain intensity was significantly higher in patients with axSpA than healthy controls (P<.001). Independent sample t tests indicated that patients with axSpA presented lower gait speed (P<.001) and cadence (P=.004), shorter stride length (P<.001) and swing time (P<.001), and longer double support time (P<.001) and stance time (P<.001) than healthy controls. When using pain intensity as a covariate, spatiotemporal gait parameters were still significant with patients with axSpA exhibiting lower gait speed (P<.001), shorter stride length (P=.001) and swing time (P<.001), and longer double support time (P<.001) and stance time (P<.001) than matched healthy controls. Interestingly, there were no longer statistically significant between-group differences observed for the cadence (P=.17). Conclusions Gait was significantly altered in patients with axSpA with reduced speed, cadence, stride length, and swing time and increased double support and stance time. Taken together, these changes in spatiotemporal gait parameters could be interpreted as the adoption of a so-called cautious gait pattern in patients with axSpA. Among factors that may influence gait in patients with axSpA, patient self-reported pain intensity could play a role. Finally, IMUs allowed computation of spatiotemporal gait parameters and are usable to assess gait in patients with axSpA in clinical routine. Trial Registration ClinicalTrials.gov NCT03761212; https://clinicaltrials.gov/ct2/show/NCT03761212 International Registered Report Identifier (IRRID) RR2-10.1007/s00296-019-04396-4
Collapse
Affiliation(s)
- Julie Soulard
- University Grenoble Alpes, AGEIS, La Tronche, France.,Grenoble Alpes University Hospital, Grenoble, France
| | | | - Athan Baillet
- University Grenoble Alpes, CNRS, Grenoble Alpes University Hospital, Grenoble INP, TIMC-IMAG UMR5525, Grenoble, France
| | - Philippe Gaudin
- University Grenoble Alpes, CNRS, Grenoble Alpes University Hospital, Grenoble INP, TIMC-IMAG UMR5525, Grenoble, France
| | - Nicolas Vuillerme
- University Grenoble Alpes, AGEIS, La Tronche, France.,Institut Universitaire de France, Paris, France.,LabCom Telecom4Health, Orange Labs & Univ. Grenoble Alpes, CNRS, Inria, Grenoble INP-UGA, Grenoble, France
| |
Collapse
|
5
|
Deep Learning-Based Optimal Smart Shoes Sensor Selection for Energy Expenditure and Heart Rate Estimation. SENSORS 2021; 21:s21217058. [PMID: 34770365 PMCID: PMC8587085 DOI: 10.3390/s21217058] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/24/2021] [Revised: 10/21/2021] [Accepted: 10/21/2021] [Indexed: 11/17/2022]
Abstract
Wearable technologies are known to improve our quality of life. Among the various wearable devices, shoes are non-intrusive, lightweight, and can be used for outdoor activities. In this study, we estimated the energy consumption and heart rate in an environment (i.e., running on a treadmill) using smart shoes equipped with triaxial acceleration, triaxial gyroscope, and four-point pressure sensors. The proposed model uses the latest deep learning architecture which does not require any separate preprocessing. Moreover, it is possible to select the optimal sensor using a channel-wise attention mechanism to weigh the sensors depending on their contributions to the estimation of energy expenditure (EE) and heart rate (HR). The performance of the proposed model was evaluated using the root mean squared error (RMSE), mean absolute error (MAE), and coefficient of determination (R2). Moreover, the RMSE was 1.05 ± 0.15, MAE 0.83 ± 0.12 and R2 0.922 ± 0.005 in EE estimation. On the other hand, and RMSE was 7.87 ± 1.12, MAE 6.21 ± 0.86, and R2 0.897 ± 0.017 in HR estimation. In both estimations, the most effective sensor was the z axis of the accelerometer and gyroscope sensors. Through these results, it is demonstrated that the proposed model could contribute to the improvement of the performance of both EE and HR estimations by effectively selecting the optimal sensors during the active movements of participants.
Collapse
|
6
|
The Effects of Auditory Feedback Gait Training Using Smart Insole on Stroke Patients. Brain Sci 2021; 11:brainsci11111377. [PMID: 34827376 PMCID: PMC8615866 DOI: 10.3390/brainsci11111377] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2021] [Revised: 10/12/2021] [Accepted: 10/19/2021] [Indexed: 12/02/2022] Open
Abstract
This study aimed to assess the effect of the auditory feedback gait training (AFGT) using smart insole on the gait variables, dynamic balance, and activities of daily living (ADL) of stroke patients. In this case, 45 chronic stroke patients who were diagnosed with a stroke before 6 months and could walk more than 10 m were included in this study. Participants were randomly allocated to the smart insole training group (n = 23), in which the AFGT system was used, or to the general gait training group (GGTG) (n = 22). Both groups completed conventional rehabilitation, including conventional physiotherapy and gait training, lasting 60 min per session, five times per week for 4 weeks. Instead of gait training, the smart insole training group received smart insole training twice per week for 4 weeks. Participants were assessed using the GAITRite for gait variables and Timed Up and Go test (TUG), Berg Balance Scale (BBS) for dynamic balance, and Modified Barthel Index (MBI) for ADL. The spatiotemporal gait parameters, symmetry of gait, TUG, BBS, and MBI in the smart insole training group were significantly improved compared to those in the GGTG (p < 0.05). The AFGT system approach is a helpful method for improving gait variables, dynamic balance, and ADL in chronic stroke patients.
Collapse
|
7
|
Soulard J, Vaillant J, Baillet A, Gaudin P, Vuillerme N. The effects of a secondary task on gait in axial spondyloarthritis. Sci Rep 2021; 11:19537. [PMID: 34599222 PMCID: PMC8486771 DOI: 10.1038/s41598-021-98732-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2020] [Accepted: 08/27/2021] [Indexed: 02/08/2023] Open
Abstract
Studies on the effects of dual tasking in patients with chronic inflammatory rheumatic diseases are limited. The aim of this study was to assess dual tasking while walking in patients with axial spondyloarthritis (axSpA) in comparison to healthy controls. Thirty patients with axSpA and thirty healthy controls underwent a 10-m walk test at a self-selected comfortable walking speed in single- and dual-task conditions. Foot-worn inertial sensors were used to compute spatiotemporal gait parameters. Analysis of spatiotemporal gait parameters showed that the secondary manual task negatively affected walking performance in terms of significantly decreased mean speed (p < 0.001), stride length (p < 0.001) and swing time (p = 0.008) and increased double support (p = 0.002) and stance time (p = 0.008). No significant interaction of group and condition was observed. Both groups showed lower gait performance in dual task condition by reducing speed, swing time and stride length, and increasing double support and stance time. Patients with axSpA were not more affected by the dual task than matched healthy controls, suggesting that the secondary manual task did not require greater attention in patients with axSpA. Increasing the complexity of the walking and/or secondary task may increase the sensitivity of the dual-task design to axial spondyloarthritis.
Collapse
Affiliation(s)
- Julie Soulard
- University Grenoble Alpes, AGEIS, Grenoble, France.
- CHU Grenoble Alpes, Grenoble, France.
| | | | - Athan Baillet
- CHU Grenoble Alpes, Grenoble, France
- University Grenoble Alpes, CNRS, CHU Grenoble Alpes, Grenoble INP, TIMC-IMAG UMR5525, Grenoble, France
| | - Philippe Gaudin
- CHU Grenoble Alpes, Grenoble, France
- University Grenoble Alpes, CNRS, CHU Grenoble Alpes, Grenoble INP, TIMC-IMAG UMR5525, Grenoble, France
| | - Nicolas Vuillerme
- University Grenoble Alpes, AGEIS, Grenoble, France
- Institut Universitaire de France, Paris, France
- LabCom Telecom4Health, Orange Labs & Univ. Grenoble Alpes, CNRS, Inria, Grenoble INP-UGA, Grenoble, France
| |
Collapse
|
8
|
A Novel Tool for Gait Analysis: Validation Study of the Smart Insole PODOSmart ®. SENSORS 2021; 21:s21175972. [PMID: 34502861 PMCID: PMC8434608 DOI: 10.3390/s21175972] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/01/2021] [Revised: 09/02/2021] [Accepted: 09/03/2021] [Indexed: 12/20/2022]
Abstract
The new smart insole PODOSmart®, is introduced as a new tool for gait analysis against high cost laboratory based equipment. PODOSmart® system measures walking profile and gait variables in real life conditions. PODOSmart® insoles consists of wireless sensors, can be fitted into any shoe and offer the ability to measure spatial, temporal, and kinematic gait parameters. The intelligent insoles feature several sensors that detect and capture foot movements and a microprocessor that calculates gait related biomechanical data. Gait analysis results are presented in PODOSmart® platform. This study aims to present the characteristics of this tool and to validate it comparing with a stereophotogrammetry-based system. Validation was performed by gait analysis for eleven healthy individuals on a six-meters walkway using both PODOSmart® and Vicon system. Intraclass correlation coefficients (ICC) were calculated for gait parameters. ICC for the validation ranged from 0.313 to 0.990 in gait parameters. The highest ICC was observed in cadence, circumduction, walking speed, stride length and stride duration. PODOSmart® is a valid tool for gait analysis compared to the gold standard Vicon. As PODOSmart®, is a portable gait analysis tool with an affordable cost it can be a useful novel tool for gait analysis in healthy and pathological population.
Collapse
|
9
|
Adaptive Accumulation of Plantar Pressure for Ambulatory Activity Recognition and Pedestrian Identification. SENSORS 2021; 21:s21113842. [PMID: 34199381 PMCID: PMC8199628 DOI: 10.3390/s21113842] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Revised: 05/29/2021] [Accepted: 05/30/2021] [Indexed: 12/05/2022]
Abstract
In this paper, we propose a novel method for ambulatory activity recognition and pedestrian identification based on temporally adaptive weighting accumulation-based features extracted from categorical plantar pressure. The method relies on three pressure-related features, which are calculated by accumulating the pressure of the standing foot in each step over three different temporal weighting forms. In addition, we consider a feature reflecting the pressure variation. These four features characterize the standing posture in a step by differently weighting step pressure data over time. We use these features to analyze the standing foot during walking and then recognize ambulatory activities and identify pedestrians based on multilayer multiclass support vector machine classifiers. Experimental results show that the proposed method achieves 97% accuracy for the two tasks when analyzing eight consecutive steps. For faster processing, the method reaches 89.9% and 91.3% accuracy for ambulatory activity recognition and pedestrian identification considering two consecutive steps, respectively, whereas the accuracy drops to 83.3% and 82.3% when considering one step for the respective tasks. Comparative results demonstrated the high performance of the proposed method regarding accuracy and temporal sensitivity.
Collapse
|
10
|
Spatio-temporal gait parameters obtained from foot-worn inertial sensors are reliable in healthy adults in single- and dual-task conditions. Sci Rep 2021; 11:10229. [PMID: 33986307 PMCID: PMC8119721 DOI: 10.1038/s41598-021-88794-4] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2020] [Accepted: 04/07/2021] [Indexed: 02/07/2023] Open
Abstract
Inertial measurement units (IMUs) are increasingly popular and may be usable in clinical routine to assess gait. However, assessing their intra-session reliability is crucial and has not been tested with foot-worn sensors in healthy participants. The aim of this study was to assess the intra-session reliability of foot-worn IMUs for measuring gait parameters in healthy adults. Twenty healthy participants were enrolled in the study and performed the 10-m walk test in single- and dual-task ('carrying a full cup of water') conditions, three trials per condition. IMUs were used to assess spatiotemporal gait parameters, gait symmetry parameters (symmetry index (SI) and symmetry ratio (SR)), and dual task effects parameters. The relative and the absolute reliability were calculated for each gait parameter. Results showed that spatiotemporal gait parameters measured with foot-worn inertial sensors were reliable; symmetry gait parameters relative reliability was low, and SR showed better absolute reliability than SI; dual task effects were poorly reliable, and taking the mean of the second and the third trials was the most reliable. Foot-worn IMUs are reliable to assess spatiotemporal and symmetry ratio gait parameters but symmetry index and DTE gait parameters reliabilities were low and need to be interpreted with cautious by clinicians and researchers.
Collapse
|
11
|
Soulard J, Vaillant J, Balaguier R, Baillet A, Gaudin P, Vuillerme N. Foot-Worn Inertial Sensors Are Reliable to Assess Spatiotemporal Gait Parameters in Axial Spondyloarthritis under Single and Dual Task Walking in Axial Spondyloarthritis. SENSORS (BASEL, SWITZERLAND) 2020; 20:E6453. [PMID: 33198119 PMCID: PMC7697708 DOI: 10.3390/s20226453] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 10/07/2020] [Revised: 11/06/2020] [Accepted: 11/09/2020] [Indexed: 02/07/2023]
Abstract
The aim of this study was (1) to evaluate the relative and absolute reliability of gait parameters during walking in single- and dual-task conditions in patients with axial spondyloarthritis (axSpA), (2) to evaluate the absolute and relative reliability of dual task effects (DTE) parameters, and (3) to determine the number of trials required to ensure reliable gait assessment, in patients with axSpA. Twenty patients with axSpa performed a 10-m walk test in single- and dual-task conditions, three times for each condition. Spatiotemporal, symmetry, and DTE gait parameters were calculated from foot-worn inertial sensors. The relative reliability (intraclass correlation coefficients-ICC) and absolute reliability (standard error of measurement-SEM and minimum detectable change-MDC) were calculated for these parameters in each condition. Spatiotemporal gait parameters showed good to excellent reliability in both conditions (0.59 < ICC < 0.90). The reliability of symmetry and DTE parameters was low. ICC, SEM, and MDC were better when using the mean of the second and the third trials. Spatiotemporal gait parameters obtained from foot-worn inertial sensors assessed in patients with axSpA in single- and dual-task conditions are reliable. However, symmetry and DTE parameters seem less reliable and need to be interpreted with caution. Finally, better reliability of gait parameters was found when using the mean of the 2nd and the 3rd trials.
Collapse
Affiliation(s)
- Julie Soulard
- University Grenoble Alpes, AGEIS, 38000 Grenoble, France; (J.V.); (R.B.); (N.V.)
- CHU Grenoble Alpes, 38000 Grenoble, France
| | - Jacques Vaillant
- University Grenoble Alpes, AGEIS, 38000 Grenoble, France; (J.V.); (R.B.); (N.V.)
| | - Romain Balaguier
- University Grenoble Alpes, AGEIS, 38000 Grenoble, France; (J.V.); (R.B.); (N.V.)
| | - Athan Baillet
- University Grenoble Alpes, CNRS, CHU Grenoble Alpes, Grenoble INP, TIMC-IMAG UMR5525, 38000 Grenoble, France; (A.B.); (P.G.)
| | - Philippe Gaudin
- University Grenoble Alpes, CNRS, CHU Grenoble Alpes, Grenoble INP, TIMC-IMAG UMR5525, 38000 Grenoble, France; (A.B.); (P.G.)
| | - Nicolas Vuillerme
- University Grenoble Alpes, AGEIS, 38000 Grenoble, France; (J.V.); (R.B.); (N.V.)
- Institut Universitaire de France, 75000 Paris, France
- LabCom Telecom4Health, University Grenoble Alpes & Orange Labs, 38000 Grenoble, France
| |
Collapse
|
12
|
Seo M, Shin MJ, Park TS, Park JH. Clinometric Gait Analysis Using Smart Insoles in Patients With Hemiplegia After Stroke: Pilot Study. JMIR Mhealth Uhealth 2020; 8:e22208. [PMID: 32909949 PMCID: PMC7516684 DOI: 10.2196/22208] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2020] [Revised: 08/10/2020] [Accepted: 08/18/2020] [Indexed: 12/18/2022] Open
Abstract
Background For effective rehabilitation after stroke, it is essential to conduct an objective assessment of the patient’s functional status. Several stroke severity scales have been used for this purpose, but such scales have various limitations. Objective Gait analysis using smart insole technology can be applied continuously, objectively, and quantitatively, thereby overcoming the shortcomings of other assessment tools. Methods To confirm the reliability of gait analysis using smart insole technology, normal healthy controls wore insoles in their shoes during the Timed Up and Go (TUG) test. The gait parameters were compared with the manually collected data. To determine the gait characteristics of patients with hemiplegia due to stroke, they were asked to wear insoles and take the TUG test; gait parameters were calculated and compared with those of control subjects. To investigate whether the gait analysis accurately reflected the patients’ clinical condition, we analyzed the relationships of 22 gait parameters on 4 stroke severity scales. Results The smart insole gait parameter data were similar to those calculated manually. Among the 18 gait parameters tested, 14 were significantly effective at distinguishing patients from healthy controls. The smart insole data revealed that the stance duration on both sides was longer in patients than controls, which has proven difficult to show using other methods. Furthermore, the sound side in patients showed a markedly longer stance duration. Regarding swing duration, that of the sound side was shorter in patients than controls, whereas that of the hemiplegic side was longer. We identified 10 significantly correlated gait parameters on the stroke severity scales. Notably, the difference in stance duration between the sound and hemiplegic sides was significantly correlated with the Fugl-Meyer Assessment (FMA) lower extremity score. Conclusions This study confirmed the feasibility and applicability of the smart insole as a device to assess the gait of patients with hemiplegia due to stroke. In addition, we demonstrated that the FMA score was significantly correlated with the smart insole data. Providing an environment where stroke patients can easily measure walking ability helps to maintain chronic functions as well as acute rehabilitation. Trial Registration UMIN Clinical Trials Registry UMIN000041646, https://upload.umin.ac.jp/cgi-open-bin/ctr_e/ctr_view.cgi?recptno=R000047538
Collapse
Affiliation(s)
- Minseok Seo
- School of Medicine, Pusan National University, Busan, Republic of Korea
| | - Myung-Jun Shin
- Department of Rehabilitation Medicine, School of Medicine, Pusan National University, Busan, Republic of Korea
| | - Tae Sung Park
- Biomedical Research Institute, Pusan National University Hospital, Busan, Republic of Korea
| | - Jong-Hwan Park
- Biomedical Research Institute, Pusan National University Hospital, Busan, Republic of Korea
| |
Collapse
|
13
|
Ngueleu AM, Blanchette AK, Maltais D, Moffet H, McFadyen BJ, Bouyer L, Batcho CS. Validity of Instrumented Insoles for Step Counting, Posture and Activity Recognition: A Systematic Review. SENSORS 2019; 19:s19112438. [PMID: 31141973 PMCID: PMC6603748 DOI: 10.3390/s19112438] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/19/2019] [Revised: 05/23/2019] [Accepted: 05/24/2019] [Indexed: 11/16/2022]
Abstract
With the growing interest in daily activity monitoring, several insole designs have been developed to identify postures, detect activities, and count steps. However, the validity of these devices is not clearly established. The aim of this systematic review was to synthesize the available information on the criterion validity of instrumented insoles in detecting postures activities and steps. The literature search through six databases led to 33 articles that met inclusion criteria. These studies evaluated 17 different insole models and involved 290 participants from 16 to 75 years old. Criterion validity was assessed using six statistical indicators. For posture and activity recognition, accuracy varied from 75.0% to 100%, precision from 65.8% to 100%, specificity from 98.1% to 100%, sensitivity from 73.0% to 100%, and identification rate from 66.2% to 100%. For step counting, accuracies were very high (94.8% to 100%). Across studies, different postures and activities were assessed using different criterion validity indicators, leading to heterogeneous results. Instrumented insoles appeared to be highly accurate for steps counting. However, measurement properties were variable for posture and activity recognition. These findings call for a standardized methodology to investigate the measurement properties of such devices.
Collapse
Affiliation(s)
- Armelle M Ngueleu
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (CIRRIS), Centre intégré universitaire de santé et de services sociaux de la Capitale-Nationale (CIUSSS-CN), Quebec City, QC G1M2S8, Canada.
| | - Andréanne K Blanchette
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (CIRRIS), Centre intégré universitaire de santé et de services sociaux de la Capitale-Nationale (CIUSSS-CN), Quebec City, QC G1M2S8, Canada.
- Department of Rehabilitation, Faculty of Medicine, Université Laval, Quebec City, QC G1M2S8, Canada.
| | - Désirée Maltais
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (CIRRIS), Centre intégré universitaire de santé et de services sociaux de la Capitale-Nationale (CIUSSS-CN), Quebec City, QC G1M2S8, Canada.
- Department of Rehabilitation, Faculty of Medicine, Université Laval, Quebec City, QC G1M2S8, Canada.
| | - Hélène Moffet
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (CIRRIS), Centre intégré universitaire de santé et de services sociaux de la Capitale-Nationale (CIUSSS-CN), Quebec City, QC G1M2S8, Canada.
- Department of Rehabilitation, Faculty of Medicine, Université Laval, Quebec City, QC G1M2S8, Canada.
| | - Bradford J McFadyen
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (CIRRIS), Centre intégré universitaire de santé et de services sociaux de la Capitale-Nationale (CIUSSS-CN), Quebec City, QC G1M2S8, Canada.
- Department of Rehabilitation, Faculty of Medicine, Université Laval, Quebec City, QC G1M2S8, Canada.
| | - Laurent Bouyer
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (CIRRIS), Centre intégré universitaire de santé et de services sociaux de la Capitale-Nationale (CIUSSS-CN), Quebec City, QC G1M2S8, Canada.
- Department of Rehabilitation, Faculty of Medicine, Université Laval, Quebec City, QC G1M2S8, Canada.
| | - Charles S Batcho
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (CIRRIS), Centre intégré universitaire de santé et de services sociaux de la Capitale-Nationale (CIUSSS-CN), Quebec City, QC G1M2S8, Canada.
- Department of Rehabilitation, Faculty of Medicine, Université Laval, Quebec City, QC G1M2S8, Canada.
| |
Collapse
|
14
|
Lee SS, Choi ST, Choi SI. Classification of Gait Type Based on Deep Learning Using Various Sensors with Smart Insole. SENSORS 2019; 19:s19081757. [PMID: 31013773 PMCID: PMC6514988 DOI: 10.3390/s19081757] [Citation(s) in RCA: 43] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/26/2019] [Revised: 04/06/2019] [Accepted: 04/09/2019] [Indexed: 11/25/2022]
Abstract
In this paper, we proposed a gait type classification method based on deep learning using a smart insole with various sensor arrays. We measured gait data using a pressure sensor array, an acceleration sensor array, and a gyro sensor array built into a smart insole. Features of gait pattern were then extracted using a deep convolution neural network (DCNN). In order to accomplish this, measurement data of continuous gait cycle were divided into unit steps. Pre-processing of data were then performed to remove noise followed by data normalization. A feature map was then extracted by constructing an independent DCNN for data obtained from each sensor array. Each of the feature maps was then combined to form a fully connected network for gait type classification. Experimental results for seven types of gait (walking, fast walking, running, stair climbing, stair descending, hill climbing, and hill descending) showed that the proposed method provided a high classification rate of more than 90%.
Collapse
Affiliation(s)
- Sung-Sin Lee
- Department of Data Science, Dankook University, Yongin 16890, Korea.
| | - Sang Tae Choi
- Department of Internal Medicine, Chung-Ang University, Seoul 06984, Korea.
| | - Sang-Il Choi
- Department of Computer Science and Engineering, Dankook University, Yongin 16890, Korea.
| |
Collapse
|
15
|
Design and Accuracy of an Instrumented Insole Using Pressure Sensors for Step Count. SENSORS 2019; 19:s19050984. [PMID: 30813515 PMCID: PMC6427154 DOI: 10.3390/s19050984] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/07/2019] [Revised: 02/16/2019] [Accepted: 02/21/2019] [Indexed: 12/28/2022]
Abstract
Despite the accessibility of several step count measurement systems, count accuracy in real environments remains a major challenge. Microelectromechanical systems and pressure sensors seem to present a potential solution for step count accuracy. The purpose of this study was to equip an insole with pressure sensors and to test a novel and potentially more accurate method of detecting steps. Methods: Five force-sensitive resistors (FSR) were integrated under the heel, the first, third, and fifth metatarsal heads and the great toe. This system was tested with twelve healthy participants at self-selected and maximal walking speeds in indoor and outdoor settings. Step counts were computed based on previously reported calculation methods, individual and averaged FSR-signals, and a new method: cumulative sum of all FSR-signals. These data were compared to a direct visual step count for accuracy analysis. Results: This system accurately detected steps with success rates ranging from 95.5 ± 3.5% to 98.5 ± 2.1% (indoor) and from 96.5 ± 3.9% to 98.0 ± 2.3% (outdoor) for self-selected walking speeds and from 98.1 ± 2.7% to 99.0 ± 0.7% (indoor) and 97.0 ± 6.2% to 99.4 ± 0.7% (outdoor) for maximal walking speeds. Cumulative sum of pressure signals during the stance phase showed high step detection accuracy (99.5 ± 0.7%–99.6 ± 0.4%) and appeared to be a valid method of step counting. Conclusions: The accuracy of step counts varied according to the calculation methods, with cumulative sum-based method being highly accurate.
Collapse
|
16
|
Dasgupta P, VanSwearingen J, Sejdic E. "You can tell by the way I use my walk." Predicting the presence of cognitive load with gait measurements. Biomed Eng Online 2018; 17:122. [PMID: 30208897 PMCID: PMC6134780 DOI: 10.1186/s12938-018-0555-8] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2018] [Accepted: 09/01/2018] [Indexed: 11/12/2022] Open
Abstract
Background There is considerable evidence that a person’s gait is affected by cognitive load. Research in this field has implications for understanding the relationship between motor control and neurological conditions in aging and clinical populations. Accordingly, this pilot study evaluates the cognitive load based on gait accelerometry measurements of the walking patterns of ten healthy individuals (18–35 years old). Methods Data points were collected using six triaxial accelerometer sensors and treadmill pressure reports. Stride and window extraction methods were used to process these data points and separate into statistical features. A binary classification was created by using logistic regression, support vector machine, random forest, and learning vector quantization to classify cognitive load vs. no cognitive load. Results Within and between subjects, a cognitive load was predicted with accuracy values ranged of 0.93–1 by all four models. Various feature selection methods demonstrated that only 2–20 variables could be used to achieve similar levels of accuracies. Conclusion Coupling sensors with machine learning algorithms to detect the most minute changes in gait patterns, most of which are too subtle to identify with the human eye, may have a remarkable impact on the potential to detect potential neuromotor illnesses and fall risks. In doing so, we can open a new window to human health and safety prevention.
Collapse
Affiliation(s)
- Pritika Dasgupta
- Department of Biomedical Informatics, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
| | - Jessie VanSwearingen
- Department of Physical Therapy, School of Health and Rehabilitation Sciences, University of Pittsburgh, Pittsburgh, PA, USA
| | - Ervin Sejdic
- Department of Electrical and Computer Engineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, USA.
| |
Collapse
|
17
|
Shaikh MF, Salcic Z, Wang KIK. A Novel Accelerometer-Based Technique for Robust Detection of Walking Direction. IEEE Trans Biomed Eng 2018; 65:1740-1747. [PMID: 29989934 DOI: 10.1109/tbme.2017.2774924] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
OBJECTIVE Distance estimation in pedestrian dead reckoning is acquired using vector norm of accelerations, which results in positive values. However, anteroposterior acceleration is negative when a step is taken backward, which must be detected for accurate localization. This paper proposes a novel approach for the detection of walking direction, which uses a dominant trend duration. METHODS The approach evaluates anteroposterior acceleration out of a foot-worn accelerometer for temporal dominance of acceleration trends during swing phase of the walk. The approach is tested for forward and backward walks with speed variations on a straight path as well as for forward walk at normal speed on a turning path. To validate the detection accuracy, success rates per participant per walk trial are calculated and then overall success rate for all the trials are reported. Moreover, metrics precision, recall and F1 scores are calculated for detection reliability in both directions. RESULTS Overall 98 ± 2% detection accuracy is achieved on linear path considering both directions and all speed variations, whereas 93 ± 7% on turning path including left and right turns. In comparison with the state-of-the-art bidirectional detection approach, the proposed approach delivers accurate detection with speed variations without requiring prior training and relies on a single sensory feature. CONCLUSION Dominant trend duration is a novel and reliable feature to detect directional changes during communal walk with speed variation. SIGNIFICANCE The approach can be employed in different contexts, such as enabling pedestrian localization approaches to accommodate back stepping or any application that requires knowledge of changing directions while walking.
Collapse
|
18
|
Trong Bui D, Nguyen ND, Jeong GM. A Robust Step Detection Algorithm and Walking Distance Estimation Based on Daily Wrist Activity Recognition Using a Smart Band. SENSORS 2018; 18:s18072034. [PMID: 29941842 PMCID: PMC6069265 DOI: 10.3390/s18072034] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/24/2018] [Revised: 05/31/2018] [Accepted: 06/09/2018] [Indexed: 11/24/2022]
Abstract
Human activity recognition and pedestrian dead reckoning are an interesting field because of their importance utilities in daily life healthcare. Currently, these fields are facing many challenges, one of which is the lack of a robust algorithm with high performance. This paper proposes a new method to implement a robust step detection and adaptive distance estimation algorithm based on the classification of five daily wrist activities during walking at various speeds using a smart band. The key idea is that the non-parametric adaptive distance estimator is performed after two activity classifiers and a robust step detector. In this study, two classifiers perform two phases of recognizing five wrist activities during walking. Then, a robust step detection algorithm, which is integrated with an adaptive threshold, peak and valley correction algorithm, is applied to the classified activities to detect the walking steps. In addition, the misclassification activities are fed back to the previous layer. Finally, three adaptive distance estimators, which are based on a non-parametric model of the average walking speed, calculate the length of each strike. The experimental results show that the average classification accuracy is about 99%, and the accuracy of the step detection is 98.7%. The error of the estimated distance is 2.2–4.2% depending on the type of wrist activities.
Collapse
Affiliation(s)
- Duong Trong Bui
- School of Electrical Engineering, Kookmin University, 861-1 Jeongnung-dong, Seongbuk-gu, Seoul 136-702, Korea.
| | - Nhan Duc Nguyen
- School of Electrical Engineering, Kookmin University, 861-1 Jeongnung-dong, Seongbuk-gu, Seoul 136-702, Korea.
| | - Gu-Min Jeong
- School of Electrical Engineering, Kookmin University, 861-1 Jeongnung-dong, Seongbuk-gu, Seoul 136-702, Korea.
| |
Collapse
|
19
|
An Automatic Gait Feature Extraction Method for Identifying Gait Asymmetry Using Wearable Sensors. SENSORS 2018; 18:s18020676. [PMID: 29495299 PMCID: PMC5855014 DOI: 10.3390/s18020676] [Citation(s) in RCA: 38] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/06/2018] [Revised: 02/08/2018] [Accepted: 02/20/2018] [Indexed: 11/17/2022]
Abstract
This paper aims to assess the use of Inertial Measurement Unit (IMU) sensors to identify gait asymmetry by extracting automatic gait features. We design and develop an android app to collect real time synchronous IMU data from legs. The results from our method are validated using a Qualisys Motion Capture System. The data are collected from 10 young and 10 older subjects. Each performed a trial in a straight corridor comprising 15 strides of normal walking, a turn around and another 15 strides. We analyse the data for total distance, total time, total velocity, stride, step, cadence, step ratio, stance, and swing. The accuracy of detecting the stride number using the proposed method is 100% for young and 92.67% for older subjects. The accuracy of estimating travelled distance using the proposed method for young subjects is 97.73% and 98.82% for right and left legs; and for the older, is 88.71% and 89.88% for right and left legs. The average travelled distance is 37.77 (95% CI ± 3.57) meters for young subjects and is 22.50 (95% CI ± 2.34) meters for older subjects. The average travelled time for young subjects is 51.85 (95% CI ± 3.08) seconds and for older subjects is 84.02 (95% CI ± 9.98) seconds. The results show that wearable sensors can be used for identifying gait asymmetry without the requirement and expense of an elaborate laboratory setup. This can serve as a tool in diagnosing gait abnormalities in individuals and opens the possibilities for home based self-gait asymmetry assessment.
Collapse
|
20
|
Abstract
Gait is one of the keys to functional independence. For a long-time, walking was considered an automatic process involving minimal higher-level cognitive input. Indeed, walking does not take place without muscles that move the limbs and the "lower-level" control that regulates the timely activation of the muscles. However, a growing body of literature suggests that walking can be viewed as a cognitive process that requires "higher-level" cognitive control, especially during challenging walking conditions that require executive function and attention. Two main locomotor pathways have been identified involving multiple brain areas for the control of posture and gait: the dorsal pathway of cognitive locomotor control and the ventral pathway for emotional locomotor control. These pathways may be distinctly affected in different pathologies that have important implications for rehabilitation and therapy. The clinical assessment of gait should be a focused, simple, and cost-effective process that provides both quantifiable and qualitative information on performance. In the last two decades, gait analysis has gradually shifted from analysis of a few steps in a restricted space to long-term monitoring of gait using body fixed sensors, capturing real-life and routine behavior in the home and community environment. The chapter also describes this evolution and its implications.
Collapse
Affiliation(s)
- Anat Mirelman
- Center for the Study of Movement, Cognition, and Mobility, Neurology Division, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel; Sagol School of Neuroscience, Tel Aviv University, Israel; Department of Neurology, Sackler School of Medicine, Tel Aviv University, Israel; Laboratory of Early Markers of Neurodegeneration, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - Shirley Shema
- Center for the Study of Movement, Cognition, and Mobility, Neurology Division, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - Inbal Maidan
- Center for the Study of Movement, Cognition, and Mobility, Neurology Division, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel; Sagol School of Neuroscience, Tel Aviv University, Israel; Department of Neurology, Sackler School of Medicine, Tel Aviv University, Israel; Laboratory of Early Markers of Neurodegeneration, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - Jeffery M Hausdorff
- Center for the Study of Movement, Cognition, and Mobility, Neurology Division, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel; Sagol School of Neuroscience, Tel Aviv University, Israel; Department of Physical Therapy, Sackler Faculty of Medicine, Tel Aviv University, Israel; Rush Alzheimer's Disease Center and Department of Orthopaedic Surgery, Rush University Medical Center, Chicago, IL, United States.
| |
Collapse
|
21
|
|