Detection of Gait From Continuous Inertial Sensor Data Using Harmonic Frequencies

Real-World Gait Detection Using a Wrist-Worn Inertial Sensor: Validation Study

BACKGROUND

Wrist-worn inertial sensors are used in digital health for evaluating mobility in real-world environments. Preceding the estimation of spatiotemporal gait parameters within long-term recordings, gait detection is an important step to identify regions of interest where gait occurs, which requires robust algorithms due to the complexity of arm movements. While algorithms exist for other sensor positions, a comparative validation of algorithms applied to the wrist position on real-world data sets across different disease populations is missing. Furthermore, gait detection performance differences between the wrist and lower back position have not yet been explored but could yield valuable information regarding sensor position choice in clinical studies.

OBJECTIVE

The aim of this study was to validate gait sequence (GS) detection algorithms developed for the wrist position against reference data acquired in a real-world context. In addition, this study aimed to compare the performance of algorithms applied to the wrist position to those applied to lower back-worn inertial sensors.

METHODS

Participants with Parkinson disease, multiple sclerosis, proximal femoral fracture (hip fracture recovery), chronic obstructive pulmonary disease, and congestive heart failure and healthy older adults (N=83) were monitored for 2.5 hours in the real-world using inertial sensors on the wrist, lower back, and feet including pressure insoles and infrared distance sensors as reference. In total, 10 algorithms for wrist-based gait detection were validated against a multisensor reference system and compared to gait detection performance using lower back-worn inertial sensors.

RESULTS

The best-performing GS detection algorithm for the wrist showed a mean (per disease group) sensitivity ranging between 0.55 (SD 0.29) and 0.81 (SD 0.09) and a mean (per disease group) specificity ranging between 0.95 (SD 0.06) and 0.98 (SD 0.02). The mean relative absolute error of estimated walking time ranged between 8.9% (SD 7.1%) and 32.7% (SD 19.2%) per disease group for this algorithm as compared to the reference system. Gait detection performance from the best algorithm applied to the wrist inertial sensors was lower than for the best algorithms applied to the lower back, which yielded mean sensitivity between 0.71 (SD 0.12) and 0.91 (SD 0.04), mean specificity between 0.96 (SD 0.03) and 0.99 (SD 0.01), and a mean relative absolute error of estimated walking time between 6.3% (SD 5.4%) and 23.5% (SD 13%). Performance was lower in disease groups with major gait impairments (eg, patients recovering from hip fracture) and for patients using bilateral walking aids.

CONCLUSIONS

Algorithms applied to the wrist position can detect GSs with high performance in real-world environments. Those periods of interest in real-world recordings can facilitate gait parameter extraction and allow the quantification of gait duration distribution in everyday life. Our findings allow taking informed decisions on alternative positions for gait recording in clinical studies and public health.

TRIAL REGISTRATION

ISRCTN Registry 12246987; https://www.isrctn.com/ISRCTN12246987.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1136/bmjopen-2021-050785.

Gaitmap-An Open Ecosystem for IMU-Based Human Gait Analysis and Algorithm Benchmarking

Goal: Gait analysis using inertial measurement units (IMUs) has emerged as a promising method for monitoring movement disorders. However, the lack of public data and easy-to-use open-source algorithms hinders method comparison and clinical application development. To address these challenges, this publication introduces the gaitmap ecosystem, a comprehensive set of open source Python packages for gait analysis using foot-worn IMUs. Methods: This initial release includes over 20 state-of-the-art algorithms, enables easy access to seven datasets, and provides eight benchmark challenges with reference implementations. Together with its extensive documentation and tooling, it enables rapid development and validation of new algorithm and provides a foundation for novel clinical applications. Conclusion: The published software projects represent a pioneering effort to establish an open-source ecosystem for IMU-based gait analysis. We believe that this work can democratize the access to high-quality algorithm and serve as a driver for open and reproducible research in the field of human gait analysis and beyond.

Ecological validity of a deep learning algorithm to detect gait events from real-life walking bouts in mobility-limiting diseases

Introduction

The clinical assessment of mobility, and walking specifically, is still mainly based on functional tests that lack ecological validity. Thanks to inertial measurement units (IMUs), gait analysis is shifting to unsupervised monitoring in naturalistic and unconstrained settings. However, the extraction of clinically relevant gait parameters from IMU data often depends on heuristics-based algorithms that rely on empirically determined thresholds. These were mainly validated on small cohorts in supervised settings.

Methods

Here, a deep learning (DL) algorithm was developed and validated for gait event detection in a heterogeneous population of different mobility-limiting disease cohorts and a cohort of healthy adults. Participants wore pressure insoles and IMUs on both feet for 2.5 h in their habitual environment. The raw accelerometer and gyroscope data from both feet were used as input to a deep convolutional neural network, while reference timings for gait events were based on the combined IMU and pressure insoles data.

Results and discussion

The results showed a high-detection performance for initial contacts (ICs) (recall: 98%, precision: 96%) and final contacts (FCs) (recall: 99%, precision: 94%) and a maximum median time error of -0.02 s for ICs and 0.03 s for FCs. Subsequently derived temporal gait parameters were in good agreement with a pressure insoles-based reference with a maximum mean difference of 0.07, -0.07, and <0.01 s for stance, swing, and stride time, respectively. Thus, the DL algorithm is considered successful in detecting gait events in ecologically valid environments across different mobility-limiting diseases.

A robust walking detection algorithm using a single foot-worn inertial sensor: validation in real-life settings

Walking activity and gait parameters are considered among the most relevant mobility-related parameters. Currently, gait assessments have been mainly analyzed in laboratory or hospital settings, which only partially reflect usual performance (i.e., real world behavior). In this study, we aim to validate a robust walking detection algorithm using a single foot-worn inertial measurement unit (IMU) in real-life settings. We used a challenging dataset including 18 individuals performing free-living activities. A multi-sensor wearable system including pressure insoles, multiple IMUs, and infrared distance sensors (INDIP) was used as reference. Accurate walking detection was obtained, with sensitivity and specificity of 98 and 91% respectively. As robust walking detection is needed for ambulatory monitoring to complete the processing pipeline from raw recorded data to walking/mobility outcomes, a validated algorithm would pave the way for assessing patient performance and gait quality in real-world conditions.

Reverse Engineering of Digital Measures: Inviting Patients to the Conversation

Background

Digital measures offer an unparalleled opportunity to create a more holistic picture of how people who are patients behave in their real-world environments, thereby establishing a better connection between patients, caregivers, and the clinical evidence used to drive drug development and disease management. Reaching this vision will require achieving a new level of co-creation between the stakeholders who design, develop, use, and make decisions using evidence from digital measures.

Summary

In September 2022, the second in a series of meetings hosted by the Swiss Federal Institute of Technology in Zürich, the Foundation for the National Institutes of Health Biomarkers Consortium, and sponsored by Wellcome Trust, entitled "Reverse Engineering of Digital Measures," was held in Zurich, Switzerland, with a broad range of stakeholders sharing their experience across four case studies to examine how patient centricity is essential in shaping development and validation of digital evidence generation tools.

Key Messages

In this paper, we discuss progress and the remaining barriers to widespread use of digital measures for evidence generation in clinical development and care delivery. We also present key discussion points and takeaways in order to continue discourse and provide a basis for dissemination and outreach to the wider community and other stakeholders. The work presented here shows us a blueprint for how and why the patient voice can be thoughtfully integrated into digital measure development and that continued multistakeholder engagement is critical for further progress.

Human gait-labeling uncertainty and a hybrid model for gait segmentation

Motion capture systems are widely accepted as ground-truth for gait analysis and are used for the validation of other gait analysis systems. To date, their reliability and limitations in manual labeling of gait events have not been studied.

Objectives

Evaluate manual labeling uncertainty and introduce a hybrid stride detection and gait-event estimation model for autonomous, long-term, and remote monitoring.

Methods

Estimate inter-labeler inconsistencies by computing the limits-of-agreement. Develop a hybrid model based on dynamic time warping and convolutional neural network to identify valid strides and eliminate non-stride data in inertial (walking) data collected by a wearable device. Finally, detect gait events within a valid stride region.

Results

The limits of inter-labeler agreement for key gait events heel off, toe off, heel strike, and flat foot are 72, 16, 24, and 80 ms, respectively; The hybrid model's classification accuracy for stride and non-stride are 95.16 and 84.48%, respectively; The mean absolute error for detected heel off, toe off, heel strike, and flat foot are 24, 5, 9, and 13 ms, respectively, when compared to the average human labels.

Conclusions

The results show the inherent labeling uncertainty and the limits of human gait labeling of motion capture data; The proposed hybrid-model's performance is comparable to that of human labelers, and it is a valid model to reliably detect strides and estimate the gait events in human gait data.

Significance

This work establishes the foundation for fully automated human gait analysis systems with performances comparable to human-labelers.

A deep-learning approach for automatically detecting gait-events based on foot-marker kinematics in children with cerebral palsy-Which markers work best for which gait patterns?

Neuromotor pathologies often cause motor deficits and deviations from typical locomotion, reducing the quality of life. Clinical gait analysis is used to effectively classify these motor deficits to gain deeper insights into resulting walking behaviours. To allow the ensemble averaging of spatio-temporal metrics across individuals during walking, gait events, such as initial contact (IC) or toe-off (TO), are extracted through either manual annotation based on video data, or through force thresholds using force plates. This study developed a deep-learning long short-term memory (LSTM) approach to detect IC and TO automatically based on foot-marker kinematics of 363 cerebral palsy subjects (age: 11.8 ± 3.2). These foot-marker kinematics, including 3D positions and velocities of the markers located on the hallux (HLX), calcaneus (HEE), distal second metatarsal (TOE), and proximal fifth metatarsal (PMT5), were extracted retrospectively from standard barefoot gait analysis sessions. Different input combinations of these four foot-markers were evaluated across three gait subgroups (IC with the heel, midfoot, or forefoot). For the overall group, our approach detected 89.7% of ICs within 16ms of the true event with a 18.5% false alarm rate. For TOs, only 71.6% of events were detected with a 33.8% false alarm rate. While the TOE|HEE marker combination performed well across all subgroups for IC detection, optimal performance for TO detection required different input markers per subgroup with performance differences of 5-10%. Thus, deep-learning LSTM based detection of IC events using the TOE|HEE markers offers an automated alternative to avoid operator-dependent and laborious manual annotation, as well as the limited step coverage and inability to measure assisted walking for force plate-based detection of IC events.

Automatic Assessment of the Type and Intensity of Agitated Hand Movements

With increasing numbers of people living with dementia, there is growing interest in the automatic monitoring of agitation. Current assessments rely on carer observations within a framework of behavioural scales. Automatic monitoring of agitation can supplement existing assessments, providing carers and clinicians with a greater understanding of the causes and extent of agitation. Despite agitation frequently manifesting in repetitive hand movements, the automatic assessment of repetitive hand movements remains a sparsely researched field. Monitoring hand movements is problematic due to the subtle differences between different types of hand movements and variations in how they can be carried out; the lack of training data creates additional challenges. This paper proposes a novel approach to assess the type and intensity of repetitive hand movements using skeletal model data derived from video. We introduce a video-based dataset of five repetitive hand movements symptomatic of agitation. Using skeletal keypoint locations extracted from video, we demonstrate a system to recognise repetitive hand movements using discriminative poses. By first learning characteristics of the movement, our system can accurately identify changes in the intensity of repetitive movements. Wide inter-subject variation in agitated behaviours suggests the benefit of personalising the recognition model with some end-user information. Our results suggest that data captured using a single conventional RGB video camera can be used to automatically monitor agitated hand movements of sedentary patients.

Real-World Stair Ambulation Characteristics Differ Between Prospective Fallers and Non-Fallers in Parkinson's Disease

Falls are among the leading causes of injuries or death for individuals from the age of 65 and the prevalence of falls is especially high for patients suffering from neurological diseases like Parkinson's disease (PD). Due to advancements in wearable sensor technology, inertial measurement units (IMUs) can be integrated unobtrusively into patients' everyday lives to monitor various mobility and gait parameters, which are related to common risk factors like reduced balance and reduced lower-limb muscle strength, or lower range of joints. Although stair ambulation is a fundamental part of our daily lives and is known for its unique challenges for the gait and balance system, long-term gait analysis studies have not investigated real-world stair ambulation parameters yet. Therefore, we applied a recently published gait analysis pipeline on real-world foot-worn IMU data of 40 PD patients over a recording period of two weeks to extract objective gait parameters from level walking but also from stair ascending and stair descending gait. In combination with fall records from a prospective three-month follow-up phase, we investigated group differences in gait parameters of future fallers compared to non-fallers for each individual gait activity. We found significant differences in stair ascending and descending parameters. Stance time was increased by up to 20% and gait speed reduced by up to 16% for fallers compared to non-fallers during stair walking. These differences were not present in level walking parameters. Hence, these results suggest that real-world stair ambulation provides sensitive parameters for mobility and fall risk due to the unique challenges stairs add to the balance and control system. Our work complements existing gait analysis studies by adding new insights into mobility and gait performance during real-world gait.

Do We Walk Differently at Home? A Context-Aware Gait Analysis System in Continuous Real-World Environments

Driven by the advancements of wearable sensors and signal processing algorithms, studies on continuous real-world monitoring are of major interest in the field of clinical gait and motion analysis. While real-world studies enable a more detailed and realistic insight into various mobility parameters such as walking speed, confounding and environmental factors might skew those digital mobility outcomes (DMOs), making the interpretation of results challenging. To consider confounding factors, context information needs to be included in the analysis. In this work, we present a context-aware mobile gait analysis system that can distinguish between gait recorded at home and not at home based on Bluetooth proximity information. The system was evaluated on 9 healthy subjects and 6 Parkinsons disease (PD) patients. The classification of the at home/not at home context reached an average F1-score of 98.2 ± 3.2 %. A context-aware analysis of gait parameters revealed different walking bout length distributions between the two environmental conditions. Furthermore, a reduction of gait speed within the at home context compared to walking not at home of 8.9 ± 9.4 % and 8.7 ±5.9 % on average for healthy and PD subjects was found, respectively. Our results indicate the influence of the recording environment on DMOs and, therefore, emphasize the importance of context in the analysis of continuous motion data. Hence, the presented work contributes to a better understanding of confounding factors for future real-world studies.

Detection of Unsupervised Standardized Gait Tests From Real-World Inertial Sensor Data in Parkinson's Disease

Gait tests as part of home monitoring study protocols for patients with movement disorders may provide valuable standardized anchor-points for real-world gait analysis using inertial measurement units (IMUs). However, analyzing unsupervised gait tests relies on reliable test annotations by the patients requiring a potentially error-prone interaction with the recording system. To overcome this limitation, this work presents a novel algorithmic pipeline for the automated detection of unsupervised standardized gait tests from continuous real-world IMU data. In a study with twelve Parkinson's disease patients, we recorded real-world gait data over two weeks using foot-worn IMUs. During continuous daily recordings, the participants performed series of three consecutive 4×10 -Meters-Walking-Tests ( 4×10 MWTs) at different walking speeds, besides their usual daily-living activities. The algorithm first detected these gait test series using a gait sequence detection algorithm, a peak enhancement pipeline, and subsequence Dynamic Time Warping and then decomposed them into single 4×10 MWTs based on the walking speed. In the evaluation with 419 available gait test series, the detection reached an F1-score of 88.9% and the decomposition an F1-score of 94.0%. A concurrent validity evaluation revealed very good agreement between spatio-temporal gait parameters derived from manually labelled and automatically detected 4×10 MWTs. Our algorithm allows to remove the burden of system interaction from the patients and reduces the time for manual data annotation for researchers. The study contributes to an improved automated processing of real-world IMU gait data and enables a simple integration of standardized tests into continuous long-term recordings. This will help to bridge the gap between supervised and unsupervised gait assessment.

The Contribution of Machine Learning in the Validation of Commercial Wearable Sensors for Gait Monitoring in Patients: A Systematic Review

Gait, balance, and coordination are important in the development of chronic disease, but the ability to accurately assess these in the daily lives of patients may be limited by traditional biased assessment tools. Wearable sensors offer the possibility of minimizing the main limitations of traditional assessment tools by generating quantitative data on a regular basis, which can greatly improve the home monitoring of patients. However, these commercial sensors must be validated in this context with rigorous validation methods. This scoping review summarizes the state-of-the-art between 2010 and 2020 in terms of the use of commercial wearable devices for gait monitoring in patients. For this specific period, 10 databases were searched and 564 records were retrieved from the associated search. This scoping review included 70 studies investigating one or more wearable sensors used to automatically track patient gait in the field. The majority of studies (95%) utilized accelerometers either by itself (N = 17 of 70) or embedded into a device (N = 57 of 70) and/or gyroscopes (51%) to automatically monitor gait via wearable sensors. All of the studies (N = 70) used one or more validation methods in which “ground truth” data were reported. Regarding the validation of wearable sensors, studies using machine learning have become more numerous since 2010, at 17% of included studies. This scoping review highlights the current state of the ability of commercial sensors to enhance traditional methods of gait assessment by passively monitoring gait in daily life, over long periods of time, and with minimal user interaction. Considering our review of the last 10 years in this field, machine learning approaches are algorithms to be considered for the future. These are in fact data-based approaches which, as long as the data collected are numerous, annotated, and representative, allow for the training of an effective model. In this context, commercial wearable sensors allowing for increased data collection and good patient adherence through efforts of miniaturization, energy consumption, and comfort will contribute to its future success.

Hidden Markov Model based stride segmentation on unsupervised free-living gait data in Parkinson's disease patients

Background

To objectively assess a patient’s gait, a robust identification of stride borders is one of the first steps in inertial sensor-based mobile gait analysis pipelines. While many different methods for stride segmentation have been presented in the literature, an out-of-lab evaluation of respective algorithms on free-living gait is still missing.

Method

To address this issue, we present a comprehensive free-living evaluation dataset, including 146.574 semi-automatic labeled strides of 28 Parkinson’s Disease patients. This dataset was used to evaluate the segmentation performance of a new Hidden Markov Model (HMM) based stride segmentation approach compared to an available dynamic time warping (DTW) based method.

Results

The proposed HMM achieved a mean F1-score of 92.1% and outperformed the DTW approach significantly. Further analysis revealed a dependency of segmentation performance to the number of strides within respective walking bouts. Shorter bouts (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$< 30$$\end{document}<30 strides) resulted in worse performance, which could be related to more heterogeneous gait and an increased diversity of different stride types in short free-living walking bouts. In contrast, the HMM reached F1-scores of more than 96.2% for longer bouts (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$> 50$$\end{document}>50 strides). Furthermore, we showed that an HMM, which was trained on at-lab data only, could be transferred to a free-living context with a negligible decrease in performance.

Conclusion

The generalizability of the proposed HMM is a promising feature, as fully labeled free-living training data might not be available for many applications. To the best of our knowledge, this is the first evaluation of stride segmentation performance on a large scale free-living dataset. Our proposed HMM-based approach was able to address the increased complexity of free-living gait data, and thus will help to enable a robust assessment of stride parameters in future free-living gait analysis applications.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12984-021-00883-7.

An Intelligent In-Shoe System for Gait Monitoring and Analysis with Optimized Sampling and Real-Time Visualization Capabilities

The deterioration of gait can be used as a biomarker for ageing and neurological diseases. Continuous gait monitoring and analysis are essential for early deficit detection and personalized rehabilitation. The use of mobile and wearable inertial sensor systems for gait monitoring and analysis have been well explored with promising results in the literature. However, most of these studies focus on technologies for the assessment of gait characteristics, few of them have considered the data acquisition bandwidth of the sensing system. Inadequate sampling frequency will sacrifice signal fidelity, thus leading to an inaccurate estimation especially for spatial gait parameters. In this work, we developed an inertial sensor based in-shoe gait analysis system for real-time gait monitoring and investigated the optimal sampling frequency to capture all the information on walking patterns. An exploratory validation study was performed using an optical motion capture system on four healthy adult subjects, where each person underwent five walking sessions, giving a total of 20 sessions. Percentage mean absolute errors (MAE%) obtained in stride time, stride length, stride velocity, and cadence while walking were 1.19%, 1.68%, 2.08%, and 1.23%, respectively. In addition, an eigenanalysis based graphical descriptor from raw gait cycle signals was proposed as a new gait metric that can be quantified by principal component analysis to differentiate gait patterns, which has great potential to be used as a powerful analytical tool for gait disorder diagnostics.

Robust Step Detection from Different Waist-Worn Sensor Positions: Implications for Clinical Studies

Analyzing human gait with inertial sensors provides valuable insights into a wide range of health impairments, including many musculoskeletal and neurological diseases. A representative and reliable assessment of gait requires continuous monitoring over long periods and ideally takes place in the subjects' habitual environment (real-world). An inconsistent sensor wearing position can affect gait characterization and influence clinical study results, thus clinical study protocols are typically highly proscriptive, instructing all participants to wear the sensor in a uniform manner. This restrictive approach improves data quality but reduces overall adherence. In this work, we analyze the impact of altering the sensor wearing position around the waist on sensor signal and step detection. We demonstrate that an asymmetrically worn sensor leads to additional odd-harmonic frequency components in the frequency spectrum. We propose a robust solution for step detection based on autocorrelation to overcome sensor position variation (sensitivity = 0.99, precision = 0.99). The proposed solution reduces the impact of inconsistent sensor positioning on gait characterization in clinical studies, thus providing more flexibility to protocol implementation and more freedom to participants to wear the sensor in the position most comfortable to them. This work is a first step towards truly position-agnostic gait assessment in clinical settings.

Gait event detection using a thigh-worn accelerometer

BACKGROUND

Gait event detection is critical for remote gait analysis. Algorithms using a thigh-worn accelerometer for estimating spatiotemporal gait variables have demonstrated clinical utility in monitoring the gait of patients with gait and balance impairment. However, one may obtain accurate estimates of spatiotemporal variables, but with biased estimates of foot contact and foot off events. Some biomechanical analyses depend on accurate gait phase segmentation, but previous studies using a thigh-worn accelerometer have not quantified the error in estimating foot contact and foot off events.

METHODS

Gait events and spatiotemporal gait variables were estimated using a thigh-worn accelerometer from 32 healthy subjects across a range of walking speeds (0.56-1.78 m/s). Ground truth estimates were obtained using vertical ground reaction forces measured using a pressure treadmill. Estimation performance was quantified using absolute error, root mean square error, and correlation analysis.

RESULTS

Across all strides (N = 3,898), the absolute error in estimating foot contact, foot off, stride time, stance time, and swing time was similar to other accelerometer-based techniques (39 ± 28 ms, 28 ± 28 ms, 11 ± 14 ms, 46 ± 31 ms, and 45 ± 30 ms, respectively). The correlation between reference measurements and estimates of bout-average stride time, stance time, and swing time were 1.00, 0.92, and 0.80, respectively. The (5th, 95th) percentiles of the foot contact and foot off estimation errors were (-91 ms, 51 ms) and (-70 ms, 60 ms), the largest of which amounts to about three samples using the 31.25 Hz sampling frequency used in this study.

SIGNIFICANCE

Use of the proposed algorithm for estimating spatiotemporal gait variables is supported by the strong correlations with reference measurements. The gait event estimation error distributions provide bounds on the estimated gait events for enforcing gait phase-dependent task constraints for biomechanical analysis.