Development of gait segmentation methods for wearable foot pressure sensors

A Low-Cost Instrumented Shoe System for Gait Phase Detection Based on Foot Plantar Pressure Data

This paper presents a novel low-cost and fully-portable instrumented shoe system for gait phase detection. The instrumented shoe consists of 174 independent sensing units constructed based on an off-the-shelf force-sensitive film known as the Velostat conductive copolymer. A zero potential method was implemented to address the crosstalk effect among the matrix-formed sensing arrays. A customized algorithm for gait event and phase detection was developed to estimate stance sub-phases including initial contact, flat foot, and push off. Experiments were carried out to evaluate the performance of the proposed instrumented shoe system in gait phase detection for both straight-line walking and turning walking. The results showed that the mean absolute time differences between the estimated phases by the proposed instrumented shoe system and the reference measurement ranged from 45 to 58 ms during straight-line walking and from 51 to 77 ms during turning walking, which were comparable to the state of art.Clinical and Translational Impact Statement-By allowing convenient gait monitoring in home healthcare settings, the proposed system enables extensive ADL data collection and facilitates developing effective treatment and rehabilitation strategies for patients with movement disorders.

Predicting vertical ground reaction forces from 3D accelerometry using reservoir computers leads to accurate gait event detection

Accelerometers are low-cost measurement devices that can readily be used outside the lab. However, determining isolated gait events from accelerometer signals, especially foot-off events during running, is an open problem. We outline a two-step approach where machine learning serves to predict vertical ground reaction forces from accelerometer signals, followed by force-based event detection. We collected shank accelerometer signals and ground reaction forces from 21 adults during comfortable walking and running on an instrumented treadmill. We trained one common reservoir computer using segmented data using both walking and running data. Despite being trained on just a small number of strides, this reservoir computer predicted vertical ground reaction forces in continuous gait with high quality. The subsequent foot contact and foot off event detection proved highly accurate when compared to the gold standard based on co-registered ground reaction forces. Our proof-of-concept illustrates the capacity of combining accelerometry with machine learning for detecting isolated gait events irrespective of mode of locomotion.

Petri net transition times as training features for multiclass models to support the detection of neurodegenerative diseases

This paper proposes the transition times of Petri net models of human gait as training features for multiclass random forests (RFs) and classification trees (CTs). These models are designed to support screening for neurodegenerative diseases. The proposed Petri net describes gait in terms of nine cyclic phases and the timing of the nine events that mark the transition between phases. Since the transition times between strides vary, each is represented as a random variable characterized by its mean and standard deviation. These transition times are calculated using the PhysioNet database of vertical ground reaction forces (VGRFs) generated by feet-ground contact. This database comprises the VGRFs of four groups: amyotrophic lateral sclerosis, the control group, Huntington's disease, and Parkinson disease. The RF produced an overall classification accuracy of 91%, and the specificities and sensitivities for each class were between 80% and 100%. However, despite this high performance, the RF-generated models demonstrated lack of interpretability prompted the training of a CT using identical features. The obtained tree comprised only four features and required a maximum of three comparisons. However, this simplification dramatically reduced the overall accuracy from 90.6% to 62.3%. The proposed set features were compared with those included in PhysioNet database of VGRFs. In terms of both the RF and CT, more accurate models were established using our features than those of the PhysioNet.

Recent Trends and Practices Toward Assessment and Rehabilitation of Neurodegenerative Disorders: Insights From Human Gait

The study of human movement and biomechanics forms an integral part of various clinical assessments and provides valuable information toward diagnosing neurodegenerative disorders where the motor symptoms predominate. Conventional gait and postural balance analysis techniques like force platforms, motion cameras, etc., are complex, expensive equipment requiring specialist operators, thereby posing a significant challenge toward translation to the clinics. The current manuscript presents an overview and relevant literature summarizing the umbrella of factors associated with neurodegenerative disorder management: from the pathogenesis and motor symptoms of commonly occurring disorders to current alternate practices toward its quantification and mitigation. This article reviews recent advances in technologies and methodologies for managing important neurodegenerative gait and balance disorders, emphasizing assessment and rehabilitation/assistance. The review predominantly focuses on the application of inertial sensors toward various facets of gait analysis, including event detection, spatiotemporal gait parameter measurement, estimation of joint kinematics, and postural balance analysis. In addition, the use of other sensing principles such as foot-force interaction measurement, electromyography techniques, electrogoniometers, force-myography, ultrasonic, piezoelectric, and microphone sensors has also been explored. The review also examined the commercially available wearable gait analysis systems. Additionally, a summary of recent progress in therapeutic approaches, viz., wearables, virtual reality (VR), and phytochemical compounds, has also been presented, explicitly targeting the neuro-motor and functional impairments associated with these disorders. Efforts toward therapeutic and functional rehabilitation through VR, wearables, and different phytochemical compounds are presented using recent examples of research across the commonly occurring neurodegenerative conditions [viz., Parkinson's disease (PD), Alzheimer's disease (AD), multiple sclerosis, Huntington's disease (HD), and amyotrophic lateral sclerosis (ALS)]. Studies exploring the potential role of Phyto compounds in mitigating commonly associated neurodegenerative pathologies such as mitochondrial dysfunction, α-synuclein accumulation, imbalance of free radicals, etc., are also discussed in breadth. Parameters such as joint angles, plantar pressure, and muscle force can be measured using portable and wearable sensors like accelerometers, gyroscopes, footswitches, force sensors, etc. Kinetic foot insoles and inertial measurement tools are widely explored for studying kinematic and kinetic parameters associated with gait. With advanced correlation algorithms and extensive RCTs, such measurement techniques can be an effective clinical and home-based monitoring and rehabilitation tool for neuro-impaired gait. As evident from the present literature, although the vast majority of works reported are not clinically and extensively validated to derive a firm conclusion about the effectiveness of such techniques, wearable sensors present a promising impact toward dealing with neurodegenerative motor disorders.

Frailty Assessment Using Temporal Gait Characteristics and a Long Short-Term Memory Network

Faced with the rapidly aging world population, frailty has emerged as a major health burden among the elderly. This study aimed to investigate the feasibility of using temporal gait characteristics and a long short-term memory network for assessing frailty. Seventy-four community-dwelling elderly individuals participated in this study. The participants were categorized into three groups by their FRAIL scale: robust, pre-frail, and frail groups. The participants completed a 7-meter walking at the self-selected pace with a gyroscope on each foot. Analyzing the gyroscopic data produced seven temporal gait parameters per each gait cycle. Enumerating six consecutive values of each gait parameter produced the gait sequence features which were used as frailty predictors along with the demographic features. Five-fold cross-validation was applied to 70% of the data, and the remaining 30% were used as test data. An F₁-score of 0.931 was achieved in classifying the robust, pre-frail, and frail groups by the random forest model trained with age, sex, and the outputs of the long short-term memory network-based classifier that used the initial and terminal double-limb support, step, and stride times as inputs. The proposed approach of assessing frailty using the arrhythmic gait pattern of the elderly and machine learning technique is novel and promising. Pioneering a way that self-monitor frailty at home without any help from experts, the study can contribute toearly diagnosis of frailty and make timely medical intervention possible.

Wearable Sensor-Based Real-Time Gait Detection: A Systematic Review

Gait analysis has traditionally been carried out in a laboratory environment using expensive equipment, but, recently, reliable, affordable, and wearable sensors have enabled integration into clinical applications as well as use during activities of daily living. Real-time gait analysis is key to the development of gait rehabilitation techniques and assistive devices such as neuroprostheses. This article presents a systematic review of wearable sensors and techniques used in real-time gait analysis, and their application to pathological gait. From four major scientific databases, we identified 1262 articles of which 113 were analyzed in full-text. We found that heel strike and toe off are the most sought-after gait events. Inertial measurement units (IMU) are the most widely used wearable sensors and the shank and foot are the preferred placements. Insole pressure sensors are the most common sensors for ground-truth validation for IMU-based gait detection. Rule-based techniques relying on threshold or peak detection are the most widely used gait detection method. The heterogeneity of evaluation criteria prevented quantitative performance comparison of all methods. Although most studies predicted that the proposed methods would work on pathological gait, less than one third were validated on such data. Clinical applications of gait detection algorithms were considered, and we recommend a combination of IMU and rule-based methods as an optimal solution.

A Review of Gait Phase Detection Algorithms for Lower Limb Prostheses

Fast and accurate gait phase detection is essential to achieve effective powered lower-limb prostheses and exoskeletons. As the versatility but also the complexity of these robotic devices increases, the research on how to make gait detection algorithms more performant and their sensing devices smaller and more wearable gains interest. A functional gait detection algorithm will improve the precision, stability, and safety of prostheses, and other rehabilitation devices. In the past years the state-of-the-art has advanced significantly in terms of sensors, signal processing, and gait detection algorithms. In this review, we investigate studies and developments in the field of gait event detection methods, more precisely applied to prosthetic devices. We compared advantages and limitations between all the proposed methods and extracted the relevant questions and recommendations about gait detection methods for future developments.

Recognition of Gait Phases with a Single Knee Electrogoniometer: A Deep Learning Approach

Artificial neural networks were satisfactorily implemented for assessing gait events from different walking data. This study aims to propose a novel approach for recognizing gait phases and events, based on deep-learning analysis of only sagittal knee-joint angle measured by a single electrogoniometer per leg. Promising classification/prediction performances have been previously achieved by surface-EMG studies; thus, a further aim is to test if adding electrogoniometer data could improve classification performances of state-of-the-art methods. Gait data are measured in about 10,000 strides from 23 healthy adults, during ground walking. A multi-layer perceptron model is implemented, composed of three hidden layers and a one-dimensional output. Classification/prediction accuracy is tested vs. ground truth represented by foot–floor-contact signals, through samples acquired from subjects not seen during training phase. Average classification-accuracy of 90.6 ± 2.9% and mean absolute value (MAE) of 29.4 ± 13.7 and 99.5 ± 28.9 ms in assessing heel-strike and toe-off timing are achieved in unseen subjects. Improvement of classification-accuracy (four points) and reduction of MAE (at least 35%) are achieved when knee-angle data are used to enhance sEMG-data prediction. Comparison of the two approaches shows as the reduction of set-up complexity implies a worsening of mainly toe-off prediction. Thus, the present electrogoniometer approach is particularly suitable for the classification tasks where only heel-strike event is involved, such as stride recognition, stride-time computation, and identification of toe walking.

Gait Cycle Validation and Segmentation Using Inertial Sensors

In this paper, we develop an algorithm to automatically validate and segment a gait cycle in real time into three gait events, namely midstance, toe-off, and heel-strike, using inertial sensors. We first use the physical models of sensor data obtained from a foot-mounted inertial system to differentiate stationary and moving segments of the sensor data. Next, we develop an optimization routine called sparsity-assisted wavelet denoising (SAWD), which simultaneously combines linear time invariant filters, orthogonal multiresolution representations such as wavelets, and sparsity-based methods, to generate a sparse template of the moving segments of the gyroscope measurements in the sagittal plane for valid gait cycles. Thereafter, to validate any moving segment as a gait cycle, we compute the root-mean-square error between the generated sparse template and the sparse representation of the moving segment of the gyroscope data in the sagittal plane obtained using SAWD. Finally, we find the local minima for the stationary and moving segments of a valid gait cycle to detect the gait events. We compare our proposed method with existing methods, for a fixed threshold, using real data obtained from three groups, namely controls, participants with Parkinson disease, and geriatric participants. Our proposed method demonstrates an average F1 score of 87.78% across all groups for a fixed sampling rate, and an average F1 score of 92.44% across all Parkinson disease participants for a variable sampling rate.

ED-FNN: A New Deep Learning Algorithm to Detect Percentage of the Gait Cycle for Powered Prostheses

Throughout the last decade, a whole new generation of powered transtibial prostheses and exoskeletons has been developed. However, these technologies are limited by a gait phase detection which controls the wearable device as a function of the activities of the wearer. Consequently, gait phase detection is considered to be of great importance, as achieving high detection accuracy will produce a more precise, stable, and safe rehabilitation device. In this paper, we propose a novel gait percent detection algorithm that can predict a full gait cycle discretised within a 1% interval. We called this algorithm an exponentially delayed fully connected neural network (ED-FNN). A dataset was obtained from seven healthy subjects that performed daily walking activities on the flat ground and a 15-degree slope. The signals were taken from only one inertial measurement unit (IMU) attached to the lower shank. The dataset was divided into training and validation datasets for every subject, and the mean square error (MSE) error between the model prediction and the real percentage of the gait was computed. An average MSE of 0.00522 was obtained for every subject in both training and validation sets, and an average MSE of 0.006 for the training set and 0.0116 for the validation set was obtained when combining all subjects' signals together. Although our experiments were conducted in an offline setting, due to the forecasting capabilities of the ED-FNN, our system provides an opportunity to eliminate detection delays for real-time applications.

A Wearable Gait Phase Detection System Based on Force Myography Techniques

(1) Background: Quantitative evaluation of gait parameters can provide useful information for constructing individuals’ gait profile, diagnosing gait abnormalities, and better planning of rehabilitation schemes to restore normal gait pattern. Objective determination of gait phases in a gait cycle is a key requirement in gait analysis applications; (2) Methods: In this study, the feasibility of using a force myography-based technique for a wearable gait phase detection system is explored. In this regard, a force myography band is developed and tested with nine participants walking on a treadmill. The collected force myography data are first examined sample-by-sample and classified into four phases using Linear Discriminant Analysis. The gait phase events are then detected from these classified samples using a set of supervisory rules; (3) Results: The results show that the force myography band can correctly detect more than 99.9% of gait phases with zero insertions and only four deletions over 12,965 gait phase segments. The average temporal error of gait phase detection is 55.2 ms, which translates into 2.1% error with respect to the corresponding labelled stride duration; (4) Conclusions: This proof-of-concept study demonstrates the feasibility of force myography techniques as viable solutions in developing wearable gait phase detection systems.

Smart Annotation of Cyclic Data Using Hierarchical Hidden Markov Models

Cyclic signals are an intrinsic part of daily life, such as human motion and heart activity. The detailed analysis of them is important for clinical applications such as pathological gait analysis and for sports applications such as performance analysis. Labeled training data for algorithms that analyze these cyclic data come at a high annotation cost due to only limited annotations available under laboratory conditions or requiring manual segmentation of the data under less restricted conditions. This paper presents a smart annotation method that reduces this cost of labeling for sensor-based data, which is applicable to data collected outside of strict laboratory conditions. The method uses semi-supervised learning of sections of cyclic data with a known cycle number. A hierarchical hidden Markov model (hHMM) is used, achieving a mean absolute error of 0.041 ± 0.020 s relative to a manually-annotated reference. The resulting model was also used to simultaneously segment and classify continuous, ‘in the wild’ data, demonstrating the applicability of using hHMM, trained on limited data sections, to label a complete dataset. This technique achieved comparable results to its fully-supervised equivalent. Our semi-supervised method has the significant advantage of reduced annotation cost. Furthermore, it reduces the opportunity for human error in the labeling process normally required for training of segmentation algorithms. It also lowers the annotation cost of training a model capable of continuous monitoring of cycle characteristics such as those employed to analyze the progress of movement disorders or analysis of running technique.

Gastrocnemius myoelectric control of a robotic hip exoskeleton

In this paper we present a novel EMG-based assistive control strategy for lower-limb exoskeletons. An active pelvis orthosis (APO) generates torque profiles for the hip flexion motion assistance, according to the Gastrocnemius Medialis EMG signal. The strategy has been tested on one healthy subject: experimental results show that the user is able to reduce his muscular activation when the assistance is switched on with respect to the free walking condition.

Gait Partitioning Methods: A Systematic Review

In the last years, gait phase partitioning has come to be a challenging research topic due to its impact on several applications related to gait technologies. A variety of sensors can be used to feed algorithms for gait phase partitioning, mainly classifiable as wearable or non-wearable. Among wearable sensors, footswitches or foot pressure insoles are generally considered as the gold standard; however, to overcome some inherent limitations of the former, inertial measurement units have become popular in recent decades. Valuable results have been achieved also though electromyography, electroneurography, and ultrasonic sensors. Non-wearable sensors, such as opto-electronic systems along with force platforms, remain the most accurate system to perform gait analysis in an indoor environment. In the present paper we identify, select, and categorize the available methodologies for gait phase detection, analyzing advantages and disadvantages of each solution. Finally, we comparatively examine the obtainable gait phase granularities, the usable computational methodologies and the optimal sensor placements on the targeted body segments.

Providing time-discrete gait information by wearable feedback apparatus for lower-limb amputees: usability and functional validation

Here we describe a novel wearable feedback apparatus for lower-limb amputees. The system is based on three modules: a pressure-sensitive insole for the measurement of the plantar pressure distribution under the prosthetic foot during gait, a computing unit for data processing and gait segmentation, and a set of vibrating elements placed on the thigh skin. The feedback strategy relies on the detection of specific gait-phase transitions of the amputated leg. Vibrating elements are activated in a time-discrete manner, simultaneously with the occurrence of the detected gait-phase transitions. Usability and effectiveness of the apparatus were successfully assessed through an experimental validation involving ten healthy volunteers.

Online phase detection using wearable sensors for walking with a robotic prosthesis

This paper presents a gait phase detection algorithm for providing feedback in walking with a robotic prosthesis. The algorithm utilizes the output signals of a wearable wireless sensory system incorporating sensorized shoe insoles and inertial measurement units attached to body segments. The principle of detecting transitions between gait phases is based on heuristic threshold rules, dividing a steady-state walking stride into four phases. For the evaluation of the algorithm, experiments with three amputees, walking with the robotic prosthesis and wearable sensors, were performed. Results show a high rate of successful detection for all four phases (the average success rate across all subjects >90%). A comparison of the proposed method to an off-line trained algorithm using hidden Markov models reveals a similar performance achieved without the need for learning dataset acquisition and previous model training.

A wireless flexible sensorized insole for gait analysis

This paper introduces the design and development of a novel pressure-sensitive foot insole for real-time monitoring of plantar pressure distribution during walking. The device consists of a flexible insole with 64 pressure-sensitive elements and an integrated electronic board for high-frequency data acquisition, pre-filtering, and wireless transmission to a remote data computing/storing unit. The pressure-sensitive technology is based on an optoelectronic technology developed at Scuola Superiore Sant'Anna. The insole is a low-cost and low-power battery-powered device. The design and development of the device is presented along with its experimental characterization and validation with healthy subjects performing a task of walking at different speeds, and benchmarked against an instrumented force platform.

A modular sensorized mat for monitoring infant posture

We present a novel sensorized mat for monitoring infant's posture through the measure of pressure maps. The pressure-sensitive mat is based on an optoelectronic technology developed in the last few years at Scuola Superiore Sant'Anna: a soft silicone skin cover, which constitutes the mat, participates in the transduction principle and provides the mat with compliance. The device has a modular structure (with a minimum of one and a maximum of six sub-modules, and a total surface area of about 1 m2) that enables dimensional adaptation of the pressure-sensitive area to different specific applications. The system consists of on-board electronics for data collection, pre-elaboration, and transmission to a remote computing unit for analysis and posture classification. In this work we present a complete description of the sensing apparatus along with its experimental characterization and validation with five healthy infants.

A flexible sensor technology for the distributed measurement of interaction pressure

We present a sensor technology for the measure of the physical human-robot interaction pressure developed in the last years at Scuola Superiore Sant'Anna. The system is composed of flexible matrices of opto-electronic sensors covered by a soft silicone cover. This sensory system is completely modular and scalable, allowing one to cover areas of any sizes and shapes, and to measure different pressure ranges. In this work we present the main application areas for this technology. A first generation of the system was used to monitor human-robot interaction in upper- (NEUROExos; Scuola Superiore Sant'Anna) and lower-limb (LOPES; University of Twente) exoskeletons for rehabilitation. A second generation, with increased resolution and wireless connection, was used to develop a pressure-sensitive foot insole and an improved human-robot interaction measurement systems. The experimental characterization of the latter system along with its validation on three healthy subjects is presented here for the first time. A perspective on future uses and development of the technology is finally drafted.