Smoother-Based 3-D Foot Trajectory Estimation Using Inertial Sensors

Enhancing accuracy and convenience of golf swing tracking with a wrist-worn single inertial sensor

In this study, we address two technical challenges to enhance golf swing trajectory accuracy using a wrist-worn inertial sensor: orientation estimation and drift error mitigation. We extrapolated consistent sensor orientation from specific address-phase signal segments and trained the estimation with a convolutional neural network. We then mitigated drift error by applying a constraint on wrist speed at the address, backswing top, and finish, and ensuring that the wrist's finish displacement aligns with a virtual circle on the 3D swing plane. To verify the proposed methods, we gathered data from twenty male right-handed golfers, including professionals and amateurs, using a driver and a 7-iron. The orientation estimation error was about 60% of the baseline, comparable to studies requiring additional sensor information or calibration poses. The drift error was halved and the single-inertial-sensor tracking performance across all swing phases was about 17 cm, on par with multimodal approaches. This study introduces a novel signal processing method for tracking rapid, wide-ranging motions, such as a golf swing, while maintaining user convenience. Our results could impact the burgeoning field of daily motion monitoring for health care, especially with the increasing prevalence of wearable devices like smartwatches.

Recent Trends and Practices Toward Assessment and Rehabilitation of Neurodegenerative Disorders: Insights From Human Gait

The study of human movement and biomechanics forms an integral part of various clinical assessments and provides valuable information toward diagnosing neurodegenerative disorders where the motor symptoms predominate. Conventional gait and postural balance analysis techniques like force platforms, motion cameras, etc., are complex, expensive equipment requiring specialist operators, thereby posing a significant challenge toward translation to the clinics. The current manuscript presents an overview and relevant literature summarizing the umbrella of factors associated with neurodegenerative disorder management: from the pathogenesis and motor symptoms of commonly occurring disorders to current alternate practices toward its quantification and mitigation. This article reviews recent advances in technologies and methodologies for managing important neurodegenerative gait and balance disorders, emphasizing assessment and rehabilitation/assistance. The review predominantly focuses on the application of inertial sensors toward various facets of gait analysis, including event detection, spatiotemporal gait parameter measurement, estimation of joint kinematics, and postural balance analysis. In addition, the use of other sensing principles such as foot-force interaction measurement, electromyography techniques, electrogoniometers, force-myography, ultrasonic, piezoelectric, and microphone sensors has also been explored. The review also examined the commercially available wearable gait analysis systems. Additionally, a summary of recent progress in therapeutic approaches, viz., wearables, virtual reality (VR), and phytochemical compounds, has also been presented, explicitly targeting the neuro-motor and functional impairments associated with these disorders. Efforts toward therapeutic and functional rehabilitation through VR, wearables, and different phytochemical compounds are presented using recent examples of research across the commonly occurring neurodegenerative conditions [viz., Parkinson's disease (PD), Alzheimer's disease (AD), multiple sclerosis, Huntington's disease (HD), and amyotrophic lateral sclerosis (ALS)]. Studies exploring the potential role of Phyto compounds in mitigating commonly associated neurodegenerative pathologies such as mitochondrial dysfunction, α-synuclein accumulation, imbalance of free radicals, etc., are also discussed in breadth. Parameters such as joint angles, plantar pressure, and muscle force can be measured using portable and wearable sensors like accelerometers, gyroscopes, footswitches, force sensors, etc. Kinetic foot insoles and inertial measurement tools are widely explored for studying kinematic and kinetic parameters associated with gait. With advanced correlation algorithms and extensive RCTs, such measurement techniques can be an effective clinical and home-based monitoring and rehabilitation tool for neuro-impaired gait. As evident from the present literature, although the vast majority of works reported are not clinically and extensively validated to derive a firm conclusion about the effectiveness of such techniques, wearable sensors present a promising impact toward dealing with neurodegenerative motor disorders.

A Probability Distribution Model-Based Approach for Foot Placement Prediction in the Early Swing Phase With a Wearable IMU Sensor

Predicting the next foot placement of humans during walking can help improve compliant interactions between humans and walking aid robots. Previous studies have focused on foot placement estimation with wearable inertial sensors after heel-strike, but few have predicted foot placements in advance during the early swing phase. In this study, a Bayesian inference-based foot placement prediction approach was proposed. Possible foot placements were modeled as a probability distribution grid map. With selected foot motion feature events detected sequentially in the early swing phase, the foot placement probability map could be updated iteratively using the feature models we built. The weighted center of the probability distribution was regarded as the predicted foot placement. Prediction errors were evaluated with collected walking data sets. When testing with the data from inertial measurement units, the prediction errors were (5.46 cm ± 10.89 cm, -0.83 cm ± 10.56 cm) for cross-velocity walking data and (-4.99 cm ± 12.31 cm, -11.27 cm ± 7.74 cm) for cross-subject-cross-velocity walking data. The results were comparable to previous works yet the prediction could be made earlier. For the subject who walked with more stable gaits, the prediction error can be further decreased. The proposed foot placement prediction approach can be utilized to help walking aid robots adjust their pose before each heel-strike event during walking, which will make human-robot interactions more compliant. This study is also expected to inspire additional probabilistic gait analysis works.

Sparse Visual-Inertial Measurement Units Placement for Gait Kinematics Assessment

This study investigates the possibility of estimating lower-limb joint kinematics and meaningful performance indexes for physiotherapists, during gait on a treadmill based on data collected from a sparse placement of new Visual Inertial Measurement Units (VIMU) and the use of an Extended Kalman Filter (EKF). The proposed EKF takes advantage of the biomechanics of the human body and of the investigated task to reduce sensor inaccuracies. Two state-vector formulations, one based on the use of constant acceleration model and one based on Fourier series, and the tuning of their corresponding parameters were analyzed. The constant acceleration model, due to its inherent inconsistency for human motion, required a cumbersome optimisation process and needed the a-priori knowledge of reference joint trajectories for EKF parameters tuning. On the other hand, the Fourier series formulation could be used without a specific parameters tuning process. In both cases, the average root mean square difference and correlation coefficient between the estimated joint angles and those reconstructed with a reference stereophotogrammetric system was 3.5deg and 0.70, respectively. Moreover, the stride lengths were estimated with a normalized root mean square difference inferior to 2% when using the forward kinematics model receiving as input the estimated joint angles. The popular gait deviation index was also estimated and showed similar results very close to 100, using both the proposed method and the reference stereophotogrammetric system. Such consistency was obtained using only three wireless and affordable VIMU located at the pelvis and both heels and tracked using two affordable RGB cameras. Being further easy-to-use and suitable for applications taking place outside of the laboratory, the proposed method thus represents a good compromise between accurate reference stereophotogrammetric systems and markerless ones for which accuracy is still under debate.

A Subvision System for Enhancing the Environmental Adaptability of the Powered Transfemoral Prosthesis

Visual information is indispensable to human locomotion in complex environments. Although amputees can perceive the environmental information by eyes, they cannot transmit the neural signals to prostheses directly. To augment human-prosthesis interaction, this article introduces a subvision system that can perceive environments actively, assist to control the powered prosthesis predictively, and accordingly reconstruct a complete vision-locomotion loop for transfemoral amputees. By using deep learning, the subvision system can classify common static terrains (e.g., level ground, stairs, and ramps) and estimate corresponding motion intents of amputees with high accuracy (98%). After applying the subvision system to the locomotion control system, the powered prosthesis can help amputees to achieve nonrhythmic locomotion naturally, including switching between different locomotion modes and crossing the obstacle. The subvision system can also recognize dynamic objects, such as an unexpected obstacle approaching the amputee, and assist in generating an agile obstacle-avoidance reflex movement. The experimental results demonstrate that the subvision system can cooperate with the powered prosthesis to reconstruct a complete vision-locomotion loop, which enhances the environmental adaptability of the amputees.

Abnormal Gait Detection Using Wearable Hall-Effect Sensors

Abnormalities and irregularities in walking (gait) are predictors and indicators of both disease and injury. Gait has traditionally been monitored and analyzed in clinical settings using complex video (camera-based) systems, pressure mats, or a combination thereof. Wearable gait sensors offer the opportunity to collect data in natural settings and to complement data collected in clinical settings, thereby offering the potential to improve quality of care and diagnosis for those whose gait varies from healthy patterns of movement. This paper presents a gait monitoring system designed to be worn on the inner knee or upper thigh. It consists of low-power Hall-effect sensors positioned on one leg and a compact magnet positioned on the opposite leg. Wireless data collected from the sensor system were used to analyze stride width, stride width variability, cadence, and cadence variability for four different individuals engaged in normal gait, two types of abnormal gait, and two types of irregular gait. Using leg gap variability as a proxy for stride width variability, 81% of abnormal or irregular strides were accurately identified as different from normal stride. Cadence was surprisingly 100% accurate in identifying strides which strayed from normal, but variability in cadence provided no useful information. This highly sensitive, non-contact Hall-effect sensing method for gait monitoring offers the possibility for detecting visually imperceptible gait variability in natural settings. These nuanced changes in gait are valuable for predicting early stages of disease and also for indicating progress in recovering from injury.

Unsupervised Cross-Subject Adaptation for Predicting Human Locomotion Intent

Accurately predicting human locomotion intent is beneficial in controlling wearable robots and in assisting humans to walk smoothly on different terrains. Traditional methods for predicting human locomotion intent require collecting and labeling the human signals, and training specific classifiers for each new subject, which introduce a heavy burden on both the subject and the researcher. In addressing this issue, the present study liberates the subject and the researcher from labeling a large amount of data, by incorporating an unsupervised cross-subject adaptation method to predict the locomotion intent of a target subject whose signals are not labeled. The adaptation is realized by designing two classifiers to maximize the classification discrepancy and a feature generator to align the hidden features of the source and the target subjects to minimize the classification discrepancy. A neural network is trained by the labeled training set of source subjects and the unlabeled training set of target subjects. Then it is validated and tested on the validation set and the test set of target subjects. Experimental results in the leave-one-subject-out test indicate that the present method can classify the locomotion intent and activities of target subjects at the averaged accuracy of 93.60% and 94.59% on two public datasets. The present method increases the user-independence of the classifiers, but it has been evaluated only on the data of subjects without disabilities. The potential of the present method to predict the locomotion intent of subjects with disabilities and control the wearable robots will be evaluated in future work.

Accurate Ambulatory Gait Analysis in Walking and Running Using Machine Learning Models

Wearable sensors have been proposed as alternatives to traditional laboratory equipment for low-cost and portable real-time gait analysis in unconstrained environments. However, the moderate accuracy of these systems currently limits their widespread use. In this paper, we show that support vector regression (SVR) models can be used to extract accurate estimates of fundamental gait parameters (i.e., stride length, velocity, and foot clearance), from custom-engineered instrumented insoles (SportSole) during walking and running tasks. Additionally, these learning-based models are robust to inter-subject variability, thereby making it unnecessary to collect subject-specific training data. Gait analysis was performed in N=14 healthy subjects during two separate sessions, each including 6-minute bouts of treadmill walking and running at different speeds (i.e., 85% and 115% of each subject's preferred speed). Gait metrics were simultaneously measured with the instrumented insoles and with reference laboratory equipment. SVR models yielded excellent intraclass correlation coefficients (ICC) in all the gait parameters analyzed. Percentage mean absolute errors (MAE%) in stride length, velocity, and foot clearance obtained with SVR models were 1.37%±0.49%, 1.23%±0.27%, and 2.08%±0.72% for walking, 2.59%±0.64%, 2.91%±0.85%, and 5.13%±1.52% for running, respectively. These findings provide evidence that machine learning regression is a promising new approach to improve the accuracy of wearable sensors for gait analysis.

Sequential Decision Fusion for Environmental Classification in Assistive Walking

Powered prostheses are effective for helping amputees walk in a single environment, but these devices are inconvenient to use in complex environments. In order to help amputees walk in complex environments, prostheses need to understand the motion intent of amputees. Recently, researchers have found that vision sensors can be utilized to classify environments and predict the motion intent of amputees. Although previous studies have been able to classify environments accurately in offline analysis, the corresponding time delay has not been considered. To increase the accuracy and decrease the time delay of environmental classification, the present paper proposes a new decision fusion method. In this method, the sequential decisions of environmental classification are fused by constructing a hidden Markov model and designing a transition probability matrix. The developed method is evaluated by inviting five able-bodied subjects and three amputees to perform indoor and outdoor walking experiments. The results indicate that the proposed method can classify environments with accuracy improvements of 1.01% (indoor) and 2.48% (outdoor) over the previous voting method when a delay of only one frame is incorporated. The present method also achieves higher classification accuracy than with the methods of recurrent neural network (RNN), long-short term memory (LSTM), and gated recurrent unit (GRU). When achieving the same classification accuracy, the method of the present paper can decrease the time delay by 67 ms (indoor) and 733 ms (outdoor) in comparison to the previous voting method. Besides classifying environments, the proposed decision fusion method may be able to optimize the sequential predictions of the human motion intent.