Predicting Complete Ground Reaction Forces and Moments During Gait With Insole Plantar Pressure Information Using a Wavelet Neural Network

Impact of PCA Pre-Normalization Methods on Ground Reaction Force Estimation Accuracy

Ground reaction force (GRF) components can be estimated using insole pressure sensors. Principal component analysis in conjunction with machine learning (PCA-ML) methods are widely used for this task. PCA reduces dimensionality and requires pre-normalization. In this paper, we evaluated the impact of twelve pre-normalization methods using three PCA-ML methods on the accuracy of GRF component estimation. Accuracy was assessed using laboratory data from gold-standard force plate measurements. Data were collected from nine subjects during slow- and normal-speed walking activities. We tested the ANN (artificial neural network) and LS (least square) methods while also exploring support vector regression (SVR), a method not previously examined in the literature, to the best of our knowledge. In the context of our work, our results suggest that the same normalization method can produce the worst or the best accuracy results, depending on the ML method. For example, the body weight normalization method yields good results for PCA-ANN but the worst performance for PCA-SVR. For PCA-ANN and PCA-LS, the vector standardization normalization method is recommended. For PCA-SVR, the mean method is recommended. The final message is not to define a normalization method a priori independently of the ML method.

Prediction of Three-Directional Ground Reaction Forces during Walking Using a Shoe Sole Sensor System and Machine Learning

We developed a shoe sole sensor system with four high-capacity, compact triaxial force sensors using a nitrogen added chromium strain-sensitive thin film mounted on the sole of a shoe. Walking experiments were performed, including straight walking and turning (side-step and cross-step turning), in six healthy young male participants and two healthy young female participants wearing the sole sensor system. A regression model to predict three-directional ground reaction forces (GRFs) from force sensor outputs was created using multiple linear regression and Gaussian process regression (GPR). The predicted GRF values were compared with the GRF values measured with a force plate. In the model trained on data from the straight walking and turning trials, the percent root-mean-square error (%RMSE) for predicting the GRFs in the anteroposterior and vertical directions was less than 15%, except for the GRF in the mediolateral direction. The model trained separately for straight walking, side-step turning, and cross-step turning showed a %RMSE of less than 15% in all directions in the GPR model, which is considered accurate for practical use.

Predicting vertical and shear ground reaction forces during walking and jogging using wearable plantar pressure insoles

BACKGROUND

The development of plantar pressure insoles has made them a potential replacement for force plates. These wearable devices can measure multiple steps and might be used outside of the lab environment for rehabilitation and evaluation of sport performance. However, they can only measure the vertical force which does not completely represent the vertical ground reaction force. In addition, they are not able to measure shear forces which play an import role in the dynamic performance of individuals. Indirect approaches might be implemented to improve the accuracy of the force estimated by plantar pressure systems.

RESEARCH QUESTION

The aim of this study was to predict the vertical and shear components of ground reaction force from plantar pressure data using recurrent neural networks.

METHODS

Ground reaction force and plantar pressure data were collected from 16 healthy individuals during 10 trials of walking and five trials of jogging using Bertec force plates at 1000 Hz and FScan plantar pressure insoles at 100 Hz. A long short-term memory neural network was built to consider the time dependency of pressure and force data in predictions. The data were split into three subsets of train, to train the model, evaluate, to optimize the model hyperparameters, and test sets, to assess the accuracy of the model predictions.

RESULTS

The results of this study showed that our long short-term memory model could accurately predict the shear and vertical force components during walking and jogging. The predictions were more accurate during walking compared to jogging. In addition, the predictions of mediolateral force had higher error and lower correlation compared to vertical and anteroposterior components.

SIGNIFICANCE

The long short-term memory model developed in this study may be an acceptable option for accurate estimation of ground reaction force during outdoor activities which can have significant impacts in rehabilitation, sport performance, and gaming.

Predicting vertical ground reaction force in rearfoot running: A wavelet neural network model and factor loading

This study proposed a simple method for selecting input variables by factor loading and inputting these variables into a wavelet neural network (WNN) model to predict vertical ground reaction force (vGRF). The kinematic data and vGRF of 9 rearfoot strikers at 12, 14, and 16 km/h were collected using a motion capture system and an instrumented treadmill. The input variables were screened by factor loading and utilized to predict vGRF with the WNN. Nine kinematic variables were selected, corresponding to nine principal components, mainly focusing on the knee and ankle joints. The prediction results of vGRF were effective and accurate at different speeds, namely, the coefficient of multiple correlation (CMC) > 0.98 (0.984-0.988), the normalized root means square error (NRMSE) < 15% (9.34-11.51%). The NRMSEs of impact force (8.18-10.01%), active force (4.92-7.42%), and peak time (7.16-12.52%) were less than 15%. There was a small number (peak, 4.12-6.18%; time, 4.71-6.76%) exceeding the 95% confidence interval (CI) using the Bland-Altman method. The knee joint was the optimal location for estimating vGRF, followed by the ankle. There were high accuracy and agreement for predicting vGRF with the peak and peak time at 12, 14, and 16 km/h. Therefore, factor loading could be a valid method to screen kinematic variables in artificial neural networks.

Machine Learning Strategies for Low-Cost Insole-Based Prediction of Center of Gravity during Gait in Healthy Males

Whole-body center of gravity (CG) movements in relation to the center of pressure (COP) offer insights into the balance control strategies of the human body. Existing CG measurement methods using expensive measurement equipment fixed in a laboratory environment are not intended for continuous monitoring. The development of wireless sensing technology makes it possible to expand the measurement in daily life. The insole system is a wearable device that can evaluate human balance ability by measuring pressure distribution on the ground. In this study, a novel protocol (data preparation and model training) for estimating the 3-axis CG trajectory from vertical plantar pressures was proposed and its performance was evaluated. Input and target data were obtained through gait experiments conducted on 15 adult and 15 elderly males using a self-made insole prototype and optical motion capture system. One gait cycle was divided into four semantic phases. Features specified for each phase were extracted and the CG trajectory was predicted using a bi-directional long short-term memory (Bi-LSTM) network. The performance of the proposed CG prediction model was evaluated by a comparative study with four prediction models having no gait phase segmentation. The CG trajectory calculated with the optoelectronic system was used as a golden standard. The relative root mean square error of the proposed model on the 3-axis of anterior/posterior, medial/lateral, and proximal/distal showed the best prediction performance, with 2.12%, 12.97%, and 12.47%. Biomechanical analysis of two healthy male groups was conducted. A statistically significant difference between CG trajectories of the two groups was shown in the proposed model. Large CG sway of the medial/lateral axis trajectory and CG fall of the proximal/distal axis trajectory is shown in the old group. The protocol proposed in this study is a basic step to have gait analysis in daily life. It is expected to be utilized as a key element for clinical applications.

INSOLE-BASED ESTIMATION OF COMPLETE GROUND REACTION FORCE WITH GAUSSIAN KERNEL REGRESSION AND DATA EXPANSION

A method for estimating ground reaction force (GRF) with plantar pressure was proposed in this paper. The estimation model was constructed to approximate the nonlinear relationships between GRF and the plantar pressure according to the linear combinations of Gaussian kernel functions. Partial least squares regression (PLSR) was adopted to obtain model parameters and eliminate multicollinearity among the pressure components. The general model and subject-specific models were constructed for 12 male and 4 female subjects. Moreover, a data expansion method was introduced for the establishment of subject-specific model, which is implemented by searching and adopting the data with consistent statistical characteristics in a pre-established database. That approach is particularly meaningful for the group whose walking ability is limited or clinic where the force platform is not available. The NRMSEs (%) for general model were 5.27–7.85% (GRF_V), 7.35–8.53% (GRF_ML), and 8.82–10.54% (GRF_AP). The maximum NRMSEs (%) for subject-specific models were 5.02% (GRF_V), 9.91% (GRF_ML), and 10.23% (GRF_AP). Results showed that both general and subject-specific models achieved higher accuracy than existing methods such as linear regression and neural network methods.

Machine Learning Model to Estimate Net Joint Moments during Lifting Task Using Wearable Sensors: A Preliminary Study for Design of Exoskeleton Control System

Accurately measuring the lower extremities and L5/S1 moments is important since L5/S1 moments are the principal parameters that measure the risk of musculoskeletal diseases during lifting. In this study, protocol that predicts lower extremities and L5/S1 moments with an insole sensor was proposed to replace the prior methods that have spatial constraints. The protocol is hierarchically composed of a classification model and a regression model to predict joint moments. Additionally, a single LSTM model was developed to compare with proposed protocol. To optimize hyperparameters of the machine learning model and input feature, Bayesian optimization method was adopted. As a result, the proposed protocol showed a relative root mean square error (rRMSE) of 8.06~13.88% while the single LSTM showed 9.30~18.66% rRMSE. This protocol in this research is expected to be a starting point for developing a system for estimating the lower extremity and L5/S1 moment during lifting that can replace the complex prior method and adopted to workplace environments. This novel study has the potential to precisely design a feedback iterative control system of an exoskeleton for the appropriate generation of an actuator torque.

A narrative review of machine learning as promising revolution in clinical practice of scoliosis

Machine learning (ML), as an advanced domain of artificial intelligence (AI), is progressively changing our view of the world. By implementing its algorithms, our ability to detect previously undiscoverable patterns in data has the potential to revolutionize predictive analytics. Scoliosis, as a relatively specialized branch in the spine field, mainly covers the pediatric, adult and the elderly populations, and its diagnosis and treatment remain difficult. With recent efforts and interdisciplinary cooperation, ML has been widely applied to investigate issues related to scoliosis, and surprisingly augment a surgeon's ability in clinical practice related to scoliosis. Meanwhile, ML models penetrate in every stage of the clinical practice procedure of scoliosis. In this review, we first present a brief description of the application of ML in the clinical practice procedures regarding scoliosis, including screening, diagnosis and classification, surgical decision making, intraoperative manipulation, complication prediction, prognosis prediction and rehabilitation. Meanwhile, the ML models and specific applications adopted are presented. Additionally, current limitations and future directions are briefly discussed regarding its use in the field of scoliosis. We believe that the implementation of ML is a promising revolution to assist surgeons in all aspects of clinical practice related to scoliosis in the near future.

Real-Time Prediction of Joint Forces by Motion Capture and Machine Learning

Conventional biomechanical modelling approaches involve the solution of large systems of equations that encode the complex mathematical representation of human motion and skeletal structure. To improve stability and computational speed, being a common bottleneck in current approaches, we apply machine learning to train surrogate models and to predict in near real-time, previously calculated medial and lateral knee contact forces (KCFs) of 54 young and elderly participants during treadmill walking in a speed range of 3 to 7 km/h. Predictions are obtained by fusing optical motion capture and musculoskeletal modeling-derived kinematic and force variables, into regression models using artificial neural networks (ANNs) and support vector regression (SVR). Training schemes included either data from all subjects (LeaveTrialsOut) or only from a portion of them (LeaveSubjectsOut), in combination with inclusion of ground reaction forces (GRFs) in the dataset or not. Results identify ANNs as the best-performing predictor of KCFs, both in terms of Pearson R (0.89-0.98 for LeaveTrialsOut and 0.45-0.85 for LeaveSubjectsOut) and percentage normalized root mean square error (0.67-2.35 for LeaveTrialsOut and 1.6-5.39 for LeaveSubjectsOut). When GRFs were omitted from the dataset, no substantial decrease in prediction power of both models was observed. Our findings showcase the strength of ANNs to predict simultaneously multi-component KCF during walking at different speeds-even in the absence of GRFs-particularly applicable in real-time applications that make use of knee loading conditions to guide and treat patients.

Enhancing the Accuracy of Vertical Ground Reaction Force Measurement During Walking Using Pressure-Measuring Insoles

Pressure-measuring insoles can be an attractive tool for measuring ground reaction force (GRF) since they are portable and can record multiple consecutive steps. Several researchers have, however, observed that these insoles are less accurate than instrumented force platforms. To address this issue, the authors identified transfer functions that best described each insole size to enhance the measurements of the vertical component of GRF during walking. GRF data were collected from 29 participants (6/23 male/female, 24.3 ± 6.7 yrs, 70.4 ± 23.9 kg, 1.66 ± 0.11 m) using Medilogic® pressure-measuring insoles and Kistler® force platforms for three walking trials. Participants provided the institutionally approved written consent (IRB #724468). The data from both instruments were preprocessed. A subset of the data was used to train the system identification toolbox (matlab) to identify the coefficients of several candidate transfer functions for each insole size. The resulting transfer functions were compared using all available data for each insole to assess which one modified the insole data to be closer to that of the force platform. All tested transfer functions moved the vertical component of GRF closer to the corresponding force platform data. Each insole size had a specific transfer model that that yielded the best results. Using system identification techniques produced transfer functions that, when using insole data of the vertical component of GRF as input, produced output that is comparable to the corresponding measurement using an instrumented force platform.

Estimation of Vertical Ground Reaction Force Using Low-Cost Insole With Force Plate-Free Learning From Single Leg Stance and Walking

For the evaluation of pathological gait, a machine learning-based estimation of the vertical ground reaction force (vGRF) using a low-cost insole is proposed as an alternative to costly force plates. However, learning a model for estimation still relies on the use of force plates, which is not accessible in small clinics and individuals. Therefore, this paper presents a force plate-free learning from a single leg stance (SLS) and natural walking measured only by the insoles. This method used a linear least squares regression that fits insole measurements during SLS to body weight in order to learn a model to estimate vGRF during walking. Constraints were added to the regression so that vGRF estimates during walking were of proper magnitude, and the constraint bounds were newly defined as a linear function of stance duration. Moreover, a lower bound for the estimated vGRF in mid-stance was added to the constraints to enhance estimation accuracy. The vGRF estimated by the proposed method was compared with force platforms for 4 healthy young adults and 13 elderly adults including patients with mild osteoarthritis, knee pain, and valgus hallux. Through the experiments, the proposed learning method had a normalized root mean squared error under 10% for healthy young and elderly adults with stance durations within a certain range (600-800 ms). From these results, the validity of the proposed learning method was verified for various users requiring assessment in the field of medicine and healthcare.

Rapid energy expenditure estimation for ankle assisted and inclined loaded walking

BACKGROUND

Estimating energy expenditure with indirect calorimetry requires expensive equipment and several minutes of data collection for each condition of interest. While several methods estimate energy expenditure using correlation to data from wearable sensors, such as heart rate monitors or accelerometers, their accuracy has not been evaluated for activity conditions or subjects not included in the correlation process. The goal of our study was to develop data-driven models to estimate energy expenditure at intervals of approximately one second and demonstrate their ability to predict energetic cost for new conditions and subjects. Model inputs were muscle activity and vertical ground reaction forces, which are measurable by wearable electromyography electrodes and pressure sensing insoles.

METHODS

We developed models that estimated energy expenditure while walking (1) with ankle exoskeleton assistance and (2) while carrying various loads and walking on inclines. Estimates were made each gait cycle or four second interval. We evaluated the performance of the models for three use cases. The first estimated energy expenditure (in Watts) during walking conditions for subjects with some subject specific training data available. The second estimated all conditions in the dataset for a new subject not included in the training data. The third estimated new conditions for a new subject.

RESULTS

The mean absolute percent errors in estimated energy expenditure during assisted walking conditions were 4.4%, 8.0%, and 8.1% for the three use cases, respectively. The average errors in energy expenditure estimation during inclined and loaded walking conditions were 6.1%, 9.7%, and 11.7% for the three use cases. For models not using subject-specific data, we evaluated the ability to order the magnitude of energy expenditure across conditions. The average percentage of correctly ordered conditions was 63% for assisted walking and 87% for incline and loaded walking.

CONCLUSIONS

We have determined the accuracy of estimating energy expenditure with data-driven models that rely on ground reaction forces and muscle activity for three use cases. For experimental use cases where the accuracy of a data-driven model is sufficient and similar training data is available, standard indirect calorimetry could be replaced. The models, code, and datasets are provided for reproduction and extension of our results.

Insole-Based Estimation of Vertical Ground Reaction Force Using One-Step Learning With Probabilistic Regression and Data Augmentation

An insole-based estimation of the vertical ground reaction force (vGRF) is proposed as an alternative to costly force plates for the evaluation of pathological gait. However, machine learning techniques for estimation still rely on the use of force plates. Moreover, measuring plural walking steps in order to prevent overfitting induces fall risks and physically taxes the patients. Therefore, this paper presents an accessible and efficient learning scheme for the insole-based estimation of vGRF. In this system, we employ a low-cost scale as an alternative to force plates. Then, we use Gaussian process regression (GPR) to learn a model in order to estimate vGRF without overfitting of small-sized data sets corrupted by measurement errors and noise of the devices. In addition, we propose a "one-step learning" scheme based on a probabilistic data augmentation. This approach augments actual measurements of a minimum (just one) walking step to a virtual data set for plural steps by considering their typical variability between steps. In experiments, the GPR models learned from two walking steps estimated vGRF with mean errors of 8% or under for entire/local magnitudes. Moreover, the learning from one step with probabilistic augmentation enhanced the estimation accuracy.

Gait and Dynamic Balance Sensing Using Wearable Foot Sensors

Remote monitoring of gait performance offers possibilities for objective evaluation and tackling impairment in motor ability, gait, and balance in populations, such as elderly, stroke, multiple sclerosis, and Parkinson's. This requires a wearable and unobtrusive system capable of estimating ambulatory gait and balance measures, such as the extrapolated center of mass (XCoM) and dynamicmargin of stability. These estimations require the knowledge of 3-D forces and moments (F&M) and accurate foot positions. Though an existing ambulatory gait and balance system (AGBS) consisting of 3-D F&M sensors and inertial measurement units can be used for the purpose, it is bulky and conspicuous. Resistive pressure sensorswere investigated as an alternative to the onboard 3-D F&M sensors. Subject-specific regression models were built to estimate 3-D F&M from 1-D plantar pressures. The model was applicable for different walking speeds. Different pressure sensor configurations were studied to optimize the system complexity and accuracy. Using resistive sensors only under the toe and heel, we were able to estimate the XCoM with a mean absolute rms error of 2.2 ±0.3 cm in the walking direction while walking at a preferred speed, when compared to the AGBS. For the same case, the XCoM was classified as ahead or behind the base of support correctly at 97.7±1.7%. In conclusion, this paper shows that pressure sensors, minimally under the heel and toe, offer a lightweight and inconspicuous alternative for F&M sensing, toward estimating ambulatory gait and dynamic balance.

Predicting Athlete Ground Reaction Forces and Moments From Spatio-Temporal Driven CNN Models

The accurate prediction of three-dimensional (3-D) ground reaction forces and moments (GRF/Ms) outside the laboratory setting would represent a watershed for on-field biomechanical analysis. To extricate the biomechanist's reliance on ground embedded force plates, this study sought to improve on an earlier partial least squares (PLS) approach by using deep learning to predict 3-D GRF/Ms from legacy marker based motion capture sidestepping trials, ranking multivariate regression of GRF/Ms from five convolutional neural network (CNN) models. In a possible first for biomechanics, tactical feature engineering techniques were used to compress space-time and facilitate fine-tuning from three pretrained CNNs, from which a model derivative of ImageNet called "CaffeNet" achieved the strongest average correlation to ground truth GRF/Ms [Formula: see text] 0.9881 and [Formula: see text] 0.9715 ([Formula: see text] 4.31 and 7.04%). These results demonstrate the power of CNN models to facilitate real-world multivariate regression with practical application for spatio-temporal sports analytics.

Estimation of unmeasured ground reaction force data based on the oscillatory characteristics of the center of mass during human walking

To enhance the wearability of portable motion-monitoring devices, the size and number of sensors are minimized, but at the expense of quality and quantity of data collected. For example, owing to the size and weight of low-frequency force transducers, most currently available wearable gait measurement systems provide only limited, if any, elements of ground reaction force (GRF) data. To obtain the most GRF information possible with a minimal use of sensors, we propose a GRF estimation method based on biomechanical knowledge of human walking. This includes the dynamics of the center of mass (CoM) during steady human gait resembling the oscillatory behaviors of a mass-spring system. Available measurement data were incorporated into a spring-loaded inverted pendulum with translating pivot. The spring stiffness and simulation parameters were tuned to match, as accurately as possible, the available data and oscillatory characteristics of walking. Our results showed that the model simulation estimated reasonably well the unmeasured GRF. Using the vertical GRF and CoP profile for gait speeds ranging from 0.93 to 1.89 m/s, the anterior-posterior (A-P) GRF was estimated and resulted in an average correlation coefficient of R = 0.982 ± 0.009. Even when the ground contact timing and gait speed information were alone available, our method estimated GRFs resulting in R = 0.969 ± 0.022 for the A-P and R = 0.891 ± 0.101 for the vertical GRFs. This research demonstrates that the biomechanical knowledge of human walking, such as inherited oscillatory characteristics of the CoM, can be used to gain unmeasured information regarding human gait dynamics.

Measurement of Walking Ground Reactions in Real-Life Environments: A Systematic Review of Techniques and Technologies

Monitoring natural human gait in real-life environments is essential in many applications, including quantification of disease progression, monitoring the effects of treatment, and monitoring alteration of performance biomarkers in professional sports. Nevertheless, developing reliable and practical techniques and technologies necessary for continuous real-life monitoring of gait is still an open challenge. A systematic review of English-language articles from scientific databases including Scopus, ScienceDirect, Pubmed, IEEE Xplore, EBSCO and MEDLINE were carried out to analyse the ‘accuracy’ and ‘practicality’ of the current techniques and technologies for quantitative measurement of the tri-axial walking ground reactions outside the laboratory environment, and to highlight their strengths and shortcomings. In total, 679 relevant abstracts were identified, 54 full-text papers were included in the paper and the quantitative results of 17 papers were used for meta-analysis and comparison. Three classes of methods were reviewed: (1) methods based on measured kinematic data; (2) methods based on measured plantar pressure; and (3) methods based on direct measurement of ground reactions. It was found that all three classes of methods have competitive accuracy levels with methods based on direct measurement of the ground reactions showing highest accuracy while being least practical for long-term real-life measurement. On the other hand, methods that estimate ground reactions using measured body kinematics show highest practicality of the three classes of methods reviewed. Among the most prominent technical and technological challenges are: (1) reducing the size and price of tri-axial load-cells; (2) improving the accuracy of orientation measurement using IMUs; (3) minimizing the number and optimizing the location of required IMUs for kinematic measurement; (4) increasing the durability of pressure insole sensors, and (5) enhancing the robustness and versatility of the ground reactions estimation methods to include pathological gaits and natural variability of gait in real-life physical environment.

Insole optical fiber Bragg grating sensors network for dynamic vertical force monitoring

In an era of unprecedented progress in technology and increase in population age, continuous and close monitoring of elder citizens and patients is becoming more of a necessity than a luxury. Contributing toward this field and enhancing the life quality of elder citizens and patients with disabilities, this work presents the design and implementation of a noninvasive platform and insole fiber Bragg grating sensors network to monitor the vertical ground reaction forces distribution induced in the foot plantar surface during gait and body center of mass displacements. The acquired measurements are a reliable indication of the accuracy and consistency of the proposed solution in monitoring and mapping the vertical forces active on the foot plantar sole, with a sensitivity up to 11.06 ?? pm / N . The acquired measurements can be used to infer the foot structure and health condition, in addition to anomalies related to spine function and other pathologies (e.g., related to diabetes); also its application in rehabilitation robotics field can dramatically reduce the computational burden of exoskeletons’ control strategy. The proposed technology has the advantages of optical fiber sensing (robustness, noninvasiveness, accuracy, and electromagnetic insensitivity) to surpass all drawbacks verified in traditionally used sensing systems (fragility, instability, and inconsistent feedback).