Estimating Lower Limb Kinematics Using a Reduced Wearable Sensor Count

Evaluating the Performance of Joint Angle Estimation Algorithms on an Exoskeleton Mock-Up via a Modular Testing Approach

A common challenge for exoskeleton control is discerning operator intent to provide seamless actuation of the device with the operator. One way to accomplish this is with joint angle estimation algorithms and multiple sensors on the human-machine system. However, the question remains of what can be accomplished with just one sensor. The objective of this study was to deploy a modular testing approach to test the performance of two joint angle estimation models-a kinematic extrapolation algorithm and a Random Forest machine learning algorithm-when each was informed solely with kinematic gait data from a single potentiometer on an ankle exoskeleton mock-up. This study demonstrates (i) the feasibility of implementing a modular approach to exoskeleton mock-up evaluation to promote continuity between testing configurations and (ii) that a Random Forest algorithm yielded lower realized errors of estimated joint angles and a decreased actuation time than the kinematic model when deployed on the physical device.

Model-less prediction filter for adaptive adjustment process noise

In this study, a filtering scheme suitable for high-precision sensors was proposed to extract high-precision sensor information. According to the principle of Kalman gain based on data fusion, a model-less prediction filter with minimum gain measurement noise compensation and process noise posteriori constraint adjustment was developed. In comparison to various Kalman filter methods, the proposed algorithm demonstrated better accuracy in the steady state. The high precision performance and effectiveness of the model-less prediction filter were verified under a digitally controlled linear power supply.

A dataset of asymptomatic human gait and movements obtained from markers, IMUs, insoles and force plates

Human motion capture and analysis could be made easier through the use of wearable devices such as inertial sensors and/or pressure insoles. However, many steps are still needed to reach the performance of optoelectronic systems to compute kinematic parameters. The proposed dataset has been established on 10 asymptomatic adults. Participants were asked to walk at different speeds on a 10-meters walkway in a laboratory and to perform different movements such as squats or knee flexion/extension tasks. Three-dimensional trajectories of 69 reflective markers placed according to a conventional full body markerset, acceleration and angular velocity signals of 8 inertial sensors, pressure signals of 2 insoles, 3D ground reaction forces and moments obtained from 3 force plates were simultaneously recorded. Eight calculated virtual markers related to joint centers were also added to the dataset. This dataset contains a total of 337 trials including static and dynamic tasks for each participant. Its purpose is to enable comparisons between various motion capture systems and stimulate the development of new methods for gait analysis.

A Wearable-Sensor System with AI Technology for Real-Time Biomechanical Feedback Training in Hammer Throw

Developing real-time biomechanical feedback systems for in-field applications will transfer human motor skills' learning/training from subjective (experience-based) to objective (science-based). The translation will greatly improve the efficiency of human motor skills' learning and training. Such a translation is especially indispensable for the hammer-throw training which still relies on coaches' experience/observation and has not seen a new world record since 1986. Therefore, we developed a wearable wireless sensor system combining with artificial intelligence for real-time biomechanical feedback training in hammer throw. A framework was devised for developing such practical wearable systems. A printed circuit board was designed to miniaturize the size of the wearable device, where an Arduino microcontroller, an XBee wireless communication module, an embedded load cell and two micro inertial measurement units (IMUs) could be inserted/connected onto the board. The load cell was for measuring the wire tension, while the two IMUs were for determining the vertical displacements of the wrists and the hip. After calibration, the device returned a mean relative error of 0.87% for the load cell and the accuracy of 6% for the IMUs. Further, two deep neural network models were built to estimate selected joint angles of upper and lower limbs related to limb coordination based on the IMUs' measurements. The estimation errors for both models were within an acceptable range, i.e., approximately ±12° and ±4°, respectively, demonstrating strong correlation existed between the limb coordination and the IMUs' measurements. The results of the current study suggest a remarkable novelty: the difficulty-to-measure human motor skills, especially in those sports involving high speed and complex motor skills, can be tracked by wearable sensors with neglect movement constraints to the athletes. Therefore, the application of artificial intelligence in a wearable system has shown great potential of establishing real-time biomechanical feedback training in various sports. To our best knowledge, this is the first practical research of combing wearables and machine learning to provide biomechanical feedback in hammer throw. Hopefully, more wearable biomechanical feedback systems integrating artificial intelligence would be developed in the future.

Cross-Leg Prediction of Running Kinematics across Various Running Conditions and Drawing from a Minimal Data Set Using a Single Wearable Sensor

The feasibility of prediction of same-limb kinematics using a single inertial measurement unit attached to the same limb has been demonstrated using machine learning. This study was performed to see if a single inertial measurement unit attached to the tibia can predict the opposite leg’s kinematics (cross-leg prediction). It also investigated if there is a minimal or smaller data set in a convolutional neural network model to predict lower extremity running kinematics under other running conditions and with what accuracy for the intra- and inter-participant situations. Ten recreational runners completed running exercises under five conditions, including treadmill running at speeds of 2, 2.5, 3, and 3.5 m/s and level-ground running at their preferred speed. A one-predict-all scheme was adopted to determine which running condition could be used to best predict a participant’s overall running kinematics. Running kinematic predictions were performed for intra- and inter-participant scenarios. Among the tested running conditions, treadmill running at 3 m/s was found to be the optimal condition for accurately predicting running kinematics under other conditions, with R2 values ranging from 0.880 to 0.958 and 0.784 to 0.936 for intra- and inter-participant scenarios, respectively. The feasibility of cross-leg prediction was demonstrated but with significantly lower accuracy than the same leg. The treadmill running condition at 3 m/s showed the highest intra-participant cross-leg prediction accuracy. This study proposes a novel, deep-learning method for predicting running kinematics under different conditions on a small training data set.

An Open-Source and Wearable System for Measuring 3D Human Motion in Real-Time

OBJECTIVE

Analyzing human motion is essential for diagnosing movement disorders and guiding rehabilitation for conditions like osteoarthritis, stroke, and Parkinson's disease. Optical motion capture systems are the standard for estimating kinematics, but the equipment is expensive and requires a predefined space. While wearable sensor systems can estimate kinematics in any environment, existing systems are generally less accurate than optical motion capture. Many wearable sensor systems require a computer in close proximity and use proprietary software, limiting experimental reproducibility.

METHODS

Here, we present OpenSenseRT, an open-source and wearable system that estimates upper and lower extremity kinematics in real time by using inertial measurement units and a portable microcontroller.

RESULTS

We compared the OpenSenseRT system to optical motion capture and found an average RMSE of 4.4 degrees across 5 lower-limb joint angles during three minutes of walking and an average RMSE of 5.6 degrees across 8 upper extremity joint angles during a Fugl-Meyer task. The open-source software and hardware are scalable, tracking 1 to 14 body segments, with one sensor per segment. A musculoskeletal model and inverse kinematics solver estimate Kinematics in real-time. The computation frequency depends on the number of tracked segments, but is sufficient for real-time measurement for many tasks of interest; for example, the system can track 7 segments at 30 Hz in real-time. The system uses off-the-shelf parts costing approximately $100 USD plus $20 for each tracked segment.

SIGNIFICANCE

The OpenSenseRT system is validated against optical motion capture, low-cost, and simple to replicate, enabling movement analysis in clinics, homes, and free-living settings.

Development of an Inexpensive Harnessing System Allowing Independent Gardening for Balance Training for Mobility Impaired Individuals

Balance is key to independent mobility, and poor balance leads to a risk of falling and subsequent injury that can cause self-restriction of activity for older adults. Balance and mobility can be improved through training programs, but many programs are not intensive or engaging enough to sufficiently improve balance while maintaining adherence. As an alternative to traditional balance training, harnessed gardening sessions were conducted in an urban greenhouse as an example of a community activity through which balance and mobility can be trained and/or maintained. An inexpensive multidirectional harness system was developed that can be used as an assistive or rehabilitative device in community, private, and senior center gardens to allow balance or mobility-impaired adults to participate in programming. Two wearable sensor systems were used to measure responses to the system: the Polhemus G4 system measured gardeners’ positions and center of mass relative to the base of support, and ActiGraph activity monitors measured the frequency and intensity of arm movements in garden as compared to home environments. The harnessed gardening system provides a safe environment for intense movement activity and can be used as a rehabilitation device along with wearable sensor systems to monitor ongoing changes.

Sparse Visual-Inertial Measurement Units Placement for Gait Kinematics Assessment

This study investigates the possibility of estimating lower-limb joint kinematics and meaningful performance indexes for physiotherapists, during gait on a treadmill based on data collected from a sparse placement of new Visual Inertial Measurement Units (VIMU) and the use of an Extended Kalman Filter (EKF). The proposed EKF takes advantage of the biomechanics of the human body and of the investigated task to reduce sensor inaccuracies. Two state-vector formulations, one based on the use of constant acceleration model and one based on Fourier series, and the tuning of their corresponding parameters were analyzed. The constant acceleration model, due to its inherent inconsistency for human motion, required a cumbersome optimisation process and needed the a-priori knowledge of reference joint trajectories for EKF parameters tuning. On the other hand, the Fourier series formulation could be used without a specific parameters tuning process. In both cases, the average root mean square difference and correlation coefficient between the estimated joint angles and those reconstructed with a reference stereophotogrammetric system was 3.5deg and 0.70, respectively. Moreover, the stride lengths were estimated with a normalized root mean square difference inferior to 2% when using the forward kinematics model receiving as input the estimated joint angles. The popular gait deviation index was also estimated and showed similar results very close to 100, using both the proposed method and the reference stereophotogrammetric system. Such consistency was obtained using only three wireless and affordable VIMU located at the pelvis and both heels and tracked using two affordable RGB cameras. Being further easy-to-use and suitable for applications taking place outside of the laboratory, the proposed method thus represents a good compromise between accurate reference stereophotogrammetric systems and markerless ones for which accuracy is still under debate.

Comparison between Accelerometer and Gyroscope in Predicting Level-Ground Running Kinematics by Treadmill Running Kinematics Using a Single Wearable Sensor

Wearable sensors facilitate running kinematics analysis of joint kinematics in real running environments. The use of a few sensors or, ideally, a single inertial measurement unit (IMU) is preferable for accurate gait analysis. This study aimed to use a convolutional neural network (CNN) to predict level-ground running kinematics (measured by four IMUs on the lower extremities) by using treadmill running kinematics training data measured using a single IMU on the anteromedial side of the right tibia and to compare the performance of level-ground running kinematics predictions between raw accelerometer and gyroscope data. The CNN model performed regression for intraparticipant and interparticipant scenarios and predicted running kinematics. Ten recreational runners were recruited. Accelerometer and gyroscope data were collected. Intraparticipant and interparticipant R² values of actual and predicted running kinematics ranged from 0.85 to 0.96 and from 0.7 to 0.92, respectively. Normalized root mean squared error values of actual and predicted running kinematics ranged from 3.6% to 10.8% and from 7.4% to 10.8% in intraparticipant and interparticipant tests, respectively. Kinematics predictions in the sagittal plane were found to be better for the knee joint than for the hip joint, and predictions using the gyroscope as the regressor were demonstrated to be significantly better than those using the accelerometer as the regressor.

Joint angle estimation with wavelet neural networks

This paper presents a wavelet neural network (WNN) based method to reduce reliance on wearable kinematic sensors in gait analysis. Wearable kinematic sensors hinder real-time outdoor gait monitoring applications due to drawbacks caused by multiple sensor placements and sensor offset errors. The proposed WNN method uses vertical Ground Reaction Forces (vGRFs) measured from foot kinetic sensors as inputs to estimate ankle, knee, and hip joint angles. Salient vGRF inputs are extracted from primary gait event intervals. These selected gait inputs facilitate future integration with smart insoles for real-time outdoor gait studies. The proposed concept potentially reduces the number of body-mounted kinematics sensors used in gait analysis applications, hence leading to a simplified sensor placement and control circuitry without deteriorating the overall performance.

Estimating Lower Limb Kinematics Using a Lie Group Constrained Extended Kalman Filter with a Reduced Wearable IMU Count and Distance Measurements

Tracking the kinematics of human movement usually requires the use of equipment that constrains the user within a room (e.g., optical motion capture systems), or requires the use of a conspicuous body-worn measurement system (e.g., inertial measurement units (IMUs) attached to each body segment). This paper presents a novel Lie group constrained extended Kalman filter to estimate lower limb kinematics using IMU and inter-IMU distance measurements in a reduced sensor count configuration. The algorithm iterates through the prediction (kinematic equations), measurement (pelvis height assumption/inter-IMU distance measurements, zero velocity update for feet/ankles, flat-floor assumption for feet/ankles, and covariance limiter), and constraint update (formulation of hinged knee joints and ball-and-socket hip joints). The knee and hip joint angle root-mean-square errors in the sagittal plane for straight walking were 7.6±2.6∘ and 6.6±2.7∘, respectively, while the correlation coefficients were 0.95±0.03 and 0.87±0.16, respectively. Furthermore, experiments using simulated inter-IMU distance measurements show that performance improved substantially for dynamic movements, even at large noise levels (σ=0.2 m). However, further validation is recommended with actual distance measurement sensors, such as ultra-wideband ranging sensors.