Hand Pose Estimation by Fusion of Inertial and Magnetic Sensing Aided by a Permanent Magnet

Validation of Inertial Sensing-Based Wearable Device for Tremor and Bradykinesia Quantification

Neurologists judge the severity of Parkinsonian motor symptoms according to clinical scales, and their judgments exist inconsistent because of differences in clinical experience. Correspondingly, inertial sensing-based wearable devices (ISWDs) produce objective and standardized quantifications. However, ISWDs indirectly quantify symptoms by parametric modeling of angular velocities and linear accelerations nd trained by the judgments of several neurologists through supervised learning algorithms. Hence, the ISWD outputs are biased along with the scores provided by neurologists. To investigate the effectiveness ISWDs for Parkinsonian symptoms quantification, technical verification and clinical validation of both tremor and bradykinesia quantification methods were carried out. A total of 45 Parkinson's disease patients and 30 healthy controls performed the tremor and finger-tapping tasks, which were tracked simultaneously by an ISWD and a 6-axis high-precision electromagnetic tracking system (EMTS). The Unified Parkinson's Disease Rating Scale (UPDRS) prescribed parameters obtained from the EMTS, which directly provides linear and rotational displacements, were compared with the scores provided by both the ISWD and seven neurologists. EMTS-based parameters were regarded as the ground truth and were employed to train several common machine learning (ML) algorithms, i.e., support vector machine (SVM), k-nearest neighbors (KNN), and random forest (RF) algorithms. Inconsistency among the scores provided by the neurologists was proven. Besides, the quantification performance (sensitivity, specificity, and accuracy) of the ISWD employed with ML algorithms were better than that of the neurologists. Furthermore, EMTS can be utilized to both modify the quantification algorithms of ISWDs and improve the assessment skills of young neurologists.

Sleeve for Knee Angle Monitoring: An IMU-POF Sensor Fusion System

The knee flexion-extension angle is an important variable to be monitored in various clinical scenarios, for example, during physical rehabilitation assessment. The purpose of this work is to develop and validate a sensor fusion system based on a knee sleeve for monitoring of physical therapy. The system consists of merging data from two inertial measurement units (IMUs) and an intensity-variation based Polymer Optical Fiber (POF) curvature sensor using a quaternion-based Multiplicative Extended Kalman Filter (MEKF). The proposed data fusion method is magnetometer-free and deals with sensors' uncertainties through reliability intervals defined during gait. Walking trials were performed by twelve healthy participants using our knee sleeve system and results were validated against a gold standard motion capture system. Additionally, a comparison with other three knee angle estimation methods, which are exclusively based on IMUs, was carried out. The proposed system presented better performance (mean RMSE 3.3 ^°, LFM coefficients, a₁ = 0.99 ± 0.04, a₀ = 0.70 ± 2.29, R² = 0.98 ± 0.01 and ρ_C 0.99) when compared to the other evaluated methods. Experimental results demonstrate the usability and feasibility of our system to estimate knee motion with high accuracy, repeatability, and reproducibility. This wearable system may be suitable for motion assessment in rehabilitation labs in future studies.

Wearable sensing devices for upper limbs: A systematic review

Wearable sensing devices, which are smart electronic devices that can be worn on the body as implants or accessories, have attracted much research interest in recent years. They are rapidly advancing in terms of technology, functionality, size, and real-time applications along with the fast development of manufacturing technologies and sensor technologies. By covering some of the most important technologies and algorithms of wearable devices, this paper is intended to provide an overview of upper-limb wearable device research and to explore future research trends. The review of the state-of-the-art of upper-limb wearable technologies involving wearable design, sensor technologies, wearable computing algorithms and wearable applications is presented along with a summary of their advantages and disadvantages. Toward the end of this paper, we highlight areas of future research potential. It is our goal that this review will guide future researchers to develop better wearable sensing devices for upper limbs.

Total Variation Regularization of Pose Signals with an Application to 3D Freehand Ultrasound

Three-dimensional freehand imaging techniques are gaining wider adoption due to their ?exibility and cost ef?ciency. Typical examples for such a combination of a tracking system with an imaging device are freehand SPECT or freehand 3D ultrasound. However, the quality of the resulting image data is heavily dependent on the skill of the human operator and on the level of noise of the tracking data. The latter aspect can introduce blur or strong artifacts, which can signi?cantly hamper the interpretation of image data. Unfortunately, the most commonly used tracking systems to date, i.e. optical and electromagnetic, present a trade-off between invading the surgeon's workspace (due to line-of-sight requirements) and higher levels of noise and sensitivity due to the interference of surrounding metallic objects. In this work, we propose a novel approach for total variation regularization of data from tracking systems (which we term pose signals) based on a variational formulation in the manifold of Euclidean transformations. The performance of the proposed approach was evaluated using synthetic data as well as real ultrasound sweeps executed on both a Lego phantom and human anatomy, showing signi?cant improvement in terms of tracking data quality and compounded ultrasound images. Source code can be found at https://github.com/IFL-CAMP/pose_regularization.

An instrumented glove for monitoring hand function

The measurement of hand kinematics is important for the assessment and rehabilitation of the paralysed hand. The traditional method of hand function assessment uses a mechanical or electronic goniometer placed across the joint of interest to measure the range of joint movement. Mechanical goniometers are imprecise and lack the ability to provide a dynamic measurement; electronic goniometers are expensive and cumbersome to use during therapy. An alternative to the goniometric based assessment is to use inertial motion sensors to monitor the hand movement-these can be incorporated in a glove. In this paper, we present the design of an instrumented glove equipped with Magnetic, Angular Rate and Gravity (MARG) sensors for the objective evaluation of hand function. The instrumented glove presented in this paper is designed to assess the range of movement of the hand and also monitor the hand function during the course of hand rehabilitation. Static and dynamic calibrations were performed for the Euler angles calculated from the MARG sensors. The results are also presented for physiological flexion/extension of the wrist (relative roll), flexion/extension of elbow (relative pitch), and internal rotation/external rotation (relative yaw). The static calibration results gave mean absolute errors of 4.1° for roll, 4.0° for pitch, and 4.6° for yaw. From the dynamic calibration, the speed of response to a step change gave a convergence time of 0.4 s; sinusoidally oscillating movement gave good tracking at 0.2 Hz but exhibits overshoot errors at higher frequencies which were tested to be 1 Hz. We present the results of the calibration of the instrumented glove (one sensor pair measuring one joint angle) measuring anatomical joint angles-mean absolute errors during static calibration: 6.3° for a relative roll (wrist flexion/extension), 5.0° for relative pitch (elbow flexion/extension), and 4.5° for relative yaw (shoulder internal rotation/external rotation). The experimental results from the instrumented glove are promising, and it can be used as an alternative to the traditional goniometer based hand function assessments.

An Adaptive Orientation Estimation Method for Magnetic and Inertial Sensors in the Presence of Magnetic Disturbances

Magnetic and inertial sensors have been widely used to estimate the orientation of human segments due to their low cost, compact size and light weight. However, the accuracy of the estimated orientation is easily affected by external factors, especially when the sensor is used in an environment with magnetic disturbances. In this paper, we propose an adaptive method to improve the accuracy of orientation estimations in the presence of magnetic disturbances. The method is based on existing gradient descent algorithms, and it is performed prior to sensor fusion algorithms. The proposed method includes stationary state detection and magnetic disturbance severity determination. The stationary state detection makes this method immune to magnetic disturbances in stationary state, while the magnetic disturbance severity determination helps to determine the credibility of magnetometer data under dynamic conditions, so as to mitigate the negative effect of the magnetic disturbances. The proposed method was validated through experiments performed on a customized three-axis instrumented gimbal with known orientations. The error of the proposed method and the original gradient descent algorithms were calculated and compared. Experimental results demonstrate that in stationary state, the proposed method is completely immune to magnetic disturbances, and in dynamic conditions, the error caused by magnetic disturbance is reduced by 51.2% compared with original MIMU gradient descent algorithm.

Rhythmic Extended Kalman Filter for Gait Rehabilitation Motion Estimation and Segmentation

This paper proposes a method to enable the use of non-intrusive, small, wearable, and wireless sensors to estimate the pose of the lower body during gait and other periodic motions and to extract objective performance measures useful for physiotherapy. The Rhythmic Extended Kalman Filter (Rhythmic-EKF) algorithm is developed to estimate the pose, learn an individualized model of periodic movement over time, and use the learned model to improve pose estimation. The proposed approach learns a canonical dynamical system model of the movement during online observation, which is used to accurately model the acceleration during pose estimation. The canonical dynamical system models the motion as a periodic signal. The estimated phase and frequency of the motion also allow the proposed approach to segment the motion into repetitions and extract useful features, such as gait symmetry, step length, and mean joint movement and variance. The algorithm is shown to outperform the extended Kalman filter in simulation, on healthy participant data, and stroke patient data. For the healthy participant marching dataset, the Rhythmic-EKF improves joint acceleration and velocity estimates over regular EKF by 40% and 37%, respectively, estimates joint angles with 2.4° root mean squared error, and segments the motion into repetitions with 96% accuracy.

Wearable Goniometer and Accelerometer Sensory Fusion for Knee Joint Angle Measurement in Daily Life

Human motion analysis is crucial for a wide range of applications and disciplines. The development and validation of low cost and unobtrusive sensing systems for ambulatory motion detection is still an open issue. Inertial measurement systems and e-textile sensors are emerging as potential technologies for daily life situations. We developed and conducted a preliminary evaluation of an innovative sensing concept that combines e-textiles and tri-axial accelerometers for ambulatory human motion analysis. Our sensory fusion method is based on a Kalman filter technique and combines the outputs of textile electrogoniometers and accelerometers without making any assumptions regarding the initial accelerometer position and orientation. We used our technique to measure the flexion-extension angle of the knee in different motion tasks (monopodalic flexions and walking at different velocities). The estimation technique was benchmarked against a commercial measurement system based on inertial measurement units and performed reliably for all of the various tasks (mean and standard deviation of the root mean square error of 1:96 and 0:96, respectively). In addition, the method showed a notable improvement in angular estimation compared to the estimation derived by the textile goniometer and accelerometer considered separately. In future work, we will extend this method to more complex and multi-degree of freedom joints.